2024-09-21T00:36:48.918 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T00:36:48.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:36:49.045 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913343' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcqTiZcTQsGvIXL19Q7EYXa4qoWFqgS4A1hmZtvvwgnHeFq42UAzMk1CjQCvZML7sTCSFB7Y7F/qvGlpTsVuv8= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPWA4jExyL7Z13O5QFA/96TWqp1OqS8msRZQuLwjKU6R0jEgwZ5NGNqxETDfBh4lxAwZHsPq4FDO8kWqit92ARI= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-21T00:36:49.045 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T00:36:49.046 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T00:36:49.046 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T00:36:49.047 INFO:teuthology.task.internal:Checking packages... 2024-09-21T00:36:49.069 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T00:36:49.070 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:36:49.070 INFO:teuthology.packaging:ref: None 2024-09-21T00:36:49.070 INFO:teuthology.packaging:tag: None 2024-09-21T00:36:49.070 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:36:49.070 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:36:49.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:36:49.226 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T00:36:49.227 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T00:36:49.234 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T00:36:49.234 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T00:36:49.243 INFO:teuthology.task.internal:Saving configuration 2024-09-21T00:36:49.264 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T00:36:49.271 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T00:36:49.295 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:31:49.372764', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcqTiZcTQsGvIXL19Q7EYXa4qoWFqgS4A1hmZtvvwgnHeFq42UAzMk1CjQCvZML7sTCSFB7Y7F/qvGlpTsVuv8='} 2024-09-21T00:36:49.316 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:31:49.374141', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPWA4jExyL7Z13O5QFA/96TWqp1OqS8msRZQuLwjKU6R0jEgwZ5NGNqxETDfBh4lxAwZHsPq4FDO8kWqit92ARI='} 2024-09-21T00:36:49.316 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T00:36:49.322 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-21T00:36:49.322 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-21T00:36:49.322 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T00:36:49.381 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc8ab1e8160>, signals=[15]) 2024-09-21T00:36:49.381 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T00:36:49.388 INFO:teuthology.task.internal:Opening connections... 2024-09-21T00:36:49.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:36:49.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:36:49.466 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-09-21T00:36:49.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:36:49.540 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T00:36:49.549 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-21T00:36:49.567 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-21T00:36:49.567 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:36:49.625 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-21T00:36:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:36:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:36:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:36:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:36:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:36:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:36:49.627 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-21T00:36:49.645 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-09-21T00:36:49.663 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-09-21T00:36:49.663 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-09-21T00:36:49.720 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:36:49.721 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:36:49.722 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-09-21T00:36:49.745 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T00:36:49.754 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T00:36:49.795 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T00:36:49.795 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:36:49.797 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:36:49.814 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T00:36:49.821 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T00:36:49.821 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:36:49.855 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:36:49.967 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T00:36:50.019 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T00:36:50.033 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T00:36:50.033 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T00:36:50.033 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:36:50.034 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:36:50.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:36:50.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:36:50.051 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-21T00:36:50.051 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-21T00:36:50.108 INFO:teuthology.orchestra.run.smithi187.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:36:50.108 INFO:teuthology.task.kernel:Running kernel on smithi187: 5.14.0-503.el9.x86_64 2024-09-21T00:36:50.108 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum install -y kernel 2024-09-21T00:36:50.109 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:36:50.110 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.14.0-503.el9.x86_64 2024-09-21T00:36:50.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2024-09-21T00:36:53.362 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.3 MB 00:01 2024-09-21T00:36:53.596 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T00:36:55.455 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-21T00:36:57.404 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 20 MB 00:02 2024-09-21T00:36:59.881 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T00:37:01.532 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-21T00:37:01.829 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-21T00:37:02.302 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T00:37:03.230 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 19 kB 00:00 2024-09-21T00:37:03.976 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T00:37:07.642 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-09-21T00:37:09.448 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-21T00:37:09.506 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T00:37:09.507 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T00:37:09.610 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T00:37:09.619 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:37:09.620 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:37:09.620 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:37:09.620 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-21T00:37:09.620 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:37:09.620 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 79 M 2024-09-21T00:37:09.620 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 126 M 2024-09-21T00:37:09.620 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:37:09.843 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 178 kB/s | 36 kB 00:00 2024-09-21T00:37:11.354 INFO:teuthology.orchestra.run.smithi187.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T00:37:11.355 INFO:teuthology.orchestra.run.smithi187.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T00:37:11.460 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:37:11.464 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:37:11.464 INFO:teuthology.orchestra.run.smithi187.stdout: Package Architecture Version Repository Size 2024-09-21T00:37:11.464 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:37:11.464 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout:Install 4 Packages 2024-09-21T00:37:11.465 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:37:11.466 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 79 M 2024-09-21T00:37:11.466 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 126 M 2024-09-21T00:37:11.466 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:37:11.841 INFO:teuthology.orchestra.run.smithi187.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 294 kB/s | 36 kB 00:00 2024-09-21T00:37:14.383 INFO:teuthology.orchestra.run.smithi187.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.9 MB/s | 16 MB 00:02 2024-09-21T00:37:14.885 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-09-21T00:37:16.058 INFO:teuthology.orchestra.run.smithi187.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.8 MB/s | 29 MB 00:04 2024-09-21T00:37:16.608 INFO:teuthology.orchestra.run.smithi187.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 7.1 MB/s | 35 MB 00:04 2024-09-21T00:37:16.608 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:37:16.608 INFO:teuthology.orchestra.run.smithi187.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-21T00:37:17.292 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:37:17.651 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:37:17.652 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:37:18.623 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:37:18.623 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:37:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.0 MB/s | 29 MB 00:09 2024-09-21T00:37:21.071 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:37:21.710 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:37:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:37:22.468 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.7 MB/s | 35 MB 00:12 2024-09-21T00:37:22.468 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:37:22.468 INFO:teuthology.orchestra.run.smithi112.stdout:Total 6.1 MB/s | 79 MB 00:12 2024-09-21T00:37:23.153 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:37:23.513 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:37:23.513 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:37:24.470 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:37:24.470 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:37:24.527 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:37:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:37:26.877 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:37:27.510 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:37:27.594 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:37:29.488 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:37:29.601 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:37:30.473 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:37:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:35.345 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:37:35.382 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:37:40.235 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:12.607 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:12.646 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:38:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:38:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:38:13.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:13.786 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:38:13.787 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:38:13.787 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T00:38:13.787 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T00:38:13.787 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T00:38:13.787 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T00:38:13.787 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:38:13.787 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:38:14.116 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:38:14.207 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:38:14.208 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:38:14.208 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T00:38:14.208 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T00:38:14.208 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T00:38:14.208 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-21T00:38:14.208 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T00:38:14.209 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:38:14.268 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:38:14.268 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:38:14.268 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.06 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 82.el9 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Group : Unspecified 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 8274670 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:38:14.308 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : builder@centos.org 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : CentOS 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:38:14.309 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:38:14.310 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:38:14.310 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 5.14.0-508.el9.x86_64 2024-09-21T00:38:14.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:38:14.982 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-09-21T00:38:16.361 INFO:teuthology.orchestra.run.smithi187.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:38:16.392 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-09-21T00:38:16.394 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-21T00:38:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.IJ6fZmb2aW 2024-09-21T00:38:16.410 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IJ6fZmb2aW 2024-09-21T00:38:16.479 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.IJ6fZmb2aW 2024-09-21T00:38:16.621 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.IJ6fZmb2aW is 6KB 2024-09-21T00:38:16.676 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.IJ6fZmb2aW 2024-09-21T00:38:16.691 DEBUG:teuthology.orchestra.run.smithi187:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:38:16.753 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:38:16.753 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:38:16.753 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:38:16.753 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T00:38:16.755 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T00:38:16.904 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-09-21T00:38:18.074 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:18.120 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:38:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:38:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:38:19.311 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:38:19.312 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:38:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:38:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T00:38:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T00:38:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T00:38:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T00:38:19.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:38:19.314 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:38:19.660 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:38:19.750 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:38:19.750 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:38:19.750 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T00:38:19.750 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T00:38:19.751 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T00:38:19.751 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-21T00:38:19.751 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T00:38:19.751 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:38:19.809 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:38:19.810 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:38:19.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.06 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 82.el9 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Group : Unspecified 2024-09-21T00:38:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 8274670 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : builder@centos.org 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:38:19.842 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:38:19.843 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-09-21T00:38:19.843 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:38:19.843 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:38:19.843 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:38:19.843 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 5.14.0-508.el9.x86_64 2024-09-21T00:38:19.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:38:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-21T00:38:21.815 INFO:teuthology.orchestra.run.smithi112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:38:21.840 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-21T00:38:21.842 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-21T00:38:21.858 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.orPkJUn4jN 2024-09-21T00:38:21.858 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.orPkJUn4jN 2024-09-21T00:38:21.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.orPkJUn4jN 2024-09-21T00:38:22.068 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.orPkJUn4jN is 6KB 2024-09-21T00:38:22.116 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.orPkJUn4jN 2024-09-21T00:38:22.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:38:22.193 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:38:22.193 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:38:22.193 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:38:22.193 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T00:38:22.195 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T00:38:22.350 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-21T00:38:46.914 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-21T00:38:46.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T00:38:46.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:38:52.359 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-21T00:38:52.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T00:38:52.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:39:05.455 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-21T00:39:10.831 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-21T00:39:14.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T00:39:14.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:39:17.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-21T00:39:19.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T00:39:19.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:39:29.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T00:39:29.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:39:47.951 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-21T00:40:02.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T00:40:02.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:40:03.367 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-21T00:40:03.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T00:40:03.962 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T00:40:03.962 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-21T00:40:04.008 INFO:teuthology.orchestra.run.smithi187.stdout:5.14.0-508.el9.x86_64 2024-09-21T00:40:04.008 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T00:40:04.008 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:40:04.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:40:05.009 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-21T00:40:05.009 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T00:40:05.371 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2024-09-21T00:40:05.398 DEBUG:teuthology.parallel:result is None 2024-09-21T00:40:19.837 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T00:40:31.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T00:40:31.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:40:32.228 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-21T00:40:32.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T00:40:32.568 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T00:40:32.568 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-21T00:40:32.584 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-508.el9.x86_64 2024-09-21T00:40:32.584 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T00:40:32.584 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:40:32.584 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:40:33.585 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-21T00:40:33.586 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T00:40:33.645 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-21T00:40:33.670 DEBUG:teuthology.parallel:result is None 2024-09-21T00:40:33.670 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T00:40:33.679 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T00:40:33.679 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:40:33.682 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:40:33.700 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T00:40:33.708 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T00:40:33.721 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T00:40:33.721 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:40:33.740 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:40:33.774 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T00:40:33.780 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T00:40:33.781 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:40:33.806 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:40:33.841 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:40:33.849 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:40:33.852 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:40:33.861 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:40:33.863 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T00:40:33.871 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T00:40:33.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:40:33.897 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:40:33.930 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T00:40:33.941 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T00:40:33.941 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:40:33.964 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:40:33.987 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:40:34.061 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:40:34.112 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:40:34.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:40:34.235 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:40:34.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:40:34.300 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:40:34.343 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:40:34.399 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:40:34.483 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:40:34.524 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:40:34.524 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:40:34.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-21T00:40:34.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-09-21T00:40:34.641 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:40:34.676 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:40:35.049 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T00:40:35.057 INFO:teuthology.task.internal:Starting timer... 2024-09-21T00:40:35.102 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T00:40:35.115 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T00:40:35.128 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T00:40:35.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-21T00:40:35.167 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-21T00:40:35.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2024-09-21T00:40:35.225 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2024-09-21T00:40:35.227 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T00:40:35.227 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-21T00:40:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-21T00:40:35.246 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2024-09-21T00:40:35.266 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2024-09-21T00:40:35.266 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2024-09-21T00:40:35.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:40:35.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:40:35.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:40:35.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:40:35.342 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T00:40:35.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:40:35.390 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:40:35.430 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T00:40:35.443 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T00:40:35.445 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T00:40:35.555 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T00:40:35.565 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T00:40:35.566 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T00:44:17.071 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-09-21T00:44:17.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T00:44:17.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:44:17.191 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-21T00:44:17.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T00:44:17.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T00:44:17.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:44:17.351 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-21T00:44:17.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T00:44:17.434 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T00:44:17.451 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T00:44:17.452 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:44:17.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:44:17.454 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:44:17.455 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:44:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:44:17.498 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:44:17.503 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:44:17.517 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:44:17.523 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-21T00:44:17.534 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-21T00:44:17.541 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2024-09-21T00:44:17.548 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:44:17.553 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2024-09-21T00:44:17.562 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:44:17.567 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:44:17.580 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:44:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:44:17.629 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:44:17.629 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-21T00:44:17.629 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.629 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.629 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.629 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.639 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:44:17.642 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:44:17.642 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-09-21T00:44:17.642 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.643 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.643 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.643 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:44:17.643 INFO:teuthology.run_tasks:Running task install... 2024-09-21T00:44:17.652 DEBUG:teuthology.task.install:project ceph 2024-09-21T00:44:17.652 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T00:44:17.652 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T00:44:17.652 INFO:teuthology.task.install:Using flavor: default 2024-09-21T00:44:17.657 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T00:44:17.657 INFO:teuthology.task.install:extra packages: [] 2024-09-21T00:44:17.657 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:44:17.658 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:44:17.658 INFO:teuthology.packaging:ref: None 2024-09-21T00:44:17.658 INFO:teuthology.packaging:tag: None 2024-09-21T00:44:17.658 INFO:teuthology.packaging:branch: squid 2024-09-21T00:44:17.658 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:44:17.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T00:44:17.660 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:44:17.660 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:44:17.660 INFO:teuthology.packaging:ref: None 2024-09-21T00:44:17.660 INFO:teuthology.packaging:tag: None 2024-09-21T00:44:17.660 INFO:teuthology.packaging:branch: squid 2024-09-21T00:44:17.660 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:44:17.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T00:44:17.859 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T00:44:17.859 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T00:44:17.912 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T00:44:17.912 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T00:44:17.979 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:44:17.979 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:44:17.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:44:18.006 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T00:44:18.006 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:44:18.007 INFO:teuthology.packaging:ref: None 2024-09-21T00:44:18.007 INFO:teuthology.packaging:tag: None 2024-09-21T00:44:18.007 INFO:teuthology.packaging:branch: squid 2024-09-21T00:44:18.007 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:44:18.007 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:44:18.019 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:44:18.019 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:44:18.019 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:44:18.046 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T00:44:18.047 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:44:18.047 INFO:teuthology.packaging:ref: None 2024-09-21T00:44:18.047 INFO:teuthology.packaging:tag: None 2024-09-21T00:44:18.047 INFO:teuthology.packaging:branch: squid 2024-09-21T00:44:18.047 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:44:18.047 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:44:18.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:44:18.114 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:44:18.149 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:44:18.189 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:44:18.213 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-21T00:44:18.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-21T00:44:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2024-09-21T00:44:18.254 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2024-09-21T00:44:18.446 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-21T00:44:18.473 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw 2024-09-21T00:44:18.487 INFO:teuthology.orchestra.run.smithi187.stdout:45 files removed 2024-09-21T00:44:18.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw 2024-09-21T00:44:19.053 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 281 kB/s | 84 kB 00:00 2024-09-21T00:44:19.094 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 286 kB/s | 84 kB 00:00 2024-09-21T00:44:19.378 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T00:44:19.453 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-09-21T00:44:19.654 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T00:44:19.729 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T00:44:20.079 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.3 MB 00:00 2024-09-21T00:44:20.287 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T00:44:22.039 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-21T00:44:22.072 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T00:44:26.273 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T00:44:26.415 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T00:44:27.857 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-21T00:44:27.874 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-21T00:44:28.844 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-21T00:44:29.279 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-21T00:44:34.267 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T00:44:34.685 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-21T00:44:36.502 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:44:36.517 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:44:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:44:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:44:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout:Installing weak dependencies: 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout:Install 30 Packages 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 2 Packages 2024-09-21T00:44:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:44:36.522 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 60 M 2024-09-21T00:44:36.522 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:44:37.069 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T00:44:37.077 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T00:44:37.078 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-09-21T00:44:37.079 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout:Install 30 Packages 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 2 Packages 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 60 M 2024-09-21T00:44:37.080 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:44:37.377 INFO:teuthology.orchestra.run.smithi187.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 9.6 MB/s | 5.4 MB 00:00 2024-09-21T00:44:37.436 INFO:teuthology.orchestra.run.smithi187.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 432 kB/s | 25 kB 00:00 2024-09-21T00:44:37.570 INFO:teuthology.orchestra.run.smithi187.stdout:(3/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 14 MB/s | 11 MB 00:00 2024-09-21T00:44:37.612 INFO:teuthology.orchestra.run.smithi187.stdout:(4/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 4.2 MB/s | 751 kB 00:00 2024-09-21T00:44:37.637 INFO:teuthology.orchestra.run.smithi187.stdout:(5/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 7.4 MB/s | 507 kB 00:00 2024-09-21T00:44:37.703 INFO:teuthology.orchestra.run.smithi187.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 679 kB/s | 45 kB 00:00 2024-09-21T00:44:37.804 INFO:teuthology.orchestra.run.smithi187.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 1.3 MB/s | 136 kB 00:00 2024-09-21T00:44:37.879 INFO:teuthology.orchestra.run.smithi187.stdout:(8/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 20 MB/s | 5.3 MB 00:00 2024-09-21T00:44:37.904 INFO:teuthology.orchestra.run.smithi187.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 1.6 MB/s | 162 kB 00:00 2024-09-21T00:44:37.938 INFO:teuthology.orchestra.run.smithi187.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 5.4 MB/s | 321 kB 00:00 2024-09-21T00:44:37.963 INFO:teuthology.orchestra.run.smithi187.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-21T00:44:37.997 INFO:teuthology.orchestra.run.smithi187.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-21T00:44:38.197 INFO:teuthology.orchestra.run.smithi187.stdout:(13/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 15 MB/s | 21 MB 00:01 2024-09-21T00:44:38.314 INFO:teuthology.orchestra.run.smithi187.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 305 kB/s | 107 kB 00:00 2024-09-21T00:44:38.339 INFO:teuthology.orchestra.run.smithi187.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-09-21T00:44:38.365 INFO:teuthology.orchestra.run.smithi187.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-09-21T00:44:38.415 INFO:teuthology.orchestra.run.smithi187.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-21T00:44:38.440 INFO:teuthology.orchestra.run.smithi187.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 561 kB/s | 42 kB 00:00 2024-09-21T00:44:38.491 INFO:teuthology.orchestra.run.smithi187.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-21T00:44:38.516 INFO:teuthology.orchestra.run.smithi187.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-09-21T00:44:38.541 INFO:teuthology.orchestra.run.smithi187.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-21T00:44:38.583 INFO:teuthology.orchestra.run.smithi187.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-09-21T00:44:38.625 INFO:teuthology.orchestra.run.smithi187.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T00:44:38.628 INFO:teuthology.orchestra.run.smithi112.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 4.8 MB/s | 5.4 MB 00:01 2024-09-21T00:44:38.650 INFO:teuthology.orchestra.run.smithi187.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-21T00:44:38.676 INFO:teuthology.orchestra.run.smithi187.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 288 kB/s | 26 kB 00:00 2024-09-21T00:44:38.678 INFO:teuthology.orchestra.run.smithi112.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 505 kB/s | 25 kB 00:00 2024-09-21T00:44:38.701 INFO:teuthology.orchestra.run.smithi187.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T00:44:38.735 INFO:teuthology.orchestra.run.smithi187.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T00:44:38.778 INFO:teuthology.orchestra.run.smithi112.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 7.4 MB/s | 751 kB 00:00 2024-09-21T00:44:38.801 INFO:teuthology.orchestra.run.smithi187.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-21T00:44:38.846 INFO:teuthology.orchestra.run.smithi187.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T00:44:38.928 INFO:teuthology.orchestra.run.smithi112.stdout:(4/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 7.4 MB/s | 11 MB 00:01 2024-09-21T00:44:38.929 INFO:teuthology.orchestra.run.smithi187.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T00:44:38.970 INFO:teuthology.orchestra.run.smithi112.stdout:(5/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 2.6 MB/s | 507 kB 00:00 2024-09-21T00:44:39.071 INFO:teuthology.orchestra.run.smithi112.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 452 kB/s | 45 kB 00:00 2024-09-21T00:44:39.071 INFO:teuthology.orchestra.run.smithi187.stdout:(31/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 14 MB/s | 3.2 MB 00:00 2024-09-21T00:44:39.138 INFO:teuthology.orchestra.run.smithi112.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 2.0 MB/s | 136 kB 00:00 2024-09-21T00:44:39.138 INFO:teuthology.orchestra.run.smithi187.stdout:(32/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 10 MB/s | 3.4 MB 00:00 2024-09-21T00:44:39.143 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:44:39.143 INFO:teuthology.orchestra.run.smithi187.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-21T00:44:39.204 INFO:teuthology.orchestra.run.smithi112.stdout:(8/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 2.4 MB/s | 162 kB 00:00 2024-09-21T00:44:39.248 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:44:39.284 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:44:39.284 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:44:39.288 INFO:teuthology.orchestra.run.smithi112.stdout:(9/32): python3-rados-19.1.1-373.g4e45e6b4.el9. 3.7 MB/s | 321 kB 00:00 2024-09-21T00:44:39.364 INFO:teuthology.orchestra.run.smithi112.stdout:(10/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_6 12 MB/s | 5.3 MB 00:00 2024-09-21T00:44:39.389 INFO:teuthology.orchestra.run.smithi112.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 2.9 MB/s | 300 kB 00:00 2024-09-21T00:44:39.414 INFO:teuthology.orchestra.run.smithi112.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T00:44:39.631 INFO:teuthology.orchestra.run.smithi112.stdout:(13/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 9.9 MB/s | 21 MB 00:02 2024-09-21T00:44:39.731 INFO:teuthology.orchestra.run.smithi112.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 454 kB/s | 45 kB 00:00 2024-09-21T00:44:39.757 INFO:teuthology.orchestra.run.smithi112.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 291 kB/s | 107 kB 00:00 2024-09-21T00:44:39.782 INFO:teuthology.orchestra.run.smithi112.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 436 kB/s | 160 kB 00:00 2024-09-21T00:44:39.882 INFO:teuthology.orchestra.run.smithi112.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-21T00:44:39.907 INFO:teuthology.orchestra.run.smithi112.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 337 kB/s | 42 kB 00:00 2024-09-21T00:44:39.933 INFO:teuthology.orchestra.run.smithi112.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-21T00:44:39.967 INFO:teuthology.orchestra.run.smithi112.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-21T00:44:39.968 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:44:39.968 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:44:39.991 INFO:teuthology.orchestra.run.smithi112.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 428 kB/s | 36 kB 00:00 2024-09-21T00:44:40.017 INFO:teuthology.orchestra.run.smithi112.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-21T00:44:40.084 INFO:teuthology.orchestra.run.smithi112.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-21T00:44:40.109 INFO:teuthology.orchestra.run.smithi112.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T00:44:40.134 INFO:teuthology.orchestra.run.smithi112.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 255 kB/s | 26 kB 00:00 2024-09-21T00:44:40.159 INFO:teuthology.orchestra.run.smithi112.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T00:44:40.193 INFO:teuthology.orchestra.run.smithi112.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T00:44:40.260 INFO:teuthology.orchestra.run.smithi112.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-21T00:44:40.302 INFO:teuthology.orchestra.run.smithi112.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T00:44:40.386 INFO:teuthology.orchestra.run.smithi112.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T00:44:40.528 INFO:teuthology.orchestra.run.smithi112.stdout:(31/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 14 MB/s | 3.2 MB 00:00 2024-09-21T00:44:40.661 INFO:teuthology.orchestra.run.smithi112.stdout:(32/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 8.5 MB/s | 3.4 MB 00:00 2024-09-21T00:44:40.666 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:44:40.667 INFO:teuthology.orchestra.run.smithi112.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-21T00:44:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:44:40.809 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:44:40.809 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:44:41.448 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:44:41.490 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:44:41.491 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:44:41.529 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T00:44:41.559 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T00:44:41.585 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T00:44:41.607 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T00:44:41.628 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T00:44:41.818 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T00:44:41.871 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T00:44:42.218 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T00:44:42.328 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T00:44:42.420 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T00:44:42.507 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T00:44:42.529 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T00:44:42.626 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T00:44:42.663 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T00:44:42.706 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T00:44:42.783 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T00:44:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T00:44:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T00:44:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T00:44:42.977 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:44:43.019 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T00:44:43.056 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T00:44:43.062 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T00:44:43.091 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T00:44:43.108 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T00:44:43.117 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T00:44:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T00:44:43.139 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T00:44:43.163 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T00:44:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T00:44:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T00:44:43.349 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T00:44:43.402 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T00:44:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T00:44:43.571 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T00:44:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T00:44:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T00:44:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T00:44:43.768 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T00:44:43.851 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T00:44:43.943 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T00:44:44.034 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T00:44:44.061 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T00:44:44.126 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T00:44:44.161 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T00:44:44.205 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T00:44:44.247 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T00:44:44.275 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T00:44:44.281 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T00:44:44.305 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T00:44:44.336 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T00:44:44.369 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T00:44:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T00:44:44.414 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T00:44:44.442 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T00:44:44.514 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T00:44:44.546 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T00:44:44.596 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T00:44:44.636 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T00:44:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T00:44:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T00:44:45.019 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T00:44:45.144 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T00:44:45.233 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T00:44:45.265 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T00:44:45.301 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T00:44:45.781 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T00:44:45.813 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T00:44:45.884 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T00:44:45.962 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T00:44:45.999 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T00:44:46.766 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T00:44:46.797 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T00:44:47.370 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T00:44:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T00:44:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T00:44:47.499 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:44:47.499 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:44:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:44:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T00:44:48.237 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T00:44:48.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T00:44:48.858 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T00:44:48.934 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T00:44:49.032 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T00:44:49.032 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:44:49.032 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:44:49.032 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:44:49.082 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T00:44:57.719 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T00:44:57.719 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2024-09-21T00:44:57.719 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2024-09-21T00:44:57.719 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2024-09-21T00:44:57.719 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2024-09-21T00:44:57.719 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2024-09-21T00:44:57.720 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /root 2024-09-21T00:44:57.720 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2024-09-21T00:44:57.720 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:44:58.692 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T00:44:58.717 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T00:44:58.717 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:44:58.717 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:44:58.717 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:44:58.717 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:44:58.717 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:44:58.719 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T00:44:58.803 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T00:44:58.804 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T00:44:59.011 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-21T00:44:59.012 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:44:59.998 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T00:45:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T00:45:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T00:45:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T00:45:00.027 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T00:45:00.027 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:00.027 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:45:00.027 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:00.027 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:45:00.027 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:00.027 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T00:45:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T00:45:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T00:45:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T00:45:00.117 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T00:45:00.117 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:45:01.048 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:01.049 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T00:45:01.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T00:45:01.261 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T00:45:01.262 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T00:45:01.262 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T00:45:01.262 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T00:45:01.262 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T00:45:01.262 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T00:45:01.263 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T00:45:01.263 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T00:45:01.263 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T00:45:01.263 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T00:45:01.263 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T00:45:01.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-test 2024-09-21T00:45:01.971 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:27 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:02.109 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:02.110 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:02.110 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:02.110 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:02.110 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:02.110 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout:Install 4 Packages 2024-09-21T00:45:02.111 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:02.112 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 49 M 2024-09-21T00:45:02.112 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 209 M 2024-09-21T00:45:02.112 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T00:45:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:02.232 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-21T00:45:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:45:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:45:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:45:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:45:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:45:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:45:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:02.235 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:02.366 INFO:teuthology.orchestra.run.smithi187.stdout:(1/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 804 kB/s | 163 kB 00:00 2024-09-21T00:45:02.400 INFO:teuthology.orchestra.run.smithi187.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-21T00:45:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 424 kB/s | 64 kB 00:00 2024-09-21T00:45:02.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-test 2024-09-21T00:45:03.160 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:29 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:03.301 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:03.302 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:03.303 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-21T00:45:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:03.303 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 49 M 2024-09-21T00:45:03.303 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 209 M 2024-09-21T00:45:03.303 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:03.684 INFO:teuthology.orchestra.run.smithi187.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-21T00:45:03.686 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:03.686 INFO:teuthology.orchestra.run.smithi187.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-21T00:45:03.713 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:03.733 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:03.733 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:03.905 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 507 kB/s | 163 kB 00:00 2024-09-21T00:45:04.103 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:04.104 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:04.389 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 377 kB/s | 304 kB 00:00 2024-09-21T00:45:04.514 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 105 kB/s | 64 kB 00:00 2024-09-21T00:45:04.632 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:04.714 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T00:45:04.757 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T00:45:04.785 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T00:45:07.323 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 13 MB/s | 49 MB 00:03 2024-09-21T00:45:07.325 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:07.325 INFO:teuthology.orchestra.run.smithi112.stdout:Total 12 MB/s | 49 MB 00:04 2024-09-21T00:45:07.352 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:45:07.373 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:45:07.373 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:45:07.744 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:45:07.744 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:45:08.272 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:45:08.375 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T00:45:08.421 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T00:45:08.449 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T00:45:09.415 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T00:45:09.500 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T00:45:11.853 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T00:45:11.853 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T00:45:11.853 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T00:45:11.853 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:45:12.143 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:12.144 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:12.427 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph 2024-09-21T00:45:13.011 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:13.066 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T00:45:13.147 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T00:45:13.149 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:13.151 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:13.151 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:13.151 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:45:13.152 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:45:13.153 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:13.154 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi187.stdout:Install 37 Packages 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 30 M 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 108 M 2024-09-21T00:45:13.155 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:13.659 INFO:teuthology.orchestra.run.smithi187.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 28 kB/s | 6.6 kB 00:00 2024-09-21T00:45:14.034 INFO:teuthology.orchestra.run.smithi187.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 2.5 MB/s | 1.5 MB 00:00 2024-09-21T00:45:14.334 INFO:teuthology.orchestra.run.smithi187.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 2.6 MB/s | 2.4 MB 00:00 2024-09-21T00:45:14.427 INFO:teuthology.orchestra.run.smithi187.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.7 MB/s | 249 kB 00:00 2024-09-21T00:45:14.544 INFO:teuthology.orchestra.run.smithi187.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T00:45:14.785 INFO:teuthology.orchestra.run.smithi187.stdout:(6/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 4.2 MB/s | 4.7 MB 00:01 2024-09-21T00:45:14.819 INFO:teuthology.orchestra.run.smithi187.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 4.5 MB/s | 1.2 MB 00:00 2024-09-21T00:45:14.994 INFO:teuthology.orchestra.run.smithi187.stdout:(8/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 18 MB/s | 17 MB 00:00 2024-09-21T00:45:15.028 INFO:teuthology.orchestra.run.smithi187.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 648 kB/s | 135 kB 00:00 2024-09-21T00:45:15.056 INFO:teuthology.orchestra.run.smithi187.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 393 kB/s | 106 kB 00:00 2024-09-21T00:45:15.081 INFO:teuthology.orchestra.run.smithi187.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.9 MB/s | 215 kB 00:00 2024-09-21T00:45:15.123 INFO:teuthology.orchestra.run.smithi187.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-21T00:45:15.157 INFO:teuthology.orchestra.run.smithi187.stdout:(13/37): python3-requests-2.25.1-8.el9.noarch.r 769 kB/s | 125 kB 00:00 2024-09-21T00:45:15.183 INFO:teuthology.orchestra.run.smithi187.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-21T00:45:15.208 INFO:teuthology.orchestra.run.smithi187.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 414 kB/s | 35 kB 00:00 2024-09-21T00:45:15.233 INFO:teuthology.orchestra.run.smithi187.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-21T00:45:15.258 INFO:teuthology.orchestra.run.smithi187.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-21T00:45:15.283 INFO:teuthology.orchestra.run.smithi187.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-21T00:45:15.325 INFO:teuthology.orchestra.run.smithi187.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-21T00:45:15.351 INFO:teuthology.orchestra.run.smithi187.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 7.2 MB/s | 172 kB 00:00 2024-09-21T00:45:15.376 INFO:teuthology.orchestra.run.smithi187.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 471 kB/s | 43 kB 00:00 2024-09-21T00:45:15.401 INFO:teuthology.orchestra.run.smithi187.stdout:(22/37): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-09-21T00:45:15.427 INFO:teuthology.orchestra.run.smithi187.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-09-21T00:45:15.460 INFO:teuthology.orchestra.run.smithi187.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 877 kB/s | 23 kB 00:00 2024-09-21T00:45:15.485 INFO:teuthology.orchestra.run.smithi187.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 843 kB/s | 19 kB 00:00 2024-09-21T00:45:15.511 INFO:teuthology.orchestra.run.smithi187.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-09-21T00:45:15.536 INFO:teuthology.orchestra.run.smithi187.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-21T00:45:15.561 INFO:teuthology.orchestra.run.smithi187.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-21T00:45:15.587 INFO:teuthology.orchestra.run.smithi187.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-21T00:45:15.612 INFO:teuthology.orchestra.run.smithi187.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T00:45:15.637 INFO:teuthology.orchestra.run.smithi187.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-21T00:45:15.662 INFO:teuthology.orchestra.run.smithi187.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-21T00:45:15.687 INFO:teuthology.orchestra.run.smithi187.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 716 kB/s | 36 kB 00:00 2024-09-21T00:45:15.692 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T00:45:15.693 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T00:45:15.693 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T00:45:15.693 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T00:45:15.713 INFO:teuthology.orchestra.run.smithi187.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T00:45:15.738 INFO:teuthology.orchestra.run.smithi187.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-21T00:45:15.763 INFO:teuthology.orchestra.run.smithi187.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:45:15.788 INFO:teuthology.orchestra.run.smithi187.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T00:45:15.793 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:15.793 INFO:teuthology.orchestra.run.smithi187.stdout:Total 11 MB/s | 30 MB 00:02 2024-09-21T00:45:15.949 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:15.989 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:15.990 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T00:45:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:16.018 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:16.018 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:16.019 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:45:16.019 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:45:16.019 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:16.019 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:16.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph 2024-09-21T00:45:16.480 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:16.480 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:16.887 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:42 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:17.021 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:17.023 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:45:17.024 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:45:17.025 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:17.026 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:17.027 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:17.027 INFO:teuthology.orchestra.run.smithi112.stdout:Install 37 Packages 2024-09-21T00:45:17.027 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:17.027 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 30 M 2024-09-21T00:45:17.027 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 108 M 2024-09-21T00:45:17.027 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:17.693 INFO:teuthology.orchestra.run.smithi112.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 48 kB/s | 6.6 kB 00:00 2024-09-21T00:45:17.836 INFO:teuthology.orchestra.run.smithi112.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 5.4 MB/s | 1.5 MB 00:00 2024-09-21T00:45:17.876 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:17.902 INFO:teuthology.orchestra.run.smithi112.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.9 MB/s | 2.4 MB 00:00 2024-09-21T00:45:17.941 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T00:45:17.961 INFO:teuthology.orchestra.run.smithi112.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 4.2 MB/s | 249 kB 00:00 2024-09-21T00:45:17.983 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T00:45:18.018 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T00:45:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T00:45:18.126 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T00:45:18.159 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T00:45:18.253 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T00:45:18.330 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T00:45:18.379 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T00:45:18.411 INFO:teuthology.orchestra.run.smithi112.stdout:(5/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-21T00:45:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T00:45:18.443 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T00:45:18.478 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T00:45:18.486 INFO:teuthology.orchestra.run.smithi112.stdout:(6/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 5.9 MB/s | 4.7 MB 00:00 2024-09-21T00:45:18.511 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T00:45:18.552 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T00:45:18.595 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T00:45:18.629 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T00:45:18.687 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T00:45:18.687 INFO:teuthology.orchestra.run.smithi112.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 349 kB/s | 253 kB 00:00 2024-09-21T00:45:18.719 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T00:45:18.800 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T00:45:18.803 INFO:teuthology.orchestra.run.smithi112.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-21T00:45:18.913 INFO:teuthology.orchestra.run.smithi112.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-09-21T00:45:18.946 INFO:teuthology.orchestra.run.smithi112.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-21T00:45:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T00:45:19.027 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T00:45:19.038 INFO:teuthology.orchestra.run.smithi112.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-09-21T00:45:19.079 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T00:45:19.119 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T00:45:19.138 INFO:teuthology.orchestra.run.smithi112.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 982 kB/s | 188 kB 00:00 2024-09-21T00:45:19.184 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T00:45:19.189 INFO:teuthology.orchestra.run.smithi112.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 696 kB/s | 35 kB 00:00 2024-09-21T00:45:19.222 INFO:teuthology.orchestra.run.smithi112.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 937 kB/s | 172 kB 00:00 2024-09-21T00:45:19.239 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T00:45:19.247 INFO:teuthology.orchestra.run.smithi112.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-21T00:45:19.272 INFO:teuthology.orchestra.run.smithi112.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T00:45:19.298 INFO:teuthology.orchestra.run.smithi112.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-21T00:45:19.340 INFO:teuthology.orchestra.run.smithi112.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-21T00:45:19.365 INFO:teuthology.orchestra.run.smithi112.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-21T00:45:19.390 INFO:teuthology.orchestra.run.smithi112.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 864 kB/s | 43 kB 00:00 2024-09-21T00:45:19.432 INFO:teuthology.orchestra.run.smithi112.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2024-09-21T00:45:19.437 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T00:45:19.474 INFO:teuthology.orchestra.run.smithi112.stdout:(22/37): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-09-21T00:45:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T00:45:19.499 INFO:teuthology.orchestra.run.smithi112.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 164 kB/s | 11 kB 00:00 2024-09-21T00:45:19.533 INFO:teuthology.orchestra.run.smithi112.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 899 kB/s | 23 kB 00:00 2024-09-21T00:45:19.558 INFO:teuthology.orchestra.run.smithi112.stdout:(25/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 891 kB/s | 172 kB 00:00 2024-09-21T00:45:19.559 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T00:45:19.575 INFO:teuthology.orchestra.run.smithi112.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 484 kB/s | 19 kB 00:00 2024-09-21T00:45:19.592 INFO:teuthology.orchestra.run.smithi112.stdout:(27/37): python3-jaraco-classes-3.2.1-5.el9.noa 150 kB/s | 18 kB 00:00 2024-09-21T00:45:19.609 INFO:teuthology.orchestra.run.smithi112.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T00:45:19.634 INFO:teuthology.orchestra.run.smithi112.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 790 kB/s | 46 kB 00:00 2024-09-21T00:45:19.648 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T00:45:19.659 INFO:teuthology.orchestra.run.smithi112.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-21T00:45:19.685 INFO:teuthology.orchestra.run.smithi112.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-21T00:45:19.697 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T00:45:19.702 INFO:teuthology.orchestra.run.smithi112.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-21T00:45:19.736 INFO:teuthology.orchestra.run.smithi112.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-21T00:45:19.761 INFO:teuthology.orchestra.run.smithi112.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T00:45:19.786 INFO:teuthology.orchestra.run.smithi112.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T00:45:19.803 INFO:teuthology.orchestra.run.smithi112.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 479 kB/s | 20 kB 00:00 2024-09-21T00:45:19.822 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T00:45:19.836 INFO:teuthology.orchestra.run.smithi112.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T00:45:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:19.841 INFO:teuthology.orchestra.run.smithi112.stdout:Total 11 MB/s | 30 MB 00:02 2024-09-21T00:45:19.991 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:45:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T00:45:20.024 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T00:45:20.031 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:45:20.031 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:45:20.051 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T00:45:20.051 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:20.051 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:45:20.051 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:20.051 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:20.051 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:20.513 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:45:20.513 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:45:21.491 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T00:45:21.519 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T00:45:21.519 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:21.519 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:45:21.519 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:21.519 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:21.519 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:21.887 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:45:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T00:45:21.956 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T00:45:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T00:45:21.975 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:21.975 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:45:21.975 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:21.975 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:21.989 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T00:45:22.017 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T00:45:22.087 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T00:45:22.148 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T00:45:22.189 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T00:45:22.201 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T00:45:22.225 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T00:45:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:45:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:22.225 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:22.289 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T00:45:22.290 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T00:45:22.383 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T00:45:22.433 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T00:45:22.468 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T00:45:22.498 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T00:45:22.533 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T00:45:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T00:45:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T00:45:22.641 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T00:45:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T00:45:22.724 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T00:45:22.757 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T00:45:22.828 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T00:45:22.966 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T00:45:23.047 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T00:45:23.100 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T00:45:23.139 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T00:45:23.187 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T00:45:23.243 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T00:45:23.436 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T00:45:23.510 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T00:45:23.587 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T00:45:23.675 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T00:45:23.709 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T00:45:23.823 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T00:45:23.988 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T00:45:24.019 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T00:45:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T00:45:24.046 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:24.046 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:45:24.046 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:24.046 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:45:24.046 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T00:45:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T00:45:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T00:45:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:45:25.269 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:45:25.270 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:45:25.271 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:25.272 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T00:45:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T00:45:25.538 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:25.538 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:45:25.538 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:25.539 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:45:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:25.637 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-base 2024-09-21T00:45:25.979 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T00:45:26.003 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T00:45:26.003 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:26.003 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:45:26.003 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:26.003 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:45:26.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:26.216 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:26.230 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T00:45:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T00:45:26.253 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:26.253 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:45:26.253 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:26.253 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:45:26.253 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:26.304 INFO:teuthology.orchestra.run.smithi187.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:45:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T00:45:26.346 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:26.347 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:45:26.347 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:26.418 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install cephadm 2024-09-21T00:45:26.995 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:27.126 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:27.127 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 765 k 2024-09-21T00:45:27.128 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 772 k 2024-09-21T00:45:27.128 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:27.391 INFO:teuthology.orchestra.run.smithi187.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-21T00:45:27.391 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:27.392 INFO:teuthology.orchestra.run.smithi187.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-21T00:45:27.392 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:27.397 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:27.397 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:27.403 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:27.403 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:27.473 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:27.926 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:28.003 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:28.139 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T00:45:28.140 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T00:45:28.141 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T00:45:28.143 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T00:45:28.355 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:28.601 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:28.601 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:28.601 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:28.601 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:28.601 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:28.602 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:28.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T00:45:29.080 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:45:29.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:45:29.082 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:29.083 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:29.434 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:29.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-base 2024-09-21T00:45:29.569 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repo Size 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2024-09-21T00:45:29.570 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:29.571 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 145 k 2024-09-21T00:45:29.571 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 435 k 2024-09-21T00:45:29.571 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:29.763 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 756 kB/s | 145 kB 00:00 2024-09-21T00:45:29.764 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:29.764 INFO:teuthology.orchestra.run.smithi187.stdout:Total 749 kB/s | 145 kB 00:00 2024-09-21T00:45:29.764 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:29.772 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:29.772 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:29.828 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:29.829 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:29.975 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:30.056 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T00:45:30.065 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T00:45:30.081 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:30.081 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:45:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:30.154 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:45:30.196 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:30.197 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:45:30.197 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:30.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install cephadm 2024-09-21T00:45:30.843 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:30.974 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:30.974 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:45:30.974 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:30.974 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 765 k 2024-09-21T00:45:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 772 k 2024-09-21T00:45:30.976 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:31.013 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T00:45:31.013 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:31.013 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:31.014 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:31.014 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:31.253 INFO:teuthology.orchestra.run.smithi112.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.7 MB/s | 765 kB 00:00 2024-09-21T00:45:31.253 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:31.254 INFO:teuthology.orchestra.run.smithi112.stdout:Total 2.7 MB/s | 765 kB 00:00 2024-09-21T00:45:31.254 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:45:31.259 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:45:31.259 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:45:31.265 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:45:31.265 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:45:31.277 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-mgr 2024-09-21T00:45:31.341 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:45:31.815 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:31.874 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:31.907 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:31.964 INFO:teuthology.orchestra.run.smithi187.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:45:32.005 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:32.006 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:45:32.006 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:32.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T00:45:32.264 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:32.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T00:45:32.524 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:32.524 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:32.524 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:32.524 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:32.524 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:32.651 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:32.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T00:45:32.781 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:45:32.782 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout:Install 12 Packages 2024-09-21T00:45:32.783 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:32.784 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 8.7 M 2024-09-21T00:45:32.784 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 105 M 2024-09-21T00:45:32.784 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:33.385 INFO:teuthology.orchestra.run.smithi187.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 214 kB/s | 32 kB 00:00 2024-09-21T00:45:33.410 INFO:teuthology.orchestra.run.smithi187.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 95 kB/s | 16 kB 00:00 2024-09-21T00:45:33.452 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T00:45:33.453 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:33.454 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 145 k 2024-09-21T00:45:33.454 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 435 k 2024-09-21T00:45:33.454 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:33.619 INFO:teuthology.orchestra.run.smithi187.stdout:(3/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 9.3 MB/s | 3.6 MB 00:00 2024-09-21T00:45:33.644 INFO:teuthology.orchestra.run.smithi187.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-21T00:45:33.660 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 705 kB/s | 145 kB 00:00 2024-09-21T00:45:33.661 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:33.661 INFO:teuthology.orchestra.run.smithi112.stdout:Total 699 kB/s | 145 kB 00:00 2024-09-21T00:45:33.661 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:45:33.670 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:45:33.670 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:45:33.694 INFO:teuthology.orchestra.run.smithi187.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T00:45:33.720 INFO:teuthology.orchestra.run.smithi187.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T00:45:33.725 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:45:33.725 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:45:33.787 INFO:teuthology.orchestra.run.smithi187.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 30 MB/s | 2.0 MB 00:00 2024-09-21T00:45:33.820 INFO:teuthology.orchestra.run.smithi187.stdout:(8/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.3 MB/s | 1.0 MB 00:00 2024-09-21T00:45:33.854 INFO:teuthology.orchestra.run.smithi187.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-21T00:45:33.877 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:45:33.888 INFO:teuthology.orchestra.run.smithi187.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 3.1 MB/s | 863 kB 00:00 2024-09-21T00:45:33.913 INFO:teuthology.orchestra.run.smithi187.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 334 kB/s | 31 kB 00:00 2024-09-21T00:45:33.938 INFO:teuthology.orchestra.run.smithi187.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T00:45:33.941 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:33.942 INFO:teuthology.orchestra.run.smithi187.stdout:Total 7.5 MB/s | 8.7 MB 00:01 2024-09-21T00:45:33.953 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T00:45:33.977 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T00:45:33.977 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:45:33.977 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:45:33.978 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:33.988 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:34.004 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:34.004 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:34.223 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:34.224 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:34.745 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:34.822 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T00:45:34.857 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T00:45:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T00:45:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:34.891 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:45:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:34.891 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:34.903 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T00:45:34.942 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T00:45:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T00:45:35.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr 2024-09-21T00:45:35.183 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T00:45:35.277 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T00:45:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T00:45:35.359 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T00:45:35.391 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T00:45:35.706 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:35.798 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:45:35.840 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:35.840 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:45:35.841 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:35.909 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T00:45:36.441 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T00:45:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T00:45:36.477 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:02 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:36.608 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T00:45:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:36.610 INFO:teuthology.orchestra.run.smithi112.stdout:Install 12 Packages 2024-09-21T00:45:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:36.611 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 8.7 M 2024-09-21T00:45:36.611 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 105 M 2024-09-21T00:45:36.611 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:36.905 INFO:teuthology.orchestra.run.smithi112.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 194 kB/s | 32 kB 00:00 2024-09-21T00:45:36.930 INFO:teuthology.orchestra.run.smithi112.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 87 kB/s | 16 kB 00:00 2024-09-21T00:45:37.447 INFO:teuthology.orchestra.run.smithi112.stdout:(3/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 5.0 MB/s | 3.6 MB 00:00 2024-09-21T00:45:37.655 INFO:teuthology.orchestra.run.smithi112.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.1 MB/s | 863 kB 00:00 2024-09-21T00:45:37.706 INFO:teuthology.orchestra.run.smithi112.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T00:45:37.731 INFO:teuthology.orchestra.run.smithi112.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-21T00:45:37.806 INFO:teuthology.orchestra.run.smithi112.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-21T00:45:37.831 INFO:teuthology.orchestra.run.smithi112.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-21T00:45:37.857 INFO:teuthology.orchestra.run.smithi112.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T00:45:37.882 INFO:teuthology.orchestra.run.smithi112.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T00:45:37.901 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T00:45:37.902 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T00:45:37.902 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T00:45:37.902 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T00:45:37.941 INFO:teuthology.orchestra.run.smithi112.stdout:(11/12): python3-protobuf-3.14.0-13.el9.noarch. 266 kB/s | 269 kB 00:01 2024-09-21T00:45:38.211 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:45:38.213 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:45:38.213 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:38.213 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:38.241 INFO:teuthology.orchestra.run.smithi112.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 773 kB/s | 1.0 MB 00:01 2024-09-21T00:45:38.245 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:38.245 INFO:teuthology.orchestra.run.smithi112.stdout:Total 5.3 MB/s | 8.7 MB 00:01 2024-09-21T00:45:38.295 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:45:38.313 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:45:38.313 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:45:38.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T00:45:38.524 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:45:38.524 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:45:39.048 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:05 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:39.049 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:45:39.158 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T00:45:39.181 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:39.182 INFO:teuthology.orchestra.run.smithi187.stdout:====================================================================================== 2024-09-21T00:45:39.182 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout:====================================================================================== 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:45:39.183 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:45:39.184 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:45:39.184 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:39.184 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:39.184 INFO:teuthology.orchestra.run.smithi187.stdout:====================================================================================== 2024-09-21T00:45:39.184 INFO:teuthology.orchestra.run.smithi187.stdout:Install 12 Packages 2024-09-21T00:45:39.184 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:39.184 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 38 M 2024-09-21T00:45:39.185 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 212 M 2024-09-21T00:45:39.185 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:39.193 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T00:45:39.239 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T00:45:39.279 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T00:45:39.394 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T00:45:39.529 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T00:45:39.596 INFO:teuthology.orchestra.run.smithi187.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-21T00:45:39.622 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T00:45:39.662 INFO:teuthology.orchestra.run.smithi187.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-21T00:45:39.674 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T00:45:39.688 INFO:teuthology.orchestra.run.smithi187.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 358 kB/s | 33 kB 00:00 2024-09-21T00:45:39.723 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T00:45:39.730 INFO:teuthology.orchestra.run.smithi187.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 435 kB/s | 18 kB 00:00 2024-09-21T00:45:39.751 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T00:45:39.780 INFO:teuthology.orchestra.run.smithi187.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-21T00:45:39.913 INFO:teuthology.orchestra.run.smithi187.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-21T00:45:39.964 INFO:teuthology.orchestra.run.smithi187.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-21T00:45:40.098 INFO:teuthology.orchestra.run.smithi187.stdout:(8/12): ceph-mgr-diskprediction-local-19.1.1-37 12 MB/s | 7.4 MB 00:00 2024-09-21T00:45:40.173 INFO:teuthology.orchestra.run.smithi187.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-21T00:45:40.240 INFO:teuthology.orchestra.run.smithi187.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 11 MB/s | 4.9 MB 00:00 2024-09-21T00:45:40.348 INFO:teuthology.orchestra.run.smithi187.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.0 MB/s | 250 kB 00:00 2024-09-21T00:45:40.548 INFO:teuthology.orchestra.run.smithi187.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-09-21T00:45:40.549 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:40.550 INFO:teuthology.orchestra.run.smithi187.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-21T00:45:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T00:45:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T00:45:40.904 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:40.930 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:40.930 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:41.355 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:41.355 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:42.168 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:42.202 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T00:45:42.202 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T00:45:42.203 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T00:45:42.238 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T00:45:42.280 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T00:45:42.379 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T00:45:42.422 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T00:45:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T00:45:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:42.546 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:45:42.546 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:42.547 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:42.616 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T00:45:42.646 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T00:45:42.723 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T00:45:42.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T00:45:43.372 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:09 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:43.379 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T00:45:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T00:45:43.514 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:43.515 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:45:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout:Install 12 Packages 2024-09-21T00:45:43.517 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:43.518 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 38 M 2024-09-21T00:45:43.518 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 212 M 2024-09-21T00:45:43.518 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:43.791 INFO:teuthology.orchestra.run.smithi112.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 958 kB/s | 191 kB 00:00 2024-09-21T00:45:43.857 INFO:teuthology.orchestra.run.smithi112.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-21T00:45:43.883 INFO:teuthology.orchestra.run.smithi112.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-21T00:45:43.933 INFO:teuthology.orchestra.run.smithi112.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-21T00:45:43.983 INFO:teuthology.orchestra.run.smithi112.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-21T00:45:44.067 INFO:teuthology.orchestra.run.smithi112.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-09-21T00:45:44.125 INFO:teuthology.orchestra.run.smithi112.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T00:45:44.343 INFO:teuthology.orchestra.run.smithi112.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-21T00:45:44.409 INFO:teuthology.orchestra.run.smithi112.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-21T00:45:44.435 INFO:teuthology.orchestra.run.smithi112.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-21T00:45:44.733 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T00:45:44.960 INFO:teuthology.orchestra.run.smithi112.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-21T00:45:45.302 INFO:teuthology.orchestra.run.smithi112.stdout:(12/12): ceph-mgr-diskprediction-local-19.1.1-3 4.3 MB/s | 7.4 MB 00:01 2024-09-21T00:45:45.303 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:45.303 INFO:teuthology.orchestra.run.smithi112.stdout:Total 21 MB/s | 38 MB 00:01 2024-09-21T00:45:45.649 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:45:45.675 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:45:45.675 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:45:45.767 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T00:45:45.796 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T00:45:46.109 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:45:46.109 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:45:46.864 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:45:46.936 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T00:45:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T00:45:47.073 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T00:45:47.109 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T00:45:47.293 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T00:45:47.325 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T00:45:47.401 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T00:45:48.051 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T00:45:48.162 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T00:45:48.561 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T00:45:48.562 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T00:45:48.965 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:45:48.966 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:48.967 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:48.967 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:45:48.967 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:48.967 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:49.368 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-mgr-rook 2024-09-21T00:45:49.390 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T00:45:49.955 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:15 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:50.087 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:45:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout:Install 13 Packages 2024-09-21T00:45:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:50.090 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 2.2 M 2024-09-21T00:45:50.090 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 26 M 2024-09-21T00:45:50.090 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T00:45:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T00:45:50.563 INFO:teuthology.orchestra.run.smithi187.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 223 kB/s | 26 kB 00:00 2024-09-21T00:45:50.588 INFO:teuthology.orchestra.run.smithi187.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 137 kB/s | 19 kB 00:00 2024-09-21T00:45:50.689 INFO:teuthology.orchestra.run.smithi187.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-21T00:45:50.714 INFO:teuthology.orchestra.run.smithi187.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-21T00:45:50.781 INFO:teuthology.orchestra.run.smithi187.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.0 MB/s | 279 kB 00:00 2024-09-21T00:45:50.798 INFO:teuthology.orchestra.run.smithi187.stdout:(6/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 141 kB/s | 49 kB 00:00 2024-09-21T00:45:50.823 INFO:teuthology.orchestra.run.smithi187.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 493 kB/s | 54 kB 00:00 2024-09-21T00:45:50.865 INFO:teuthology.orchestra.run.smithi187.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 384 kB/s | 32 kB 00:00 2024-09-21T00:45:50.882 INFO:teuthology.orchestra.run.smithi187.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 169 kB/s | 14 kB 00:00 2024-09-21T00:45:50.899 INFO:teuthology.orchestra.run.smithi187.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T00:45:50.924 INFO:teuthology.orchestra.run.smithi187.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.5 MB/s | 220 kB 00:00 2024-09-21T00:45:50.949 INFO:teuthology.orchestra.run.smithi187.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-21T00:45:50.983 INFO:teuthology.orchestra.run.smithi187.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.8 MB/s | 1.0 MB 00:00 2024-09-21T00:45:50.986 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:50.987 INFO:teuthology.orchestra.run.smithi187.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-21T00:45:51.050 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:51.065 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:51.065 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:51.157 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:51.157 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:51.672 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:51.848 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T00:45:51.909 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T00:45:51.965 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T00:45:52.002 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T00:45:52.043 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T00:45:52.146 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T00:45:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T00:45:52.304 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T00:45:53.023 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T00:45:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T00:45:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T00:45:53.118 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T00:45:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T00:45:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T00:45:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T00:45:53.119 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T00:45:53.157 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T00:45:53.187 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T00:45:53.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:53.540 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:45:53.541 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:45:53.541 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:53.541 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:53.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-rook 2024-09-21T00:45:53.980 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T00:45:53.981 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T00:45:54.309 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T00:45:54.309 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:54.309 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:54.309 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:54.309 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:45:54.309 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:45:54.309 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:54.310 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:54.495 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:20 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:54.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T00:45:54.627 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:54.628 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:54.628 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:45:54.628 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:54.628 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:54.628 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T00:45:54.628 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:54.629 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:54.630 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:54.630 INFO:teuthology.orchestra.run.smithi112.stdout:Install 13 Packages 2024-09-21T00:45:54.630 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:54.630 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 2.2 M 2024-09-21T00:45:54.630 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 26 M 2024-09-21T00:45:54.630 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:55.031 INFO:teuthology.orchestra.run.smithi112.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 209 kB/s | 19 kB 00:00 2024-09-21T00:45:55.056 INFO:teuthology.orchestra.run.smithi112.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 219 kB/s | 26 kB 00:00 2024-09-21T00:45:55.115 INFO:teuthology.orchestra.run.smithi112.stdout:(3/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 280 kB/s | 49 kB 00:00 2024-09-21T00:45:55.141 INFO:teuthology.orchestra.run.smithi112.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-21T00:45:55.159 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:55.166 INFO:teuthology.orchestra.run.smithi112.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-21T00:45:55.191 INFO:teuthology.orchestra.run.smithi112.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T00:45:55.233 INFO:teuthology.orchestra.run.smithi112.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-21T00:45:55.258 INFO:teuthology.orchestra.run.smithi112.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-21T00:45:55.283 INFO:teuthology.orchestra.run.smithi112.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-21T00:45:55.293 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:55.293 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:45:55.294 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:45:55.295 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:55.295 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:55.295 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:55.295 INFO:teuthology.orchestra.run.smithi187.stdout:Install 6 Packages 2024-09-21T00:45:55.295 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:55.295 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 7.0 M 2024-09-21T00:45:55.295 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 33 M 2024-09-21T00:45:55.296 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:55.317 INFO:teuthology.orchestra.run.smithi112.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-21T00:45:55.342 INFO:teuthology.orchestra.run.smithi112.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-21T00:45:55.359 INFO:teuthology.orchestra.run.smithi112.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-09-21T00:45:55.393 INFO:teuthology.orchestra.run.smithi112.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-21T00:45:55.396 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:55.396 INFO:teuthology.orchestra.run.smithi112.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-21T00:45:55.460 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:45:55.475 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:45:55.475 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:45:55.566 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:45:55.566 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:45:55.776 INFO:teuthology.orchestra.run.smithi187.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-21T00:45:55.827 INFO:teuthology.orchestra.run.smithi187.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-21T00:45:55.852 INFO:teuthology.orchestra.run.smithi187.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-21T00:45:55.877 INFO:teuthology.orchestra.run.smithi187.stdout:(4/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 605 kB/s | 146 kB 00:00 2024-09-21T00:45:55.903 INFO:teuthology.orchestra.run.smithi187.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-21T00:45:55.978 INFO:teuthology.orchestra.run.smithi187.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-21T00:45:55.980 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:55.980 INFO:teuthology.orchestra.run.smithi187.stdout:Total 10 MB/s | 7.0 MB 00:00 2024-09-21T00:45:56.050 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:56.061 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:56.061 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:56.082 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:45:56.160 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:56.162 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:45:56.248 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T00:45:56.319 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T00:45:56.374 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T00:45:56.411 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T00:45:56.453 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T00:45:56.470 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:45:56.554 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T00:45:56.655 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T00:45:56.656 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T00:45:56.713 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T00:45:56.730 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T00:45:57.248 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T00:45:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T00:45:57.406 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T00:45:57.433 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T00:45:57.452 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T00:45:57.510 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T00:45:57.543 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T00:45:57.592 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T00:45:57.622 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T00:45:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T00:45:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T00:45:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T00:45:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T00:45:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T00:45:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T00:45:58.490 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:58.491 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:45:58.735 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-fuse 2024-09-21T00:45:58.811 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T00:45:58.811 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:58.811 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:45:58.811 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:45:58.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:45:58.811 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:58.812 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:45:59.083 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T00:45:59.313 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:59.446 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:45:59.447 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:59.448 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:45:59.448 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:45:59.448 INFO:teuthology.orchestra.run.smithi187.stdout:Install 2 Packages 2024-09-21T00:45:59.448 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:45:59.448 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 976 k 2024-09-21T00:45:59.448 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 2.9 M 2024-09-21T00:45:59.448 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:45:59.646 INFO:teuthology.orchestra.run.smithi187.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 884 kB/s | 80 kB 00:00 2024-09-21T00:45:59.667 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:45:59.800 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:45:59.800 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:59.800 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:45:59.800 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:45:59.801 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:45:59.802 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:59.802 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:45:59.802 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:45:59.802 INFO:teuthology.orchestra.run.smithi112.stdout:Install 6 Packages 2024-09-21T00:45:59.802 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:45:59.802 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 7.0 M 2024-09-21T00:45:59.802 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 33 M 2024-09-21T00:45:59.803 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:45:59.830 INFO:teuthology.orchestra.run.smithi187.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-21T00:45:59.831 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:45:59.831 INFO:teuthology.orchestra.run.smithi187.stdout:Total 2.5 MB/s | 976 kB 00:00 2024-09-21T00:45:59.843 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:45:59.865 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:45:59.865 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:45:59.946 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:45:59.947 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:46:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:46:00.153 INFO:teuthology.orchestra.run.smithi112.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-21T00:46:00.178 INFO:teuthology.orchestra.run.smithi112.stdout:(2/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 602 kB/s | 146 kB 00:00 2024-09-21T00:46:00.228 INFO:teuthology.orchestra.run.smithi112.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-21T00:46:00.254 INFO:teuthology.orchestra.run.smithi112.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 765 kB/s | 58 kB 00:00 2024-09-21T00:46:00.279 INFO:teuthology.orchestra.run.smithi112.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-21T00:46:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T00:46:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T00:46:01.054 INFO:teuthology.orchestra.run.smithi112.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-09-21T00:46:01.056 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:01.057 INFO:teuthology.orchestra.run.smithi112.stdout:Total 5.6 MB/s | 7.0 MB 00:01 2024-09-21T00:46:01.070 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T00:46:01.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T00:46:01.128 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:46:01.140 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:46:01.140 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:46:01.239 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:46:01.240 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:46:01.340 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T00:46:01.341 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:01.341 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:46:01.341 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T00:46:01.341 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:01.341 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:01.573 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:46:01.646 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install librados-devel 2024-09-21T00:46:01.744 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T00:46:01.789 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T00:46:02.250 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T00:46:02.384 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:02.384 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repo Size 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 127 k 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 456 k 2024-09-21T00:46:02.385 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:46:02.391 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T00:46:02.456 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T00:46:02.485 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T00:46:02.601 INFO:teuthology.orchestra.run.smithi187.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 588 kB/s | 127 kB 00:00 2024-09-21T00:46:02.601 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:02.602 INFO:teuthology.orchestra.run.smithi187.stdout:Total 583 kB/s | 127 kB 00:00 2024-09-21T00:46:02.602 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:46:02.607 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:46:02.607 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:46:02.670 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:46:02.670 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:46:02.820 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:46:02.923 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T00:46:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T00:46:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T00:46:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T00:46:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T00:46:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T00:46:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:46:03.510 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:46:03.511 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:03.511 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:03.641 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:03.642 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:03.642 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:46:03.642 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:03.642 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:03.642 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:03.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-fuse 2024-09-21T00:46:03.901 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install libcephfs2 2024-09-21T00:46:04.331 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:04.463 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:04.463 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:04.463 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T00:46:04.463 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout:Install 2 Packages 2024-09-21T00:46:04.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:04.465 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 976 k 2024-09-21T00:46:04.465 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 2.9 M 2024-09-21T00:46:04.465 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:46:04.481 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:04.569 INFO:teuthology.orchestra.run.smithi187.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:04.613 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:04.614 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:46:04.614 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:04.697 INFO:teuthology.orchestra.run.smithi112.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-21T00:46:04.715 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install libcephfs-devel 2024-09-21T00:46:04.839 INFO:teuthology.orchestra.run.smithi112.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-21T00:46:04.839 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:04.840 INFO:teuthology.orchestra.run.smithi112.stdout:Total 2.5 MB/s | 976 kB 00:00 2024-09-21T00:46:04.851 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:46:04.873 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:46:04.873 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:46:04.953 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:46:04.953 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:46:05.140 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:46:05.274 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T00:46:05.298 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:05.355 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T00:46:05.432 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repo Size 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:46:05.433 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:05.434 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2024-09-21T00:46:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:05.434 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 32 k 2024-09-21T00:46:05.434 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 142 k 2024-09-21T00:46:05.434 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:46:05.579 INFO:teuthology.orchestra.run.smithi187.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 218 kB/s | 32 kB 00:00 2024-09-21T00:46:05.580 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:05.580 INFO:teuthology.orchestra.run.smithi187.stdout:Total 216 kB/s | 32 kB 00:00 2024-09-21T00:46:05.580 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:46:05.584 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:46:05.584 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:46:05.604 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:46:05.605 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:46:05.694 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:46:05.811 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:06.013 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T00:46:06.013 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T00:46:06.205 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T00:46:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:06.298 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:46:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T00:46:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:06.298 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:06.430 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:06.430 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:46:06.431 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:06.431 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:06.594 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados-devel 2024-09-21T00:46:06.645 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install librados2 2024-09-21T00:46:07.194 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:07.218 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:07.308 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:07.330 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:07.331 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:07.331 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T00:46:07.331 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:07.331 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:46:07.331 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T00:46:07.331 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:07.331 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:46:07.332 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:07.332 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T00:46:07.332 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:07.332 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 127 k 2024-09-21T00:46:07.332 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 456 k 2024-09-21T00:46:07.332 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:07.420 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install librbd1 2024-09-21T00:46:07.563 INFO:teuthology.orchestra.run.smithi112.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 547 kB/s | 127 kB 00:00 2024-09-21T00:46:07.564 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:07.564 INFO:teuthology.orchestra.run.smithi112.stdout:Total 543 kB/s | 127 kB 00:00 2024-09-21T00:46:07.564 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:46:07.569 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:46:07.570 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:46:07.633 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:46:07.633 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:46:07.783 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:46:07.891 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:07.991 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:08.080 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:08.123 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:08.124 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:46:08.124 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:08.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install python3-rados 2024-09-21T00:46:08.343 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:08.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:08.611 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:08.611 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:46:08.611 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:08.611 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:08.611 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:08.764 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:08.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs2 2024-09-21T00:46:08.852 INFO:teuthology.orchestra.run.smithi187.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:08.895 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:46:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:08.961 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install python3-rgw 2024-09-21T00:46:09.435 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:09.526 INFO:teuthology.orchestra.run.smithi112.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:09.534 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:09.571 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:09.572 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:46:09.572 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:09.621 INFO:teuthology.orchestra.run.smithi187.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:09.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs-devel 2024-09-21T00:46:09.665 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:09.666 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:46:09.666 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:09.725 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install python3-cephfs 2024-09-21T00:46:10.215 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:10.308 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:10.348 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:10.348 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T00:46:10.348 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:10.348 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:46:10.348 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T00:46:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:10.349 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:46:10.349 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:10.349 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T00:46:10.349 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:10.349 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 32 k 2024-09-21T00:46:10.349 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 142 k 2024-09-21T00:46:10.350 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:46:10.399 INFO:teuthology.orchestra.run.smithi187.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:46:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:10.496 INFO:teuthology.orchestra.run.smithi112.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 216 kB/s | 32 kB 00:00 2024-09-21T00:46:10.497 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:10.497 INFO:teuthology.orchestra.run.smithi112.stdout:Total 214 kB/s | 32 kB 00:00 2024-09-21T00:46:10.497 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:46:10.500 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:46:10.501 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:46:10.511 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install python3-rbd 2024-09-21T00:46:10.525 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:46:10.526 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:46:10.613 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:46:10.745 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:11.085 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:11.108 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:11.173 INFO:teuthology.orchestra.run.smithi187.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:11.216 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:11.217 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-21T00:46:11.217 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:11.285 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install rbd-fuse 2024-09-21T00:46:11.342 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:11.343 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:11.343 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:46:11.343 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:11.343 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:11.343 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:11.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados2 2024-09-21T00:46:11.864 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:11.997 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:11.997 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: Package Architecture Version Repository Size 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 85 k 2024-09-21T00:46:11.998 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 231 k 2024-09-21T00:46:11.999 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:46:12.093 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:12.183 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:12.190 INFO:teuthology.orchestra.run.smithi187.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 445 kB/s | 85 kB 00:00 2024-09-21T00:46:12.191 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:12.191 INFO:teuthology.orchestra.run.smithi187.stdout:Total 442 kB/s | 85 kB 00:00 2024-09-21T00:46:12.192 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:46:12.198 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:46:12.198 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:46:12.225 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:12.226 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:46:12.226 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:12.262 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:46:12.262 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:46:12.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librbd1 2024-09-21T00:46:12.413 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:46:12.513 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:12.870 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:12.960 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:13.006 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:13.007 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:46:13.007 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:13.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rados 2024-09-21T00:46:13.138 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:13.138 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:13.138 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:46:13.138 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:13.138 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:13.138 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:13.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install rbd-mirror 2024-09-21T00:46:13.659 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:13.752 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:13.798 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:13.799 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:46:13.799 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:13.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rgw 2024-09-21T00:46:13.968 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:14.105 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repo Size 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:14.106 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2024-09-21T00:46:14.107 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:14.107 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 3.1 M 2024-09-21T00:46:14.107 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 13 M 2024-09-21T00:46:14.107 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:46:14.454 INFO:teuthology.orchestra.run.smithi187.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.0 MB/s | 3.1 MB 00:00 2024-09-21T00:46:14.454 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:14.455 INFO:teuthology.orchestra.run.smithi187.stdout:Total 8.9 MB/s | 3.1 MB 00:00 2024-09-21T00:46:14.455 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:46:14.464 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:46:14.464 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:46:14.496 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:14.544 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:46:14.544 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:46:14.585 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:14.629 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:14.630 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:46:14.630 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:14.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-cephfs 2024-09-21T00:46:14.969 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:46:15.038 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:15.062 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:15.062 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:15.062 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:46:15.062 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:46:15.062 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:46:15.062 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:15.288 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:15.375 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:15.418 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:15.418 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:46:15.418 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:15.485 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rbd 2024-09-21T00:46:16.057 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:16.144 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T00:46:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:16.181 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:46:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:16.182 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:16.190 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:16.190 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T00:46:16.191 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:16.261 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-fuse 2024-09-21T00:46:16.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install rbd-nbd 2024-09-21T00:46:16.875 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:17.006 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:17.007 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:17.007 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-21T00:46:17.007 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:17.007 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 85 k 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 231 k 2024-09-21T00:46:17.008 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:46:17.057 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:17.199 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: Package Architecture Version Repository Size 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout:Install 1 Package 2024-09-21T00:46:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:17.201 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 170 k 2024-09-21T00:46:17.201 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 494 k 2024-09-21T00:46:17.201 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T00:46:17.216 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 410 kB/s | 85 kB 00:00 2024-09-21T00:46:17.217 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:17.217 INFO:teuthology.orchestra.run.smithi112.stdout:Total 407 kB/s | 85 kB 00:00 2024-09-21T00:46:17.217 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:46:17.224 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:46:17.224 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:46:17.288 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:46:17.288 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:46:17.431 INFO:teuthology.orchestra.run.smithi187.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 740 kB/s | 170 kB 00:00 2024-09-21T00:46:17.432 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:17.432 INFO:teuthology.orchestra.run.smithi187.stdout:Total 734 kB/s | 170 kB 00:00 2024-09-21T00:46:17.432 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T00:46:17.434 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:46:17.440 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T00:46:17.440 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T00:46:17.508 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T00:46:17.508 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T00:46:17.547 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T00:46:17.764 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:18.209 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:46:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:18.210 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:18.210 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:18.256 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:18.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-mirror 2024-09-21T00:46:18.523 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:18.523 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:18.524 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T00:46:18.524 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:18.524 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:46:18.524 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T00:46:18.804 DEBUG:teuthology.parallel:result is None 2024-09-21T00:46:19.042 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:19.180 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:19.181 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T00:46:19.181 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:19.181 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:46:19.181 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 3.1 M 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 13 M 2024-09-21T00:46:19.182 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:46:19.519 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.2 MB/s | 3.1 MB 00:00 2024-09-21T00:46:19.520 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:19.520 INFO:teuthology.orchestra.run.smithi112.stdout:Total 9.2 MB/s | 3.1 MB 00:00 2024-09-21T00:46:19.520 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:46:19.529 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:46:19.529 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:46:19.615 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:46:20.042 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:46:20.145 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:20.171 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:20.171 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:46:20.171 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:46:20.171 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:46:20.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:21.305 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:46:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:21.305 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:21.576 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-nbd 2024-09-21T00:46:22.168 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 12:44:34 AM UTC. 2024-09-21T00:46:22.303 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 170 k 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 494 k 2024-09-21T00:46:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T00:46:22.548 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 699 kB/s | 170 kB 00:00 2024-09-21T00:46:22.549 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:22.549 INFO:teuthology.orchestra.run.smithi112.stdout:Total 695 kB/s | 170 kB 00:00 2024-09-21T00:46:22.549 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T00:46:22.557 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T00:46:22.557 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T00:46:22.620 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T00:46:22.621 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T00:46:22.777 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T00:46:22.896 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:23.313 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:23.569 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T00:46:23.569 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:23.569 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T00:46:23.569 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T00:46:23.569 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:46:23.569 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T00:46:23.819 DEBUG:teuthology.parallel:result is None 2024-09-21T00:46:23.819 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:46:23.819 INFO:teuthology.packaging:ref: None 2024-09-21T00:46:23.819 INFO:teuthology.packaging:tag: None 2024-09-21T00:46:23.819 INFO:teuthology.packaging:branch: squid 2024-09-21T00:46:23.819 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:46:23.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T00:46:24.053 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:46:24.074 INFO:teuthology.orchestra.run.smithi112.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T00:46:24.075 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T00:46:24.075 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T00:46:24.077 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:46:24.077 INFO:teuthology.packaging:ref: None 2024-09-21T00:46:24.077 INFO:teuthology.packaging:tag: None 2024-09-21T00:46:24.077 INFO:teuthology.packaging:branch: squid 2024-09-21T00:46:24.077 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:46:24.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T00:46:24.309 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:46:24.334 INFO:teuthology.orchestra.run.smithi187.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T00:46:24.335 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T00:46:24.335 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T00:46:24.336 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T00:46:24.337 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:46:24.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:46:24.362 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:46:24.363 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:46:24.405 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T00:46:24.405 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:46:24.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:46:24.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:46:24.494 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:46:24.494 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:46:24.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:46:24.589 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T00:46:24.589 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:46:24.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:46:24.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:46:24.678 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:46:24.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:46:24.705 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:46:24.770 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T00:46:24.770 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:46:24.771 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:46:24.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:46:24.861 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:46:24.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:46:24.886 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:46:24.952 INFO:teuthology.run_tasks:Running task print... 2024-09-21T00:46:24.961 INFO:teuthology.task.print:**** done install task... 2024-09-21T00:46:24.961 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T00:46:25.097 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T00:46:25.097 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T00:46:25.098 INFO:tasks.cephadm:Cluster fsid is ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:25.098 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T00:46:25.098 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-21T00:46:25.098 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi112': '172.21.15.112', 'mon.smithi187': '172.21.15.187'} 2024-09-21T00:46:25.098 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T00:46:25.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-09-21T00:46:25.123 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname $(hostname -s) 2024-09-21T00:46:25.149 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-21T00:46:25.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:46:25.300 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T00:46:25.540 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 4e45e6b490e6cbe082cdf155fea780438ec53fc7 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-21T00:46:25.541 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:46:25.541 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:46:25.541 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:46:25.910 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 00:46 /home/ubuntu/cephtest/cephadm 2024-09-21T00:46:25.910 DEBUG:teuthology.orchestra.run.smithi187:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:46:26.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 00:46 /home/ubuntu/cephtest/cephadm 2024-09-21T00:46:26.465 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:46:26.485 DEBUG:teuthology.orchestra.run.smithi187:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:46:26.514 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-21T00:46:26.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T00:46:26.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T00:46:28.139 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T00:46:28.235 INFO:teuthology.orchestra.run.smithi187.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T00:46:54.836 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:46:54.837 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T00:46:54.837 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T00:46:54.837 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-09-21T00:46:54.837 INFO:teuthology.orchestra.run.smithi112.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T00:46:54.837 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-21T00:46:54.838 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:46:55.175 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-21T00:46:55.175 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T00:46:55.176 INFO:teuthology.orchestra.run.smithi187.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T00:46:55.176 INFO:teuthology.orchestra.run.smithi187.stdout: "repo_digests": [ 2024-09-21T00:46:55.176 INFO:teuthology.orchestra.run.smithi187.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T00:46:55.176 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-21T00:46:55.176 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-21T00:46:55.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-09-21T00:46:55.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph 2024-09-21T00:46:55.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-09-21T00:46:55.297 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /etc/ceph 2024-09-21T00:46:55.323 INFO:tasks.cephadm:Writing seed config... 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T00:46:55.324 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T00:46:55.325 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T00:46:55.326 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:46:55.326 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T00:46:55.353 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ede6b7bc-77b2-11ef-baf5-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T00:46:55.354 DEBUG:teuthology.orchestra.run.smithi112:mon.smithi112> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service 2024-09-21T00:46:55.396 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T00:46:55.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.112 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:46:55.596 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:55.596 INFO:teuthology.orchestra.run.smithi112.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.112', '--skip-admin-label'] 2024-09-21T00:46:55.596 INFO:teuthology.orchestra.run.smithi112.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T00:46:55.596 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying podman|docker is present... 2024-09-21T00:46:55.619 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:46:55.620 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying lvm2 is present... 2024-09-21T00:46:55.620 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying time synchronization is in place... 2024-09-21T00:46:55.627 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:46:55.627 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:46:55.634 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:46:55.634 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-21T00:46:55.640 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout enabled 2024-09-21T00:46:55.647 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout active 2024-09-21T00:46:55.647 INFO:teuthology.orchestra.run.smithi112.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:46:55.647 INFO:teuthology.orchestra.run.smithi112.stdout:Repeating the final host check... 2024-09-21T00:46:55.668 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:46:55.668 INFO:teuthology.orchestra.run.smithi112.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T00:46:55.668 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl is present 2024-09-21T00:46:55.668 INFO:teuthology.orchestra.run.smithi112.stdout:lvcreate is present 2024-09-21T00:46:55.675 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:46:55.675 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:46:55.681 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:46:55.681 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-21T00:46:55.687 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout enabled 2024-09-21T00:46:55.694 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout active 2024-09-21T00:46:55.694 INFO:teuthology.orchestra.run.smithi112.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:46:55.694 INFO:teuthology.orchestra.run.smithi112.stdout:Host looks OK 2024-09-21T00:46:55.694 INFO:teuthology.orchestra.run.smithi112.stdout:Cluster fsid: ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:46:55.694 INFO:teuthology.orchestra.run.smithi112.stdout:Acquiring lock 140156442769248 on /run/cephadm/ede6b7bc-77b2-11ef-baf5-efdc52797490.lock 2024-09-21T00:46:55.694 INFO:teuthology.orchestra.run.smithi112.stdout:Lock 140156442769248 acquired on /run/cephadm/ede6b7bc-77b2-11ef-baf5-efdc52797490.lock 2024-09-21T00:46:55.695 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying IP 172.21.15.112 port 3300 ... 2024-09-21T00:46:55.695 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying IP 172.21.15.112 port 6789 ... 2024-09-21T00:46:55.695 INFO:teuthology.orchestra.run.smithi112.stdout:Base mon IP(s) is [172.21.15.112:3300, 172.21.15.112:6789], mon addrv is [v2:172.21.15.112:3300,v1:172.21.15.112:6789] 2024-09-21T00:46:55.698 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.112 metric 100 2024-09-21T00:46:55.698 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.112 metric 100 2024-09-21T00:46:55.700 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T00:46:55.700 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T00:46:55.700 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T00:46:55.703 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T00:46:55.703 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T00:46:55.703 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:46:55.703 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T00:46:55.704 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-21T00:46:55.704 INFO:teuthology.orchestra.run.smithi112.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:46:55.704 INFO:teuthology.orchestra.run.smithi112.stdout:Mon IP `172.21.15.112` is in CIDR network `172.21.0.0/20` 2024-09-21T00:46:55.704 INFO:teuthology.orchestra.run.smithi112.stdout:Mon IP `172.21.15.112` is in CIDR network `172.21.0.0/20` 2024-09-21T00:46:55.704 INFO:teuthology.orchestra.run.smithi112.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T00:46:55.704 INFO:teuthology.orchestra.run.smithi112.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T00:46:55.705 INFO:teuthology.orchestra.run.smithi112.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T00:46:56.198 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stdout 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T00:46:56.198 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T00:46:56.198 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T00:46:56.198 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T00:46:56.198 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Copying blob sha256:66069d7a5240ff24cb47e5b84cff1b0dd6013e59abb2a061101c2af76e3da9e1 2024-09-21T00:46:56.199 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Copying config sha256:164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T00:46:56.199 INFO:teuthology.orchestra.run.smithi112.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T00:46:57.162 INFO:teuthology.orchestra.run.smithi112.stdout:ceph: stdout ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T00:46:57.162 INFO:teuthology.orchestra.run.smithi112.stdout:Ceph version: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T00:46:57.162 INFO:teuthology.orchestra.run.smithi112.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T00:46:58.075 INFO:teuthology.orchestra.run.smithi112.stdout:stat: stdout 167 167 2024-09-21T00:46:58.075 INFO:teuthology.orchestra.run.smithi112.stdout:Creating initial keys... 2024-09-21T00:47:03.882 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph-authtool: stdout AQCCF+5mP0PJFxAAf1+jgfG7ZCip8QPvJ0ZmWw== 2024-09-21T00:47:10.746 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph-authtool: stdout AQCKF+5m8+FjNRAA0VNjX1DI6ihqu3kiu0pGKQ== 2024-09-21T00:47:11.785 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph-authtool: stdout AQCPF+5mVmT/AhAA7PHYQhQNl6NJ24Oo51iCkw== 2024-09-21T00:47:11.786 INFO:teuthology.orchestra.run.smithi112.stdout:Creating initial monmap... 2024-09-21T00:47:12.775 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool for smithi112 [v2:172.21.15.112:3300,v1:172.21.15.112:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = quincy 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: set fsid to ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:47:12.776 INFO:teuthology.orchestra.run.smithi112.stdout:Creating mon... 2024-09-21T00:47:13.764 INFO:teuthology.orchestra.run.smithi112.stdout:create mon.smithi112 on 2024-09-21T00:47:13.975 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T00:47:14.110 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T00:47:14.278 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490.target. 2024-09-21T00:47:14.279 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490.target. 2024-09-21T00:47:14.522 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112 2024-09-21T00:47:14.522 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service: Unit ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service not loaded. 2024-09-21T00:47:14.690 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490.target.wants/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service → /etc/systemd/system/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@.service. 2024-09-21T00:47:15.206 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:47:15.206 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-21T00:47:15.214 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:47:15.214 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-21T00:47:15.214 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-21T00:47:15.214 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:47:15.214 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mon to start... 2024-09-21T00:47:15.215 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mon... 2024-09-21T00:47:17.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:17 smithi112 ceph-mon[27701]: from='client.? 172.21.15.112:0/1091378839' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T00:47:17.189 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T00:47:17.191 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout id: ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:17.191 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T00:47:17.191 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:17.191 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout services: 2024-09-21T00:47:17.191 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi112 (age 1.45415s) 2024-09-21T00:47:17.191 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout data: 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:mon is available 2024-09-21T00:47:17.192 INFO:teuthology.orchestra.run.smithi112.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T00:47:18.210 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:18 smithi112 ceph-mon[27701]: from='client.? 172.21.15.112:0/3961383992' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T00:47:18.210 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:18 smithi112 ceph-mon[27701]: from='client.? 172.21.15.112:0/3961383992' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout fsid = ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.112:3300,v1:172.21.15.112:6789] 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:47:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:Generating new minimal ceph.conf... 2024-09-21T00:47:19.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:19 smithi112 ceph-mon[27701]: from='client.? 172.21.15.112:0/1700287515' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:47:19.294 INFO:teuthology.orchestra.run.smithi112.stdout:Restarting the monitor... 2024-09-21T00:47:19.561 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:19 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:47:20.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:19 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[27696]: 2024-09-21T00:47:19.559+0000 7f1ed687b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:47:20.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:19 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[27696]: 2024-09-21T00:47:19.559+0000 7f1ed687b640 -1 mon.smithi112@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T00:47:20.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:19 smithi112 podman[27952]: 2024-09-21 00:47:19.714210339 +0000 UTC m=+0.239057705 container died 065c7bae9e91ab829e6deb0269d94d79dc7ceab6e153417b97ab166c26c73442 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b) 2024-09-21T00:47:20.337 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 podman[27952]: 2024-09-21 00:47:20.135784286 +0000 UTC m=+0.660631630 container cleanup 065c7bae9e91ab829e6deb0269d94d79dc7ceab6e153417b97ab166c26c73442 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T00:47:20.337 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 bash[27952]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112 2024-09-21T00:47:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 podman[27965]: 2024-09-21 00:47:20.336625991 +0000 UTC m=+0.625319465 container remove 065c7bae9e91ab829e6deb0269d94d79dc7ceab6e153417b97ab166c26c73442 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T00:47:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service: Deactivated successfully. 2024-09-21T00:47:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:47:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 systemd[1]: Starting Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T00:47:21.017 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 podman[28059]: 2024-09-21 00:47:20.669050456 +0000 UTC m=+0.015686055 image pull 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T00:47:21.017 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 podman[28059]: 2024-09-21 00:47:20.787248039 +0000 UTC m=+0.133883616 container create 6595fa98b1e45845b1524802f9ef7e0716908b105b1817fca096b7e197f76b2b (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2) 2024-09-21T00:47:21.017 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 podman[28059]: 2024-09-21 00:47:20.989597838 +0000 UTC m=+0.336233432 container init 6595fa98b1e45845b1524802f9ef7e0716908b105b1817fca096b7e197f76b2b (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-4e45e6b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T00:47:21.017 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:20 smithi112 podman[28059]: 2024-09-21 00:47:20.992658601 +0000 UTC m=+0.339294178 container start 6595fa98b1e45845b1524802f9ef7e0716908b105b1817fca096b7e197f76b2b (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T00:47:21.017 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:47:21.017 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 2 2024-09-21T00:47:21.017 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: pidfile_write: ignore empty --pid-file 2024-09-21T00:47:21.018 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: load: jerasure load: lrc 2024-09-21T00:47:21.077 INFO:teuthology.orchestra.run.smithi112.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T00:47:21.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Git sha 0 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: DB SUMMARY 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: DB Session ID: 3NVZK545A4EWC8NYPH2W 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T00:47:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000009.log size: 95292 ; 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.env: 0x56070bdf5940 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.info_log: 0x56070d4218c0 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.statistics: (nil) 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.use_fsync: 0 2024-09-21T00:47:21.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.db_log_dir: 2024-09-21T00:47:21.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.wal_dir: 2024-09-21T00:47:21.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:47:21.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:47:21.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:47:21.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:47:21.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:47:21.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:47:21.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:47:21.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:47:21.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.write_buffer_manager: 0x56070d430dc0 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.unordered_write: 0 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:47:21.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.row_cache: None 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.wal_filter: None 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.wal_compression: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:47:21.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:47:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_open_files: -1 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Compression algorithms supported: 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kZSTD supported: 0 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:47:21.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000010 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.merge_operator: 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_filter: None 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:47:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56070d421520) 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 4 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x56070d4151f0 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-09-21T00:47:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: bloomfilter 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-09-21T00:47:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 5 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_auto_readahead_size: 262144 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: prepopulate_block_cache: 0 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression: NoCompression 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.num_levels: 7 2024-09-21T00:47:21.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:47:21.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:47:21.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:47:21.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:47:21.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.ttl: 2592000 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:47:21.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b7456f3d-c943-41f6-ad4f-916c24447490 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879641019072, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879641019965, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91220, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 290, "table_properties": {"data_size": 89266, "index_size": 274, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11720, "raw_average_key_size": 47, "raw_value_size": 82730, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 245, "num_filter_entries": 245, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879641, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b7456f3d-c943-41f6-ad4f-916c24447490", "db_session_id": "3NVZK545A4EWC8NYPH2W", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879641020036, "job": 1, "event": "recovery_finished"} 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:47:21.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56070d442e00 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: DB pointer 0x56070d53e000 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T00:47:21.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 2/0 90.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 2/0 90.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 152.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:47:21.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 29.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 29.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache BinnedLRUCache@0x56070d4151f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: starting mon.smithi112 rank 0 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:21.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???) e1 preinit fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???).mds e1 new map 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???).mds e1 print_map 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e1 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: btime 2024-09-21T00:47:15:163755+0000 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: -1 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: No filesystems configured 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T00:47:21.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 bash[28059]: 6595fa98b1e45845b1524802f9ef7e0716908b105b1817fca096b7e197f76b2b 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 systemd[1]: Started Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mon.smithi112 is new leader, mons smithi112 in quorum (ranks 0) 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: monmap epoch 1 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: last_changed 2024-09-21T00:47:12.183691+0000 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: created 2024-09-21T00:47:12.183691+0000 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: min_mon_release 19 (squid) 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: election_strategy: 1 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: fsmap 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T00:47:21.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:21 smithi112 ceph-mon[28078]: mgrmap e1: no daemons active 2024-09-21T00:47:22.542 INFO:teuthology.orchestra.run.smithi112.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T00:47:22.563 INFO:teuthology.orchestra.run.smithi112.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:47:22.563 INFO:teuthology.orchestra.run.smithi112.stdout:Creating mgr... 2024-09-21T00:47:22.563 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T00:47:22.564 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T00:47:22.564 INFO:teuthology.orchestra.run.smithi112.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-21T00:47:22.816 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mgr.smithi112.fzmyfw 2024-09-21T00:47:22.816 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mgr.smithi112.fzmyfw.service: Unit ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mgr.smithi112.fzmyfw.service not loaded. 2024-09-21T00:47:22.823 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:22 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2061914602' entity='client.admin' 2024-09-21T00:47:22.971 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490.target.wants/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mgr.smithi112.fzmyfw.service → /etc/systemd/system/ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@.service. 2024-09-21T00:47:23.509 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:47:23.510 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-21T00:47:23.518 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:47:23.518 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-21T00:47:23.518 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-21T00:47:23.518 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:47:23.529 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:47:23.529 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-21T00:47:23.537 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:47:23.537 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-21T00:47:23.537 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-21T00:47:23.537 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-21T00:47:23.537 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr to start... 2024-09-21T00:47:23.538 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr... 2024-09-21T00:47:24.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:24 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4207678472' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T00:47:24.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:24.722 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:24.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsid": "ede6b7bc-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:47:24.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:47:24.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:47:24.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:47:24.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:47:24.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:24.723 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:47:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:47:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:47:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:47:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "smithi112" 2024-09-21T00:47:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T00:47:24.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:47:24.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:24.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:47:24.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:47:24.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:24.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:47:24.725 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:24.726 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:47:24.726 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:47:24.726 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:47:24.727 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:47:24.727 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:47:24.727 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:47:24.727 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:24.727 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:47:24.727 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:47:24.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:47:24.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:47:24.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:47:24.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:47:24.728 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:47:24.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:47:24.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:47:24.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:24.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:47:24.729 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:24.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:47:15:163755+0000", 2024-09-21T00:47:24.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:47:24.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:47:24.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:24.730 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:47:24.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T00:47:24.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:47:24.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:47:24.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:47:24.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:47:24.731 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:47:24.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:24.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:47:24.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:24.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:47:24.732 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:24.733 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:47:15.164402+0000", 2024-09-21T00:47:24.733 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:47:24.733 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:24.733 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:47:24.733 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:24.734 INFO:teuthology.orchestra.run.smithi112.stdout:mgr not available, waiting (1/15)... 2024-09-21T00:47:27.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:27 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2125225772' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T00:47:28.019 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:28.019 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:28.019 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsid": "ede6b7bc-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:47:28.019 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "smithi112" 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:28.020 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:47:28.021 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:47:28.024 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:28.024 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:47:28.024 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:47:28.024 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:47:28.024 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:47:28.024 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:47:15:163755+0000", 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:47:28.025 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:47:15.164402+0000", 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:28.026 INFO:teuthology.orchestra.run.smithi112.stdout:mgr not available, waiting (2/15)... 2024-09-21T00:47:28.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: Activating manager daemon smithi112.fzmyfw 2024-09-21T00:47:28.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: mgrmap e2: smithi112.fzmyfw(active, starting, since 0.00286398s) 2024-09-21T00:47:28.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:47:28.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:47:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:47:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:47:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:47:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: Manager daemon smithi112.fzmyfw is now available 2024-09-21T00:47:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:47:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:47:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:28 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:29 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:29 smithi112 ceph-mon[28078]: from='mgr.14100 172.21.15.112:0/3489865150' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:29 smithi112 ceph-mon[28078]: mgrmap e3: smithi112.fzmyfw(active, since 1.00704s) 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsid": "ede6b7bc-77b2-11ef-baf5-efdc52797490", 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:31.201 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "smithi112" 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:31.202 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:47:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:47:15:163755+0000", 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:47:31.207 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:47:15.164402+0000", 2024-09-21T00:47:31.208 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:47:31.208 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:47:31.208 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:47:31.208 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:31.208 INFO:teuthology.orchestra.run.smithi112.stdout:mgr is available 2024-09-21T00:47:31.447 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:31 smithi112 ceph-mon[28078]: mgrmap e4: smithi112.fzmyfw(active, since 2s) 2024-09-21T00:47:31.447 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:31 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3262841116' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T00:47:32.432 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:32.432 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:47:32.432 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout fsid = ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:32.432 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.112:3300,v1:172.21.15.112:6789] 2024-09-21T00:47:32.432 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:47:32.433 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:47:32.434 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:47:32.434 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling cephadm module... 2024-09-21T00:47:32.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:32 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/305089583' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T00:47:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:33 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1424847436' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-21T00:47:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:34 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1424847436' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T00:47:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:34 smithi112 ceph-mon[28078]: mgrmap e5: smithi112.fzmyfw(active, since 5s) 2024-09-21T00:47:35.245 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T00:47:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:47:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "active_name": "smithi112.fzmyfw", 2024-09-21T00:47:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:47:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for the mgr to restart... 2024-09-21T00:47:35.246 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr epoch 5... 2024-09-21T00:47:35.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:35 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3222674463' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T00:47:38.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: Active manager daemon smithi112.fzmyfw restarted 2024-09-21T00:47:38.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: Activating manager daemon smithi112.fzmyfw 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: mgrmap e6: smithi112.fzmyfw(active, starting, since 0.0034343s) 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: Manager daemon smithi112.fzmyfw is now available 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:47:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:38 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:47:39.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:39 smithi112 ceph-mon[28078]: Found migration_current of "None". Setting to last migration. 2024-09-21T00:47:39.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:39 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:39.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:39 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:39.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:39 smithi112 ceph-mon[28078]: mgrmap e7: smithi112.fzmyfw(active, since 1.00591s) 2024-09-21T00:47:39.751 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:47:39.751 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T00:47:39.751 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:47:39.751 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:47:39.752 INFO:teuthology.orchestra.run.smithi112.stdout:mgr epoch 5 is available 2024-09-21T00:47:39.752 INFO:teuthology.orchestra.run.smithi112.stdout:Setting orchestrator backend to cephadm... 2024-09-21T00:47:40.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:40 smithi112 ceph-mon[28078]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T00:47:40.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:40 smithi112 ceph-mon[28078]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T00:47:40.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:40 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: [21/Sep/2024:00:47:39] ENGINE Bus STARTING 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: [21/Sep/2024:00:47:39] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: [21/Sep/2024:00:47:39] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: [21/Sep/2024:00:47:39] ENGINE Bus STARTED 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: [21/Sep/2024:00:47:39] ENGINE Error in HTTPServer.serve 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:47:41.216 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:47:41.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: mgrmap e8: smithi112.fzmyfw(active, since 2s) 2024-09-21T00:47:41.218 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:41.218 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:41 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:42.071 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T00:47:42.072 INFO:teuthology.orchestra.run.smithi112.stdout:Generating ssh key... 2024-09-21T00:47:42.397 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:42 smithi112 ceph-mon[28078]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:43.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:43 smithi112 ceph-mon[28078]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:43.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:43 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:43.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:43 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:44 smithi112 ceph-mon[28078]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:44 smithi112 ceph-mon[28078]: Generating ssh key... 2024-09-21T00:47:44.559 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXe4MOGlI1LHrmLv13WXYubB09hVtBqrzrE2fJHRpJsZdF3aVI9ICsqa1F1TTXQEuUoMCtBkQHYK/WVHHOHUYbQh4sIXm/vizqm3u+a4DyNUe96WTXVSps+jxU2B3bEUXCJ8FsPpwD6FyIz8383rStjZFepVe1RKW9Lzl2tzCFm+zCbA1tZ5SEqpaZZ41GkmpN1clOYCge/1mJKcx8CXMdmlGUQybp4gUFLbjSGpdP05QfElb/RxpTFdt6pEmekmTkJJMIyHZqyfqPgbbW4UBM//JzXYFY3DMlkjFvE70FkguwDRKp1FhONDbO60aVrtmsbBPyR6y9Rd0+5P0XsF77qsoPsg1LwSoVADic4IZW7owPTQ5HDr0uUCeTr3rtERdVtkZHflhy8ujupky8BxrPR0gnLOdotIf2h1T7hqUlA0kyUFEkoQKRxqx2Kpl4yiWKZiTzbvW2P400h4JX29xurT32SqxmCxvWGuVh7enyaEC3/xKQ5C46o0zO5ZrgpnM= ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:47:44.560 INFO:teuthology.orchestra.run.smithi112.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T00:47:44.560 INFO:teuthology.orchestra.run.smithi112.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T00:47:44.566 INFO:teuthology.orchestra.run.smithi112.stdout:Adding host smithi112... 2024-09-21T00:47:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:45 smithi112 ceph-mon[28078]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:46.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:46 smithi112 ceph-mon[28078]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "addr": "172.21.15.112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:47 smithi112 ceph-mon[28078]: Deploying cephadm binary to smithi112 2024-09-21T00:47:48.942 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Added host 'smithi112' with addr '172.21.15.112' 2024-09-21T00:47:48.942 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying mon service with default placement... 2024-09-21T00:47:49.569 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:49 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:49.570 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:49 smithi112 ceph-mon[28078]: Added host smithi112 2024-09-21T00:47:49.570 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:49 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:47:50.401 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T00:47:50.401 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying mgr service with default placement... 2024-09-21T00:47:50.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:50 smithi112 ceph-mon[28078]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:50.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:50 smithi112 ceph-mon[28078]: Saving service mon spec with placement count:5 2024-09-21T00:47:50.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:50 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:51.650 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T00:47:51.651 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying crash service with default placement... 2024-09-21T00:47:52.227 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:51 smithi112 ceph-mon[28078]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:52.227 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:51 smithi112 ceph-mon[28078]: Saving service mgr spec with placement count:2 2024-09-21T00:47:52.227 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:51 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:53.461 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-21T00:47:53.461 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying ceph-exporter service with default placement... 2024-09-21T00:47:53.567 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:53 smithi112 ceph-mon[28078]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:53.567 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:53 smithi112 ceph-mon[28078]: Saving service crash spec with placement * 2024-09-21T00:47:53.567 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:53 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:53.567 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:53 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:54.593 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-21T00:47:54.593 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying prometheus service with default placement... 2024-09-21T00:47:55.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:54 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:55.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:54 smithi112 ceph-mon[28078]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:55.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:54 smithi112 ceph-mon[28078]: Saving service ceph-exporter spec with placement * 2024-09-21T00:47:55.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:54 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:55.782 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-21T00:47:55.782 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying grafana service with default placement... 2024-09-21T00:47:56.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:56 smithi112 ceph-mon[28078]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:56.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:56 smithi112 ceph-mon[28078]: Saving service prometheus spec with placement count:1 2024-09-21T00:47:56.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:56 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:57.506 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:57 smithi112 ceph-mon[28078]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:57.506 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:57 smithi112 ceph-mon[28078]: Saving service grafana spec with placement count:1 2024-09-21T00:47:57.506 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:57 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:57.506 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:57 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-21T00:47:57.508 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying node-exporter service with default placement... 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-21T00:47:58.757 INFO:teuthology.orchestra.run.smithi112.stdout:Deploying alertmanager service with default placement... 2024-09-21T00:47:59.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:59 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:47:59.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:59 smithi112 ceph-mon[28078]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:47:59.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:59 smithi112 ceph-mon[28078]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:47:59.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:59 smithi112 ceph-mon[28078]: Saving service node-exporter spec with placement * 2024-09-21T00:47:59.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:47:59 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:00.355 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:00 smithi112 ceph-mon[28078]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:00.355 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:00 smithi112 ceph-mon[28078]: Saving service alertmanager spec with placement count:1 2024-09-21T00:48:00.356 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:00 smithi112 ceph-mon[28078]: from='mgr.14118 172.21.15.112:0/1429562431' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:00.356 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:00 smithi112 ceph-mon[28078]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:00.761 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-21T00:48:02.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:02 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4136152185' entity='client.admin' 2024-09-21T00:48:02.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:02 smithi112 ceph-mon[28078]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:03.158 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling the dashboard module... 2024-09-21T00:48:03.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:03 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3458515038' entity='client.admin' 2024-09-21T00:48:04.901 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:04 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4203728322' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-21T00:48:04.901 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:04 smithi112 ceph-mon[28078]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:05.698 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:05 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4203728322' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T00:48:05.698 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:05 smithi112 ceph-mon[28078]: mgrmap e9: smithi112.fzmyfw(active, since 26s) 2024-09-21T00:48:06.385 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:48:06.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T00:48:06.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:48:06.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "active_name": "smithi112.fzmyfw", 2024-09-21T00:48:06.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:48:06.386 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:48:06.386 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for the mgr to restart... 2024-09-21T00:48:06.386 INFO:teuthology.orchestra.run.smithi112.stdout:Waiting for mgr epoch 9... 2024-09-21T00:48:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:06 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2939309463' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T00:48:09.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: Active manager daemon smithi112.fzmyfw restarted 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: Activating manager daemon smithi112.fzmyfw 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: mgrmap e10: smithi112.fzmyfw(active, starting, since 0.00556234s) 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: Manager daemon smithi112.fzmyfw is now available 2024-09-21T00:48:09.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:48:09.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:48:09.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:09 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:48:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:mgr epoch 9 is available 2024-09-21T00:48:11.171 INFO:teuthology.orchestra.run.smithi112.stdout:Generating a dashboard self-signed certificate... 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:11 smithi112 ceph-mon[28078]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:11 smithi112 ceph-mon[28078]: mgrmap e11: smithi112.fzmyfw(active, since 1.00569s) 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:11 smithi112 ceph-mon[28078]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T00:48:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:11 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:12.485 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-21T00:48:12.485 INFO:teuthology.orchestra.run.smithi112.stdout:Creating initial admin user... 2024-09-21T00:48:12.616 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: [21/Sep/2024:00:48:10] ENGINE Bus STARTING 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: [21/Sep/2024:00:48:10] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: [21/Sep/2024:00:48:11] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: [21/Sep/2024:00:48:11] ENGINE Bus STARTED 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: [21/Sep/2024:00:48:11] ENGINE Error in HTTPServer.serve 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:48:12.617 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:12.618 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:12 smithi112 ceph-mon[28078]: mgrmap e12: smithi112.fzmyfw(active, since 2s) 2024-09-21T00:48:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:13 smithi112 ceph-mon[28078]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:13 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:14.523 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$WdjXicKkQkV52QUwSONNPuZh5UAHGmnGnv6j3dAT1jKitc6xTwnMC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726879693, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T00:48:14.523 INFO:teuthology.orchestra.run.smithi112.stdout:Fetching dashboard port number... 2024-09-21T00:48:14.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:14 smithi112 ceph-mon[28078]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:15.653 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T00:48:15.663 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:48:15.663 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout disabled 2024-09-21T00:48:15.670 INFO:teuthology.orchestra.run.smithi112.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:48:15.670 INFO:teuthology.orchestra.run.smithi112.stdout:systemctl: stdout inactive 2024-09-21T00:48:15.670 INFO:teuthology.orchestra.run.smithi112.stdout:firewalld.service is not enabled 2024-09-21T00:48:15.670 INFO:teuthology.orchestra.run.smithi112.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T00:48:15.672 INFO:teuthology.orchestra.run.smithi112.stdout:Ceph Dashboard is now available at: 2024-09-21T00:48:15.672 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:15.672 INFO:teuthology.orchestra.run.smithi112.stdout: URL: https://smithi112.front.sepia.ceph.com:8443/ 2024-09-21T00:48:15.672 INFO:teuthology.orchestra.run.smithi112.stdout: User: admin 2024-09-21T00:48:15.672 INFO:teuthology.orchestra.run.smithi112.stdout: Password: f474jxnurr 2024-09-21T00:48:15.672 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:15.672 INFO:teuthology.orchestra.run.smithi112.stdout:Saving cluster configuration to /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config directory 2024-09-21T00:48:15.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:15 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3076575922' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-21T00:48:16.657 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:16 smithi112 ceph-mon[28078]: mgrmap e13: smithi112.fzmyfw(active, since 6s) 2024-09-21T00:48:16.657 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:16 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2314298615' entity='client.admin' 2024-09-21T00:48:16.943 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: ceph telemetry on 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout:For more information see: 2024-09-21T00:48:16.944 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.945 INFO:teuthology.orchestra.run.smithi112.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T00:48:16.945 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:16.945 INFO:teuthology.orchestra.run.smithi112.stdout:Bootstrap complete. 2024-09-21T00:48:16.983 INFO:tasks.cephadm:Fetching config... 2024-09-21T00:48:16.983 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:48:16.983 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T00:48:16.998 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T00:48:16.998 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:48:16.998 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T00:48:17.054 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T00:48:17.054 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:48:17.054 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/keyring of=/dev/stdout 2024-09-21T00:48:17.119 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T00:48:17.119 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:48:17.119 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T00:48:17.175 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T00:48:17.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXe4MOGlI1LHrmLv13WXYubB09hVtBqrzrE2fJHRpJsZdF3aVI9ICsqa1F1TTXQEuUoMCtBkQHYK/WVHHOHUYbQh4sIXm/vizqm3u+a4DyNUe96WTXVSps+jxU2B3bEUXCJ8FsPpwD6FyIz8383rStjZFepVe1RKW9Lzl2tzCFm+zCbA1tZ5SEqpaZZ41GkmpN1clOYCge/1mJKcx8CXMdmlGUQybp4gUFLbjSGpdP05QfElb/RxpTFdt6pEmekmTkJJMIyHZqyfqPgbbW4UBM//JzXYFY3DMlkjFvE70FkguwDRKp1FhONDbO60aVrtmsbBPyR6y9Rd0+5P0XsF77qsoPsg1LwSoVADic4IZW7owPTQ5HDr0uUCeTr3rtERdVtkZHflhy8ujupky8BxrPR0gnLOdotIf2h1T7hqUlA0kyUFEkoQKRxqx2Kpl4yiWKZiTzbvW2P400h4JX29xurT32SqxmCxvWGuVh7enyaEC3/xKQ5C46o0zO5ZrgpnM= ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:48:17.249 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXe4MOGlI1LHrmLv13WXYubB09hVtBqrzrE2fJHRpJsZdF3aVI9ICsqa1F1TTXQEuUoMCtBkQHYK/WVHHOHUYbQh4sIXm/vizqm3u+a4DyNUe96WTXVSps+jxU2B3bEUXCJ8FsPpwD6FyIz8383rStjZFepVe1RKW9Lzl2tzCFm+zCbA1tZ5SEqpaZZ41GkmpN1clOYCge/1mJKcx8CXMdmlGUQybp4gUFLbjSGpdP05QfElb/RxpTFdt6pEmekmTkJJMIyHZqyfqPgbbW4UBM//JzXYFY3DMlkjFvE70FkguwDRKp1FhONDbO60aVrtmsbBPyR6y9Rd0+5P0XsF77qsoPsg1LwSoVADic4IZW7owPTQ5HDr0uUCeTr3rtERdVtkZHflhy8ujupky8BxrPR0gnLOdotIf2h1T7hqUlA0kyUFEkoQKRxqx2Kpl4yiWKZiTzbvW2P400h4JX29xurT32SqxmCxvWGuVh7enyaEC3/xKQ5C46o0zO5ZrgpnM= ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:17.260 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXe4MOGlI1LHrmLv13WXYubB09hVtBqrzrE2fJHRpJsZdF3aVI9ICsqa1F1TTXQEuUoMCtBkQHYK/WVHHOHUYbQh4sIXm/vizqm3u+a4DyNUe96WTXVSps+jxU2B3bEUXCJ8FsPpwD6FyIz8383rStjZFepVe1RKW9Lzl2tzCFm+zCbA1tZ5SEqpaZZ41GkmpN1clOYCge/1mJKcx8CXMdmlGUQybp4gUFLbjSGpdP05QfElb/RxpTFdt6pEmekmTkJJMIyHZqyfqPgbbW4UBM//JzXYFY3DMlkjFvE70FkguwDRKp1FhONDbO60aVrtmsbBPyR6y9Rd0+5P0XsF77qsoPsg1LwSoVADic4IZW7owPTQ5HDr0uUCeTr3rtERdVtkZHflhy8ujupky8BxrPR0gnLOdotIf2h1T7hqUlA0kyUFEkoQKRxqx2Kpl4yiWKZiTzbvW2P400h4JX29xurT32SqxmCxvWGuVh7enyaEC3/xKQ5C46o0zO5ZrgpnM= ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:48:17.309 INFO:teuthology.orchestra.run.smithi187.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXe4MOGlI1LHrmLv13WXYubB09hVtBqrzrE2fJHRpJsZdF3aVI9ICsqa1F1TTXQEuUoMCtBkQHYK/WVHHOHUYbQh4sIXm/vizqm3u+a4DyNUe96WTXVSps+jxU2B3bEUXCJ8FsPpwD6FyIz8383rStjZFepVe1RKW9Lzl2tzCFm+zCbA1tZ5SEqpaZZ41GkmpN1clOYCge/1mJKcx8CXMdmlGUQybp4gUFLbjSGpdP05QfElb/RxpTFdt6pEmekmTkJJMIyHZqyfqPgbbW4UBM//JzXYFY3DMlkjFvE70FkguwDRKp1FhONDbO60aVrtmsbBPyR6y9Rd0+5P0XsF77qsoPsg1LwSoVADic4IZW7owPTQ5HDr0uUCeTr3rtERdVtkZHflhy8ujupky8BxrPR0gnLOdotIf2h1T7hqUlA0kyUFEkoQKRxqx2Kpl4yiWKZiTzbvW2P400h4JX29xurT32SqxmCxvWGuVh7enyaEC3/xKQ5C46o0zO5ZrgpnM= ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:48:17.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T00:48:17.599 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:48:18.947 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T00:48:18.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T00:48:19.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:19 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1346050641' entity='client.admin' 2024-09-21T00:48:19.929 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:48:21.117 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi187 2024-09-21T00:48:21.117 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:48:21.117 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.conf 2024-09-21T00:48:21.136 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:48:21.136 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:21.193 INFO:tasks.cephadm:Adding host smithi187 to orchestrator... 2024-09-21T00:48:21.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch host add smithi187 2024-09-21T00:48:21.573 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:48:21.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:21 smithi112 ceph-mon[28078]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:21.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:21 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:21.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:21 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:21 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:21 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:48:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:21 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:48:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:21 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:48:22.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:22 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:48:22.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:22 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:22.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:22 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:22.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:22 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:22.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:22 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:48:22.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:22 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T00:48:22.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:22 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:48:24.006 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:23 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:48:24.006 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:23 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:24.006 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:23 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:48:24.006 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:23 smithi112 ceph-mon[28078]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:24.006 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:23 smithi112 ceph-mon[28078]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T00:48:24.660 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:24 smithi112 ceph-mon[28078]: Deploying cephadm binary to smithi187 2024-09-21T00:48:25.531 INFO:teuthology.orchestra.run.smithi112.stdout:Added host 'smithi187' with addr '172.21.15.187' 2024-09-21T00:48:26.247 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:26.247 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: Deploying daemon crash.smithi112 on smithi112 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:26.248 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:25 smithi112 ceph-mon[28078]: Added host smithi187 2024-09-21T00:48:26.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T00:48:27.464 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:48:28.124 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:48:28.124 INFO:teuthology.orchestra.run.smithi112.stdout:[{"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}, {"addr": "172.21.15.187", "hostname": "smithi187", "labels": [], "status": ""}] 2024-09-21T00:48:28.749 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:28 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:28.749 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:28 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:28.750 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:28 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:28.750 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:28 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:28.750 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:28 smithi112 ceph-mon[28078]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-21T00:48:28.780 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T00:48:28.780 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T00:48:29.043 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:48:29.697 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:29 smithi112 ceph-mon[28078]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:48:30.493 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2024-09-21T00:48:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:30 smithi112 ceph-mon[28078]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:30 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:30.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:30 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3545725521' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T00:48:31.540 INFO:tasks.cephadm:Adding mon.smithi112 on smithi112 2024-09-21T00:48:31.541 INFO:tasks.cephadm:Adding mon.smithi187 on smithi187 2024-09-21T00:48:31.541 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch apply mon '2;smithi112:172.21.15.112=smithi112;smithi187:172.21.15.187=smithi187' 2024-09-21T00:48:31.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:31 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3545725521' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:48:31.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:31 smithi112 ceph-mon[28078]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:48:31.798 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:31.846 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:32.433 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mon update... 2024-09-21T00:48:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:32 smithi112 ceph-mon[28078]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:32 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:32 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:33.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:32 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:33.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:32 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:33.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:32 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:33.058 DEBUG:teuthology.orchestra.run.smithi187:mon.smithi187> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi187.service 2024-09-21T00:48:33.060 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:33.060 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:33.329 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:33.373 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:34.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:33 smithi112 ceph-mon[28078]: Deploying daemon alertmanager.smithi112 on smithi112 2024-09-21T00:48:34.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:33 smithi112 ceph-mon[28078]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi112:172.21.15.112=smithi112;smithi187:172.21.15.187=smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:48:34.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:33 smithi112 ceph-mon[28078]: Saving service mon spec with placement smithi112:172.21.15.112=smithi112;smithi187:172.21.15.187=smithi187;count:2 2024-09-21T00:48:34.016 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:34.016 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:34.016 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:34 smithi112 ceph-mon[28078]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:34 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/2716101109' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:34 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:35.584 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:35.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:35.827 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:35.871 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:36.612 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:36.612 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:36.612 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:36.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:36 smithi112 ceph-mon[28078]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:37.574 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:37 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1733230917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:38.195 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:38.195 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:38.437 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:38.480 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:38.605 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:38 smithi112 ceph-mon[28078]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:39.122 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:39.122 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:39.122 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:39.631 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:39 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/758802146' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:40.675 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:40.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:40.912 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:40.956 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:41.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:41.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T00:48:41.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:40 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:41.650 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:41.650 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:41.650 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:41 smithi112 ceph-mon[28078]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T00:48:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:41 smithi112 ceph-mon[28078]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T00:48:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:41 smithi112 ceph-mon[28078]: Deploying daemon grafana.smithi112 on smithi112 2024-09-21T00:48:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:42 smithi112 ceph-mon[28078]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:42 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/184752552' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:43.223 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:43.223 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:43.461 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:43.504 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:44.138 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:44.138 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:44.138 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:45.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:44 smithi112 ceph-mon[28078]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:45.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:44 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/3547466643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:45.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:44 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:45.690 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:45.690 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:45.924 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:45.967 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:46 smithi112 ceph-mon[28078]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:46.776 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:46.777 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:46.777 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:47.999 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:47 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1658915534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:48.377 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:48.378 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:48.637 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:48.691 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:48.919 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:48 smithi112 ceph-mon[28078]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:49.379 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:49.379 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.403 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: Deploying daemon prometheus.smithi112 on smithi112 2024-09-21T00:48:50.404 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/3257751812' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:50.404 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:50.404 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:50 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:48:50.966 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:50.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:51.208 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:51.251 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:52.032 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:52.032 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:52.032 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:52.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:52 smithi112 ceph-mon[28078]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:52.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:52 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/3621297159' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:53.606 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:53.606 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:53.848 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:53.892 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:54.497 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:54.498 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:54.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:54 smithi112 ceph-mon[28078]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:54.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:54 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/2316219623' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:56.096 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:56.096 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:56.336 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:56.380 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:56 smithi112 ceph-mon[28078]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:57.122 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:57.122 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:57.123 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:48:57.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:57 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1220449768' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:48:58.685 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:48:58.685 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:48:58.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:48:58 smithi112 ceph-mon[28078]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:48:58.927 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:58.971 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:48:59.624 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:48:59.624 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:48:59.624 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:00 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:00 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:00 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:00 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T00:49:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:00 smithi112 ceph-mon[28078]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:00 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:00 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/661420927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:01.132 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:01.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:01.378 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:01.423 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:01 smithi112 ceph-mon[28078]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T00:49:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:01 smithi112 ceph-mon[28078]: mgrmap e14: smithi112.fzmyfw(active, since 51s) 2024-09-21T00:49:02.107 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:02.107 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:02.107 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:02 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1642087952' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:03.697 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:03.698 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:03.941 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:03.985 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:04.605 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:04.605 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:04.605 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:05.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:04 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/3661121187' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:05.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: Active manager daemon smithi112.fzmyfw restarted 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: Activating manager daemon smithi112.fzmyfw 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: mgrmap e15: smithi112.fzmyfw(active, starting, since 0.00301802s) 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: Manager daemon smithi112.fzmyfw is now available 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:49:05.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:49:06.196 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:06.196 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:06.431 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:06.476 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:07.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:06 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:07.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:06 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:07.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:06 smithi112 ceph-mon[28078]: mgrmap e16: smithi112.fzmyfw(active, since 1.00566s) 2024-09-21T00:49:07.133 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:07.133 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:07.133 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:07 smithi112 ceph-mon[28078]: [21/Sep/2024:00:49:06] ENGINE Bus STARTING 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:07 smithi112 ceph-mon[28078]: [21/Sep/2024:00:49:06] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:07 smithi112 ceph-mon[28078]: [21/Sep/2024:00:49:06] ENGINE Error in HTTPServer.serve 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T00:49:08.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:49:08.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:07 smithi112 ceph-mon[28078]: [21/Sep/2024:00:49:06] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T00:49:08.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:07 smithi112 ceph-mon[28078]: [21/Sep/2024:00:49:06] ENGINE Bus STARTED 2024-09-21T00:49:08.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:07 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/2940156012' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:08.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:08.738 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:08.738 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:09.198 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:09.210 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:08 smithi112 ceph-mon[28078]: mgrmap e17: smithi112.fzmyfw(active, since 2s) 2024-09-21T00:49:09.250 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T00:49:09.921 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:09.921 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:09.922 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1760470629' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:10 smithi112 ceph-mon[28078]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:11.998 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:11.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:12.464 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:12.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:12.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:12 smithi112 ceph-mon[28078]: Deploying daemon ceph-exporter.smithi187 on smithi187 2024-09-21T00:49:13.312 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:13.312 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:13.312 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:13 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/2887555268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:14.822 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:14.823 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:15.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:15.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:15.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:49:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T00:49:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: Deploying daemon crash.smithi187 on smithi187 2024-09-21T00:49:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:15.831 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:16.702 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:16.702 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:16.702 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:17.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:16 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/3987109832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:18.384 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:18.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:18.683 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:18 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:18 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:18 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:19.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:18 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:19.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:18 smithi112 ceph-mon[28078]: Deploying daemon node-exporter.smithi187 on smithi187 2024-09-21T00:49:19.397 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:19.397 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:19.397 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:20.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:19 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1440907595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:21.535 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:21.536 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:21.790 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:22.510 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:22.510 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:22.510 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: Deploying daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:49:23.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:22 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/3906188675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:24.163 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:24.163 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:24.520 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:25.177 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:25.177 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:25.177 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:25.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:25 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/3066869592' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:26.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:26.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:26.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:26.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:26.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:26.420 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:26.420 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T00:49:26.420 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:26.420 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:26 smithi112 ceph-mon[28078]: Deploying daemon mon.smithi187 on smithi187 2024-09-21T00:49:27.021 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:27.021 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:28.140 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:49:28.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:28 smithi112 ceph-mon[28078]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:28.983 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:28 smithi187 podman[34965]: 2024-09-21 00:49:28.981930818 +0000 UTC m=+0.132995179 container create 09a6c459af745c143cf8435dc1e4ca8d6aa49b683526ace5627b66abb672bd8b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T00:49:28.991 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:28.991 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:47:12.183691Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:49:28.991 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T00:49:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:29 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/631275039' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 podman[34965]: 2024-09-21 00:49:29.385952482 +0000 UTC m=+0.537016849 container init 09a6c459af745c143cf8435dc1e4ca8d6aa49b683526ace5627b66abb672bd8b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T00:49:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 podman[34965]: 2024-09-21 00:49:29.389639446 +0000 UTC m=+0.540703814 container start 09a6c459af745c143cf8435dc1e4ca8d6aa49b683526ace5627b66abb672bd8b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:49:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:49:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 2 2024-09-21T00:49:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pidfile_write: ignore empty --pid-file 2024-09-21T00:49:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: load: jerasure load: lrc 2024-09-21T00:49:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Git sha 0 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: DB SUMMARY 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: DB Session ID: FDBDL2W2RO96551RPXGY 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi187/store.db dir, Total Num: 0, files: 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi187/store.db: 000004.log size: 511 ; 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:49:29.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:49:29.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:49:29.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.env: 0x5594eee23940 2024-09-21T00:49:29.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:49:29.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.info_log: 0x5594ef6e18c0 2024-09-21T00:49:29.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.statistics: (nil) 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.use_fsync: 0 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:49:29.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.db_log_dir: 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.wal_dir: 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.write_buffer_manager: 0x5594ef6f0dc0 2024-09-21T00:49:29.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.unordered_write: 0 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.row_cache: None 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.wal_filter: None 2024-09-21T00:49:29.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.wal_compression: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:49:29.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_open_files: -1 2024-09-21T00:49:29.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Compression algorithms supported: 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kZSTD supported: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:49:29.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi187/store.db/MANIFEST-000005 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.merge_operator: 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_filter: None 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5594ef6e1520) 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:49:29.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: index_type: 0 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: data_block_index_type: 0 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: index_shortening: 1 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: checksum: 4 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: no_block_cache: 0 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache: 0x5594ef6d51f0 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache_options: 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: capacity : 536870912 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: num_shard_bits : 4 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: strict_capacity_limit : 0 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache_compressed: (nil) 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: persistent_cache: (nil) 2024-09-21T00:49:29.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_size: 4096 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_size_deviation: 10 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_restart_interval: 16 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: index_block_restart_interval: 1 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: metadata_block_size: 4096 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: partition_filters: 0 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: use_delta_encoding: 1 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: filter_policy: bloomfilter 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: whole_key_filtering: 1 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: verify_compression: 0 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: format_version: 5 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: enable_index_compression: 1 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_align: 0 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: max_auto_readahead_size: 262144 2024-09-21T00:49:29.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: prepopulate_block_cache: 0 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression: NoCompression 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.num_levels: 7 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:49:29.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:49:29.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:49:29.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:49:29.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:49:29.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.ttl: 2592000 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:49:29.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi187/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b3c6305f-4e4e-49c1-ab98-004a8587f297 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879769416384, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T00:49:29.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879769416802, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879769, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b3c6305f-4e4e-49c1-ab98-004a8587f297", "db_session_id": "FDBDL2W2RO96551RPXGY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879769416912, "job": 1, "event": "recovery_finished"} 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi187/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5594ef702e00 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: DB pointer 0x5594ef7fe000 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** DB Stats ** 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:49:29.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** Compaction Stats [default] ** 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** Compaction Stats [default] ** 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:49:29.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Block cache BinnedLRUCache@0x5594ef6d51f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-21T00:49:29.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187 does not exist in monmap, will attempt to join an existing cluster 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: using public_addr v2:172.21.15.187:0/0 -> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: starting mon.smithi187 rank -1 at public addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] at bind addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi187 fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(???) e0 preinit fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).mds e1 new map 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).mds e1 print_map 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: e1 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: btime 2024-09-21T00:47:15:163755+0000 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: legacy client fscid: -1 2024-09-21T00:49:29.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: No filesystems configured 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:29.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying cephadm binary to smithi187 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon crash.smithi112 on smithi112 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Added host smithi187 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3545725521' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3545725521' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.685 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon alertmanager.smithi112 on smithi112 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi112:172.21.15.112=smithi112;smithi187:172.21.15.187=smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Saving service mon spec with placement smithi112:172.21.15.112=smithi112;smithi187:172.21.15.187=smithi187;count:2 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/2716101109' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1733230917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/758802146' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.686 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T00:49:29.687 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon grafana.smithi112 on smithi112 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/184752552' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/3547466643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1658915534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.688 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon prometheus.smithi112 on smithi112 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/3257751812' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/3621297159' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/2316219623' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1220449768' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.689 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/661420927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14162 172.21.15.112:0/2909113121' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mgrmap e14: smithi112.fzmyfw(active, since 51s) 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1642087952' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/3661121187' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Active manager daemon smithi112.fzmyfw restarted 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Activating manager daemon smithi112.fzmyfw 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T00:49:29.690 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mgrmap e15: smithi112.fzmyfw(active, starting, since 0.00301802s) 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Manager daemon smithi112.fzmyfw is now available 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.691 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mgrmap e16: smithi112.fzmyfw(active, since 1.00566s) 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: [21/Sep/2024:00:49:06] ENGINE Bus STARTING 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: [21/Sep/2024:00:49:06] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: [21/Sep/2024:00:49:06] ENGINE Error in HTTPServer.serve 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Traceback (most recent call last): 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._run(expiration_interval) 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: s = self.context.wrap_socket( 2024-09-21T00:49:29.692 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: return self.sslsocket_class._create( 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self.do_handshake() 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._sslobj.do_handshake() 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: [21/Sep/2024:00:49:06] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: [21/Sep/2024:00:49:06] ENGINE Bus STARTED 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/2940156012' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.693 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mgrmap e17: smithi112.fzmyfw(active, since 2s) 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1760470629' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:49:29.694 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.695 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon ceph-exporter.smithi187 on smithi187 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/2887555268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:49:29.696 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon crash.smithi187 on smithi187 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/3987109832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon node-exporter.smithi187 on smithi187 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1440907595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.697 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/3906188675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/3066869592' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:29.698 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T00:49:29.699 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:29.699 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: Deploying daemon mon.smithi187 on smithi187 2024-09-21T00:49:29.699 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:29.699 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/631275039' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:29.699 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 ceph-mon[34997]: mon.smithi187@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-21T00:49:29.699 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 bash[34965]: 09a6c459af745c143cf8435dc1e4ca8d6aa49b683526ace5627b66abb672bd8b 2024-09-21T00:49:29.699 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:29 smithi187 systemd[1]: Started Ceph mon.smithi187 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T00:49:31.111 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T00:49:31.111 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:31.359 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:49:34.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:34.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:49:34.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: mon.smithi112 calling monitor election 2024-09-21T00:49:34.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:49:34.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: mon.smithi187 calling monitor election 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: mon.smithi112 is new leader, mons smithi112,smithi187 in quorum (ranks 0,1) 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: monmap epoch 2 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: last_changed 2024-09-21T00:49:29.446962+0000 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: created 2024-09-21T00:47:12.183691+0000 2024-09-21T00:49:34.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: min_mon_release 19 (squid) 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: election_strategy: 1 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.smithi187 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: fsmap 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: mgrmap e17: smithi112.fzmyfw(active, since 29s) 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: overall HEALTH_OK 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.828 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.829 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.829 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:34 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:34.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:49:34.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: mon.smithi112 calling monitor election 2024-09-21T00:49:34.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:49:34.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: mon.smithi187 calling monitor election 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: mon.smithi112 is new leader, mons smithi112,smithi187 in quorum (ranks 0,1) 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: monmap epoch 2 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: last_changed 2024-09-21T00:49:29.446962+0000 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: created 2024-09-21T00:47:12.183691+0000 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: min_mon_release 19 (squid) 2024-09-21T00:49:34.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: election_strategy: 1 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.smithi187 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: fsmap 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: mgrmap e17: smithi112.fzmyfw(active, since 29s) 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: overall HEALTH_OK 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/3345250223' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.911 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:34.912 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:34 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:49:35.040 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":2,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","modified":"2024-09-21T00:49:29.446962Z","created":"2024-09-21T00:47:12.183691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi187","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:49:35.041 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 2 2024-09-21T00:49:35.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:35 smithi187 ceph-mon[34997]: mgrmap e18: smithi112.fzmyfw(active, since 29s), standbys: smithi187.hpbgni 2024-09-21T00:49:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi187.hpbgni", "id": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:49:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:49:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:35 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1611931236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:35 smithi187 ceph-mon[34997]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:35.791 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T00:49:35.791 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T00:49:35.818 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:35 smithi112 ceph-mon[28078]: mgrmap e18: smithi112.fzmyfw(active, since 29s), standbys: smithi187.hpbgni 2024-09-21T00:49:35.818 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi187.hpbgni", "id": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:49:35.818 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:49:35.818 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:35 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1611931236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T00:49:35.818 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:35 smithi112 ceph-mon[28078]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:35.818 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:35.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:49:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:# minimal ceph.conf for ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:49:36.730 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-21T00:49:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T00:49:36.730 INFO:teuthology.orchestra.run.smithi112.stdout: mon_host = [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-21T00:49:36.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:36 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4167144977' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:37.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:36 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4167144977' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:37.584 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T00:49:37.584 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:49:37.584 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:49:37.651 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:49:37.651 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:37.715 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:49:37.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:49:37.742 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:49:37.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:37.807 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T00:49:37.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T00:49:37.810 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T00:49:37.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T00:49:37.852 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T00:49:37.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T00:49:37.895 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T00:49:37.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T00:49:37.938 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T00:49:37.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T00:49:37.981 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T00:49:37.982 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T00:49:38.025 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T00:49:38.025 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T00:49:38.067 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T00:49:38.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T00:49:38.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:38.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:49:38.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T00:49:38.100 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:38.103 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T00:49:38.103 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T00:49:38.147 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T00:49:38.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T00:49:38.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:38.189 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T00:49:38.190 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T00:49:38.232 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T00:49:38.232 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T00:49:38.284 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T00:49:38.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T00:49:38.328 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T00:49:38.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T00:49:38.372 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T00:49:38.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T00:49:38.414 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T00:49:38.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T00:49:38.458 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T00:49:38.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T00:49:38.500 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T00:49:38.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T00:49:38.544 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T00:49:38.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T00:49:38.587 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T00:49:38.588 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T00:49:38.636 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T00:49:38.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T00:49:38.680 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T00:49:38.680 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T00:49:38.725 DEBUG:tasks.cephadm:set 22 configs 2024-09-21T00:49:38.725 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi112') 2024-09-21T00:49:39.139 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:39.259 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:38 smithi187 ceph-mon[34997]: Reconfiguring mon.smithi112 (unknown last config time)... 2024-09-21T00:49:39.259 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:38 smithi187 ceph-mon[34997]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-21T00:49:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:38 smithi112 ceph-mon[28078]: Reconfiguring mon.smithi112 (unknown last config time)... 2024-09-21T00:49:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:38 smithi112 ceph-mon[28078]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-21T00:49:39.910 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:40.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:40.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:40.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: Reconfiguring mgr.smithi112.fzmyfw (unknown last config time)... 2024-09-21T00:49:40.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.fzmyfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:49:40.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:49:40.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:40.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: Reconfiguring daemon mgr.smithi112.fzmyfw on smithi112 2024-09-21T00:49:40.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:40.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:40.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:40 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2580068394' entity='client.admin' 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: Reconfiguring mgr.smithi112.fzmyfw (unknown last config time)... 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.fzmyfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: Reconfiguring daemon mgr.smithi112.fzmyfw on smithi112 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:40 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2580068394' entity='client.admin' 2024-09-21T00:49:40.800 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi112') 2024-09-21T00:49:41.620 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:41.648 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:41.652 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:41.659 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:41.659 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:41.670 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:42.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:42 smithi112 ceph-mon[28078]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:42.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:42 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2802632004' entity='client.admin' 2024-09-21T00:49:42.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:42.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:42.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:49:42.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:42 smithi187 ceph-mon[34997]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:42 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2802632004' entity='client.admin' 2024-09-21T00:49:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:49:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:43.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:43 smithi112 ceph-mon[28078]: Reconfiguring ceph-exporter.smithi112 (monmap changed)... 2024-09-21T00:49:43.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:43 smithi112 ceph-mon[28078]: Reconfiguring daemon ceph-exporter.smithi112 on smithi112 2024-09-21T00:49:43.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:43 smithi187 ceph-mon[34997]: Reconfiguring ceph-exporter.smithi112 (monmap changed)... 2024-09-21T00:49:43.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:43 smithi187 ceph-mon[34997]: Reconfiguring daemon ceph-exporter.smithi112 on smithi112 2024-09-21T00:49:44.657 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:44 smithi112 ceph-mon[28078]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:44.658 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:44 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2195599847' entity='client.admin' 2024-09-21T00:49:44.658 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:44 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1627048349' entity='client.admin' 2024-09-21T00:49:44.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:44 smithi187 ceph-mon[34997]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:44.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:44 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2195599847' entity='client.admin' 2024-09-21T00:49:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:44 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1627048349' entity='client.admin' 2024-09-21T00:49:44.867 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:44.867 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:46.627 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:46 smithi112 ceph-mon[28078]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:46.627 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:46 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3775630597' entity='client.admin' 2024-09-21T00:49:46.627 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:46 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/142257999' entity='client.admin' 2024-09-21T00:49:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:46 smithi187 ceph-mon[34997]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:46 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3775630597' entity='client.admin' 2024-09-21T00:49:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:46 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/142257999' entity='client.admin' 2024-09-21T00:49:47.806 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:47.807 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:47.807 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:47.810 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:47.811 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:47.820 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:47.830 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:48.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:47 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3858760506' entity='client.admin' 2024-09-21T00:49:48.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:47 smithi187 ceph-mon[34997]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:48.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:47 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3858760506' entity='client.admin' 2024-09-21T00:49:48.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:47 smithi112 ceph-mon[28078]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:50.104 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:50 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2416887128' entity='client.admin' 2024-09-21T00:49:50.104 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:50 smithi112 ceph-mon[28078]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:50.104 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:50 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1955350108' entity='client.admin' 2024-09-21T00:49:50.363 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:50 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2416887128' entity='client.admin' 2024-09-21T00:49:50.363 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:50 smithi187 ceph-mon[34997]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:50.363 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:50 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1955350108' entity='client.admin' 2024-09-21T00:49:51.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:51.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:49:52.211 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:52 smithi112 ceph-mon[28078]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:52.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:52 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2542126466' entity='client.admin' 2024-09-21T00:49:52.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:52 smithi187 ceph-mon[34997]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:52.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:52 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2542126466' entity='client.admin' 2024-09-21T00:49:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:53 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2286888258' entity='client.admin' 2024-09-21T00:49:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:53 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4110528124' entity='client.admin' 2024-09-21T00:49:53.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:53 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2286888258' entity='client.admin' 2024-09-21T00:49:53.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:53 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4110528124' entity='client.admin' 2024-09-21T00:49:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:54 smithi112 ceph-mon[28078]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:49:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:54.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:54 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3446379917' entity='client.admin' 2024-09-21T00:49:54.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:54 smithi187 ceph-mon[34997]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:54.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:54.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:49:54.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:49:54.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:49:54.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:54 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3446379917' entity='client.admin' 2024-09-21T00:49:55.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:55 smithi112 ceph-mon[28078]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-21T00:49:55.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:55 smithi112 ceph-mon[28078]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-21T00:49:55.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:55 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3924882264' entity='client.admin' 2024-09-21T00:49:55.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:55 smithi187 ceph-mon[34997]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-21T00:49:55.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:55 smithi187 ceph-mon[34997]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-21T00:49:55.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:55 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3924882264' entity='client.admin' 2024-09-21T00:49:56.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:56 smithi112 ceph-mon[28078]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:56.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:56 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4195614119' entity='client.admin' 2024-09-21T00:49:56.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:56 smithi187 ceph-mon[34997]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:56.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:56 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4195614119' entity='client.admin' 2024-09-21T00:49:58.084 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:58.084 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:49:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:58 smithi187 ceph-mon[34997]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:58.668 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:58 smithi112 ceph-mon[28078]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:59.670 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi112') 2024-09-21T00:49:59.898 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:59 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3936068717' entity='client.admin' 2024-09-21T00:49:59.898 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:49:59 smithi112 ceph-mon[28078]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:59 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3936068717' entity='client.admin' 2024-09-21T00:50:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:49:59 smithi187 ceph-mon[34997]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:00 smithi187 ceph-mon[34997]: overall HEALTH_OK 2024-09-21T00:50:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:00 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3856082878' entity='client.admin' 2024-09-21T00:50:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:00 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1405593199' entity='client.admin' 2024-09-21T00:50:01.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:00 smithi112 ceph-mon[28078]: overall HEALTH_OK 2024-09-21T00:50:01.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:00 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3856082878' entity='client.admin' 2024-09-21T00:50:01.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:00 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1405593199' entity='client.admin' 2024-09-21T00:50:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:01 smithi187 ceph-mon[34997]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:01 smithi112 ceph-mon[28078]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:03.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 -- 172.21.15.112:0/4217852555 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f17c406e230 msgr2=0x7f17c40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:03.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 --2- 172.21.15.112:0/4217852555 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f17c406e230 0x7f17c40706f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17c00096c0 tx=0x7f17c0000bc0 comp rx=0 tx=0).stop 2024-09-21T00:50:03.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 -- 172.21.15.112:0/4217852555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d4102410 msgr2=0x7f17d4197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:03.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 --2- 172.21.15.112:0/4217852555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d4102410 0x7f17d4197450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f17c800d6f0 tx=0x7f17c800dbb0 comp rx=0 tx=0).stop 2024-09-21T00:50:03.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 -- 172.21.15.112:0/4217852555 shutdown_connections 2024-09-21T00:50:03.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 --2- 172.21.15.112:0/4217852555 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f17c406e230 0x7f17c40706f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:03.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 --2- 172.21.15.112:0/4217852555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17d4104d40 0x7f17d4197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:03.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 --2- 172.21.15.112:0/4217852555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17d4102410 0x7f17d4197450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:03.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 -- 172.21.15.112:0/4217852555 >> 172.21.15.112:0/4217852555 conn(0x7f17d40fc010 msgr2=0x7f17d40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:03.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 -- 172.21.15.112:0/4217852555 shutdown_connections 2024-09-21T00:50:03.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:03.808+0000 7f17dab25640 1 -- 172.21.15.112:0/4217852555 wait complete. 2024-09-21T00:50:04.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:03 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:04.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:03 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:04.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:03 smithi112 ceph-mon[28078]: Reconfiguring alertmanager.smithi112 (dependencies changed)... 2024-09-21T00:50:04.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:03 smithi112 ceph-mon[28078]: Reconfiguring daemon alertmanager.smithi112 on smithi112 2024-09-21T00:50:04.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:03 smithi112 ceph-mon[28078]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:04.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:03 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2998173215' entity='client.admin' 2024-09-21T00:50:04.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:03 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4217852555' entity='client.admin' 2024-09-21T00:50:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:03 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:03 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:03 smithi187 ceph-mon[34997]: Reconfiguring alertmanager.smithi112 (dependencies changed)... 2024-09-21T00:50:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:03 smithi187 ceph-mon[34997]: Reconfiguring daemon alertmanager.smithi112 on smithi112 2024-09-21T00:50:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:03 smithi187 ceph-mon[34997]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:03 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2998173215' entity='client.admin' 2024-09-21T00:50:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:03 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4217852555' entity='client.admin' 2024-09-21T00:50:05.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.578 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:05.606 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.606 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.607 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.607 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.607 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.607 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.607 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ede6b7bc-77b2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi112') 2024-09-21T00:50:05.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T00:50:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:06.037 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:50:06.418 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:06 smithi112 ceph-mon[28078]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:06 smithi187 ceph-mon[34997]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.308+0000 7fc7724f7640 1 -- 172.21.15.112:0/788775338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c100840 msgr2=0x7fc76c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.308+0000 7fc7724f7640 1 --2- 172.21.15.112:0/788775338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c100840 0x7fc76c100c40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009880 tx=0x7fc75c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.308+0000 7fc7724f7640 1 -- 172.21.15.112:0/788775338 shutdown_connections 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.308+0000 7fc7724f7640 1 --2- 172.21.15.112:0/788775338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c101a40 0x7fc76c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.308+0000 7fc7724f7640 1 --2- 172.21.15.112:0/788775338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c100840 0x7fc76c100c40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.308+0000 7fc7724f7640 1 -- 172.21.15.112:0/788775338 >> 172.21.15.112:0/788775338 conn(0x7fc76c0fbff0 msgr2=0x7fc76c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.308+0000 7fc7724f7640 1 -- 172.21.15.112:0/788775338 shutdown_connections 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.309+0000 7fc7724f7640 1 -- 172.21.15.112:0/788775338 wait complete. 2024-09-21T00:50:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.309+0000 7fc7724f7640 1 Processor -- start 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.309+0000 7fc7724f7640 1 -- start start 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.309+0000 7fc7724f7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c100840 0x7fc76c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.309+0000 7fc7724f7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c101a40 0x7fc76c19c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.309+0000 7fc7724f7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c1096e0 con 0x7fc76c101a40 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.309+0000 7fc7724f7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c109560 con 0x7fc76c100840 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c101a40 0x7fc76c19c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c101a40 0x7fc76c19c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49590/0 (socket says 172.21.15.112:49590) 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76b7fe640 1 -- 172.21.15.112:0/2404642630 learned_addr learned my addr 172.21.15.112:0/2404642630 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76bfff640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c100840 0x7fc76c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76b7fe640 1 -- 172.21.15.112:0/2404642630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c100840 msgr2=0x7fc76c06a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76b7fe640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c100840 0x7fc76c06a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76b7fe640 1 -- 172.21.15.112:0/2404642630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76c19c830 con 0x7fc76c101a40 2024-09-21T00:50:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc76b7fe640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c101a40 0x7fc76c19c270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc76000b420 tx=0x7fc76000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc7697fa640 1 -- 172.21.15.112:0/2404642630 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc760011630 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76c19cb20 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc7697fa640 1 -- 172.21.15.112:0/2404642630 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc760016070 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc7697fa640 1 -- 172.21.15.112:0/2404642630 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc760010d30 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.310+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76c19d130 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.311+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76c100c40 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.312+0000 7fc7697fa640 1 -- 172.21.15.112:0/2404642630 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7fc76001b460 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.312+0000 7fc7697fa640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc75406e230 0x7fc7540706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.312+0000 7fc7697fa640 1 -- 172.21.15.112:0/2404642630 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc76008c910 con 0x7fc76c101a40 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.312+0000 7fc76bfff640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc75406e230 0x7fc7540706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.312+0000 7fc76bfff640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc75406e230 0x7fc7540706f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc75c000c00 tx=0x7fc75c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:08.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.316+0000 7fc7697fa640 1 -- 172.21.15.112:0/2404642630 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc76005b2c0 con 0x7fc76c101a40 2024-09-21T00:50:08.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.495+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc76c02d7c0 con 0x7fc76c101a40 2024-09-21T00:50:08.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.496+0000 7fc7697fa640 1 -- 172.21.15.112:0/2404642630 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) ==== 59+0+18512 (secure 0 0 0) 0x7fc76005ef70 con 0x7fc76c101a40 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global dev auth_debug true 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64 * 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global basic log_to_file true 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global basic log_to_journald false 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global basic log_to_stderr false 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_allow_pool_delete true 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T00:50:08.497 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_cluster_log_file_level debug 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_pg_warn_min_per_osd 0 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global dev ms_die_on_bug true 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global dev ms_die_on_old_message true 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T00:50:08.498 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced debug_mon 20/20 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced debug_ms 1/1 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced debug_paxos 20/20 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T00:50:08.499 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced client_mount_timeout 30 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced debug_client 20/20 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced debug_mgr 20/20 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced debug_ms 1/1 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mgr/dashboard/GRAFANA_API_SSL_VERIFY false * 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced bdev_async_discard true 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev bdev_debug_aio true 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced bdev_enable_discard true 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced debug_bluefs 1/20 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced debug_bluestore 1/20 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced debug_ms 1/1 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced debug_osd 20/20 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_class_default_list * * 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_class_load_list * * 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T00:50:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev osd_debug_op_order true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev osd_debug_shutdown true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T00:50:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced debug_mds 20/20 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced debug_ms 2/2 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds dev mds_debug_frag true 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds dev mds_debug_scatterstat true 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds dev mds_verify_scatter true 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T00:50:08.503 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced client_mount_timeout 600 2024-09-21T00:50:08.504 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced debug_client 20/20 2024-09-21T00:50:08.504 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced debug_ms 1/1 2024-09-21T00:50:08.504 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T00:50:08.504 INFO:teuthology.orchestra.run.smithi112.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T00:50:08.504 INFO:teuthology.orchestra.run.smithi112.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T00:50:08.504 INFO:teuthology.orchestra.run.smithi112.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T00:50:08.504 INFO:teuthology.orchestra.run.smithi112.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc75406e230 msgr2=0x7fc7540706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc75406e230 0x7fc7540706f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc75c000c00 tx=0x7fc75c005a20 comp rx=0 tx=0).stop 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c101a40 msgr2=0x7fc76c19c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c101a40 0x7fc76c19c270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc76000b420 tx=0x7fc76000b8e0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 shutdown_connections 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc75406e230 0x7fc7540706f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc76c101a40 0x7fc76c19c270 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 --2- 172.21.15.112:0/2404642630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c100840 0x7fc76c06a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:08.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 >> 172.21.15.112:0/2404642630 conn(0x7fc76c0fbff0 msgr2=0x7fc76c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:08.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 shutdown_connections 2024-09-21T00:50:08.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:08.498+0000 7fc7724f7640 1 -- 172.21.15.112:0/2404642630 wait complete. 2024-09-21T00:50:08.606 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:08 smithi112 ceph-mon[28078]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:08.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:08 smithi187 ceph-mon[34997]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:09.227 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T00:50:09.227 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:50:09.227 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:50:09.243 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:50:09.243 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 00:48:58.820279395 +0000 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 00:43:57.416207829 +0000 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 00:43:57.416207829 +0000 2024-09-21T00:50:09.299 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 00:43:57.416207829 +0000 2024-09-21T00:50:09.300 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:50:09.361 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:09 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2404642630' entity='client.admin' cmd=[{"prefix": "config dump"}]: dispatch 2024-09-21T00:50:09.365 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T00:50:09.365 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T00:50:09.365 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00021111 s, 2.4 MB/s 2024-09-21T00:50:09.366 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:50:09.422 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 00:48:58.820279395 +0000 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 00:43:57.738199473 +0000 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 00:43:57.738199473 +0000 2024-09-21T00:50:09.479 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 00:43:57.738199473 +0000 2024-09-21T00:50:09.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:50:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T00:50:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T00:50:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000205112 s, 2.5 MB/s 2024-09-21T00:50:09.544 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:50:09.600 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-21T00:50:09.657 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 00:48:58.821279369 +0000 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 00:43:58.076190701 +0000 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 00:43:58.076190701 +0000 2024-09-21T00:50:09.658 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 00:43:58.076190701 +0000 2024-09-21T00:50:09.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:50:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:09 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2404642630' entity='client.admin' cmd=[{"prefix": "config dump"}]: dispatch 2024-09-21T00:50:09.723 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T00:50:09.723 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T00:50:09.723 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000185958 s, 2.8 MB/s 2024-09-21T00:50:09.724 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:50:09.781 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 00:48:58.821279369 +0000 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 00:43:58.400182293 +0000 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 00:43:58.400182293 +0000 2024-09-21T00:50:09.838 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 00:43:58.400182293 +0000 2024-09-21T00:50:09.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:50:09.902 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T00:50:09.902 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T00:50:09.902 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000225028 s, 2.3 MB/s 2024-09-21T00:50:09.903 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:50:09.959 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:50:09.959 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:50:09.981 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:50:09.981 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-09-21T00:50:10.040 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 00:49:28.650087560 +0000 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 00:43:57.410786239 +0000 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 00:43:57.410786239 +0000 2024-09-21T00:50:10.041 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 00:43:57.410786239 +0000 2024-09-21T00:50:10.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:50:10.111 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T00:50:10.111 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T00:50:10.111 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000237248 s, 2.2 MB/s 2024-09-21T00:50:10.112 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:50:10.172 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-09-21T00:50:10.230 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:50:10.230 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T00:50:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 00:49:28.650087560 +0000 2024-09-21T00:50:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 00:43:57.734781296 +0000 2024-09-21T00:50:10.231 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 00:43:57.734781296 +0000 2024-09-21T00:50:10.231 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 00:43:57.734781296 +0000 2024-09-21T00:50:10.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:50:10.297 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T00:50:10.298 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T00:50:10.298 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000208434 s, 2.5 MB/s 2024-09-21T00:50:10.299 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:50:10.358 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-09-21T00:50:10.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:10 smithi187 ceph-mon[34997]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 00:49:28.651087545 +0000 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 00:43:58.061776307 +0000 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 00:43:58.061776307 +0000 2024-09-21T00:50:10.416 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 00:43:58.061776307 +0000 2024-09-21T00:50:10.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:50:10.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:10 smithi112 ceph-mon[28078]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.482 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T00:50:10.482 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T00:50:10.482 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.00022087 s, 2.3 MB/s 2024-09-21T00:50:10.487 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:50:10.544 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-09-21T00:50:10.600 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:50:10.600 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:10.600 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T00:50:10.600 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:10.600 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:10.600 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 00:49:28.651087545 +0000 2024-09-21T00:50:10.600 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 00:43:58.390771287 +0000 2024-09-21T00:50:10.601 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 00:43:58.390771287 +0000 2024-09-21T00:50:10.601 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 00:43:58.390771287 +0000 2024-09-21T00:50:10.601 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:50:10.665 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T00:50:10.665 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T00:50:10.665 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000328388 s, 1.6 MB/s 2024-09-21T00:50:10.667 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:50:10.723 INFO:tasks.cephadm:Deploying osd.0 on smithi112 with /dev/vg_nvme/lv_4... 2024-09-21T00:50:10.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:50:11.002 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:50:12.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:11 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:12.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:11 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:12.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:11 smithi112 ceph-mon[28078]: Reconfiguring grafana.smithi112 (dependencies changed)... 2024-09-21T00:50:12.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:11 smithi112 ceph-mon[28078]: Reconfiguring daemon grafana.smithi112 on smithi112 2024-09-21T00:50:12.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:11 smithi112 ceph-mon[28078]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:11 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:11 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:11 smithi187 ceph-mon[34997]: Reconfiguring grafana.smithi112 (dependencies changed)... 2024-09-21T00:50:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:11 smithi187 ceph-mon[34997]: Reconfiguring daemon grafana.smithi112 on smithi112 2024-09-21T00:50:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:11 smithi187 ceph-mon[34997]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:14 smithi112 ceph-mon[28078]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:14 smithi187 ceph-mon[34997]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:16.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:16 smithi112 ceph-mon[28078]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:16.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:16.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:16 smithi187 ceph-mon[34997]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:17.425 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:17 smithi112 ceph-mon[28078]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-21T00:50:17.425 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:17 smithi112 ceph-mon[28078]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-21T00:50:17.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:50:17.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-09-21T00:50:17.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:17 smithi187 ceph-mon[34997]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-21T00:50:17.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:17 smithi187 ceph-mon[34997]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-21T00:50:18.560 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:18 smithi187 ceph-mon[34997]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:18 smithi112 ceph-mon[28078]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:20.281 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:50:20.407 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:20 smithi112 ceph-mon[28078]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:20.408 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:20.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:20 smithi187 ceph-mon[34997]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:20.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:20.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 -- 172.21.15.112:0/762597477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 msgr2=0x7f1544100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:20.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 --2- 172.21.15.112:0/762597477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f1544100c40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1534009880 tx=0x7f153402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:50:20.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 -- 172.21.15.112:0/762597477 shutdown_connections 2024-09-21T00:50:20.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 --2- 172.21.15.112:0/762597477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1544101a40 0x7f1544101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:20.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 --2- 172.21.15.112:0/762597477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f1544100c40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:20.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 -- 172.21.15.112:0/762597477 >> 172.21.15.112:0/762597477 conn(0x7f15440fbff0 msgr2=0x7f15440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:20.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 -- 172.21.15.112:0/762597477 shutdown_connections 2024-09-21T00:50:20.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.750+0000 7f15490a6640 1 -- 172.21.15.112:0/762597477 wait complete. 2024-09-21T00:50:20.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f15490a6640 1 Processor -- start 2024-09-21T00:50:20.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f15490a6640 1 -- start start 2024-09-21T00:50:20.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f15490a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f15441974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:20.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f15490a6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1544101a40 0x7f1544197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:20.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f15490a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1544109660 con 0x7f1544100840 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f15490a6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f15441094e0 con 0x7f1544101a40 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f1542d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f15441974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f1542d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f15441974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54230/0 (socket says 172.21.15.112:54230) 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.751+0000 7f1542d9d640 1 -- 172.21.15.112:0/3249693691 learned_addr learned my addr 172.21.15.112:0/3249693691 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f154259c640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1544101a40 0x7f1544197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f1542d9d640 1 -- 172.21.15.112:0/3249693691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1544101a40 msgr2=0x7f1544197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f1542d9d640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1544101a40 0x7f1544197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f1542d9d640 1 -- 172.21.15.112:0/3249693691 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15441980a0 con 0x7f1544100840 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f1542d9d640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f15441974e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1534006010 tx=0x7f15340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f152bfff640 1 -- 172.21.15.112:0/3249693691 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f153403f070 con 0x7f1544100840 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f152bfff640 1 -- 172.21.15.112:0/3249693691 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1534004a50 con 0x7f1544100840 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154419ca80 con 0x7f1544100840 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f152bfff640 1 -- 172.21.15.112:0/3249693691 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1534035030 con 0x7f1544100840 2024-09-21T00:50:20.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.752+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154419d010 con 0x7f1544100840 2024-09-21T00:50:20.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.753+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1544100c40 con 0x7f1544100840 2024-09-21T00:50:20.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.754+0000 7f152bfff640 1 -- 172.21.15.112:0/3249693691 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f1534042070 con 0x7f1544100840 2024-09-21T00:50:20.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.755+0000 7f152bfff640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f152c06e280 0x7f152c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:20.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.755+0000 7f154259c640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f152c06e280 0x7f152c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:20.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.755+0000 7f152bfff640 1 -- 172.21.15.112:0/3249693691 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f15340adc20 con 0x7f1544100840 2024-09-21T00:50:20.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.755+0000 7f154259c640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f152c06e280 0x7f152c070740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1538005d00 tx=0x7f1538005c50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:20.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.759+0000 7f152bfff640 1 -- 172.21.15.112:0/3249693691 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f153407c5c0 con 0x7f1544100840 2024-09-21T00:50:20.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:20.957+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f154419d240 con 0x7f152c06e280 2024-09-21T00:50:21.547 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:21 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:50:21.547 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:21 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:50:21.547 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:21 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:21.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:21 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:50:21.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:21 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:50:21.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:21 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:22.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:22 smithi187 ceph-mon[34997]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:22.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:22 smithi187 ceph-mon[34997]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:22.680 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:22 smithi112 ceph-mon[28078]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:22.680 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:22 smithi112 ceph-mon[28078]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:24.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:24.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: Reconfiguring ceph-exporter.smithi187 (monmap changed)... 2024-09-21T00:50:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:50:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: Reconfiguring daemon ceph-exporter.smithi187 on smithi187 2024-09-21T00:50:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/587194756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf9e830a-c469-4288-97b6-d514ed6f5cbc"}]: dispatch 2024-09-21T00:50:24.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/587194756' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf9e830a-c469-4288-97b6-d514ed6f5cbc"}]': finished 2024-09-21T00:50:24.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:50:24.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:24 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: Reconfiguring ceph-exporter.smithi187 (monmap changed)... 2024-09-21T00:50:24.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:50:24.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:24.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: Reconfiguring daemon ceph-exporter.smithi187 on smithi187 2024-09-21T00:50:24.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/587194756' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf9e830a-c469-4288-97b6-d514ed6f5cbc"}]: dispatch 2024-09-21T00:50:24.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/587194756' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf9e830a-c469-4288-97b6-d514ed6f5cbc"}]': finished 2024-09-21T00:50:24.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:50:24.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:24 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:25.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:25 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:25.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:25 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:25.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:25 smithi112 ceph-mon[28078]: Reconfiguring crash.smithi187 (monmap changed)... 2024-09-21T00:50:25.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:25 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:50:25.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:25 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:25.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:25 smithi112 ceph-mon[28078]: Reconfiguring daemon crash.smithi187 on smithi187 2024-09-21T00:50:25.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:25 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/40657505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:50:25.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:25 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:25.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:25 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:25.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:25 smithi187 ceph-mon[34997]: Reconfiguring crash.smithi187 (monmap changed)... 2024-09-21T00:50:25.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:25 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T00:50:25.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:25 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:25.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:25 smithi187 ceph-mon[34997]: Reconfiguring daemon crash.smithi187 on smithi187 2024-09-21T00:50:25.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:25 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/40657505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:50:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:26 smithi187 ceph-mon[34997]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:50:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:50:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:27.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:26 smithi112 ceph-mon[28078]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:27.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:27.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:27.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:50:27.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:50:27.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:27.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:27 smithi187 ceph-mon[34997]: Reconfiguring mgr.smithi187.hpbgni (monmap changed)... 2024-09-21T00:50:27.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:27 smithi187 ceph-mon[34997]: Reconfiguring daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:50:27.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:27 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:27.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:27 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:27.643 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:27 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T00:50:27.643 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:27 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T00:50:27.643 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:27 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:28.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:27 smithi112 ceph-mon[28078]: Reconfiguring mgr.smithi187.hpbgni (monmap changed)... 2024-09-21T00:50:28.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:27 smithi112 ceph-mon[28078]: Reconfiguring daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:50:28.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:27 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:27 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:27 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T00:50:28.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:27 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T00:50:28.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:27 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: Reconfiguring mon.smithi187 (monmap changed)... 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: Reconfiguring daemon mon.smithi187 on smithi187 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T00:50:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T00:50:28.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:50:28.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T00:50:28.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:28 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:28.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: Reconfiguring mon.smithi187 (monmap changed)... 2024-09-21T00:50:28.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: Reconfiguring daemon mon.smithi187 on smithi187 2024-09-21T00:50:28.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T00:50:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:28.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:28 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:29.619 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:29 smithi112 ceph-mon[28078]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:50:29.619 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:29 smithi112 ceph-mon[28078]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T00:50:29.619 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:29 smithi112 ceph-mon[28078]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T00:50:29.619 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:29 smithi112 ceph-mon[28078]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T00:50:29.619 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:29 smithi112 ceph-mon[28078]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:50:29.619 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:29 smithi112 ceph-mon[28078]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T00:50:29.811 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:29 smithi187 ceph-mon[34997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:50:29.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:29 smithi187 ceph-mon[34997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi112.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T00:50:29.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:29 smithi187 ceph-mon[34997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T00:50:29.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:29 smithi187 ceph-mon[34997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi112.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T00:50:29.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:29 smithi187 ceph-mon[34997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:50:29.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:29 smithi187 ceph-mon[34997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi112.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T00:50:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:30 smithi112 ceph-mon[28078]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:30 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:30 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:30.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:30 smithi187 ceph-mon[34997]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:30 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:30 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:31.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:31 smithi112 ceph-mon[28078]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:31.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:31 smithi187 ceph-mon[34997]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:34 smithi112 ceph-mon[28078]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:34 smithi187 ceph-mon[34997]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:35.848 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:35.848 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:35.848 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T00:50:35.848 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:35.848 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: Deploying daemon osd.0 on smithi112 2024-09-21T00:50:35.848 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:35.849 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:35.849 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:35.849 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:50:35.849 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: Deploying daemon osd.0 on smithi112 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:50:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:38.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:38 smithi112 ceph-mon[28078]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:38.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:38 smithi187 ceph-mon[34997]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:40.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:40 smithi112 ceph-mon[28078]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:40 smithi187 ceph-mon[34997]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:42.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:42 smithi112 ceph-mon[28078]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:42.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:42.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:42.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:42.577 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:42 smithi187 ceph-mon[34997]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:42.577 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:42.577 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:42.577 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:44.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:44 smithi112 ceph-mon[28078]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:44.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:44 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:44.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:44 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:44.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:44 smithi187 ceph-mon[34997]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:44.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:44 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:44.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:44 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:46.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.351+0000 7f152bfff640 1 -- 172.21.15.112:0/3249693691 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f154419d240 con 0x7f152c06e280 2024-09-21T00:50:46.353 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 0 on host 'smithi112' 2024-09-21T00:50:46.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f152c06e280 msgr2=0x7f152c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f152c06e280 0x7f152c070740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1538005d00 tx=0x7f1538005c50 comp rx=0 tx=0).stop 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 msgr2=0x7f15441974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f15441974e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1534006010 tx=0x7f15340045e0 comp rx=0 tx=0).stop 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 shutdown_connections 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f152c06e280 0x7f152c070740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1544101a40 0x7f1544197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 --2- 172.21.15.112:0/3249693691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1544100840 0x7f15441974e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 >> 172.21.15.112:0/3249693691 conn(0x7f15440fbff0 msgr2=0x7f1544069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 shutdown_connections 2024-09-21T00:50:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:46.354+0000 7f15490a6640 1 -- 172.21.15.112:0/3249693691 wait complete. 2024-09-21T00:50:46.719 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:46 smithi112 ceph-mon[28078]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:46.719 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:46 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:46.719 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:46 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:46 smithi187 ceph-mon[34997]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:46 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:46 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:47.060 DEBUG:teuthology.orchestra.run.smithi112:osd.0> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T00:50:47.063 INFO:tasks.cephadm:Deploying osd.1 on smithi112 with /dev/vg_nvme/lv_3... 2024-09-21T00:50:47.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:50:47.805 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:50:48.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:50:48 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[50229]: 2024-09-21T00:50:48.068+0000 7fb6bfc1b640 -1 osd.0 0 log_to_monitors true 2024-09-21T00:50:48.795 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:48 smithi112 ceph-mon[28078]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:48.795 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:48 smithi112 ceph-mon[28078]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T00:50:48.795 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:48 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:48.795 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:48 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:48.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:48 smithi187 ceph-mon[34997]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:48.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:48 smithi187 ceph-mon[34997]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T00:50:48.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:48 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:48.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:48 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:49.876 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[50229]: 2024-09-21T00:50:49.528+0000 7fb6bb37b640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T00:50:49.877 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[50229]: 2024-09-21T00:50:49.531+0000 7fb6b79b5640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T00:50:49.877 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:49.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:50:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:50:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T00:50:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: from='osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T00:50:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T00:50:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:50 smithi112 ceph-mon[28078]: osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] boot 2024-09-21T00:50:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:50 smithi112 ceph-mon[28078]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:50:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:50 smithi187 ceph-mon[34997]: osd.0 [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] boot 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:50 smithi187 ceph-mon[34997]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:50:51.612 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:50:51.636 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-09-21T00:50:51.846 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:51 smithi112 ceph-mon[28078]: purged_snaps scrub starts 2024-09-21T00:50:51.846 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:51 smithi112 ceph-mon[28078]: purged_snaps scrub ok 2024-09-21T00:50:51.846 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:51 smithi112 ceph-mon[28078]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:51.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:51 smithi187 ceph-mon[34997]: purged_snaps scrub starts 2024-09-21T00:50:51.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:51 smithi187 ceph-mon[34997]: purged_snaps scrub ok 2024-09-21T00:50:51.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:51 smithi187 ceph-mon[34997]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:52.353 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:50:52.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:52 smithi112 ceph-mon[28078]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T00:50:52.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:52 smithi187 ceph-mon[34997]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T00:50:52.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 -- 172.21.15.112:0/4067995871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90101970 msgr2=0x7f8a90101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:52.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 --2- 172.21.15.112:0/4067995871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90101970 0x7f8a90101d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009880 tx=0x7f8a8002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:50:52.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 -- 172.21.15.112:0/4067995871 shutdown_connections 2024-09-21T00:50:52.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 --2- 172.21.15.112:0/4067995871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a90102b70 0x7f8a90102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:52.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 --2- 172.21.15.112:0/4067995871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90101970 0x7f8a90101d70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 -- 172.21.15.112:0/4067995871 >> 172.21.15.112:0/4067995871 conn(0x7f8a900fd140 msgr2=0x7f8a900ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 -- 172.21.15.112:0/4067995871 shutdown_connections 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.961+0000 7f8a9569b640 1 -- 172.21.15.112:0/4067995871 wait complete. 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a9569b640 1 Processor -- start 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a9569b640 1 -- start start 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a9569b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a90101970 0x7f8a90197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a9569b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90102b70 0x7f8a901979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a9569b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9010a790 con 0x7f8a90102b70 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a9569b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9010a610 con 0x7f8a90101970 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a867fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90102b70 0x7f8a901979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a867fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90102b70 0x7f8a901979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41736/0 (socket says 172.21.15.112:41736) 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.962+0000 7f8a867fc640 1 -- 172.21.15.112:0/3281792806 learned_addr learned my addr 172.21.15.112:0/3281792806 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:50:52.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a8effd640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a90101970 0x7f8a90197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a867fc640 1 -- 172.21.15.112:0/3281792806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a90101970 msgr2=0x7f8a90197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a867fc640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a90101970 0x7f8a90197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a867fc640 1 -- 172.21.15.112:0/3281792806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a90197fb0 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a867fc640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90102b70 0x7f8a901979c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c8a0 tx=0x7f8a7800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a8cff9640 1 -- 172.21.15.112:0/3281792806 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a780079b0 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a8cff9640 1 -- 172.21.15.112:0/3281792806 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a78007b50 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9019ca20 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a8cff9640 1 -- 172.21.15.112:0/3281792806 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a78018700 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.963+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9019cf80 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.964+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a90101d70 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.965+0000 7f8a8cff9640 1 -- 172.21.15.112:0/3281792806 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f8a780188c0 con 0x7f8a90102b70 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.965+0000 7f8a8cff9640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8a7c06e230 0x7f8a7c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.965+0000 7f8a8cff9640 1 -- 172.21.15.112:0/3281792806 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f8a7808d500 con 0x7f8a90102b70 2024-09-21T00:50:52.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.965+0000 7f8a8effd640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8a7c06e230 0x7f8a7c0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:52.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.966+0000 7f8a8effd640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8a7c06e230 0x7f8a7c0706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009230 tx=0x7f8a800058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:52.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:52.970+0000 7f8a8cff9640 1 -- 172.21.15.112:0/3281792806 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a78014030 con 0x7f8a90102b70 2024-09-21T00:50:53.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:50:53.154+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8a901070f0 con 0x7f8a7c06e230 2024-09-21T00:50:53.729 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:53 smithi112 ceph-mon[28078]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:53.730 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:53 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:50:53.730 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:53 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:50:53.730 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:53 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:53.730 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:53 smithi112 ceph-mon[28078]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:50:53.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:53 smithi187 ceph-mon[34997]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:53.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:53 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:50:53.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:53 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:50:53.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:53 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:53.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:53 smithi187 ceph-mon[34997]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: Detected new or changed devices on smithi112 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi112 to 11840M 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:50:55.186 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.187 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:55 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: Detected new or changed devices on smithi112 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi112 to 11840M 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:55 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:50:56.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:56 smithi112 ceph-mon[28078]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:50:56.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:56 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:56.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:56 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:56.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:56 smithi187 ceph-mon[34997]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:50:56.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:56 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:56.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:56 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:50:57.329 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:57 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2782458163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70a071b-237d-453a-b32c-36b6fe38e1f3"}]: dispatch 2024-09-21T00:50:57.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:57 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2782458163' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e70a071b-237d-453a-b32c-36b6fe38e1f3"}]': finished 2024-09-21T00:50:57.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:57 smithi112 ceph-mon[28078]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:50:57.330 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:57 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:50:57.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:57 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2782458163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70a071b-237d-453a-b32c-36b6fe38e1f3"}]: dispatch 2024-09-21T00:50:57.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:57 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2782458163' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e70a071b-237d-453a-b32c-36b6fe38e1f3"}]': finished 2024-09-21T00:50:57.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:57 smithi187 ceph-mon[34997]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:50:57.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:57 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:50:58.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:58 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/383497089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:50:58.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:50:58 smithi112 ceph-mon[28078]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:50:58.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:58 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/383497089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:50:58.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:50:58 smithi187 ceph-mon[34997]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:00.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:00 smithi112 ceph-mon[28078]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:00.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:00 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:00.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:00 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:00.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:00 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:00.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:00 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:00.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:00 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:00 smithi187 ceph-mon[34997]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:00 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:00 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:00 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:00 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:00 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:02.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:02 smithi112 ceph-mon[28078]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:02.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:02 smithi187 ceph-mon[34997]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:04.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:04 smithi112 ceph-mon[28078]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:04.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:04 smithi187 ceph-mon[34997]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T00:51:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T00:51:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:06.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:06 smithi112 ceph-mon[28078]: Deploying daemon osd.1 on smithi112 2024-09-21T00:51:06.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:06 smithi112 ceph-mon[28078]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:06.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:06 smithi187 ceph-mon[34997]: Deploying daemon osd.1 on smithi112 2024-09-21T00:51:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:06 smithi187 ceph-mon[34997]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:08.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:08 smithi112 ceph-mon[28078]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:08.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:08 smithi187 ceph-mon[34997]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:10.489 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:10 smithi112 ceph-mon[28078]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:10.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:10 smithi187 ceph-mon[34997]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:12.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:12 smithi187 ceph-mon[34997]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:12 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:12 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:12 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:12.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:12 smithi112 ceph-mon[28078]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:12.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:12.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:12.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:12 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:14.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:14.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:14.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:14 smithi112 ceph-mon[28078]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:14.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:14 smithi187 ceph-mon[34997]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:15.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.435+0000 7f8a8cff9640 1 -- 172.21.15.112:0/3281792806 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8a901070f0 con 0x7f8a7c06e230 2024-09-21T00:51:15.437 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 1 on host 'smithi112' 2024-09-21T00:51:15.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8a7c06e230 msgr2=0x7f8a7c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:15.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8a7c06e230 0x7f8a7c0706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009230 tx=0x7f8a800058d0 comp rx=0 tx=0).stop 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90102b70 msgr2=0x7f8a901979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90102b70 0x7f8a901979c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c8a0 tx=0x7f8a7800cd60 comp rx=0 tx=0).stop 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 shutdown_connections 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8a7c06e230 0x7f8a7c0706f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a90102b70 0x7f8a901979c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 --2- 172.21.15.112:0/3281792806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a90101970 0x7f8a90197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 >> 172.21.15.112:0/3281792806 conn(0x7f8a900fd140 msgr2=0x7f8a900ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 shutdown_connections 2024-09-21T00:51:15.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:15.437+0000 7f8a9569b640 1 -- 172.21.15.112:0/3281792806 wait complete. 2024-09-21T00:51:16.059 DEBUG:teuthology.orchestra.run.smithi112:osd.1> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T00:51:16.061 INFO:tasks.cephadm:Deploying osd.2 on smithi112 with /dev/vg_nvme/lv_2... 2024-09-21T00:51:16.061 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:51:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:16 smithi112 ceph-mon[28078]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:16.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:16 smithi187 ceph-mon[34997]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:16.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:16.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:17.521 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:51:17.950 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[57907]: 2024-09-21T00:51:17.741+0000 7fc334b1b640 -1 osd.1 0 log_to_monitors true 2024-09-21T00:51:18.626 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:18 smithi112 ceph-mon[28078]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:18.627 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:18 smithi112 ceph-mon[28078]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T00:51:18.711 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:18 smithi187 ceph-mon[34997]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:18.711 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:18 smithi187 ceph-mon[34997]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T00:51:19.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:19 smithi187 ceph-mon[34997]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:51:19.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:19 smithi187 ceph-mon[34997]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:51:19.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:19 smithi187 ceph-mon[34997]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T00:51:19.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:19 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:19.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:19 smithi187 ceph-mon[34997]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T00:51:19.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:19 smithi187 ceph-mon[34997]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T00:51:19.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:19 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:19 smithi112 ceph-mon[28078]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:51:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:19 smithi112 ceph-mon[28078]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:51:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:19 smithi112 ceph-mon[28078]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T00:51:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:19 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:19 smithi112 ceph-mon[28078]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T00:51:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:19 smithi112 ceph-mon[28078]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T00:51:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:19 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:20.503 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[57907]: 2024-09-21T00:51:20.268+0000 7fc33027b640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T00:51:20.503 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[57907]: 2024-09-21T00:51:20.274+0000 7fc3288ad640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:51:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-mon[28078]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-mon[28078]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' 2024-09-21T00:51:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:20 smithi187 ceph-mon[34997]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:20 smithi187 ceph-mon[34997]: from='osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047]' entity='osd.1' 2024-09-21T00:51:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:21.186 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:51:21.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-09-21T00:51:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:21 smithi112 ceph-mon[28078]: purged_snaps scrub starts 2024-09-21T00:51:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:21 smithi112 ceph-mon[28078]: purged_snaps scrub ok 2024-09-21T00:51:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:21 smithi112 ceph-mon[28078]: osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] boot 2024-09-21T00:51:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:21 smithi112 ceph-mon[28078]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:51:21.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:21 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:21 smithi187 ceph-mon[34997]: purged_snaps scrub starts 2024-09-21T00:51:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:21 smithi187 ceph-mon[34997]: purged_snaps scrub ok 2024-09-21T00:51:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:21 smithi187 ceph-mon[34997]: osd.1 [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] boot 2024-09-21T00:51:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:21 smithi187 ceph-mon[34997]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:51:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:21 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:51:22.203 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:51:22.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 -- 172.21.15.112:0/4146726326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 msgr2=0x7f32c4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 --2- 172.21.15.112:0/4146726326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4100c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009880 tx=0x7f32b802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 -- 172.21.15.112:0/4146726326 shutdown_connections 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 --2- 172.21.15.112:0/4146726326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c4101a80 0x7f32c4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 --2- 172.21.15.112:0/4146726326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4100c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 -- 172.21.15.112:0/4146726326 >> 172.21.15.112:0/4146726326 conn(0x7f32c40fc010 msgr2=0x7f32c40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 -- 172.21.15.112:0/4146726326 shutdown_connections 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.675+0000 7f32cae34640 1 -- 172.21.15.112:0/4146726326 wait complete. 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.676+0000 7f32cae34640 1 Processor -- start 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.676+0000 7f32cae34640 1 -- start start 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32cae34640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32cae34640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c4101a80 0x7f32c4196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32cae34640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4109720 con 0x7f32c4100880 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32cae34640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f32c41095a0 con 0x7f32c4101a80 2024-09-21T00:51:22.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c8bd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c8bd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44896/0 (socket says 172.21.15.112:44896) 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c8bd0640 1 -- 172.21.15.112:0/3184843710 learned_addr learned my addr 172.21.15.112:0/3184843710 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c8bd0640 1 -- 172.21.15.112:0/3184843710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c4101a80 msgr2=0x7f32c4196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c3fff640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c4101a80 0x7f32c4196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c8bd0640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c4101a80 0x7f32c4196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c8bd0640 1 -- 172.21.15.112:0/3184843710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c4196fd0 con 0x7f32c4100880 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c8bd0640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4196410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c1ffb640 1 -- 172.21.15.112:0/3184843710 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32b8035070 con 0x7f32c4100880 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c1ffb640 1 -- 172.21.15.112:0/3184843710 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32b80044d0 con 0x7f32c4100880 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c406a300 con 0x7f32c4100880 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.677+0000 7f32c1ffb640 1 -- 172.21.15.112:0/3184843710 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32b80319a0 con 0x7f32c4100880 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.678+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c406a910 con 0x7f32c4100880 2024-09-21T00:51:22.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.679+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c4100c80 con 0x7f32c4100880 2024-09-21T00:51:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.679+0000 7f32c1ffb640 1 -- 172.21.15.112:0/3184843710 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f32b8031ca0 con 0x7f32c4100880 2024-09-21T00:51:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.680+0000 7f32c1ffb640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f32b406e230 0x7f32b40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.680+0000 7f32c1ffb640 1 -- 172.21.15.112:0/3184843710 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2414+0+0 (secure 0 0 0) 0x7f32b803e070 con 0x7f32c4100880 2024-09-21T00:51:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.680+0000 7f32c3fff640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f32b406e230 0x7f32b40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.680+0000 7f32c3fff640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f32b406e230 0x7f32b40706f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32c41978c0 tx=0x7f32b0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:22.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.684+0000 7f32c1ffb640 1 -- 172.21.15.112:0/3184843710 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32b807e1a0 con 0x7f32c4100880 2024-09-21T00:51:22.737 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:22 smithi112 ceph-mon[28078]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:22.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:22.870+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f32c4106000 con 0x7f32b406e230 2024-09-21T00:51:22.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:22 smithi187 ceph-mon[34997]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:23.717 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T00:51:23.717 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:23.718 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:23 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:23.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:23.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:23.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:23.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:23.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:23 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:24.864 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:24 smithi112 ceph-mon[28078]: from='client.14386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:24.864 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:24 smithi112 ceph-mon[28078]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:24.864 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:24 smithi112 ceph-mon[28078]: Detected new or changed devices on smithi112 2024-09-21T00:51:24.865 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:24 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi112 to 5920M 2024-09-21T00:51:24.865 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:24 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:24.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:24 smithi187 ceph-mon[34997]: from='client.14386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:24.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:24 smithi187 ceph-mon[34997]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:24.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:24 smithi187 ceph-mon[34997]: Detected new or changed devices on smithi112 2024-09-21T00:51:24.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:24 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi112 to 5920M 2024-09-21T00:51:24.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:24 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:26.582 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:26 smithi112 ceph-mon[28078]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:26.582 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:26 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3753763425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c726bb2d-fa9f-4e8b-b7c1-480772a1757d"}]: dispatch 2024-09-21T00:51:26.582 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:26 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3753763425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c726bb2d-fa9f-4e8b-b7c1-480772a1757d"}]': finished 2024-09-21T00:51:26.582 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:26 smithi112 ceph-mon[28078]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:51:26.583 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:26.583 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:26 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4147888859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:51:26.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:26 smithi187 ceph-mon[34997]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:26.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:26 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3753763425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c726bb2d-fa9f-4e8b-b7c1-480772a1757d"}]: dispatch 2024-09-21T00:51:26.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:26 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3753763425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c726bb2d-fa9f-4e8b-b7c1-480772a1757d"}]': finished 2024-09-21T00:51:26.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:26 smithi187 ceph-mon[34997]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:51:26.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:26.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:26 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4147888859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:51:28.796 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:28 smithi112 ceph-mon[28078]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:28.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:28 smithi187 ceph-mon[34997]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:30 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:30 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:30 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:30 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:30 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:30 smithi187 ceph-mon[34997]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:30.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:30 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:30.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:30 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:30.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:30 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:30.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:30 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:30.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:30 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:30 smithi112 ceph-mon[28078]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:32.580 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:32 smithi112 ceph-mon[28078]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:32.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:32 smithi187 ceph-mon[34997]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:34.573 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:34 smithi112 ceph-mon[28078]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:34.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:34 smithi187 ceph-mon[34997]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T00:51:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:35.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T00:51:35.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:35.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:36.507 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:36 smithi112 ceph-mon[28078]: Deploying daemon osd.2 on smithi112 2024-09-21T00:51:36.507 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:36 smithi112 ceph-mon[28078]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:36.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:36 smithi187 ceph-mon[34997]: Deploying daemon osd.2 on smithi112 2024-09-21T00:51:36.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:36 smithi187 ceph-mon[34997]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:38.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:38 smithi112 ceph-mon[28078]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:38.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:38 smithi187 ceph-mon[34997]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:40.378 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:40 smithi112 ceph-mon[28078]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:40.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:40 smithi187 ceph-mon[34997]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:41.345 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:41 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:41.345 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:41 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:41.345 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:41 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:41.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:41 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:41 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:41 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:42.546 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:42 smithi112 ceph-mon[28078]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:42 smithi187 ceph-mon[34997]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:44 smithi112 ceph-mon[28078]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:44 smithi187 ceph-mon[34997]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:44.733 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 2 on host 'smithi112' 2024-09-21T00:51:44.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.731+0000 7f32c1ffb640 1 -- 172.21.15.112:0/3184843710 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f32c4106000 con 0x7f32b406e230 2024-09-21T00:51:44.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f32b406e230 msgr2=0x7f32b40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:44.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f32b406e230 0x7f32b40706f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32c41978c0 tx=0x7f32b0008040 comp rx=0 tx=0).stop 2024-09-21T00:51:44.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 msgr2=0x7f32c4196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:44.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4196410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b80048f0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 shutdown_connections 2024-09-21T00:51:44.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f32b406e230 0x7f32b40706f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c4101a80 0x7f32c4196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 --2- 172.21.15.112:0/3184843710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32c4100880 0x7f32c4196410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 >> 172.21.15.112:0/3184843710 conn(0x7f32c40fc010 msgr2=0x7f32c40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:44.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 shutdown_connections 2024-09-21T00:51:44.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:51:44.734+0000 7f32cae34640 1 -- 172.21.15.112:0/3184843710 wait complete. 2024-09-21T00:51:45.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:45 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:45.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:45 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:45.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:45 smithi112 ceph-mon[28078]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:45.765 DEBUG:teuthology.orchestra.run.smithi112:osd.2> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T00:51:45.767 INFO:tasks.cephadm:Deploying osd.3 on smithi187 with /dev/vg_nvme/lv_4... 2024-09-21T00:51:45.768 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:51:46.022 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:51:46.143 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:45 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:46.143 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:45 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:46.144 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:45 smithi187 ceph-mon[34997]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:46.991 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:46 smithi187 ceph-mon[34997]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T00:51:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:46 smithi112 ceph-mon[28078]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T00:51:47.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:46 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[65373]: 2024-09-21T00:51:46.697+0000 7f830a3d2640 -1 osd.2 0 log_to_monitors true 2024-09-21T00:51:47.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:47 smithi187 ceph-mon[34997]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:51:47.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:47 smithi187 ceph-mon[34997]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:51:47.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:47 smithi187 ceph-mon[34997]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T00:51:47.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:47 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:47.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:47 smithi187 ceph-mon[34997]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:48.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:47 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[65373]: 2024-09-21T00:51:47.742+0000 7f8305b32640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T00:51:48.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:47 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[65373]: 2024-09-21T00:51:47.746+0000 7f830216c640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:51:48.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:47 smithi112 ceph-mon[28078]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:51:48.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:47 smithi112 ceph-mon[28078]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:51:48.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:47 smithi112 ceph-mon[28078]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T00:51:48.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:47 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:48.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:47 smithi112 ceph-mon[28078]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:48.259 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:51:48.284 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi187:vg_nvme/lv_4 2024-09-21T00:51:48.532 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:51:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:48 smithi112 ceph-mon[28078]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T00:51:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:48 smithi112 ceph-mon[28078]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T00:51:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:48 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:48 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:48 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:48.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:48 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:48.976 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:48 smithi187 ceph-mon[34997]: from='osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T00:51:48.976 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:48 smithi187 ceph-mon[34997]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T00:51:48.976 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:48 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:48.976 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:48 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:48.976 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:48 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:48.976 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:48 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:48.978 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 -- 172.21.15.187:0/1800656043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c102490 msgr2=0x7f139c104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:48.978 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1800656043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c102490 0x7f139c104880 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1398009880 tx=0x7f139802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.978 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 -- 172.21.15.187:0/1800656043 shutdown_connections 2024-09-21T00:51:48.978 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1800656043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c104dc0 0x7f139c1071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.978 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1800656043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c102490 0x7f139c104880 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.979 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 -- 172.21.15.187:0/1800656043 >> 172.21.15.187:0/1800656043 conn(0x7f139c0fbff0 msgr2=0x7f139c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:48.979 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 -- 172.21.15.187:0/1800656043 shutdown_connections 2024-09-21T00:51:48.979 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.976+0000 7f13a45e7640 1 -- 172.21.15.187:0/1800656043 wait complete. 2024-09-21T00:51:48.980 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a45e7640 1 Processor -- start 2024-09-21T00:51:48.980 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a45e7640 1 -- start start 2024-09-21T00:51:48.980 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a45e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c102490 0x7f139c101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:48.980 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a45e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c104dc0 0x7f139c100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a45e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f139c10a7d0 con 0x7f139c102490 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a45e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f139c10a650 con 0x7f139c104dc0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a1b82640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c104dc0 0x7f139c100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a2383640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c102490 0x7f139c101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a1b82640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c104dc0 0x7f139c100440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52452/0 (socket says 172.21.15.187:52452) 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a1b82640 1 -- 172.21.15.187:0/1525957687 learned_addr learned my addr 172.21.15.187:0/1525957687 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.977+0000 7f13a1b82640 1 -- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c102490 msgr2=0x7f139c101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13a1b82640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c102490 0x7f139c101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13a1b82640 1 -- 172.21.15.187:0/1525957687 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c100980 con 0x7f139c104dc0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13a2383640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c102490 0x7f139c101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13a1b82640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c104dc0 0x7f139c100440 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f138c00e970 tx=0x7f138c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f138c00cac0 con 0x7f139c104dc0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c100c70 con 0x7f139c104dc0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f138c0054e0 con 0x7f139c104dc0 2024-09-21T00:51:48.981 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f138c010430 con 0x7f139c104dc0 2024-09-21T00:51:48.982 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.978+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c101200 con 0x7f139c104dc0 2024-09-21T00:51:48.982 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.979+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f139c102870 con 0x7f139c104dc0 2024-09-21T00:51:48.982 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.980+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f138c004ec0 con 0x7f139c104dc0 2024-09-21T00:51:48.983 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.980+0000 7f13937fe640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f138806e240 0x7f1388070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:48.983 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.980+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2846+0+0 (secure 0 0 0) 0x7f138c08dc60 con 0x7f139c104dc0 2024-09-21T00:51:48.983 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.980+0000 7f13a2383640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f138806e240 0x7f1388070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:48.983 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.981+0000 7f13a2383640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f138806e240 0x7f1388070700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1398000c00 tx=0x7f1398005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:48.986 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:48.985+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f138c05c0e0 con 0x7f139c104dc0 2024-09-21T00:51:49.167 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:49.165+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f139c19f5b0 con 0x7f138806e240 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: purged_snaps scrub starts 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: purged_snaps scrub ok 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] boot 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:51:49.812 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:49.813 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:49.813 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:49 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T00:51:50.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: purged_snaps scrub starts 2024-09-21T00:51:50.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: purged_snaps scrub ok 2024-09-21T00:51:50.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:50.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: osd.2 [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] boot 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:50.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:49 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T00:51:50.818 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:51:50.818 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:50 smithi187 ceph-mon[34997]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T00:51:50.818 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T00:51:50.818 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:51.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:51:51.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:50 smithi112 ceph-mon[28078]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T00:51:51.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T00:51:51.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:51:51.510 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69655]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:51:51.510 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69655]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:51.510 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:51.510 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69655]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:51.818 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69690]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:51:51.819 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69690]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:51.819 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:51.819 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69690]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:51.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:51:51.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T00:51:51.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: Detected new or changed devices on smithi112 2024-09-21T00:51:51.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:51.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:51.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:51.819 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi112 to 3946M 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1429639292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f73faab7-053d-4a3d-8d3b-fc9e779a93b8"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f73faab7-053d-4a3d-8d3b-fc9e779a93b8"}]: dispatch 2024-09-21T00:51:51.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f73faab7-053d-4a3d-8d3b-fc9e779a93b8"}]': finished 2024-09-21T00:51:51.821 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:51:51.821 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:51:51.821 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:52.075 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69693]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:51:52.075 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69693]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:52.076 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:52.076 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:51 smithi112 sudo[69693]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: Detected new or changed devices on smithi112 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi112 to 3946M 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:52.103 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1429639292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f73faab7-053d-4a3d-8d3b-fc9e779a93b8"}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f73faab7-053d-4a3d-8d3b-fc9e779a93b8"}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f73faab7-053d-4a3d-8d3b-fc9e779a93b8"}]': finished 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:51:52.104 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:52.217 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:51:52.215+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f138c0051b0 con 0x7f139c104dc0 2024-09-21T00:51:52.325 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69699]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:51:52.326 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69699]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:52.326 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:52.326 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69696]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:51:52.326 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69696]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:52.326 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:52.326 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69696]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:52.579 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69699]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:52.839 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:51:52.840 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:52.840 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:52.840 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69702]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:52.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69705]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:51:52.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69705]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:52.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:52.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:52 smithi112 sudo[69705]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:53 smithi112 sudo[69708]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:51:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:53 smithi112 sudo[69708]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:53 smithi112 sudo[69708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:53 smithi112 sudo[69708]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:53 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1990821418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:51:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:53 smithi112 ceph-mon[28078]: mgrmap e19: smithi112.fzmyfw(active, since 2m), standbys: smithi187.hpbgni 2024-09-21T00:51:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:53 smithi112 ceph-mon[28078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:51:53.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1990821418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:51:53.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 ceph-mon[34997]: mgrmap e19: smithi112.fzmyfw(active, since 2m), standbys: smithi187.hpbgni 2024-09-21T00:51:53.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:51:53.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[38946]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:51:53.348 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[38946]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:53.348 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[38946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:53.348 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[38946]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:53.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[39134]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:51:53.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[39134]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:51:53.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[39134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:51:53.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:53 smithi187 sudo[39134]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: pgmap v94: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:51:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:51:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:51:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:51:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:51:54.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:51:54.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:51:54.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: pgmap v94: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:51:54.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:51:54.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:51:56.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:56 smithi187 ceph-mon[34997]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:51:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:56 smithi112 ceph-mon[28078]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:51:58.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:51:58 smithi187 ceph-mon[34997]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 229 KiB/s wr, 15 op/s 2024-09-21T00:51:58.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:51:58 smithi112 ceph-mon[28078]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 229 KiB/s wr, 15 op/s 2024-09-21T00:52:00.587 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:00 smithi187 ceph-mon[34997]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-09-21T00:52:00.588 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:00 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T00:52:00.588 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:00 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:00.693 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:00 smithi112 ceph-mon[28078]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-09-21T00:52:00.693 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:00 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T00:52:00.693 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:00 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:01 smithi187 ceph-mon[34997]: Deploying daemon osd.3 on smithi187 2024-09-21T00:52:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:01 smithi112 ceph-mon[28078]: Deploying daemon osd.3 on smithi187 2024-09-21T00:52:02.512 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:02 smithi187 ceph-mon[34997]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-21T00:52:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:02 smithi112 ceph-mon[28078]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-21T00:52:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:04 smithi187 ceph-mon[34997]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-09-21T00:52:04.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:04 smithi112 ceph-mon[28078]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-09-21T00:52:05.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:05.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:06.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:06 smithi187 ceph-mon[34997]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-21T00:52:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:06 smithi112 ceph-mon[28078]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-21T00:52:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:07.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:07.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:07.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:08.634 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:08 smithi187 ceph-mon[34997]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-21T00:52:08.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:08 smithi112 ceph-mon[28078]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-21T00:52:10.574 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:10 smithi187 ceph-mon[34997]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:10.575 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:10 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:10.575 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:10 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:10.575 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:10 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:10.575 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:10 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:10.575 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:10 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:10.615 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.614+0000 7f13937fe640 1 -- 172.21.15.187:0/1525957687 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f139c19f5b0 con 0x7f138806e240 2024-09-21T00:52:10.615 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 3 on host 'smithi187' 2024-09-21T00:52:10.617 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f138806e240 msgr2=0x7f1388070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f138806e240 0x7f1388070700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1398000c00 tx=0x7f1398005a20 comp rx=0 tx=0).stop 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c104dc0 msgr2=0x7f139c100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c104dc0 0x7f139c100440 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f138c00e970 tx=0x7f138c00ee30 comp rx=0 tx=0).stop 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 shutdown_connections 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f138806e240 0x7f1388070700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f139c104dc0 0x7f139c100440 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 --2- 172.21.15.187:0/1525957687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f139c102490 0x7f139c101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 >> 172.21.15.187:0/1525957687 conn(0x7f139c0fbff0 msgr2=0x7f139c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 shutdown_connections 2024-09-21T00:52:10.618 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:10.617+0000 7f13a45e7640 1 -- 172.21.15.187:0/1525957687 wait complete. 2024-09-21T00:52:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:10 smithi112 ceph-mon[28078]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:10.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:10.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:11.189 DEBUG:teuthology.orchestra.run.smithi187:osd.3> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T00:52:11.191 INFO:tasks.cephadm:Deploying osd.4 on smithi187 with /dev/vg_nvme/lv_3... 2024-09-21T00:52:11.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:52:11.449 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:11 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:11.449 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:11 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:11.449 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:11 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:11 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:11 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:11 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:11.872 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:52:12.644 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:12 smithi187 ceph-mon[34997]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:12.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:12 smithi112 ceph-mon[28078]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:12.908 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 00:52:12 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[40919]: 2024-09-21T00:52:12.643+0000 7f6dbda16640 -1 osd.3 0 log_to_monitors true 2024-09-21T00:52:13.499 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:13 smithi187 ceph-mon[34997]: from='osd.3 [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T00:52:13.500 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:13 smithi187 ceph-mon[34997]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T00:52:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:13 smithi112 ceph-mon[28078]: from='osd.3 [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T00:52:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:13 smithi112 ceph-mon[28078]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T00:52:14.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-mon[34997]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:14.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-mon[34997]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:52:14.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-mon[34997]: from='osd.3 [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:14.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-mon[34997]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:52:14.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:14.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-mon[34997]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:14.571 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[40919]: 2024-09-21T00:52:14.394+0000 7f6db9176640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T00:52:14.572 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 00:52:14 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[40919]: 2024-09-21T00:52:14.401+0000 7f6db57b0640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:52:14.573 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:52:14.598 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi187:vg_nvme/lv_3 2024-09-21T00:52:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:14 smithi112 ceph-mon[28078]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:14 smithi112 ceph-mon[28078]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:52:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:14 smithi112 ceph-mon[28078]: from='osd.3 [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:14 smithi112 ceph-mon[28078]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:52:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:14 smithi112 ceph-mon[28078]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:15.104 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:52:15.501 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:15 smithi187 ceph-mon[34997]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T00:52:15.502 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:15 smithi187 ceph-mon[34997]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T00:52:15.502 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:15 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:15.502 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:15 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:15.588 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.586+0000 7f10d4b4e640 1 -- 172.21.15.187:0/2763171256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0101970 msgr2=0x7f10d0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:15.588 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.586+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/2763171256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0101970 0x7f10d0101d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009880 tx=0x7f10c002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:52:15.588 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 -- 172.21.15.187:0/2763171256 shutdown_connections 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/2763171256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d0102b70 0x7f10d0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/2763171256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0101970 0x7f10d0101d70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 -- 172.21.15.187:0/2763171256 >> 172.21.15.187:0/2763171256 conn(0x7f10d00fd100 msgr2=0x7f10d00ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 -- 172.21.15.187:0/2763171256 shutdown_connections 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 -- 172.21.15.187:0/2763171256 wait complete. 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 Processor -- start 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.587+0000 7f10d4b4e640 1 -- start start 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10d4b4e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d0101970 0x7f10d01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10d4b4e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0102b70 0x7f10d0199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10d4b4e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10d010a7b0 con 0x7f10d0101970 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10d4b4e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f10d010a630 con 0x7f10d0102b70 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10cdd9b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0102b70 0x7f10d0199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10cdd9b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0102b70 0x7f10d0199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:47790/0 (socket says 172.21.15.187:47790) 2024-09-21T00:52:15.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10cdd9b640 1 -- 172.21.15.187:0/1414599014 learned_addr learned my addr 172.21.15.187:0/1414599014 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T00:52:15.590 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10ce59c640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d0101970 0x7f10d01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10cdd9b640 1 -- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d0101970 msgr2=0x7f10d01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10cdd9b640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d0101970 0x7f10d01996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10cdd9b640 1 -- 172.21.15.187:0/1414599014 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d019a2b0 con 0x7f10d0102b70 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10cdd9b640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0102b70 0x7f10d0199c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f10c400d6f0 tx=0x7f10c400dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10bf7fe640 1 -- 172.21.15.187:0/1414599014 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10c4017070 con 0x7f10d0102b70 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.588+0000 7f10bf7fe640 1 -- 172.21.15.187:0/1414599014 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10c400de00 con 0x7f10d0102b70 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.589+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d019ecf0 con 0x7f10d0102b70 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.589+0000 7f10bf7fe640 1 -- 172.21.15.187:0/1414599014 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10c4004bb0 con 0x7f10d0102b70 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.589+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d019f220 con 0x7f10d0102b70 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.590+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d0101d70 con 0x7f10d0102b70 2024-09-21T00:52:15.591 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.590+0000 7f10bf7fe640 1 -- 172.21.15.187:0/1414599014 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f10c4004e60 con 0x7f10d0102b70 2024-09-21T00:52:15.592 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.591+0000 7f10bf7fe640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f10b806e2b0 0x7f10b8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:15.592 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.591+0000 7f10bf7fe640 1 -- 172.21.15.187:0/1414599014 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3807+0+0 (secure 0 0 0) 0x7f10c408d630 con 0x7f10d0102b70 2024-09-21T00:52:15.592 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.591+0000 7f10ce59c640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f10b806e2b0 0x7f10b8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:15.592 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.591+0000 7f10ce59c640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f10b806e2b0 0x7f10b8070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10c0006010 tx=0x7f10c0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:15.596 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.596+0000 7f10bf7fe640 1 -- 172.21.15.187:0/1414599014 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10c405f2c0 con 0x7f10d0102b70 2024-09-21T00:52:15.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:15 smithi112 ceph-mon[28078]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T00:52:15.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:15 smithi112 ceph-mon[28078]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T00:52:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:15.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:15 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:15.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:15.775+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f10d0062630 con 0x7f10b806e2b0 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: purged_snaps scrub starts 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: purged_snaps scrub ok 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: osd.3 [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] boot 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:52:16.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:16.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:16 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: purged_snaps scrub starts 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: purged_snaps scrub ok 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: osd.3 [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] boot 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:52:16.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:16.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:16 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:17.619 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:17 smithi187 ceph-mon[34997]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:17.619 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:17 smithi187 ceph-mon[34997]: Detected new or changed devices on smithi187 2024-09-21T00:52:17.619 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:17 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi187 to 14912M 2024-09-21T00:52:17.619 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:17 smithi187 ceph-mon[34997]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T00:52:17.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:17 smithi112 ceph-mon[28078]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:17.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:17 smithi112 ceph-mon[28078]: Detected new or changed devices on smithi187 2024-09-21T00:52:17.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:17 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi187 to 14912M 2024-09-21T00:52:17.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:17 smithi112 ceph-mon[28078]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T00:52:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:18 smithi112 ceph-mon[28078]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:18 smithi112 ceph-mon[28078]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T00:52:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:18 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/2611792566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f"}]: dispatch 2024-09-21T00:52:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:18 smithi112 ceph-mon[28078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f"}]: dispatch 2024-09-21T00:52:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:18 smithi112 ceph-mon[28078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f"}]': finished 2024-09-21T00:52:18.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:18 smithi112 ceph-mon[28078]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:52:18.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:18 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:18.887 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:18 smithi187 ceph-mon[34997]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:18.887 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:18 smithi187 ceph-mon[34997]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T00:52:18.887 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:18 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/2611792566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f"}]: dispatch 2024-09-21T00:52:18.887 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:18 smithi187 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f"}]: dispatch 2024-09-21T00:52:18.887 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:18 smithi187 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f"}]': finished 2024-09-21T00:52:18.887 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:18 smithi187 ceph-mon[34997]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:52:18.887 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:18 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:19.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:19 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/2456742198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:52:20.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:19 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/2456742198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:52:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:20 smithi187 ceph-mon[34997]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:20.978 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:20 smithi112 ceph-mon[28078]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:20.978 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:22.895 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:22 smithi187 ceph-mon[34997]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T00:52:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:22 smithi112 ceph-mon[28078]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T00:52:24.802 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:24 smithi187 ceph-mon[34997]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T00:52:24.813 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:24 smithi112 ceph-mon[28078]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T00:52:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:26 smithi187 ceph-mon[34997]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T00:52:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:26 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:26 smithi112 ceph-mon[28078]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T00:52:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:26 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:27.794 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:27 smithi187 ceph-mon[34997]: Deploying daemon osd.4 on smithi187 2024-09-21T00:52:28.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:27 smithi112 ceph-mon[28078]: Deploying daemon osd.4 on smithi187 2024-09-21T00:52:28.794 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:28 smithi187 ceph-mon[34997]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T00:52:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:28 smithi112 ceph-mon[28078]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T00:52:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:30 smithi187 ceph-mon[34997]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T00:52:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:30 smithi112 ceph-mon[28078]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T00:52:31.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:31 smithi187 ceph-mon[34997]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:32.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:31 smithi112 ceph-mon[28078]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:32.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:32 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:32.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:32 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:32.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:32 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:32 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:32 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:32 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:33.852 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:33 smithi187 ceph-mon[34997]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:34.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:33 smithi112 ceph-mon[28078]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:35.545 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:35.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:36.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:36 smithi112 ceph-mon[28078]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:36.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:36 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:36.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:36 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:36.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:36 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:36.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:36 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:36.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:36 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:36.540 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:36 smithi187 ceph-mon[34997]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:36.540 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:36 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:36.540 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:36 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:36.540 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:36 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:36.540 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:36 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:36.541 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:36 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:36.805 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.805+0000 7f10bf7fe640 1 -- 172.21.15.187:0/1414599014 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f10d0062630 con 0x7f10b806e2b0 2024-09-21T00:52:36.806 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 4 on host 'smithi187' 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f10b806e2b0 msgr2=0x7f10b8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f10b806e2b0 0x7f10b8070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10c0006010 tx=0x7f10c0005a20 comp rx=0 tx=0).stop 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0102b70 msgr2=0x7f10d0199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0102b70 0x7f10d0199c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f10c400d6f0 tx=0x7f10c400dbb0 comp rx=0 tx=0).stop 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 shutdown_connections 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f10b806e2b0 0x7f10b8070770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10d0102b70 0x7f10d0199c30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 --2- 172.21.15.187:0/1414599014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d0101970 0x7f10d01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 >> 172.21.15.187:0/1414599014 conn(0x7f10d00fd100 msgr2=0x7f10d0104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 shutdown_connections 2024-09-21T00:52:36.808 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:36.807+0000 7f10d4b4e640 1 -- 172.21.15.187:0/1414599014 wait complete. 2024-09-21T00:52:37.436 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:37.436 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:37.436 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:37 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:37.470 DEBUG:teuthology.orchestra.run.smithi187:osd.4> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T00:52:37.473 INFO:tasks.cephadm:Deploying osd.5 on smithi187 with /dev/vg_nvme/lv_2... 2024-09-21T00:52:37.473 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:52:37.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:37.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:37.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:37 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:38.602 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:38 smithi187 ceph-mon[34997]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:38.749 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:52:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:38 smithi112 ceph-mon[28078]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:38.873 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 00:52:38 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[47632]: 2024-09-21T00:52:38.824+0000 7f7bbf2a1640 -1 osd.4 0 log_to_monitors true 2024-09-21T00:52:39.478 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:39 smithi187 ceph-mon[34997]: from='osd.4 [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T00:52:39.478 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:39 smithi187 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T00:52:39.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:39 smithi112 ceph-mon[28078]: from='osd.4 [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T00:52:39.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:39 smithi112 ceph-mon[28078]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T00:52:40.621 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[47632]: 2024-09-21T00:52:40.303+0000 7f7bbaa01640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T00:52:40.621 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[47632]: 2024-09-21T00:52:40.308+0000 7f7bb703b640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='osd.4 [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:40.622 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:40.623 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:40 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:52:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='osd.4 [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:52:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:40 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:41 smithi112 ceph-mon[28078]: Detected new or changed devices on smithi187 2024-09-21T00:52:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:41 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi187 to 7456M 2024-09-21T00:52:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:41 smithi112 ceph-mon[28078]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T00:52:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:41 smithi112 ceph-mon[28078]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T00:52:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:41 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:41.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:41 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:41 smithi187 ceph-mon[34997]: Detected new or changed devices on smithi187 2024-09-21T00:52:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:41 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi187 to 7456M 2024-09-21T00:52:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:41 smithi187 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T00:52:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:41 smithi187 ceph-mon[34997]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T00:52:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:41 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:41.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:41 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:42.040 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T00:52:42.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi187:vg_nvme/lv_2 2024-09-21T00:52:42.304 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:42 smithi187 ceph-mon[34997]: purged_snaps scrub starts 2024-09-21T00:52:42.304 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:42 smithi187 ceph-mon[34997]: purged_snaps scrub ok 2024-09-21T00:52:42.304 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:42 smithi187 ceph-mon[34997]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:42.304 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:42.308 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:52:42.561 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:42 smithi187 ceph-mon[34997]: osd.4 [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] boot 2024-09-21T00:52:42.561 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:42 smithi187 ceph-mon[34997]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T00:52:42.562 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:42.749 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 -- 172.21.15.187:0/1261890298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 msgr2=0x7f5200101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:42.749 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 --2- 172.21.15.187:0/1261890298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f5200101d60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009880 tx=0x7f51f002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:52:42.749 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 -- 172.21.15.187:0/1261890298 shutdown_connections 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 --2- 172.21.15.187:0/1261890298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5200102b60 0x7f5200102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 --2- 172.21.15.187:0/1261890298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f5200101d60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 -- 172.21.15.187:0/1261890298 >> 172.21.15.187:0/1261890298 conn(0x7f52000fd0f0 msgr2=0x7f52000ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 -- 172.21.15.187:0/1261890298 shutdown_connections 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 -- 172.21.15.187:0/1261890298 wait complete. 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 Processor -- start 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 -- start start 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.747+0000 7f52064fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f52001974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f52064fb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5200102b60 0x7f52001979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f52064fb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f520010a780 con 0x7f5200102b60 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f52064fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f520010a600 con 0x7f5200101960 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f52001974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:42.750 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f52001974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:50848/0 (socket says 172.21.15.187:50848) 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fffff640 1 -- 172.21.15.187:0/1420441382 learned_addr learned my addr 172.21.15.187:0/1420441382 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51ff7fe640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5200102b60 0x7f52001979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fffff640 1 -- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5200102b60 msgr2=0x7f52001979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fffff640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5200102b60 0x7f52001979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fffff640 1 -- 172.21.15.187:0/1420441382 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5200198070 con 0x7f5200101960 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fffff640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f52001974b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f51f0006010 tx=0x7f51f00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fd7fa640 1 -- 172.21.15.187:0/1420441382 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51f003f070 con 0x7f5200101960 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fd7fa640 1 -- 172.21.15.187:0/1420441382 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51f0004a50 con 0x7f5200101960 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520019ca50 con 0x7f5200101960 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f51fd7fa640 1 -- 172.21.15.187:0/1420441382 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51f0035030 con 0x7f5200101960 2024-09-21T00:52:42.751 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.748+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520019cfe0 con 0x7f5200101960 2024-09-21T00:52:42.752 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.749+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5200101d60 con 0x7f5200101960 2024-09-21T00:52:42.752 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.750+0000 7f51fd7fa640 1 -- 172.21.15.187:0/1420441382 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f51f0042070 con 0x7f5200101960 2024-09-21T00:52:42.753 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.750+0000 7f51fd7fa640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f51e806e2b0 0x7f51e8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:42.753 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.750+0000 7f51fd7fa640 1 -- 172.21.15.187:0/1420441382 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4206+0+0 (secure 0 0 0) 0x7f51f00ae6f0 con 0x7f5200101960 2024-09-21T00:52:42.753 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.750+0000 7f51ff7fe640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f51e806e2b0 0x7f51e8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:42.753 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.751+0000 7f51ff7fe640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f51e806e2b0 0x7f51e8070770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5200198960 tx=0x7f51f400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:42.755 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.755+0000 7f51fd7fa640 1 -- 172.21.15.187:0/1420441382 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51f0004c00 con 0x7f5200101960 2024-09-21T00:52:42.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:42 smithi112 ceph-mon[28078]: purged_snaps scrub starts 2024-09-21T00:52:42.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:42 smithi112 ceph-mon[28078]: purged_snaps scrub ok 2024-09-21T00:52:42.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:42 smithi112 ceph-mon[28078]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:42.764 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:42.764 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:42 smithi112 ceph-mon[28078]: osd.4 [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] boot 2024-09-21T00:52:42.764 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:42 smithi112 ceph-mon[28078]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T00:52:42.764 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:52:42.935 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:52:42.930+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5200062630 con 0x7f51e806e2b0 2024-09-21T00:52:43.575 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:43 smithi187 ceph-mon[34997]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T00:52:43.576 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:43 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:52:43.576 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:43 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:52:43.576 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:43 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:43.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:43 smithi112 ceph-mon[28078]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T00:52:43.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:43 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T00:52:43.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:43 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T00:52:43.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:43 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:44.589 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:44 smithi187 ceph-mon[34997]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:44.590 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:44 smithi187 ceph-mon[34997]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:44 smithi112 ceph-mon[28078]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:44 smithi112 ceph-mon[28078]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:45.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:45 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/546144809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00acf156-4c06-4a90-9dfe-831bf693b7c1"}]: dispatch 2024-09-21T00:52:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:45 smithi187 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00acf156-4c06-4a90-9dfe-831bf693b7c1"}]: dispatch 2024-09-21T00:52:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:45 smithi187 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00acf156-4c06-4a90-9dfe-831bf693b7c1"}]': finished 2024-09-21T00:52:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:45 smithi187 ceph-mon[34997]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T00:52:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:45 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:52:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:45 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/546144809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00acf156-4c06-4a90-9dfe-831bf693b7c1"}]: dispatch 2024-09-21T00:52:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:45 smithi112 ceph-mon[28078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00acf156-4c06-4a90-9dfe-831bf693b7c1"}]: dispatch 2024-09-21T00:52:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:45 smithi112 ceph-mon[28078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00acf156-4c06-4a90-9dfe-831bf693b7c1"}]': finished 2024-09-21T00:52:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:45 smithi112 ceph-mon[28078]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T00:52:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:45 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:52:46.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:46 smithi187 ceph-mon[34997]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:46.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:46 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/2174111619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:52:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:46 smithi112 ceph-mon[28078]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:46 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/2174111619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T00:52:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:48 smithi187 ceph-mon[34997]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:48 smithi112 ceph-mon[28078]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:50.511 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:50 smithi187 ceph-mon[34997]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:50.511 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:50 smithi112 ceph-mon[28078]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:52:52.445 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:52 smithi187 ceph-mon[34997]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:52.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:52 smithi112 ceph-mon[28078]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:54 smithi187 ceph-mon[34997]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T00:52:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:54.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:54 smithi112 ceph-mon[28078]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:54.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T00:52:54.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:52:55.457 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:55 smithi187 ceph-mon[34997]: Deploying daemon osd.5 on smithi187 2024-09-21T00:52:55.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:55 smithi112 ceph-mon[28078]: Deploying daemon osd.5 on smithi187 2024-09-21T00:52:56.342 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:56 smithi187 ceph-mon[34997]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:56 smithi112 ceph-mon[28078]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:58.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:58 smithi187 ceph-mon[34997]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:58.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:58 smithi112 ceph-mon[28078]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:52:59.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:59.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:59.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:52:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:59.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:52:59.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:52:59.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:52:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:00.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:00 smithi187 ceph-mon[34997]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:00 smithi112 ceph-mon[28078]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:02.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:02 smithi187 ceph-mon[34997]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:02 smithi112 ceph-mon[28078]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:03.190 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 5 on host 'smithi187' 2024-09-21T00:53:03.190 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.189+0000 7f51fd7fa640 1 -- 172.21.15.187:0/1420441382 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5200062630 con 0x7f51e806e2b0 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f51e806e2b0 msgr2=0x7f51e8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f51e806e2b0 0x7f51e8070770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5200198960 tx=0x7f51f400b410 comp rx=0 tx=0).stop 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 msgr2=0x7f52001974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f52001974b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f51f0006010 tx=0x7f51f00045e0 comp rx=0 tx=0).stop 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 shutdown_connections 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f51e806e2b0 0x7f51e8070770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5200102b60 0x7f52001979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 --2- 172.21.15.187:0/1420441382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5200101960 0x7f52001974b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 >> 172.21.15.187:0/1420441382 conn(0x7f52000fd0f0 msgr2=0x7f5200105f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 shutdown_connections 2024-09-21T00:53:03.193 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:03.192+0000 7f52064fb640 1 -- 172.21.15.187:0/1420441382 wait complete. 2024-09-21T00:53:03.729 DEBUG:teuthology.orchestra.run.smithi187:osd.5> sudo journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T00:53:03.732 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-21T00:53:03.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:53:03.994 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:04.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:04.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:04.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:04 smithi112 ceph-mon[28078]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:04.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:04.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 -- 172.21.15.112:0/989291150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c401023d0 msgr2=0x7f6c401047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 --2- 172.21.15.112:0/989291150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c401023d0 0x7f6c401047c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009c50 tx=0x7f6c3802a9a0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 -- 172.21.15.112:0/989291150 shutdown_connections 2024-09-21T00:53:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 --2- 172.21.15.112:0/989291150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c40104d00 0x7f6c401070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 --2- 172.21.15.112:0/989291150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c401023d0 0x7f6c401047c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 -- 172.21.15.112:0/989291150 >> 172.21.15.112:0/989291150 conn(0x7f6c400fbff0 msgr2=0x7f6c400fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:04.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 -- 172.21.15.112:0/989291150 shutdown_connections 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.445+0000 7f6c4564c640 1 -- 172.21.15.112:0/989291150 wait complete. 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c4564c640 1 Processor -- start 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c4564c640 1 -- start start 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c4564c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c401023d0 0x7f6c40101cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c4564c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c40104d00 0x7f6c40100380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c4564c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010a7a0 con 0x7f6c40104d00 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c4564c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4010a620 con 0x7f6c401023d0 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c40104d00 0x7f6c40100380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c40104d00 0x7f6c40100380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57004/0 (socket says 172.21.15.112:57004) 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3e7fc640 1 -- 172.21.15.112:0/1876103961 learned_addr learned my addr 172.21.15.112:0/1876103961 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3effd640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c401023d0 0x7f6c40101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3e7fc640 1 -- 172.21.15.112:0/1876103961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c401023d0 msgr2=0x7f6c40101cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3e7fc640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c401023d0 0x7f6c40101cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3e7fc640 1 -- 172.21.15.112:0/1876103961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c401008c0 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.446+0000 7f6c3effd640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c401023d0 0x7f6c40101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.447+0000 7f6c3e7fc640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c40104d00 0x7f6c40100380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e940 tx=0x7f6c2800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.447+0000 7f6c37fff640 1 -- 172.21.15.112:0/1876103961 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c2800cac0 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.447+0000 7f6c37fff640 1 -- 172.21.15.112:0/1876103961 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c280054e0 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.447+0000 7f6c37fff640 1 -- 172.21.15.112:0/1876103961 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c28004e40 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.447+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c40100bb0 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.447+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c401011c0 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.448+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c401027b0 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.448+0000 7f6c37fff640 1 -- 172.21.15.112:0/1876103961 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f6c28005020 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.449+0000 7f6c37fff640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f6c2c06e310 0x7f6c2c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.449+0000 7f6c37fff640 1 -- 172.21.15.112:0/1876103961 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4321+0+0 (secure 0 0 0) 0x7f6c2808e2b0 con 0x7f6c40104d00 2024-09-21T00:53:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.449+0000 7f6c3effd640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f6c2c06e310 0x7f6c2c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:04.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.449+0000 7f6c3effd640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f6c2c06e310 0x7f6c2c0707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c3802f860 tx=0x7f6c38005ef0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:04.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.453+0000 7f6c37fff640 1 -- 172.21.15.112:0/1876103961 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c2805c0a0 con 0x7f6c40104d00 2024-09-21T00:53:04.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.625+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6c4019f7e0 con 0x7f6c40104d00 2024-09-21T00:53:04.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.626+0000 7f6c37fff640 1 -- 172.21.15.112:0/1876103961 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) ==== 74+0+130 (secure 0 0 0) 0x7f6c2805fd50 con 0x7f6c40104d00 2024-09-21T00:53:04.628 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f6c2c06e310 msgr2=0x7f6c2c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f6c2c06e310 0x7f6c2c0707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c3802f860 tx=0x7f6c38005ef0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c40104d00 msgr2=0x7f6c40100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c40104d00 0x7f6c40100380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e940 tx=0x7f6c2800ee00 comp rx=0 tx=0).stop 2024-09-21T00:53:04.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 shutdown_connections 2024-09-21T00:53:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f6c2c06e310 0x7f6c2c0707d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c40104d00 0x7f6c40100380 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 --2- 172.21.15.112:0/1876103961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c401023d0 0x7f6c40101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 >> 172.21.15.112:0/1876103961 conn(0x7f6c400fbff0 msgr2=0x7f6c400fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 shutdown_connections 2024-09-21T00:53:04.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:04.628+0000 7f6c4564c640 1 -- 172.21.15.112:0/1876103961 wait complete. 2024-09-21T00:53:04.641 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:04.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:04.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:04 smithi187 ceph-mon[34997]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:04.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:04.642 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:05.339 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1726879961,"num_in_osds":6,"osd_in_since":1726879965,"num_remapped_pgs":0} 2024-09-21T00:53:05.341 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:05 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1876103961' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T00:53:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:05 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1876103961' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T00:53:05.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 00:53:05 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[54275]: 2024-09-21T00:53:05.340+0000 7f75e6962640 -1 osd.5 0 log_to_monitors true 2024-09-21T00:53:06.341 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:53:06.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:06 smithi187 ceph-mon[34997]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:06 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:06 smithi187 ceph-mon[34997]: from='osd.5 [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T00:53:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:06 smithi187 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T00:53:06.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:06 smithi112 ceph-mon[28078]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:06.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:06 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:06.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:06 smithi112 ceph-mon[28078]: from='osd.5 [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T00:53:06.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:06 smithi112 ceph-mon[28078]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T00:53:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:07.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/3573469630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 msgr2=0x7fb7d4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:07.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/3573469630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d4100c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009c20 tx=0x7fb7d002a970 comp rx=0 tx=0).stop 2024-09-21T00:53:07.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/3573469630 shutdown_connections 2024-09-21T00:53:07.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/3573469630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4101a80 0x7fb7d4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:07.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/3573469630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d4100c80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:07.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/3573469630 >> 172.21.15.112:0/3573469630 conn(0x7fb7d40fc010 msgr2=0x7fb7d40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:07.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/3573469630 shutdown_connections 2024-09-21T00:53:07.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/3573469630 wait complete. 2024-09-21T00:53:07.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 Processor -- start 2024-09-21T00:53:07.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.068+0000 7fb7dc6bd640 1 -- start start 2024-09-21T00:53:07.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7dc6bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:07.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7dc6bd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4101a80 0x7fb7d419c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:07.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7dc6bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d41096c0 con 0x7fb7d4100880 2024-09-21T00:53:07.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7dc6bd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d4109540 con 0x7fb7d4101a80 2024-09-21T00:53:07.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7da459640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:07.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7da459640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57008/0 (socket says 172.21.15.112:57008) 2024-09-21T00:53:07.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7da459640 1 -- 172.21.15.112:0/2331036813 learned_addr learned my addr 172.21.15.112:0/2331036813 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:07.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7d9c58640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4101a80 0x7fb7d419c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:07.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7da459640 1 -- 172.21.15.112:0/2331036813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4101a80 msgr2=0x7fb7d419c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:07.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7da459640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4101a80 0x7fb7d419c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:07.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7da459640 1 -- 172.21.15.112:0/2331036813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d419c7d0 con 0x7fb7d4100880 2024-09-21T00:53:07.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7da459640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d406adf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0004af0 tx=0x7fb7d002f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:07.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7cb7fe640 1 -- 172.21.15.112:0/2331036813 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7d0047070 con 0x7fb7d4100880 2024-09-21T00:53:07.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d419ca60 con 0x7fb7d4100880 2024-09-21T00:53:07.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7cb7fe640 1 -- 172.21.15.112:0/2331036813 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7d0003e30 con 0x7fb7d4100880 2024-09-21T00:53:07.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7cb7fe640 1 -- 172.21.15.112:0/2331036813 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7d0034070 con 0x7fb7d4100880 2024-09-21T00:53:07.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.069+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d419d010 con 0x7fb7d4100880 2024-09-21T00:53:07.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.070+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d4100c80 con 0x7fb7d4100880 2024-09-21T00:53:07.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.071+0000 7fb7cb7fe640 1 -- 172.21.15.112:0/2331036813 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fb7d004a070 con 0x7fb7d4100880 2024-09-21T00:53:07.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.071+0000 7fb7cb7fe640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb7c006e2b0 0x7fb7c0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:07.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.072+0000 7fb7cb7fe640 1 -- 172.21.15.112:0/2331036813 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4342+0+0 (secure 0 0 0) 0x7fb7d00aea30 con 0x7fb7d4100880 2024-09-21T00:53:07.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.072+0000 7fb7d9c58640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb7c006e2b0 0x7fb7c0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:07.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.072+0000 7fb7d9c58640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb7c006e2b0 0x7fb7c0070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb7d406ab70 tx=0x7fb7c400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:07.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.076+0000 7fb7cb7fe640 1 -- 172.21.15.112:0/2331036813 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb7d003f070 con 0x7fb7d4100880 2024-09-21T00:53:07.225 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:07 smithi187 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:53:07.225 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:07 smithi187 ceph-mon[34997]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T00:53:07.225 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:07.225 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:07 smithi187 ceph-mon[34997]: from='osd.5 [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:53:07.225 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:07 smithi187 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:53:07.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.245+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb7d419d930 con 0x7fb7d4100880 2024-09-21T00:53:07.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.245+0000 7fb7cb7fe640 1 -- 172.21.15.112:0/2331036813 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) ==== 74+0+130 (secure 0 0 0) 0x7fb7d0080410 con 0x7fb7d4100880 2024-09-21T00:53:07.247 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb7c006e2b0 msgr2=0x7fb7c0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb7c006e2b0 0x7fb7c0070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb7d406ab70 tx=0x7fb7c400b390 comp rx=0 tx=0).stop 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 msgr2=0x7fb7d406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d406adf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0004af0 tx=0x7fb7d002f660 comp rx=0 tx=0).stop 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 shutdown_connections 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb7c006e2b0 0x7fb7c0070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4101a80 0x7fb7d419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 --2- 172.21.15.112:0/2331036813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7d4100880 0x7fb7d406adf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 >> 172.21.15.112:0/2331036813 conn(0x7fb7d40fc010 msgr2=0x7fb7d40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 shutdown_connections 2024-09-21T00:53:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:07.247+0000 7fb7dc6bd640 1 -- 172.21.15.112:0/2331036813 wait complete. 2024-09-21T00:53:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:07 smithi112 ceph-mon[28078]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:53:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:07 smithi112 ceph-mon[28078]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T00:53:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:07.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:07 smithi112 ceph-mon[28078]: from='osd.5 [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:53:07.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:07 smithi112 ceph-mon[28078]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2024-09-21T00:53:07.861 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726879961,"num_in_osds":6,"osd_in_since":1726879965,"num_remapped_pgs":0} 2024-09-21T00:53:08.408 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 00:53:07 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[54275]: 2024-09-21T00:53:07.967+0000 7f75e30f9640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T00:53:08.409 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 00:53:07 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[54275]: 2024-09-21T00:53:07.974+0000 7f75da6f4640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:53:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T00:53:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T00:53:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2331036813' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T00:53:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: Detected new or changed devices on smithi187 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi187 to 4970M 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:08.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:08.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='osd.5 ' entity='osd.5' 2024-09-21T00:53:08.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:08 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:08.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T00:53:08.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T00:53:08.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2331036813' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: Detected new or changed devices on smithi187 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi187 to 4970M 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:08.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:08.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:08.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:08.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:08.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:08.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='osd.5 ' entity='osd.5' 2024-09-21T00:53:08.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:08 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:08.861 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:53:09.124 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:09 smithi112 ceph-mon[28078]: purged_snaps scrub starts 2024-09-21T00:53:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:09 smithi112 ceph-mon[28078]: purged_snaps scrub ok 2024-09-21T00:53:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:09 smithi112 ceph-mon[28078]: osd.5 [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] boot 2024-09-21T00:53:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:09 smithi112 ceph-mon[28078]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T00:53:09.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:09 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:09.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 -- 172.21.15.112:0/3309713649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60101a80 msgr2=0x7f3f60101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:09.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/3309713649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60101a80 0x7f3f60101f00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009880 tx=0x7f3f5402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 -- 172.21.15.112:0/3309713649 shutdown_connections 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/3309713649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60101a80 0x7f3f60101f00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/3309713649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f60100880 0x7f3f60100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 -- 172.21.15.112:0/3309713649 >> 172.21.15.112:0/3309713649 conn(0x7f3f600fc010 msgr2=0x7f3f600fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 -- 172.21.15.112:0/3309713649 shutdown_connections 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.533+0000 7f3f64e5e640 1 -- 172.21.15.112:0/3309713649 wait complete. 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f64e5e640 1 Processor -- start 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f64e5e640 1 -- start start 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f64e5e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60100880 0x7f3f60197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:09.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f64e5e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f60101a80 0x7f3f60197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f64e5e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60109740 con 0x7f3f60100880 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f64e5e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601095c0 con 0x7f3f60101a80 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f5e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60100880 0x7f3f60197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f5e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60100880 0x7f3f60197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57016/0 (socket says 172.21.15.112:57016) 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f5e59c640 1 -- 172.21.15.112:0/174164221 learned_addr learned my addr 172.21.15.112:0/174164221 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f5dd9b640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f60101a80 0x7f3f60197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f5e59c640 1 -- 172.21.15.112:0/174164221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f60101a80 msgr2=0x7f3f60197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f5e59c640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f60101a80 0x7f3f60197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.534+0000 7f3f5e59c640 1 -- 172.21.15.112:0/174164221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f60198140 con 0x7f3f60100880 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.535+0000 7f3f5e59c640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60100880 0x7f3f60197580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000b3d0 tx=0x7f3f5000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.535+0000 7f3f4f7fe640 1 -- 172.21.15.112:0/174164221 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f50015020 con 0x7f3f60100880 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.535+0000 7f3f4f7fe640 1 -- 172.21.15.112:0/174164221 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f50011af0 con 0x7f3f60100880 2024-09-21T00:53:09.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.535+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6019cb80 con 0x7f3f60100880 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.535+0000 7f3f4f7fe640 1 -- 172.21.15.112:0/174164221 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f50010da0 con 0x7f3f60100880 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.535+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6019d0e0 con 0x7f3f60100880 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.536+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f60100c80 con 0x7f3f60100880 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.536+0000 7f3f4f7fe640 1 -- 172.21.15.112:0/174164221 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f3f50018020 con 0x7f3f60100880 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.537+0000 7f3f4f7fe640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f3f4806e300 0x7f3f480707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.537+0000 7f3f5dd9b640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f3f4806e300 0x7f3f480707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.537+0000 7f3f4f7fe640 1 -- 172.21.15.112:0/174164221 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4638+0+0 (secure 0 0 0) 0x7f3f5008d8c0 con 0x7f3f60100880 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.537+0000 7f3f5dd9b640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f3f4806e300 0x7f3f480707c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000c00 tx=0x7f3f54005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:09.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.541+0000 7f3f4f7fe640 1 -- 172.21.15.112:0/174164221 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f5001f020 con 0x7f3f60100880 2024-09-21T00:53:09.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:09 smithi187 ceph-mon[34997]: purged_snaps scrub starts 2024-09-21T00:53:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:09 smithi187 ceph-mon[34997]: purged_snaps scrub ok 2024-09-21T00:53:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:09 smithi187 ceph-mon[34997]: osd.5 [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] boot 2024-09-21T00:53:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:09 smithi187 ceph-mon[34997]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T00:53:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:09 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:53:09.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.707+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3f6019d530 con 0x7f3f60100880 2024-09-21T00:53:09.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.707+0000 7f3f4f7fe640 1 -- 172.21.15.112:0/174164221 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7f3f5005b5e0 con 0x7f3f60100880 2024-09-21T00:53:09.710 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f3f4806e300 msgr2=0x7f3f480707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f3f4806e300 0x7f3f480707c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000c00 tx=0x7f3f54005a20 comp rx=0 tx=0).stop 2024-09-21T00:53:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60100880 msgr2=0x7f3f60197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60100880 0x7f3f60197580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000b3d0 tx=0x7f3f5000b890 comp rx=0 tx=0).stop 2024-09-21T00:53:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 shutdown_connections 2024-09-21T00:53:09.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f3f4806e300 0x7f3f480707c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f60101a80 0x7f3f60197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 --2- 172.21.15.112:0/174164221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f60100880 0x7f3f60197580 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 >> 172.21.15.112:0/174164221 conn(0x7f3f600fc010 msgr2=0x7f3f6006a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 shutdown_connections 2024-09-21T00:53:09.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:09.709+0000 7f3f64e5e640 1 -- 172.21.15.112:0/174164221 wait complete. 2024-09-21T00:53:10.435 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:10 smithi112 ceph-mon[28078]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:10.435 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:10 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/174164221' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T00:53:10.461 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1726879988,"num_in_osds":6,"osd_in_since":1726879965,"num_remapped_pgs":0} 2024-09-21T00:53:10.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:53:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:10 smithi187 ceph-mon[34997]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:10 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/174164221' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T00:53:10.705 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:11.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 -- 172.21.15.112:0/2266527104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 msgr2=0x7ff320102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:11.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 --2- 172.21.15.112:0/2266527104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff320102e80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff310009c20 tx=0x7ff31002aa00 comp rx=0 tx=0).stop 2024-09-21T00:53:11.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 -- 172.21.15.112:0/2266527104 shutdown_connections 2024-09-21T00:53:11.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 --2- 172.21.15.112:0/2266527104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3201033c0 0x7ff32010b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 --2- 172.21.15.112:0/2266527104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff320102e80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 -- 172.21.15.112:0/2266527104 >> 172.21.15.112:0/2266527104 conn(0x7ff3200fc4c0 msgr2=0x7ff3200fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:11.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 -- 172.21.15.112:0/2266527104 shutdown_connections 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.141+0000 7ff327fd5640 1 -- 172.21.15.112:0/2266527104 wait complete. 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff327fd5640 1 Processor -- start 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff327fd5640 1 -- start start 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff327fd5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff32019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff327fd5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3201033c0 0x7ff32019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff327fd5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff32010edb0 con 0x7ff320102aa0 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff327fd5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff32010ec30 con 0x7ff3201033c0 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff325d71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff32019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff325d71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff32019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57032/0 (socket says 172.21.15.112:57032) 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff325d71640 1 -- 172.21.15.112:0/794648504 learned_addr learned my addr 172.21.15.112:0/794648504 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff325570640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3201033c0 0x7ff32019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff325d71640 1 -- 172.21.15.112:0/794648504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3201033c0 msgr2=0x7ff32019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff325d71640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3201033c0 0x7ff32019db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.142+0000 7ff325d71640 1 -- 172.21.15.112:0/794648504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3201977a0 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.143+0000 7ff325d71640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff32019d620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff31002af20 tx=0x7ff31002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.143+0000 7ff31effd640 1 -- 172.21.15.112:0/794648504 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff310047070 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.143+0000 7ff31effd640 1 -- 172.21.15.112:0/794648504 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff310003e30 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.143+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff320197a30 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.143+0000 7ff31effd640 1 -- 172.21.15.112:0/794648504 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff310033050 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.143+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff320197f60 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.144+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32006a410 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.144+0000 7ff31effd640 1 -- 172.21.15.112:0/794648504 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff31004a070 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.145+0000 7ff31effd640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff30806e300 0x7ff3080707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.145+0000 7ff31effd640 1 -- 172.21.15.112:0/794648504 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff31003e030 con 0x7ff320102aa0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.145+0000 7ff325570640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff30806e300 0x7ff3080707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.145+0000 7ff325570640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff30806e300 0x7ff3080707c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3140058c0 tx=0x7ff314005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:11.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.149+0000 7ff31effd640 1 -- 172.21.15.112:0/794648504 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff31007cba0 con 0x7ff320102aa0 2024-09-21T00:53:11.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.321+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff320105f70 con 0x7ff320102aa0 2024-09-21T00:53:11.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.321+0000 7ff31effd640 1 -- 172.21.15.112:0/794648504 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+11404 (secure 0 0 0) 0x7ff310080850 con 0x7ff320102aa0 2024-09-21T00:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":38,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:47:15.163950+0000","modified":"2024-09-21T00:53:10.213553+0000","last_up_change":"2024-09-21T00:53:08.972465+0000","last_in_change":"2024-09-21T00:52:45.154463+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:51:49.527927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf9e830a-c469-4288-97b6-d514ed6f5cbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6803","nonce":54877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6805","nonce":54877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6809","nonce":54877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6807","nonce":54877108}]},"public_addr":"172.21.15.112:6803/54877108","cluster_addr":"172.21.15.112:6805/54877108","heartbeat_back_addr":"172.21.15.112:6809/54877108","heartbeat_front_addr":"172.21.15.112:6807/54877108","state":["exists","up"]},{"osd":1,"uuid":"e70a071b-237d-453a-b32c-36b6fe38e1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6811","nonce":1589865047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6813","nonce":1589865047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6817","nonce":1589865047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6815","nonce":1589865047}]},"public_addr":"172.21.15.112:6811/1589865047","cluster_addr":"172.21.15.112:6813/1589865047","heartbeat_back_addr":"172.21.15.112:6817/1589865047","heartbeat_front_addr":"172.21.15.112:6815/1589865047","state":["exists","up"]},{"osd":2,"uuid":"c726bb2d-fa9f-4e8b-b7c1-480772a1757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6819","nonce":1709988830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6821","nonce":1709988830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6825","nonce":1709988830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6823","nonce":1709988830}]},"public_addr":"172.21.15.112:6819/1709988830","cluster_addr":"172.21.15.112:6821/1709988830","heartbeat_back_addr":"172.21.15.112:6825/1709988830","heartbeat_front_addr":"172.21.15.112:6823/1709988830","state":["exists","up"]},{"osd":3,"uuid":"f73faab7-053d-4a3d-8d3b-fc9e779a93b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6801","nonce":2152078309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6803","nonce":2152078309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6807","nonce":2152078309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6805","nonce":2152078309}]},"public_addr":"172.21.15.187:6801/2152078309","cluster_addr":"172.21.15.187:6803/2152078309","heartbeat_back_addr":"172.21.15.187:6807/2152078309","heartbeat_front_addr":"172.21.15.187:6805/2152078309","state":["exists","up"]},{"osd":4,"uuid":"70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6809","nonce":1806494478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6811","nonce":1806494478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6815","nonce":1806494478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6813","nonce":1806494478}]},"public_addr":"172.21.15.187:6809/1806494478","cluster_addr":"172.21.15.187:6811/1806494478","heartbeat_back_addr":"172.21.15.187:6815/1806494478","heartbeat_front_addr":"172.21.15.187:6813/1806494478","state":["exists","up"]},{"osd":5,"uuid":"00acf156-4c06-4a90-9dfe-831bf693b7c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6817","nonce":79785513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6819","nonce":79785513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6823","nonce":79785513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6821","nonce":79785513}]},"public_addr":"172.21.15.187:6817/79785513","cluster_addr":"172.21.15.187:6819/79785513","heartbeat_back_addr":"172.21.15.187:6823/79785513","heartbeat_front_addr":"172.21.15.187:6821/79785513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:49.064500+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:18.736425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.731443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.601651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:39.801307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:06.362521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6801/3765534604":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1057860168":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6801/1831378595":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6800/3765534604":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1095552815":"2024-09-22T00:48:09.439159+0000","172.21.15.112:6801/1888748619":"2024-09-22T00:48:09.439159+0000","172.21.15.112:6800/1831378595":"2024-09-22T00:47:38.084945+0000","172.21.15.112:0/3460305391":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6800/1888748619":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/1370295957":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/31517036":"2024-09-22T00:47:38.084945+0000","172.21.15.112:0/186527546":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/987062445":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/713543":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1353438780":"2024-09-22T00:49:05.189182+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:53:11.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff30806e300 msgr2=0x7ff3080707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:11.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff30806e300 0x7ff3080707c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3140058c0 tx=0x7ff314005850 comp rx=0 tx=0).stop 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 msgr2=0x7ff32019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff32019d620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff31002af20 tx=0x7ff31002ee60 comp rx=0 tx=0).stop 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 shutdown_connections 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff30806e300 0x7ff3080707c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3201033c0 0x7ff32019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.323+0000 7ff327fd5640 1 --2- 172.21.15.112:0/794648504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff320102aa0 0x7ff32019d620 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.324+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 >> 172.21.15.112:0/794648504 conn(0x7ff3200fc4c0 msgr2=0x7ff320108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.324+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 shutdown_connections 2024-09-21T00:53:11.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:11.324+0000 7ff327fd5640 1 -- 172.21.15.112:0/794648504 wait complete. 2024-09-21T00:53:11.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:11 smithi112 ceph-mon[28078]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T00:53:11.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:11 smithi187 ceph-mon[34997]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T00:53:12.128 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:51:49.527927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:53:12.129 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T00:53:12.378 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:12.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:12 smithi112 ceph-mon[28078]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:12.500 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:12 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/794648504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T00:53:12.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:12 smithi187 ceph-mon[34997]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:12.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:12 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/794648504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T00:53:12.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/395950457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc107930 msgr2=0x7f2ecc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:12.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/395950457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc107930 0x7f2ecc107d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009880 tx=0x7f2ebc02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/395950457 shutdown_connections 2024-09-21T00:53:12.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/395950457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ecc101930 0x7f2ecc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/395950457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc107930 0x7f2ecc107d10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/395950457 >> 172.21.15.112:0/395950457 conn(0x7f2ecc0fd630 msgr2=0x7f2ecc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/395950457 shutdown_connections 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.809+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/395950457 wait complete. 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2ed0ab3640 1 Processor -- start 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2ed0ab3640 1 -- start start 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2ed0ab3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc101930 0x7f2ecc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2ed0ab3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ecc107930 0x7f2ecc19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2ed0ab3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc10ee00 con 0x7f2ecc101930 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2ed0ab3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc10ec80 con 0x7f2ecc107930 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2eca59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc101930 0x7f2ecc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2eca59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc101930 0x7f2ecc19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57066/0 (socket says 172.21.15.112:57066) 2024-09-21T00:53:12.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2eca59c640 1 -- 172.21.15.112:0/4035444614 learned_addr learned my addr 172.21.15.112:0/4035444614 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.810+0000 7f2ec9d9b640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ecc107930 0x7f2ecc19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2eca59c640 1 -- 172.21.15.112:0/4035444614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ecc107930 msgr2=0x7f2ecc19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2eca59c640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ecc107930 0x7f2ecc19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2eca59c640 1 -- 172.21.15.112:0/4035444614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc1977f0 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2eca59c640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc101930 0x7f2ecc19d670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc031460 tx=0x7f2ebc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2ebb7fe640 1 -- 172.21.15.112:0/4035444614 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc03f070 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc197a80 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2ebb7fe640 1 -- 172.21.15.112:0/4035444614 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ebc0035f0 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2ebb7fe640 1 -- 172.21.15.112:0/4035444614 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc035030 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.811+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc197fb0 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.812+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc103070 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.812+0000 7f2ebb7fe640 1 -- 172.21.15.112:0/4035444614 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f2ebc042070 con 0x7f2ecc101930 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.813+0000 7f2ebb7fe640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2eb406e2b0 0x7f2eb4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:12.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.813+0000 7f2ebb7fe640 1 -- 172.21.15.112:0/4035444614 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f2ebc0ae770 con 0x7f2ecc101930 2024-09-21T00:53:12.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.813+0000 7f2ec9d9b640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2eb406e2b0 0x7f2eb4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:12.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.813+0000 7f2ec9d9b640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2eb406e2b0 0x7f2eb4070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0ffc20 tx=0x7f2ec000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:12.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.817+0000 7f2ebb7fe640 1 -- 172.21.15.112:0/4035444614 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ebc0800c0 con 0x7f2ecc101930 2024-09-21T00:53:12.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.980+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ecc109ea0 con 0x7f2ecc101930 2024-09-21T00:53:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.981+0000 7f2ebb7fe640 1 -- 172.21.15.112:0/4035444614 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7f2ebc0848f0 con 0x7f2ecc101930 2024-09-21T00:53:12.983 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2eb406e2b0 msgr2=0x7f2eb4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2eb406e2b0 0x7f2eb4070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0ffc20 tx=0x7f2ec000b390 comp rx=0 tx=0).stop 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc101930 msgr2=0x7f2ecc19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc101930 0x7f2ecc19d670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc031460 tx=0x7f2ebc0045e0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 shutdown_connections 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2eb406e2b0 0x7f2eb4070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ecc107930 0x7f2ecc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 --2- 172.21.15.112:0/4035444614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ecc101930 0x7f2ecc19d670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 >> 172.21.15.112:0/4035444614 conn(0x7f2ecc0fd630 msgr2=0x7f2ecc0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 shutdown_connections 2024-09-21T00:53:12.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:12.983+0000 7f2ed0ab3640 1 -- 172.21.15.112:0/4035444614 wait complete. 2024-09-21T00:53:13.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:13 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4035444614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T00:53:13.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:13 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4035444614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T00:53:13.696 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T00:53:13.696 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T00:53:13.940 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:14.320 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:14 smithi112 ceph-mon[28078]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 -- 172.21.15.112:0/3618662223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 msgr2=0x7f9640103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 --2- 172.21.15.112:0/3618662223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640103000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9634009880 tx=0x7f963402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 -- 172.21.15.112:0/3618662223 shutdown_connections 2024-09-21T00:53:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 --2- 172.21.15.112:0/3618662223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640103000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 --2- 172.21.15.112:0/3618662223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9640101980 0x7f9640101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 -- 172.21.15.112:0/3618662223 >> 172.21.15.112:0/3618662223 conn(0x7f96400fd110 msgr2=0x7f96400ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:14.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 -- 172.21.15.112:0/3618662223 shutdown_connections 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 -- 172.21.15.112:0/3618662223 wait complete. 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 Processor -- start 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.408+0000 7f96462bf640 1 -- start start 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f96462bf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9640101980 0x7f96401974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f96462bf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f96462bf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f964010a7c0 con 0x7f9640102b80 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f96462bf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f964010a640 con 0x7f9640101980 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57090/0 (socket says 172.21.15.112:57090) 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963f7fe640 1 -- 172.21.15.112:0/1938080137 learned_addr learned my addr 172.21.15.112:0/1938080137 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963ffff640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9640101980 0x7f96401974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963f7fe640 1 -- 172.21.15.112:0/1938080137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9640101980 msgr2=0x7f96401974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963f7fe640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9640101980 0x7f96401974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963f7fe640 1 -- 172.21.15.112:0/1938080137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9640198090 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963ffff640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9640101980 0x7f96401974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963f7fe640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640197a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9634006010 tx=0x7f96340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963d7fa640 1 -- 172.21.15.112:0/1938080137 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f963403f070 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964019ca70 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963d7fa640 1 -- 172.21.15.112:0/1938080137 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9634004ac0 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f963d7fa640 1 -- 172.21.15.112:0/1938080137 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9634035030 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.409+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964019d000 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.410+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9640101d80 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.411+0000 7f963d7fa640 1 -- 172.21.15.112:0/1938080137 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f9634042070 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.411+0000 7f963d7fa640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f962806e2b0 0x7f9628070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.411+0000 7f963ffff640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f962806e2b0 0x7f9628070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.411+0000 7f963d7fa640 1 -- 172.21.15.112:0/1938080137 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f96340aeaf0 con 0x7f9640102b80 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.412+0000 7f963ffff640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f962806e2b0 0x7f9628070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96300058c0 tx=0x7f9630005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:14.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.415+0000 7f963d7fa640 1 -- 172.21.15.112:0/1938080137 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f963407c730 con 0x7f9640102b80 2024-09-21T00:53:14.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.646+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f96401915d0 con 0x7f9640102b80 2024-09-21T00:53:14.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.651+0000 7f963d7fa640 1 -- 172.21.15.112:0/1938080137 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f96340803e0 con 0x7f9640102b80 2024-09-21T00:53:14.652 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-21T00:53:14.652 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQD6GO5mbA6hJhAAlPuJQuwl+dGk5qVXI3YSnw== 2024-09-21T00:53:14.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f962806e2b0 msgr2=0x7f9628070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:14.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f962806e2b0 0x7f9628070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96300058c0 tx=0x7f9630005850 comp rx=0 tx=0).stop 2024-09-21T00:53:14.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 msgr2=0x7f9640197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:14.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640197a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9634006010 tx=0x7f96340046c0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 shutdown_connections 2024-09-21T00:53:14.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f962806e2b0 0x7f9628070770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9640102b80 0x7f9640197a10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 --2- 172.21.15.112:0/1938080137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9640101980 0x7f96401974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:14.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 >> 172.21.15.112:0/1938080137 conn(0x7f96400fd110 msgr2=0x7f9640105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:14.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 shutdown_connections 2024-09-21T00:53:14.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:14.653+0000 7f96462bf640 1 -- 172.21.15.112:0/1938080137 wait complete. 2024-09-21T00:53:14.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:14 smithi187 ceph-mon[34997]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:15.368 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:53:15.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T00:53:15.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T00:53:15.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T00:53:15.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:15 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1938080137' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T00:53:15.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:15 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1938080137' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:53:15.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:15 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1938080137' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T00:53:15.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:15 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1938080137' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:53:15.662 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi187/config 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 -- 172.21.15.187:0/1171378109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41029a0 msgr2=0x7f2cd4102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1171378109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41029a0 0x7f2cd4102e20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009880 tx=0x7f2cc802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 -- 172.21.15.187:0/1171378109 shutdown_connections 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1171378109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41029a0 0x7f2cd4102e20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1171378109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd41017a0 0x7f2cd4101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 -- 172.21.15.187:0/1171378109 >> 172.21.15.187:0/1171378109 conn(0x7f2cd40fcf30 msgr2=0x7f2cd40ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 -- 172.21.15.187:0/1171378109 shutdown_connections 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.106+0000 7f2cd359e640 1 -- 172.21.15.187:0/1171378109 wait complete. 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd359e640 1 Processor -- start 2024-09-21T00:53:16.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd359e640 1 -- start start 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd359e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41017a0 0x7f2cd41972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd359e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd41029a0 0x7f2cd4197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd359e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd410a5e0 con 0x7f2cd41029a0 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd359e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd410a460 con 0x7f2cd41017a0 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd259c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41017a0 0x7f2cd41972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd259c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41017a0 0x7f2cd41972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52374/0 (socket says 172.21.15.187:52374) 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.107+0000 7f2cd259c640 1 -- 172.21.15.187:0/1423149980 learned_addr learned my addr 172.21.15.187:0/1423149980 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cd1d9b640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd41029a0 0x7f2cd4197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cd259c640 1 -- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd41029a0 msgr2=0x7f2cd4197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cd259c640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd41029a0 0x7f2cd4197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cd259c640 1 -- 172.21.15.187:0/1423149980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd4197eb0 con 0x7f2cd41017a0 2024-09-21T00:53:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cd259c640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41017a0 0x7f2cd41972f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400d8d0 tx=0x7f2cc400dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cc37fe640 1 -- 172.21.15.187:0/1423149980 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cc4017070 con 0x7f2cd41017a0 2024-09-21T00:53:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd419c8f0 con 0x7f2cd41017a0 2024-09-21T00:53:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cc37fe640 1 -- 172.21.15.187:0/1423149980 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cc400be10 con 0x7f2cd41017a0 2024-09-21T00:53:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cc37fe640 1 -- 172.21.15.187:0/1423149980 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cc400f3c0 con 0x7f2cd41017a0 2024-09-21T00:53:16.112 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.108+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd419ce50 con 0x7f2cd41017a0 2024-09-21T00:53:16.112 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.109+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd410adc0 con 0x7f2cd41017a0 2024-09-21T00:53:16.112 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.110+0000 7f2cc37fe640 1 -- 172.21.15.187:0/1423149980 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f2cc401a070 con 0x7f2cd41017a0 2024-09-21T00:53:16.112 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.110+0000 7f2cc37fe640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2cbc06e2b0 0x7f2cbc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:16.112 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.110+0000 7f2cc37fe640 1 -- 172.21.15.187:0/1423149980 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f2cc408d980 con 0x7f2cd41017a0 2024-09-21T00:53:16.112 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.110+0000 7f2cd1d9b640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2cbc06e2b0 0x7f2cbc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:16.112 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.111+0000 7f2cd1d9b640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2cbc06e2b0 0x7f2cbc070770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8000c00 tx=0x7f2cc80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:16.115 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.115+0000 7f2cc37fe640 1 -- 172.21.15.187:0/1423149980 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cc405f2d0 con 0x7f2cd41017a0 2024-09-21T00:53:16.342 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.342+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f2cd402db70 con 0x7f2cd41017a0 2024-09-21T00:53:16.349 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.349+0000 7f2cc37fe640 1 -- 172.21.15.187:0/1423149980 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f2cd402db70 con 0x7f2cd41017a0 2024-09-21T00:53:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2024-09-21T00:53:16.350 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQD8GO5mV66BFBAAd52SeP69WBPtTp1rG3VLpQ== 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2cbc06e2b0 msgr2=0x7f2cbc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2cbc06e2b0 0x7f2cbc070770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8000c00 tx=0x7f2cc80058d0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41017a0 msgr2=0x7f2cd41972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41017a0 0x7f2cd41972f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400d8d0 tx=0x7f2cc400dd90 comp rx=0 tx=0).stop 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 shutdown_connections 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2cbc06e2b0 0x7f2cbc070770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cd41029a0 0x7f2cd4197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 --2- 172.21.15.187:0/1423149980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cd41017a0 0x7f2cd41972f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:16.352 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 >> 172.21.15.187:0/1423149980 conn(0x7f2cd40fcf30 msgr2=0x7f2cd4105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:16.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 shutdown_connections 2024-09-21T00:53:16.353 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:53:16.351+0000 7f2cd359e640 1 -- 172.21.15.187:0/1423149980 wait complete. 2024-09-21T00:53:16.361 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:16 smithi187 ceph-mon[34997]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:16.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:16 smithi112 ceph-mon[28078]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:16.976 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:53:16.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T00:53:16.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T00:53:17.013 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T00:53:17.261 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:17.382 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:17 smithi112 ceph-mon[28078]: from='client.? 172.21.15.187:0/1423149980' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T00:53:17.382 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:17 smithi112 ceph-mon[28078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T00:53:17.382 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:17 smithi112 ceph-mon[28078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:53:17.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:17 smithi187 ceph-mon[34997]: from='client.? 172.21.15.187:0/1423149980' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T00:53:17.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:17 smithi187 ceph-mon[34997]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T00:53:17.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:17 smithi187 ceph-mon[34997]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:53:17.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 -- 172.21.15.112:0/3884999654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100106800 msgr2=0x7ff100106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:17.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 --2- 172.21.15.112:0/3884999654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100106800 0x7ff100106be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009880 tx=0x7ff0f002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 -- 172.21.15.112:0/3884999654 shutdown_connections 2024-09-21T00:53:17.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 --2- 172.21.15.112:0/3884999654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff100100800 0x7ff100100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 --2- 172.21.15.112:0/3884999654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100106800 0x7ff100106be0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 -- 172.21.15.112:0/3884999654 >> 172.21.15.112:0/3884999654 conn(0x7ff1000fc4e0 msgr2=0x7ff1000fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 -- 172.21.15.112:0/3884999654 shutdown_connections 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.732+0000 7ff1056c7640 1 -- 172.21.15.112:0/3884999654 wait complete. 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff1056c7640 1 Processor -- start 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff1056c7640 1 -- start start 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff1056c7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100100800 0x7ff10019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff1056c7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff100106800 0x7ff10019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff1056c7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010dd30 con 0x7ff100100800 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff1056c7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010dbb0 con 0x7ff100106800 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff0feffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100100800 0x7ff10019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff0feffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100100800 0x7ff10019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57100/0 (socket says 172.21.15.112:57100) 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.733+0000 7ff0feffd640 1 -- 172.21.15.112:0/2097241268 learned_addr learned my addr 172.21.15.112:0/2097241268 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0f67fc640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff100106800 0x7ff10019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0feffd640 1 -- 172.21.15.112:0/2097241268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff100106800 msgr2=0x7ff10019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0feffd640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff100106800 0x7ff10019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0feffd640 1 -- 172.21.15.112:0/2097241268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1001966e0 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0feffd640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100100800 0x7ff10019c610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0031460 tx=0x7ff0f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0fcff9640 1 -- 172.21.15.112:0/2097241268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0f003f070 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff100196970 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0fcff9640 1 -- 172.21.15.112:0/2097241268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0f00044d0 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff0fcff9640 1 -- 172.21.15.112:0/2097241268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0f0035030 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.734+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff100196e70 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.735+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff100101f40 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.736+0000 7ff0fcff9640 1 -- 172.21.15.112:0/2097241268 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff0f0042070 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.736+0000 7ff0fcff9640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff0ec06e2b0 0x7ff0ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.736+0000 7ff0fcff9640 1 -- 172.21.15.112:0/2097241268 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff0f00ae9d0 con 0x7ff100100800 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.736+0000 7ff0f67fc640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff0ec06e2b0 0x7ff0ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:17.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.736+0000 7ff0f67fc640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff0ec06e2b0 0x7ff0ec070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff100197f30 tx=0x7ff0e8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:17.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.740+0000 7ff0fcff9640 1 -- 172.21.15.112:0/2097241268 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0f0004cf0 con 0x7ff100100800 2024-09-21T00:53:17.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.907+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7ff100108d70 con 0x7ff100100800 2024-09-21T00:53:17.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.908+0000 7ff0fcff9640 1 -- 172.21.15.112:0/2097241268 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+160 (secure 0 0 0) 0x7ff0f007c670 con 0x7ff100100800 2024-09-21T00:53:17.909 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff0ec06e2b0 msgr2=0x7ff0ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff0ec06e2b0 0x7ff0ec070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff100197f30 tx=0x7ff0e8008040 comp rx=0 tx=0).stop 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100100800 msgr2=0x7ff10019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100100800 0x7ff10019c610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0031460 tx=0x7ff0f00048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 shutdown_connections 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff0ec06e2b0 0x7ff0ec070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff100106800 0x7ff10019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 --2- 172.21.15.112:0/2097241268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff100100800 0x7ff10019c610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 >> 172.21.15.112:0/2097241268 conn(0x7ff1000fc4e0 msgr2=0x7ff1000fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 shutdown_connections 2024-09-21T00:53:17.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:17.910+0000 7ff1056c7640 1 -- 172.21.15.112:0/2097241268 wait complete. 2024-09-21T00:53:18.576 INFO:teuthology.orchestra.run.smithi112.stdout:[{"version":41,"timestamp":"2024-09-21T00:53:07.969087+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"8956.149412"}]}] 2024-09-21T00:53:18.577 INFO:tasks.ceph_manager:config epoch is 41 2024-09-21T00:53:18.577 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T00:53:18.577 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T00:53:18.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T00:53:18.606 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:18 smithi112 ceph-mon[28078]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:18.606 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:18 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2097241268' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T00:53:18.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:18 smithi187 ceph-mon[34997]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:18.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:18 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2097241268' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T00:53:18.829 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1596628795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0101930 msgr2=0x7fe2c0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1596628795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0101930 0x7fe2c0101d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009880 tx=0x7fe2b402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1596628795 shutdown_connections 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1596628795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0101930 0x7fe2c0101d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1596628795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0107930 0x7fe2c0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1596628795 >> 172.21.15.112:0/1596628795 conn(0x7fe2c00fd630 msgr2=0x7fe2c00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1596628795 shutdown_connections 2024-09-21T00:53:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.231+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1596628795 wait complete. 2024-09-21T00:53:19.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2c5be7640 1 Processor -- start 2024-09-21T00:53:19.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2c5be7640 1 -- start start 2024-09-21T00:53:19.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2c5be7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0101930 0x7fe2c019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:19.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2c5be7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0107930 0x7fe2c019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2c5be7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c010ee00 con 0x7fe2c0107930 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2c5be7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c010ec80 con 0x7fe2c0101930 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2bf7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0101930 0x7fe2c019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2beffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0107930 0x7fe2c019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2bf7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0101930 0x7fe2c019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:37712/0 (socket says 172.21.15.112:37712) 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2beffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0107930 0x7fe2c019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57132/0 (socket says 172.21.15.112:57132) 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.232+0000 7fe2bf7fe640 1 -- 172.21.15.112:0/1728781658 learned_addr learned my addr 172.21.15.112:0/1728781658 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2beffd640 1 -- 172.21.15.112:0/1728781658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0101930 msgr2=0x7fe2c019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2beffd640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0101930 0x7fe2c019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2beffd640 1 -- 172.21.15.112:0/1728781658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c0197810 con 0x7fe2c0107930 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2bf7fe640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0101930 0x7fe2c019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2beffd640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0107930 0x7fe2c019dbd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4006010 tx=0x7fe2b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2bcff9640 1 -- 172.21.15.112:0/1728781658 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2b403f070 con 0x7fe2c0107930 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2bcff9640 1 -- 172.21.15.112:0/1728781658 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2b40035f0 con 0x7fe2c0107930 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c0197aa0 con 0x7fe2c0107930 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2bcff9640 1 -- 172.21.15.112:0/1728781658 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2b4035030 con 0x7fe2c0107930 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.233+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c0197fd0 con 0x7fe2c0107930 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.234+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c0103070 con 0x7fe2c0107930 2024-09-21T00:53:19.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.235+0000 7fe2bcff9640 1 -- 172.21.15.112:0/1728781658 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe2b4042070 con 0x7fe2c0107930 2024-09-21T00:53:19.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.235+0000 7fe2bcff9640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe2a806e2b0 0x7fe2a8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:19.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.235+0000 7fe2bcff9640 1 -- 172.21.15.112:0/1728781658 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fe2b40ae790 con 0x7fe2c0107930 2024-09-21T00:53:19.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.235+0000 7fe2bf7fe640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe2a806e2b0 0x7fe2a8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:19.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.235+0000 7fe2bf7fe640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe2a806e2b0 0x7fe2a8070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00104e0 tx=0x7fe2b000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:19.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.239+0000 7fe2bcff9640 1 -- 172.21.15.112:0/1728781658 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2b40800e0 con 0x7fe2c0107930 2024-09-21T00:53:19.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.451+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe2c0109ea0 con 0x7fe2c0107930 2024-09-21T00:53:19.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.454+0000 7fe2bcff9640 1 -- 172.21.15.112:0/1728781658 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176573 (secure 0 0 0) 0x7fe2b4084910 con 0x7fe2c0107930 2024-09-21T00:53:19.457 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:19.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe2a806e2b0 msgr2=0x7fe2a8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe2a806e2b0 0x7fe2a8070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00104e0 tx=0x7fe2b000b410 comp rx=0 tx=0).stop 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0107930 msgr2=0x7fe2c019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0107930 0x7fe2c019dbd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4006010 tx=0x7fe2b40045e0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 shutdown_connections 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe2a806e2b0 0x7fe2a8070770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0107930 0x7fe2c019dbd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 --2- 172.21.15.112:0/1728781658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2c0101930 0x7fe2c019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 >> 172.21.15.112:0/1728781658 conn(0x7fe2c00fd630 msgr2=0x7fe2c00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 shutdown_connections 2024-09-21T00:53:19.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:19.457+0000 7fe2c5be7640 1 -- 172.21.15.112:0/1728781658 wait complete. 2024-09-21T00:53:20.133 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi112.fzmyfw","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":1149588560},{"type":"v1","addr":"172.21.15.112:6801","nonce":1149588560}]},"active_addr":"172.21.15.112:6801/1149588560","active_change":"2024-09-21T00:49:05.189289+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14244,"name":"smithi187.hpbgni","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.112:8443/","prometheus":"http://172.21.15.112:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":703678932}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":4169831408}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3625555904}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":163748665}]}]} 2024-09-21T00:53:20.138 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T00:53:20.138 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T00:53:20.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:53:20.356 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:20 smithi112 ceph-mon[28078]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:20.356 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:20 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1728781658' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T00:53:20.356 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:20.420 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:20.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:20 smithi187 ceph-mon[34997]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:20.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:20 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1728781658' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T00:53:20.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 -- 172.21.15.112:0/1820821361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641067e0 msgr2=0x7fca64106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 --2- 172.21.15.112:0/1820821361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641067e0 0x7fca64106bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca54009880 tx=0x7fca5402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 -- 172.21.15.112:0/1820821361 shutdown_connections 2024-09-21T00:53:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 --2- 172.21.15.112:0/1820821361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca641007e0 0x7fca64100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 --2- 172.21.15.112:0/1820821361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641067e0 0x7fca64106bc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 -- 172.21.15.112:0/1820821361 >> 172.21.15.112:0/1820821361 conn(0x7fca640fc4c0 msgr2=0x7fca640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:20.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 -- 172.21.15.112:0/1820821361 shutdown_connections 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.913+0000 7fca6981f640 1 -- 172.21.15.112:0/1820821361 wait complete. 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.914+0000 7fca6981f640 1 Processor -- start 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.914+0000 7fca6981f640 1 -- start start 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.914+0000 7fca6981f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641007e0 0x7fca6419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.914+0000 7fca6981f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca641067e0 0x7fca6419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.914+0000 7fca6981f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fca6410dc90 con 0x7fca641007e0 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.914+0000 7fca6981f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fca6410db10 con 0x7fca641067e0 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca62ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641007e0 0x7fca6419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca62ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641007e0 0x7fca6419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57146/0 (socket says 172.21.15.112:57146) 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca62ffd640 1 -- 172.21.15.112:0/1774563166 learned_addr learned my addr 172.21.15.112:0/1774563166 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca627fc640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca641067e0 0x7fca6419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca62ffd640 1 -- 172.21.15.112:0/1774563166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca641067e0 msgr2=0x7fca6419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca62ffd640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca641067e0 0x7fca6419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca62ffd640 1 -- 172.21.15.112:0/1774563166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca64197750 con 0x7fca641007e0 2024-09-21T00:53:20.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca627fc640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca641067e0 0x7fca6419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca62ffd640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641007e0 0x7fca6419d680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca54031460 tx=0x7fca540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca6881d640 1 -- 172.21.15.112:0/1774563166 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca5403f070 con 0x7fca641007e0 2024-09-21T00:53:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca641979e0 con 0x7fca641007e0 2024-09-21T00:53:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca6881d640 1 -- 172.21.15.112:0/1774563166 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca54004cf0 con 0x7fca641007e0 2024-09-21T00:53:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca6881d640 1 -- 172.21.15.112:0/1774563166 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca54035030 con 0x7fca641007e0 2024-09-21T00:53:20.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.915+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca64197f10 con 0x7fca641007e0 2024-09-21T00:53:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.916+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca64101f20 con 0x7fca641007e0 2024-09-21T00:53:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.917+0000 7fca6881d640 1 -- 172.21.15.112:0/1774563166 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fca54042070 con 0x7fca641007e0 2024-09-21T00:53:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.917+0000 7fca6881d640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fca4c06e2b0 0x7fca4c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.917+0000 7fca6881d640 1 -- 172.21.15.112:0/1774563166 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fca540ae8a0 con 0x7fca641007e0 2024-09-21T00:53:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.917+0000 7fca627fc640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fca4c06e2b0 0x7fca4c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:20.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.918+0000 7fca627fc640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fca4c06e2b0 0x7fca4c070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca64198fa0 tx=0x7fca58005d90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:20.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:20.922+0000 7fca6881d640 1 -- 172.21.15.112:0/1774563166 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca5407c540 con 0x7fca641007e0 2024-09-21T00:53:21.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.090+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca64198c80 con 0x7fca641007e0 2024-09-21T00:53:21.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.091+0000 7fca6881d640 1 -- 172.21.15.112:0/1774563166 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+11404 (secure 0 0 0) 0x7fca540801f0 con 0x7fca641007e0 2024-09-21T00:53:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:21.092 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":38,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:47:15.163950+0000","modified":"2024-09-21T00:53:10.213553+0000","last_up_change":"2024-09-21T00:53:08.972465+0000","last_in_change":"2024-09-21T00:52:45.154463+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:51:49.527927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf9e830a-c469-4288-97b6-d514ed6f5cbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6803","nonce":54877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6805","nonce":54877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6809","nonce":54877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6807","nonce":54877108}]},"public_addr":"172.21.15.112:6803/54877108","cluster_addr":"172.21.15.112:6805/54877108","heartbeat_back_addr":"172.21.15.112:6809/54877108","heartbeat_front_addr":"172.21.15.112:6807/54877108","state":["exists","up"]},{"osd":1,"uuid":"e70a071b-237d-453a-b32c-36b6fe38e1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6811","nonce":1589865047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6813","nonce":1589865047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6817","nonce":1589865047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6815","nonce":1589865047}]},"public_addr":"172.21.15.112:6811/1589865047","cluster_addr":"172.21.15.112:6813/1589865047","heartbeat_back_addr":"172.21.15.112:6817/1589865047","heartbeat_front_addr":"172.21.15.112:6815/1589865047","state":["exists","up"]},{"osd":2,"uuid":"c726bb2d-fa9f-4e8b-b7c1-480772a1757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6819","nonce":1709988830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6821","nonce":1709988830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6825","nonce":1709988830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6823","nonce":1709988830}]},"public_addr":"172.21.15.112:6819/1709988830","cluster_addr":"172.21.15.112:6821/1709988830","heartbeat_back_addr":"172.21.15.112:6825/1709988830","heartbeat_front_addr":"172.21.15.112:6823/1709988830","state":["exists","up"]},{"osd":3,"uuid":"f73faab7-053d-4a3d-8d3b-fc9e779a93b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6801","nonce":2152078309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6803","nonce":2152078309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6807","nonce":2152078309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6805","nonce":2152078309}]},"public_addr":"172.21.15.187:6801/2152078309","cluster_addr":"172.21.15.187:6803/2152078309","heartbeat_back_addr":"172.21.15.187:6807/2152078309","heartbeat_front_addr":"172.21.15.187:6805/2152078309","state":["exists","up"]},{"osd":4,"uuid":"70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6809","nonce":1806494478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6811","nonce":1806494478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6815","nonce":1806494478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6813","nonce":1806494478}]},"public_addr":"172.21.15.187:6809/1806494478","cluster_addr":"172.21.15.187:6811/1806494478","heartbeat_back_addr":"172.21.15.187:6815/1806494478","heartbeat_front_addr":"172.21.15.187:6813/1806494478","state":["exists","up"]},{"osd":5,"uuid":"00acf156-4c06-4a90-9dfe-831bf693b7c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6817","nonce":79785513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6819","nonce":79785513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6823","nonce":79785513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6821","nonce":79785513}]},"public_addr":"172.21.15.187:6817/79785513","cluster_addr":"172.21.15.187:6819/79785513","heartbeat_back_addr":"172.21.15.187:6823/79785513","heartbeat_front_addr":"172.21.15.187:6821/79785513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:49.064500+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:18.736425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.731443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.601651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:39.801307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:06.362521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6801/3765534604":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1057860168":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6801/1831378595":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6800/3765534604":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1095552815":"2024-09-22T00:48:09.439159+0000","172.21.15.112:6801/1888748619":"2024-09-22T00:48:09.439159+0000","172.21.15.112:6800/1831378595":"2024-09-22T00:47:38.084945+0000","172.21.15.112:0/3460305391":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6800/1888748619":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/1370295957":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/31517036":"2024-09-22T00:47:38.084945+0000","172.21.15.112:0/186527546":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/987062445":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/713543":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1353438780":"2024-09-22T00:49:05.189182+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fca4c06e2b0 msgr2=0x7fca4c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fca4c06e2b0 0x7fca4c070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca64198fa0 tx=0x7fca58005d90 comp rx=0 tx=0).stop 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641007e0 msgr2=0x7fca6419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641007e0 0x7fca6419d680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca54031460 tx=0x7fca540048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 shutdown_connections 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fca4c06e2b0 0x7fca4c070770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca641067e0 0x7fca6419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 --2- 172.21.15.112:0/1774563166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641007e0 0x7fca6419d680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:21.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 >> 172.21.15.112:0/1774563166 conn(0x7fca640fc4c0 msgr2=0x7fca64069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:21.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 shutdown_connections 2024-09-21T00:53:21.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:21.094+0000 7fca6981f640 1 -- 172.21.15.112:0/1774563166 wait complete. 2024-09-21T00:53:21.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:21 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1774563166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T00:53:21.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:21 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1774563166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T00:53:21.801 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T00:53:21.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:53:22.051 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:22.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:22 smithi112 ceph-mon[28078]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.470+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/3553755185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc106900 msgr2=0x7ff9bc106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.470+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/3553755185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc106900 0x7ff9bc106ce0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009880 tx=0x7ff9b802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.470+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/3553755185 shutdown_connections 2024-09-21T00:53:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.470+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/3553755185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9bc0ff8e0 0x7ff9bc0ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.470+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/3553755185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc106900 0x7ff9bc106ce0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.470+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/3553755185 >> 172.21.15.112:0/3553755185 conn(0x7ff9bc0fb810 msgr2=0x7ff9bc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/3553755185 shutdown_connections 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/3553755185 wait complete. 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 Processor -- start 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 -- start start 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc0ff8e0 0x7ff9bc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9bc106900 0x7ff9bc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc10ee00 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.471+0000 7ff9c3d2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc10ec80 con 0x7ff9bc106900 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c1ac8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc0ff8e0 0x7ff9bc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c1ac8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc0ff8e0 0x7ff9bc19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40884/0 (socket says 172.21.15.112:40884) 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c1ac8640 1 -- 172.21.15.112:0/2689801371 learned_addr learned my addr 172.21.15.112:0/2689801371 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c12c7640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9bc106900 0x7ff9bc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c1ac8640 1 -- 172.21.15.112:0/2689801371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9bc106900 msgr2=0x7ff9bc19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c1ac8640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9bc106900 0x7ff9bc19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c1ac8640 1 -- 172.21.15.112:0/2689801371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc1977d0 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c12c7640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9bc106900 0x7ff9bc19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c1ac8640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc0ff8e0 0x7ff9bc19d650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8031460 tx=0x7ff9b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9b2ffd640 1 -- 172.21.15.112:0/2689801371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9b803f070 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9bc197a60 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9b2ffd640 1 -- 172.21.15.112:0/2689801371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9b8004cf0 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9b2ffd640 1 -- 172.21.15.112:0/2689801371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9b8035030 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.472+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9bc198010 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.473+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9bc100e00 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.474+0000 7ff9b2ffd640 1 -- 172.21.15.112:0/2689801371 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff9b8042070 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.474+0000 7ff9b2ffd640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff9a806e2b0 0x7ff9a8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.474+0000 7ff9b2ffd640 1 -- 172.21.15.112:0/2689801371 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff9b80ae970 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.474+0000 7ff9c12c7640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff9a806e2b0 0x7ff9a8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:22.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.475+0000 7ff9c12c7640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff9a806e2b0 0x7ff9a8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006fd0 tx=0x7ff9ac008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:22.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.479+0000 7ff9b2ffd640 1 -- 172.21.15.112:0/2689801371 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9b807c5b0 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.645+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9bc109e40 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.645+0000 7ff9b2ffd640 1 -- 172.21.15.112:0/2689801371 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+11404 (secure 0 0 0) 0x7ff9b8080260 con 0x7ff9bc0ff8e0 2024-09-21T00:53:22.646 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:22.646 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":38,"fsid":"ede6b7bc-77b2-11ef-baf5-efdc52797490","created":"2024-09-21T00:47:15.163950+0000","modified":"2024-09-21T00:53:10.213553+0000","last_up_change":"2024-09-21T00:53:08.972465+0000","last_in_change":"2024-09-21T00:52:45.154463+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:51:49.527927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf9e830a-c469-4288-97b6-d514ed6f5cbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6803","nonce":54877108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6805","nonce":54877108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6809","nonce":54877108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":54877108},{"type":"v1","addr":"172.21.15.112:6807","nonce":54877108}]},"public_addr":"172.21.15.112:6803/54877108","cluster_addr":"172.21.15.112:6805/54877108","heartbeat_back_addr":"172.21.15.112:6809/54877108","heartbeat_front_addr":"172.21.15.112:6807/54877108","state":["exists","up"]},{"osd":1,"uuid":"e70a071b-237d-453a-b32c-36b6fe38e1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6811","nonce":1589865047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6813","nonce":1589865047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6817","nonce":1589865047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1589865047},{"type":"v1","addr":"172.21.15.112:6815","nonce":1589865047}]},"public_addr":"172.21.15.112:6811/1589865047","cluster_addr":"172.21.15.112:6813/1589865047","heartbeat_back_addr":"172.21.15.112:6817/1589865047","heartbeat_front_addr":"172.21.15.112:6815/1589865047","state":["exists","up"]},{"osd":2,"uuid":"c726bb2d-fa9f-4e8b-b7c1-480772a1757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6819","nonce":1709988830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6821","nonce":1709988830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6825","nonce":1709988830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1709988830},{"type":"v1","addr":"172.21.15.112:6823","nonce":1709988830}]},"public_addr":"172.21.15.112:6819/1709988830","cluster_addr":"172.21.15.112:6821/1709988830","heartbeat_back_addr":"172.21.15.112:6825/1709988830","heartbeat_front_addr":"172.21.15.112:6823/1709988830","state":["exists","up"]},{"osd":3,"uuid":"f73faab7-053d-4a3d-8d3b-fc9e779a93b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6801","nonce":2152078309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6803","nonce":2152078309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6807","nonce":2152078309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2152078309},{"type":"v1","addr":"172.21.15.187:6805","nonce":2152078309}]},"public_addr":"172.21.15.187:6801/2152078309","cluster_addr":"172.21.15.187:6803/2152078309","heartbeat_back_addr":"172.21.15.187:6807/2152078309","heartbeat_front_addr":"172.21.15.187:6805/2152078309","state":["exists","up"]},{"osd":4,"uuid":"70ca23c9-ae89-4e83-bb7b-9d3bbdd8605f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6809","nonce":1806494478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6811","nonce":1806494478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6815","nonce":1806494478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1806494478},{"type":"v1","addr":"172.21.15.187:6813","nonce":1806494478}]},"public_addr":"172.21.15.187:6809/1806494478","cluster_addr":"172.21.15.187:6811/1806494478","heartbeat_back_addr":"172.21.15.187:6815/1806494478","heartbeat_front_addr":"172.21.15.187:6813/1806494478","state":["exists","up"]},{"osd":5,"uuid":"00acf156-4c06-4a90-9dfe-831bf693b7c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6817","nonce":79785513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6819","nonce":79785513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6823","nonce":79785513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":79785513},{"type":"v1","addr":"172.21.15.187:6821","nonce":79785513}]},"public_addr":"172.21.15.187:6817/79785513","cluster_addr":"172.21.15.187:6819/79785513","heartbeat_back_addr":"172.21.15.187:6823/79785513","heartbeat_front_addr":"172.21.15.187:6821/79785513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:50:49.064500+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:18.736425+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.731443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.601651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:39.801307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:06.362521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6801/3765534604":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1057860168":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6801/1831378595":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6800/3765534604":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1095552815":"2024-09-22T00:48:09.439159+0000","172.21.15.112:6801/1888748619":"2024-09-22T00:48:09.439159+0000","172.21.15.112:6800/1831378595":"2024-09-22T00:47:38.084945+0000","172.21.15.112:0/3460305391":"2024-09-22T00:47:38.084945+0000","172.21.15.112:6800/1888748619":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/1370295957":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/31517036":"2024-09-22T00:47:38.084945+0000","172.21.15.112:0/186527546":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/987062445":"2024-09-22T00:48:09.439159+0000","172.21.15.112:0/713543":"2024-09-22T00:49:05.189182+0000","172.21.15.112:0/1353438780":"2024-09-22T00:49:05.189182+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:53:22.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff9a806e2b0 msgr2=0x7ff9a8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff9a806e2b0 0x7ff9a8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006fd0 tx=0x7ff9ac008040 comp rx=0 tx=0).stop 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc0ff8e0 msgr2=0x7ff9bc19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc0ff8e0 0x7ff9bc19d650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8031460 tx=0x7ff9b80048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 shutdown_connections 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff9a806e2b0 0x7ff9a8070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9bc106900 0x7ff9bc19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 --2- 172.21.15.112:0/2689801371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9bc0ff8e0 0x7ff9bc19d650 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 >> 172.21.15.112:0/2689801371 conn(0x7ff9bc0fb810 msgr2=0x7ff9bc0fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 shutdown_connections 2024-09-21T00:53:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:22.648+0000 7ff9c3d2c640 1 -- 172.21.15.112:0/2689801371 wait complete. 2024-09-21T00:53:22.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:22 smithi187 ceph-mon[34997]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:23.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T00:53:23.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T00:53:23.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T00:53:23.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T00:53:23.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T00:53:23.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T00:53:23.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:23 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2689801371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T00:53:23.642 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:23.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:23 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2689801371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T00:53:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 -- 172.21.15.112:0/108892561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4100820 msgr2=0x7fd5e4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 --2- 172.21.15.112:0/108892561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4100820 0x7fd5e4100c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009880 tx=0x7fd5d402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 -- 172.21.15.112:0/108892561 shutdown_connections 2024-09-21T00:53:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 --2- 172.21.15.112:0/108892561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4100820 0x7fd5e4100c80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 --2- 172.21.15.112:0/108892561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e4106820 0x7fd5e4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 -- 172.21.15.112:0/108892561 >> 172.21.15.112:0/108892561 conn(0x7fd5e40fc520 msgr2=0x7fd5e40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 -- 172.21.15.112:0/108892561 shutdown_connections 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 -- 172.21.15.112:0/108892561 wait complete. 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 Processor -- start 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.132+0000 7fd5e9963640 1 -- start start 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e9963640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e4100820 0x7fd5e419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e9963640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4106820 0x7fd5e419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e9963640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410dd50 con 0x7fd5e4106820 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e9963640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e410dbd0 con 0x7fd5e4100820 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4106820 0x7fd5e419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4106820 0x7fd5e419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40900/0 (socket says 172.21.15.112:40900) 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e27fc640 1 -- 172.21.15.112:0/2325712108 learned_addr learned my addr 172.21.15.112:0/2325712108 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e2ffd640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e4100820 0x7fd5e419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e27fc640 1 -- 172.21.15.112:0/2325712108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e4100820 msgr2=0x7fd5e419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e27fc640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e4100820 0x7fd5e419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e27fc640 1 -- 172.21.15.112:0/2325712108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e4199a40 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e27fc640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4106820 0x7fd5e419fdc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4031460 tx=0x7fd5d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5d403f070 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5d4004cf0 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e4199cd0 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.133+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5d4035030 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.134+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e419a200 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.135+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5e419a7c0 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.135+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd5d4042070 con 0x7fd5e4106820 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.135+0000 7fd5e8961640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd5cc06e2b0 0x7fd5cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.135+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fd5d40ae8a0 con 0x7fd5e4106820 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.136+0000 7fd5e2ffd640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd5cc06e2b0 0x7fd5cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.136+0000 7fd5e8961640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] conn(0x7fd5cc0740a0 0x7fd5cc0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.136+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 --> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5d40054e0 con 0x7fd5cc0740a0 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.136+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd5d40b32a0 con 0x7fd5e4106820 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.136+0000 7fd5e37fe640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] conn(0x7fd5cc0740a0 0x7fd5cc0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.136+0000 7fd5e2ffd640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd5cc06e2b0 0x7fd5cc070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd5e419ab80 tx=0x7fd5d8009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.136+0000 7fd5e37fe640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] conn(0x7fd5cc0740a0 0x7fd5cc0764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.137+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== osd.2 v2:172.21.15.112:6818/1709988830 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5d40054e0 con 0x7fd5cc0740a0 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.150+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 --> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5e40fde00 con 0x7fd5cc0740a0 2024-09-21T00:53:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e8961640 1 -- 172.21.15.112:0/2325712108 <== osd.2 v2:172.21.15.112:6818/1709988830 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd5e40fde00 con 0x7fd5cc0740a0 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] conn(0x7fd5cc0740a0 msgr2=0x7fd5cc0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] conn(0x7fd5cc0740a0 0x7fd5cc0764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd5cc06e2b0 msgr2=0x7fd5cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd5cc06e2b0 0x7fd5cc070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd5e419ab80 tx=0x7fd5d8009110 comp rx=0 tx=0).stop 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4106820 msgr2=0x7fd5e419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4106820 0x7fd5e419fdc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4031460 tx=0x7fd5d40048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 shutdown_connections 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6818/1709988830,v1:172.21.15.112:6819/1709988830] conn(0x7fd5cc0740a0 0x7fd5cc0764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd5cc06e2b0 0x7fd5cc070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5e4106820 0x7fd5e419fdc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 --2- 172.21.15.112:0/2325712108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e4100820 0x7fd5e419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 >> 172.21.15.112:0/2325712108 conn(0x7fd5e40fc520 msgr2=0x7fd5e40fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 shutdown_connections 2024-09-21T00:53:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.151+0000 7fd5e9963640 1 -- 172.21.15.112:0/2325712108 wait complete. 2024-09-21T00:53:24.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:24 smithi112 ceph-mon[28078]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:24.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:24 smithi187 ceph-mon[34997]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:24.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/903308653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec102b20 msgr2=0x7ff2ec102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/903308653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec102b20 0x7ff2ec102f00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009880 tx=0x7ff2dc02a530 comp rx=0 tx=0).stop 2024-09-21T00:53:24.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/903308653 shutdown_connections 2024-09-21T00:53:24.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/903308653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2ec103440 0x7ff2ec10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/903308653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec102b20 0x7ff2ec102f00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/903308653 >> 172.21.15.112:0/903308653 conn(0x7ff2ec0fc4c0 msgr2=0x7ff2ec0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/903308653 shutdown_connections 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.852+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/903308653 wait complete. 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2f1c9e640 1 Processor -- start 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2f1c9e640 1 -- start start 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2f1c9e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2ec102b20 0x7ff2ec19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2f1c9e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec103440 0x7ff2ec19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2f1c9e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec10ee30 con 0x7ff2ec103440 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2f1c9e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec10ecb0 con 0x7ff2ec102b20 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2e3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec103440 0x7ff2ec19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2e3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec103440 0x7ff2ec19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40918/0 (socket says 172.21.15.112:40918) 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.853+0000 7ff2e3fff640 1 -- 172.21.15.112:0/505889706 learned_addr learned my addr 172.21.15.112:0/505889706 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:24.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2eb7fe640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2ec102b20 0x7ff2ec19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2e3fff640 1 -- 172.21.15.112:0/505889706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2ec102b20 msgr2=0x7ff2ec19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2e3fff640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2ec102b20 0x7ff2ec19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2e3fff640 1 -- 172.21.15.112:0/505889706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec197820 con 0x7ff2ec103440 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2e3fff640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec103440 0x7ff2ec19dbe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400b420 tx=0x7ff2d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2d401d070 con 0x7ff2ec103440 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2d4010d50 con 0x7ff2ec103440 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec197ab0 con 0x7ff2ec103440 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2d4016570 con 0x7ff2ec103440 2024-09-21T00:53:24.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.854+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec198040 con 0x7ff2ec103440 2024-09-21T00:53:24.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.855+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2ec198660 con 0x7ff2ec103440 2024-09-21T00:53:24.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.856+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff2d4020070 con 0x7ff2ec103440 2024-09-21T00:53:24.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.856+0000 7ff2e97fa640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff2d806e2b0 0x7ff2d8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.856+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff2d4091410 con 0x7ff2ec103440 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.856+0000 7ff2eb7fe640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff2d806e2b0 0x7ff2d8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.856+0000 7ff2e97fa640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] conn(0x7ff2d80740a0 0x7ff2d80764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.856+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 --> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2d8076b70 con 0x7ff2d80740a0 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.856+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff2d4098050 con 0x7ff2ec103440 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.857+0000 7ff2ebfff640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] conn(0x7ff2d80740a0 0x7ff2d80764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.857+0000 7ff2eb7fe640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff2d806e2b0 0x7ff2d8070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0096c0 tx=0x7ff2dc004f30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.857+0000 7ff2ebfff640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] conn(0x7ff2d80740a0 0x7ff2d80764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:24.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.858+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== osd.0 v2:172.21.15.112:6802/54877108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2d8076b70 con 0x7ff2d80740a0 2024-09-21T00:53:24.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.871+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 --> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2ec062900 con 0x7ff2d80740a0 2024-09-21T00:53:24.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.871+0000 7ff2e97fa640 1 -- 172.21.15.112:0/505889706 <== osd.0 v2:172.21.15.112:6802/54877108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff2ec062900 con 0x7ff2d80740a0 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.871+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] conn(0x7ff2d80740a0 msgr2=0x7ff2d80764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.871+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] conn(0x7ff2d80740a0 0x7ff2d80764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff2d806e2b0 msgr2=0x7ff2d8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff2d806e2b0 0x7ff2d8070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0096c0 tx=0x7ff2dc004f30 comp rx=0 tx=0).stop 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec103440 msgr2=0x7ff2ec19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec103440 0x7ff2ec19dbe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400b420 tx=0x7ff2d400b8e0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 shutdown_connections 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6802/54877108,v1:172.21.15.112:6803/54877108] conn(0x7ff2d80740a0 0x7ff2d80764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff2d806e2b0 0x7ff2d8070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2ec103440 0x7ff2ec19dbe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 --2- 172.21.15.112:0/505889706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2ec102b20 0x7ff2ec19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:24.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 >> 172.21.15.112:0/505889706 conn(0x7ff2ec0fc4c0 msgr2=0x7ff2ec108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 shutdown_connections 2024-09-21T00:53:24.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:24.872+0000 7ff2f1c9e640 1 -- 172.21.15.112:0/505889706 wait complete. 2024-09-21T00:53:25.143 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:25.144 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:25.686 INFO:teuthology.orchestra.run.smithi112.stdout:38654705697 2024-09-21T00:53:25.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T00:53:25.705 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:25.705 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:26.038 INFO:teuthology.orchestra.run.smithi112.stdout:81604378646 2024-09-21T00:53:26.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T00:53:26.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 -- 172.21.15.112:0/2506194742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 msgr2=0x7faa0010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:26.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2506194742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0010b8b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009880 tx=0x7fa9f002a530 comp rx=0 tx=0).stop 2024-09-21T00:53:26.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 -- 172.21.15.112:0/2506194742 shutdown_connections 2024-09-21T00:53:26.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2506194742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0010b8b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2506194742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa00102aa0 0x7faa00102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 -- 172.21.15.112:0/2506194742 >> 172.21.15.112:0/2506194742 conn(0x7faa000fc4c0 msgr2=0x7faa000fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 -- 172.21.15.112:0/2506194742 shutdown_connections 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 -- 172.21.15.112:0/2506194742 wait complete. 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.446+0000 7faa07ac6640 1 Processor -- start 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa07ac6640 1 -- start start 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa07ac6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa00102aa0 0x7faa0019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa07ac6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa07ac6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa0010ee30 con 0x7faa001033c0 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa07ac6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faa0010ecb0 con 0x7faa00102aa0 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05061640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05061640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40926/0 (socket says 172.21.15.112:40926) 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05061640 1 -- 172.21.15.112:0/2530440842 learned_addr learned my addr 172.21.15.112:0/2530440842 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:26.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05862640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa00102aa0 0x7faa0019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05061640 1 -- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa00102aa0 msgr2=0x7faa0019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05061640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa00102aa0 0x7faa0019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05061640 1 -- 172.21.15.112:0/2530440842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa00197860 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05862640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa00102aa0 0x7faa0019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.447+0000 7faa05061640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0019dbe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0031460 tx=0x7fa9f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.448+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9f003f070 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.448+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9f0004ac0 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.448+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa00197af0 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.448+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9f0035030 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.448+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa00198020 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.449+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa001985e0 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.449+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fa9f0042070 con 0x7faa001033c0 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.449+0000 7fa9f6ffd640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fa9ec06e2b0 0x7fa9ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:26.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.450+0000 7faa05862640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fa9ec06e2b0 0x7fa9ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.450+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fa9f00ae860 con 0x7faa001033c0 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.450+0000 7fa9f6ffd640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] conn(0x7fa9ec0740a0 0x7fa9ec0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.450+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 --> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9f0039e50 con 0x7fa9ec0740a0 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.450+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa9f00b32a0 con 0x7faa001033c0 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.450+0000 7faa05862640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fa9ec06e2b0 0x7fa9ec070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa001989a0 tx=0x7fa9fc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.450+0000 7faa06063640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] conn(0x7fa9ec0740a0 0x7fa9ec0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.451+0000 7faa06063640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] conn(0x7fa9ec0740a0 0x7fa9ec0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:26.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.451+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== osd.4 v2:172.21.15.187:6808/1806494478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9f0039e50 con 0x7fa9ec0740a0 2024-09-21T00:53:26.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.465+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 --> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa00062900 con 0x7fa9ec0740a0 2024-09-21T00:53:26.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.465+0000 7fa9f6ffd640 1 -- 172.21.15.112:0/2530440842 <== osd.4 v2:172.21.15.187:6808/1806494478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa00062900 con 0x7fa9ec0740a0 2024-09-21T00:53:26.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.465+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] conn(0x7fa9ec0740a0 msgr2=0x7fa9ec0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:26.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.465+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] conn(0x7fa9ec0740a0 0x7fa9ec0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fa9ec06e2b0 msgr2=0x7fa9ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fa9ec06e2b0 0x7fa9ec070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa001989a0 tx=0x7fa9fc008040 comp rx=0 tx=0).stop 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 msgr2=0x7faa0019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0019dbe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0031460 tx=0x7fa9f00046c0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 shutdown_connections 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fa9ec06e2b0 0x7fa9ec070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa001033c0 0x7faa0019dbe0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:6808/1806494478,v1:172.21.15.187:6809/1806494478] conn(0x7fa9ec0740a0 0x7fa9ec0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 --2- 172.21.15.112:0/2530440842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa00102aa0 0x7faa0019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 >> 172.21.15.112:0/2530440842 conn(0x7faa000fc4c0 msgr2=0x7faa00108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 shutdown_connections 2024-09-21T00:53:26.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:26.466+0000 7faa07ac6640 1 -- 172.21.15.112:0/2530440842 wait complete. 2024-09-21T00:53:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:26 smithi187 ceph-mon[34997]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:26 smithi112 ceph-mon[28078]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:27.079 INFO:teuthology.orchestra.run.smithi112.stdout:137438953484 2024-09-21T00:53:27.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T00:53:27.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/830268457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 msgr2=0x7ffbd810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:27.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/830268457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd810b8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009880 tx=0x7ffbcc02a530 comp rx=0 tx=0).stop 2024-09-21T00:53:27.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/830268457 shutdown_connections 2024-09-21T00:53:27.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/830268457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd810b8f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/830268457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd8102ae0 0x7ffbd8102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/830268457 >> 172.21.15.112:0/830268457 conn(0x7ffbd80fc520 msgr2=0x7ffbd80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:27.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/830268457 shutdown_connections 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.939+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/830268457 wait complete. 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdf9b6640 1 Processor -- start 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdf9b6640 1 -- start start 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdf9b6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd8102ae0 0x7ffbd819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdf9b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdf9b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd810ee10 con 0x7ffbd8103400 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdf9b6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd810ec90 con 0x7ffbd8102ae0 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdcf51640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdcf51640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40942/0 (socket says 172.21.15.112:40942) 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.940+0000 7ffbdcf51640 1 -- 172.21.15.112:0/3110946704 learned_addr learned my addr 172.21.15.112:0/3110946704 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbdd752640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd8102ae0 0x7ffbd819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbdcf51640 1 -- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd8102ae0 msgr2=0x7ffbd819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:27.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbdcf51640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd8102ae0 0x7ffbd819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbdcf51640 1 -- 172.21.15.112:0/3110946704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd8197820 con 0x7ffbd8103400 2024-09-21T00:53:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbdcf51640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd819dbe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc031460 tx=0x7ffbcc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc03f070 con 0x7ffbd8103400 2024-09-21T00:53:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffbcc0035f0 con 0x7ffbd8103400 2024-09-21T00:53:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc035030 con 0x7ffbd8103400 2024-09-21T00:53:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd8197ab0 con 0x7ffbd8103400 2024-09-21T00:53:27.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.941+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd8197fe0 con 0x7ffbd8103400 2024-09-21T00:53:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.942+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffbd81985a0 con 0x7ffbd8103400 2024-09-21T00:53:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.943+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ffbcc042070 con 0x7ffbd8103400 2024-09-21T00:53:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.943+0000 7ffbd67fc640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ffbc006e310 0x7ffbc00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.943+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ffbcc0aed70 con 0x7ffbd8103400 2024-09-21T00:53:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.943+0000 7ffbdd752640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ffbc006e310 0x7ffbc00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:27.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.943+0000 7ffbd67fc640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] conn(0x7ffbc0074100 0x7ffbc0076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.943+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 --> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbcc032e50 con 0x7ffbc0074100 2024-09-21T00:53:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.943+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ffbcc0af210 con 0x7ffbd8103400 2024-09-21T00:53:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.944+0000 7ffbdd752640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ffbc006e310 0x7ffbc00707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0005fd0 tx=0x7ffbd0005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.944+0000 7ffbddf53640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] conn(0x7ffbc0074100 0x7ffbc0076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.944+0000 7ffbddf53640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] conn(0x7ffbc0074100 0x7ffbc0076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:27.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.945+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== osd.5 v2:172.21.15.187:6816/79785513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffbcc032e50 con 0x7ffbc0074100 2024-09-21T00:53:27.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.958+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 --> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffbd8062880 con 0x7ffbc0074100 2024-09-21T00:53:27.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbd67fc640 1 -- 172.21.15.112:0/3110946704 <== osd.5 v2:172.21.15.187:6816/79785513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffbd8062880 con 0x7ffbc0074100 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] conn(0x7ffbc0074100 msgr2=0x7ffbc0076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] conn(0x7ffbc0074100 0x7ffbc0076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ffbc006e310 msgr2=0x7ffbc00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ffbc006e310 0x7ffbc00707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0005fd0 tx=0x7ffbd0005850 comp rx=0 tx=0).stop 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 msgr2=0x7ffbd819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd819dbe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc031460 tx=0x7ffbcc004530 comp rx=0 tx=0).stop 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 shutdown_connections 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:6816/79785513,v1:172.21.15.187:6817/79785513] conn(0x7ffbc0074100 0x7ffbc0076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ffbc006e310 0x7ffbc00707d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8103400 0x7ffbd819dbe0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 --2- 172.21.15.112:0/3110946704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd8102ae0 0x7ffbd819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:27.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 >> 172.21.15.112:0/3110946704 conn(0x7ffbd80fc520 msgr2=0x7ffbd8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:27.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 shutdown_connections 2024-09-21T00:53:27.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:27.959+0000 7ffbdf9b6640 1 -- 172.21.15.112:0/3110946704 wait complete. 2024-09-21T00:53:28.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 -- 172.21.15.112:0/1414105446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 msgr2=0x7fad2c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:28.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 --2- 172.21.15.112:0/1414105446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c100c80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad20009880 tx=0x7fad2002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 -- 172.21.15.112:0/1414105446 shutdown_connections 2024-09-21T00:53:28.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 --2- 172.21.15.112:0/1414105446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c100c80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 --2- 172.21.15.112:0/1414105446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c106820 0x7fad2c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 -- 172.21.15.112:0/1414105446 >> 172.21.15.112:0/1414105446 conn(0x7fad2c0fc520 msgr2=0x7fad2c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 -- 172.21.15.112:0/1414105446 shutdown_connections 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.147+0000 7fad321e7640 1 -- 172.21.15.112:0/1414105446 wait complete. 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad321e7640 1 Processor -- start 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad321e7640 1 -- start start 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad321e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad321e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c106820 0x7fad2c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad321e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c10dd50 con 0x7fad2c100820 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad321e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c10dbd0 con 0x7fad2c106820 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad2b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad2b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40960/0 (socket says 172.21.15.112:40960) 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.148+0000 7fad2b7fe640 1 -- 172.21.15.112:0/2978507938 learned_addr learned my addr 172.21.15.112:0/2978507938 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:28.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad2b7fe640 1 -- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c106820 msgr2=0x7fad2c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad2affd640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c106820 0x7fad2c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad2b7fe640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c106820 0x7fad2c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad2b7fe640 1 -- 172.21.15.112:0/2978507938 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c1993c0 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad2b7fe640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c198880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00b420 tx=0x7fad1c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad1c011630 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2c1996b0 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad1c016070 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad1c010d40 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.149+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2c1a1cb0 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.150+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad2c0628c0 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.150+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fad1c01b460 con 0x7fad2c100820 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad28ff9640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fad1406e2b0 0x7fad14070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:28.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fad1c08d6c0 con 0x7fad2c100820 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad2affd640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fad1406e2b0 0x7fad14070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad28ff9640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] conn(0x7fad140740a0 0x7fad140764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 --> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad14076b70 con 0x7fad140740a0 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fad1c094050 con 0x7fad2c100820 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad2affd640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fad1406e2b0 0x7fad14070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad20031460 tx=0x7fad20009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.151+0000 7fad2bfff640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] conn(0x7fad140740a0 0x7fad140764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.152+0000 7fad2bfff640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] conn(0x7fad140740a0 0x7fad140764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.153+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== osd.3 v2:172.21.15.187:6800/2152078309 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad14076b70 con 0x7fad140740a0 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.166+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 --> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad2c062d40 con 0x7fad140740a0 2024-09-21T00:53:28.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad28ff9640 1 -- 172.21.15.112:0/2978507938 <== osd.3 v2:172.21.15.187:6800/2152078309 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad2c062d40 con 0x7fad140740a0 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] conn(0x7fad140740a0 msgr2=0x7fad140764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] conn(0x7fad140740a0 0x7fad140764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fad1406e2b0 msgr2=0x7fad14070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fad1406e2b0 0x7fad14070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad20031460 tx=0x7fad20009560 comp rx=0 tx=0).stop 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 msgr2=0x7fad2c198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c198880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00b420 tx=0x7fad1c00b8e0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 shutdown_connections 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:6800/2152078309,v1:172.21.15.187:6801/2152078309] conn(0x7fad140740a0 0x7fad140764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fad1406e2b0 0x7fad14070770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c106820 0x7fad2c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 --2- 172.21.15.112:0/2978507938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c100820 0x7fad2c198880 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:28.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 >> 172.21.15.112:0/2978507938 conn(0x7fad2c0fc520 msgr2=0x7fad2c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:28.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 shutdown_connections 2024-09-21T00:53:28.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:28.167+0000 7fad321e7640 1 -- 172.21.15.112:0/2978507938 wait complete. 2024-09-21T00:53:28.657 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:28 smithi112 ceph-mon[28078]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:28.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:28 smithi187 ceph-mon[34997]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:29.037 INFO:teuthology.orchestra.run.smithi112.stdout:107374182418 2024-09-21T00:53:29.038 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T00:53:29.480 INFO:teuthology.orchestra.run.smithi112.stdout:158913789959 2024-09-21T00:53:29.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 -- 172.21.15.112:0/823781432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 msgr2=0x7fc14c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 --2- 172.21.15.112:0/823781432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c100c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc138009880 tx=0x7fc13802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 -- 172.21.15.112:0/823781432 shutdown_connections 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 --2- 172.21.15.112:0/823781432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c100c40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 --2- 172.21.15.112:0/823781432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c1067e0 0x7fc14c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 -- 172.21.15.112:0/823781432 >> 172.21.15.112:0/823781432 conn(0x7fc14c0fc4c0 msgr2=0x7fc14c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 -- 172.21.15.112:0/823781432 shutdown_connections 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 -- 172.21.15.112:0/823781432 wait complete. 2024-09-21T00:53:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 Processor -- start 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.680+0000 7fc15314d640 1 -- start start 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc15314d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc15314d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c1067e0 0x7fc14c198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc15314d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c10dcb0 con 0x7fc14c1007e0 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc15314d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c10db30 con 0x7fc14c1067e0 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc150ee9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc150ee9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c1987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40980/0 (socket says 172.21.15.112:40980) 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc150ee9640 1 -- 172.21.15.112:0/3792824092 learned_addr learned my addr 172.21.15.112:0/3792824092 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc14bfff640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c1067e0 0x7fc14c198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc150ee9640 1 -- 172.21.15.112:0/3792824092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c1067e0 msgr2=0x7fc14c198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc150ee9640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c1067e0 0x7fc14c198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc150ee9640 1 -- 172.21.15.112:0/3792824092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c199330 con 0x7fc14c1007e0 2024-09-21T00:53:29.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc150ee9640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c1987a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc14000d6f0 tx=0x7fc14000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc140017070 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc14000de00 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c1a1810 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.681+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc140004bb0 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.682+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c1a1c10 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.682+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc14c0628c0 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.683+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fc140004e60 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.683+0000 7fc149ffb640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc13c06e2b0 0x7fc13c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.683+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fc14008da20 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.683+0000 7fc14bfff640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc13c06e2b0 0x7fc13c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.683+0000 7fc149ffb640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] conn(0x7fc13c0740a0 0x7fc13c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.683+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 --> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc13c076b70 con 0x7fc13c0740a0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.683+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc1400922a0 con 0x7fc14c1007e0 2024-09-21T00:53:29.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.684+0000 7fc1516ea640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] conn(0x7fc13c0740a0 0x7fc13c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.684+0000 7fc14bfff640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc13c06e2b0 0x7fc13c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc14c06a6c0 tx=0x7fc138031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.684+0000 7fc1516ea640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] conn(0x7fc13c0740a0 0x7fc13c0764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.685+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== osd.1 v2:172.21.15.112:6810/1589865047 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc13c076b70 con 0x7fc13c0740a0 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 --> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc14c062cc0 con 0x7fc13c0740a0 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc149ffb640 1 -- 172.21.15.112:0/3792824092 <== osd.1 v2:172.21.15.112:6810/1589865047 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc14c062cc0 con 0x7fc13c0740a0 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] conn(0x7fc13c0740a0 msgr2=0x7fc13c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] conn(0x7fc13c0740a0 0x7fc13c0764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc13c06e2b0 msgr2=0x7fc13c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc13c06e2b0 0x7fc13c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc14c06a6c0 tx=0x7fc138031400 comp rx=0 tx=0).stop 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 msgr2=0x7fc14c1987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c1987a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc14000d6f0 tx=0x7fc14000dbb0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.698+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 shutdown_connections 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.699+0000 7fc15314d640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6810/1589865047,v1:172.21.15.112:6811/1589865047] conn(0x7fc13c0740a0 0x7fc13c0764c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.699+0000 7fc15314d640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fc13c06e2b0 0x7fc13c070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.699+0000 7fc15314d640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c1067e0 0x7fc14c198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.699+0000 7fc15314d640 1 --2- 172.21.15.112:0/3792824092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c1007e0 0x7fc14c1987a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.699+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 >> 172.21.15.112:0/3792824092 conn(0x7fc14c0fc4c0 msgr2=0x7fc14c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.699+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 shutdown_connections 2024-09-21T00:53:29.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:29.699+0000 7fc15314d640 1 -- 172.21.15.112:0/3792824092 wait complete. 2024-09-21T00:53:29.951 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:30.467 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:30.479 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:30.497 INFO:teuthology.orchestra.run.smithi112.stdout:60129542173 2024-09-21T00:53:30.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T00:53:30.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:30 smithi187 ceph-mon[34997]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:30.721 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:30 smithi112 ceph-mon[28078]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 -- 172.21.15.112:0/4023966868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 msgr2=0x7fd190100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 --2- 172.21.15.112:0/4023966868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd190100c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd180009880 tx=0x7fd18002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 -- 172.21.15.112:0/4023966868 shutdown_connections 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 --2- 172.21.15.112:0/4023966868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd190100c40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 --2- 172.21.15.112:0/4023966868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1901067e0 0x7fd190106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 -- 172.21.15.112:0/4023966868 >> 172.21.15.112:0/4023966868 conn(0x7fd1900fc4c0 msgr2=0x7fd1900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 -- 172.21.15.112:0/4023966868 shutdown_connections 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.255+0000 7fd197505640 1 -- 172.21.15.112:0/4023966868 wait complete. 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd197505640 1 Processor -- start 2024-09-21T00:53:31.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd197505640 1 -- start start 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd197505640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd1901987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd197505640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1901067e0 0x7fd190198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd197505640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd19010dcb0 con 0x7fd1901007e0 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd197505640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd19010db30 con 0x7fd1901067e0 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd1952a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd1901987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd1952a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd1901987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41010/0 (socket says 172.21.15.112:41010) 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd1952a1640 1 -- 172.21.15.112:0/3763328010 learned_addr learned my addr 172.21.15.112:0/3763328010 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd194aa0640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1901067e0 0x7fd190198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd1952a1640 1 -- 172.21.15.112:0/3763328010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1901067e0 msgr2=0x7fd190198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd1952a1640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1901067e0 0x7fd190198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd1952a1640 1 -- 172.21.15.112:0/3763328010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd190199320 con 0x7fd1901007e0 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.256+0000 7fd194aa0640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1901067e0 0x7fd190198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:31.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.257+0000 7fd1952a1640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd1901987e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c8f0 tx=0x7fd18c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.257+0000 7fd1867fc640 1 -- 172.21.15.112:0/3763328010 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd18c0079b0 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.257+0000 7fd1867fc640 1 -- 172.21.15.112:0/3763328010 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd18c0054e0 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.257+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd190199610 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.257+0000 7fd1867fc640 1 -- 172.21.15.112:0/3763328010 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd18c004dd0 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.257+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1901a1c10 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.258+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd190101f20 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.259+0000 7fd1867fc640 1 -- 172.21.15.112:0/3763328010 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd18c005020 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.259+0000 7fd1867fc640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd17c06e260 0x7fd17c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.259+0000 7fd1867fc640 1 -- 172.21.15.112:0/3763328010 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fd18c08ddf0 con 0x7fd1901007e0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.259+0000 7fd194aa0640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd17c06e260 0x7fd17c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.259+0000 7fd194aa0640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd17c06e260 0x7fd17c070720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd180006010 tx=0x7fd1800095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:31.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.263+0000 7fd1867fc640 1 -- 172.21.15.112:0/3763328010 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd190199610 con 0x7fd1901007e0 2024-09-21T00:53:31.367 INFO:teuthology.orchestra.run.smithi112.stdout:137438953485 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 -- 172.21.15.112:0/2029419681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4107930 msgr2=0x7ff4f4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 --2- 172.21.15.112:0/2029419681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4107930 0x7ff4f4107d10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009880 tx=0x7ff4e402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 -- 172.21.15.112:0/2029419681 shutdown_connections 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 --2- 172.21.15.112:0/2029419681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4f4101930 0x7ff4f4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 --2- 172.21.15.112:0/2029419681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4107930 0x7ff4f4107d10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 -- 172.21.15.112:0/2029419681 >> 172.21.15.112:0/2029419681 conn(0x7ff4f40fd630 msgr2=0x7ff4f40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 -- 172.21.15.112:0/2029419681 shutdown_connections 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 -- 172.21.15.112:0/2029419681 wait complete. 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 Processor -- start 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.140+0000 7ff4fa852640 1 -- start start 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4fa852640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4101930 0x7ff4f419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:31.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4fa852640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4f4107930 0x7ff4f419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4fa852640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f410ee60 con 0x7ff4f4101930 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4fa852640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f410ece0 con 0x7ff4f4107930 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4101930 0x7ff4f419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4101930 0x7ff4f419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40992/0 (socket says 172.21.15.112:40992) 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f3fff640 1 -- 172.21.15.112:0/3573693224 learned_addr learned my addr 172.21.15.112:0/3573693224 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f37fe640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4f4107930 0x7ff4f419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f3fff640 1 -- 172.21.15.112:0/3573693224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4f4107930 msgr2=0x7ff4f419dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f3fff640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4f4107930 0x7ff4f419dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f3fff640 1 -- 172.21.15.112:0/3573693224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f4197890 con 0x7ff4f4101930 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f37fe640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4f4107930 0x7ff4f419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f3fff640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4101930 0x7ff4f419d6d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4031460 tx=0x7ff4e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f17fa640 1 -- 172.21.15.112:0/3573693224 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e403f070 con 0x7ff4f4101930 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f4197b20 con 0x7ff4f4101930 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f17fa640 1 -- 172.21.15.112:0/3573693224 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4e4004cf0 con 0x7ff4f4101930 2024-09-21T00:53:31.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.141+0000 7ff4f17fa640 1 -- 172.21.15.112:0/3573693224 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e4035030 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.142+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f4198050 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.143+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f4103070 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.143+0000 7ff4f17fa640 1 -- 172.21.15.112:0/3573693224 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff4e4042070 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.143+0000 7ff4f17fa640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff4dc06e2b0 0x7ff4dc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.144+0000 7ff4f17fa640 1 -- 172.21.15.112:0/3573693224 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff4e40ae910 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.144+0000 7ff4f37fe640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff4dc06e2b0 0x7ff4dc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.144+0000 7ff4f37fe640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff4dc06e2b0 0x7ff4dc070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8006fd0 tx=0x7ff4e8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.148+0000 7ff4f17fa640 1 -- 172.21.15.112:0/3573693224 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff4e407c5b0 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.323+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff4f4198dc0 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.324+0000 7ff4f17fa640 1 -- 172.21.15.112:0/3573693224 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff4e4080260 con 0x7ff4f4101930 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff4dc06e2b0 msgr2=0x7ff4dc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff4dc06e2b0 0x7ff4dc070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8006fd0 tx=0x7ff4e8008040 comp rx=0 tx=0).stop 2024-09-21T00:53:31.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4101930 msgr2=0x7ff4f419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4101930 0x7ff4f419d6d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4031460 tx=0x7ff4e40048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 shutdown_connections 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff4dc06e2b0 0x7ff4dc070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4f4107930 0x7ff4f419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 --2- 172.21.15.112:0/3573693224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4f4101930 0x7ff4f419d6d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 >> 172.21.15.112:0/3573693224 conn(0x7ff4f40fd630 msgr2=0x7ff4f40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 shutdown_connections 2024-09-21T00:53:31.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.326+0000 7ff4fa852640 1 -- 172.21.15.112:0/3573693224 wait complete. 2024-09-21T00:53:31.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.441+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd190108d50 con 0x7fd1901007e0 2024-09-21T00:53:31.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.441+0000 7fd1867fc640 1 -- 172.21.15.112:0/3763328010 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd18c014030 con 0x7fd1901007e0 2024-09-21T00:53:31.442 INFO:teuthology.orchestra.run.smithi112.stdout:81604378648 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd17c06e260 msgr2=0x7fd17c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd17c06e260 0x7fd17c070720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd180006010 tx=0x7fd1800095f0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 msgr2=0x7fd1901987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd1901987e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c8f0 tx=0x7fd18c00cdb0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 shutdown_connections 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd17c06e260 0x7fd17c070720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1901067e0 0x7fd190198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 --2- 172.21.15.112:0/3763328010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1901007e0 0x7fd1901987e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 >> 172.21.15.112:0/3763328010 conn(0x7fd1900fc4c0 msgr2=0x7fd1900fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 shutdown_connections 2024-09-21T00:53:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:31.443+0000 7fd197505640 1 -- 172.21.15.112:0/3763328010 wait complete. 2024-09-21T00:53:31.632 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:31 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3573693224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T00:53:31.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:31 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3573693224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T00:53:32.444 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378648 for osd.2 2024-09-21T00:53:32.444 DEBUG:teuthology.parallel:result is None 2024-09-21T00:53:32.487 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:32.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:32 smithi187 ceph-mon[34997]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:32.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:32 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3763328010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T00:53:32.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:32 smithi112 ceph-mon[28078]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:32.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:32 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3763328010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T00:53:32.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 -- 172.21.15.112:0/629818739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c107930 msgr2=0x7f308c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:32.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 --2- 172.21.15.112:0/629818739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c107930 0x7f308c107d10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f307c009880 tx=0x7f307c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 -- 172.21.15.112:0/629818739 shutdown_connections 2024-09-21T00:53:32.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 --2- 172.21.15.112:0/629818739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f308c101930 0x7f308c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 --2- 172.21.15.112:0/629818739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c107930 0x7f308c107d10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 -- 172.21.15.112:0/629818739 >> 172.21.15.112:0/629818739 conn(0x7f308c0fd630 msgr2=0x7f308c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 -- 172.21.15.112:0/629818739 shutdown_connections 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.681+0000 7f3091138640 1 -- 172.21.15.112:0/629818739 wait complete. 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f3091138640 1 Processor -- start 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f3091138640 1 -- start start 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f3091138640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c101930 0x7f308c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f3091138640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f308c107930 0x7f308c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f3091138640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f308c10ee60 con 0x7f308c101930 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f3091138640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f308c10ece0 con 0x7f308c107930 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f308ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c101930 0x7f308c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f308ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c101930 0x7f308c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51364/0 (socket says 172.21.15.112:51364) 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f308ad9d640 1 -- 172.21.15.112:0/4021130298 learned_addr learned my addr 172.21.15.112:0/4021130298 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f3083fff640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f308c107930 0x7f308c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.682+0000 7f308ad9d640 1 -- 172.21.15.112:0/4021130298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f308c107930 msgr2=0x7f308c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f308ad9d640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f308c107930 0x7f308c19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f308ad9d640 1 -- 172.21.15.112:0/4021130298 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c197890 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f3083fff640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f308c107930 0x7f308c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f308ad9d640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c101930 0x7f308c19d6d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f307c031460 tx=0x7f307c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f3088d99640 1 -- 172.21.15.112:0/4021130298 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f307c03f070 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f3088d99640 1 -- 172.21.15.112:0/4021130298 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f307c004cf0 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308c197b20 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f3088d99640 1 -- 172.21.15.112:0/4021130298 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f307c035030 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.683+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f308c198050 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.684+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f308c103070 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.684+0000 7f3088d99640 1 -- 172.21.15.112:0/4021130298 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f307c042070 con 0x7f308c101930 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.685+0000 7f3088d99640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f307806e2b0 0x7f3078070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.685+0000 7f3083fff640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f307806e2b0 0x7f3078070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.685+0000 7f3088d99640 1 -- 172.21.15.112:0/4021130298 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f307c0ae910 con 0x7f308c101930 2024-09-21T00:53:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.685+0000 7f3083fff640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f307806e2b0 0x7f3078070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3074006fd0 tx=0x7f3074008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.690+0000 7f3088d99640 1 -- 172.21.15.112:0/4021130298 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f307c07c5b0 con 0x7f308c101930 2024-09-21T00:53:32.713 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:32.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.862+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f308c198dc0 con 0x7f308c101930 2024-09-21T00:53:32.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.862+0000 7f3088d99640 1 -- 172.21.15.112:0/4021130298 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f307c080260 con 0x7f308c101930 2024-09-21T00:53:32.863 INFO:teuthology.orchestra.run.smithi112.stdout:38654705698 2024-09-21T00:53:32.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f307806e2b0 msgr2=0x7f3078070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:32.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f307806e2b0 0x7f3078070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3074006fd0 tx=0x7f3074008040 comp rx=0 tx=0).stop 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c101930 msgr2=0x7f308c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c101930 0x7f308c19d6d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f307c031460 tx=0x7f307c0048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 shutdown_connections 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f307806e2b0 0x7f3078070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f308c107930 0x7f308c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 --2- 172.21.15.112:0/4021130298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f308c101930 0x7f308c19d6d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 >> 172.21.15.112:0/4021130298 conn(0x7f308c0fd630 msgr2=0x7f308c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 shutdown_connections 2024-09-21T00:53:32.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:32.865+0000 7f3091138640 1 -- 172.21.15.112:0/4021130298 wait complete. 2024-09-21T00:53:33.624 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:33 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4021130298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T00:53:33.657 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705698 for osd.0 2024-09-21T00:53:33.658 DEBUG:teuthology.parallel:result is None 2024-09-21T00:53:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:33 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4021130298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T00:53:34.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 -- 172.21.15.112:0/3774656520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988102aa0 msgr2=0x7fb988102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:34.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3774656520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988102aa0 0x7fb988102e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009880 tx=0x7fb97c02a530 comp rx=0 tx=0).stop 2024-09-21T00:53:34.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 -- 172.21.15.112:0/3774656520 shutdown_connections 2024-09-21T00:53:34.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3774656520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9881033c0 0x7fb98810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3774656520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb988102aa0 0x7fb988102e80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 -- 172.21.15.112:0/3774656520 >> 172.21.15.112:0/3774656520 conn(0x7fb9880fc4c0 msgr2=0x7fb9880fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:34.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 -- 172.21.15.112:0/3774656520 shutdown_connections 2024-09-21T00:53:34.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.065+0000 7fb98d10f640 1 -- 172.21.15.112:0/3774656520 wait complete. 2024-09-21T00:53:34.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.066+0000 7fb98d10f640 1 Processor -- start 2024-09-21T00:53:34.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.066+0000 7fb98d10f640 1 -- start start 2024-09-21T00:53:34.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98d10f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb988102aa0 0x7fb98819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:34.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98d10f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9881033c0 0x7fb98819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:34.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98d10f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810edb0 con 0x7fb9881033c0 2024-09-21T00:53:34.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98d10f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810ec30 con 0x7fb988102aa0 2024-09-21T00:53:34.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9881033c0 0x7fb98819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9881033c0 0x7fb98819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51394/0 (socket says 172.21.15.112:51394) 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98659c640 1 -- 172.21.15.112:0/3513504548 learned_addr learned my addr 172.21.15.112:0/3513504548 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb986d9d640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb988102aa0 0x7fb98819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98659c640 1 -- 172.21.15.112:0/3513504548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb988102aa0 msgr2=0x7fb98819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98659c640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb988102aa0 0x7fb98819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98659c640 1 -- 172.21.15.112:0/3513504548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb988197780 con 0x7fb9881033c0 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb986d9d640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb988102aa0 0x7fb98819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98659c640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9881033c0 0x7fb98819db40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c8f0 tx=0x7fb97800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb96ffff640 1 -- 172.21.15.112:0/3513504548 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9780079b0 con 0x7fb9881033c0 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb988197a70 con 0x7fb9881033c0 2024-09-21T00:53:34.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb96ffff640 1 -- 172.21.15.112:0/3513504548 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb978007b50 con 0x7fb9881033c0 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb96ffff640 1 -- 172.21.15.112:0/3513504548 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb978018610 con 0x7fb9881033c0 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.067+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb988198000 con 0x7fb9881033c0 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.069+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98806a410 con 0x7fb9881033c0 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.069+0000 7fb96ffff640 1 -- 172.21.15.112:0/3513504548 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fb978007d00 con 0x7fb9881033c0 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.069+0000 7fb96ffff640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb97006e2b0 0x7fb970070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.070+0000 7fb96ffff640 1 -- 172.21.15.112:0/3513504548 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fb97808e060 con 0x7fb9881033c0 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.070+0000 7fb986d9d640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb97006e2b0 0x7fb970070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:34.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.070+0000 7fb986d9d640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb97006e2b0 0x7fb970070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb97c006010 tx=0x7fb97c0095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:34.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.074+0000 7fb96ffff640 1 -- 172.21.15.112:0/3513504548 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb978014030 con 0x7fb9881033c0 2024-09-21T00:53:34.201 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:34.229 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953484 got 137438953485 for osd.4 2024-09-21T00:53:34.229 DEBUG:teuthology.parallel:result is None 2024-09-21T00:53:34.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.251+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb988198ce0 con 0x7fb9881033c0 2024-09-21T00:53:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.251+0000 7fb96ffff640 1 -- 172.21.15.112:0/3513504548 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb97807b020 con 0x7fb9881033c0 2024-09-21T00:53:34.252 INFO:teuthology.orchestra.run.smithi112.stdout:60129542174 2024-09-21T00:53:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb97006e2b0 msgr2=0x7fb970070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb97006e2b0 0x7fb970070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb97c006010 tx=0x7fb97c0095f0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9881033c0 msgr2=0x7fb98819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9881033c0 0x7fb98819db40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c8f0 tx=0x7fb97800cdb0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 shutdown_connections 2024-09-21T00:53:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fb97006e2b0 0x7fb970070770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9881033c0 0x7fb98819db40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 --2- 172.21.15.112:0/3513504548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb988102aa0 0x7fb98819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 >> 172.21.15.112:0/3513504548 conn(0x7fb9880fc4c0 msgr2=0x7fb988108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 shutdown_connections 2024-09-21T00:53:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.253+0000 7fb98d10f640 1 -- 172.21.15.112:0/3513504548 wait complete. 2024-09-21T00:53:34.444 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:34 smithi112 ceph-mon[28078]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:34.445 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:34 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3513504548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T00:53:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:34 smithi187 ceph-mon[34997]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:34 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3513504548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 -- 172.21.15.112:0/2351574366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 msgr2=0x7f68c8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 --2- 172.21.15.112:0/2351574366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c8100c80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009880 tx=0x7f68bc02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 -- 172.21.15.112:0/2351574366 shutdown_connections 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 --2- 172.21.15.112:0/2351574366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c8100c80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 --2- 172.21.15.112:0/2351574366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c8106820 0x7f68c8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 -- 172.21.15.112:0/2351574366 >> 172.21.15.112:0/2351574366 conn(0x7f68c80fc520 msgr2=0x7f68c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 -- 172.21.15.112:0/2351574366 shutdown_connections 2024-09-21T00:53:34.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 -- 172.21.15.112:0/2351574366 wait complete. 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 Processor -- start 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.831+0000 7f68d0286640 1 -- start start 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68d0286640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68d0286640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c8106820 0x7f68c819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68d0286640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f68c810dd50 con 0x7f68c8100820 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68d0286640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f68c810dbd0 con 0x7f68c8106820 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68ce022640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68ce022640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51404/0 (socket says 172.21.15.112:51404) 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68ce022640 1 -- 172.21.15.112:0/1999216592 learned_addr learned my addr 172.21.15.112:0/1999216592 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68ce022640 1 -- 172.21.15.112:0/1999216592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c8106820 msgr2=0x7f68c819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68ce022640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c8106820 0x7f68c819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68ce022640 1 -- 172.21.15.112:0/1999216592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c8197870 con 0x7f68c8100820 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68ce022640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c819d6b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68c400b420 tx=0x7f68c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:34.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68bb7fe640 1 -- 172.21.15.112:0/1999216592 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68c4011630 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68bb7fe640 1 -- 172.21.15.112:0/1999216592 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68c4016070 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c8197b60 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68bb7fe640 1 -- 172.21.15.112:0/1999216592 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68c4010d40 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.832+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c81980f0 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.833+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c8101f60 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.834+0000 7f68bb7fe640 1 -- 172.21.15.112:0/1999216592 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f68c401b460 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.834+0000 7f68bb7fe640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f68b406e2b0 0x7f68b4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.834+0000 7f68bb7fe640 1 -- 172.21.15.112:0/1999216592 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f68c408d6c0 con 0x7f68c8100820 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.834+0000 7f68cd821640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f68b406e2b0 0x7f68b4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.835+0000 7f68cd821640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f68b406e2b0 0x7f68b4070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0096c0 tx=0x7f68bc000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:34.839+0000 7f68bb7fe640 1 -- 172.21.15.112:0/1999216592 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68c405b360 con 0x7f68c8100820 2024-09-21T00:53:35.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.006+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f68c8198da0 con 0x7f68c8100820 2024-09-21T00:53:35.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.007+0000 7f68bb7fe640 1 -- 172.21.15.112:0/1999216592 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f68c405f010 con 0x7f68c8100820 2024-09-21T00:53:35.008 INFO:teuthology.orchestra.run.smithi112.stdout:107374182419 2024-09-21T00:53:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f68b406e2b0 msgr2=0x7f68b4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f68b406e2b0 0x7f68b4070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0096c0 tx=0x7f68bc000bc0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 msgr2=0x7f68c819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c819d6b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68c400b420 tx=0x7f68c400b8e0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 shutdown_connections 2024-09-21T00:53:35.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f68b406e2b0 0x7f68b4070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c8106820 0x7f68c819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 --2- 172.21.15.112:0/1999216592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c8100820 0x7f68c819d6b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.009+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 >> 172.21.15.112:0/1999216592 conn(0x7f68c80fc520 msgr2=0x7f68c806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.010+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 shutdown_connections 2024-09-21T00:53:35.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.010+0000 7f68d0286640 1 -- 172.21.15.112:0/1999216592 wait complete. 2024-09-21T00:53:35.283 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542174 for osd.1 2024-09-21T00:53:35.284 DEBUG:teuthology.parallel:result is None 2024-09-21T00:53:35.537 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:35 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1999216592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T00:53:35.537 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:35.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:35 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1999216592' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T00:53:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 -- 172.21.15.112:0/636246930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 msgr2=0x7f077c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 --2- 172.21.15.112:0/636246930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c102ec0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f076c009880 tx=0x7f076c02a530 comp rx=0 tx=0).stop 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 -- 172.21.15.112:0/636246930 shutdown_connections 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 --2- 172.21.15.112:0/636246930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077c103400 0x7f077c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 --2- 172.21.15.112:0/636246930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c102ec0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 -- 172.21.15.112:0/636246930 >> 172.21.15.112:0/636246930 conn(0x7f077c0fc520 msgr2=0x7f077c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 -- 172.21.15.112:0/636246930 shutdown_connections 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.721+0000 7f07829cc640 1 -- 172.21.15.112:0/636246930 wait complete. 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.722+0000 7f07829cc640 1 Processor -- start 2024-09-21T00:53:35.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.722+0000 7f07829cc640 1 -- start start 2024-09-21T00:53:35.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.722+0000 7f07829cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:35.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.722+0000 7f07829cc640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077c103400 0x7f077c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:35.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.722+0000 7f07829cc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f077c10edf0 con 0x7f077c102ae0 2024-09-21T00:53:35.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.722+0000 7f07829cc640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f077c10ec70 con 0x7f077c103400 2024-09-21T00:53:35.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:35.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51434/0 (socket says 172.21.15.112:51434) 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077bfff640 1 -- 172.21.15.112:0/1890647692 learned_addr learned my addr 172.21.15.112:0/1890647692 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077b7fe640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077c103400 0x7f077c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077bfff640 1 -- 172.21.15.112:0/1890647692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077c103400 msgr2=0x7f077c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077bfff640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077c103400 0x7f077c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077bfff640 1 -- 172.21.15.112:0/1890647692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c1977e0 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f077bfff640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c19d660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f076c031460 tx=0x7f076c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f07797fa640 1 -- 172.21.15.112:0/1890647692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f076c03f070 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f07797fa640 1 -- 172.21.15.112:0/1890647692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f076c004cf0 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c197a70 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f07797fa640 1 -- 172.21.15.112:0/1890647692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f076c035030 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.723+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c197fa0 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.724+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c06abe0 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.725+0000 7f07797fa640 1 -- 172.21.15.112:0/1890647692 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f076c042070 con 0x7f077c102ae0 2024-09-21T00:53:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.725+0000 7f07797fa640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f076406e2b0 0x7f0764070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:35.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.725+0000 7f07797fa640 1 -- 172.21.15.112:0/1890647692 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f076c0ae8a0 con 0x7f077c102ae0 2024-09-21T00:53:35.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.725+0000 7f077b7fe640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f076406e2b0 0x7f0764070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:35.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.725+0000 7f077b7fe640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f076406e2b0 0x7f0764070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0770005fd0 tx=0x7f0770005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:35.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.729+0000 7f07797fa640 1 -- 172.21.15.112:0/1890647692 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f076c07c540 con 0x7f077c102ae0 2024-09-21T00:53:35.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.898+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f077c198d40 con 0x7f077c102ae0 2024-09-21T00:53:35.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.898+0000 7f07797fa640 1 -- 172.21.15.112:0/1890647692 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f077c198d40 con 0x7f077c102ae0 2024-09-21T00:53:35.899 INFO:teuthology.orchestra.run.smithi112.stdout:158913789961 2024-09-21T00:53:35.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f076406e2b0 msgr2=0x7f0764070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:35.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f076406e2b0 0x7f0764070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0770005fd0 tx=0x7f0770005f60 comp rx=0 tx=0).stop 2024-09-21T00:53:35.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 msgr2=0x7f077c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:35.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c19d660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f076c031460 tx=0x7f076c0048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 shutdown_connections 2024-09-21T00:53:35.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f076406e2b0 0x7f0764070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077c103400 0x7f077c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 --2- 172.21.15.112:0/1890647692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f077c102ae0 0x7f077c19d660 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:35.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 >> 172.21.15.112:0/1890647692 conn(0x7f077c0fc520 msgr2=0x7f077c108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:35.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 shutdown_connections 2024-09-21T00:53:35.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:35.900+0000 7f07829cc640 1 -- 172.21.15.112:0/1890647692 wait complete. 2024-09-21T00:53:36.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:36 smithi112 ceph-mon[28078]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:36.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:36 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1890647692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T00:53:36.630 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182418 got 107374182419 for osd.3 2024-09-21T00:53:36.631 DEBUG:teuthology.parallel:result is None 2024-09-21T00:53:36.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:36 smithi187 ceph-mon[34997]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:36.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:36 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1890647692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T00:53:37.065 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789959 got 158913789961 for osd.5 2024-09-21T00:53:37.066 DEBUG:teuthology.parallel:result is None 2024-09-21T00:53:37.066 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T00:53:37.066 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:53:37.317 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 -- 172.21.15.112:0/1806471692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 msgr2=0x7f2560107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 --2- 172.21.15.112:0/1806471692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560107d10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2558009880 tx=0x7f255802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 -- 172.21.15.112:0/1806471692 shutdown_connections 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 --2- 172.21.15.112:0/1806471692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2560101930 0x7f2560101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 --2- 172.21.15.112:0/1806471692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560107d10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 -- 172.21.15.112:0/1806471692 >> 172.21.15.112:0/1806471692 conn(0x7f25600fd630 msgr2=0x7f25600ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 -- 172.21.15.112:0/1806471692 shutdown_connections 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.727+0000 7f2564ed4640 1 -- 172.21.15.112:0/1806471692 wait complete. 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f2564ed4640 1 Processor -- start 2024-09-21T00:53:37.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f2564ed4640 1 -- start start 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f2564ed4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2560101930 0x7f25600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f2564ed4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f2564ed4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f256010ee60 con 0x7f2560107930 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f2564ed4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f256010ece0 con 0x7f2560101930 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f255dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f255dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51462/0 (socket says 172.21.15.112:51462) 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f255dd9b640 1 -- 172.21.15.112:0/673909601 learned_addr learned my addr 172.21.15.112:0/673909601 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.728+0000 7f255e59c640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2560101930 0x7f25600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f255dd9b640 1 -- 172.21.15.112:0/673909601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2560101930 msgr2=0x7f25600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f255dd9b640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2560101930 0x7f25600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f255dd9b640 1 -- 172.21.15.112:0/673909601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2560074f70 con 0x7f2560107930 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f255e59c640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2560101930 0x7f25600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f255dd9b640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560074a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f255400b420 tx=0x7f255400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:37.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f254f7fe640 1 -- 172.21.15.112:0/673909601 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2554011630 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2560075260 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f254f7fe640 1 -- 172.21.15.112:0/673909601 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2554016070 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f254f7fe640 1 -- 172.21.15.112:0/673909601 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2554010d40 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.729+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25601a3ef0 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.730+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2560103070 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.730+0000 7f254f7fe640 1 -- 172.21.15.112:0/673909601 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f255401b460 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.731+0000 7f254f7fe640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f254806e2b0 0x7f2548070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.731+0000 7f254f7fe640 1 -- 172.21.15.112:0/673909601 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f255408d6e0 con 0x7f2560107930 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.731+0000 7f255e59c640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f254806e2b0 0x7f2548070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.731+0000 7f255e59c640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f254806e2b0 0x7f2548070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2558006010 tx=0x7f25580095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.735+0000 7f254f7fe640 1 -- 172.21.15.112:0/673909601 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f255405b380 con 0x7f2560107930 2024-09-21T00:53:37.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.907+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2560062630 con 0x7f254806e2b0 2024-09-21T00:53:37.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.908+0000 7f254f7fe640 1 -- 172.21.15.112:0/673909601 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f2560062630 con 0x7f254806e2b0 2024-09-21T00:53:37.909 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:37.909 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f254806e2b0 msgr2=0x7f2548070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f254806e2b0 0x7f2548070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2558006010 tx=0x7f25580095f0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 msgr2=0x7f2560074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560074a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f255400b420 tx=0x7f255400b8e0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 shutdown_connections 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f254806e2b0 0x7f2548070770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2560107930 0x7f2560074a30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 --2- 172.21.15.112:0/673909601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2560101930 0x7f25600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:37.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 >> 172.21.15.112:0/673909601 conn(0x7f25600fd630 msgr2=0x7f25600fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:37.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 shutdown_connections 2024-09-21T00:53:37.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:37.910+0000 7f2564ed4640 1 -- 172.21.15.112:0/673909601 wait complete. 2024-09-21T00:53:38.603 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-21T00:53:37.237048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":174284,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":170358,"kb_avail":562296628,"statfs":{"total":575970213888,"available":575791747072,"internally_reserved":0,"allocated":3870720,"data_stored":2565426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":174447264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002672"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":192,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T00:53:10.221875+0000","last_change":"2024-09-21T00:52:41.310940+0000","last_active":"2024-09-21T00:53:10.221875+0000","last_peered":"2024-09-21T00:53:10.221875+0000","last_clean":"2024-09-21T00:53:10.221875+0000","last_became_active":"2024-09-21T00:52:41.310498+0000","last_became_peered":"2024-09-21T00:52:41.310498+0000","last_unstale":"2024-09-21T00:53:10.221875+0000","last_undegraded":"2024-09-21T00:53:10.221875+0000","last_fullsized":"2024-09-21T00:53:10.221875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:51:49.752661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:51:49.752661+0000","last_clean_scrub_stamp":"2024-09-21T00:51:49.752661+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.640944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713624,"statfs":{"total":95995035648,"available":95962750976,"internally_reserved":0,"allocated":348160,"data_stored":132387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717780,"statfs":{"total":95995035648,"available":95967006720,"internally_reserved":0,"allocated":348160,"data_stored":132387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":722755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717780,"statfs":{"total":95995035648,"available":95967006720,"internally_reserved":0,"allocated":348160,"data_stored":132387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":722755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":722755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:53:38.604 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:53:38.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:38 smithi187 ceph-mon[34997]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:38 smithi112 ceph-mon[28078]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:38.853 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 -- 172.21.15.112:0/955748891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 msgr2=0x7f5c30107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 --2- 172.21.15.112:0/955748891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c30107d10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009880 tx=0x7f5c2002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 -- 172.21.15.112:0/955748891 shutdown_connections 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 --2- 172.21.15.112:0/955748891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c30101930 0x7f5c30101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 --2- 172.21.15.112:0/955748891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c30107d10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 -- 172.21.15.112:0/955748891 >> 172.21.15.112:0/955748891 conn(0x7f5c300fd630 msgr2=0x7f5c300ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 -- 172.21.15.112:0/955748891 shutdown_connections 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 -- 172.21.15.112:0/955748891 wait complete. 2024-09-21T00:53:39.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.269+0000 7f5c3617a640 1 Processor -- start 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c3617a640 1 -- start start 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c3617a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c30101930 0x7f5c3019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c3617a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c3019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c3617a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3010ee60 con 0x7f5c30107930 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c3617a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3010ece0 con 0x7f5c30101930 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c3019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c3019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51484/0 (socket says 172.21.15.112:51484) 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2effd640 1 -- 172.21.15.112:0/928493417 learned_addr learned my addr 172.21.15.112:0/928493417 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2f7fe640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c30101930 0x7f5c3019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2effd640 1 -- 172.21.15.112:0/928493417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c30101930 msgr2=0x7f5c3019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2effd640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c30101930 0x7f5c3019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2effd640 1 -- 172.21.15.112:0/928493417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c30197870 con 0x7f5c30107930 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2effd640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c3019dbf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400b420 tx=0x7f5c2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:39.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2cff9640 1 -- 172.21.15.112:0/928493417 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c24011630 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c30197b60 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2cff9640 1 -- 172.21.15.112:0/928493417 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c24016070 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c2cff9640 1 -- 172.21.15.112:0/928493417 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c24010d40 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.270+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c301980f0 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.272+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c30103070 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.272+0000 7f5c2cff9640 1 -- 172.21.15.112:0/928493417 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f5c2401b460 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.272+0000 7f5c2cff9640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5c1806e2b0 0x7f5c18070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.273+0000 7f5c2f7fe640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5c1806e2b0 0x7f5c18070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.273+0000 7f5c2cff9640 1 -- 172.21.15.112:0/928493417 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f5c2408d690 con 0x7f5c30107930 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.273+0000 7f5c2f7fe640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5c1806e2b0 0x7f5c18070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000c00 tx=0x7f5c20031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:39.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.277+0000 7f5c2cff9640 1 -- 172.21.15.112:0/928493417 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c2405b330 con 0x7f5c30107930 2024-09-21T00:53:39.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.442+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c30198da0 con 0x7f5c1806e2b0 2024-09-21T00:53:39.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.443+0000 7f5c2cff9640 1 -- 172.21.15.112:0/928493417 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f5c30198da0 con 0x7f5c1806e2b0 2024-09-21T00:53:39.444 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:39.444 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5c1806e2b0 msgr2=0x7f5c18070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5c1806e2b0 0x7f5c18070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000c00 tx=0x7f5c20031400 comp rx=0 tx=0).stop 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 msgr2=0x7f5c3019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c3019dbf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400b420 tx=0x7f5c2400b8e0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 shutdown_connections 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5c1806e2b0 0x7f5c18070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c30107930 0x7f5c3019dbf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 --2- 172.21.15.112:0/928493417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c30101930 0x7f5c3019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 >> 172.21.15.112:0/928493417 conn(0x7f5c300fd630 msgr2=0x7f5c300fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 shutdown_connections 2024-09-21T00:53:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:39.445+0000 7f5c3617a640 1 -- 172.21.15.112:0/928493417 wait complete. 2024-09-21T00:53:39.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:39 smithi187 ceph-mon[34997]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:53:39.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:39 smithi112 ceph-mon[28078]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:53:40.067 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-21T00:53:39.237403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":174284,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":170358,"kb_avail":562296628,"statfs":{"total":575970213888,"available":575791747072,"internally_reserved":0,"allocated":3870720,"data_stored":2565426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":174447264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002758"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":192,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T00:53:10.221875+0000","last_change":"2024-09-21T00:52:41.310940+0000","last_active":"2024-09-21T00:53:10.221875+0000","last_peered":"2024-09-21T00:53:10.221875+0000","last_clean":"2024-09-21T00:53:10.221875+0000","last_became_active":"2024-09-21T00:52:41.310498+0000","last_became_peered":"2024-09-21T00:52:41.310498+0000","last_unstale":"2024-09-21T00:53:10.221875+0000","last_undegraded":"2024-09-21T00:53:10.221875+0000","last_fullsized":"2024-09-21T00:53:10.221875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:51:49.752661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:51:49.752661+0000","last_clean_scrub_stamp":"2024-09-21T00:51:49.752661+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.640944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713624,"statfs":{"total":95995035648,"available":95962750976,"internally_reserved":0,"allocated":348160,"data_stored":132387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717780,"statfs":{"total":95995035648,"available":95967006720,"internally_reserved":0,"allocated":348160,"data_stored":132387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":722755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717780,"statfs":{"total":95995035648,"available":95967006720,"internally_reserved":0,"allocated":348160,"data_stored":132387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":722755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":722755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:53:40.068 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T00:53:40.068 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T00:53:40.068 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T00:53:40.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T00:53:40.315 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:40.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:40 smithi187 ceph-mon[34997]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:40 smithi187 ceph-mon[34997]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:53:40.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:40 smithi112 ceph-mon[28078]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:40.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:40 smithi112 ceph-mon[28078]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 -- 172.21.15.112:0/3148909576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 msgr2=0x7fd054100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 --2- 172.21.15.112:0/3148909576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd054100c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd044009880 tx=0x7fd04402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 -- 172.21.15.112:0/3148909576 shutdown_connections 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 --2- 172.21.15.112:0/3148909576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd054100c40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 --2- 172.21.15.112:0/3148909576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0541067e0 0x7fd054106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 -- 172.21.15.112:0/3148909576 >> 172.21.15.112:0/3148909576 conn(0x7fd0540fc4c0 msgr2=0x7fd0540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 -- 172.21.15.112:0/3148909576 shutdown_connections 2024-09-21T00:53:40.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.760+0000 7fd05b489640 1 -- 172.21.15.112:0/3148909576 wait complete. 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd05b489640 1 Processor -- start 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd05b489640 1 -- start start 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd05b489640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd0541987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd05b489640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0541067e0 0x7fd054198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd05b489640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd05410dcb0 con 0x7fd0541007e0 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd05b489640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd05410db30 con 0x7fd0541067e0 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd059225640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd0541987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd059225640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd0541987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51512/0 (socket says 172.21.15.112:51512) 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.761+0000 7fd059225640 1 -- 172.21.15.112:0/3107984828 learned_addr learned my addr 172.21.15.112:0/3107984828 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd059225640 1 -- 172.21.15.112:0/3107984828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0541067e0 msgr2=0x7fd054198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd059225640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0541067e0 0x7fd054198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd059225640 1 -- 172.21.15.112:0/3107984828 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd054199320 con 0x7fd0541007e0 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd059225640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd0541987e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c8f0 tx=0x7fd05000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:40.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd04a7fc640 1 -- 172.21.15.112:0/3107984828 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0500079b0 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd04a7fc640 1 -- 172.21.15.112:0/3107984828 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0500054e0 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd054199610 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd04a7fc640 1 -- 172.21.15.112:0/3107984828 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd050004dd0 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.762+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0541a1c10 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.763+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd054101f20 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.763+0000 7fd04a7fc640 1 -- 172.21.15.112:0/3107984828 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd050005020 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.764+0000 7fd04a7fc640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd04006e260 0x7fd040070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.764+0000 7fd058a24640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd04006e260 0x7fd040070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.764+0000 7fd04a7fc640 1 -- 172.21.15.112:0/3107984828 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fd05008ddf0 con 0x7fd0541007e0 2024-09-21T00:53:40.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.765+0000 7fd058a24640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd04006e260 0x7fd040070720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd0440096c0 tx=0x7fd044000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:40.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.768+0000 7fd04a7fc640 1 -- 172.21.15.112:0/3107984828 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd054199610 con 0x7fd0541007e0 2024-09-21T00:53:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.974+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd054100c40 con 0x7fd0541007e0 2024-09-21T00:53:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.974+0000 7fd04a7fc640 1 -- 172.21.15.112:0/3107984828 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd050014030 con 0x7fd0541007e0 2024-09-21T00:53:40.976 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:40.976 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T00:53:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd04006e260 msgr2=0x7fd040070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd04006e260 0x7fd040070720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd0440096c0 tx=0x7fd044000bc0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 msgr2=0x7fd0541987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:40.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd0541987e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c8f0 tx=0x7fd05000cdb0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 shutdown_connections 2024-09-21T00:53:40.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd04006e260 0x7fd040070720 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0541067e0 0x7fd054198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 --2- 172.21.15.112:0/3107984828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0541007e0 0x7fd0541987e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:40.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.976+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 >> 172.21.15.112:0/3107984828 conn(0x7fd0540fc4c0 msgr2=0x7fd0540fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:40.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.977+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 shutdown_connections 2024-09-21T00:53:40.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:40.977+0000 7fd05b489640 1 -- 172.21.15.112:0/3107984828 wait complete. 2024-09-21T00:53:41.579 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:41 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3107984828' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T00:53:41.605 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T00:53:41.605 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T00:53:41.606 INFO:teuthology.run_tasks:Running task print... 2024-09-21T00:53:41.614 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-21T00:53:41.614 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:53:41.625 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:53:41.625 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-21T00:53:41.869 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:41.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:41 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3107984828' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 -- 172.21.15.112:0/1881254238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 msgr2=0x7f0b60100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 --2- 172.21.15.112:0/1881254238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b60100c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009880 tx=0x7f0b5402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 -- 172.21.15.112:0/1881254238 shutdown_connections 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 --2- 172.21.15.112:0/1881254238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b60101a40 0x7f0b60101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 --2- 172.21.15.112:0/1881254238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b60100c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 -- 172.21.15.112:0/1881254238 >> 172.21.15.112:0/1881254238 conn(0x7f0b600fbff0 msgr2=0x7f0b600fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 -- 172.21.15.112:0/1881254238 shutdown_connections 2024-09-21T00:53:42.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.315+0000 7f0b66b79640 1 -- 172.21.15.112:0/1881254238 wait complete. 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b66b79640 1 Processor -- start 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b66b79640 1 -- start start 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b66b79640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b601963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b66b79640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b60101a40 0x7f0b60196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b66b79640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b60109680 con 0x7f0b60100840 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b66b79640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b60109500 con 0x7f0b60101a40 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b64915640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b601963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b64915640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b601963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51566/0 (socket says 172.21.15.112:51566) 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b64915640 1 -- 172.21.15.112:0/169025221 learned_addr learned my addr 172.21.15.112:0/169025221 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b5ffff640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b60101a40 0x7f0b60196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b64915640 1 -- 172.21.15.112:0/169025221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b60101a40 msgr2=0x7f0b60196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b64915640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b60101a40 0x7f0b60196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b64915640 1 -- 172.21.15.112:0/169025221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b60196f80 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b5ffff640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b60101a40 0x7f0b60196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.316+0000 7f0b64915640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b601963c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b54006010 tx=0x7f0b540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.317+0000 7f0b5dffb640 1 -- 172.21.15.112:0/169025221 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b54035070 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.317+0000 7f0b5dffb640 1 -- 172.21.15.112:0/169025221 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b540049d0 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.317+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b60069b30 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.317+0000 7f0b5dffb640 1 -- 172.21.15.112:0/169025221 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b54031960 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.317+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6006a0c0 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.318+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b60109e60 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.318+0000 7f0b5dffb640 1 -- 172.21.15.112:0/169025221 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f0b54003cd0 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.319+0000 7f0b5dffb640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b5006e2b0 0x7f0b50070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.319+0000 7f0b5dffb640 1 -- 172.21.15.112:0/169025221 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f0b5403e070 con 0x7f0b60100840 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.319+0000 7f0b5ffff640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b5006e2b0 0x7f0b50070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.319+0000 7f0b5ffff640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b5006e2b0 0x7f0b50070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0058c0 tx=0x7f0b4c005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:42.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.323+0000 7f0b5dffb640 1 -- 172.21.15.112:0/169025221 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b54040370 con 0x7f0b60100840 2024-09-21T00:53:42.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.490+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f0b60100c40 con 0x7f0b60100840 2024-09-21T00:53:42.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.493+0000 7f0b5dffb640 1 -- 172.21.15.112:0/169025221 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v42)=0 v42) ==== 143+0+0 (secure 0 0 0) 0x7f0b540b0030 con 0x7f0b60100840 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b5006e2b0 msgr2=0x7f0b50070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b5006e2b0 0x7f0b50070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0058c0 tx=0x7f0b4c005850 comp rx=0 tx=0).stop 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 msgr2=0x7f0b601963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b601963c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b54006010 tx=0x7f0b540045e0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 shutdown_connections 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b5006e2b0 0x7f0b50070770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b60101a40 0x7f0b60196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 --2- 172.21.15.112:0/169025221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b60100840 0x7f0b601963c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 >> 172.21.15.112:0/169025221 conn(0x7f0b600fbff0 msgr2=0x7f0b60104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 shutdown_connections 2024-09-21T00:53:42.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:42.496+0000 7f0b66b79640 1 -- 172.21.15.112:0/169025221 wait complete. 2024-09-21T00:53:42.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:42 smithi112 ceph-mon[28078]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:42.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:42 smithi187 ceph-mon[34997]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:43.174 INFO:teuthology.run_tasks:Running task print... 2024-09-21T00:53:43.183 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-21T00:53:43.183 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:53:43.191 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:53:43.191 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T00:53:43.438 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:43.752 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:43 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/169025221' entity='client.admin' 2024-09-21T00:53:43.753 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:43 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:43.753 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:43 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:43.753 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:43 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:43.753 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:43 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:43.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:43 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/169025221' entity='client.admin' 2024-09-21T00:53:43.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:43 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:43.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:43 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:43.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:43 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:43.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:43 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:43.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 -- 172.21.15.112:0/1067907864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20100880 msgr2=0x7f9c20100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 --2- 172.21.15.112:0/1067907864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20100880 0x7f9c20100c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009880 tx=0x7f9c1002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 -- 172.21.15.112:0/1067907864 shutdown_connections 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 --2- 172.21.15.112:0/1067907864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c20101a80 0x7f9c20101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 --2- 172.21.15.112:0/1067907864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20100880 0x7f9c20100c80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 -- 172.21.15.112:0/1067907864 >> 172.21.15.112:0/1067907864 conn(0x7f9c200fc010 msgr2=0x7f9c200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 -- 172.21.15.112:0/1067907864 shutdown_connections 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.921+0000 7f9c26742640 1 -- 172.21.15.112:0/1067907864 wait complete. 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c26742640 1 Processor -- start 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c26742640 1 -- start start 2024-09-21T00:53:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c26742640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c20100880 0x7f9c20196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c26742640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20101a80 0x7f9c201968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c26742640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201096a0 con 0x7f9c20101a80 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c26742640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20109520 con 0x7f9c20100880 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c17fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20101a80 0x7f9c201968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c17fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20101a80 0x7f9c201968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51582/0 (socket says 172.21.15.112:51582) 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c17fff640 1 -- 172.21.15.112:0/1925701001 learned_addr learned my addr 172.21.15.112:0/1925701001 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.922+0000 7f9c1ffff640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c20100880 0x7f9c20196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c17fff640 1 -- 172.21.15.112:0/1925701001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c20100880 msgr2=0x7f9c20196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c17fff640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c20100880 0x7f9c20196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c17fff640 1 -- 172.21.15.112:0/1925701001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c20196ec0 con 0x7f9c20101a80 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c17fff640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20101a80 0x7f9c201968d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c8a0 tx=0x7f9c0800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c1dffb640 1 -- 172.21.15.112:0/1925701001 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c080079b0 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c1dffb640 1 -- 172.21.15.112:0/1925701001 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c08007b50 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2019b930 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c1dffb640 1 -- 172.21.15.112:0/1925701001 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c08018700 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.923+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2019be90 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.924+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20100c80 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.925+0000 7f9c1dffb640 1 -- 172.21.15.112:0/1925701001 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f9c08007d00 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.925+0000 7f9c1dffb640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9c0c06e310 0x7f9c0c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.925+0000 7f9c1dffb640 1 -- 172.21.15.112:0/1925701001 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f9c0808df80 con 0x7f9c20101a80 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.925+0000 7f9c1ffff640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9c0c06e310 0x7f9c0c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.926+0000 7f9c1ffff640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9c0c06e310 0x7f9c0c0707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009230 tx=0x7f9c100058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:43.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:43.930+0000 7f9c1dffb640 1 -- 172.21.15.112:0/1925701001 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c08014030 con 0x7f9c20101a80 2024-09-21T00:53:44.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.110+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9c20106000 con 0x7f9c0c06e310 2024-09-21T00:53:44.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.111+0000 7f9c1dffb640 1 -- 172.21.15.112:0/1925701001 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9c20106000 con 0x7f9c0c06e310 2024-09-21T00:53:44.113 INFO:teuthology.orchestra.run.smithi112.stdout:Backend: cephadm 2024-09-21T00:53:44.113 INFO:teuthology.orchestra.run.smithi112.stdout:Available: Yes 2024-09-21T00:53:44.113 INFO:teuthology.orchestra.run.smithi112.stdout:Paused: No 2024-09-21T00:53:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9c0c06e310 msgr2=0x7f9c0c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9c0c06e310 0x7f9c0c0707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009230 tx=0x7f9c100058d0 comp rx=0 tx=0).stop 2024-09-21T00:53:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20101a80 msgr2=0x7f9c201968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20101a80 0x7f9c201968d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c8a0 tx=0x7f9c0800cd60 comp rx=0 tx=0).stop 2024-09-21T00:53:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 shutdown_connections 2024-09-21T00:53:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9c0c06e310 0x7f9c0c0707d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c20101a80 0x7f9c201968d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:44.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 --2- 172.21.15.112:0/1925701001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c20100880 0x7f9c20196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:44.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.113+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 >> 172.21.15.112:0/1925701001 conn(0x7f9c200fc010 msgr2=0x7f9c200fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:44.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.114+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 shutdown_connections 2024-09-21T00:53:44.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:44.114+0000 7f9c26742640 1 -- 172.21.15.112:0/1925701001 wait complete. 2024-09-21T00:53:44.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:44 smithi187 ceph-mon[34997]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:44.755 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:44 smithi112 ceph-mon[28078]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:44.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T00:53:45.028 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:45.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 -- 172.21.15.112:0/1793241441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c101990 msgr2=0x7f0b2c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:45.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 --2- 172.21.15.112:0/1793241441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c101990 0x7f0b2c101d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009880 tx=0x7f0b1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 -- 172.21.15.112:0/1793241441 shutdown_connections 2024-09-21T00:53:45.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 --2- 172.21.15.112:0/1793241441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c102b90 0x7f0b2c103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 --2- 172.21.15.112:0/1793241441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c101990 0x7f0b2c101d90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 -- 172.21.15.112:0/1793241441 >> 172.21.15.112:0/1793241441 conn(0x7f0b2c0fd140 msgr2=0x7f0b2c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 -- 172.21.15.112:0/1793241441 shutdown_connections 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 -- 172.21.15.112:0/1793241441 wait complete. 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.446+0000 7f0b31334640 1 Processor -- start 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b31334640 1 -- start start 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b31334640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c101990 0x7f0b2c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b31334640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c102b90 0x7f0b2c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b31334640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c10a7b0 con 0x7f0b2c102b90 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b31334640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c10a630 con 0x7f0b2c101990 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c101990 0x7f0b2c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b227fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c102b90 0x7f0b2c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c101990 0x7f0b2c1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:51720/0 (socket says 172.21.15.112:51720) 2024-09-21T00:53:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.447+0000 7f0b2affd640 1 -- 172.21.15.112:0/572645272 learned_addr learned my addr 172.21.15.112:0/572645272 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b227fc640 1 -- 172.21.15.112:0/572645272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c101990 msgr2=0x7f0b2c1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b227fc640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c101990 0x7f0b2c1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b227fc640 1 -- 172.21.15.112:0/572645272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c198080 con 0x7f0b2c102b90 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b227fc640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c102b90 0x7f0b2c197a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0b14005fd0 tx=0x7f0b1400dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b28ff9640 1 -- 172.21.15.112:0/572645272 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b1400be30 con 0x7f0b2c102b90 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b28ff9640 1 -- 172.21.15.112:0/572645272 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b14004030 con 0x7f0b2c102b90 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c19cac0 con 0x7f0b2c102b90 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b28ff9640 1 -- 172.21.15.112:0/572645272 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b14003cd0 con 0x7f0b2c102b90 2024-09-21T00:53:45.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.448+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c19d050 con 0x7f0b2c102b90 2024-09-21T00:53:45.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.449+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c101d90 con 0x7f0b2c102b90 2024-09-21T00:53:45.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.449+0000 7f0b28ff9640 1 -- 172.21.15.112:0/572645272 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f0b140041e0 con 0x7f0b2c102b90 2024-09-21T00:53:45.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.450+0000 7f0b28ff9640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b1806e2b0 0x7f0b18070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:45.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.450+0000 7f0b28ff9640 1 -- 172.21.15.112:0/572645272 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f0b1408d7c0 con 0x7f0b2c102b90 2024-09-21T00:53:45.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.450+0000 7f0b2affd640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b1806e2b0 0x7f0b18070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:45.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.450+0000 7f0b2affd640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b1806e2b0 0x7f0b18070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c000c00 tx=0x7f0b1c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:45.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.454+0000 7f0b28ff9640 1 -- 172.21.15.112:0/572645272 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b14017020 con 0x7f0b2c102b90 2024-09-21T00:53:45.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.628+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0b2c0626f0 con 0x7f0b1806e2b0 2024-09-21T00:53:45.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.637+0000 7f0b28ff9640 1 -- 172.21.15.112:0/572645272 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3080 (secure 0 0 0) 0x7f0b2c0626f0 con 0x7f0b1806e2b0 2024-09-21T00:53:45.638 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:53:45.638 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (3m) 117s ago 5m 26.6M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (5m) 117s ago 5m 7684k - 19.1.1-373-g4e45e6b4 164465d2334a f33e5ce7bd79 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (4m) 41s ago 4m 5263k - 19.1.1-373-g4e45e6b4 164465d2334a fcd1455bbc96 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (5m) 117s ago 5m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (4m) 41s ago 4m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (3m) 117s ago 4m 77.1M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:9283,8765,8443 running (6m) 117s ago 6m 490M - 19.1.1-373-g4e45e6b4 164465d2334a c587f79e18b3 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (4m) 41s ago 4m 439M - 19.1.1-373-g4e45e6b4 164465d2334a 4a701436c860 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (6m) 117s ago 6m 47.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (4m) 41s ago 4m 40.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 117s ago 5m 14.1M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (4m) 41s ago 4m 16.3M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (3m) 117s ago 3m 39.5M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (2m) 117s ago 2m 49.7M 3946M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:53:45.639 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (2m) 117s ago 2m 11.0M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:53:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (99s) 41s ago 99s 40.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:53:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (73s) 41s ago 73s 36.8M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:53:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (46s) 41s ago 46s 12.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:53:45.640 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (3m) 117s ago 4m 42.9M - 2.43.0 a07b618ecd1d 67f455a0b500 2024-09-21T00:53:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b1806e2b0 msgr2=0x7f0b18070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:45.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b1806e2b0 0x7f0b18070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c000c00 tx=0x7f0b1c0058d0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c102b90 msgr2=0x7f0b2c197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c102b90 0x7f0b2c197a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0b14005fd0 tx=0x7f0b1400dd60 comp rx=0 tx=0).stop 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 shutdown_connections 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f0b1806e2b0 0x7f0b18070770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b2c102b90 0x7f0b2c197a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 --2- 172.21.15.112:0/572645272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c101990 0x7f0b2c1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 >> 172.21.15.112:0/572645272 conn(0x7f0b2c0fd140 msgr2=0x7f0b2c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 shutdown_connections 2024-09-21T00:53:45.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:45.639+0000 7f0b31334640 1 -- 172.21.15.112:0/572645272 wait complete. 2024-09-21T00:53:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:45 smithi112 ceph-mon[28078]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:45.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:45 smithi187 ceph-mon[34997]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:46.400 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T00:53:46.647 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:46 smithi112 ceph-mon[28078]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:46.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:46 smithi187 ceph-mon[34997]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 -- 172.21.15.112:0/1771395402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc100860 msgr2=0x7fbedc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1771395402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc100860 0x7fbedc100c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009880 tx=0x7fbecc02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 -- 172.21.15.112:0/1771395402 shutdown_connections 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1771395402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc101a60 0x7fbedc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1771395402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc100860 0x7fbedc100c60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 -- 172.21.15.112:0/1771395402 >> 172.21.15.112:0/1771395402 conn(0x7fbedc0fbff0 msgr2=0x7fbedc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 -- 172.21.15.112:0/1771395402 shutdown_connections 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 -- 172.21.15.112:0/1771395402 wait complete. 2024-09-21T00:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.045+0000 7fbee1e45640 1 Processor -- start 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbee1e45640 1 -- start start 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbee1e45640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc100860 0x7fbedc104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbee1e45640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc101a60 0x7fbedc102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbee1e45640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1096a0 con 0x7fbedc101a60 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbee1e45640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc109520 con 0x7fbedc100860 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedaffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc101a60 0x7fbedc102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedaffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc101a60 0x7fbedc102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51598/0 (socket says 172.21.15.112:51598) 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedaffd640 1 -- 172.21.15.112:0/1899526380 learned_addr learned my addr 172.21.15.112:0/1899526380 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedb7fe640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc100860 0x7fbedc104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedaffd640 1 -- 172.21.15.112:0/1899526380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc100860 msgr2=0x7fbedc104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedaffd640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc100860 0x7fbedc104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedaffd640 1 -- 172.21.15.112:0/1899526380 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc103380 con 0x7fbedc101a60 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedb7fe640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc100860 0x7fbedc104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbedaffd640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc101a60 0x7fbedc102e40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbed000e970 tx=0x7fbed000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbed8ff9640 1 -- 172.21.15.112:0/1899526380 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed000cac0 con 0x7fbedc101a60 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc103670 con 0x7fbedc101a60 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbed8ff9640 1 -- 172.21.15.112:0/1899526380 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbed00054e0 con 0x7fbedc101a60 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.046+0000 7fbed8ff9640 1 -- 172.21.15.112:0/1899526380 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed0010430 con 0x7fbedc101a60 2024-09-21T00:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.047+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc103c00 con 0x7fbedc101a60 2024-09-21T00:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.048+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbedc100c60 con 0x7fbedc101a60 2024-09-21T00:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.048+0000 7fbed8ff9640 1 -- 172.21.15.112:0/1899526380 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fbed0004e80 con 0x7fbedc101a60 2024-09-21T00:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.048+0000 7fbed8ff9640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fbec406e2b0 0x7fbec4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.049+0000 7fbedb7fe640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fbec406e2b0 0x7fbec4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.049+0000 7fbed8ff9640 1 -- 172.21.15.112:0/1899526380 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fbed008e4e0 con 0x7fbedc101a60 2024-09-21T00:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.049+0000 7fbedb7fe640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fbec406e2b0 0x7fbec4070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbecc000c00 tx=0x7fbecc005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:47.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.053+0000 7fbed8ff9640 1 -- 172.21.15.112:0/1899526380 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbed005c180 con 0x7fbedc101a60 2024-09-21T00:53:47.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.231+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fbedc19f5a0 con 0x7fbec406e2b0 2024-09-21T00:53:47.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.238+0000 7fbed8ff9640 1 -- 172.21.15.112:0/1899526380 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1310 (secure 0 0 0) 0x7fbedc19f5a0 con 0x7fbec406e2b0 2024-09-21T00:53:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T00:53:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager ?:9093,9094 1/1 119s ago 5m count:1 2024-09-21T00:53:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter 2/2 119s ago 5m * 2024-09-21T00:53:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:crash 2/2 119s ago 5m * 2024-09-21T00:53:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:grafana ?:3000 1/1 119s ago 5m count:1 2024-09-21T00:53:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:mgr 2/2 119s ago 5m count:2 2024-09-21T00:53:47.241 INFO:teuthology.orchestra.run.smithi112.stdout:mon 2/2 119s ago 5m smithi112:172.21.15.112=smithi112;smithi187:172.21.15.187=smithi187;count:2 2024-09-21T00:53:47.241 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter ?:9100 2/2 119s ago 5m * 2024-09-21T00:53:47.241 INFO:teuthology.orchestra.run.smithi112.stdout:osd 6 119s ago - 2024-09-21T00:53:47.241 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus ?:9095 1/1 119s ago 5m count:1 2024-09-21T00:53:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fbec406e2b0 msgr2=0x7fbec4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:47.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fbec406e2b0 0x7fbec4070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbecc000c00 tx=0x7fbecc005a20 comp rx=0 tx=0).stop 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc101a60 msgr2=0x7fbedc102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc101a60 0x7fbedc102e40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbed000e970 tx=0x7fbed000ed70 comp rx=0 tx=0).stop 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 shutdown_connections 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fbec406e2b0 0x7fbec4070770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbedc101a60 0x7fbedc102e40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 --2- 172.21.15.112:0/1899526380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc100860 0x7fbedc104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 >> 172.21.15.112:0/1899526380 conn(0x7fbedc0fbff0 msgr2=0x7fbedc06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 shutdown_connections 2024-09-21T00:53:47.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:47.241+0000 7fbee1e45640 1 -- 172.21.15.112:0/1899526380 wait complete. 2024-09-21T00:53:47.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:47 smithi187 ceph-mon[34997]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:47.914 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:47 smithi112 ceph-mon[28078]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:47.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T00:53:48.188 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:48.630 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:48 smithi112 ceph-mon[28078]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:48.631 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:48 smithi112 ceph-mon[28078]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.628+0000 7f2ae600d640 1 -- 172.21.15.112:0/1317379296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0100200 msgr2=0x7f2ae0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.628+0000 7f2ae600d640 1 --2- 172.21.15.112:0/1317379296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0100200 0x7f2ae0102610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009880 tx=0x7f2ad002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.628+0000 7f2ae600d640 1 -- 172.21.15.112:0/1317379296 shutdown_connections 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.628+0000 7f2ae600d640 1 --2- 172.21.15.112:0/1317379296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ae0102b50 0x7f2ae0104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.628+0000 7f2ae600d640 1 --2- 172.21.15.112:0/1317379296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0100200 0x7f2ae0102610 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.628+0000 7f2ae600d640 1 -- 172.21.15.112:0/1317379296 >> 172.21.15.112:0/1317379296 conn(0x7f2ae00fc010 msgr2=0x7f2ae00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.628+0000 7f2ae600d640 1 -- 172.21.15.112:0/1317379296 shutdown_connections 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.629+0000 7f2ae600d640 1 -- 172.21.15.112:0/1317379296 wait complete. 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.629+0000 7f2ae600d640 1 Processor -- start 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.629+0000 7f2ae600d640 1 -- start start 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ae600d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ae0100200 0x7f2ae019dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:48.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ae600d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0102b50 0x7f2ae019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ae600d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae0110e10 con 0x7f2ae0102b50 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ae600d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae0110c90 con 0x7f2ae0100200 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ad7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0102b50 0x7f2ae019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ad7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0102b50 0x7f2ae019e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51616/0 (socket says 172.21.15.112:51616) 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ad7fff640 1 -- 172.21.15.112:0/253207204 learned_addr learned my addr 172.21.15.112:0/253207204 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2adf7fe640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ae0100200 0x7f2ae019dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ad7fff640 1 -- 172.21.15.112:0/253207204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ae0100200 msgr2=0x7f2ae019dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ad7fff640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ae0100200 0x7f2ae019dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ad7fff640 1 -- 172.21.15.112:0/253207204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae019e680 con 0x7f2ae0102b50 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ad7fff640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0102b50 0x7f2ae019e000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800b420 tx=0x7f2ac800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2add7fa640 1 -- 172.21.15.112:0/253207204 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ac8011630 con 0x7f2ae0102b50 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2add7fa640 1 -- 172.21.15.112:0/253207204 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ac8016070 con 0x7f2ae0102b50 2024-09-21T00:53:48.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae01a30c0 con 0x7f2ae0102b50 2024-09-21T00:53:48.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2add7fa640 1 -- 172.21.15.112:0/253207204 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ac8010d40 con 0x7f2ae0102b50 2024-09-21T00:53:48.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.630+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae01a36d0 con 0x7f2ae0102b50 2024-09-21T00:53:48.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.631+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae0100600 con 0x7f2ae0102b50 2024-09-21T00:53:48.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.632+0000 7f2add7fa640 1 -- 172.21.15.112:0/253207204 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f2ac801b460 con 0x7f2ae0102b50 2024-09-21T00:53:48.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.632+0000 7f2add7fa640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2acc06e2b0 0x7f2acc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:48.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.633+0000 7f2add7fa640 1 -- 172.21.15.112:0/253207204 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f2ac808d680 con 0x7f2ae0102b50 2024-09-21T00:53:48.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.633+0000 7f2adf7fe640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2acc06e2b0 0x7f2acc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:48.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.633+0000 7f2adf7fe640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2acc06e2b0 0x7f2acc070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0000c00 tx=0x7f2ad00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:48.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.638+0000 7f2add7fa640 1 -- 172.21.15.112:0/253207204 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ac805b320 con 0x7f2ae0102b50 2024-09-21T00:53:48.810 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:48 smithi187 ceph-mon[34997]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:48.810 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:48 smithi187 ceph-mon[34997]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:48.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.810+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2ae0103450 con 0x7f2acc06e2b0 2024-09-21T00:53:48.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.811+0000 7f2add7fa640 1 -- 172.21.15.112:0/253207204 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f2ae0103450 con 0x7f2acc06e2b0 2024-09-21T00:53:48.813 INFO:teuthology.orchestra.run.smithi112.stdout:HOST ADDR LABELS STATUS 2024-09-21T00:53:48.813 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112 172.21.15.112 2024-09-21T00:53:48.813 INFO:teuthology.orchestra.run.smithi112.stdout:smithi187 172.21.15.187 2024-09-21T00:53:48.813 INFO:teuthology.orchestra.run.smithi112.stdout:2 hosts in cluster 2024-09-21T00:53:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2acc06e2b0 msgr2=0x7f2acc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2acc06e2b0 0x7f2acc070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0000c00 tx=0x7f2ad00058d0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0102b50 msgr2=0x7f2ae019e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0102b50 0x7f2ae019e000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800b420 tx=0x7f2ac800b8e0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 shutdown_connections 2024-09-21T00:53:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2acc06e2b0 0x7f2acc070770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae0102b50 0x7f2ae019e000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 --2- 172.21.15.112:0/253207204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ae0100200 0x7f2ae019dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:48.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 >> 172.21.15.112:0/253207204 conn(0x7f2ae00fc010 msgr2=0x7f2ae00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:48.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 shutdown_connections 2024-09-21T00:53:48.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:48.813+0000 7f2ae600d640 1 -- 172.21.15.112:0/253207204 wait complete. 2024-09-21T00:53:49.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T00:53:49.608 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:50.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 -- 172.21.15.112:0/1673475217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 msgr2=0x7f2988103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:50.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 --2- 172.21.15.112:0/1673475217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988103010 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f297c009880 tx=0x7f297c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 -- 172.21.15.112:0/1673475217 shutdown_connections 2024-09-21T00:53:50.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 --2- 172.21.15.112:0/1673475217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988103010 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 --2- 172.21.15.112:0/1673475217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2988101990 0x7f2988101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 -- 172.21.15.112:0/1673475217 >> 172.21.15.112:0/1673475217 conn(0x7f29880fd140 msgr2=0x7f29880ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 -- 172.21.15.112:0/1673475217 shutdown_connections 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.028+0000 7f298c9b5640 1 -- 172.21.15.112:0/1673475217 wait complete. 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f298c9b5640 1 Processor -- start 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f298c9b5640 1 -- start start 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f298c9b5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2988101990 0x7f29881974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f298c9b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f298c9b5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f298810a7d0 con 0x7f2988102b90 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f298c9b5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f298810a650 con 0x7f2988101990 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f2985d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f2985d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51634/0 (socket says 172.21.15.112:51634) 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.029+0000 7f2985d9b640 1 -- 172.21.15.112:0/2519612350 learned_addr learned my addr 172.21.15.112:0/2519612350 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f298659c640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2988101990 0x7f29881974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f2985d9b640 1 -- 172.21.15.112:0/2519612350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2988101990 msgr2=0x7f29881974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:50.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f2985d9b640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2988101990 0x7f29881974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f2985d9b640 1 -- 172.21.15.112:0/2519612350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2988198080 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f298659c640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2988101990 0x7f29881974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f2985d9b640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988197a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f297c006010 tx=0x7f297c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f29777fe640 1 -- 172.21.15.112:0/2519612350 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f297c03f070 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f29777fe640 1 -- 172.21.15.112:0/2519612350 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f297c0044d0 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298819ca60 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f29777fe640 1 -- 172.21.15.112:0/2519612350 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f297c035030 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.030+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298819cff0 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.031+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2988101d90 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.032+0000 7f29777fe640 1 -- 172.21.15.112:0/2519612350 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f297c042070 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.032+0000 7f29777fe640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f297006e310 0x7f29700707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.032+0000 7f298659c640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f297006e310 0x7f29700707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.032+0000 7f29777fe640 1 -- 172.21.15.112:0/2519612350 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f297c0aead0 con 0x7f2988102b90 2024-09-21T00:53:50.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.033+0000 7f298659c640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f297006e310 0x7f29700707d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29780058c0 tx=0x7f2978005ec0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:50.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.037+0000 7f29777fe640 1 -- 172.21.15.112:0/2519612350 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f297c07c7f0 con 0x7f2988102b90 2024-09-21T00:53:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.208+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f2988062630 con 0x7f297006e310 2024-09-21T00:53:50.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.209+0000 7f29777fe640 1 -- 172.21.15.112:0/2519612350 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f2988062630 con 0x7f297006e310 2024-09-21T00:53:50.211 INFO:teuthology.orchestra.run.smithi112.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T00:53:50.211 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 119s ago Has a FileSystem, LVM detected 2024-09-21T00:53:50.211 INFO:teuthology.orchestra.run.smithi112.stdout:smithi187 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500MW400BGN 372G No 42s ago Has a FileSystem, LVM detected 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f297006e310 msgr2=0x7f29700707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f297006e310 0x7f29700707d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29780058c0 tx=0x7f2978005ec0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 msgr2=0x7f2988197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988197a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f297c006010 tx=0x7f297c0048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 shutdown_connections 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f297006e310 0x7f29700707d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2988102b90 0x7f2988197a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 --2- 172.21.15.112:0/2519612350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2988101990 0x7f29881974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 >> 172.21.15.112:0/2519612350 conn(0x7f29880fd140 msgr2=0x7f2988106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 shutdown_connections 2024-09-21T00:53:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:50.211+0000 7f298c9b5640 1 -- 172.21.15.112:0/2519612350 wait complete. 2024-09-21T00:53:50.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:50 smithi112 ceph-mon[28078]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:50.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:50 smithi112 ceph-mon[28078]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:50.820 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:50.852 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:53:50.862 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:53:50.862 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-21T00:53:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:50 smithi187 ceph-mon[34997]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:50 smithi187 ceph-mon[34997]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:53:51.107 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 -- 172.21.15.112:0/498618049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c100840 msgr2=0x7f556c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 --2- 172.21.15.112:0/498618049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c100840 0x7f556c100c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5560009880 tx=0x7f556002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 -- 172.21.15.112:0/498618049 shutdown_connections 2024-09-21T00:53:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 --2- 172.21.15.112:0/498618049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f556c101a40 0x7f556c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 --2- 172.21.15.112:0/498618049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c100840 0x7f556c100c40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 -- 172.21.15.112:0/498618049 >> 172.21.15.112:0/498618049 conn(0x7f556c0fbff0 msgr2=0x7f556c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 -- 172.21.15.112:0/498618049 shutdown_connections 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 -- 172.21.15.112:0/498618049 wait complete. 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.697+0000 7f5572de5640 1 Processor -- start 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5572de5640 1 -- start start 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5572de5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f556c100840 0x7f556c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5572de5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c101a40 0x7f556c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5572de5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f556c1096e0 con 0x7f556c101a40 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5572de5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f556c109560 con 0x7f556c100840 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f556bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c101a40 0x7f556c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f556bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c101a40 0x7f556c197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51656/0 (socket says 172.21.15.112:51656) 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f556bfff640 1 -- 172.21.15.112:0/3745285954 learned_addr learned my addr 172.21.15.112:0/3745285954 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5570b81640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f556c100840 0x7f556c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f556bfff640 1 -- 172.21.15.112:0/3745285954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f556c100840 msgr2=0x7f556c197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f556bfff640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f556c100840 0x7f556c197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f556bfff640 1 -- 172.21.15.112:0/3745285954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556c1980f0 con 0x7f556c101a40 2024-09-21T00:53:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f556bfff640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c101a40 0x7f556c197a70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f555800b420 tx=0x7f555800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5569ffb640 1 -- 172.21.15.112:0/3745285954 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5558011630 con 0x7f556c101a40 2024-09-21T00:53:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5569ffb640 1 -- 172.21.15.112:0/3745285954 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5558016070 con 0x7f556c101a40 2024-09-21T00:53:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556c19cb30 con 0x7f556c101a40 2024-09-21T00:53:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.698+0000 7f5569ffb640 1 -- 172.21.15.112:0/3745285954 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5558010d40 con 0x7f556c101a40 2024-09-21T00:53:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.699+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556c19d140 con 0x7f556c101a40 2024-09-21T00:53:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.700+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f556c100c40 con 0x7f556c101a40 2024-09-21T00:53:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.700+0000 7f5569ffb640 1 -- 172.21.15.112:0/3745285954 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f555801b460 con 0x7f556c101a40 2024-09-21T00:53:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.700+0000 7f5569ffb640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f555c06e2b0 0x7f555c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.700+0000 7f5569ffb640 1 -- 172.21.15.112:0/3745285954 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f555808d740 con 0x7f556c101a40 2024-09-21T00:53:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.700+0000 7f5570b81640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f555c06e2b0 0x7f555c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.701+0000 7f5570b81640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f555c06e2b0 0x7f555c070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5560000c00 tx=0x7f5560005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:51.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.705+0000 7f5569ffb640 1 -- 172.21.15.112:0/3745285954 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f555805b3e0 con 0x7f556c101a40 2024-09-21T00:53:51.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:51 smithi112 ceph-mon[28078]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:51.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:51.895+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f556c06a2f0 con 0x7f555c06e2b0 2024-09-21T00:53:51.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:51 smithi187 ceph-mon[34997]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:52.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:52 smithi187 ceph-mon[34997]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:52.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:52 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T00:53:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:52 smithi112 ceph-mon[28078]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:52 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T00:53:53.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.577+0000 7f5569ffb640 1 -- 172.21.15.112:0/3745285954 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f556c06a2f0 con 0x7f555c06e2b0 2024-09-21T00:53:53.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.580+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f555c06e2b0 msgr2=0x7f555c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:53.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.580+0000 7f5572de5640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f555c06e2b0 0x7f555c070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5560000c00 tx=0x7f5560005a20 comp rx=0 tx=0).stop 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c101a40 msgr2=0x7f556c197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c101a40 0x7f556c197a70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f555800b420 tx=0x7f555800b8e0 comp rx=0 tx=0).stop 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 shutdown_connections 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f555c06e2b0 0x7f555c070770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f556c101a40 0x7f556c197a70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 --2- 172.21.15.112:0/3745285954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f556c100840 0x7f556c197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 >> 172.21.15.112:0/3745285954 conn(0x7f556c0fbff0 msgr2=0x7f556c069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 shutdown_connections 2024-09-21T00:53:53.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:53.581+0000 7f5572de5640 1 -- 172.21.15.112:0/3745285954 wait complete. 2024-09-21T00:53:53.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:53 smithi187 ceph-mon[34997]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:53.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:53 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T00:53:53.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:53 smithi187 ceph-mon[34997]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T00:53:53.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:53 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T00:53:53.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:53 smithi112 ceph-mon[28078]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:53.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:53 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T00:53:53.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:53 smithi112 ceph-mon[28078]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T00:53:53.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:53 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T00:53:53.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[28074]: 2024-09-21T00:53:53.556+0000 7f0b9b2a2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:53:54.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T00:53:54.805 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: pgmap v171: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:54.805 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T00:53:54.805 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T00:53:54.805 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: fsmap cephfs:0 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: Saving service mds.cephfs spec with placement count:4 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.yntrjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:53:54.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.yntrjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:53:54.807 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:54.807 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:54 smithi112 ceph-mon[28078]: Deploying daemon mds.cephfs.smithi112.yntrjn on smithi112 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: pgmap v171: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: fsmap cephfs:0 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: Saving service mds.cephfs spec with placement count:4 2024-09-21T00:53:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.yntrjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.yntrjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:54.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:54 smithi187 ceph-mon[34997]: Deploying daemon mds.cephfs.smithi112.yntrjn on smithi112 2024-09-21T00:53:55.509 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:55 smithi112 ceph-mon[28078]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T00:53:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:55 smithi112 ceph-mon[28078]: pgmap v175: 65 pgs: 8 creating+peering, 42 unknown, 15 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:55.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:55 smithi187 ceph-mon[34997]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T00:53:55.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:55 smithi187 ceph-mon[34997]: pgmap v175: 65 pgs: 8 creating+peering, 42 unknown, 15 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:56.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/3376573937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 msgr2=0x7f5dcc107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:56.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/3376573937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc107170 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009880 tx=0x7f5dc002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/3376573937 shutdown_connections 2024-09-21T00:53:56.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/3376573937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc107170 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/3376573937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dcc102450 0x7f5dcc104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/3376573937 >> 172.21.15.112:0/3376573937 conn(0x7f5dcc0fbff0 msgr2=0x7f5dcc0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/3376573937 shutdown_connections 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.125+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/3376573937 wait complete. 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.126+0000 7f5dd0fdf640 1 Processor -- start 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.126+0000 7f5dd0fdf640 1 -- start start 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.126+0000 7f5dd0fdf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dcc102450 0x7f5dcc1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.126+0000 7f5dd0fdf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.126+0000 7f5dd0fdf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10a760 con 0x7f5dcc104d80 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.126+0000 7f5dd0fdf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10a5e0 con 0x7f5dcc102450 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dc9d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dc9d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42980/0 (socket says 172.21.15.112:42980) 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dc9d9b640 1 -- 172.21.15.112:0/532913098 learned_addr learned my addr 172.21.15.112:0/532913098 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dca59c640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dcc102450 0x7f5dcc1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:56.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dc9d9b640 1 -- 172.21.15.112:0/532913098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dcc102450 msgr2=0x7f5dcc1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dc9d9b640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dcc102450 0x7f5dcc1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dc9d9b640 1 -- 172.21.15.112:0/532913098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc197ff0 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dca59c640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dcc102450 0x7f5dcc1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dc9d9b640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc197a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0006010 tx=0x7f5dc00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dbb7fe640 1 -- 172.21.15.112:0/532913098 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dc003f070 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dbb7fe640 1 -- 172.21.15.112:0/532913098 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5dc00044d0 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dbb7fe640 1 -- 172.21.15.112:0/532913098 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dc0035030 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc19ca00 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.127+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc19cf00 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.128+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc102830 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.129+0000 7f5dbb7fe640 1 -- 172.21.15.112:0/532913098 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f5dc0042070 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.130+0000 7f5dbb7fe640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5db406e2b0 0x7f5db4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.130+0000 7f5dca59c640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5db406e2b0 0x7f5db4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.130+0000 7f5dbb7fe640 1 -- 172.21.15.112:0/532913098 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f5dc00aedf0 con 0x7f5dcc104d80 2024-09-21T00:53:56.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.130+0000 7f5dca59c640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5db406e2b0 0x7f5db4070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00baa0 tx=0x7f5dbc005d90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:56.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.134+0000 7f5dbb7fe640 1 -- 172.21.15.112:0/532913098 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5dc007c750 con 0x7f5dcc104d80 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:e2 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:53:53:557570+0000 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 2 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T00:53:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:53:53.557502+0000 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 0 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:in 2024-09-21T00:53:56.370 INFO:teuthology.orchestra.run.smithi112.stdout:up {} 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data disabled 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 0 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:56.371 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.367+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5dcc19d8a0 con 0x7f5dcc104d80 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.367+0000 7f5dbb7fe640 1 -- 172.21.15.112:0/532913098 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f5dc0080400 con 0x7f5dcc104d80 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 2 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5db406e2b0 msgr2=0x7f5db4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5db406e2b0 0x7f5db4070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00baa0 tx=0x7f5dbc005d90 comp rx=0 tx=0).stop 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 msgr2=0x7f5dcc197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc197a00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0006010 tx=0x7f5dc00048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 shutdown_connections 2024-09-21T00:53:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f5db406e2b0 0x7f5db4070770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dcc104d80 0x7f5dcc197a00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 --2- 172.21.15.112:0/532913098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dcc102450 0x7f5dcc1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.370+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 >> 172.21.15.112:0/532913098 conn(0x7f5dcc0fbff0 msgr2=0x7f5dcc0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.371+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 shutdown_connections 2024-09-21T00:53:56.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:56.371+0000 7f5dd0fdf640 1 -- 172.21.15.112:0/532913098 wait complete. 2024-09-21T00:53:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:56 smithi112 ceph-mon[28078]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T00:53:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:56 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/532913098' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T00:53:56.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:56 smithi187 ceph-mon[34997]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T00:53:56.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:56 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/532913098' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T00:53:57.081 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:53:57.091 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:53:57.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-21T00:53:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:57.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 -- 172.21.15.112:0/1902409053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 msgr2=0x7fedac101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 --2- 172.21.15.112:0/1902409053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac101d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feda0009880 tx=0x7feda002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 -- 172.21.15.112:0/1902409053 shutdown_connections 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 --2- 172.21.15.112:0/1902409053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedac102b90 0x7fedac103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 --2- 172.21.15.112:0/1902409053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac101d90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 -- 172.21.15.112:0/1902409053 >> 172.21.15.112:0/1902409053 conn(0x7fedac0fd140 msgr2=0x7fedac0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 -- 172.21.15.112:0/1902409053 shutdown_connections 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.978+0000 7fedb473d640 1 -- 172.21.15.112:0/1902409053 wait complete. 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.979+0000 7fedb473d640 1 Processor -- start 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.979+0000 7fedb473d640 1 -- start start 2024-09-21T00:53:57.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.979+0000 7fedb473d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.979+0000 7fedb473d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedac102b90 0x7fedac197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.979+0000 7fedb473d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fedac10a830 con 0x7fedac101990 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.979+0000 7fedb473d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fedac10a6b0 con 0x7fedac102b90 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb24d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb24d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43028/0 (socket says 172.21.15.112:43028) 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb24d9640 1 -- 172.21.15.112:0/2420545857 learned_addr learned my addr 172.21.15.112:0/2420545857 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb1cd8640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedac102b90 0x7fedac197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb24d9640 1 -- 172.21.15.112:0/2420545857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedac102b90 msgr2=0x7fedac197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb24d9640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedac102b90 0x7fedac197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb24d9640 1 -- 172.21.15.112:0/2420545857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac1980f0 con 0x7fedac101990 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb1cd8640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedac102b90 0x7fedac197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb24d9640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac197530 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feda0006010 tx=0x7feda00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fed9f7fe640 1 -- 172.21.15.112:0/2420545857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feda003f070 con 0x7fedac101990 2024-09-21T00:53:57.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fed9f7fe640 1 -- 172.21.15.112:0/2420545857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feda00044d0 con 0x7fedac101990 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedac19cad0 con 0x7fedac101990 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fed9f7fe640 1 -- 172.21.15.112:0/2420545857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feda0035030 con 0x7fedac101990 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.980+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedac19d060 con 0x7fedac101990 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.981+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedac101d90 con 0x7fedac101990 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.982+0000 7fed9f7fe640 1 -- 172.21.15.112:0/2420545857 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7feda0042070 con 0x7fedac101990 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.982+0000 7fed9f7fe640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fed9806e2b0 0x7fed98070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.982+0000 7fedb1cd8640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fed9806e2b0 0x7fed98070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.983+0000 7fed9f7fe640 1 -- 172.21.15.112:0/2420545857 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7feda00aee20 con 0x7fedac101990 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.983+0000 7fedb1cd8640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fed9806e2b0 0x7fed98070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fedac1989e0 tx=0x7feda8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:57.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:57.987+0000 7fed9f7fe640 1 -- 172.21.15.112:0/2420545857 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feda007c780 con 0x7fedac101990 2024-09-21T00:53:58.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.190+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fedac02d7c0 con 0x7fedac101990 2024-09-21T00:53:58.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.578+0000 7fed9f7fe640 1 -- 172.21.15.112:0/2420545857 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7feda0080430 con 0x7fedac101990 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fed9806e2b0 msgr2=0x7fed98070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fed9806e2b0 0x7fed98070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fedac1989e0 tx=0x7feda8008040 comp rx=0 tx=0).stop 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 msgr2=0x7fedac197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac197530 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feda0006010 tx=0x7feda00048f0 comp rx=0 tx=0).stop 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 shutdown_connections 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fed9806e2b0 0x7fed98070770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedac102b90 0x7fedac197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 --2- 172.21.15.112:0/2420545857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedac101990 0x7fedac197530 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 >> 172.21.15.112:0/2420545857 conn(0x7fedac0fd140 msgr2=0x7fedac106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:58.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 shutdown_connections 2024-09-21T00:53:58.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:58.581+0000 7fedb473d640 1 -- 172.21.15.112:0/2420545857 wait complete. 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: pgmap v177: 65 pgs: 8 creating+peering, 6 unknown, 51 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.cdcgvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.cdcgvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: Deploying daemon mds.cephfs.smithi187.cdcgvm on smithi187 2024-09-21T00:53:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6826/1702504243,v1:172.21.15.112:6827/1702504243] up:boot 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: daemon mds.cephfs.smithi112.yntrjn assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: Cluster is now healthy 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: fsmap cephfs:0 1 up:standby 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:creating} 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: daemon mds.cephfs.smithi112.yntrjn is now active in filesystem cephfs as rank 0 2024-09-21T00:53:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:58 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2420545857' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T00:53:58.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: pgmap v177: 65 pgs: 8 creating+peering, 6 unknown, 51 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:58.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.cdcgvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.cdcgvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: Deploying daemon mds.cephfs.smithi187.cdcgvm on smithi187 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6826/1702504243,v1:172.21.15.112:6827/1702504243] up:boot 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: daemon mds.cephfs.smithi112.yntrjn assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: Cluster is now healthy 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: fsmap cephfs:0 1 up:standby 2024-09-21T00:53:58.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:53:58.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:creating} 2024-09-21T00:53:58.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: daemon mds.cephfs.smithi112.yntrjn is now active in filesystem cephfs as rank 0 2024-09-21T00:53:58.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:58 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2420545857' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T00:53:59.279 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:53:59.288 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:53:59.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-21T00:53:59.538 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:53:59.838 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:59 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2420545857' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T00:53:59.838 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:59 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6826/1702504243,v1:172.21.15.112:6827/1702504243] up:active 2024-09-21T00:53:59.838 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:59 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 2024-09-21T00:53:59.838 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:53:59 smithi187 ceph-mon[34997]: pgmap v178: 65 pgs: 65 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:59.909 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:59 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2420545857' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T00:53:59.909 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:59 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6826/1702504243,v1:172.21.15.112:6827/1702504243] up:active 2024-09-21T00:53:59.909 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:59 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 2024-09-21T00:53:59.909 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:53:59 smithi112 ceph-mon[28078]: pgmap v178: 65 pgs: 65 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 -- 172.21.15.112:0/2264821229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 msgr2=0x7f25f4101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 --2- 172.21.15.112:0/2264821229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4101d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009880 tx=0x7f25e802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 -- 172.21.15.112:0/2264821229 shutdown_connections 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 --2- 172.21.15.112:0/2264821229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25f4102b80 0x7f25f4103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 --2- 172.21.15.112:0/2264821229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4101d80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 -- 172.21.15.112:0/2264821229 >> 172.21.15.112:0/2264821229 conn(0x7f25f40fd110 msgr2=0x7f25f40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 -- 172.21.15.112:0/2264821229 shutdown_connections 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.992+0000 7f25faa89640 1 -- 172.21.15.112:0/2264821229 wait complete. 2024-09-21T00:53:59.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25faa89640 1 Processor -- start 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25faa89640 1 -- start start 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25faa89640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25faa89640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25f4102b80 0x7f25f40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25faa89640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f25f410a7c0 con 0x7f25f4101980 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25faa89640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f25f410a640 con 0x7f25f4102b80 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f8825640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f8825640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43046/0 (socket says 172.21.15.112:43046) 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f8825640 1 -- 172.21.15.112:0/4169308349 learned_addr learned my addr 172.21.15.112:0/4169308349 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f3fff640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25f4102b80 0x7f25f40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f8825640 1 -- 172.21.15.112:0/4169308349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25f4102b80 msgr2=0x7f25f40745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f8825640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25f4102b80 0x7f25f40745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f8825640 1 -- 172.21.15.112:0/4169308349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f4074b20 con 0x7f25f4101980 2024-09-21T00:53:59.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.993+0000 7f25f8825640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4075f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009230 tx=0x7f25e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:59.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.994+0000 7f25f1ffb640 1 -- 172.21.15.112:0/4169308349 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25e803f070 con 0x7f25f4101980 2024-09-21T00:53:59.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.994+0000 7f25f1ffb640 1 -- 172.21.15.112:0/4169308349 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25e80049d0 con 0x7f25f4101980 2024-09-21T00:53:59.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.994+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f4074db0 con 0x7f25f4101980 2024-09-21T00:53:59.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.994+0000 7f25f1ffb640 1 -- 172.21.15.112:0/4169308349 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25e8035030 con 0x7f25f4101980 2024-09-21T00:53:59.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.994+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f40752e0 con 0x7f25f4101980 2024-09-21T00:53:59.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.995+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f4101d80 con 0x7f25f4101980 2024-09-21T00:53:59.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.995+0000 7f25f1ffb640 1 -- 172.21.15.112:0/4169308349 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f25e8042070 con 0x7f25f4101980 2024-09-21T00:53:59.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.996+0000 7f25f1ffb640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f25e406e2b0 0x7f25e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:59.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.996+0000 7f25f1ffb640 1 -- 172.21.15.112:0/4169308349 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f25e80aec10 con 0x7f25f4101980 2024-09-21T00:53:59.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.996+0000 7f25f3fff640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f25e406e2b0 0x7f25e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:59.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:53:59.996+0000 7f25f3fff640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f25e406e2b0 0x7f25e4070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25f4075ca0 tx=0x7f25e0005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:00.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.000+0000 7f25f1ffb640 1 -- 172.21.15.112:0/4169308349 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25e8080220 con 0x7f25f4101980 2024-09-21T00:54:00.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.212+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f25f4062df0 con 0x7f25f4101980 2024-09-21T00:54:00.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.583+0000 7f25f1ffb640 1 -- 172.21.15.112:0/4169308349 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f25e8084a50 con 0x7f25f4101980 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f25e406e2b0 msgr2=0x7f25e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f25e406e2b0 0x7f25e4070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25f4075ca0 tx=0x7f25e0005f90 comp rx=0 tx=0).stop 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 msgr2=0x7f25f4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4075f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009230 tx=0x7f25e80045e0 comp rx=0 tx=0).stop 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 shutdown_connections 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f25e406e2b0 0x7f25e4070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25f4102b80 0x7f25f40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 --2- 172.21.15.112:0/4169308349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25f4101980 0x7f25f4075f20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 >> 172.21.15.112:0/4169308349 conn(0x7f25f40fd110 msgr2=0x7f25f4106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 shutdown_connections 2024-09-21T00:54:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:00.586+0000 7f25faa89640 1 -- 172.21.15.112:0/4169308349 wait complete. 2024-09-21T00:54:01.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:01.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:01.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:01.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ngfvvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:54:01.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ngfvvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:01.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:01.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: Deploying daemon mds.cephfs.smithi112.ngfvvg on smithi112 2024-09-21T00:54:01.250 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4169308349' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T00:54:01.250 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4169308349' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T00:54:01.250 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:boot 2024-09-21T00:54:01.250 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 1 up:standby 2024-09-21T00:54:01.250 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"}]: dispatch 2024-09-21T00:54:01.250 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:01 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 1 up:standby 2024-09-21T00:54:01.276 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:54:01.285 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:54:01.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-21T00:54:01.370 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:01.370 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ngfvvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ngfvvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: Deploying daemon mds.cephfs.smithi112.ngfvvg on smithi112 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4169308349' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4169308349' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:boot 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 1 up:standby 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"}]: dispatch 2024-09-21T00:54:01.371 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:01 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 1 up:standby 2024-09-21T00:54:01.768 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:02.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:02 smithi112 ceph-mon[28078]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 1 op/s 2024-09-21T00:54:02.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:02 smithi187 ceph-mon[34997]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 1 op/s 2024-09-21T00:54:02.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.909+0000 7f50ef897640 1 -- 172.21.15.112:0/1758181783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 msgr2=0x7f50e8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.909+0000 7f50ef897640 1 --2- 172.21.15.112:0/1758181783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e8100c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009880 tx=0x7f50e402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 -- 172.21.15.112:0/1758181783 shutdown_connections 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 --2- 172.21.15.112:0/1758181783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e8101a80 0x7f50e8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 --2- 172.21.15.112:0/1758181783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e8100c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 -- 172.21.15.112:0/1758181783 >> 172.21.15.112:0/1758181783 conn(0x7f50e80fc010 msgr2=0x7f50e80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 -- 172.21.15.112:0/1758181783 shutdown_connections 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 -- 172.21.15.112:0/1758181783 wait complete. 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 Processor -- start 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 -- start start 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e81963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e8101a80 0x7f50e8196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f50e81096c0 con 0x7f50e8100880 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ef897640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8109540 con 0x7f50e8101a80 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.910+0000 7f50ed633640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e81963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ed633640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e81963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39572/0 (socket says 172.21.15.112:39572) 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ed633640 1 -- 172.21.15.112:0/712783632 learned_addr learned my addr 172.21.15.112:0/712783632 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ece32640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e8101a80 0x7f50e8196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ed633640 1 -- 172.21.15.112:0/712783632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e8101a80 msgr2=0x7f50e8196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ed633640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e8101a80 0x7f50e8196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ed633640 1 -- 172.21.15.112:0/712783632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e8196fa0 con 0x7f50e8100880 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ed633640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e81963e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006010 tx=0x7f50e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50de7fc640 1 -- 172.21.15.112:0/712783632 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50e4035070 con 0x7f50e8100880 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e806a300 con 0x7f50e8100880 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50de7fc640 1 -- 172.21.15.112:0/712783632 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50e40049d0 con 0x7f50e8100880 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50de7fc640 1 -- 172.21.15.112:0/712783632 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50e4031960 con 0x7f50e8100880 2024-09-21T00:54:02.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.911+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e806a890 con 0x7f50e8100880 2024-09-21T00:54:02.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.912+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e8109ea0 con 0x7f50e8100880 2024-09-21T00:54:02.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.913+0000 7f50de7fc640 1 -- 172.21.15.112:0/712783632 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f50e4003cd0 con 0x7f50e8100880 2024-09-21T00:54:02.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.913+0000 7f50de7fc640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f50d406e2b0 0x7f50d4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:02.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.913+0000 7f50de7fc640 1 -- 172.21.15.112:0/712783632 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f50e403e070 con 0x7f50e8100880 2024-09-21T00:54:02.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.913+0000 7f50ece32640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f50d406e2b0 0x7f50d4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:02.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.914+0000 7f50ece32640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f50d406e2b0 0x7f50d4070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50e8197890 tx=0x7f50d800b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:02.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:02.918+0000 7f50de7fc640 1 -- 172.21.15.112:0/712783632 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50e407e030 con 0x7f50e8100880 2024-09-21T00:54:03.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.135+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f50e8100c80 con 0x7f50e8100880 2024-09-21T00:54:03.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.187+0000 7f50de7fc640 1 -- 172.21.15.112:0/712783632 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v8) ==== 168+0+0 (secure 0 0 0) 0x7f50e4081ce0 con 0x7f50e8100880 2024-09-21T00:54:03.188 INFO:teuthology.orchestra.run.smithi112.stderr:inline data enabled 2024-09-21T00:54:03.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f50d406e2b0 msgr2=0x7f50d4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:03.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f50d406e2b0 0x7f50d4070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50e8197890 tx=0x7f50d800b390 comp rx=0 tx=0).stop 2024-09-21T00:54:03.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 msgr2=0x7f50e81963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e81963e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006010 tx=0x7f50e40045e0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 shutdown_connections 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f50d406e2b0 0x7f50d4070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e8101a80 0x7f50e8196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 --2- 172.21.15.112:0/712783632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50e8100880 0x7f50e81963e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.189+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 >> 172.21.15.112:0/712783632 conn(0x7f50e80fc010 msgr2=0x7f50e8104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.190+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 shutdown_connections 2024-09-21T00:54:03.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:03.190+0000 7f50ef897640 1 -- 172.21.15.112:0/712783632 wait complete. 2024-09-21T00:54:03.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:03 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/712783632' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T00:54:03.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:03 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/712783632' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T00:54:04.045 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:54:04.054 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:54:04.054 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T00:54:04.306 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:04.416 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T00:54:04.416 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/712783632' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:54:04.416 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 1 up:standby 2024-09-21T00:54:04.416 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T00:54:04.416 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:04.416 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:04.416 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:04.417 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.osicpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:54:04.417 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.osicpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:04.417 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:04 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/712783632' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 1 up:standby 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.osicpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.osicpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:54:04.427 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:04 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:04.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.782+0000 7f7c6aab1640 1 -- 172.21.15.112:0/330115890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 msgr2=0x7f7c64103380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:04.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.782+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/330115890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64103380 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009880 tx=0x7f7c5402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.782+0000 7f7c6aab1640 1 -- 172.21.15.112:0/330115890 shutdown_connections 2024-09-21T00:54:04.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.782+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/330115890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c64103950 0x7f7c640ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.782+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/330115890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64103380 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.782+0000 7f7c6aab1640 1 -- 172.21.15.112:0/330115890 >> 172.21.15.112:0/330115890 conn(0x7f7c640fb790 msgr2=0x7f7c640fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.782+0000 7f7c6aab1640 1 -- 172.21.15.112:0/330115890 shutdown_connections 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6aab1640 1 -- 172.21.15.112:0/330115890 wait complete. 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6aab1640 1 Processor -- start 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6aab1640 1 -- start start 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6aab1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6aab1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c64103950 0x7f7c64197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6aab1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6410a810 con 0x7f7c64102f80 2024-09-21T00:54:04.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6aab1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6410a690 con 0x7f7c64103950 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6884d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6884d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39606/0 (socket says 172.21.15.112:39606) 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c6884d640 1 -- 172.21.15.112:0/1962670143 learned_addr learned my addr 172.21.15.112:0/1962670143 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.783+0000 7f7c63fff640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c64103950 0x7f7c64197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c6884d640 1 -- 172.21.15.112:0/1962670143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c64103950 msgr2=0x7f7c64197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c6884d640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c64103950 0x7f7c64197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c6884d640 1 -- 172.21.15.112:0/1962670143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c641980d0 con 0x7f7c64102f80 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c63fff640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c64103950 0x7f7c64197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c6884d640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64197510 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7c54006010 tx=0x7f7c540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c61ffb640 1 -- 172.21.15.112:0/1962670143 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c5403f070 con 0x7f7c64102f80 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c61ffb640 1 -- 172.21.15.112:0/1962670143 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c540049d0 con 0x7f7c64102f80 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6419cab0 con 0x7f7c64102f80 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c61ffb640 1 -- 172.21.15.112:0/1962670143 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c54035030 con 0x7f7c64102f80 2024-09-21T00:54:04.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.784+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6419d040 con 0x7f7c64102f80 2024-09-21T00:54:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.785+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c64103380 con 0x7f7c64102f80 2024-09-21T00:54:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.786+0000 7f7c61ffb640 1 -- 172.21.15.112:0/1962670143 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f7c54042070 con 0x7f7c64102f80 2024-09-21T00:54:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.786+0000 7f7c61ffb640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f7c4c06e2b0 0x7f7c4c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:04.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.786+0000 7f7c61ffb640 1 -- 172.21.15.112:0/1962670143 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f7c540aecc0 con 0x7f7c64102f80 2024-09-21T00:54:04.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.786+0000 7f7c63fff640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f7c4c06e2b0 0x7f7c4c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:04.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.787+0000 7f7c63fff640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f7c4c06e2b0 0x7f7c4c070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c641989c0 tx=0x7f7c58005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:04.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.791+0000 7f7c61ffb640 1 -- 172.21.15.112:0/1962670143 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c5407c620 con 0x7f7c64102f80 2024-09-21T00:54:04.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.990+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7c64062df0 con 0x7f7c64102f80 2024-09-21T00:54:04.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.991+0000 7f7c61ffb640 1 -- 172.21.15.112:0/1962670143 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) ==== 75+0+1803 (secure 0 0 0) 0x7f7c540802d0 con 0x7f7c64102f80 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:e9 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:04:191733+0000 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 8 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T00:54:04.992 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:03.136551+0000 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 0 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14578} 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T00:54:04.993 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14578 members: 14578 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{0:14578} state up:active seq 2 addr [v2:172.21.15.112:6826/1702504243,v1:172.21.15.112:6827/1702504243] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{-1:14598} state up:standby seq 1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:54:04.994 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:54:04.995 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2024-09-21T00:54:04.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f7c4c06e2b0 msgr2=0x7f7c4c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f7c4c06e2b0 0x7f7c4c070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c641989c0 tx=0x7f7c58005f90 comp rx=0 tx=0).stop 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 msgr2=0x7f7c64197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64197510 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7c54006010 tx=0x7f7c540045e0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 shutdown_connections 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f7c4c06e2b0 0x7f7c4c070770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c64103950 0x7f7c64197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 --2- 172.21.15.112:0/1962670143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c64102f80 0x7f7c64197510 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 >> 172.21.15.112:0/1962670143 conn(0x7f7c640fb790 msgr2=0x7f7c64106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 shutdown_connections 2024-09-21T00:54:04.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:04.993+0000 7f7c6aab1640 1 -- 172.21.15.112:0/1962670143 wait complete. 2024-09-21T00:54:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:05 smithi112 ceph-mon[28078]: Deploying daemon mds.cephfs.smithi187.osicpg on smithi187 2024-09-21T00:54:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:05 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:boot 2024-09-21T00:54:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:05 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 2 up:standby 2024-09-21T00:54:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"}]: dispatch 2024-09-21T00:54:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:05.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:05 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1962670143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T00:54:05.552 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:05 smithi187 ceph-mon[34997]: Deploying daemon mds.cephfs.smithi187.osicpg on smithi187 2024-09-21T00:54:05.552 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:05 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:boot 2024-09-21T00:54:05.552 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:05 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 2 up:standby 2024-09-21T00:54:05.552 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"}]: dispatch 2024-09-21T00:54:05.552 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:05.552 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:05 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1962670143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T00:54:05.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-21T00:54:05.881 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:06 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:06 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:06 smithi112 ceph-mon[28078]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-21T00:54:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 -- 172.21.15.112:0/1236965940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0101a40 msgr2=0x7fe5a0101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1236965940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0101a40 0x7fe5a0101ec0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe594009880 tx=0x7fe59402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 -- 172.21.15.112:0/1236965940 shutdown_connections 2024-09-21T00:54:06.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1236965940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0101a40 0x7fe5a0101ec0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1236965940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5a0100840 0x7fe5a0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 -- 172.21.15.112:0/1236965940 >> 172.21.15.112:0/1236965940 conn(0x7fe5a00fbff0 msgr2=0x7fe5a00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 -- 172.21.15.112:0/1236965940 shutdown_connections 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.367+0000 7fe5a4885640 1 -- 172.21.15.112:0/1236965940 wait complete. 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe5a4885640 1 Processor -- start 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe5a4885640 1 -- start start 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe5a4885640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0100840 0x7fe5a0196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe5a4885640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5a0101a40 0x7fe5a0196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe5a4885640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0109700 con 0x7fe5a0100840 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe5a4885640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0109580 con 0x7fe5a0101a40 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe59e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0100840 0x7fe5a0196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe59e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0100840 0x7fe5a0196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39618/0 (socket says 172.21.15.112:39618) 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe59e59c640 1 -- 172.21.15.112:0/1798591089 learned_addr learned my addr 172.21.15.112:0/1798591089 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe59dd9b640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5a0101a40 0x7fe5a0196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe59e59c640 1 -- 172.21.15.112:0/1798591089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5a0101a40 msgr2=0x7fe5a0196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe59e59c640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5a0101a40 0x7fe5a0196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.368+0000 7fe59e59c640 1 -- 172.21.15.112:0/1798591089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a0196fe0 con 0x7fe5a0100840 2024-09-21T00:54:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.369+0000 7fe59e59c640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0100840 0x7fe5a0196420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c6a0 tx=0x7fe59000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.370+0000 7fe58f7fe640 1 -- 172.21.15.112:0/1798591089 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe590008630 con 0x7fe5a0100840 2024-09-21T00:54:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.370+0000 7fe58f7fe640 1 -- 172.21.15.112:0/1798591089 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe590008c90 con 0x7fe5a0100840 2024-09-21T00:54:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.371+0000 7fe58f7fe640 1 -- 172.21.15.112:0/1798591089 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe590018400 con 0x7fe5a0100840 2024-09-21T00:54:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.371+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a0069b90 con 0x7fe5a0100840 2024-09-21T00:54:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.371+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a006a170 con 0x7fe5a0100840 2024-09-21T00:54:06.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.372+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a0109ee0 con 0x7fe5a0100840 2024-09-21T00:54:06.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.372+0000 7fe58f7fe640 1 -- 172.21.15.112:0/1798591089 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe5900087d0 con 0x7fe5a0100840 2024-09-21T00:54:06.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.373+0000 7fe58f7fe640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe58806e310 0x7fe5880707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:06.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.373+0000 7fe58f7fe640 1 -- 172.21.15.112:0/1798591089 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fe59008e010 con 0x7fe5a0100840 2024-09-21T00:54:06.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.373+0000 7fe59dd9b640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe58806e310 0x7fe5880707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:06.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.373+0000 7fe59dd9b640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe58806e310 0x7fe5880707d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe594000c00 tx=0x7fe5940058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.377+0000 7fe58f7fe640 1 -- 172.21.15.112:0/1798591089 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe590014030 con 0x7fe5a0100840 2024-09-21T00:54:06.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.623+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5a0100c40 con 0x7fe5a0100840 2024-09-21T00:54:06.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.624+0000 7fe58f7fe640 1 -- 172.21.15.112:0/1798591089 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+4475 (secure 0 0 0) 0x7fe590008e40 con 0x7fe5a0100840 2024-09-21T00:54:06.624 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2024-09-21T00:54:06.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe58806e310 msgr2=0x7fe5880707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe58806e310 0x7fe5880707d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe594000c00 tx=0x7fe5940058d0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0100840 msgr2=0x7fe5a0196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:06.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0100840 0x7fe5a0196420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c6a0 tx=0x7fe59000cb60 comp rx=0 tx=0).stop 2024-09-21T00:54:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 shutdown_connections 2024-09-21T00:54:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe58806e310 0x7fe5880707d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5a0101a40 0x7fe5a0196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 --2- 172.21.15.112:0/1798591089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5a0100840 0x7fe5a0196420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 >> 172.21.15.112:0/1798591089 conn(0x7fe5a00fbff0 msgr2=0x7fe5a0104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 shutdown_connections 2024-09-21T00:54:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:06.627+0000 7fe5a4885640 1 -- 172.21.15.112:0/1798591089 wait complete. 2024-09-21T00:54:06.636 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:54:06.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:06 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:06.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:06 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:06.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:06 smithi187 ceph-mon[34997]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-21T00:54:07.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1798591089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:boot 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T00:54:07.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:07 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"}]: dispatch 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1798591089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:boot 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T00:54:07.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:07 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"}]: dispatch 2024-09-21T00:54:08.231 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:08.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:08 smithi187 ceph-mon[34997]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-21T00:54:08.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:08 smithi112 ceph-mon[28078]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-21T00:54:08.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 -- 172.21.15.112:0/1919896653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 msgr2=0x7f21a8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:08.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1919896653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a8100c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009880 tx=0x7f21a402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 -- 172.21.15.112:0/1919896653 shutdown_connections 2024-09-21T00:54:08.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1919896653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a8101a80 0x7f21a8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1919896653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a8100c80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 -- 172.21.15.112:0/1919896653 >> 172.21.15.112:0/1919896653 conn(0x7f21a80fc010 msgr2=0x7f21a80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 -- 172.21.15.112:0/1919896653 shutdown_connections 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 -- 172.21.15.112:0/1919896653 wait complete. 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 Processor -- start 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.744+0000 7f21af3a0640 1 -- start start 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21af3a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21af3a0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a8101a80 0x7f21a819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21af3a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81096c0 con 0x7f21a8100880 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21af3a0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8109540 con 0x7f21a8101a80 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ad13c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ad13c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a806adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39642/0 (socket says 172.21.15.112:39642) 2024-09-21T00:54:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ad13c640 1 -- 172.21.15.112:0/1154485010 learned_addr learned my addr 172.21.15.112:0/1154485010 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ac93b640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a8101a80 0x7f21a819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ad13c640 1 -- 172.21.15.112:0/1154485010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a8101a80 msgr2=0x7f21a819c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ad13c640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a8101a80 0x7f21a819c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ad13c640 1 -- 172.21.15.112:0/1154485010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a819c7d0 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21ad13c640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a806adf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f21a4006010 tx=0x7f21a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f219a7fc640 1 -- 172.21.15.112:0/1154485010 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21a403f070 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f219a7fc640 1 -- 172.21.15.112:0/1154485010 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21a4004a50 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a819ca60 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.745+0000 7f219a7fc640 1 -- 172.21.15.112:0/1154485010 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21a4035030 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.746+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a819cf90 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.746+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a8100c80 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.747+0000 7f219a7fc640 1 -- 172.21.15.112:0/1154485010 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f21a4042070 con 0x7f21a8100880 2024-09-21T00:54:08.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.747+0000 7f219a7fc640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f219406e310 0x7f21940707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:08.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.748+0000 7f219a7fc640 1 -- 172.21.15.112:0/1154485010 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f21a40aecf0 con 0x7f21a8100880 2024-09-21T00:54:08.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.748+0000 7f21ac93b640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f219406e310 0x7f21940707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:08.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.748+0000 7f21ac93b640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f219406e310 0x7f21940707d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21a806ab70 tx=0x7f219c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:08.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.752+0000 7f219a7fc640 1 -- 172.21.15.112:0/1154485010 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21a4080290 con 0x7f21a8100880 2024-09-21T00:54:08.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.991+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7f21a819d8a0 con 0x7f21a8100880 2024-09-21T00:54:08.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.992+0000 7f219a7fc640 1 -- 172.21.15.112:0/1154485010 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v12) ==== 78+0+98 (secure 0 0 0) 0x7f21a4084ac0 con 0x7f21a8100880 2024-09-21T00:54:08.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f219406e310 msgr2=0x7f21940707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f219406e310 0x7f21940707d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21a806ab70 tx=0x7f219c00b390 comp rx=0 tx=0).stop 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 msgr2=0x7f21a806adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a806adf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f21a4006010 tx=0x7f21a40045e0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 shutdown_connections 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f219406e310 0x7f21940707d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a8101a80 0x7f21a819c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 --2- 172.21.15.112:0/1154485010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f21a8100880 0x7f21a806adf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 >> 172.21.15.112:0/1154485010 conn(0x7f21a80fc010 msgr2=0x7f21a80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 shutdown_connections 2024-09-21T00:54:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:08.994+0000 7f21af3a0640 1 -- 172.21.15.112:0/1154485010 wait complete. 2024-09-21T00:54:09.003 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:54:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:standby 2024-09-21T00:54:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:standby 2024-09-21T00:54:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: Dropping low affinity active daemon mds.cephfs.smithi112.yntrjn in favor of higher affinity standby. 2024-09-21T00:54:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: Replacing daemon mds.cephfs.smithi112.yntrjn as rank 0 with standby daemon mds.cephfs.smithi112.ngfvvg 2024-09-21T00:54:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T00:54:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T00:54:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T00:54:09.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: fsmap cephfs:1/1 {0=cephfs.smithi112.ngfvvg=up:replay} 2 up:standby 2024-09-21T00:54:09.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:09.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:09.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:09 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1154485010' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:standby 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:standby 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: Dropping low affinity active daemon mds.cephfs.smithi112.yntrjn in favor of higher affinity standby. 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: Replacing daemon mds.cephfs.smithi112.yntrjn as rank 0 with standby daemon mds.cephfs.smithi112.ngfvvg 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: fsmap cephfs:1/1 {0=cephfs.smithi112.ngfvvg=up:replay} 2 up:standby 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:09.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:09 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1154485010' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T00:54:09.956 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-21T00:54:09.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:54:10.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:10 smithi112 ceph-mon[28078]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-21T00:54:10.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:10 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:reconnect 2024-09-21T00:54:10.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:10 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] up:boot 2024-09-21T00:54:10.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:10 smithi112 ceph-mon[28078]: fsmap cephfs:1/1 {0=cephfs.smithi112.ngfvvg=up:reconnect} 3 up:standby 2024-09-21T00:54:10.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:54:10.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:10 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:10 smithi187 ceph-mon[34997]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-21T00:54:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:10 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:reconnect 2024-09-21T00:54:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:10 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] up:boot 2024-09-21T00:54:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:10 smithi187 ceph-mon[34997]: fsmap cephfs:1/1 {0=cephfs.smithi112.ngfvvg=up:reconnect} 3 up:standby 2024-09-21T00:54:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:10 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:54:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:10 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:10.682 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:11.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:11 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:rejoin 2024-09-21T00:54:11.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:11 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:standby 2024-09-21T00:54:11.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:11 smithi187 ceph-mon[34997]: fsmap cephfs:1/1 {0=cephfs.smithi112.ngfvvg=up:rejoin} 3 up:standby 2024-09-21T00:54:11.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:11 smithi187 ceph-mon[34997]: daemon mds.cephfs.smithi112.ngfvvg is now active in filesystem cephfs as rank 0 2024-09-21T00:54:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:11 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:rejoin 2024-09-21T00:54:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:11 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:standby 2024-09-21T00:54:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:11 smithi112 ceph-mon[28078]: fsmap cephfs:1/1 {0=cephfs.smithi112.ngfvvg=up:rejoin} 3 up:standby 2024-09-21T00:54:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:11 smithi112 ceph-mon[28078]: daemon mds.cephfs.smithi112.ngfvvg is now active in filesystem cephfs as rank 0 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/2054823914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 msgr2=0x7f4a08106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/2054823914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08106c00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009880 tx=0x7f4a0402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/2054823914 shutdown_connections 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/2054823914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a08100820 0x7f4a08100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/2054823914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08106c00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/2054823914 >> 172.21.15.112:0/2054823914 conn(0x7f4a080fc520 msgr2=0x7f4a080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/2054823914 shutdown_connections 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.710+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/2054823914 wait complete. 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0f4ff640 1 Processor -- start 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0f4ff640 1 -- start start 2024-09-21T00:54:11.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0f4ff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a08100820 0x7f4a081023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0f4ff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08102930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0f4ff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0810dd50 con 0x7f4a08106820 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0f4ff640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0810dbd0 con 0x7f4a08100820 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0ca9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0ca9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08102930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39666/0 (socket says 172.21.15.112:39666) 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0ca9a640 1 -- 172.21.15.112:0/3656237836 learned_addr learned my addr 172.21.15.112:0/3656237836 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0d29b640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a08100820 0x7f4a081023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0ca9a640 1 -- 172.21.15.112:0/3656237836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a08100820 msgr2=0x7f4a081023f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0ca9a640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a08100820 0x7f4a081023f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.711+0000 7f4a0ca9a640 1 -- 172.21.15.112:0/3656237836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a08102e70 con 0x7f4a08106820 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.712+0000 7f4a0ca9a640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08102930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f49f800b420 tx=0x7f49f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.712+0000 7f49fe7fc640 1 -- 172.21.15.112:0/3656237836 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49f8011630 con 0x7f4a08106820 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.712+0000 7f49fe7fc640 1 -- 172.21.15.112:0/3656237836 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49f8016070 con 0x7f4a08106820 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.712+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a08103160 con 0x7f4a08106820 2024-09-21T00:54:11.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.712+0000 7f49fe7fc640 1 -- 172.21.15.112:0/3656237836 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49f8010d40 con 0x7f4a08106820 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.712+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a081a3ea0 con 0x7f4a08106820 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.713+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a08101f60 con 0x7f4a08106820 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.713+0000 7f49fe7fc640 1 -- 172.21.15.112:0/3656237836 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f49f801b460 con 0x7f4a08106820 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.714+0000 7f49fe7fc640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f49f406e2b0 0x7f49f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.714+0000 7f4a0d29b640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f49f406e2b0 0x7f49f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.714+0000 7f49fe7fc640 1 -- 172.21.15.112:0/3656237836 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f49f808d9e0 con 0x7f4a08106820 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.714+0000 7f4a0d29b640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f49f406e2b0 0x7f49f4070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a040096c0 tx=0x7f4a04031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.718+0000 7f49fe7fc640 1 -- 172.21.15.112:0/3656237836 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f49f805b2e0 con 0x7f4a08106820 2024-09-21T00:54:11.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.934+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a081a41c0 con 0x7f4a08106820 2024-09-21T00:54:11.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.934+0000 7f49fe7fc640 1 -- 172.21.15.112:0/3656237836 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5325 (secure 0 0 0) 0x7f49f805ef90 con 0x7f4a08106820 2024-09-21T00:54:11.935 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T00:54:11.936 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-21T00:54:11:404609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14614,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/852244245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":852244245},{"type":"v1","addr":"172.21.15.112:6827","nonce":852244245}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T00:54:11.404605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"cephfs.smithi112.ngfvvg","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/1434345295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1434345295},{"type":"v1","addr":"172.21.15.112:6829","nonce":1434345295}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14598,"qdb_cluster":[14598]},"id":1}]} 2024-09-21T00:54:11.936 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T00:54:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.936+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f49f406e2b0 msgr2=0x7f49f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.936+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f49f406e2b0 0x7f49f4070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a040096c0 tx=0x7f4a04031400 comp rx=0 tx=0).stop 2024-09-21T00:54:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.936+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 msgr2=0x7f4a08102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.936+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08102930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f49f800b420 tx=0x7f49f800b8e0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.937+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 shutdown_connections 2024-09-21T00:54:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.937+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f49f406e2b0 0x7f49f4070770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.937+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a08106820 0x7f4a08102930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.937+0000 7f4a0f4ff640 1 --2- 172.21.15.112:0/3656237836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a08100820 0x7f4a081023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.937+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 >> 172.21.15.112:0/3656237836 conn(0x7f4a080fc520 msgr2=0x7f4a081045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.937+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 shutdown_connections 2024-09-21T00:54:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:11.937+0000 7f4a0f4ff640 1 -- 172.21.15.112:0/3656237836 wait complete. 2024-09-21T00:54:12.586 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:12 smithi112 ceph-mon[28078]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 2 op/s 2024-09-21T00:54:12.587 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:12 smithi112 ceph-mon[28078]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T00:54:12.587 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:12 smithi112 ceph-mon[28078]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:active 2024-09-21T00:54:12.587 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:12 smithi112 ceph-mon[28078]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T00:54:12.587 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:12 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3656237836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T00:54:12.616 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-21T00:54:12.617 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T00:54:12.642 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T00:54:12.642 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-21T00:54:12.642 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-21T00:54:12.642 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:54:12.642 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:12.642 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-21T00:54:12.642 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:54:12.642 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:12.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:12.643 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-21T00:54:12.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:12 smithi187 ceph-mon[34997]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 2 op/s 2024-09-21T00:54:12.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:12 smithi187 ceph-mon[34997]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T00:54:12.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:12 smithi187 ceph-mon[34997]: mds.? [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] up:active 2024-09-21T00:54:12.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:12 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T00:54:12.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:12 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3656237836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T00:54:12.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:12.660 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2024-09-21T00:54:12.731 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2024-09-21T00:54:12.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:54:12.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:12.733 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-21T00:54:12.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:12.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-21T00:54:12.815 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-21T00:54:12.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:54:12.817 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T00:54:12.818 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T00:54:12.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T00:54:13.224 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:13.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 -- 172.21.15.112:0/4022921560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 msgr2=0x7f747c10b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 --2- 172.21.15.112:0/4022921560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c10b970 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7470009880 tx=0x7f747002a530 comp rx=0 tx=0).stop 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 -- 172.21.15.112:0/4022921560 shutdown_connections 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 --2- 172.21.15.112:0/4022921560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c10b970 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 --2- 172.21.15.112:0/4022921560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c102b60 0x7f747c102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 -- 172.21.15.112:0/4022921560 >> 172.21.15.112:0/4022921560 conn(0x7f747c0fc520 msgr2=0x7f747c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 -- 172.21.15.112:0/4022921560 shutdown_connections 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.639+0000 7f7482884640 1 -- 172.21.15.112:0/4022921560 wait complete. 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f7482884640 1 Processor -- start 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f7482884640 1 -- start start 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f7482884640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c102b60 0x7f747c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f7482884640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f7482884640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f747c10ee10 con 0x7f747c103480 2024-09-21T00:54:13.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f7482884640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f747c10ec90 con 0x7f747c102b60 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f747b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f747b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52356/0 (socket says 172.21.15.112:52356) 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.640+0000 7f747b7fe640 1 -- 172.21.15.112:0/3192716359 learned_addr learned my addr 172.21.15.112:0/3192716359 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f747bfff640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c102b60 0x7f747c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f747b7fe640 1 -- 172.21.15.112:0/3192716359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c102b60 msgr2=0x7f747c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f747b7fe640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c102b60 0x7f747c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f747b7fe640 1 -- 172.21.15.112:0/3192716359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c1977e0 con 0x7f747c103480 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f747b7fe640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c19dba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7470004f90 tx=0x7f74700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f74797fa640 1 -- 172.21.15.112:0/3192716359 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f747003f070 con 0x7f747c103480 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f74797fa640 1 -- 172.21.15.112:0/3192716359 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7470004c70 con 0x7f747c103480 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747c197a70 con 0x7f747c103480 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f74797fa640 1 -- 172.21.15.112:0/3192716359 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7470035030 con 0x7f747c103480 2024-09-21T00:54:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.641+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747c197fa0 con 0x7f747c103480 2024-09-21T00:54:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.642+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f747c06ab60 con 0x7f747c103480 2024-09-21T00:54:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.643+0000 7f74797fa640 1 -- 172.21.15.112:0/3192716359 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f7470042070 con 0x7f747c103480 2024-09-21T00:54:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.643+0000 7f74797fa640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f746406e310 0x7f74640707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.643+0000 7f74797fa640 1 -- 172.21.15.112:0/3192716359 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f74700aea70 con 0x7f747c103480 2024-09-21T00:54:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.643+0000 7f747bfff640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f746406e310 0x7f74640707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.644+0000 7f747bfff640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f746406e310 0x7f74640707d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f746c005fd0 tx=0x7f746c005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.648+0000 7f74797fa640 1 -- 172.21.15.112:0/3192716359 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f747007c3f0 con 0x7f747c103480 2024-09-21T00:54:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.882+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f747c198d10 con 0x7f747c103480 2024-09-21T00:54:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.882+0000 7f74797fa640 1 -- 172.21.15.112:0/3192716359 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7f74700800a0 con 0x7f747c103480 2024-09-21T00:54:13.883 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f746406e310 msgr2=0x7f74640707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f746406e310 0x7f74640707d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f746c005fd0 tx=0x7f746c005850 comp rx=0 tx=0).stop 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 msgr2=0x7f747c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c19dba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7470004f90 tx=0x7f74700048f0 comp rx=0 tx=0).stop 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 shutdown_connections 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f746406e310 0x7f74640707d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747c103480 0x7f747c19dba0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 --2- 172.21.15.112:0/3192716359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c102b60 0x7f747c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:13.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 >> 172.21.15.112:0/3192716359 conn(0x7f747c0fc520 msgr2=0x7f747c103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:13.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 shutdown_connections 2024-09-21T00:54:13.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:13.885+0000 7f7482884640 1 -- 172.21.15.112:0/3192716359 wait complete. 2024-09-21T00:54:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T00:54:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3192716359' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T00:54:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:54:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:14 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:54:14.577 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:54:14.577 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:54:14.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-21T00:54:14.578 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T00:54:14.578 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:14.578 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:54:14.578 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:54:14.578 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:54:14.578 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:54:14.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:14.578 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-21T00:54:14.594 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:54:14.594 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:54:14.594 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:54:14.594 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:54:14.594 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-21T00:54:14.594 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42343sec preferred_lft 42343sec 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-21T00:54:14.595 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:54:14.596 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:54:14.596 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:14.596 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T00:54:14.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:54:14.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-09-21T00:54:14.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-09-21T00:54:14.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:54:14.596 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T00:54:14.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T00:54:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3192716359' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T00:54:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:54:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:14 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:54:14.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:14.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:14.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:14.804 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:54:14.828 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-21T00:54:14.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:14.830 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-21T00:54:14.925 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-21T00:54:14.925 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:54:14.926 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:54:14.926 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:54:14.926 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:54:14.926 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:14.926 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T00:54:14.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:54:14.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:54:14.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:54:14.927 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T00:54:14.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:15.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:15.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:15.410 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-21T00:54:15.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:15.426 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-21T00:54:15.482 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:15.482 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T00:54:15.482 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:54:15.482 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T00:54:15.483 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T00:54:15.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:15.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:15.891 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T00:54:15.891 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:15.891 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T00:54:15.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T00:54:15.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:54:15.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T00:54:15.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T00:54:15.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T00:54:15.892 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T00:54:15.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:16.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:16.048 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:16.048 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T00:54:16.048 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-21T00:54:16.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:54:16.049 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T00:54:16.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:16.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:16.124 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-21T00:54:16.124 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:54:16.124 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:16.139 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:54:16.139 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:54:16.139 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:16.191 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-21T00:54:16.256 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:54:16.313 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-21T00:54:16.314 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-21T00:54:16.314 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-21T00:54:16.314 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-21T00:54:16.314 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-21T00:54:16.314 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-21T00:54:16.314 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-21T00:54:16.315 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-21T00:54:16.315 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-21T00:54:16.315 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-21T00:54:16.315 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-21T00:54:16.315 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/selinux 2024-09-21T00:54:16.315 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:16.316 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-21T00:54:16.316 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-21T00:54:16.316 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-21T00:54:16.316 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-21T00:54:16.316 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-21T00:54:16.316 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-21T00:54:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:54:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:54:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:54:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:54:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-21T00:54:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-21T00:54:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay 2024-09-21T00:54:16.318 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/145a8874beb3ea9e7999a92cd9df04eb3beea88e03eb50605f13ebf3beb1b641/merged 2024-09-21T00:54:16.318 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/ef4d5006d7103f7e418d154206fec4bcaa670df0958859551b4e63c83c3a5b0f/merged 2024-09-21T00:54:16.318 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/0 2024-09-21T00:54:16.318 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:16.318 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/750fc5f189f6555de339f2ecc03425f102c5d0882750bd3b3b7a5bfcb4d69953/merged 2024-09-21T00:54:16.318 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/309ee1590b43c90b61037930523bd2c4ffad1158a4d2dede1e7bdaf8ea3ede82/merged 2024-09-21T00:54:16.319 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/3508580f2c24010e75417b0727c0dd51916a5c8ae67ed4d7e71fe4d04e79bc7d/merged 2024-09-21T00:54:16.319 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/083314cb4de934e94dfbbac857c7a72650c2d0b96f50895c09f2bc5d07b5a790/merged 2024-09-21T00:54:16.319 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/6701091bd44b0d519b7b78e74bfb74a86b71a0009d092ca987832fed5d0bcc1d/merged 2024-09-21T00:54:16.319 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/0be4b88eedbeb5ad1d2a55b758bfdc7048b7f4c4d5fe5db6243647d1c57c8fc6/merged 2024-09-21T00:54:16.319 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/4302cd6753c4672b340364085550708d40dc37b352800b34b6f7d457214febea/merged 2024-09-21T00:54:16.319 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/28f6a0f49a5575f4dbfc1b9c535b9321968a7598b4183c9333903929897f6647/merged 2024-09-21T00:54:16.320 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/be039a1a22df2492ddfbc72d3d10d9464b58cd9a2e63ee5dfc94ab3155a6e067/merged 2024-09-21T00:54:16.320 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/9866bc00b9ffe6616771d4b9e1a4fb2bcbb277c9d3961c5b6597757f4757d0e9/merged 2024-09-21T00:54:16.320 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/f2e12df7492c16ae14d0ee725845e66d7d77a77ad99550684380a7cac455ff0e/merged 2024-09-21T00:54:16.320 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-21T00:54:16.320 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:54:16.320 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:54:16.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:16.321 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-21T00:54:16.368 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T00:54:16.369 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-21T00:54:16.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-21T00:54:16.435 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:54:16.491 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-21T00:54:16.491 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/selinux 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:16.492 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay 2024-09-21T00:54:16.493 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/145a8874beb3ea9e7999a92cd9df04eb3beea88e03eb50605f13ebf3beb1b641/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/ef4d5006d7103f7e418d154206fec4bcaa670df0958859551b4e63c83c3a5b0f/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/0 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/750fc5f189f6555de339f2ecc03425f102c5d0882750bd3b3b7a5bfcb4d69953/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/309ee1590b43c90b61037930523bd2c4ffad1158a4d2dede1e7bdaf8ea3ede82/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/3508580f2c24010e75417b0727c0dd51916a5c8ae67ed4d7e71fe4d04e79bc7d/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/083314cb4de934e94dfbbac857c7a72650c2d0b96f50895c09f2bc5d07b5a790/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/6701091bd44b0d519b7b78e74bfb74a86b71a0009d092ca987832fed5d0bcc1d/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/0be4b88eedbeb5ad1d2a55b758bfdc7048b7f4c4d5fe5db6243647d1c57c8fc6/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/4302cd6753c4672b340364085550708d40dc37b352800b34b6f7d457214febea/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/28f6a0f49a5575f4dbfc1b9c535b9321968a7598b4183c9333903929897f6647/merged 2024-09-21T00:54:16.494 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/be039a1a22df2492ddfbc72d3d10d9464b58cd9a2e63ee5dfc94ab3155a6e067/merged 2024-09-21T00:54:16.495 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/9866bc00b9ffe6616771d4b9e1a4fb2bcbb277c9d3961c5b6597757f4757d0e9/merged 2024-09-21T00:54:16.495 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/f2e12df7492c16ae14d0ee725845e66d7d77a77ad99550684380a7cac455ff0e/merged 2024-09-21T00:54:16.495 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-21T00:54:16.495 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:54:16.495 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:54:16.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:16.495 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-21T00:54:16.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:16 smithi112 ceph-mon[28078]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 6 op/s 2024-09-21T00:54:16.594 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-21T00:54:16.594+0000 7f3197708480 -1 init, newargv = 0x562f9731e130 newargc=15 2024-09-21T00:54:16.595 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[76913]: starting ceph client 2024-09-21T00:54:16.599 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[76913]: starting fuse 2024-09-21T00:54:16.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:16 smithi187 ceph-mon[34997]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 6 op/s 2024-09-21T00:54:17.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-21T00:54:17.696 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:54:17.752 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-21T00:54:17.752 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-21T00:54:17.752 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/selinux 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-21T00:54:17.753 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/145a8874beb3ea9e7999a92cd9df04eb3beea88e03eb50605f13ebf3beb1b641/merged 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/ef4d5006d7103f7e418d154206fec4bcaa670df0958859551b4e63c83c3a5b0f/merged 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/0 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/750fc5f189f6555de339f2ecc03425f102c5d0882750bd3b3b7a5bfcb4d69953/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/309ee1590b43c90b61037930523bd2c4ffad1158a4d2dede1e7bdaf8ea3ede82/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/3508580f2c24010e75417b0727c0dd51916a5c8ae67ed4d7e71fe4d04e79bc7d/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/083314cb4de934e94dfbbac857c7a72650c2d0b96f50895c09f2bc5d07b5a790/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/6701091bd44b0d519b7b78e74bfb74a86b71a0009d092ca987832fed5d0bcc1d/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/0be4b88eedbeb5ad1d2a55b758bfdc7048b7f4c4d5fe5db6243647d1c57c8fc6/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/4302cd6753c4672b340364085550708d40dc37b352800b34b6f7d457214febea/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/28f6a0f49a5575f4dbfc1b9c535b9321968a7598b4183c9333903929897f6647/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/be039a1a22df2492ddfbc72d3d10d9464b58cd9a2e63ee5dfc94ab3155a6e067/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/9866bc00b9ffe6616771d4b9e1a4fb2bcbb277c9d3961c5b6597757f4757d0e9/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/containers/storage/overlay/f2e12df7492c16ae14d0ee725845e66d7d77a77ad99550684380a7cac455ff0e/merged 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:54:17.755 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:17.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:17.756 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-21T00:54:17.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:17 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:17.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:17 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:17.775 INFO:teuthology.orchestra.run.smithi112.stdout:153 2024-09-21T00:54:17.775 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [153] 2024-09-21T00:54:17.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-21T00:54:17.776 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-21T00:54:17.776 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-21T00:54:17.776 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-21T00:54:17.776 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-21T00:54:17.776 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-21T00:54:17.776 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-21T00:54:17.777 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T00:54:17.777 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-21T00:54:17.777 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T00:54:17.777 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-21T00:54:17.777 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-21T00:54:17.777 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-21T00:54:17.778 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-21T00:54:17.778 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-21T00:54:17.778 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-21T00:54:17.778 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-21T00:54:17.778 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T00:54:17.778 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T00:54:17.778 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T00:54:17.779 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-21T00:54:17.779 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-21T00:54:17.779 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-21T00:54:17.779 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T00:54:17.779 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-21T00:54:17.779 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-21T00:54:17.780 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-21T00:54:17.893 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.76913.asok 2024-09-21T00:54:17.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:17.903 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76913.asok 2024-09-21T00:54:17.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:17.903 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76913.asok status 2024-09-21T00:54:17.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:17 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:17.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:17 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:18.046 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:54:18.046 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-21T00:54:18.046 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T00:54:18.046 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "76913", 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-21T00:54:18.047 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 14630, 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 14630 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3559983563 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:54:18.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3559983563 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.14630 192.168.0.1:0/3559983563", 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/3559983563", 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 15, 2024-09-21T00:54:18.049 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 44, 2024-09-21T00:54:18.050 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-21T00:54:18.050 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-21T00:54:18.050 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-21T00:54:18.050 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:54:18.055 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T00:54:18.055 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T00:54:18.719 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:18.810 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:18 smithi187 ceph-mon[34997]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:54:18.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:18 smithi112 ceph-mon[28078]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:54:19.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 -- 172.21.15.112:0/3417020392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 msgr2=0x7f2a6c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:19.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 --2- 172.21.15.112:0/3417020392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c101d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009c20 tx=0x7f2a5c02a970 comp rx=0 tx=0).stop 2024-09-21T00:54:19.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 -- 172.21.15.112:0/3417020392 shutdown_connections 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 --2- 172.21.15.112:0/3417020392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c101d90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 --2- 172.21.15.112:0/3417020392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a6c107930 0x7f2a6c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 -- 172.21.15.112:0/3417020392 >> 172.21.15.112:0/3417020392 conn(0x7f2a6c0fd630 msgr2=0x7f2a6c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 -- 172.21.15.112:0/3417020392 shutdown_connections 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.217+0000 7f2a72cab640 1 -- 172.21.15.112:0/3417020392 wait complete. 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a72cab640 1 Processor -- start 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a72cab640 1 -- start start 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a72cab640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a72cab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a6c107930 0x7f2a6c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a72cab640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c10ede0 con 0x7f2a6c101930 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a72cab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c10ec60 con 0x7f2a6c107930 2024-09-21T00:54:19.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a70a47640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a70a47640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52380/0 (socket says 172.21.15.112:52380) 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.218+0000 7f2a70a47640 1 -- 172.21.15.112:0/4246311283 learned_addr learned my addr 172.21.15.112:0/4246311283 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a70a47640 1 -- 172.21.15.112:0/4246311283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a6c107930 msgr2=0x7f2a6c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a70a47640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a6c107930 0x7f2a6c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a70a47640 1 -- 172.21.15.112:0/4246311283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c197850 con 0x7f2a6c101930 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a70a47640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c19d6d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400d8d0 tx=0x7f2a6400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a69ffb640 1 -- 172.21.15.112:0/4246311283 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a64017070 con 0x7f2a6c101930 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a69ffb640 1 -- 172.21.15.112:0/4246311283 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a64010460 con 0x7f2a6c101930 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c197b40 con 0x7f2a6c101930 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a69ffb640 1 -- 172.21.15.112:0/4246311283 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a6400f5f0 con 0x7f2a6c101930 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.219+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c1980d0 con 0x7f2a6c101930 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.220+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c103070 con 0x7f2a6c101930 2024-09-21T00:54:19.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.221+0000 7f2a69ffb640 1 -- 172.21.15.112:0/4246311283 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f2a64009a30 con 0x7f2a6c101930 2024-09-21T00:54:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.221+0000 7f2a69ffb640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2a5806e2b0 0x7f2a58070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.221+0000 7f2a69ffb640 1 -- 172.21.15.112:0/4246311283 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f2a6408e0d0 con 0x7f2a6c101930 2024-09-21T00:54:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.221+0000 7f2a6bfff640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2a5806e2b0 0x7f2a58070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.222+0000 7f2a6bfff640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2a5806e2b0 0x7f2a58070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009430 tx=0x7f2a5c0093a0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:19.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.226+0000 7f2a69ffb640 1 -- 172.21.15.112:0/4246311283 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a6405b9d0 con 0x7f2a6c101930 2024-09-21T00:54:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.437+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2a6c109ec0 con 0x7f2a6c101930 2024-09-21T00:54:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.438+0000 7f2a69ffb640 1 -- 172.21.15.112:0/4246311283 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7f2a6405f680 con 0x7f2a6c101930 2024-09-21T00:54:19.440 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T00:54:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2a5806e2b0 msgr2=0x7f2a58070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2a5806e2b0 0x7f2a58070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009430 tx=0x7f2a5c0093a0 comp rx=0 tx=0).stop 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 msgr2=0x7f2a6c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c19d6d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400d8d0 tx=0x7f2a6400dd90 comp rx=0 tx=0).stop 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 shutdown_connections 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2a5806e2b0 0x7f2a58070770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a6c107930 0x7f2a6c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 --2- 172.21.15.112:0/4246311283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a6c101930 0x7f2a6c19d6d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 >> 172.21.15.112:0/4246311283 conn(0x7f2a6c0fd630 msgr2=0x7f2a6c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 shutdown_connections 2024-09-21T00:54:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:19.440+0000 7f2a72cab640 1 -- 172.21.15.112:0/4246311283 wait complete. 2024-09-21T00:54:20.045 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:54:20.045 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:54:20.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-21T00:54:20.045 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T00:54:20.045 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:20.046 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:54:20.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:54:20.046 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:54:20.046 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T00:54:20.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:20.046 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-21T00:54:20.062 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:54:20.062 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:54:20.062 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:54:20.062 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:54:20.062 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42337sec preferred_lft 42337sec 2024-09-21T00:54:20.063 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-21T00:54:20.064 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:54:20.064 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:54:20.064 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:20.064 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-21T00:54:20.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:54:20.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2024-09-21T00:54:20.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2024-09-21T00:54:20.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:54:20.064 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-21T00:54:20.151 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:20.271 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:20.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:20.278 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:54:20.303 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-21T00:54:20.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:20.305 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-21T00:54:20.370 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-21T00:54:20.370 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:54:20.371 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T00:54:20.371 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T00:54:20.371 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:54:20.371 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:20.371 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-21T00:54:20.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T00:54:20.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T00:54:20.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T00:54:20.371 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-21T00:54:20.458 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:20.467 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:54:20.467 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:20.467 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:20.467 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:20.467 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:54:20.467 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:20.467 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4246311283' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T00:54:20.468 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:20.692 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:20.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:20.699 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-21T00:54:20.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:20.717 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2024-09-21T00:54:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T00:54:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:54:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:54:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:54:20.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4246311283' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T00:54:20.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:20.773 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:20.773 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-21T00:54:20.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:54:20.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T00:54:20.774 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-21T00:54:20.863 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:20.886 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:20.892 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T00:54:20.892 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:20.893 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-21T00:54:20.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T00:54:20.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:54:20.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T00:54:20.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T00:54:20.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T00:54:20.893 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-21T00:54:20.942 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:21.012 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:21.018 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:54:21.018 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-21T00:54:21.018 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-21T00:54:21.018 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:54:21.018 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-21T00:54:21.065 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:54:21.088 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:21.095 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-21T00:54:21.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:54:21.095 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:21.110 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T00:54:21.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:54:21.110 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:21.166 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2024-09-21T00:54:21.234 DEBUG:teuthology.orchestra.run.smithi187:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/proc 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/sys 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/dev 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/security 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/shm 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/pts 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/run 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/cgroup 2024-09-21T00:54:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/pstore 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/bpf 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/ 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/selinux 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/hugepages 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/mqueue 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/debug 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/tracing 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/fuse/connections 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/config 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:54:21.292 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/1000 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/0 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/523e159a613323d77dbdec1a36d1b8817657505ee4a360ee7f68ac54f4412ee6/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/b635d176adfeaf27b1a8e957b51fe016c25a6e7b3e2d962a82433cb0fb9310a4/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/21e1d0d0803ba6d8708f8093ab3e288d1b894ee74b3881e0e698aff005b55ead/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/ffd0ec4ccb3174eb18aecb254cc2b2c510d965367da46f47f79ee4edd865d202/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/e51469b289a251babc918161ec8764c2fa688d57d923e3f5c6763201f6d9611b/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/11831a75b57c641e2af1bd624040fe3530127ce72363875ef1cb2aacf87702ef/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/2be30cf895e2e620aba3342861c3e855d566cbf0ec3d7486639cba26054e6796/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/d2aa75bb239da4b1b91a4e8c01370f1cedde0bf95d15c4c4559e3e4df8a70687/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/84ddec434c0733c3e6f798cac167d0ad34ff71c32bd7e211e3695c9b90ba0e2e/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/c88919763d5b5c6bc5f58964c56f6180840e83156b9b4ab2251722c8d977bb42/merged 2024-09-21T00:54:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns 2024-09-21T00:54:21.294 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:54:21.294 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:54:21.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:21.294 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2024-09-21T00:54:21.347 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T00:54:21.347 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-21T00:54:21.391 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2024-09-21T00:54:21.415 DEBUG:teuthology.orchestra.run.smithi187:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T00:54:21.471 INFO:teuthology.orchestra.run.smithi187.stdout:/proc 2024-09-21T00:54:21.471 INFO:teuthology.orchestra.run.smithi187.stdout:/sys 2024-09-21T00:54:21.471 INFO:teuthology.orchestra.run.smithi187.stdout:/dev 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/security 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/shm 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/pts 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/run 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/cgroup 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/pstore 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/bpf 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/ 2024-09-21T00:54:21.472 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/selinux 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/hugepages 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/mqueue 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/debug 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/tracing 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/fuse/connections 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/config 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/1000 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph 2024-09-21T00:54:21.473 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/0 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/523e159a613323d77dbdec1a36d1b8817657505ee4a360ee7f68ac54f4412ee6/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/b635d176adfeaf27b1a8e957b51fe016c25a6e7b3e2d962a82433cb0fb9310a4/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/21e1d0d0803ba6d8708f8093ab3e288d1b894ee74b3881e0e698aff005b55ead/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/ffd0ec4ccb3174eb18aecb254cc2b2c510d965367da46f47f79ee4edd865d202/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/e51469b289a251babc918161ec8764c2fa688d57d923e3f5c6763201f6d9611b/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/11831a75b57c641e2af1bd624040fe3530127ce72363875ef1cb2aacf87702ef/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/2be30cf895e2e620aba3342861c3e855d566cbf0ec3d7486639cba26054e6796/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/d2aa75bb239da4b1b91a4e8c01370f1cedde0bf95d15c4c4559e3e4df8a70687/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/84ddec434c0733c3e6f798cac167d0ad34ff71c32bd7e211e3695c9b90ba0e2e/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/containers/storage/overlay/c88919763d5b5c6bc5f58964c56f6180840e83156b9b4ab2251722c8d977bb42/merged 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:54:21.474 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T00:54:21.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:21.475 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2024-09-21T00:54:21.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2024-09-21T00:54:21.519+0000 7ffb83506480 -1 init, newargv = 0x5629975d0090 newargc=15 2024-09-21T00:54:21.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[60651]: starting ceph client 2024-09-21T00:54:21.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[60651]: starting fuse 2024-09-21T00:54:21.528 INFO:teuthology.orchestra.run.smithi187.stdout:129 2024-09-21T00:54:21.528 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo stdin-killer -- python3 -c ' 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> import re 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> import os 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-21T00:54:21.528 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> return f 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> 2024-09-21T00:54:21.529 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2024-09-21T00:54:21.530 DEBUG:teuthology.orchestra.run.smithi187:> ' 2024-09-21T00:54:21.645 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.60651.asok 2024-09-21T00:54:21.648 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T00:54:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:54:21.655 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.60651.asok 2024-09-21T00:54:21.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:21.656 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.60651.asok status 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "60651", 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2024-09-21T00:54:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 24343, 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 24343 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 2267224782 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2024-09-21T00:54:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 2267224782 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.24343 192.168.0.1:0/2267224782", 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/2267224782", 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 15, 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 44, 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2024-09-21T00:54:21.792 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-21T00:54:21.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:21.798 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-21T00:54:21.798 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:21.819 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-21T00:54:21.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:21.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:21.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:21.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:21.892 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2024-09-21T00:54:21.892 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:21.908 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2024-09-21T00:54:21.908 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:21.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:54:21.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:21.976 INFO:teuthology.run_tasks:Running task print... 2024-09-21T00:54:21.993 INFO:teuthology.task.print:**** done client 2024-09-21T00:54:21.993 INFO:teuthology.run_tasks:Running task parallel... 2024-09-21T00:54:22.016 INFO:teuthology.task.parallel:starting parallel... 2024-09-21T00:54:22.016 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T00:54:22.016 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T00:54:22.017 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T00:54:22.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T00:54:22.017 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T00:54:22.017 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-21T00:54:22.022 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:54:22.022 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T00:54:22.022 INFO:tasks.workunit:timeout=3h 2024-09-21T00:54:22.022 INFO:tasks.workunit:cleanup=True 2024-09-21T00:54:22.022 DEBUG:teuthology.orchestra.run.smithi112:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 99h/153d Inode: 1 Links: 2 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 00:53:57.580742068 +0000 2024-09-21T00:54:22.043 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 00:54:21.889772511 +0000 2024-09-21T00:54:22.044 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-21T00:54:22.044 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T00:54:22.044 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T00:54:22.115 DEBUG:teuthology.orchestra.run.smithi187:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:22.131 INFO:teuthology.orchestra.run.smithi187.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:22.131 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T00:54:22.131 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-21T00:54:22.131 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:54:22.131 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T00:54:22.131 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T00:54:22.132 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 00:54:22.109679418 +0000 2024-09-21T00:54:22.132 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 00:54:22.109679418 +0000 2024-09-21T00:54:22.132 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-21T00:54:22.132 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-21T00:54:22.132 DEBUG:teuthology.orchestra.run.smithi187:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-21T00:54:22.201 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:54:22.202 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:54:22.218 INFO:tasks.workunit.client.0.smithi112.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T00:54:22.257 INFO:tasks.workunit.client.1.smithi187.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-21T00:54:22.289 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:22.578 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:22 smithi112 ceph-mon[28078]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T00:54:22.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:22 smithi187 ceph-mon[34997]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T00:54:22.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 -- 172.21.15.112:0/4108349349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 msgr2=0x7fe1c0101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:22.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/4108349349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c0101f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009880 tx=0x7fe1ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 -- 172.21.15.112:0/4108349349 shutdown_connections 2024-09-21T00:54:22.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/4108349349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c0101f00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/4108349349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c0100880 0x7fe1c0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 -- 172.21.15.112:0/4108349349 >> 172.21.15.112:0/4108349349 conn(0x7fe1c00fc010 msgr2=0x7fe1c00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:22.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 -- 172.21.15.112:0/4108349349 shutdown_connections 2024-09-21T00:54:22.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.755+0000 7fe1c6c20640 1 -- 172.21.15.112:0/4108349349 wait complete. 2024-09-21T00:54:22.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1c6c20640 1 Processor -- start 2024-09-21T00:54:22.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1c6c20640 1 -- start start 2024-09-21T00:54:22.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1c6c20640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c0100880 0x7fe1c006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:22.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1c6c20640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:22.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1c6c20640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c01096a0 con 0x7fe1c0101a80 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1c6c20640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c0109520 con 0x7fe1c0100880 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40922/0 (socket says 172.21.15.112:40922) 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1bffff640 1 -- 172.21.15.112:0/279976581 learned_addr learned my addr 172.21.15.112:0/279976581 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1c49bc640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c0100880 0x7fe1c006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1bffff640 1 -- 172.21.15.112:0/279976581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c0100880 msgr2=0x7fe1c006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1bffff640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c0100880 0x7fe1c006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1bffff640 1 -- 172.21.15.112:0/279976581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c019c7a0 con 0x7fe1c0101a80 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.756+0000 7fe1bffff640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c019c1e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac006010 tx=0x7fe1ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.757+0000 7fe1bdffb640 1 -- 172.21.15.112:0/279976581 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1ac03f070 con 0x7fe1c0101a80 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.757+0000 7fe1bdffb640 1 -- 172.21.15.112:0/279976581 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1ac0044d0 con 0x7fe1c0101a80 2024-09-21T00:54:22.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.757+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c019ca30 con 0x7fe1c0101a80 2024-09-21T00:54:22.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.757+0000 7fe1bdffb640 1 -- 172.21.15.112:0/279976581 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1ac035030 con 0x7fe1c0101a80 2024-09-21T00:54:22.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.757+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c019cf60 con 0x7fe1c0101a80 2024-09-21T00:54:22.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.758+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c0100c80 con 0x7fe1c0101a80 2024-09-21T00:54:22.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.758+0000 7fe1bdffb640 1 -- 172.21.15.112:0/279976581 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe1ac042070 con 0x7fe1c0101a80 2024-09-21T00:54:22.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.759+0000 7fe1bdffb640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe1b006e2b0 0x7fe1b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:22.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.759+0000 7fe1bdffb640 1 -- 172.21.15.112:0/279976581 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7fe1ac0aeee0 con 0x7fe1c0101a80 2024-09-21T00:54:22.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.759+0000 7fe1c49bc640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe1b006e2b0 0x7fe1b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:22.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.759+0000 7fe1c49bc640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe1b006e2b0 0x7fe1b0070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1c01018e0 tx=0x7fe1b400a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:22.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.764+0000 7fe1bdffb640 1 -- 172.21.15.112:0/279976581 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe1ac080400 con 0x7fe1c0101a80 2024-09-21T00:54:22.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.940+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fe1c0062df0 con 0x7fe1c0101a80 2024-09-21T00:54:22.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.940+0000 7fe1bdffb640 1 -- 172.21.15.112:0/279976581 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) ==== 155+0+0 (secure 0 0 0) 0x7fe1ac084c30 con 0x7fe1c0101a80 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe1b006e2b0 msgr2=0x7fe1b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe1b006e2b0 0x7fe1b0070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1c01018e0 tx=0x7fe1b400a2d0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 msgr2=0x7fe1c019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c019c1e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac006010 tx=0x7fe1ac0048f0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 shutdown_connections 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe1b006e2b0 0x7fe1b0070770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1c0101a80 0x7fe1c019c1e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 --2- 172.21.15.112:0/279976581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c0100880 0x7fe1c006adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 >> 172.21.15.112:0/279976581 conn(0x7fe1c00fc010 msgr2=0x7fe1c0104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 shutdown_connections 2024-09-21T00:54:22.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:22.943+0000 7fe1c6c20640 1 -- 172.21.15.112:0/279976581 wait complete. 2024-09-21T00:54:23.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T00:54:23.911 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.372+0000 7f2e9b66b640 1 -- 172.21.15.112:0/4230701091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94102490 msgr2=0x7f2e94104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.372+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/4230701091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94102490 0x7f2e94104880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009880 tx=0x7f2e9002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.372+0000 7f2e9b66b640 1 -- 172.21.15.112:0/4230701091 shutdown_connections 2024-09-21T00:54:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.372+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/4230701091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e94104dc0 0x7f2e941071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.372+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/4230701091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94102490 0x7f2e94104880 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.372+0000 7f2e9b66b640 1 -- 172.21.15.112:0/4230701091 >> 172.21.15.112:0/4230701091 conn(0x7f2e940fbff0 msgr2=0x7f2e940fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:24.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 -- 172.21.15.112:0/4230701091 shutdown_connections 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 -- 172.21.15.112:0/4230701091 wait complete. 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 Processor -- start 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 -- start start 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e94102490 0x7f2e941996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94104dc0 0x7f2e94199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9410a7b0 con 0x7f2e94104dc0 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e9b66b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9410a630 con 0x7f2e94102490 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.373+0000 7f2e98c06640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94104dc0 0x7f2e94199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e98c06640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94104dc0 0x7f2e94199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40932/0 (socket says 172.21.15.112:40932) 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e98c06640 1 -- 172.21.15.112:0/1903204020 learned_addr learned my addr 172.21.15.112:0/1903204020 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e99407640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e94102490 0x7f2e941996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e98c06640 1 -- 172.21.15.112:0/1903204020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e94102490 msgr2=0x7f2e941996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:24.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e98c06640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e94102490 0x7f2e941996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e98c06640 1 -- 172.21.15.112:0/1903204020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9419a290 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e98c06640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94104dc0 0x7f2e94199c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400d6c0 tx=0x7f2e8400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e8a7fc640 1 -- 172.21.15.112:0/1903204020 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e84017070 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e8a7fc640 1 -- 172.21.15.112:0/1903204020 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e840054e0 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9419ecd0 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e8a7fc640 1 -- 172.21.15.112:0/1903204020 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e84004b70 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.374+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9419f200 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.375+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e94102870 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.376+0000 7f2e8a7fc640 1 -- 172.21.15.112:0/1903204020 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f2e84009820 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.376+0000 7f2e8a7fc640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2e8006e2b0 0x7f2e80070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.376+0000 7f2e8a7fc640 1 -- 172.21.15.112:0/1903204020 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f2e8408dd30 con 0x7f2e94104dc0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.376+0000 7f2e99407640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2e8006e2b0 0x7f2e80070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.377+0000 7f2e99407640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2e8006e2b0 0x7f2e80070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e90000c00 tx=0x7f2e900058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:24.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.380+0000 7f2e8a7fc640 1 -- 172.21.15.112:0/1903204020 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e8405f2e0 con 0x7f2e94104dc0 2024-09-21T00:54:24.549 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:24 smithi112 ceph-mon[28078]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T00:54:24.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.554+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f2e94062df0 con 0x7f2e94104dc0 2024-09-21T00:54:24.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.554+0000 7f2e8a7fc640 1 -- 172.21.15.112:0/1903204020 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) ==== 163+0+0 (secure 0 0 0) 0x7f2e84063b10 con 0x7f2e94104dc0 2024-09-21T00:54:24.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.556+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2e8006e2b0 msgr2=0x7f2e80070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:24.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.556+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2e8006e2b0 0x7f2e80070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e90000c00 tx=0x7f2e900058d0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.556+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94104dc0 msgr2=0x7f2e94199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.556+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94104dc0 0x7f2e94199c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400d6c0 tx=0x7f2e8400db80 comp rx=0 tx=0).stop 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.557+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 shutdown_connections 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.557+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f2e8006e2b0 0x7f2e80070770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.557+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e94104dc0 0x7f2e94199c10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.557+0000 7f2e9b66b640 1 --2- 172.21.15.112:0/1903204020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e94102490 0x7f2e941996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.557+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 >> 172.21.15.112:0/1903204020 conn(0x7f2e940fbff0 msgr2=0x7f2e94101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.557+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 shutdown_connections 2024-09-21T00:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:24.557+0000 7f2e9b66b640 1 -- 172.21.15.112:0/1903204020 wait complete. 2024-09-21T00:54:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:24 smithi187 ceph-mon[34997]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T00:54:25.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T00:54:25.413 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:25.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 -- 172.21.15.112:0/2104880756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 msgr2=0x7efe60104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:25.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 --2- 172.21.15.112:0/2104880756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe60104820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efe50009880 tx=0x7efe5002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 -- 172.21.15.112:0/2104880756 shutdown_connections 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 --2- 172.21.15.112:0/2104880756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe60104d60 0x7efe60107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 --2- 172.21.15.112:0/2104880756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe60104820 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 -- 172.21.15.112:0/2104880756 >> 172.21.15.112:0/2104880756 conn(0x7efe600fbff0 msgr2=0x7efe600fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 -- 172.21.15.112:0/2104880756 shutdown_connections 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.912+0000 7efe65ab2640 1 -- 172.21.15.112:0/2104880756 wait complete. 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe65ab2640 1 Processor -- start 2024-09-21T00:54:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe65ab2640 1 -- start start 2024-09-21T00:54:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe65ab2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe601974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe65ab2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe60104d60 0x7efe60197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe65ab2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe6010a7a0 con 0x7efe60102430 2024-09-21T00:54:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe65ab2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efe6010a620 con 0x7efe60104d60 2024-09-21T00:54:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe5f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe601974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:25.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe5f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe601974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40954/0 (socket says 172.21.15.112:40954) 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe5f7fe640 1 -- 172.21.15.112:0/517609303 learned_addr learned my addr 172.21.15.112:0/517609303 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.913+0000 7efe5effd640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe60104d60 0x7efe60197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5f7fe640 1 -- 172.21.15.112:0/517609303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe60104d60 msgr2=0x7efe60197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5f7fe640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe60104d60 0x7efe60197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5f7fe640 1 -- 172.21.15.112:0/517609303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe601980b0 con 0x7efe60102430 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5effd640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe60104d60 0x7efe60197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5f7fe640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe601974f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efe50006010 tx=0x7efe500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5cff9640 1 -- 172.21.15.112:0/517609303 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe5003f070 con 0x7efe60102430 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5cff9640 1 -- 172.21.15.112:0/517609303 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe500044d0 con 0x7efe60102430 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6019caf0 con 0x7efe60102430 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe5cff9640 1 -- 172.21.15.112:0/517609303 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe50035030 con 0x7efe60102430 2024-09-21T00:54:25.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.914+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6019d080 con 0x7efe60102430 2024-09-21T00:54:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.915+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe60102810 con 0x7efe60102430 2024-09-21T00:54:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.916+0000 7efe5cff9640 1 -- 172.21.15.112:0/517609303 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7efe50042070 con 0x7efe60102430 2024-09-21T00:54:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.916+0000 7efe5cff9640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7efe4806e2b0 0x7efe48070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.916+0000 7efe5cff9640 1 -- 172.21.15.112:0/517609303 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7efe500aeef0 con 0x7efe60102430 2024-09-21T00:54:25.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.916+0000 7efe5effd640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7efe4806e2b0 0x7efe48070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:25.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.916+0000 7efe5effd640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7efe4806e2b0 0x7efe48070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe601989a0 tx=0x7efe54008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:25.920+0000 7efe5cff9640 1 -- 172.21.15.112:0/517609303 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe5007c7f0 con 0x7efe60102430 2024-09-21T00:54:26.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.086+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7efe6019d3e0 con 0x7efe60102430 2024-09-21T00:54:26.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.087+0000 7efe5cff9640 1 -- 172.21.15.112:0/517609303 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) ==== 135+0+0 (secure 0 0 0) 0x7efe500804a0 con 0x7efe60102430 2024-09-21T00:54:26.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7efe4806e2b0 msgr2=0x7efe48070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:26.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7efe4806e2b0 0x7efe48070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe601989a0 tx=0x7efe54008040 comp rx=0 tx=0).stop 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 msgr2=0x7efe601974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe601974f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efe50006010 tx=0x7efe500048f0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 shutdown_connections 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7efe4806e2b0 0x7efe48070770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe60104d60 0x7efe60197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 --2- 172.21.15.112:0/517609303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe60102430 0x7efe601974f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 >> 172.21.15.112:0/517609303 conn(0x7efe600fbff0 msgr2=0x7efe600fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 shutdown_connections 2024-09-21T00:54:26.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:26.090+0000 7efe65ab2640 1 -- 172.21.15.112:0/517609303 wait complete. 2024-09-21T00:54:26.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:26 smithi112 ceph-mon[28078]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T00:54:26.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:26 smithi187 ceph-mon[34997]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T00:54:26.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-21T00:54:27.000 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:54:27.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 -- 172.21.15.112:0/3063435289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc101a80 msgr2=0x7f36dc101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 --2- 172.21.15.112:0/3063435289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc101a80 0x7f36dc101f00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009880 tx=0x7f36d002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 -- 172.21.15.112:0/3063435289 shutdown_connections 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 --2- 172.21.15.112:0/3063435289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc101a80 0x7f36dc101f00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 --2- 172.21.15.112:0/3063435289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36dc100880 0x7f36dc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 -- 172.21.15.112:0/3063435289 >> 172.21.15.112:0/3063435289 conn(0x7f36dc0fc010 msgr2=0x7f36dc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 -- 172.21.15.112:0/3063435289 shutdown_connections 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.493+0000 7f36e0b99640 1 -- 172.21.15.112:0/3063435289 wait complete. 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36e0b99640 1 Processor -- start 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36e0b99640 1 -- start start 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36e0b99640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc100880 0x7f36dc1049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36e0b99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36dc101a80 0x7f36dc103090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36e0b99640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc1096a0 con 0x7f36dc100880 2024-09-21T00:54:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36e0b99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc109520 con 0x7f36dc101a80 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36da59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc100880 0x7f36dc1049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36da59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc100880 0x7f36dc1049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40962/0 (socket says 172.21.15.112:40962) 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36da59c640 1 -- 172.21.15.112:0/1028203531 learned_addr learned my addr 172.21.15.112:0/1028203531 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.494+0000 7f36d9d9b640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36dc101a80 0x7f36dc103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36da59c640 1 -- 172.21.15.112:0/1028203531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36dc101a80 msgr2=0x7f36dc103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36da59c640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36dc101a80 0x7f36dc103090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36da59c640 1 -- 172.21.15.112:0/1028203531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc1035d0 con 0x7f36dc100880 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36d9d9b640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36dc101a80 0x7f36dc103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36da59c640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc100880 0x7f36dc1049d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00c8f0 tx=0x7f36cc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36cb7fe640 1 -- 172.21.15.112:0/1028203531 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36cc004020 con 0x7f36dc100880 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36cb7fe640 1 -- 172.21.15.112:0/1028203531 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36cc007e10 con 0x7f36dc100880 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc1038c0 con 0x7f36dc100880 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36cb7fe640 1 -- 172.21.15.112:0/1028203531 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36cc003e10 con 0x7f36dc100880 2024-09-21T00:54:27.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.495+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36dc103e50 con 0x7f36dc100880 2024-09-21T00:54:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.496+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc100c80 con 0x7f36dc100880 2024-09-21T00:54:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.496+0000 7f36cb7fe640 1 -- 172.21.15.112:0/1028203531 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f36cc0041c0 con 0x7f36dc100880 2024-09-21T00:54:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.497+0000 7f36cb7fe640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f36c406e2b0 0x7f36c4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.497+0000 7f36cb7fe640 1 -- 172.21.15.112:0/1028203531 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f36cc08e350 con 0x7f36dc100880 2024-09-21T00:54:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.497+0000 7f36d9d9b640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f36c406e2b0 0x7f36c4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.497+0000 7f36d9d9b640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f36c406e2b0 0x7f36c4070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36dc104750 tx=0x7f36d0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:27.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.501+0000 7f36cb7fe640 1 -- 172.21.15.112:0/1028203531 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f36cc015330 con 0x7f36dc100880 2024-09-21T00:54:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:54:27.686+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f36dc105080 con 0x7f36c406e2b0 2024-09-21T00:54:28.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:28 smithi187 ceph-mon[34997]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T00:54:28.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:28 smithi112 ceph-mon[28078]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T00:54:29.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:29 smithi187 ceph-mon[34997]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:29.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:29 smithi112 ceph-mon[28078]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:30 smithi187 ceph-mon[34997]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T00:54:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:30 smithi112 ceph-mon[28078]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T00:54:32.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:32 smithi187 ceph-mon[34997]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T00:54:32.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:32 smithi112 ceph-mon[28078]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T00:54:34.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:34 smithi187 ceph-mon[34997]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-21T00:54:34.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:34 smithi112 ceph-mon[28078]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-21T00:54:35.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:35.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:36.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:36 smithi187 ceph-mon[34997]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T00:54:36.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:36 smithi112 ceph-mon[28078]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T00:54:38.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:38 smithi187 ceph-mon[34997]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T00:54:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:38 smithi112 ceph-mon[28078]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T00:54:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:40 smithi187 ceph-mon[34997]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T00:54:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:40 smithi112 ceph-mon[28078]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T00:54:42.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:42 smithi187 ceph-mon[34997]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T00:54:42.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:42 smithi112 ceph-mon[28078]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T00:54:44.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:44 smithi187 ceph-mon[34997]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T00:54:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:44 smithi112 ceph-mon[28078]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T00:54:46.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:46 smithi187 ceph-mon[34997]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:46.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:46 smithi112 ceph-mon[28078]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:48.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:48 smithi112 ceph-mon[28078]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:48.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:48 smithi187 ceph-mon[34997]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:50.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:50 smithi187 ceph-mon[34997]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:50.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:50 smithi112 ceph-mon[28078]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:54:52.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:52 smithi187 ceph-mon[34997]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:52.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:52 smithi112 ceph-mon[28078]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:54.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:54 smithi187 ceph-mon[34997]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:54.660 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:54 smithi112 ceph-mon[28078]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:56.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:56 smithi187 ceph-mon[34997]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:56 smithi112 ceph-mon[28078]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:58.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:54:58 smithi187 ceph-mon[34997]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:54:58.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:54:58 smithi112 ceph-mon[28078]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:00.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:00 smithi187 ceph-mon[34997]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:00.691 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:00 smithi112 ceph-mon[28078]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:01.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.861+0000 7f36cb7fe640 1 -- 172.21.15.112:0/1028203531 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f36dc105080 con 0x7f36c406e2b0 2024-09-21T00:55:01.863 INFO:teuthology.orchestra.run.smithi112.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:55:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f36c406e2b0 msgr2=0x7f36c4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f36c406e2b0 0x7f36c4070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36dc104750 tx=0x7f36d0005a20 comp rx=0 tx=0).stop 2024-09-21T00:55:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc100880 msgr2=0x7f36dc1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc100880 0x7f36dc1049d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00c8f0 tx=0x7f36cc00cdb0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 shutdown_connections 2024-09-21T00:55:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f36c406e2b0 0x7f36c4070770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36dc101a80 0x7f36dc103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 --2- 172.21.15.112:0/1028203531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36dc100880 0x7f36dc1049d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:01.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 >> 172.21.15.112:0/1028203531 conn(0x7f36dc0fc010 msgr2=0x7f36dc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:01.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 shutdown_connections 2024-09-21T00:55:01.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:01.864+0000 7f36e0b99640 1 -- 172.21.15.112:0/1028203531 wait complete. 2024-09-21T00:55:02.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:02 smithi112 ceph-mon[28078]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:02.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:02 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:02.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:02 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:02.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:02 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:55:02.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:02 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:55:02.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:02 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:02.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T00:55:02.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:02 smithi187 ceph-mon[34997]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:02.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:02 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:02.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:02 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:02.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:02 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:55:02.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:02 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:55:02.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:02 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T00:55:03.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:03 smithi112 ceph-mon[28078]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:55:03.556 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:03 smithi112 ceph-mon[28078]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:55:03.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.589+0000 7f9af759e640 1 -- 172.21.15.112:0/4263246887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81006a0 msgr2=0x7f9af8100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.589+0000 7f9af759e640 1 --2- 172.21.15.112:0/4263246887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81006a0 0x7f9af8100aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009880 tx=0x7f9ae802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.589+0000 7f9af759e640 1 -- 172.21.15.112:0/4263246887 shutdown_connections 2024-09-21T00:55:03.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.589+0000 7f9af759e640 1 --2- 172.21.15.112:0/4263246887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af81018a0 0x7f9af8101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.589+0000 7f9af759e640 1 --2- 172.21.15.112:0/4263246887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81006a0 0x7f9af8100aa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.590+0000 7f9af759e640 1 -- 172.21.15.112:0/4263246887 >> 172.21.15.112:0/4263246887 conn(0x7f9af80fbe70 msgr2=0x7f9af80fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:03.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.590+0000 7f9af759e640 1 -- 172.21.15.112:0/4263246887 shutdown_connections 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.590+0000 7f9af759e640 1 -- 172.21.15.112:0/4263246887 wait complete. 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.591+0000 7f9af759e640 1 Processor -- start 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.591+0000 7f9af759e640 1 -- start start 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.591+0000 7f9af759e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af81006a0 0x7f9af8110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.591+0000 7f9af759e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81018a0 0x7f9af8110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.591+0000 7f9af759e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9af81083b0 con 0x7f9af81018a0 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.591+0000 7f9af759e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9af8108230 con 0x7f9af81006a0 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9af659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af81006a0 0x7f9af8110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9aeffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81018a0 0x7f9af8110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9aeffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81018a0 0x7f9af8110a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41576/0 (socket says 172.21.15.112:41576) 2024-09-21T00:55:03.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9aeffff640 1 -- 172.21.15.112:0/675442847 learned_addr learned my addr 172.21.15.112:0/675442847 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:03.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9af659c640 1 -- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81018a0 msgr2=0x7f9af8110a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9af659c640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81018a0 0x7f9af8110a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9af659c640 1 -- 172.21.15.112:0/675442847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af8111110 con 0x7f9af81006a0 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.592+0000 7f9aeffff640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81018a0 0x7f9af8110a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.593+0000 7f9af659c640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af81006a0 0x7f9af8110550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ae802a9c0 tx=0x7f9ae8004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.593+0000 7f9aef7fe640 1 -- 172.21.15.112:0/675442847 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ae8040070 con 0x7f9af81006a0 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.593+0000 7f9aef7fe640 1 -- 172.21.15.112:0/675442847 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ae8004a10 con 0x7f9af81006a0 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.593+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af8113ae0 con 0x7f9af81006a0 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.593+0000 7f9aef7fe640 1 -- 172.21.15.112:0/675442847 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ae8035020 con 0x7f9af81006a0 2024-09-21T00:55:03.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.593+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af8114070 con 0x7f9af81006a0 2024-09-21T00:55:03.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.595+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af8115560 con 0x7f9af81006a0 2024-09-21T00:55:03.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.596+0000 7f9aef7fe640 1 -- 172.21.15.112:0/675442847 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f9ae8043070 con 0x7f9af81006a0 2024-09-21T00:55:03.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.597+0000 7f9aef7fe640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9ae406e2b0 0x7f9ae4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.597+0000 7f9aef7fe640 1 -- 172.21.15.112:0/675442847 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f9ae80af320 con 0x7f9af81006a0 2024-09-21T00:55:03.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.598+0000 7f9aeffff640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9ae406e2b0 0x7f9ae4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.598+0000 7f9aeffff640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9ae406e2b0 0x7f9ae4070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00095f0 tx=0x7f9ae0005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:03.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.605+0000 7f9aef7fe640 1 -- 172.21.15.112:0/675442847 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ae8080950 con 0x7f9af81006a0 2024-09-21T00:55:03.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:03 smithi187 ceph-mon[34997]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:55:03.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:03 smithi187 ceph-mon[34997]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:55:03.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.895+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9af8062630 con 0x7f9ae406e2b0 2024-09-21T00:55:03.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.896+0000 7f9aef7fe640 1 -- 172.21.15.112:0/675442847 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f9af8062630 con 0x7f9ae406e2b0 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9ae406e2b0 msgr2=0x7f9ae4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9ae406e2b0 0x7f9ae4070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00095f0 tx=0x7f9ae0005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af81006a0 msgr2=0x7f9af8110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af81006a0 0x7f9af8110550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ae802a9c0 tx=0x7f9ae8004600 comp rx=0 tx=0).stop 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 shutdown_connections 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9ae406e2b0 0x7f9ae4070770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af81018a0 0x7f9af8110a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 --2- 172.21.15.112:0/675442847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af81006a0 0x7f9af8110550 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 >> 172.21.15.112:0/675442847 conn(0x7f9af80fbe70 msgr2=0x7f9af8104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 shutdown_connections 2024-09-21T00:55:03.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.898+0000 7f9af759e640 1 -- 172.21.15.112:0/675442847 wait complete. 2024-09-21T00:55:03.909 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:55:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 -- 172.21.15.112:0/151636944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6781023d0 msgr2=0x7ff6781047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 --2- 172.21.15.112:0/151636944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6781023d0 0x7ff6781047c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff6740098b0 tx=0x7ff67402a4d0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 -- 172.21.15.112:0/151636944 shutdown_connections 2024-09-21T00:55:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 --2- 172.21.15.112:0/151636944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff678104d00 0x7ff6781070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 --2- 172.21.15.112:0/151636944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6781023d0 0x7ff6781047c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 -- 172.21.15.112:0/151636944 >> 172.21.15.112:0/151636944 conn(0x7ff6780fbff0 msgr2=0x7ff6780fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:03.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 -- 172.21.15.112:0/151636944 shutdown_connections 2024-09-21T00:55:03.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.984+0000 7ff6805d7640 1 -- 172.21.15.112:0/151636944 wait complete. 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff6805d7640 1 Processor -- start 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff6805d7640 1 -- start start 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff6805d7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6781023d0 0x7ff678197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff6805d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678104d00 0x7ff678197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff6805d7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810a7c0 con 0x7ff678104d00 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff6805d7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810a640 con 0x7ff6781023d0 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff67db72640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678104d00 0x7ff678197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff67db72640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678104d00 0x7ff678197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41594/0 (socket says 172.21.15.112:41594) 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff67db72640 1 -- 172.21.15.112:0/750149758 learned_addr learned my addr 172.21.15.112:0/750149758 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.985+0000 7ff67e373640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6781023d0 0x7ff678197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff67db72640 1 -- 172.21.15.112:0/750149758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6781023d0 msgr2=0x7ff678197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff67db72640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6781023d0 0x7ff678197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff67db72640 1 -- 172.21.15.112:0/750149758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6781980e0 con 0x7ff678104d00 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff67db72640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678104d00 0x7ff678197a60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff66800d6c0 tx=0x7ff66800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff66f7fe640 1 -- 172.21.15.112:0/750149758 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff668017070 con 0x7ff678104d00 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff66f7fe640 1 -- 172.21.15.112:0/750149758 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6680054e0 con 0x7ff678104d00 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff66f7fe640 1 -- 172.21.15.112:0/750149758 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff668004b70 con 0x7ff678104d00 2024-09-21T00:55:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67819cb20 con 0x7ff678104d00 2024-09-21T00:55:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.986+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6781004a0 con 0x7ff678104d00 2024-09-21T00:55:03.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.988+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6781027b0 con 0x7ff678104d00 2024-09-21T00:55:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.988+0000 7ff66f7fe640 1 -- 172.21.15.112:0/750149758 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff668009820 con 0x7ff678104d00 2024-09-21T00:55:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.989+0000 7ff66f7fe640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff66406e350 0x7ff664070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.989+0000 7ff66f7fe640 1 -- 172.21.15.112:0/750149758 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7ff66808db50 con 0x7ff678104d00 2024-09-21T00:55:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.989+0000 7ff67e373640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff66406e350 0x7ff664070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.990+0000 7ff67e373640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff66406e350 0x7ff664070810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff674006010 tx=0x7ff6740058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:03.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:03.993+0000 7ff66f7fe640 1 -- 172.21.15.112:0/750149758 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff66805f220 con 0x7ff678104d00 2024-09-21T00:55:04.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.260+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff6781056e0 con 0x7ff66406e350 2024-09-21T00:55:04.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.262+0000 7ff66f7fe640 1 -- 172.21.15.112:0/750149758 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7ff6781056e0 con 0x7ff66406e350 2024-09-21T00:55:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff66406e350 msgr2=0x7ff664070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff66406e350 0x7ff664070810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff674006010 tx=0x7ff6740058d0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678104d00 msgr2=0x7ff678197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678104d00 0x7ff678197a60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff66800d6c0 tx=0x7ff66800db80 comp rx=0 tx=0).stop 2024-09-21T00:55:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 shutdown_connections 2024-09-21T00:55:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7ff66406e350 0x7ff664070810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678104d00 0x7ff678197a60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 --2- 172.21.15.112:0/750149758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6781023d0 0x7ff678197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 >> 172.21.15.112:0/750149758 conn(0x7ff6780fbff0 msgr2=0x7ff6780fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 shutdown_connections 2024-09-21T00:55:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.265+0000 7ff6805d7640 1 -- 172.21.15.112:0/750149758 wait complete. 2024-09-21T00:55:04.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 -- 172.21.15.112:0/3879508706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 msgr2=0x7f6514101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 --2- 172.21.15.112:0/3879508706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 0x7f6514101ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6500009880 tx=0x7f650002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 -- 172.21.15.112:0/3879508706 shutdown_connections 2024-09-21T00:55:04.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 --2- 172.21.15.112:0/3879508706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 0x7f6514101ec0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 --2- 172.21.15.112:0/3879508706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 0x7f6514100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 -- 172.21.15.112:0/3879508706 >> 172.21.15.112:0/3879508706 conn(0x7f65140fbff0 msgr2=0x7f65140fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:04.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 -- 172.21.15.112:0/3879508706 shutdown_connections 2024-09-21T00:55:04.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.349+0000 7f651af12640 1 -- 172.21.15.112:0/3879508706 wait complete. 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f651af12640 1 Processor -- start 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f651af12640 1 -- start start 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f651af12640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 0x7f6514104760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f651af12640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 0x7f6514102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f651af12640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6514109680 con 0x7f6514101a40 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f651af12640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6514109500 con 0x7f6514100840 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f6518cae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 0x7f6514104760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f6518cae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 0x7f6514104760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:53242/0 (socket says 172.21.15.112:53242) 2024-09-21T00:55:04.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f6518cae640 1 -- 172.21.15.112:0/1526267875 learned_addr learned my addr 172.21.15.112:0/1526267875 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.350+0000 7f6513fff640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 0x7f6514102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f6518cae640 1 -- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 msgr2=0x7f6514102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f6518cae640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 0x7f6514102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f6518cae640 1 -- 172.21.15.112:0/1526267875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651419b140 con 0x7f6514100840 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f6513fff640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 0x7f6514102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f6518cae640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 0x7f6514104760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f650800d8d0 tx=0x7f650800dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f6511ffb640 1 -- 172.21.15.112:0/1526267875 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6508017070 con 0x7f6514100840 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6514103360 con 0x7f6514100840 2024-09-21T00:55:04.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.351+0000 7f6511ffb640 1 -- 172.21.15.112:0/1526267875 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f650800be10 con 0x7f6514100840 2024-09-21T00:55:04.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.352+0000 7f6511ffb640 1 -- 172.21.15.112:0/1526267875 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f650800f3c0 con 0x7f6514100840 2024-09-21T00:55:04.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.352+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65141038f0 con 0x7f6514100840 2024-09-21T00:55:04.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.353+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6514109e60 con 0x7f6514100840 2024-09-21T00:55:04.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.354+0000 7f6511ffb640 1 -- 172.21.15.112:0/1526267875 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f650801a070 con 0x7f6514100840 2024-09-21T00:55:04.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.354+0000 7f6511ffb640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f650406e2b0 0x7f6504070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:04.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.354+0000 7f6511ffb640 1 -- 172.21.15.112:0/1526267875 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f650808de00 con 0x7f6514100840 2024-09-21T00:55:04.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.355+0000 7f6513fff640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f650406e2b0 0x7f6504070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:04.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.355+0000 7f6513fff640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f650406e2b0 0x7f6504070770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f65141044e0 tx=0x7f6500005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:04.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.364+0000 7f6511ffb640 1 -- 172.21.15.112:0/1526267875 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f650805b700 con 0x7f6514100840 2024-09-21T00:55:04.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:04 smithi112 ceph-mon[28078]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:04.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.604+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f651406a310 con 0x7f650406e2b0 2024-09-21T00:55:04.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.614+0000 7f6511ffb640 1 -- 172.21.15.112:0/1526267875 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f651406a310 con 0x7f650406e2b0 2024-09-21T00:55:04.616 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:55:04.616 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (4m) 45s ago 6m 25.4M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:55:04.616 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (6m) 45s ago 6m 8250k - 19.1.1-373-g4e45e6b4 164465d2334a f33e5ce7bd79 2024-09-21T00:55:04.616 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (5m) 48s ago 5m 5263k - 19.1.1-373-g4e45e6b4 164465d2334a fcd1455bbc96 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (6m) 45s ago 6m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (5m) 48s ago 5m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (4m) 45s ago 6m 79.2M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (61s) 45s ago 60s 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (68s) 45s ago 67s 11.9M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (64s) 48s ago 64s 15.3M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (58s) 48s ago 58s 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:9283,8765,8443 running (7m) 45s ago 7m 500M - 19.1.1-373-g4e45e6b4 164465d2334a c587f79e18b3 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (5m) 48s ago 5m 440M - 19.1.1-373-g4e45e6b4 164465d2334a 4a701436c860 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (7m) 45s ago 7m 50.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (5m) 48s ago 5m 34.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 45s ago 6m 14.8M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (5m) 48s ago 5m 16.6M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:55:04.617 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (4m) 45s ago 4m 48.2M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:55:04.618 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (3m) 45s ago 3m 57.9M 3946M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:55:04.618 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (3m) 45s ago 3m 44.9M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:55:04.618 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (2m) 48s ago 2m 44.7M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:55:04.618 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (2m) 48s ago 2m 41.9M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:55:04.618 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (2m) 48s ago 2m 49.6M 4970M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:55:04.618 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (4m) 45s ago 6m 55.8M - 2.43.0 a07b618ecd1d 67f455a0b500 2024-09-21T00:55:04.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.617+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f650406e2b0 msgr2=0x7f6504070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.617+0000 7f651af12640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f650406e2b0 0x7f6504070770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f65141044e0 tx=0x7f6500005a20 comp rx=0 tx=0).stop 2024-09-21T00:55:04.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.617+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 msgr2=0x7f6514104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.617+0000 7f651af12640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 0x7f6514104760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f650800d8d0 tx=0x7f650800dd90 comp rx=0 tx=0).stop 2024-09-21T00:55:04.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.618+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 shutdown_connections 2024-09-21T00:55:04.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.618+0000 7f651af12640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f650406e2b0 0x7f6504070770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.618+0000 7f651af12640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6514101a40 0x7f6514102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.618+0000 7f651af12640 1 --2- 172.21.15.112:0/1526267875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6514100840 0x7f6514104760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.618+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 >> 172.21.15.112:0/1526267875 conn(0x7f65140fbff0 msgr2=0x7f6514069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:04.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.618+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 shutdown_connections 2024-09-21T00:55:04.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.618+0000 7f651af12640 1 -- 172.21.15.112:0/1526267875 wait complete. 2024-09-21T00:55:04.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:04 smithi187 ceph-mon[34997]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:04.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/1797735969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c100840 msgr2=0x7f8c9c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/1797735969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c100840 0x7f8c9c100c40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009880 tx=0x7f8c9002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/1797735969 shutdown_connections 2024-09-21T00:55:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/1797735969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c9c101a40 0x7f8c9c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/1797735969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c100840 0x7f8c9c100c40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/1797735969 >> 172.21.15.112:0/1797735969 conn(0x7f8c9c0fbff0 msgr2=0x7f8c9c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/1797735969 shutdown_connections 2024-09-21T00:55:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.704+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/1797735969 wait complete. 2024-09-21T00:55:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8ca2e9d640 1 Processor -- start 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8ca2e9d640 1 -- start start 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8ca2e9d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c9c100840 0x7f8c9c1042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8ca2e9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c101a40 0x7f8c9c104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8ca2e9d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c109660 con 0x7f8c9c101a40 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8ca2e9d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1094e0 con 0x7f8c9c100840 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8c9bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c101a40 0x7f8c9c104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8c9bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c101a40 0x7f8c9c104800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41610/0 (socket says 172.21.15.112:41610) 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8ca0c39640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c9c100840 0x7f8c9c1042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.705+0000 7f8c9bfff640 1 -- 172.21.15.112:0/3163128988 learned_addr learned my addr 172.21.15.112:0/3163128988 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8c9bfff640 1 -- 172.21.15.112:0/3163128988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c9c100840 msgr2=0x7f8c9c1042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8c9bfff640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c9c100840 0x7f8c9c1042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8c9bfff640 1 -- 172.21.15.112:0/3163128988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9c102ce0 con 0x7f8c9c101a40 2024-09-21T00:55:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8ca0c39640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c9c100840 0x7f8c9c1042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8c9bfff640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c101a40 0x7f8c9c104800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800d8d0 tx=0x7f8c8800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8c99ffb640 1 -- 172.21.15.112:0/3163128988 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c88017070 con 0x7f8c9c101a40 2024-09-21T00:55:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9c102fd0 con 0x7f8c9c101a40 2024-09-21T00:55:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9c103560 con 0x7f8c9c101a40 2024-09-21T00:55:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8c99ffb640 1 -- 172.21.15.112:0/3163128988 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c88010460 con 0x7f8c9c101a40 2024-09-21T00:55:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.706+0000 7f8c99ffb640 1 -- 172.21.15.112:0/3163128988 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c8800f5f0 con 0x7f8c9c101a40 2024-09-21T00:55:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.708+0000 7f8c99ffb640 1 -- 172.21.15.112:0/3163128988 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f8c8800f860 con 0x7f8c9c101a40 2024-09-21T00:55:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.708+0000 7f8c99ffb640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8c8c06e360 0x7f8c8c070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.708+0000 7f8c99ffb640 1 -- 172.21.15.112:0/3163128988 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f8c8808dfb0 con 0x7f8c9c101a40 2024-09-21T00:55:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.709+0000 7f8ca0c39640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8c8c06e360 0x7f8c8c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.709+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c800052c0 con 0x7f8c9c101a40 2024-09-21T00:55:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.709+0000 7f8ca0c39640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8c8c06e360 0x7f8c8c070820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c90000c00 tx=0x7f8c90005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:04.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:04.714+0000 7f8c99ffb640 1 -- 172.21.15.112:0/3163128988 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c8805b890 con 0x7f8c9c101a40 2024-09-21T00:55:05.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.034+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8c80005dc0 con 0x7f8c9c101a40 2024-09-21T00:55:05.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.035+0000 7f8c99ffb640 1 -- 172.21.15.112:0/3163128988 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f8c8805f540 con 0x7f8c9c101a40 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:05.037 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:55:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T00:55:05.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:55:05.038 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8c8c06e360 msgr2=0x7f8c8c070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8c8c06e360 0x7f8c8c070820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c90000c00 tx=0x7f8c90005a20 comp rx=0 tx=0).stop 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c101a40 msgr2=0x7f8c9c104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c101a40 0x7f8c9c104800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800d8d0 tx=0x7f8c8800dd90 comp rx=0 tx=0).stop 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 shutdown_connections 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f8c8c06e360 0x7f8c8c070820 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c9c101a40 0x7f8c9c104800 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800d8d0 tx=0x7f8c8800dd90 comp rx=0 tx=0).stop 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 --2- 172.21.15.112:0/3163128988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c9c100840 0x7f8c9c1042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 >> 172.21.15.112:0/3163128988 conn(0x7f8c9c0fbff0 msgr2=0x7f8c9c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:05.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 shutdown_connections 2024-09-21T00:55:05.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.038+0000 7f8ca2e9d640 1 -- 172.21.15.112:0/3163128988 wait complete. 2024-09-21T00:55:05.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.169+0000 7fe333f27640 1 -- 172.21.15.112:0/350362612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 msgr2=0x7fe32c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.169+0000 7fe333f27640 1 --2- 172.21.15.112:0/350362612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c101ec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009880 tx=0x7fe31c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.169+0000 7fe333f27640 1 -- 172.21.15.112:0/350362612 shutdown_connections 2024-09-21T00:55:05.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.169+0000 7fe333f27640 1 --2- 172.21.15.112:0/350362612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c101ec0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.169+0000 7fe333f27640 1 --2- 172.21.15.112:0/350362612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe32c100840 0x7fe32c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.169+0000 7fe333f27640 1 -- 172.21.15.112:0/350362612 >> 172.21.15.112:0/350362612 conn(0x7fe32c0fbff0 msgr2=0x7fe32c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:05.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.170+0000 7fe333f27640 1 -- 172.21.15.112:0/350362612 shutdown_connections 2024-09-21T00:55:05.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.170+0000 7fe333f27640 1 -- 172.21.15.112:0/350362612 wait complete. 2024-09-21T00:55:05.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.170+0000 7fe333f27640 1 Processor -- start 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe333f27640 1 -- start start 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe333f27640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe32c100840 0x7fe32c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe333f27640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c19c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe333f27640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c109680 con 0x7fe32c101a40 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe333f27640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c109500 con 0x7fe32c100840 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe331cc3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe32c100840 0x7fe32c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe3314c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c19c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe3314c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c19c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41616/0 (socket says 172.21.15.112:41616) 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.171+0000 7fe3314c2640 1 -- 172.21.15.112:0/1175375375 learned_addr learned my addr 172.21.15.112:0/1175375375 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.172+0000 7fe331cc3640 1 -- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 msgr2=0x7fe32c19c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.172+0000 7fe331cc3640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c19c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.172+0000 7fe331cc3640 1 -- 172.21.15.112:0/1175375375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c19c7b0 con 0x7fe32c100840 2024-09-21T00:55:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.172+0000 7fe3314c2640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.172+0000 7fe331cc3640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe32c100840 0x7fe32c06a620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe32800e970 tx=0x7fe32800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.173+0000 7fe322ffd640 1 -- 172.21.15.112:0/1175375375 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe32800cac0 con 0x7fe32c100840 2024-09-21T00:55:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.173+0000 7fe333f27640 1 -- 172.21.15.112:0/1175375375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c19caa0 con 0x7fe32c100840 2024-09-21T00:55:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.173+0000 7fe322ffd640 1 -- 172.21.15.112:0/1175375375 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe32800cc60 con 0x7fe32c100840 2024-09-21T00:55:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.173+0000 7fe333f27640 1 -- 172.21.15.112:0/1175375375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c19d030 con 0x7fe32c100840 2024-09-21T00:55:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.173+0000 7fe322ffd640 1 -- 172.21.15.112:0/1175375375 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe328003de0 con 0x7fe32c100840 2024-09-21T00:55:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.174+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe314005290 con 0x7fe32c100840 2024-09-21T00:55:05.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.176+0000 7fe322ffd640 1 -- 172.21.15.112:0/1175375375 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe32801f070 con 0x7fe32c100840 2024-09-21T00:55:05.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.177+0000 7fe322ffd640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe31806e310 0x7fe3180707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:05.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.177+0000 7fe3314c2640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe31806e310 0x7fe3180707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:05.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.178+0000 7fe322ffd640 1 -- 172.21.15.112:0/1175375375 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7fe32808e450 con 0x7fe32c100840 2024-09-21T00:55:05.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.178+0000 7fe3314c2640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe31806e310 0x7fe3180707d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0096c0 tx=0x7fe31c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:05.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.183+0000 7fe322ffd640 1 -- 172.21.15.112:0/1175375375 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe32805bd20 con 0x7fe32c100840 2024-09-21T00:55:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.560+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe314000bc0 con 0x7fe31806e310 2024-09-21T00:55:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.562+0000 7fe322ffd640 1 -- 172.21.15.112:0/1175375375 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fe314000bc0 con 0x7fe31806e310 2024-09-21T00:55:05.563 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:55:05.563 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:55:05.563 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:55:05.564 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:55:05.564 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-21T00:55:05.564 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T00:55:05.564 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 image on host smithi187", 2024-09-21T00:55:05.564 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:55:05.564 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe31806e310 msgr2=0x7fe3180707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe31806e310 0x7fe3180707d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0096c0 tx=0x7fe31c005a20 comp rx=0 tx=0).stop 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe32c100840 msgr2=0x7fe32c06a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe32c100840 0x7fe32c06a620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe32800e970 tx=0x7fe32800ee30 comp rx=0 tx=0).stop 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 shutdown_connections 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fe31806e310 0x7fe3180707d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe32c101a40 0x7fe32c19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 --2- 172.21.15.112:0/1175375375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe32c100840 0x7fe32c06a620 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.564+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 >> 172.21.15.112:0/1175375375 conn(0x7fe32c0fbff0 msgr2=0x7fe32c104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.565+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 shutdown_connections 2024-09-21T00:55:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:05.565+0000 7fe320ff9640 1 -- 172.21.15.112:0/1175375375 wait complete. 2024-09-21T00:55:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:05 smithi187 ceph-mon[34997]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:05 smithi187 ceph-mon[34997]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:05 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3163128988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:55:05.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:05 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:05.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:05 smithi112 ceph-mon[28078]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:05.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:05 smithi112 ceph-mon[28078]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:05.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:05.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:05 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3163128988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:55:05.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:05 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:06 smithi187 ceph-mon[34997]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:06 smithi187 ceph-mon[34997]: Upgrade: Target is version 19.3.0-5120-g18432218 (squid) 2024-09-21T00:55:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:06 smithi187 ceph-mon[34997]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, digests ['quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262'] 2024-09-21T00:55:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:06 smithi187 ceph-mon[34997]: Upgrade: Need to upgrade myself (mgr.smithi112.fzmyfw) 2024-09-21T00:55:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:06 smithi187 ceph-mon[34997]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:06.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:06 smithi187 ceph-mon[34997]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 on smithi187 2024-09-21T00:55:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:06 smithi112 ceph-mon[28078]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:06 smithi112 ceph-mon[28078]: Upgrade: Target is version 19.3.0-5120-g18432218 (squid) 2024-09-21T00:55:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:06 smithi112 ceph-mon[28078]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, digests ['quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262'] 2024-09-21T00:55:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:06 smithi112 ceph-mon[28078]: Upgrade: Need to upgrade myself (mgr.smithi112.fzmyfw) 2024-09-21T00:55:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:06 smithi112 ceph-mon[28078]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:06 smithi112 ceph-mon[28078]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 on smithi187 2024-09-21T00:55:07.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:07 smithi187 ceph-mon[34997]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:07.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:07 smithi112 ceph-mon[28078]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:08.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:08 smithi187 ceph-mon[34997]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:08.749 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:08 smithi112 ceph-mon[28078]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:10.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:10 smithi187 ceph-mon[34997]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:10 smithi112 ceph-mon[28078]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:12.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:12 smithi187 ceph-mon[34997]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:12.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:12 smithi112 ceph-mon[28078]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:14.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:14 smithi187 ceph-mon[34997]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:14 smithi112 ceph-mon[28078]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:16 smithi112 ceph-mon[28078]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:16.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:16 smithi187 ceph-mon[34997]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:18.710 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:18 smithi187 ceph-mon[34997]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:18 smithi112 ceph-mon[28078]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:20 smithi112 ceph-mon[28078]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:20 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:20.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:20 smithi187 ceph-mon[34997]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:20 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:22.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:22 smithi112 ceph-mon[28078]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:22.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:22 smithi187 ceph-mon[34997]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:24.562 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:24 smithi112 ceph-mon[28078]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:24.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:24 smithi187 ceph-mon[34997]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:24.956 INFO:tasks.workunit.client.0.smithi112.stderr:Updating files: 97% (12381/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T00:55:25.895 INFO:tasks.workunit.client.0.smithi112.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T00:55:25.895 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-21T00:55:25.895 INFO:tasks.workunit.client.0.smithi112.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T00:55:25.895 INFO:tasks.workunit.client.0.smithi112.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T00:55:25.895 INFO:tasks.workunit.client.0.smithi112.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T00:55:25.895 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-21T00:55:25.895 INFO:tasks.workunit.client.0.smithi112.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr: git switch -c 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr:Or undo this operation with: 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr: git switch - 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-21T00:55:25.896 INFO:tasks.workunit.client.0.smithi112.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:55:25.900 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T00:55:26.038 INFO:tasks.workunit.client.0.smithi112.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T00:55:26.041 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:55:26.041 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T00:55:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:26 smithi112 ceph-mon[28078]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:26.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:26 smithi187 ceph-mon[34997]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:28.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:28 smithi112 ceph-mon[28078]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:28.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:28 smithi187 ceph-mon[34997]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:29.148 INFO:tasks.workunit.client.1.smithi187.stderr:Updating files: 87% (11062/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T00:55:29.645 INFO:tasks.workunit.client.1.smithi187.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T00:55:29.645 INFO:tasks.workunit.client.1.smithi187.stderr: 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr: 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr: 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr: git switch -c 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr: 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr:Or undo this operation with: 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr: 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr: git switch - 2024-09-21T00:55:29.646 INFO:tasks.workunit.client.1.smithi187.stderr: 2024-09-21T00:55:29.647 INFO:tasks.workunit.client.1.smithi187.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T00:55:29.647 INFO:tasks.workunit.client.1.smithi187.stderr: 2024-09-21T00:55:29.647 INFO:tasks.workunit.client.1.smithi187.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:55:29.654 DEBUG:teuthology.orchestra.run.smithi187:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-21T00:55:29.723 INFO:tasks.workunit.client.1.smithi187.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T00:55:29.726 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T00:55:29.726 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T00:55:30.371 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T00:55:30.452 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T00:55:30.497 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T00:55:30.499 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T00:55:30.499 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T00:55:30.543 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T00:55:30.547 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T00:55:30.547 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-21T00:55:30.604 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-21T00:55:30.606 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T00:55:30.606 DEBUG:teuthology.orchestra.run.smithi187:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-21T00:55:30.675 INFO:tasks.workunit.client.1.smithi187.stderr:+ mkdir -p fsstress 2024-09-21T00:55:30.677 INFO:tasks.workunit.client.1.smithi187.stderr:+ pushd fsstress 2024-09-21T00:55:30.679 INFO:tasks.workunit.client.1.smithi187.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T00:55:30.679 INFO:tasks.workunit.client.1.smithi187.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T00:55:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:30 smithi112 ceph-mon[28078]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:30.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:30 smithi187 ceph-mon[34997]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:31.587 INFO:tasks.workunit.client.1.smithi187.stderr:+ tar xzf ltp-full.tgz 2024-09-21T00:55:32.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:32 smithi112 ceph-mon[28078]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:32.862 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T00:55:32.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:32 smithi187 ceph-mon[34997]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:55:32.995 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T00:55:33.081 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:55:33.083 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:55:33.083 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T00:55:33.181 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:55:33.184 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T00:55:33.184 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T00:55:33.200 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-21T00:55:33.201 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T00:55:33.201 DEBUG:teuthology.orchestra.run.smithi112:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-21T00:55:33.267 INFO:tasks.workunit.client.0.smithi112.stderr:+ mkdir -p fsstress 2024-09-21T00:55:33.269 INFO:tasks.workunit.client.0.smithi112.stderr:+ pushd fsstress 2024-09-21T00:55:33.270 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T00:55:33.270 INFO:tasks.workunit.client.0.smithi112.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T00:55:34.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:34 smithi187 ceph-mon[34997]: pgmap v226: 65 pgs: 65 active+clean; 4.9 MiB data, 175 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 368 KiB/s wr, 1 op/s 2024-09-21T00:55:34.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:34 smithi112 ceph-mon[28078]: pgmap v226: 65 pgs: 65 active+clean; 4.9 MiB data, 175 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 368 KiB/s wr, 1 op/s 2024-09-21T00:55:35.057 INFO:tasks.workunit.client.0.smithi112.stderr:+ tar xzf ltp-full.tgz 2024-09-21T00:55:35.681 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:35 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:35.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.679+0000 7f34ac02b640 1 -- 172.21.15.112:0/123782318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4100d60 msgr2=0x7f34a4101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.679+0000 7f34ac02b640 1 --2- 172.21.15.112:0/123782318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4100d60 0x7f34a4101160 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009880 tx=0x7f34a002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.679+0000 7f34ac02b640 1 -- 172.21.15.112:0/123782318 shutdown_connections 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.679+0000 7f34ac02b640 1 --2- 172.21.15.112:0/123782318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34a4101a80 0x7f34a4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.679+0000 7f34ac02b640 1 --2- 172.21.15.112:0/123782318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4100d60 0x7f34a4101160 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.679+0000 7f34ac02b640 1 -- 172.21.15.112:0/123782318 >> 172.21.15.112:0/123782318 conn(0x7f34a40fb750 msgr2=0x7f34a40fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.680+0000 7f34ac02b640 1 -- 172.21.15.112:0/123782318 shutdown_connections 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.680+0000 7f34ac02b640 1 -- 172.21.15.112:0/123782318 wait complete. 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.680+0000 7f34ac02b640 1 Processor -- start 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.680+0000 7f34ac02b640 1 -- start start 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34ac02b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34a4100d60 0x7f34a41961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34ac02b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4101a80 0x7f34a4196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34ac02b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4109690 con 0x7f34a4101a80 2024-09-21T00:55:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34ac02b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4109510 con 0x7f34a4100d60 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a95c6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4101a80 0x7f34a4196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a95c6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4101a80 0x7f34a4196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52018/0 (socket says 172.21.15.112:52018) 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a95c6640 1 -- 172.21.15.112:0/3786502058 learned_addr learned my addr 172.21.15.112:0/3786502058 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a9dc7640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34a4100d60 0x7f34a41961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a9dc7640 1 -- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4101a80 msgr2=0x7f34a4196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a9dc7640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4101a80 0x7f34a4196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a9dc7640 1 -- 172.21.15.112:0/3786502058 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a4196db0 con 0x7f34a4100d60 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.681+0000 7f34a95c6640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4101a80 0x7f34a4196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.682+0000 7f34a9dc7640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34a4100d60 0x7f34a41961f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009850 tx=0x7f34a0032c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.682+0000 7f349affd640 1 -- 172.21.15.112:0/3786502058 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34a0046070 con 0x7f34a4100d60 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.682+0000 7f349affd640 1 -- 172.21.15.112:0/3786502058 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34a00046c0 con 0x7f34a4100d60 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.682+0000 7f349affd640 1 -- 172.21.15.112:0/3786502058 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34a0035050 con 0x7f34a4100d60 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.682+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a40ff8c0 con 0x7f34a4100d60 2024-09-21T00:55:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.682+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a40ffe50 con 0x7f34a4100d60 2024-09-21T00:55:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.683+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a4100170 con 0x7f34a4100d60 2024-09-21T00:55:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.684+0000 7f349affd640 1 -- 172.21.15.112:0/3786502058 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f34a0064b50 con 0x7f34a4100d60 2024-09-21T00:55:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.684+0000 7f349affd640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f349006e2b0 0x7f3490070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.684+0000 7f349affd640 1 -- 172.21.15.112:0/3786502058 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f34a003e070 con 0x7f34a4100d60 2024-09-21T00:55:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.684+0000 7f34a95c6640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f349006e2b0 0x7f3490070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.685+0000 7f34a95c6640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f349006e2b0 0x7f3490070770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f34a41976a0 tx=0x7f3494005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.689+0000 7f349affd640 1 -- 172.21.15.112:0/3786502058 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34a00815d0 con 0x7f34a4100d60 2024-09-21T00:55:35.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:35 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:35.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.931+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f34a41064a0 con 0x7f349006e2b0 2024-09-21T00:55:35.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.933+0000 7f349affd640 1 -- 172.21.15.112:0/3786502058 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f34a41064a0 con 0x7f349006e2b0 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f349006e2b0 msgr2=0x7f3490070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f349006e2b0 0x7f3490070770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f34a41976a0 tx=0x7f3494005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34a4100d60 msgr2=0x7f34a41961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34a4100d60 0x7f34a41961f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009850 tx=0x7f34a0032c80 comp rx=0 tx=0).stop 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 shutdown_connections 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f349006e2b0 0x7f3490070770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34a4101a80 0x7f34a4196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 --2- 172.21.15.112:0/3786502058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34a4100d60 0x7f34a41961f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 >> 172.21.15.112:0/3786502058 conn(0x7f34a40fb750 msgr2=0x7f34a4104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 shutdown_connections 2024-09-21T00:55:35.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:35.936+0000 7f34ac02b640 1 -- 172.21.15.112:0/3786502058 wait complete. 2024-09-21T00:55:35.948 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:55:36.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.044+0000 7f3484a17640 1 -- 172.21.15.112:0/2446117705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800ffc00 msgr2=0x7f3480100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.044+0000 7f3484a17640 1 --2- 172.21.15.112:0/2446117705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800ffc00 0x7f3480100000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3470009880 tx=0x7f347002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.045+0000 7f3484a17640 1 -- 172.21.15.112:0/2446117705 shutdown_connections 2024-09-21T00:55:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.045+0000 7f3484a17640 1 --2- 172.21.15.112:0/2446117705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3480102be0 0x7f3480103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.045+0000 7f3484a17640 1 --2- 172.21.15.112:0/2446117705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800ffc00 0x7f3480100000 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.045+0000 7f3484a17640 1 -- 172.21.15.112:0/2446117705 >> 172.21.15.112:0/2446117705 conn(0x7f34800fb750 msgr2=0x7f34800fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.045+0000 7f3484a17640 1 -- 172.21.15.112:0/2446117705 shutdown_connections 2024-09-21T00:55:36.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.045+0000 7f3484a17640 1 -- 172.21.15.112:0/2446117705 wait complete. 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.045+0000 7f3484a17640 1 Processor -- start 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f3484a17640 1 -- start start 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f3484a17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34800ffc00 0x7f3480197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f3484a17640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102be0 0x7f34801979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f3484a17640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f348010a760 con 0x7f3480102be0 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f3484a17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f348010a5e0 con 0x7f34800ffc00 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f347e59c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34800ffc00 0x7f3480197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f347e59c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34800ffc00 0x7f3480197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:45360/0 (socket says 172.21.15.112:45360) 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f347e59c640 1 -- 172.21.15.112:0/744498810 learned_addr learned my addr 172.21.15.112:0/744498810 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f347dd9b640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102be0 0x7f34801979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.046+0000 7f347e59c640 1 -- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102be0 msgr2=0x7f34801979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f347e59c640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102be0 0x7f34801979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f347e59c640 1 -- 172.21.15.112:0/744498810 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3480198040 con 0x7f34800ffc00 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f347dd9b640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102be0 0x7f34801979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f347e59c640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34800ffc00 0x7f3480197480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3470006010 tx=0x7f34700045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f346f7fe640 1 -- 172.21.15.112:0/744498810 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f347003f070 con 0x7f34800ffc00 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f346f7fe640 1 -- 172.21.15.112:0/744498810 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3470004a50 con 0x7f34800ffc00 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f346f7fe640 1 -- 172.21.15.112:0/744498810 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3470035030 con 0x7f34800ffc00 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348019ca20 con 0x7f34800ffc00 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.047+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348019cfb0 con 0x7f34800ffc00 2024-09-21T00:55:36.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.049+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3480100000 con 0x7f34800ffc00 2024-09-21T00:55:36.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.050+0000 7f346f7fe640 1 -- 172.21.15.112:0/744498810 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f3470042070 con 0x7f34800ffc00 2024-09-21T00:55:36.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.050+0000 7f346f7fe640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f346806e2b0 0x7f3468070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.050+0000 7f346f7fe640 1 -- 172.21.15.112:0/744498810 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f34700aed10 con 0x7f34800ffc00 2024-09-21T00:55:36.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.050+0000 7f347dd9b640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f346806e2b0 0x7f3468070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.051+0000 7f347dd9b640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f346806e2b0 0x7f3468070770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3480198930 tx=0x7f347400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:36.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.056+0000 7f346f7fe640 1 -- 172.21.15.112:0/744498810 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3470004c00 con 0x7f34800ffc00 2024-09-21T00:55:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.349+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3480062630 con 0x7f346806e2b0 2024-09-21T00:55:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.351+0000 7f346f7fe640 1 -- 172.21.15.112:0/744498810 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f3480062630 con 0x7f346806e2b0 2024-09-21T00:55:36.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f346806e2b0 msgr2=0x7f3468070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f346806e2b0 0x7f3468070770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3480198930 tx=0x7f347400b390 comp rx=0 tx=0).stop 2024-09-21T00:55:36.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34800ffc00 msgr2=0x7f3480197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34800ffc00 0x7f3480197480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3470006010 tx=0x7f34700045e0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 shutdown_connections 2024-09-21T00:55:36.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f346806e2b0 0x7f3468070770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102be0 0x7f34801979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.353+0000 7f3484a17640 1 --2- 172.21.15.112:0/744498810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34800ffc00 0x7f3480197480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.354+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 >> 172.21.15.112:0/744498810 conn(0x7f34800fb750 msgr2=0x7f3480106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:36.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.354+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 shutdown_connections 2024-09-21T00:55:36.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.354+0000 7f3484a17640 1 -- 172.21.15.112:0/744498810 wait complete. 2024-09-21T00:55:36.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1205030610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc100a90 msgr2=0x7f9dbc100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1205030610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc100a90 0x7f9dbc100f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009880 tx=0x7f9dac02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1205030610 shutdown_connections 2024-09-21T00:55:36.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1205030610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc100a90 0x7f9dbc100f10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1205030610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dbc101ec0 0x7f9dbc1022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1205030610 >> 172.21.15.112:0/1205030610 conn(0x7f9dbc0fb750 msgr2=0x7f9dbc0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:36.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1205030610 shutdown_connections 2024-09-21T00:55:36.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.472+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1205030610 wait complete. 2024-09-21T00:55:36.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.473+0000 7f9dc2d19640 1 Processor -- start 2024-09-21T00:55:36.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.473+0000 7f9dc2d19640 1 -- start start 2024-09-21T00:55:36.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9dc2d19640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dbc100a90 0x7f9dbc1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9dc2d19640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc101ec0 0x7f9dbc196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9dc2d19640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc109720 con 0x7f9dbc101ec0 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9dc2d19640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc1095a0 con 0x7f9dbc100a90 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc101ec0 0x7f9dbc196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc101ec0 0x7f9dbc196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52048/0 (socket says 172.21.15.112:52048) 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9db3fff640 1 -- 172.21.15.112:0/1220462439 learned_addr learned my addr 172.21.15.112:0/1220462439 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.474+0000 7f9dc0ab5640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dbc100a90 0x7f9dbc1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.475+0000 7f9db3fff640 1 -- 172.21.15.112:0/1220462439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dbc100a90 msgr2=0x7f9dbc1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.475+0000 7f9db3fff640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dbc100a90 0x7f9dbc1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.475+0000 7f9db3fff640 1 -- 172.21.15.112:0/1220462439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc196f90 con 0x7f9dbc101ec0 2024-09-21T00:55:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.475+0000 7f9db3fff640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc101ec0 0x7f9dbc196910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9dac006010 tx=0x7f9dac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.476+0000 7f9db1ffb640 1 -- 172.21.15.112:0/1220462439 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dac035070 con 0x7f9dbc101ec0 2024-09-21T00:55:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.476+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dbc0ff980 con 0x7f9dbc101ec0 2024-09-21T00:55:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.476+0000 7f9db1ffb640 1 -- 172.21.15.112:0/1220462439 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dac0035f0 con 0x7f9dbc101ec0 2024-09-21T00:55:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.476+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dbc0fff10 con 0x7f9dbc101ec0 2024-09-21T00:55:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.476+0000 7f9db1ffb640 1 -- 172.21.15.112:0/1220462439 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dac0316d0 con 0x7f9dbc101ec0 2024-09-21T00:55:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.477+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dbc100f10 con 0x7f9dbc101ec0 2024-09-21T00:55:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.478+0000 7f9db1ffb640 1 -- 172.21.15.112:0/1220462439 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f9dac0037a0 con 0x7f9dbc101ec0 2024-09-21T00:55:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.479+0000 7f9db1ffb640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9da406e310 0x7f9da40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.479+0000 7f9db1ffb640 1 -- 172.21.15.112:0/1220462439 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f9dac03e070 con 0x7f9dbc101ec0 2024-09-21T00:55:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.480+0000 7f9dc0ab5640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9da406e310 0x7f9da40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.480+0000 7f9dc0ab5640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9da406e310 0x7f9da40707d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009bd0 tx=0x7f9db8005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:36.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.487+0000 7f9db1ffb640 1 -- 172.21.15.112:0/1220462439 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9dac07dda0 con 0x7f9dbc101ec0 2024-09-21T00:55:36.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:36 smithi112 ceph-mon[28078]: pgmap v227: 65 pgs: 65 active+clean; 9.7 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 781 KiB/s wr, 14 op/s 2024-09-21T00:55:36.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.764+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9dbc100280 con 0x7f9da406e310 2024-09-21T00:55:36.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.782+0000 7f9db1ffb640 1 -- 172.21.15.112:0/1220462439 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f9dbc100280 con 0x7f9da406e310 2024-09-21T00:55:36.783 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 77s ago 6m 25.4M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (7m) 77s ago 7m 8250k - 19.1.1-373-g4e45e6b4 164465d2334a f33e5ce7bd79 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (6m) 80s ago 6m 5263k - 19.1.1-373-g4e45e6b4 164465d2334a fcd1455bbc96 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (7m) 77s ago 7m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (6m) 80s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (5m) 77s ago 6m 79.2M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (93s) 77s ago 93s 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (100s) 77s ago 99s 11.9M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (97s) 80s ago 96s 15.3M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (90s) 80s ago 90s 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:9283,8765,8443 running (8m) 77s ago 8m 500M - 19.1.1-373-g4e45e6b4 164465d2334a c587f79e18b3 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (6m) 80s ago 6m 440M - 19.1.1-373-g4e45e6b4 164465d2334a 4a701436c860 2024-09-21T00:55:36.784 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (8m) 77s ago 8m 50.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (6m) 80s ago 6m 34.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 77s ago 7m 14.8M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (6m) 80s ago 6m 16.6M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (4m) 77s ago 4m 48.2M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (4m) 77s ago 4m 57.9M 3946M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (3m) 77s ago 3m 44.9M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (3m) 80s ago 3m 44.7M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (3m) 80s ago 3m 41.9M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (2m) 80s ago 2m 49.6M 4970M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:55:36.785 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 77s ago 6m 55.8M - 2.43.0 a07b618ecd1d 67f455a0b500 2024-09-21T00:55:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9da406e310 msgr2=0x7f9da40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9da406e310 0x7f9da40707d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009bd0 tx=0x7f9db8005f90 comp rx=0 tx=0).stop 2024-09-21T00:55:36.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc101ec0 msgr2=0x7f9dbc196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc101ec0 0x7f9dbc196910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9dac006010 tx=0x7f9dac0045e0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 shutdown_connections 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f9da406e310 0x7f9da40707d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dbc101ec0 0x7f9dbc196910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 --2- 172.21.15.112:0/1220462439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dbc100a90 0x7f9dbc1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 >> 172.21.15.112:0/1220462439 conn(0x7f9dbc0fb750 msgr2=0x7f9dbc105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 shutdown_connections 2024-09-21T00:55:36.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.785+0000 7f9dc2d19640 1 -- 172.21.15.112:0/1220462439 wait complete. 2024-09-21T00:55:36.861 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:36 smithi187 ceph-mon[34997]: pgmap v227: 65 pgs: 65 active+clean; 9.7 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 781 KiB/s wr, 14 op/s 2024-09-21T00:55:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 -- 172.21.15.112:0/3663352556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 msgr2=0x7f8234101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 --2- 172.21.15.112:0/3663352556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234101d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8224009880 tx=0x7f822402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 -- 172.21.15.112:0/3663352556 shutdown_connections 2024-09-21T00:55:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 --2- 172.21.15.112:0/3663352556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8234102b60 0x7f8234102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 --2- 172.21.15.112:0/3663352556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234101d60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 -- 172.21.15.112:0/3663352556 >> 172.21.15.112:0/3663352556 conn(0x7f82340fd0f0 msgr2=0x7f82340ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 -- 172.21.15.112:0/3663352556 shutdown_connections 2024-09-21T00:55:36.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.891+0000 7f823a855640 1 -- 172.21.15.112:0/3663352556 wait complete. 2024-09-21T00:55:36.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.892+0000 7f823a855640 1 Processor -- start 2024-09-21T00:55:36.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.892+0000 7f823a855640 1 -- start start 2024-09-21T00:55:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f823a855640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f8233fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f8233fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52078/0 (socket says 172.21.15.112:52078) 2024-09-21T00:55:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f823a855640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8234102b60 0x7f82341979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f8233fff640 1 -- 172.21.15.112:0/705721610 learned_addr learned my addr 172.21.15.112:0/705721610 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f823410a7a0 con 0x7f8234101960 2024-09-21T00:55:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f823410a620 con 0x7f8234102b60 2024-09-21T00:55:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.893+0000 7f82337fe640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8234102b60 0x7f82341979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f82337fe640 1 -- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 msgr2=0x7f8234197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f82337fe640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f82337fe640 1 -- 172.21.15.112:0/705721610 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8234198050 con 0x7f8234102b60 2024-09-21T00:55:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f8233fff640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:55:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f82337fe640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8234102b60 0x7f82341979d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f822800e970 tx=0x7f822800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f82317fa640 1 -- 172.21.15.112:0/705721610 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f822800cac0 con 0x7f8234102b60 2024-09-21T00:55:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f82317fa640 1 -- 172.21.15.112:0/705721610 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f822800cc60 con 0x7f8234102b60 2024-09-21T00:55:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823419ca90 con 0x7f8234102b60 2024-09-21T00:55:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f82317fa640 1 -- 172.21.15.112:0/705721610 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82280047a0 con 0x7f8234102b60 2024-09-21T00:55:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.894+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823419d020 con 0x7f8234102b60 2024-09-21T00:55:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.896+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8234101d60 con 0x7f8234102b60 2024-09-21T00:55:36.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.897+0000 7f82317fa640 1 -- 172.21.15.112:0/705721610 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f8228004030 con 0x7f8234102b60 2024-09-21T00:55:36.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.897+0000 7f82317fa640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f821c06e2b0 0x7f821c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:36.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.897+0000 7f82317fa640 1 -- 172.21.15.112:0/705721610 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7f822808e660 con 0x7f8234102b60 2024-09-21T00:55:36.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.897+0000 7f8233fff640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f821c06e2b0 0x7f821c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:36.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.898+0000 7f8233fff640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f821c06e2b0 0x7f821c070770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82240096c0 tx=0x7f82240058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:36.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:36.901+0000 7f82317fa640 1 -- 172.21.15.112:0/705721610 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f822805bf60 con 0x7f8234102b60 2024-09-21T00:55:37.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.225+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f823419d880 con 0x7f8234102b60 2024-09-21T00:55:37.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.226+0000 7f82317fa640 1 -- 172.21.15.112:0/705721610 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f822805fc10 con 0x7f8234102b60 2024-09-21T00:55:37.227 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:55:37.227 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:55:37.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:55:37.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:55:37.228 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:55:37.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f821c06e2b0 msgr2=0x7f821c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:37.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f821c06e2b0 0x7f821c070770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82240096c0 tx=0x7f82240058d0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8234102b60 msgr2=0x7f82341979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:37.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8234102b60 0x7f82341979d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f822800e970 tx=0x7f822800ee30 comp rx=0 tx=0).stop 2024-09-21T00:55:37.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 shutdown_connections 2024-09-21T00:55:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7f821c06e2b0 0x7f821c070770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8234102b60 0x7f82341979d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 --2- 172.21.15.112:0/705721610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8234101960 0x7f8234197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 >> 172.21.15.112:0/705721610 conn(0x7f82340fd0f0 msgr2=0x7f82340ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 shutdown_connections 2024-09-21T00:55:37.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.228+0000 7f823a855640 1 -- 172.21.15.112:0/705721610 wait complete. 2024-09-21T00:55:37.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.327+0000 7fd488012640 1 -- 172.21.15.112:0/752649064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 msgr2=0x7fd480101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.327+0000 7fd488012640 1 --2- 172.21.15.112:0/752649064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 0x7fd480101ec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd470009880 tx=0x7fd47002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.327+0000 7fd488012640 1 -- 172.21.15.112:0/752649064 shutdown_connections 2024-09-21T00:55:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.327+0000 7fd488012640 1 --2- 172.21.15.112:0/752649064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 0x7fd480101ec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.327+0000 7fd488012640 1 --2- 172.21.15.112:0/752649064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 0x7fd480100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.327+0000 7fd488012640 1 -- 172.21.15.112:0/752649064 >> 172.21.15.112:0/752649064 conn(0x7fd4800fbff0 msgr2=0x7fd4800fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 -- 172.21.15.112:0/752649064 shutdown_connections 2024-09-21T00:55:37.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 -- 172.21.15.112:0/752649064 wait complete. 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 Processor -- start 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 -- start start 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 0x7fd480196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 0x7fd4801968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd480109660 con 0x7fd480101a40 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.328+0000 7fd488012640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd4801094e0 con 0x7fd480100840 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd485dae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 0x7fd480196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd485dae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 0x7fd480196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:45402/0 (socket says 172.21.15.112:45402) 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd485dae640 1 -- 172.21.15.112:0/4133982634 learned_addr learned my addr 172.21.15.112:0/4133982634 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:55:37.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd4855ad640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 0x7fd4801968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd485dae640 1 -- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 msgr2=0x7fd4801968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd485dae640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 0x7fd4801968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd485dae640 1 -- 172.21.15.112:0/4133982634 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd480196f30 con 0x7fd480100840 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd485dae640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 0x7fd480196370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00e940 tx=0x7fd47c00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd476ffd640 1 -- 172.21.15.112:0/4133982634 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd47c00cac0 con 0x7fd480100840 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.329+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48019b970 con 0x7fd480100840 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.330+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48019bed0 con 0x7fd480100840 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.330+0000 7fd476ffd640 1 -- 172.21.15.112:0/4133982634 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd47c00cc60 con 0x7fd480100840 2024-09-21T00:55:37.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.330+0000 7fd476ffd640 1 -- 172.21.15.112:0/4133982634 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd47c003de0 con 0x7fd480100840 2024-09-21T00:55:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.331+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4640052c0 con 0x7fd480100840 2024-09-21T00:55:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.331+0000 7fd476ffd640 1 -- 172.21.15.112:0/4133982634 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd47c004020 con 0x7fd480100840 2024-09-21T00:55:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.332+0000 7fd476ffd640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd46c070520 0x7fd46c0729e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:37.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.332+0000 7fd476ffd640 1 -- 172.21.15.112:0/4133982634 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5554+0+0 (secure 0 0 0) 0x7fd47c08e7a0 con 0x7fd480100840 2024-09-21T00:55:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.332+0000 7fd4855ad640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd46c070520 0x7fd46c0729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:37.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.333+0000 7fd4855ad640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd46c070520 0x7fd46c0729e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd470000c00 tx=0x7fd4700058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:37.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.336+0000 7fd476ffd640 1 -- 172.21.15.112:0/4133982634 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd47c05c0c0 con 0x7fd480100840 2024-09-21T00:55:37.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:37 smithi112 ceph-mon[28078]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:37.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:37 smithi112 ceph-mon[28078]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:37.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:37 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/705721610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:55:37.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.632+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 --> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd464000bf0 con 0x7fd46c070520 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.633+0000 7fd476ffd640 1 -- 172.21.15.112:0/4133982634 <== mgr.14217 v2:172.21.15.112:6800/1149588560 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fd464000bf0 con 0x7fd46c070520 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 image on host smithi187", 2024-09-21T00:55:37.635 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:55:37.636 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd46c070520 msgr2=0x7fd46c0729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd46c070520 0x7fd46c0729e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd470000c00 tx=0x7fd4700058d0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 msgr2=0x7fd480196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 0x7fd480196370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00e940 tx=0x7fd47c00ee00 comp rx=0 tx=0).stop 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 shutdown_connections 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:6800/1149588560,v1:172.21.15.112:6801/1149588560] conn(0x7fd46c070520 0x7fd46c0729e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd480101a40 0x7fd4801968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 --2- 172.21.15.112:0/4133982634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd480100840 0x7fd480196370 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 >> 172.21.15.112:0/4133982634 conn(0x7fd4800fbff0 msgr2=0x7fd480104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 shutdown_connections 2024-09-21T00:55:37.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:55:37.636+0000 7fd488012640 1 -- 172.21.15.112:0/4133982634 wait complete. 2024-09-21T00:55:37.864 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:37 smithi187 ceph-mon[34997]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:37.864 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:37 smithi187 ceph-mon[34997]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:37.864 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:37 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/705721610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:55:38.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:38 smithi187 ceph-mon[34997]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:38.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:38 smithi187 ceph-mon[34997]: pgmap v228: 65 pgs: 65 active+clean; 25 MiB data, 242 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 54 op/s 2024-09-21T00:55:38.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:38 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:38.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:38 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:55:38.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:38 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:55:38.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:38 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:55:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:38 smithi112 ceph-mon[28078]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:38 smithi112 ceph-mon[28078]: pgmap v228: 65 pgs: 65 active+clean; 25 MiB data, 242 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 54 op/s 2024-09-21T00:55:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:38 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:38 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:55:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:38 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:55:38.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:38 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:55:39.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:39 smithi187 ceph-mon[34997]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:39.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:39 smithi187 ceph-mon[34997]: Upgrade: Updating mgr.smithi187.hpbgni 2024-09-21T00:55:39.571 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:39 smithi187 ceph-mon[34997]: Deploying daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:55:39.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:39 smithi112 ceph-mon[28078]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:39.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:39 smithi112 ceph-mon[28078]: Upgrade: Updating mgr.smithi187.hpbgni 2024-09-21T00:55:39.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:39 smithi112 ceph-mon[28078]: Deploying daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:55:40.530 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:40 smithi187 ceph-mon[34997]: pgmap v229: 65 pgs: 65 active+clean; 30 MiB data, 264 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 79 op/s 2024-09-21T00:55:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:40 smithi112 ceph-mon[28078]: pgmap v229: 65 pgs: 65 active+clean; 30 MiB data, 264 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 79 op/s 2024-09-21T00:55:42.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:42 smithi112 ceph-mon[28078]: pgmap v230: 65 pgs: 65 active+clean; 31 MiB data, 268 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 87 op/s 2024-09-21T00:55:42.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:42.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:42.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:42 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:42.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:42 smithi187 ceph-mon[34997]: pgmap v230: 65 pgs: 65 active+clean; 31 MiB data, 268 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 87 op/s 2024-09-21T00:55:42.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:42.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:42.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:42 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:55:44.546 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:44 smithi187 ceph-mon[34997]: pgmap v231: 65 pgs: 65 active+clean; 41 MiB data, 313 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 130 op/s 2024-09-21T00:55:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:44 smithi112 ceph-mon[28078]: pgmap v231: 65 pgs: 65 active+clean; 41 MiB data, 313 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 130 op/s 2024-09-21T00:55:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:46 smithi112 ceph-mon[28078]: pgmap v232: 65 pgs: 65 active+clean; 46 MiB data, 336 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 158 op/s 2024-09-21T00:55:46.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:46 smithi187 ceph-mon[34997]: pgmap v232: 65 pgs: 65 active+clean; 46 MiB data, 336 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 158 op/s 2024-09-21T00:55:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:48 smithi187 ceph-mon[34997]: pgmap v233: 65 pgs: 65 active+clean; 64 MiB data, 374 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 184 op/s 2024-09-21T00:55:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:48 smithi187 ceph-mon[34997]: Standby manager daemon smithi187.hpbgni restarted 2024-09-21T00:55:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:48 smithi187 ceph-mon[34997]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:55:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:48 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:55:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:48 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:55:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:48 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:55:48.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:48 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:55:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:48 smithi112 ceph-mon[28078]: pgmap v233: 65 pgs: 65 active+clean; 64 MiB data, 374 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 184 op/s 2024-09-21T00:55:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:48 smithi112 ceph-mon[28078]: Standby manager daemon smithi187.hpbgni restarted 2024-09-21T00:55:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:48 smithi112 ceph-mon[28078]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:55:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:48 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:55:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:48 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:55:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:48 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:55:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:48 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:55:49.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:49 smithi187 ceph-mon[34997]: mgrmap e20: smithi112.fzmyfw(active, since 6m), standbys: smithi187.hpbgni 2024-09-21T00:55:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:49 smithi112 ceph-mon[28078]: mgrmap e20: smithi112.fzmyfw(active, since 6m), standbys: smithi187.hpbgni 2024-09-21T00:55:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:50 smithi112 ceph-mon[28078]: pgmap v234: 65 pgs: 65 active+clean; 70 MiB data, 404 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 169 op/s 2024-09-21T00:55:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:50 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:50 smithi187 ceph-mon[34997]: pgmap v234: 65 pgs: 65 active+clean; 70 MiB data, 404 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 169 op/s 2024-09-21T00:55:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:50 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:55:51.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:51.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:51 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:51.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:51.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:51 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:55:52.501 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:52 smithi187 ceph-mon[34997]: pgmap v235: 65 pgs: 65 active+clean; 73 MiB data, 412 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 158 op/s 2024-09-21T00:55:52.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:52 smithi112 ceph-mon[28078]: pgmap v235: 65 pgs: 65 active+clean; 73 MiB data, 412 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 158 op/s 2024-09-21T00:55:54.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:54 smithi187 ceph-mon[34997]: pgmap v236: 65 pgs: 65 active+clean; 92 MiB data, 478 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.3 MiB/s wr, 205 op/s 2024-09-21T00:55:54.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:54 smithi112 ceph-mon[28078]: pgmap v236: 65 pgs: 65 active+clean; 92 MiB data, 478 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.3 MiB/s wr, 205 op/s 2024-09-21T00:55:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:56 smithi112 ceph-mon[28078]: pgmap v237: 65 pgs: 65 active+clean; 98 MiB data, 495 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 188 op/s 2024-09-21T00:55:56.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:56 smithi187 ceph-mon[34997]: pgmap v237: 65 pgs: 65 active+clean; 98 MiB data, 495 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 188 op/s 2024-09-21T00:55:58.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:58 smithi112 ceph-mon[28078]: pgmap v238: 65 pgs: 65 active+clean; 107 MiB data, 530 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.2 MiB/s wr, 192 op/s 2024-09-21T00:55:58.826 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:58 smithi187 ceph-mon[34997]: pgmap v238: 65 pgs: 65 active+clean; 107 MiB data, 530 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.2 MiB/s wr, 192 op/s 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr fail", "who": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: Activating manager daemon smithi187.hpbgni 2024-09-21T00:56:00.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "mgr fail", "who": "smithi112.fzmyfw"}]': finished 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: mgrmap e21: smithi187.hpbgni(active, starting, since 0.00997867s) 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr metadata", "who": "smithi187.hpbgni", "id": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:56:00.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:56:00.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:56:00.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:56:00.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:56:00.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:55:59 smithi187 ceph-mon[34997]: Manager daemon smithi187.hpbgni is now available 2024-09-21T00:56:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:56:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:56:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr fail", "who": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: Activating manager daemon smithi187.hpbgni 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.14217 172.21.15.112:0/890363605' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "mgr fail", "who": "smithi112.fzmyfw"}]': finished 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: mgrmap e21: smithi187.hpbgni(active, starting, since 0.00997867s) 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr metadata", "who": "smithi187.hpbgni", "id": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:56:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:56:00.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:55:59 smithi112 ceph-mon[28078]: Manager daemon smithi187.hpbgni is now available 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: mgrmap e22: smithi187.hpbgni(active, since 1.01028s) 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: pgmap v3: 65 pgs: 65 active+clean; 117 MiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:56:01.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/trash_purge_schedule"}]: dispatch 2024-09-21T00:56:01.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:01 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/trash_purge_schedule"}]: dispatch 2024-09-21T00:56:01.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: mgrmap e22: smithi187.hpbgni(active, since 1.01028s) 2024-09-21T00:56:01.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: pgmap v3: 65 pgs: 65 active+clean; 117 MiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:56:01.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:01.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/trash_purge_schedule"}]: dispatch 2024-09-21T00:56:01.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:01 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi187.hpbgni/trash_purge_schedule"}]: dispatch 2024-09-21T00:56:02.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:02 smithi187 ceph-mon[34997]: Deploying cephadm binary to smithi187 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:02 smithi187 ceph-mon[34997]: Deploying cephadm binary to smithi112 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:02 smithi187 ceph-mon[34997]: pgmap v4: 65 pgs: 65 active+clean; 117 MiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:02 smithi187 ceph-mon[34997]: [21/Sep/2024:00:56:01] ENGINE Bus STARTING 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:02 smithi187 ceph-mon[34997]: [21/Sep/2024:00:56:01] ENGINE Serving on https://172.21.15.187:7150 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:02 smithi187 ceph-mon[34997]: [21/Sep/2024:00:56:01] ENGINE Error in HTTPServer.serve 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Traceback (most recent call last): 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._run(expiration_interval) 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:56:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: s = self.context.wrap_socket( 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: return self.sslsocket_class._create( 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self.do_handshake() 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._sslobj.do_handshake() 2024-09-21T00:56:02.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:56:02.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:02 smithi112 ceph-mon[28078]: Deploying cephadm binary to smithi187 2024-09-21T00:56:02.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:02 smithi112 ceph-mon[28078]: Deploying cephadm binary to smithi112 2024-09-21T00:56:02.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:02 smithi112 ceph-mon[28078]: pgmap v4: 65 pgs: 65 active+clean; 117 MiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:56:02.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:02 smithi112 ceph-mon[28078]: [21/Sep/2024:00:56:01] ENGINE Bus STARTING 2024-09-21T00:56:02.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:02 smithi112 ceph-mon[28078]: [21/Sep/2024:00:56:01] ENGINE Serving on https://172.21.15.187:7150 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:02 smithi112 ceph-mon[28078]: [21/Sep/2024:00:56:01] ENGINE Error in HTTPServer.serve 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:56:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T00:56:02.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:56:02.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T00:56:02.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:56:02.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T00:56:02.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:56:02.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T00:56:02.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:56:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:03 smithi112 ceph-mon[28078]: [21/Sep/2024:00:56:01] ENGINE Serving on http://172.21.15.187:8765 2024-09-21T00:56:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:03 smithi112 ceph-mon[28078]: [21/Sep/2024:00:56:01] ENGINE Bus STARTED 2024-09-21T00:56:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:03 smithi112 ceph-mon[28078]: mgrmap e23: smithi187.hpbgni(active, since 3s) 2024-09-21T00:56:03.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:03 smithi187 ceph-mon[34997]: [21/Sep/2024:00:56:01] ENGINE Serving on http://172.21.15.187:8765 2024-09-21T00:56:03.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:03 smithi187 ceph-mon[34997]: [21/Sep/2024:00:56:01] ENGINE Bus STARTED 2024-09-21T00:56:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:03 smithi187 ceph-mon[34997]: mgrmap e23: smithi187.hpbgni(active, since 3s) 2024-09-21T00:56:04.224 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:04 smithi187 ceph-mon[34997]: pgmap v5: 65 pgs: 65 active+clean; 117 MiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:56:04.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:04 smithi112 ceph-mon[28078]: pgmap v5: 65 pgs: 65 active+clean; 117 MiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:56:05.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:05 smithi187 ceph-mon[34997]: mgrmap e24: smithi187.hpbgni(active, since 5s) 2024-09-21T00:56:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:05 smithi112 ceph-mon[28078]: mgrmap e24: smithi187.hpbgni(active, since 5s) 2024-09-21T00:56:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:06 smithi187 ceph-mon[34997]: pgmap v6: 65 pgs: 65 active+clean; 131 MiB data, 623 MiB used, 536 GiB / 536 GiB avail; 35 KiB/s rd, 2.8 MiB/s wr, 153 op/s 2024-09-21T00:56:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:06 smithi187 ceph-mon[34997]: Standby manager daemon smithi112.fzmyfw started 2024-09-21T00:56:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:06 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/crt"}]: dispatch 2024-09-21T00:56:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:06 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:56:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:06 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/key"}]: dispatch 2024-09-21T00:56:06.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:06 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:56:06.418 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:06 smithi112 ceph-mon[28078]: pgmap v6: 65 pgs: 65 active+clean; 131 MiB data, 623 MiB used, 536 GiB / 536 GiB avail; 35 KiB/s rd, 2.8 MiB/s wr, 153 op/s 2024-09-21T00:56:06.418 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:06 smithi112 ceph-mon[28078]: Standby manager daemon smithi112.fzmyfw started 2024-09-21T00:56:06.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:06 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/crt"}]: dispatch 2024-09-21T00:56:06.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:06 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:56:06.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:06 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/key"}]: dispatch 2024-09-21T00:56:06.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:06 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/2072021873' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:56:07.387 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:07 smithi187 ceph-mon[34997]: mgrmap e25: smithi187.hpbgni(active, since 7s), standbys: smithi112.fzmyfw 2024-09-21T00:56:07.387 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:07 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:56:07.387 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:07 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.387 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:07 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.387 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:07 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.387 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:07 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:07 smithi112 ceph-mon[28078]: mgrmap e25: smithi187.hpbgni(active, since 7s), standbys: smithi112.fzmyfw 2024-09-21T00:56:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:07 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:56:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:07 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:07 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:07 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:07 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:07.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 -- 172.21.15.112:0/3993325918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 msgr2=0x7ff6a0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:07.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3993325918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0100c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff690009880 tx=0x7ff69002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 -- 172.21.15.112:0/3993325918 shutdown_connections 2024-09-21T00:56:07.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3993325918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6a0101a80 0x7ff6a0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3993325918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0100c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 -- 172.21.15.112:0/3993325918 >> 172.21.15.112:0/3993325918 conn(0x7ff6a00fc010 msgr2=0x7ff6a00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:07.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 -- 172.21.15.112:0/3993325918 shutdown_connections 2024-09-21T00:56:07.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.749+0000 7ff6a4885640 1 -- 172.21.15.112:0/3993325918 wait complete. 2024-09-21T00:56:07.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff6a4885640 1 Processor -- start 2024-09-21T00:56:07.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff6a4885640 1 -- start start 2024-09-21T00:56:07.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff6a4885640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:07.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff6a4885640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6a0101a80 0x7ff6a0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:07.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff6a4885640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a01096c0 con 0x7ff6a0100880 2024-09-21T00:56:07.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff6a4885640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a0109540 con 0x7ff6a0101a80 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff69e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff69e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58108/0 (socket says 172.21.15.112:58108) 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.750+0000 7ff69e59c640 1 -- 172.21.15.112:0/3936129159 learned_addr learned my addr 172.21.15.112:0/3936129159 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff69dd9b640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6a0101a80 0x7ff6a0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff69e59c640 1 -- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6a0101a80 msgr2=0x7ff6a0197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff69e59c640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6a0101a80 0x7ff6a0197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff69e59c640 1 -- 172.21.15.112:0/3936129159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a01980d0 con 0x7ff6a0100880 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff69e59c640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0197510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff6900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff68f7fe640 1 -- 172.21.15.112:0/3936129159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff69003f070 con 0x7ff6a0100880 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff68f7fe640 1 -- 172.21.15.112:0/3936129159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6900049d0 con 0x7ff6a0100880 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a019cab0 con 0x7ff6a0100880 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff68f7fe640 1 -- 172.21.15.112:0/3936129159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff690035030 con 0x7ff6a0100880 2024-09-21T00:56:07.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.751+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a019d040 con 0x7ff6a0100880 2024-09-21T00:56:07.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.753+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a0100c80 con 0x7ff6a0100880 2024-09-21T00:56:07.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.754+0000 7ff68f7fe640 1 -- 172.21.15.112:0/3936129159 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff690042070 con 0x7ff6a0100880 2024-09-21T00:56:07.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.754+0000 7ff68f7fe640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7ff688074a30 0x7ff688076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:07.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.754+0000 7ff68f7fe640 1 -- 172.21.15.112:0/3936129159 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7ff6900b6e00 con 0x7ff6a0100880 2024-09-21T00:56:07.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.755+0000 7ff69dd9b640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7ff688074a30 0x7ff688076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:07.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.755+0000 7ff69dd9b640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7ff688074a30 0x7ff688076ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff6a01989c0 tx=0x7ff694005f90 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:07.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:07.761+0000 7ff68f7fe640 1 -- 172.21.15.112:0/3936129159 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff690082330 con 0x7ff6a0100880 2024-09-21T00:56:08.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.026+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff6a006aa60 con 0x7ff688074a30 2024-09-21T00:56:08.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.027+0000 7ff68f7fe640 1 -- 172.21.15.112:0/3936129159 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff6a006aa60 con 0x7ff688074a30 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7ff688074a30 msgr2=0x7ff688076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7ff688074a30 0x7ff688076ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff6a01989c0 tx=0x7ff694005f90 comp rx=0 tx=0).stop 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 msgr2=0x7ff6a0197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0197510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff6900045e0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 shutdown_connections 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7ff688074a30 0x7ff688076ef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6a0101a80 0x7ff6a0197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 --2- 172.21.15.112:0/3936129159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6a0100880 0x7ff6a0197510 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 >> 172.21.15.112:0/3936129159 conn(0x7ff6a00fc010 msgr2=0x7ff6a006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 shutdown_connections 2024-09-21T00:56:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.030+0000 7ff6a4885640 1 -- 172.21.15.112:0/3936129159 wait complete. 2024-09-21T00:56:08.040 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:56:08.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 -- 172.21.15.112:0/4176103936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 msgr2=0x7f83a0101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 --2- 172.21.15.112:0/4176103936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a0101ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8388009880 tx=0x7f838802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 -- 172.21.15.112:0/4176103936 shutdown_connections 2024-09-21T00:56:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 --2- 172.21.15.112:0/4176103936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a0101ec0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 --2- 172.21.15.112:0/4176103936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a0100840 0x7f83a0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 -- 172.21.15.112:0/4176103936 >> 172.21.15.112:0/4176103936 conn(0x7f83a00fbff0 msgr2=0x7f83a00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 -- 172.21.15.112:0/4176103936 shutdown_connections 2024-09-21T00:56:08.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 -- 172.21.15.112:0/4176103936 wait complete. 2024-09-21T00:56:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 Processor -- start 2024-09-21T00:56:08.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.130+0000 7f83a6a23640 1 -- start start 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f83a6a23640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a0100840 0x7f83a01974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f83a6a23640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a01979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f83a6a23640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0109660 con 0x7f83a0101a40 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f83a6a23640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f83a01094e0 con 0x7f83a0100840 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f8397fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a01979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f8397fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a01979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58126/0 (socket says 172.21.15.112:58126) 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f8397fff640 1 -- 172.21.15.112:0/1700783790 learned_addr learned my addr 172.21.15.112:0/1700783790 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f839ffff640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a0100840 0x7f83a01974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f8397fff640 1 -- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a0100840 msgr2=0x7f83a01974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f8397fff640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a0100840 0x7f83a01974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f8397fff640 1 -- 172.21.15.112:0/1700783790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a0197fe0 con 0x7f83a0101a40 2024-09-21T00:56:08.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f8397fff640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a01979f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8388006010 tx=0x7f83880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f839dffb640 1 -- 172.21.15.112:0/1700783790 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f838803f070 con 0x7f83a0101a40 2024-09-21T00:56:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f839dffb640 1 -- 172.21.15.112:0/1700783790 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83880044d0 con 0x7f83a0101a40 2024-09-21T00:56:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a019c9f0 con 0x7f83a0101a40 2024-09-21T00:56:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f839dffb640 1 -- 172.21.15.112:0/1700783790 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8388035030 con 0x7f83a0101a40 2024-09-21T00:56:08.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.131+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a019cef0 con 0x7f83a0101a40 2024-09-21T00:56:08.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.132+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a0100c40 con 0x7f83a0101a40 2024-09-21T00:56:08.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.133+0000 7f839dffb640 1 -- 172.21.15.112:0/1700783790 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f8388042070 con 0x7f83a0101a40 2024-09-21T00:56:08.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.134+0000 7f839dffb640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f838c074a80 0x7f838c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.134+0000 7f839dffb640 1 -- 172.21.15.112:0/1700783790 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7f83880b75c0 con 0x7f83a0101a40 2024-09-21T00:56:08.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.134+0000 7f839ffff640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f838c074a80 0x7f838c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.134+0000 7f839ffff640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f838c074a80 0x7f838c076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8390005fd0 tx=0x7f8390005ce0 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.138+0000 7f839dffb640 1 -- 172.21.15.112:0/1700783790 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8388082c10 con 0x7f83a0101a40 2024-09-21T00:56:08.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.346+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f83a006a330 con 0x7f838c074a80 2024-09-21T00:56:08.347 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:08 smithi112 ceph-mon[28078]: pgmap v7: 65 pgs: 65 active+clean; 137 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 3.0 MiB/s wr, 164 op/s 2024-09-21T00:56:08.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.347+0000 7f839dffb640 1 -- 172.21.15.112:0/1700783790 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f83a006a330 con 0x7f838c074a80 2024-09-21T00:56:08.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f838c074a80 msgr2=0x7f838c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f838c074a80 0x7f838c076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8390005fd0 tx=0x7f8390005ce0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 msgr2=0x7f83a01979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a01979f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8388006010 tx=0x7f83880048f0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 shutdown_connections 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f838c074a80 0x7f838c076f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83a0101a40 0x7f83a01979f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 --2- 172.21.15.112:0/1700783790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a0100840 0x7f83a01974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 >> 172.21.15.112:0/1700783790 conn(0x7f83a00fbff0 msgr2=0x7f83a0069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 shutdown_connections 2024-09-21T00:56:08.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.350+0000 7f83a6a23640 1 -- 172.21.15.112:0/1700783790 wait complete. 2024-09-21T00:56:08.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:08 smithi187 ceph-mon[34997]: pgmap v7: 65 pgs: 65 active+clean; 137 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 3.0 MiB/s wr, 164 op/s 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 -- 172.21.15.112:0/3802092918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4100ad0 msgr2=0x7fbba4100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 --2- 172.21.15.112:0/3802092918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4100ad0 0x7fbba4100f50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009880 tx=0x7fbb9402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 -- 172.21.15.112:0/3802092918 shutdown_connections 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 --2- 172.21.15.112:0/3802092918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4100ad0 0x7fbba4100f50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 --2- 172.21.15.112:0/3802092918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4101e20 0x7fbba4102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 -- 172.21.15.112:0/3802092918 >> 172.21.15.112:0/3802092918 conn(0x7fbba40fb750 msgr2=0x7fbba40fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 -- 172.21.15.112:0/3802092918 shutdown_connections 2024-09-21T00:56:08.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 -- 172.21.15.112:0/3802092918 wait complete. 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.455+0000 7fbbaba26640 1 Processor -- start 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbbaba26640 1 -- start start 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbbaba26640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4100ad0 0x7fbba41004f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbbaba26640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4101e20 0x7fbba419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbbaba26640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbba4109660 con 0x7fbba4101e20 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbbaba26640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbba41094e0 con 0x7fbba4100ad0 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba8fc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4101e20 0x7fbba419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba97c2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4100ad0 0x7fbba41004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba8fc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4101e20 0x7fbba419c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58132/0 (socket says 172.21.15.112:58132) 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba97c2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4100ad0 0x7fbba41004f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:33738/0 (socket says 172.21.15.112:33738) 2024-09-21T00:56:08.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba8fc1640 1 -- 172.21.15.112:0/1522418871 learned_addr learned my addr 172.21.15.112:0/1522418871 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba97c2640 1 -- 172.21.15.112:0/1522418871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4101e20 msgr2=0x7fbba419c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba97c2640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4101e20 0x7fbba419c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba97c2640 1 -- 172.21.15.112:0/1522418871 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba419c790 con 0x7fbba4100ad0 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.456+0000 7fbba8fc1640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4101e20 0x7fbba419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.457+0000 7fbba97c2640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4100ad0 0x7fbba41004f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbba000e940 tx=0x7fbba000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.457+0000 7fbb9a7fc640 1 -- 172.21.15.112:0/1522418871 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbba000cac0 con 0x7fbba4100ad0 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.457+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba419ca80 con 0x7fbba4100ad0 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.457+0000 7fbb9a7fc640 1 -- 172.21.15.112:0/1522418871 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbba000cc60 con 0x7fbba4100ad0 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.457+0000 7fbb9a7fc640 1 -- 172.21.15.112:0/1522418871 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbba00186c0 con 0x7fbba4100ad0 2024-09-21T00:56:08.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.457+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba419d010 con 0x7fbba4100ad0 2024-09-21T00:56:08.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.458+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba4100f50 con 0x7fbba4100ad0 2024-09-21T00:56:08.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.459+0000 7fbb9a7fc640 1 -- 172.21.15.112:0/1522418871 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fbba001f020 con 0x7fbba4100ad0 2024-09-21T00:56:08.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.460+0000 7fbb9a7fc640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb90074a80 0x7fbb90076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.460+0000 7fbb9a7fc640 1 -- 172.21.15.112:0/1522418871 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fbba0096490 con 0x7fbba4100ad0 2024-09-21T00:56:08.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.460+0000 7fbba8fc1640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb90074a80 0x7fbb90076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.460+0000 7fbba8fc1640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb90074a80 0x7fbb90076f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb940096c0 tx=0x7fbb94005a20 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.464+0000 7fbb9a7fc640 1 -- 172.21.15.112:0/1522418871 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fbba00619b0 con 0x7fbba4100ad0 2024-09-21T00:56:08.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.755+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbba4106090 con 0x7fbb90074a80 2024-09-21T00:56:08.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.768+0000 7fbb9a7fc640 1 -- 172.21.15.112:0/1522418871 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbba4106090 con 0x7fbb90074a80 2024-09-21T00:56:08.768 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:56:08.768 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 109s ago 7m 25.4M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (7m) 109s ago 7m 8250k - 19.1.1-373-g4e45e6b4 164465d2334a f33e5ce7bd79 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (6m) 2s ago 6m 5263k - 19.1.1-373-g4e45e6b4 164465d2334a fcd1455bbc96 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (7m) 109s ago 7m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (6m) 2s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (5m) 109s ago 7m 79.2M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (2m) 109s ago 2m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (2m) 109s ago 2m 11.9M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (2m) 2s ago 2m 16.3M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (2m) 2s ago 2m 14.1M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:9283,8765,8443 running (8m) 109s ago 8m 500M - 19.1.1-373-g4e45e6b4 164465d2334a c587f79e18b3 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (27s) 2s ago 6m 564M - 19.3.0-5120-g18432218 ddce307e1f32 9ab97a4dd8af 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (8m) 109s ago 8m 50.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (6m) 2s ago 6m 39.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 109s ago 7m 14.8M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (6m) 2s ago 6m 16.5M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (5m) 109s ago 5m 48.2M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:56:08.769 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (4m) 109s ago 4m 57.9M 3946M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:56:08.770 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (4m) 109s ago 4m 44.9M 3946M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:56:08.770 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (4m) 2s ago 4m 80.7M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:56:08.770 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (3m) 2s ago 3m 72.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:56:08.770 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (3m) 2s ago 3m 86.5M 4970M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:56:08.770 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 109s ago 7m 55.8M - 2.43.0 a07b618ecd1d 67f455a0b500 2024-09-21T00:56:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb90074a80 msgr2=0x7fbb90076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb90074a80 0x7fbb90076f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb940096c0 tx=0x7fbb94005a20 comp rx=0 tx=0).stop 2024-09-21T00:56:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4100ad0 msgr2=0x7fbba41004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4100ad0 0x7fbba41004f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbba000e940 tx=0x7fbba000ee00 comp rx=0 tx=0).stop 2024-09-21T00:56:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 shutdown_connections 2024-09-21T00:56:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb90074a80 0x7fbb90076f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbba4101e20 0x7fbba419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 --2- 172.21.15.112:0/1522418871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbba4100ad0 0x7fbba41004f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 >> 172.21.15.112:0/1522418871 conn(0x7fbba40fb750 msgr2=0x7fbba40fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 shutdown_connections 2024-09-21T00:56:08.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.770+0000 7fbbaba26640 1 -- 172.21.15.112:0/1522418871 wait complete. 2024-09-21T00:56:08.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.871+0000 7fad70995640 1 -- 172.21.15.112:0/434788672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c102b90 msgr2=0x7fad6c103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.871+0000 7fad70995640 1 --2- 172.21.15.112:0/434788672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c102b90 0x7fad6c103010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fad54009880 tx=0x7fad5402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.871+0000 7fad70995640 1 -- 172.21.15.112:0/434788672 shutdown_connections 2024-09-21T00:56:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 --2- 172.21.15.112:0/434788672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c102b90 0x7fad6c103010 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 --2- 172.21.15.112:0/434788672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad6c101990 0x7fad6c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 -- 172.21.15.112:0/434788672 >> 172.21.15.112:0/434788672 conn(0x7fad6c0fd140 msgr2=0x7fad6c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 -- 172.21.15.112:0/434788672 shutdown_connections 2024-09-21T00:56:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 -- 172.21.15.112:0/434788672 wait complete. 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 Processor -- start 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 -- start start 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.872+0000 7fad70995640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c101990 0x7fad6c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad70995640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad6c102b90 0x7fad6c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad70995640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c10a7d0 con 0x7fad6c101990 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad70995640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c10a650 con 0x7fad6c102b90 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad6a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c101990 0x7fad6c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad6a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c101990 0x7fad6c1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58154/0 (socket says 172.21.15.112:58154) 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad6a59c640 1 -- 172.21.15.112:0/3898292735 learned_addr learned my addr 172.21.15.112:0/3898292735 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad63fff640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad6c102b90 0x7fad6c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad6a59c640 1 -- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad6c102b90 msgr2=0x7fad6c197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad6a59c640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad6c102b90 0x7fad6c197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad6a59c640 1 -- 172.21.15.112:0/3898292735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c198080 con 0x7fad6c101990 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad6a59c640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c101990 0x7fad6c1974c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c8f0 tx=0x7fad5c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad637fe640 1 -- 172.21.15.112:0/3898292735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad5c004020 con 0x7fad6c101990 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c19cac0 con 0x7fad6c101990 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad637fe640 1 -- 172.21.15.112:0/3898292735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad5c0041c0 con 0x7fad6c101990 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c19d050 con 0x7fad6c101990 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.873+0000 7fad637fe640 1 -- 172.21.15.112:0/3898292735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad5c0047a0 con 0x7fad6c101990 2024-09-21T00:56:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.874+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c101d90 con 0x7fad6c101990 2024-09-21T00:56:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.875+0000 7fad637fe640 1 -- 172.21.15.112:0/3898292735 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fad5c004370 con 0x7fad6c101990 2024-09-21T00:56:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.875+0000 7fad637fe640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fad58074a30 0x7fad58076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.876+0000 7fad637fe640 1 -- 172.21.15.112:0/3898292735 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fad5c096280 con 0x7fad6c101990 2024-09-21T00:56:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.876+0000 7fad63fff640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fad58074a30 0x7fad58076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.876+0000 7fad63fff640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fad58074a30 0x7fad58076ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad54006010 tx=0x7fad54000bc0 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:08.880+0000 7fad637fe640 1 -- 172.21.15.112:0/3898292735 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fad5c014030 con 0x7fad6c101990 2024-09-21T00:56:09.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.220+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fad6c19d9e0 con 0x7fad6c101990 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.220+0000 7fad637fe640 1 -- 172.21.15.112:0/3898292735 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fad5c0617b0 con 0x7fad6c101990 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T00:56:09.221 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T00:56:09.222 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:56:09.223 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:56:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fad58074a30 msgr2=0x7fad58076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fad58074a30 0x7fad58076ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad54006010 tx=0x7fad54000bc0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c101990 msgr2=0x7fad6c1974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c101990 0x7fad6c1974c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c8f0 tx=0x7fad5c00cdb0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 shutdown_connections 2024-09-21T00:56:09.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fad58074a30 0x7fad58076ef0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad6c102b90 0x7fad6c197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 --2- 172.21.15.112:0/3898292735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad6c101990 0x7fad6c1974c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.223+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 >> 172.21.15.112:0/3898292735 conn(0x7fad6c0fd140 msgr2=0x7fad6c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:09.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.224+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 shutdown_connections 2024-09-21T00:56:09.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.224+0000 7fad70995640 1 -- 172.21.15.112:0/3898292735 wait complete. 2024-09-21T00:56:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.330+0000 7fcc4afeb640 1 -- 172.21.15.112:0/713145839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44104d60 msgr2=0x7fcc44107150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.330+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/713145839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44104d60 0x7fcc44107150 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009880 tx=0x7fcc3002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.330+0000 7fcc4afeb640 1 -- 172.21.15.112:0/713145839 shutdown_connections 2024-09-21T00:56:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.330+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/713145839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44104d60 0x7fcc44107150 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.330+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/713145839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc44102430 0x7fcc44104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.330+0000 7fcc4afeb640 1 -- 172.21.15.112:0/713145839 >> 172.21.15.112:0/713145839 conn(0x7fcc440fbff0 msgr2=0x7fcc440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 -- 172.21.15.112:0/713145839 shutdown_connections 2024-09-21T00:56:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 -- 172.21.15.112:0/713145839 wait complete. 2024-09-21T00:56:09.332 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:09 smithi112 ceph-mon[28078]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.332 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:09 smithi112 ceph-mon[28078]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.332 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:09 smithi112 ceph-mon[28078]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 Processor -- start 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 -- start start 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44102430 0x7fcc44197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc44104d60 0x7fcc441979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4410a720 con 0x7fcc44102430 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.331+0000 7fcc4afeb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4410a5a0 con 0x7fcc44104d60 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc48d87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44102430 0x7fcc44197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc48d87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44102430 0x7fcc44197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58178/0 (socket says 172.21.15.112:58178) 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc48d87640 1 -- 172.21.15.112:0/3114880226 learned_addr learned my addr 172.21.15.112:0/3114880226 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc43fff640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc44104d60 0x7fcc441979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc48d87640 1 -- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc44104d60 msgr2=0x7fcc441979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc48d87640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc44104d60 0x7fcc441979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc48d87640 1 -- 172.21.15.112:0/3114880226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc44198040 con 0x7fcc44102430 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc48d87640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44102430 0x7fcc44197480 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800e970 tx=0x7fcc3800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc41ffb640 1 -- 172.21.15.112:0/3114880226 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc3800cac0 con 0x7fcc44102430 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4419ca80 con 0x7fcc44102430 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc41ffb640 1 -- 172.21.15.112:0/3114880226 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc380054e0 con 0x7fcc44102430 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.332+0000 7fcc41ffb640 1 -- 172.21.15.112:0/3114880226 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc38004b60 con 0x7fcc44102430 2024-09-21T00:56:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.333+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4419cfe0 con 0x7fcc44102430 2024-09-21T00:56:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.334+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc44102810 con 0x7fcc44102430 2024-09-21T00:56:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.334+0000 7fcc41ffb640 1 -- 172.21.15.112:0/3114880226 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fcc38005020 con 0x7fcc44102430 2024-09-21T00:56:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.335+0000 7fcc41ffb640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcc34074a30 0x7fcc34076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.335+0000 7fcc41ffb640 1 -- 172.21.15.112:0/3114880226 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fcc38096730 con 0x7fcc44102430 2024-09-21T00:56:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.335+0000 7fcc43fff640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcc34074a30 0x7fcc34076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.336+0000 7fcc43fff640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcc34074a30 0x7fcc34076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009230 tx=0x7fcc300058d0 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:09.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.339+0000 7fcc41ffb640 1 -- 172.21.15.112:0/3114880226 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fcc38061c60 con 0x7fcc44102430 2024-09-21T00:56:09.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:09 smithi187 ceph-mon[34997]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:09 smithi187 ceph-mon[34997]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:09 smithi187 ceph-mon[34997]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:09.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.620+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcc44105740 con 0x7fcc34074a30 2024-09-21T00:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.622+0000 7fcc41ffb640 1 -- 172.21.15.112:0/3114880226 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fcc44105740 con 0x7fcc34074a30 2024-09-21T00:56:09.622 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:56:09.622 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:56:09.623 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:56:09.623 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:56:09.623 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-21T00:56:09.623 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T00:56:09.623 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "", 2024-09-21T00:56:09.623 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:56:09.623 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcc34074a30 msgr2=0x7fcc34076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcc34074a30 0x7fcc34076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009230 tx=0x7fcc300058d0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44102430 msgr2=0x7fcc44197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44102430 0x7fcc44197480 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800e970 tx=0x7fcc3800ed70 comp rx=0 tx=0).stop 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 shutdown_connections 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcc34074a30 0x7fcc34076ef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc44104d60 0x7fcc441979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 --2- 172.21.15.112:0/3114880226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc44102430 0x7fcc44197480 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 >> 172.21.15.112:0/3114880226 conn(0x7fcc440fbff0 msgr2=0x7fcc440fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 shutdown_connections 2024-09-21T00:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:09.624+0000 7fcc4afeb640 1 -- 172.21.15.112:0/3114880226 wait complete. 2024-09-21T00:56:10.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:10 smithi187 ceph-mon[34997]: pgmap v8: 65 pgs: 65 active+clean; 137 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 2.3 MiB/s wr, 127 op/s 2024-09-21T00:56:10.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:10 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3898292735' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:56:10.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:10 smithi187 ceph-mon[34997]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:10.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:10 smithi112 ceph-mon[28078]: pgmap v8: 65 pgs: 65 active+clean; 137 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 2.3 MiB/s wr, 127 op/s 2024-09-21T00:56:10.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:10 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3898292735' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:56:10.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:10 smithi112 ceph-mon[28078]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:12.397 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:12 smithi187 ceph-mon[34997]: pgmap v9: 65 pgs: 65 active+clean; 155 MiB data, 697 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 3.6 MiB/s wr, 205 op/s 2024-09-21T00:56:12.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:12 smithi112 ceph-mon[28078]: pgmap v9: 65 pgs: 65 active+clean; 155 MiB data, 697 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 3.6 MiB/s wr, 205 op/s 2024-09-21T00:56:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi187 to 2240M 2024-09-21T00:56:13.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:13.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:13.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi187 to 2240M 2024-09-21T00:56:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:14 smithi112 ceph-mon[28078]: pgmap v10: 65 pgs: 65 active+clean; 155 MiB data, 697 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 188 op/s 2024-09-21T00:56:14.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:14 smithi187 ceph-mon[34997]: pgmap v10: 65 pgs: 65 active+clean; 155 MiB data, 697 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 188 op/s 2024-09-21T00:56:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:16 smithi112 ceph-mon[28078]: pgmap v11: 65 pgs: 65 active+clean; 171 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 4.6 MiB/s wr, 332 op/s 2024-09-21T00:56:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:16 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:16.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:16 smithi187 ceph-mon[34997]: pgmap v11: 65 pgs: 65 active+clean; 171 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 4.6 MiB/s wr, 332 op/s 2024-09-21T00:56:16.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:16 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:18.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:18 smithi112 ceph-mon[28078]: pgmap v12: 65 pgs: 65 active+clean; 171 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 268 op/s 2024-09-21T00:56:18.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:18 smithi187 ceph-mon[34997]: pgmap v12: 65 pgs: 65 active+clean; 171 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 268 op/s 2024-09-21T00:56:20.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:20 smithi112 ceph-mon[28078]: pgmap v13: 65 pgs: 65 active+clean; 171 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T00:56:20.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:20 smithi187 ceph-mon[34997]: pgmap v13: 65 pgs: 65 active+clean; 171 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T00:56:22.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: pgmap v14: 65 pgs: 65 active+clean; 191 MiB data, 795 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 417 op/s 2024-09-21T00:56:22.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: Adjusting osd_memory_target on smithi112 to 1216M 2024-09-21T00:56:22.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:22.263 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:56:22.263 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:56:22.263 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:22 smithi112 ceph-mon[28078]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:56:22.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: pgmap v14: 65 pgs: 65 active+clean; 191 MiB data, 795 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 417 op/s 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: Adjusting osd_memory_target on smithi112 to 1216M 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:22 smithi187 ceph-mon[34997]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:56:22.631 INFO:tasks.workunit.client.1.smithi187.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T00:56:22.637 INFO:tasks.workunit.client.1.smithi187.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T00:56:22.637 INFO:tasks.workunit.client.1.smithi187.stderr:+ make 2024-09-21T00:56:23.262 INFO:tasks.workunit.client.1.smithi187.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T00:56:23.637 INFO:tasks.workunit.client.1.smithi187.stderr:++ readlink -f fsstress 2024-09-21T00:56:23.639 INFO:tasks.workunit.client.1.smithi187.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T00:56:23.639 INFO:tasks.workunit.client.1.smithi187.stderr:+ popd 2024-09-21T00:56:23.640 INFO:tasks.workunit.client.1.smithi187.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T00:56:23.640 INFO:tasks.workunit.client.1.smithi187.stderr:+ popd 2024-09-21T00:56:23.640 INFO:tasks.workunit.client.1.smithi187.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-21T00:56:23.641 INFO:tasks.workunit.client.1.smithi187.stderr:++ mktemp -d -p . 2024-09-21T00:56:23.643 INFO:tasks.workunit.client.1.smithi187.stderr:+ T=./tmp.HFhvNpoQ2y 2024-09-21T00:56:23.643 INFO:tasks.workunit.client.1.smithi187.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.HFhvNpoQ2y -l 1 -n 1000 -p 10 -v 2024-09-21T00:56:23.649 INFO:tasks.workunit.client.1.smithi187.stdout:seed = 1726477698 2024-09-21T00:56:23.655 INFO:tasks.workunit.client.1.smithi187.stdout:0/0: dread - no filename 2024-09-21T00:56:23.658 INFO:tasks.workunit.client.1.smithi187.stdout:1/0: rmdir - no directory 2024-09-21T00:56:23.658 INFO:tasks.workunit.client.1.smithi187.stdout:1/1: dread - no filename 2024-09-21T00:56:23.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:56:23.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Reconfiguring ceph-exporter.smithi112 (dependencies changed)... 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:56:23.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:23.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:23 smithi187 ceph-mon[34997]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T00:56:23.662 INFO:tasks.workunit.client.1.smithi187.stdout:0/1: mkdir d0 0 2024-09-21T00:56:23.662 INFO:tasks.workunit.client.1.smithi187.stdout:0/2: chown d0 81 1 2024-09-21T00:56:23.662 INFO:tasks.workunit.client.1.smithi187.stdout:0/3: chown d0 7151480 1 2024-09-21T00:56:23.668 INFO:tasks.workunit.client.1.smithi187.stdout:1/2: mkdir d0 0 2024-09-21T00:56:23.669 INFO:tasks.workunit.client.1.smithi187.stdout:2/0: mknod c0 0 2024-09-21T00:56:23.669 INFO:tasks.workunit.client.1.smithi187.stdout:2/1: write - no filename 2024-09-21T00:56:23.669 INFO:tasks.workunit.client.1.smithi187.stdout:2/2: rmdir - no directory 2024-09-21T00:56:23.673 INFO:tasks.workunit.client.1.smithi187.stdout:0/4: creat d0/f1 x:0 0 0 2024-09-21T00:56:23.677 INFO:tasks.workunit.client.1.smithi187.stdout:3/0: creat f0 x:0 0 0 2024-09-21T00:56:23.677 INFO:tasks.workunit.client.1.smithi187.stdout:3/1: rmdir - no directory 2024-09-21T00:56:23.677 INFO:tasks.workunit.client.1.smithi187.stdout:5/0: dwrite - no filename 2024-09-21T00:56:23.677 INFO:tasks.workunit.client.1.smithi187.stdout:5/1: dread - no filename 2024-09-21T00:56:23.677 INFO:tasks.workunit.client.1.smithi187.stdout:5/2: fsync - no filename 2024-09-21T00:56:23.677 INFO:tasks.workunit.client.1.smithi187.stdout:5/3: truncate - no filename 2024-09-21T00:56:23.678 INFO:tasks.workunit.client.1.smithi187.stdout:1/3: getdents d0 0 2024-09-21T00:56:23.679 INFO:tasks.workunit.client.1.smithi187.stdout:1/4: readlink - no filename 2024-09-21T00:56:23.679 INFO:tasks.workunit.client.1.smithi187.stdout:1/5: stat d0 0 2024-09-21T00:56:23.679 INFO:tasks.workunit.client.1.smithi187.stdout:1/6: write - no filename 2024-09-21T00:56:23.680 INFO:tasks.workunit.client.1.smithi187.stdout:0/5: dwrite d0/f1 [0,4194304] 0 2024-09-21T00:56:23.683 INFO:tasks.workunit.client.1.smithi187.stdout:4/0: creat f0 x:0 0 0 2024-09-21T00:56:23.684 INFO:tasks.workunit.client.1.smithi187.stdout:3/2: rename f0 to f1 0 2024-09-21T00:56:23.691 INFO:tasks.workunit.client.1.smithi187.stdout:5/4: mkdir d0 0 2024-09-21T00:56:23.691 INFO:tasks.workunit.client.1.smithi187.stdout:5/5: rename d0 to d0/d1 22 2024-09-21T00:56:23.697 INFO:tasks.workunit.client.1.smithi187.stdout:6/0: creat f0 x:0 0 0 2024-09-21T00:56:23.698 INFO:tasks.workunit.client.1.smithi187.stdout:6/1: fdatasync f0 0 2024-09-21T00:56:23.700 INFO:tasks.workunit.client.1.smithi187.stdout:3/3: dwrite f1 [0,4194304] 0 2024-09-21T00:56:23.701 INFO:tasks.workunit.client.1.smithi187.stdout:1/7: rmdir d0 0 2024-09-21T00:56:23.701 INFO:tasks.workunit.client.1.smithi187.stdout:1/8: chown . 337 1 2024-09-21T00:56:23.704 INFO:tasks.workunit.client.1.smithi187.stdout:7/0: mknod c0 0 2024-09-21T00:56:23.705 INFO:tasks.workunit.client.1.smithi187.stdout:9/0: dwrite - no filename 2024-09-21T00:56:23.705 INFO:tasks.workunit.client.1.smithi187.stdout:9/1: write - no filename 2024-09-21T00:56:23.705 INFO:tasks.workunit.client.1.smithi187.stdout:9/2: truncate - no filename 2024-09-21T00:56:23.705 INFO:tasks.workunit.client.1.smithi187.stdout:9/3: fsync - no filename 2024-09-21T00:56:23.705 INFO:tasks.workunit.client.1.smithi187.stdout:9/4: dwrite - no filename 2024-09-21T00:56:23.706 INFO:tasks.workunit.client.1.smithi187.stdout:9/5: link - no file 2024-09-21T00:56:23.708 INFO:tasks.workunit.client.1.smithi187.stdout:5/6: creat d0/f2 x:0 0 0 2024-09-21T00:56:23.709 INFO:tasks.workunit.client.1.smithi187.stdout:6/2: rename f0 to f1 0 2024-09-21T00:56:23.711 INFO:tasks.workunit.client.1.smithi187.stdout:3/4: creat f2 x:0 0 0 2024-09-21T00:56:23.712 INFO:tasks.workunit.client.1.smithi187.stdout:1/9: symlink l1 0 2024-09-21T00:56:23.712 INFO:tasks.workunit.client.1.smithi187.stdout:1/10: readlink l1 0 2024-09-21T00:56:23.714 INFO:tasks.workunit.client.1.smithi187.stdout:7/1: mkdir d1 0 2024-09-21T00:56:23.715 INFO:tasks.workunit.client.1.smithi187.stdout:8/0: creat f0 x:0 0 0 2024-09-21T00:56:23.716 INFO:tasks.workunit.client.1.smithi187.stdout:8/1: fdatasync f0 0 2024-09-21T00:56:23.719 INFO:tasks.workunit.client.1.smithi187.stdout:6/3: creat f2 x:0 0 0 2024-09-21T00:56:23.719 INFO:tasks.workunit.client.1.smithi187.stdout:6/4: readlink - no filename 2024-09-21T00:56:23.719 INFO:tasks.workunit.client.1.smithi187.stdout:6/5: dread - f1 zero size 2024-09-21T00:56:23.720 INFO:tasks.workunit.client.1.smithi187.stdout:1/11: mkdir d2 0 2024-09-21T00:56:23.720 INFO:tasks.workunit.client.1.smithi187.stdout:1/12: write - no filename 2024-09-21T00:56:23.720 INFO:tasks.workunit.client.1.smithi187.stdout:1/13: chown d2 481 1 2024-09-21T00:56:23.722 INFO:tasks.workunit.client.1.smithi187.stdout:9/6: symlink l0 0 2024-09-21T00:56:23.722 INFO:tasks.workunit.client.1.smithi187.stdout:9/7: dread - no filename 2024-09-21T00:56:23.722 INFO:tasks.workunit.client.1.smithi187.stdout:9/8: write - no filename 2024-09-21T00:56:23.722 INFO:tasks.workunit.client.1.smithi187.stdout:9/9: readlink l0 0 2024-09-21T00:56:23.722 INFO:tasks.workunit.client.1.smithi187.stdout:9/10: truncate - no filename 2024-09-21T00:56:23.723 INFO:tasks.workunit.client.1.smithi187.stdout:6/6: write f1 [210878,17306] 0 2024-09-21T00:56:23.726 INFO:tasks.workunit.client.1.smithi187.stdout:7/2: creat d1/f2 x:0 0 0 2024-09-21T00:56:23.727 INFO:tasks.workunit.client.1.smithi187.stdout:9/11: symlink l1 0 2024-09-21T00:56:23.730 INFO:tasks.workunit.client.1.smithi187.stdout:9/12: mknod c2 0 2024-09-21T00:56:23.732 INFO:tasks.workunit.client.1.smithi187.stdout:7/3: dwrite d1/f2 [0,4194304] 0 2024-09-21T00:56:23.734 INFO:tasks.workunit.client.1.smithi187.stdout:1/14: rmdir d2 0 2024-09-21T00:56:23.734 INFO:tasks.workunit.client.1.smithi187.stdout:1/15: read - no filename 2024-09-21T00:56:23.737 INFO:tasks.workunit.client.1.smithi187.stdout:9/13: symlink l3 0 2024-09-21T00:56:23.738 INFO:tasks.workunit.client.1.smithi187.stdout:9/14: chown l1 1 1 2024-09-21T00:56:23.738 INFO:tasks.workunit.client.1.smithi187.stdout:9/15: write - no filename 2024-09-21T00:56:23.738 INFO:tasks.workunit.client.1.smithi187.stdout:9/16: dwrite - no filename 2024-09-21T00:56:23.739 INFO:tasks.workunit.client.1.smithi187.stdout:9/17: fsync - no filename 2024-09-21T00:56:23.739 INFO:tasks.workunit.client.1.smithi187.stdout:9/18: fsync - no filename 2024-09-21T00:56:23.741 INFO:tasks.workunit.client.1.smithi187.stdout:7/4: dwrite d1/f2 [0,4194304] 0 2024-09-21T00:56:23.741 INFO:tasks.workunit.client.1.smithi187.stdout:1/16: creat f3 x:0 0 0 2024-09-21T00:56:23.742 INFO:tasks.workunit.client.1.smithi187.stdout:1/17: dread - f3 zero size 2024-09-21T00:56:23.743 INFO:tasks.workunit.client.1.smithi187.stdout:9/19: mkdir d4 0 2024-09-21T00:56:23.746 INFO:tasks.workunit.client.1.smithi187.stdout:1/18: mkdir d4 0 2024-09-21T00:56:23.749 INFO:tasks.workunit.client.1.smithi187.stdout:9/20: creat d4/f5 x:0 0 0 2024-09-21T00:56:23.750 INFO:tasks.workunit.client.1.smithi187.stdout:7/5: dwrite d1/f2 [0,4194304] 0 2024-09-21T00:56:23.751 INFO:tasks.workunit.client.1.smithi187.stdout:9/21: chown l0 882 1 2024-09-21T00:56:23.756 INFO:tasks.workunit.client.1.smithi187.stdout:9/22: creat d4/f6 x:0 0 0 2024-09-21T00:56:23.758 INFO:tasks.workunit.client.1.smithi187.stdout:9/23: dread - d4/f6 zero size 2024-09-21T00:56:23.758 INFO:tasks.workunit.client.1.smithi187.stdout:1/19: dwrite f3 [0,4194304] 0 2024-09-21T00:56:23.759 INFO:tasks.workunit.client.1.smithi187.stdout:9/24: read - d4/f6 zero size 2024-09-21T00:56:23.759 INFO:tasks.workunit.client.1.smithi187.stdout:1/20: chown l1 2088 1 2024-09-21T00:56:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:56:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:56:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:56:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:56:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:56:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:56:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Reconfiguring ceph-exporter.smithi112 (dependencies changed)... 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:56:23.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:23 smithi112 ceph-mon[28078]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T00:56:23.761 INFO:tasks.workunit.client.1.smithi187.stdout:7/6: dwrite d1/f2 [0,4194304] 0 2024-09-21T00:56:23.764 INFO:tasks.workunit.client.1.smithi187.stdout:9/25: creat d4/f7 x:0 0 0 2024-09-21T00:56:23.766 INFO:tasks.workunit.client.1.smithi187.stdout:1/21: dread f3 [0,4194304] 0 2024-09-21T00:56:23.767 INFO:tasks.workunit.client.1.smithi187.stdout:9/26: write d4/f7 [470881,116857] 0 2024-09-21T00:56:23.769 INFO:tasks.workunit.client.1.smithi187.stdout:9/27: truncate d4/f6 509610 0 2024-09-21T00:56:23.770 INFO:tasks.workunit.client.1.smithi187.stdout:7/7: dwrite d1/f2 [0,4194304] 0 2024-09-21T00:56:23.772 INFO:tasks.workunit.client.1.smithi187.stdout:1/22: symlink d4/l5 0 2024-09-21T00:56:23.772 INFO:tasks.workunit.client.1.smithi187.stdout:9/28: rmdir d4 39 2024-09-21T00:56:23.775 INFO:tasks.workunit.client.1.smithi187.stdout:7/8: rename c0 to d1/c3 0 2024-09-21T00:56:23.776 INFO:tasks.workunit.client.1.smithi187.stdout:1/23: mkdir d4/d6 0 2024-09-21T00:56:23.777 INFO:tasks.workunit.client.1.smithi187.stdout:1/24: chown d4/l5 35 1 2024-09-21T00:56:23.780 INFO:tasks.workunit.client.1.smithi187.stdout:1/25: dread f3 [0,4194304] 0 2024-09-21T00:56:23.782 INFO:tasks.workunit.client.1.smithi187.stdout:1/26: write f3 [1188428,123518] 0 2024-09-21T00:56:23.786 INFO:tasks.workunit.client.1.smithi187.stdout:1/27: link f3 d4/f7 0 2024-09-21T00:56:23.789 INFO:tasks.workunit.client.1.smithi187.stdout:1/28: mkdir d4/d6/d8 0 2024-09-21T00:56:23.789 INFO:tasks.workunit.client.1.smithi187.stdout:7/9: fdatasync d1/f2 0 2024-09-21T00:56:23.793 INFO:tasks.workunit.client.1.smithi187.stdout:1/29: unlink d4/l5 0 2024-09-21T00:56:23.794 INFO:tasks.workunit.client.1.smithi187.stdout:7/10: dwrite d1/f2 [0,4194304] 0 2024-09-21T00:56:23.796 INFO:tasks.workunit.client.1.smithi187.stdout:1/30: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:23.798 INFO:tasks.workunit.client.1.smithi187.stdout:7/11: creat d1/f4 x:0 0 0 2024-09-21T00:56:23.799 INFO:tasks.workunit.client.1.smithi187.stdout:1/31: rename l1 to d4/l9 0 2024-09-21T00:56:23.802 INFO:tasks.workunit.client.1.smithi187.stdout:1/32: creat d4/fa x:0 0 0 2024-09-21T00:56:23.803 INFO:tasks.workunit.client.1.smithi187.stdout:1/33: chown d4/fa 3471888 1 2024-09-21T00:56:23.806 INFO:tasks.workunit.client.1.smithi187.stdout:1/34: rename d4/fa to d4/fb 0 2024-09-21T00:56:23.813 INFO:tasks.workunit.client.1.smithi187.stdout:1/35: dwrite f3 [0,4194304] 0 2024-09-21T00:56:23.882 INFO:tasks.workunit.client.1.smithi187.stdout:2/3: getdents . 0 2024-09-21T00:56:23.884 INFO:tasks.workunit.client.1.smithi187.stdout:2/4: rename c0 to c1 0 2024-09-21T00:56:23.884 INFO:tasks.workunit.client.1.smithi187.stdout:0/6: fsync d0/f1 0 2024-09-21T00:56:23.886 INFO:tasks.workunit.client.1.smithi187.stdout:2/5: mkdir d2 0 2024-09-21T00:56:23.886 INFO:tasks.workunit.client.1.smithi187.stdout:2/6: truncate - no filename 2024-09-21T00:56:23.891 INFO:tasks.workunit.client.1.smithi187.stdout:4/1: fsync f0 0 2024-09-21T00:56:23.893 INFO:tasks.workunit.client.1.smithi187.stdout:4/2: creat f1 x:0 0 0 2024-09-21T00:56:23.894 INFO:tasks.workunit.client.1.smithi187.stdout:0/7: dwrite d0/f1 [4194304,4194304] 0 2024-09-21T00:56:23.896 INFO:tasks.workunit.client.1.smithi187.stdout:4/3: mkdir d2 0 2024-09-21T00:56:23.897 INFO:tasks.workunit.client.1.smithi187.stdout:4/4: fsync f0 0 2024-09-21T00:56:23.899 INFO:tasks.workunit.client.1.smithi187.stdout:0/8: dread d0/f1 [0,4194304] 0 2024-09-21T00:56:23.902 INFO:tasks.workunit.client.1.smithi187.stdout:4/5: mkdir d2/d3 0 2024-09-21T00:56:23.902 INFO:tasks.workunit.client.1.smithi187.stdout:0/9: dread d0/f1 [4194304,4194304] 0 2024-09-21T00:56:23.913 INFO:tasks.workunit.client.1.smithi187.stdout:8/2: getdents . 0 2024-09-21T00:56:23.915 INFO:tasks.workunit.client.1.smithi187.stdout:6/7: getdents . 0 2024-09-21T00:56:23.918 INFO:tasks.workunit.client.1.smithi187.stdout:6/8: mknod c3 0 2024-09-21T00:56:23.920 INFO:tasks.workunit.client.1.smithi187.stdout:6/9: write f1 [411103,59456] 0 2024-09-21T00:56:23.920 INFO:tasks.workunit.client.1.smithi187.stdout:6/10: rmdir - no directory 2024-09-21T00:56:23.920 INFO:tasks.workunit.client.1.smithi187.stdout:8/3: dwrite f0 [0,4194304] 0 2024-09-21T00:56:23.921 INFO:tasks.workunit.client.1.smithi187.stdout:6/11: write f2 [541124,56536] 0 2024-09-21T00:56:23.922 INFO:tasks.workunit.client.1.smithi187.stdout:8/4: mkdir d1 0 2024-09-21T00:56:23.939 INFO:tasks.workunit.client.1.smithi187.stdout:9/29: dwrite d4/f7 [0,4194304] 0 2024-09-21T00:56:23.939 INFO:tasks.workunit.client.1.smithi187.stdout:9/30: readlink l0 0 2024-09-21T00:56:23.939 INFO:tasks.workunit.client.1.smithi187.stdout:9/31: fsync d4/f5 0 2024-09-21T00:56:23.940 INFO:tasks.workunit.client.1.smithi187.stdout:9/32: truncate d4/f7 5028213 0 2024-09-21T00:56:23.943 INFO:tasks.workunit.client.1.smithi187.stdout:9/33: mkdir d4/d8 0 2024-09-21T00:56:23.954 INFO:tasks.workunit.client.1.smithi187.stdout:7/12: link d1/c3 d1/c5 0 2024-09-21T00:56:23.958 INFO:tasks.workunit.client.1.smithi187.stdout:7/13: rename d1/c5 to d1/c6 0 2024-09-21T00:56:23.961 INFO:tasks.workunit.client.1.smithi187.stdout:7/14: link d1/f2 d1/f7 0 2024-09-21T00:56:23.963 INFO:tasks.workunit.client.1.smithi187.stdout:7/15: mknod d1/c8 0 2024-09-21T00:56:23.963 INFO:tasks.workunit.client.1.smithi187.stdout:7/16: readlink - no filename 2024-09-21T00:56:23.966 INFO:tasks.workunit.client.1.smithi187.stdout:7/17: creat d1/f9 x:0 0 0 2024-09-21T00:56:23.993 INFO:tasks.workunit.client.1.smithi187.stdout:2/7: chown c1 3 1 2024-09-21T00:56:23.996 INFO:tasks.workunit.client.1.smithi187.stdout:2/8: mkdir d2/d3 0 2024-09-21T00:56:23.999 INFO:tasks.workunit.client.1.smithi187.stdout:2/9: mknod d2/c4 0 2024-09-21T00:56:24.001 INFO:tasks.workunit.client.1.smithi187.stdout:2/10: symlink d2/l5 0 2024-09-21T00:56:24.004 INFO:tasks.workunit.client.1.smithi187.stdout:2/11: symlink d2/d3/l6 0 2024-09-21T00:56:24.004 INFO:tasks.workunit.client.1.smithi187.stdout:2/12: dwrite - no filename 2024-09-21T00:56:24.005 INFO:tasks.workunit.client.1.smithi187.stdout:2/13: chown d2/c4 3 1 2024-09-21T00:56:24.005 INFO:tasks.workunit.client.1.smithi187.stdout:2/14: truncate - no filename 2024-09-21T00:56:24.005 INFO:tasks.workunit.client.1.smithi187.stdout:2/15: dwrite - no filename 2024-09-21T00:56:24.005 INFO:tasks.workunit.client.1.smithi187.stdout:2/16: dwrite - no filename 2024-09-21T00:56:24.007 INFO:tasks.workunit.client.1.smithi187.stdout:2/17: creat d2/f7 x:0 0 0 2024-09-21T00:56:24.009 INFO:tasks.workunit.client.1.smithi187.stdout:2/18: creat d2/f8 x:0 0 0 2024-09-21T00:56:24.011 INFO:tasks.workunit.client.1.smithi187.stdout:2/19: rmdir d2/d3 39 2024-09-21T00:56:24.015 INFO:tasks.workunit.client.1.smithi187.stdout:6/12: truncate f2 51433 0 2024-09-21T00:56:24.022 INFO:tasks.workunit.client.1.smithi187.stdout:9/34: truncate d4/f6 351811 0 2024-09-21T00:56:24.044 INFO:tasks.workunit.client.1.smithi187.stdout:2/20: getdents d2/d3 0 2024-09-21T00:56:24.046 INFO:tasks.workunit.client.1.smithi187.stdout:2/21: rename d2/l5 to d2/d3/l9 0 2024-09-21T00:56:24.047 INFO:tasks.workunit.client.1.smithi187.stdout:2/22: write d2/f7 [374466,35132] 0 2024-09-21T00:56:24.054 INFO:tasks.workunit.client.1.smithi187.stdout:2/23: creat d2/fa x:0 0 0 2024-09-21T00:56:24.054 INFO:tasks.workunit.client.1.smithi187.stdout:9/35: write d4/f7 [4685540,29759] 0 2024-09-21T00:56:24.054 INFO:tasks.workunit.client.1.smithi187.stdout:2/24: dread - d2/fa zero size 2024-09-21T00:56:24.056 INFO:tasks.workunit.client.1.smithi187.stdout:9/36: creat d4/f9 x:0 0 0 2024-09-21T00:56:24.056 INFO:tasks.workunit.client.1.smithi187.stdout:9/37: dread - d4/f5 zero size 2024-09-21T00:56:24.057 INFO:tasks.workunit.client.1.smithi187.stdout:9/38: dread - d4/f9 zero size 2024-09-21T00:56:24.060 INFO:tasks.workunit.client.1.smithi187.stdout:2/25: creat d2/fb x:0 0 0 2024-09-21T00:56:24.062 INFO:tasks.workunit.client.1.smithi187.stdout:9/39: symlink d4/d8/la 0 2024-09-21T00:56:24.065 INFO:tasks.workunit.client.1.smithi187.stdout:6/13: truncate f2 719295 0 2024-09-21T00:56:24.066 INFO:tasks.workunit.client.1.smithi187.stdout:2/26: mkdir d2/dc 0 2024-09-21T00:56:24.072 INFO:tasks.workunit.client.1.smithi187.stdout:9/40: rename d4/f6 to d4/d8/fb 0 2024-09-21T00:56:24.072 INFO:tasks.workunit.client.1.smithi187.stdout:9/41: chown d4/d8/la 105 1 2024-09-21T00:56:24.073 INFO:tasks.workunit.client.1.smithi187.stdout:9/42: fdatasync d4/f7 0 2024-09-21T00:56:24.074 INFO:tasks.workunit.client.1.smithi187.stdout:9/43: write d4/f7 [1033246,2199] 0 2024-09-21T00:56:24.075 INFO:tasks.workunit.client.1.smithi187.stdout:2/27: symlink d2/ld 0 2024-09-21T00:56:24.078 INFO:tasks.workunit.client.1.smithi187.stdout:6/14: dread f2 [0,4194304] 0 2024-09-21T00:56:24.079 INFO:tasks.workunit.client.1.smithi187.stdout:2/28: symlink d2/dc/le 0 2024-09-21T00:56:24.080 INFO:tasks.workunit.client.1.smithi187.stdout:6/15: dread f2 [0,4194304] 0 2024-09-21T00:56:24.080 INFO:tasks.workunit.client.1.smithi187.stdout:2/29: write d2/fb [448107,15914] 0 2024-09-21T00:56:24.081 INFO:tasks.workunit.client.1.smithi187.stdout:2/30: truncate d2/fa 707986 0 2024-09-21T00:56:24.083 INFO:tasks.workunit.client.1.smithi187.stdout:6/16: write f2 [636036,7169] 0 2024-09-21T00:56:24.083 INFO:tasks.workunit.client.1.smithi187.stdout:2/31: dread d2/fa [0,4194304] 0 2024-09-21T00:56:24.083 INFO:tasks.workunit.client.1.smithi187.stdout:2/32: fdatasync d2/f7 0 2024-09-21T00:56:24.084 INFO:tasks.workunit.client.1.smithi187.stdout:6/17: fsync f2 0 2024-09-21T00:56:24.091 INFO:tasks.workunit.client.1.smithi187.stdout:6/18: rename c3 to c4 0 2024-09-21T00:56:24.091 INFO:tasks.workunit.client.1.smithi187.stdout:6/19: write f2 [1302682,12541] 0 2024-09-21T00:56:24.093 INFO:tasks.workunit.client.1.smithi187.stdout:9/44: write d4/d8/fb [578678,72429] 0 2024-09-21T00:56:24.095 INFO:tasks.workunit.client.1.smithi187.stdout:6/20: dread f2 [0,4194304] 0 2024-09-21T00:56:24.095 INFO:tasks.workunit.client.1.smithi187.stdout:6/21: rmdir - no directory 2024-09-21T00:56:24.095 INFO:tasks.workunit.client.1.smithi187.stdout:9/45: mknod d4/cc 0 2024-09-21T00:56:24.095 INFO:tasks.workunit.client.1.smithi187.stdout:2/33: truncate d2/fa 1078045 0 2024-09-21T00:56:24.096 INFO:tasks.workunit.client.1.smithi187.stdout:2/34: truncate d2/fb 903654 0 2024-09-21T00:56:24.098 INFO:tasks.workunit.client.1.smithi187.stdout:2/35: mkdir d2/d3/df 0 2024-09-21T00:56:24.098 INFO:tasks.workunit.client.1.smithi187.stdout:9/46: dread d4/d8/fb [0,4194304] 0 2024-09-21T00:56:24.099 INFO:tasks.workunit.client.1.smithi187.stdout:9/47: dread - d4/f9 zero size 2024-09-21T00:56:24.099 INFO:tasks.workunit.client.1.smithi187.stdout:9/48: truncate d4/d8/fb 777484 0 2024-09-21T00:56:24.102 INFO:tasks.workunit.client.1.smithi187.stdout:9/49: rename l3 to d4/d8/ld 0 2024-09-21T00:56:24.102 INFO:tasks.workunit.client.1.smithi187.stdout:2/36: link d2/c4 d2/dc/c10 0 2024-09-21T00:56:24.105 INFO:tasks.workunit.client.1.smithi187.stdout:2/37: dread d2/fb [0,4194304] 0 2024-09-21T00:56:24.106 INFO:tasks.workunit.client.1.smithi187.stdout:9/50: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:24.106 INFO:tasks.workunit.client.1.smithi187.stdout:9/51: readlink l0 0 2024-09-21T00:56:24.107 INFO:tasks.workunit.client.1.smithi187.stdout:2/38: mknod d2/d3/c11 0 2024-09-21T00:56:24.107 INFO:tasks.workunit.client.1.smithi187.stdout:9/52: read d4/d8/fb [654773,55051] 0 2024-09-21T00:56:24.110 INFO:tasks.workunit.client.1.smithi187.stdout:9/53: symlink d4/le 0 2024-09-21T00:56:24.115 INFO:tasks.workunit.client.1.smithi187.stdout:2/39: dread d2/fa [0,4194304] 0 2024-09-21T00:56:24.117 INFO:tasks.workunit.client.1.smithi187.stdout:2/40: rmdir d2 39 2024-09-21T00:56:24.118 INFO:tasks.workunit.client.1.smithi187.stdout:9/54: dwrite d4/f7 [4194304,4194304] 0 2024-09-21T00:56:24.122 INFO:tasks.workunit.client.1.smithi187.stdout:9/55: write d4/d8/fb [210588,25287] 0 2024-09-21T00:56:24.141 INFO:tasks.workunit.client.1.smithi187.stdout:2/41: link d2/fa d2/d3/f12 0 2024-09-21T00:56:24.287 INFO:tasks.workunit.client.1.smithi187.stdout:2/42: creat d2/dc/f13 x:0 0 0 2024-09-21T00:56:24.287 INFO:tasks.workunit.client.1.smithi187.stdout:9/56: getdents d4/d8 0 2024-09-21T00:56:24.288 INFO:tasks.workunit.client.1.smithi187.stdout:9/57: dread - d4/f5 zero size 2024-09-21T00:56:24.288 INFO:tasks.workunit.client.1.smithi187.stdout:9/58: chown l1 4037 1 2024-09-21T00:56:24.288 INFO:tasks.workunit.client.1.smithi187.stdout:2/43: unlink d2/d3/l6 0 2024-09-21T00:56:24.289 INFO:tasks.workunit.client.1.smithi187.stdout:2/44: chown d2/f8 4 1 2024-09-21T00:56:24.290 INFO:tasks.workunit.client.1.smithi187.stdout:9/59: dread d4/d8/fb [0,4194304] 0 2024-09-21T00:56:24.290 INFO:tasks.workunit.client.1.smithi187.stdout:2/45: mknod d2/dc/c14 0 2024-09-21T00:56:24.292 INFO:tasks.workunit.client.1.smithi187.stdout:9/60: unlink d4/d8/ld 0 2024-09-21T00:56:24.294 INFO:tasks.workunit.client.1.smithi187.stdout:9/61: symlink d4/d8/lf 0 2024-09-21T00:56:24.295 INFO:tasks.workunit.client.1.smithi187.stdout:9/62: mkdir d4/d10 0 2024-09-21T00:56:24.296 INFO:tasks.workunit.client.1.smithi187.stdout:9/63: dread - d4/f9 zero size 2024-09-21T00:56:24.297 INFO:tasks.workunit.client.1.smithi187.stdout:2/46: truncate d2/d3/f12 1012524 0 2024-09-21T00:56:24.298 INFO:tasks.workunit.client.1.smithi187.stdout:2/47: write d2/f7 [534991,36784] 0 2024-09-21T00:56:24.302 INFO:tasks.workunit.client.1.smithi187.stdout:9/64: dwrite d4/f7 [4194304,4194304] 0 2024-09-21T00:56:24.308 INFO:tasks.workunit.client.1.smithi187.stdout:9/65: creat d4/d10/f11 x:0 0 0 2024-09-21T00:56:24.310 INFO:tasks.workunit.client.1.smithi187.stdout:9/66: fdatasync d4/d8/fb 0 2024-09-21T00:56:24.311 INFO:tasks.workunit.client.1.smithi187.stdout:9/67: fsync d4/d8/fb 0 2024-09-21T00:56:24.313 INFO:tasks.workunit.client.1.smithi187.stdout:9/68: symlink d4/d8/l12 0 2024-09-21T00:56:24.320 INFO:tasks.workunit.client.1.smithi187.stdout:9/69: dwrite d4/f5 [0,4194304] 0 2024-09-21T00:56:24.322 INFO:tasks.workunit.client.1.smithi187.stdout:9/70: mkdir d4/d13 0 2024-09-21T00:56:24.325 INFO:tasks.workunit.client.1.smithi187.stdout:9/71: mkdir d4/d13/d14 0 2024-09-21T00:56:24.332 INFO:tasks.workunit.client.1.smithi187.stdout:9/72: dwrite d4/f5 [0,4194304] 0 2024-09-21T00:56:24.335 INFO:tasks.workunit.client.1.smithi187.stdout:9/73: rename d4/d8/l12 to d4/d8/l15 0 2024-09-21T00:56:24.336 INFO:tasks.workunit.client.1.smithi187.stdout:9/74: rename d4/d8 to d4/d8/d16 22 2024-09-21T00:56:24.337 INFO:tasks.workunit.client.1.smithi187.stdout:9/75: rmdir d4 39 2024-09-21T00:56:24.339 INFO:tasks.workunit.client.1.smithi187.stdout:9/76: write d4/f7 [126252,32116] 0 2024-09-21T00:56:24.343 INFO:tasks.workunit.client.1.smithi187.stdout:9/77: symlink d4/d13/l17 0 2024-09-21T00:56:24.346 INFO:tasks.workunit.client.1.smithi187.stdout:9/78: creat d4/d13/d14/f18 x:0 0 0 2024-09-21T00:56:24.350 INFO:tasks.workunit.client.1.smithi187.stdout:9/79: creat d4/d8/f19 x:0 0 0 2024-09-21T00:56:24.351 INFO:tasks.workunit.client.1.smithi187.stdout:9/80: stat d4/f7 0 2024-09-21T00:56:24.353 INFO:tasks.workunit.client.1.smithi187.stdout:9/81: creat d4/f1a x:0 0 0 2024-09-21T00:56:24.354 INFO:tasks.workunit.client.1.smithi187.stdout:9/82: mknod d4/d13/d14/c1b 0 2024-09-21T00:56:24.355 INFO:tasks.workunit.client.1.smithi187.stdout:9/83: read d4/f7 [7637071,60460] 0 2024-09-21T00:56:24.358 INFO:tasks.workunit.client.1.smithi187.stdout:9/84: mknod d4/d8/c1c 0 2024-09-21T00:56:24.490 INFO:tasks.workunit.client.1.smithi187.stdout:2/48: truncate d2/fa 1688418 0 2024-09-21T00:56:24.511 INFO:tasks.workunit.client.1.smithi187.stdout:9/85: truncate d4/f7 5807782 0 2024-09-21T00:56:24.512 INFO:tasks.workunit.client.1.smithi187.stdout:9/86: write d4/f1a [890394,87289] 0 2024-09-21T00:56:24.517 INFO:tasks.workunit.client.1.smithi187.stdout:9/87: dwrite d4/d8/f19 [0,4194304] 0 2024-09-21T00:56:24.521 INFO:tasks.workunit.client.1.smithi187.stdout:9/88: mkdir d4/d13/d14/d1d 0 2024-09-21T00:56:24.525 INFO:tasks.workunit.client.1.smithi187.stdout:9/89: creat d4/d13/d14/f1e x:0 0 0 2024-09-21T00:56:24.533 INFO:tasks.workunit.client.1.smithi187.stdout:9/90: link d4/d13/d14/c1b d4/d8/c1f 0 2024-09-21T00:56:24.535 INFO:tasks.workunit.client.1.smithi187.stdout:9/91: rmdir d4/d10 39 2024-09-21T00:56:24.538 INFO:tasks.workunit.client.1.smithi187.stdout:9/92: write d4/d10/f11 [9063,90469] 0 2024-09-21T00:56:24.540 INFO:tasks.workunit.client.1.smithi187.stdout:9/93: mkdir d4/d13/d20 0 2024-09-21T00:56:24.544 INFO:tasks.workunit.client.1.smithi187.stdout:9/94: symlink d4/l21 0 2024-09-21T00:56:24.550 INFO:tasks.workunit.client.1.smithi187.stdout:9/95: dwrite d4/f1a [0,4194304] 0 2024-09-21T00:56:24.550 INFO:tasks.workunit.client.1.smithi187.stdout:9/96: readlink d4/d8/la 0 2024-09-21T00:56:24.551 INFO:tasks.workunit.client.1.smithi187.stdout:9/97: dread - d4/f9 zero size 2024-09-21T00:56:24.555 INFO:tasks.workunit.client.1.smithi187.stdout:9/98: creat d4/d8/f22 x:0 0 0 2024-09-21T00:56:24.582 INFO:tasks.workunit.client.1.smithi187.stdout:2/49: fsync d2/fa 0 2024-09-21T00:56:24.584 INFO:tasks.workunit.client.1.smithi187.stdout:2/50: dread d2/d3/f12 [0,4194304] 0 2024-09-21T00:56:24.585 INFO:tasks.workunit.client.1.smithi187.stdout:2/51: dread - d2/dc/f13 zero size 2024-09-21T00:56:24.586 INFO:tasks.workunit.client.1.smithi187.stdout:2/52: mkdir d2/d3/d15 0 2024-09-21T00:56:24.587 INFO:tasks.workunit.client.1.smithi187.stdout:2/53: stat d2/dc 0 2024-09-21T00:56:24.593 INFO:tasks.workunit.client.1.smithi187.stdout:2/54: dwrite d2/dc/f13 [0,4194304] 0 2024-09-21T00:56:24.650 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:24 smithi112 ceph-mon[28078]: pgmap v15: 65 pgs: 65 active+clean; 191 MiB data, 795 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 324 op/s 2024-09-21T00:56:24.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:24 smithi187 ceph-mon[34997]: pgmap v15: 65 pgs: 65 active+clean; 191 MiB data, 795 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 324 op/s 2024-09-21T00:56:25.763 INFO:tasks.workunit.client.1.smithi187.stdout:4/6: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:7/18: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:1/36: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:3/5: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:8/5: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:6/22: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:5/7: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:2/55: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:9/99: sync 2024-09-21T00:56:25.764 INFO:tasks.workunit.client.1.smithi187.stdout:0/10: sync 2024-09-21T00:56:25.765 INFO:tasks.workunit.client.1.smithi187.stdout:8/6: fdatasync f0 0 2024-09-21T00:56:25.765 INFO:tasks.workunit.client.1.smithi187.stdout:2/56: chown d2/fa 1763 1 2024-09-21T00:56:25.765 INFO:tasks.workunit.client.1.smithi187.stdout:3/6: truncate f1 4222449 0 2024-09-21T00:56:25.766 INFO:tasks.workunit.client.1.smithi187.stdout:3/7: chown f2 546519765 1 2024-09-21T00:56:25.766 INFO:tasks.workunit.client.1.smithi187.stdout:2/57: read d2/f7 [188227,42952] 0 2024-09-21T00:56:25.768 INFO:tasks.workunit.client.1.smithi187.stdout:5/8: mknod d0/c3 0 2024-09-21T00:56:25.768 INFO:tasks.workunit.client.1.smithi187.stdout:5/9: stat d0 0 2024-09-21T00:56:25.768 INFO:tasks.workunit.client.1.smithi187.stdout:5/10: write d0/f2 [699367,51719] 0 2024-09-21T00:56:25.769 INFO:tasks.workunit.client.1.smithi187.stdout:5/11: write d0/f2 [291686,50868] 0 2024-09-21T00:56:25.769 INFO:tasks.workunit.client.1.smithi187.stdout:4/7: mkdir d2/d4 0 2024-09-21T00:56:25.770 INFO:tasks.workunit.client.1.smithi187.stdout:4/8: fsync f0 0 2024-09-21T00:56:25.771 INFO:tasks.workunit.client.1.smithi187.stdout:7/19: unlink d1/f4 0 2024-09-21T00:56:25.772 INFO:tasks.workunit.client.1.smithi187.stdout:7/20: readlink - no filename 2024-09-21T00:56:25.773 INFO:tasks.workunit.client.1.smithi187.stdout:0/11: creat d0/f2 x:0 0 0 2024-09-21T00:56:25.774 INFO:tasks.workunit.client.1.smithi187.stdout:9/100: creat d4/d10/f23 x:0 0 0 2024-09-21T00:56:25.774 INFO:tasks.workunit.client.1.smithi187.stdout:0/12: chown d0/f2 283 1 2024-09-21T00:56:25.776 INFO:tasks.workunit.client.1.smithi187.stdout:3/8: creat f3 x:0 0 0 2024-09-21T00:56:25.776 INFO:tasks.workunit.client.1.smithi187.stdout:9/101: dread - d4/d10/f23 zero size 2024-09-21T00:56:25.778 INFO:tasks.workunit.client.1.smithi187.stdout:5/12: mknod d0/c4 0 2024-09-21T00:56:25.778 INFO:tasks.workunit.client.1.smithi187.stdout:3/9: truncate f1 4432578 0 2024-09-21T00:56:25.780 INFO:tasks.workunit.client.1.smithi187.stdout:3/10: read - f2 zero size 2024-09-21T00:56:25.782 INFO:tasks.workunit.client.1.smithi187.stdout:4/9: dwrite f1 [0,4194304] 0 2024-09-21T00:56:25.786 INFO:tasks.workunit.client.1.smithi187.stdout:2/58: truncate d2/d3/f12 896738 0 2024-09-21T00:56:25.786 INFO:tasks.workunit.client.1.smithi187.stdout:0/13: dwrite d0/f2 [0,4194304] 0 2024-09-21T00:56:25.789 INFO:tasks.workunit.client.1.smithi187.stdout:8/7: rmdir d1 0 2024-09-21T00:56:25.792 INFO:tasks.workunit.client.1.smithi187.stdout:5/13: creat d0/f5 x:0 0 0 2024-09-21T00:56:25.794 INFO:tasks.workunit.client.1.smithi187.stdout:0/14: dwrite d0/f2 [0,4194304] 0 2024-09-21T00:56:25.794 INFO:tasks.workunit.client.1.smithi187.stdout:0/15: stat d0 0 2024-09-21T00:56:25.795 INFO:tasks.workunit.client.1.smithi187.stdout:8/8: dread f0 [0,4194304] 0 2024-09-21T00:56:25.799 INFO:tasks.workunit.client.1.smithi187.stdout:8/9: dread f0 [0,4194304] 0 2024-09-21T00:56:25.799 INFO:tasks.workunit.client.1.smithi187.stdout:8/10: write f0 [4243675,2366] 0 2024-09-21T00:56:25.802 INFO:tasks.workunit.client.1.smithi187.stdout:8/11: dread f0 [0,4194304] 0 2024-09-21T00:56:25.803 INFO:tasks.workunit.client.1.smithi187.stdout:3/11: rename f1 to f4 0 2024-09-21T00:56:25.811 INFO:tasks.workunit.client.1.smithi187.stdout:3/12: dwrite f2 [0,4194304] 0 2024-09-21T00:56:25.813 INFO:tasks.workunit.client.1.smithi187.stdout:2/59: creat d2/d3/f16 x:0 0 0 2024-09-21T00:56:25.816 INFO:tasks.workunit.client.1.smithi187.stdout:5/14: rmdir d0 39 2024-09-21T00:56:25.819 INFO:tasks.workunit.client.1.smithi187.stdout:1/37: getdents d4/d6 0 2024-09-21T00:56:25.823 INFO:tasks.workunit.client.1.smithi187.stdout:9/102: truncate d4/d8/fb 101597 0 2024-09-21T00:56:25.824 INFO:tasks.workunit.client.1.smithi187.stdout:9/103: read d4/d8/f19 [2044012,81296] 0 2024-09-21T00:56:25.826 INFO:tasks.workunit.client.1.smithi187.stdout:8/12: creat f2 x:0 0 0 2024-09-21T00:56:25.835 INFO:tasks.workunit.client.1.smithi187.stdout:3/13: mknod c5 0 2024-09-21T00:56:25.835 INFO:tasks.workunit.client.1.smithi187.stdout:3/14: readlink - no filename 2024-09-21T00:56:25.837 INFO:tasks.workunit.client.1.smithi187.stdout:2/60: mkdir d2/dc/d17 0 2024-09-21T00:56:25.839 INFO:tasks.workunit.client.1.smithi187.stdout:3/15: dread f2 [0,4194304] 0 2024-09-21T00:56:25.839 INFO:tasks.workunit.client.1.smithi187.stdout:3/16: write f3 [859480,103482] 0 2024-09-21T00:56:25.840 INFO:tasks.workunit.client.1.smithi187.stdout:3/17: write f2 [3916373,83711] 0 2024-09-21T00:56:25.840 INFO:tasks.workunit.client.1.smithi187.stdout:1/38: mkdir d4/d6/dc 0 2024-09-21T00:56:25.841 INFO:tasks.workunit.client.1.smithi187.stdout:3/18: read f2 [4120453,79184] 0 2024-09-21T00:56:25.844 INFO:tasks.workunit.client.1.smithi187.stdout:1/39: dread f3 [0,4194304] 0 2024-09-21T00:56:25.845 INFO:tasks.workunit.client.1.smithi187.stdout:1/40: truncate f3 4898446 0 2024-09-21T00:56:25.847 INFO:tasks.workunit.client.1.smithi187.stdout:9/104: mkdir d4/d10/d24 0 2024-09-21T00:56:25.848 INFO:tasks.workunit.client.1.smithi187.stdout:8/13: fsync f0 0 2024-09-21T00:56:25.848 INFO:tasks.workunit.client.1.smithi187.stdout:8/14: readlink - no filename 2024-09-21T00:56:25.851 INFO:tasks.workunit.client.1.smithi187.stdout:4/10: rmdir d2/d4 0 2024-09-21T00:56:25.866 INFO:tasks.workunit.client.1.smithi187.stdout:8/15: mknod c3 0 2024-09-21T00:56:25.866 INFO:tasks.workunit.client.1.smithi187.stdout:8/16: rmdir - no directory 2024-09-21T00:56:25.869 INFO:tasks.workunit.client.1.smithi187.stdout:2/61: mknod d2/d3/df/c18 0 2024-09-21T00:56:25.878 INFO:tasks.workunit.client.1.smithi187.stdout:6/23: sync 2024-09-21T00:56:25.879 INFO:tasks.workunit.client.1.smithi187.stdout:6/24: write f1 [1503873,118327] 0 2024-09-21T00:56:25.879 INFO:tasks.workunit.client.1.smithi187.stdout:2/62: truncate d2/fb 891969 0 2024-09-21T00:56:25.884 INFO:tasks.workunit.client.1.smithi187.stdout:6/25: rename f2 to f5 0 2024-09-21T00:56:25.969 INFO:tasks.workunit.client.1.smithi187.stdout:8/17: sync 2024-09-21T00:56:25.969 INFO:tasks.workunit.client.1.smithi187.stdout:8/18: rmdir - no directory 2024-09-21T00:56:25.969 INFO:tasks.workunit.client.1.smithi187.stdout:8/19: rmdir - no directory 2024-09-21T00:56:25.970 INFO:tasks.workunit.client.1.smithi187.stdout:8/20: write f0 [178154,98398] 0 2024-09-21T00:56:25.973 INFO:tasks.workunit.client.1.smithi187.stdout:8/21: creat f4 x:0 0 0 2024-09-21T00:56:25.973 INFO:tasks.workunit.client.1.smithi187.stdout:8/22: chown f2 117354019 1 2024-09-21T00:56:25.974 INFO:tasks.workunit.client.1.smithi187.stdout:8/23: read f0 [213822,79497] 0 2024-09-21T00:56:25.979 INFO:tasks.workunit.client.1.smithi187.stdout:8/24: symlink l5 0 2024-09-21T00:56:25.979 INFO:tasks.workunit.client.1.smithi187.stdout:8/25: fdatasync f2 0 2024-09-21T00:56:25.990 INFO:tasks.workunit.client.1.smithi187.stdout:8/26: link l5 l6 0 2024-09-21T00:56:25.992 INFO:tasks.workunit.client.1.smithi187.stdout:8/27: fsync f0 0 2024-09-21T00:56:25.992 INFO:tasks.workunit.client.1.smithi187.stdout:8/28: write f0 [1719070,49894] 0 2024-09-21T00:56:25.997 INFO:tasks.workunit.client.1.smithi187.stdout:8/29: rename f4 to f7 0 2024-09-21T00:56:26.004 INFO:tasks.workunit.client.1.smithi187.stdout:8/30: dwrite f7 [0,4194304] 0 2024-09-21T00:56:26.006 INFO:tasks.workunit.client.1.smithi187.stdout:8/31: creat f8 x:0 0 0 2024-09-21T00:56:26.013 INFO:tasks.workunit.client.1.smithi187.stdout:8/32: dwrite f2 [0,4194304] 0 2024-09-21T00:56:26.014 INFO:tasks.workunit.client.1.smithi187.stdout:8/33: read f7 [937557,103294] 0 2024-09-21T00:56:26.022 INFO:tasks.workunit.client.1.smithi187.stdout:8/34: dwrite f2 [0,4194304] 0 2024-09-21T00:56:26.024 INFO:tasks.workunit.client.1.smithi187.stdout:6/26: sync 2024-09-21T00:56:26.026 INFO:tasks.workunit.client.1.smithi187.stdout:8/35: dread f0 [0,4194304] 0 2024-09-21T00:56:26.033 INFO:tasks.workunit.client.1.smithi187.stdout:8/36: fdatasync f0 0 2024-09-21T00:56:26.036 INFO:tasks.workunit.client.1.smithi187.stdout:6/27: dwrite f5 [0,4194304] 0 2024-09-21T00:56:26.036 INFO:tasks.workunit.client.1.smithi187.stdout:6/28: readlink - no filename 2024-09-21T00:56:26.036 INFO:tasks.workunit.client.1.smithi187.stdout:6/29: write f1 [2332456,65942] 0 2024-09-21T00:56:26.042 INFO:tasks.workunit.client.1.smithi187.stdout:6/30: mknod c6 0 2024-09-21T00:56:26.045 INFO:tasks.workunit.client.1.smithi187.stdout:6/31: dread f5 [0,4194304] 0 2024-09-21T00:56:26.052 INFO:tasks.workunit.client.1.smithi187.stdout:6/32: fdatasync f5 0 2024-09-21T00:56:26.057 INFO:tasks.workunit.client.1.smithi187.stdout:6/33: dread f1 [0,4194304] 0 2024-09-21T00:56:26.092 INFO:tasks.workunit.client.1.smithi187.stdout:8/37: sync 2024-09-21T00:56:26.097 INFO:tasks.workunit.client.1.smithi187.stdout:8/38: dwrite f0 [0,4194304] 0 2024-09-21T00:56:26.103 INFO:tasks.workunit.client.1.smithi187.stdout:8/39: dwrite f8 [0,4194304] 0 2024-09-21T00:56:26.111 INFO:tasks.workunit.client.1.smithi187.stdout:8/40: dwrite f0 [0,4194304] 0 2024-09-21T00:56:26.114 INFO:tasks.workunit.client.1.smithi187.stdout:8/41: mknod c9 0 2024-09-21T00:56:26.498 INFO:tasks.workunit.client.1.smithi187.stdout:0/16: fsync d0/f2 0 2024-09-21T00:56:26.506 INFO:tasks.workunit.client.1.smithi187.stdout:2/63: read d2/d3/f12 [871680,82456] 0 2024-09-21T00:56:26.507 INFO:tasks.workunit.client.1.smithi187.stdout:7/21: dwrite d1/f2 [0,4194304] 0 2024-09-21T00:56:26.510 INFO:tasks.workunit.client.1.smithi187.stdout:5/15: fsync d0/f5 0 2024-09-21T00:56:26.516 INFO:tasks.workunit.client.1.smithi187.stdout:3/19: rename f4 to f6 0 2024-09-21T00:56:26.518 INFO:tasks.workunit.client.1.smithi187.stdout:5/16: dwrite d0/f2 [0,4194304] 0 2024-09-21T00:56:26.518 INFO:tasks.workunit.client.1.smithi187.stdout:5/17: stat d0/c3 0 2024-09-21T00:56:26.519 INFO:tasks.workunit.client.1.smithi187.stdout:5/18: truncate d0/f5 425354 0 2024-09-21T00:56:26.537 INFO:tasks.workunit.client.1.smithi187.stdout:4/11: getdents d2 0 2024-09-21T00:56:26.537 INFO:tasks.workunit.client.1.smithi187.stdout:4/12: dread - f0 zero size 2024-09-21T00:56:26.552 INFO:tasks.workunit.client.1.smithi187.stdout:1/41: truncate d4/f7 3947615 0 2024-09-21T00:56:26.556 INFO:tasks.workunit.client.1.smithi187.stdout:2/64: mknod d2/d3/df/c19 0 2024-09-21T00:56:26.558 INFO:tasks.workunit.client.1.smithi187.stdout:9/105: dwrite d4/f7 [4194304,4194304] 0 2024-09-21T00:56:26.558 INFO:tasks.workunit.client.1.smithi187.stdout:2/65: write d2/d3/f16 [1020975,62532] 0 2024-09-21T00:56:26.559 INFO:tasks.workunit.client.1.smithi187.stdout:7/22: chown d1/c3 106575575 1 2024-09-21T00:56:26.559 INFO:tasks.workunit.client.1.smithi187.stdout:9/106: dread - d4/d13/d14/f18 zero size 2024-09-21T00:56:26.559 INFO:tasks.workunit.client.1.smithi187.stdout:7/23: fdatasync d1/f9 0 2024-09-21T00:56:26.566 INFO:tasks.workunit.client.1.smithi187.stdout:7/24: dread d1/f2 [0,4194304] 0 2024-09-21T00:56:26.567 INFO:tasks.workunit.client.1.smithi187.stdout:5/19: rename d0/c3 to d0/c6 0 2024-09-21T00:56:26.567 INFO:tasks.workunit.client.1.smithi187.stdout:7/25: stat d1/f9 0 2024-09-21T00:56:26.567 INFO:tasks.workunit.client.1.smithi187.stdout:9/107: dwrite d4/f7 [0,4194304] 0 2024-09-21T00:56:26.568 INFO:tasks.workunit.client.1.smithi187.stdout:9/108: dread - d4/d13/d14/f1e zero size 2024-09-21T00:56:26.577 INFO:tasks.workunit.client.1.smithi187.stdout:4/13: creat d2/f5 x:0 0 0 2024-09-21T00:56:26.578 INFO:tasks.workunit.client.1.smithi187.stdout:4/14: write f0 [998877,47086] 0 2024-09-21T00:56:26.591 INFO:tasks.workunit.client.1.smithi187.stdout:3/20: link f6 f7 0 2024-09-21T00:56:26.594 INFO:tasks.workunit.client.1.smithi187.stdout:7/26: creat d1/fa x:0 0 0 2024-09-21T00:56:26.596 INFO:tasks.workunit.client.1.smithi187.stdout:5/20: rename d0/f5 to d0/f7 0 2024-09-21T00:56:26.596 INFO:tasks.workunit.client.1.smithi187.stdout:5/21: write d0/f2 [2215280,52579] 0 2024-09-21T00:56:26.597 INFO:tasks.workunit.client.1.smithi187.stdout:5/22: write d0/f2 [2484227,43045] 0 2024-09-21T00:56:26.598 INFO:tasks.workunit.client.1.smithi187.stdout:5/23: stat d0/f2 0 2024-09-21T00:56:26.603 INFO:tasks.workunit.client.1.smithi187.stdout:1/42: getdents d4/d6/d8 0 2024-09-21T00:56:26.610 INFO:tasks.workunit.client.1.smithi187.stdout:3/21: write f6 [2948876,111889] 0 2024-09-21T00:56:26.611 INFO:tasks.workunit.client.1.smithi187.stdout:0/17: sync 2024-09-21T00:56:26.612 INFO:tasks.workunit.client.1.smithi187.stdout:0/18: write d0/f2 [2716997,46962] 0 2024-09-21T00:56:26.613 INFO:tasks.workunit.client.1.smithi187.stdout:7/27: symlink d1/lb 0 2024-09-21T00:56:26.619 INFO:tasks.workunit.client.1.smithi187.stdout:9/109: creat d4/d13/d14/d1d/f25 x:0 0 0 2024-09-21T00:56:26.624 INFO:tasks.workunit.client.1.smithi187.stdout:6/34: write f5 [4847337,63017] 0 2024-09-21T00:56:26.624 INFO:tasks.workunit.client.1.smithi187.stdout:4/15: getdents d2/d3 0 2024-09-21T00:56:26.624 INFO:tasks.workunit.client.1.smithi187.stdout:4/16: chown d2 307 1 2024-09-21T00:56:26.626 INFO:tasks.workunit.client.1.smithi187.stdout:1/43: write d4/fb [648685,96151] 0 2024-09-21T00:56:26.628 INFO:tasks.workunit.client.1.smithi187.stdout:3/22: symlink l8 0 2024-09-21T00:56:26.629 INFO:tasks.workunit.client.1.smithi187.stdout:0/19: rename d0/f2 to d0/f3 0 2024-09-21T00:56:26.631 INFO:tasks.workunit.client.1.smithi187.stdout:7/28: unlink d1/c8 0 2024-09-21T00:56:26.632 INFO:tasks.workunit.client.1.smithi187.stdout:7/29: chown d1/f2 0 1 2024-09-21T00:56:26.632 INFO:tasks.workunit.client.1.smithi187.stdout:7/30: stat d1/f9 0 2024-09-21T00:56:26.635 INFO:tasks.workunit.client.1.smithi187.stdout:5/24: link d0/f2 d0/f8 0 2024-09-21T00:56:26.638 INFO:tasks.workunit.client.1.smithi187.stdout:4/17: mknod d2/c6 0 2024-09-21T00:56:26.643 INFO:tasks.workunit.client.1.smithi187.stdout:3/23: dread f2 [0,4194304] 0 2024-09-21T00:56:26.645 INFO:tasks.workunit.client.1.smithi187.stdout:9/110: creat d4/d13/d20/f26 x:0 0 0 2024-09-21T00:56:26.648 INFO:tasks.workunit.client.1.smithi187.stdout:8/42: getdents . 0 2024-09-21T00:56:26.651 INFO:tasks.workunit.client.1.smithi187.stdout:4/18: unlink f1 0 2024-09-21T00:56:26.655 INFO:tasks.workunit.client.1.smithi187.stdout:3/24: mkdir d9 0 2024-09-21T00:56:26.656 INFO:tasks.workunit.client.1.smithi187.stdout:3/25: read f7 [97247,1382] 0 2024-09-21T00:56:26.657 INFO:tasks.workunit.client.1.smithi187.stdout:9/111: mknod d4/d13/c27 0 2024-09-21T00:56:26.657 INFO:tasks.workunit.client.1.smithi187.stdout:9/112: readlink d4/d8/la 0 2024-09-21T00:56:26.658 INFO:tasks.workunit.client.1.smithi187.stdout:9/113: write d4/d10/f23 [51188,18984] 0 2024-09-21T00:56:26.660 INFO:tasks.workunit.client.1.smithi187.stdout:9/114: stat d4/d10/f23 0 2024-09-21T00:56:26.660 INFO:tasks.workunit.client.1.smithi187.stdout:8/43: mknod ca 0 2024-09-21T00:56:26.660 INFO:tasks.workunit.client.1.smithi187.stdout:3/26: dread f7 [0,4194304] 0 2024-09-21T00:56:26.665 INFO:tasks.workunit.client.1.smithi187.stdout:9/115: mkdir d4/d13/d14/d28 0 2024-09-21T00:56:26.669 INFO:tasks.workunit.client.1.smithi187.stdout:9/116: creat d4/d8/f29 x:0 0 0 2024-09-21T00:56:26.669 INFO:tasks.workunit.client.1.smithi187.stdout:9/117: dread - d4/d8/f29 zero size 2024-09-21T00:56:26.670 INFO:tasks.workunit.client.1.smithi187.stdout:9/118: dread - d4/f9 zero size 2024-09-21T00:56:26.670 INFO:tasks.workunit.client.1.smithi187.stdout:3/27: mknod d9/ca 0 2024-09-21T00:56:26.676 INFO:tasks.workunit.client.1.smithi187.stdout:9/119: mknod d4/d13/d14/d28/c2a 0 2024-09-21T00:56:26.676 INFO:tasks.workunit.client.1.smithi187.stdout:9/120: write d4/d10/f23 [276623,24989] 0 2024-09-21T00:56:26.677 INFO:tasks.workunit.client.1.smithi187.stdout:9/121: truncate d4/f5 4299316 0 2024-09-21T00:56:26.678 INFO:tasks.workunit.client.1.smithi187.stdout:9/122: write d4/d13/d14/f18 [1017725,29576] 0 2024-09-21T00:56:26.682 INFO:tasks.workunit.client.1.smithi187.stdout:9/123: mkdir d4/d13/d20/d2b 0 2024-09-21T00:56:26.684 INFO:tasks.workunit.client.1.smithi187.stdout:9/124: mkdir d4/d13/d20/d2c 0 2024-09-21T00:56:26.687 INFO:tasks.workunit.client.1.smithi187.stdout:9/125: creat d4/d13/f2d x:0 0 0 2024-09-21T00:56:26.687 INFO:tasks.workunit.client.1.smithi187.stdout:9/126: stat d4/d13/d20/d2b 0 2024-09-21T00:56:26.688 INFO:tasks.workunit.client.1.smithi187.stdout:9/127: dread - d4/d13/d14/f1e zero size 2024-09-21T00:56:26.693 INFO:tasks.workunit.client.1.smithi187.stdout:9/128: dwrite d4/d13/f2d [0,4194304] 0 2024-09-21T00:56:26.751 INFO:tasks.workunit.client.1.smithi187.stdout:0/20: sync 2024-09-21T00:56:26.754 INFO:tasks.workunit.client.1.smithi187.stdout:0/21: write d0/f1 [2505309,33494] 0 2024-09-21T00:56:26.758 INFO:tasks.workunit.client.1.smithi187.stdout:0/22: creat d0/f4 x:0 0 0 2024-09-21T00:56:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:26 smithi112 ceph-mon[28078]: pgmap v16: 65 pgs: 65 active+clean; 263 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 175 KiB/s rd, 12 MiB/s wr, 458 op/s 2024-09-21T00:56:26.793 INFO:tasks.workunit.client.1.smithi187.stdout:8/44: sync 2024-09-21T00:56:26.795 INFO:tasks.workunit.client.1.smithi187.stdout:8/45: dread f2 [0,4194304] 0 2024-09-21T00:56:26.796 INFO:tasks.workunit.client.1.smithi187.stdout:8/46: write f8 [1608140,40413] 0 2024-09-21T00:56:26.869 INFO:tasks.workunit.client.1.smithi187.stdout:8/47: sync 2024-09-21T00:56:26.870 INFO:tasks.workunit.client.1.smithi187.stdout:8/48: write f8 [2122168,66045] 0 2024-09-21T00:56:26.873 INFO:tasks.workunit.client.1.smithi187.stdout:8/49: creat fb x:0 0 0 2024-09-21T00:56:26.875 INFO:tasks.workunit.client.1.smithi187.stdout:8/50: chown l6 20320066 1 2024-09-21T00:56:26.877 INFO:tasks.workunit.client.1.smithi187.stdout:8/51: mkdir dc 0 2024-09-21T00:56:26.883 INFO:tasks.workunit.client.1.smithi187.stdout:8/52: dwrite f7 [0,4194304] 0 2024-09-21T00:56:26.883 INFO:tasks.workunit.client.1.smithi187.stdout:8/53: chown c9 234332950 1 2024-09-21T00:56:26.884 INFO:tasks.workunit.client.1.smithi187.stdout:8/54: write f0 [303748,11705] 0 2024-09-21T00:56:26.884 INFO:tasks.workunit.client.1.smithi187.stdout:8/55: chown c3 1 1 2024-09-21T00:56:26.888 INFO:tasks.workunit.client.1.smithi187.stdout:2/66: write d2/fa [378383,96168] 0 2024-09-21T00:56:26.889 INFO:tasks.workunit.client.1.smithi187.stdout:2/67: chown d2/d3/d15 180 1 2024-09-21T00:56:26.893 INFO:tasks.workunit.client.1.smithi187.stdout:3/28: rename f6 to d9/fb 0 2024-09-21T00:56:26.895 INFO:tasks.workunit.client.1.smithi187.stdout:3/29: mknod d9/cc 0 2024-09-21T00:56:26.897 INFO:tasks.workunit.client.1.smithi187.stdout:2/68: dwrite d2/fa [0,4194304] 0 2024-09-21T00:56:26.898 INFO:tasks.workunit.client.1.smithi187.stdout:8/56: rename fb to dc/fd 0 2024-09-21T00:56:26.902 INFO:tasks.workunit.client.1.smithi187.stdout:3/30: dread f3 [0,4194304] 0 2024-09-21T00:56:26.905 INFO:tasks.workunit.client.1.smithi187.stdout:2/69: creat d2/dc/f1a x:0 0 0 2024-09-21T00:56:26.906 INFO:tasks.workunit.client.1.smithi187.stdout:3/31: dread f2 [0,4194304] 0 2024-09-21T00:56:26.907 INFO:tasks.workunit.client.1.smithi187.stdout:8/57: creat dc/fe x:0 0 0 2024-09-21T00:56:26.907 INFO:tasks.workunit.client.1.smithi187.stdout:3/32: dread f3 [0,4194304] 0 2024-09-21T00:56:26.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:26 smithi187 ceph-mon[34997]: pgmap v16: 65 pgs: 65 active+clean; 263 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 175 KiB/s rd, 12 MiB/s wr, 458 op/s 2024-09-21T00:56:26.910 INFO:tasks.workunit.client.1.smithi187.stdout:3/33: dread d9/fb [0,4194304] 0 2024-09-21T00:56:26.912 INFO:tasks.workunit.client.1.smithi187.stdout:8/58: write f2 [52764,53354] 0 2024-09-21T00:56:26.914 INFO:tasks.workunit.client.1.smithi187.stdout:8/59: symlink dc/lf 0 2024-09-21T00:56:26.919 INFO:tasks.workunit.client.1.smithi187.stdout:2/70: fsync d2/d3/f12 0 2024-09-21T00:56:26.919 INFO:tasks.workunit.client.1.smithi187.stdout:8/60: creat dc/f10 x:0 0 0 2024-09-21T00:56:26.919 INFO:tasks.workunit.client.1.smithi187.stdout:3/34: link f2 d9/fd 0 2024-09-21T00:56:26.923 INFO:tasks.workunit.client.1.smithi187.stdout:8/61: mknod dc/c11 0 2024-09-21T00:56:26.923 INFO:tasks.workunit.client.1.smithi187.stdout:8/62: read f8 [3421613,100768] 0 2024-09-21T00:56:26.924 INFO:tasks.workunit.client.1.smithi187.stdout:8/63: write dc/fe [323055,35424] 0 2024-09-21T00:56:26.925 INFO:tasks.workunit.client.1.smithi187.stdout:8/64: chown dc/fe 394637424 1 2024-09-21T00:56:26.927 INFO:tasks.workunit.client.1.smithi187.stdout:2/71: mkdir d2/d3/d15/d1b 0 2024-09-21T00:56:26.929 INFO:tasks.workunit.client.1.smithi187.stdout:3/35: dread f2 [0,4194304] 0 2024-09-21T00:56:26.931 INFO:tasks.workunit.client.1.smithi187.stdout:8/65: dwrite f7 [0,4194304] 0 2024-09-21T00:56:26.934 INFO:tasks.workunit.client.1.smithi187.stdout:2/72: mkdir d2/d3/d15/d1b/d1c 0 2024-09-21T00:56:26.934 INFO:tasks.workunit.client.1.smithi187.stdout:2/73: chown d2/dc/d17 244241 1 2024-09-21T00:56:26.937 INFO:tasks.workunit.client.1.smithi187.stdout:8/66: dread f2 [0,4194304] 0 2024-09-21T00:56:26.938 INFO:tasks.workunit.client.1.smithi187.stdout:1/44: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:26.939 INFO:tasks.workunit.client.1.smithi187.stdout:1/45: read d4/f7 [1692517,49300] 0 2024-09-21T00:56:26.950 INFO:tasks.workunit.client.1.smithi187.stdout:5/25: fsync d0/f7 0 2024-09-21T00:56:26.956 INFO:tasks.workunit.client.1.smithi187.stdout:7/31: truncate d1/f7 1691797 0 2024-09-21T00:56:26.959 INFO:tasks.workunit.client.1.smithi187.stdout:7/32: unlink d1/c3 0 2024-09-21T00:56:26.961 INFO:tasks.workunit.client.1.smithi187.stdout:7/33: mkdir d1/dc 0 2024-09-21T00:56:26.962 INFO:tasks.workunit.client.1.smithi187.stdout:7/34: write d1/fa [624156,86110] 0 2024-09-21T00:56:26.965 INFO:tasks.workunit.client.1.smithi187.stdout:7/35: chown d1/f7 0 1 2024-09-21T00:56:26.965 INFO:tasks.workunit.client.1.smithi187.stdout:7/36: write d1/f9 [228937,78210] 0 2024-09-21T00:56:26.971 INFO:tasks.workunit.client.1.smithi187.stdout:7/37: rename d1/c6 to d1/dc/cd 0 2024-09-21T00:56:26.976 INFO:tasks.workunit.client.1.smithi187.stdout:0/23: unlink d0/f3 0 2024-09-21T00:56:26.979 INFO:tasks.workunit.client.1.smithi187.stdout:0/24: creat d0/f5 x:0 0 0 2024-09-21T00:56:26.980 INFO:tasks.workunit.client.1.smithi187.stdout:0/25: chown d0 289 1 2024-09-21T00:56:26.981 INFO:tasks.workunit.client.1.smithi187.stdout:0/26: mknod d0/c6 0 2024-09-21T00:56:26.982 INFO:tasks.workunit.client.1.smithi187.stdout:5/26: fsync d0/f8 0 2024-09-21T00:56:26.982 INFO:tasks.workunit.client.1.smithi187.stdout:5/27: readlink - no filename 2024-09-21T00:56:26.982 INFO:tasks.workunit.client.1.smithi187.stdout:5/28: write d0/f7 [1251205,88119] 0 2024-09-21T00:56:26.984 INFO:tasks.workunit.client.1.smithi187.stdout:0/27: rename d0/f5 to d0/f7 0 2024-09-21T00:56:26.985 INFO:tasks.workunit.client.1.smithi187.stdout:4/19: getdents d2 0 2024-09-21T00:56:26.985 INFO:tasks.workunit.client.1.smithi187.stdout:4/20: chown f0 538818691 1 2024-09-21T00:56:26.987 INFO:tasks.workunit.client.1.smithi187.stdout:5/29: creat d0/f9 x:0 0 0 2024-09-21T00:56:26.988 INFO:tasks.workunit.client.1.smithi187.stdout:4/21: rename d2/c6 to d2/c7 0 2024-09-21T00:56:26.991 INFO:tasks.workunit.client.1.smithi187.stdout:5/30: rename d0/f8 to d0/fa 0 2024-09-21T00:56:26.994 INFO:tasks.workunit.client.1.smithi187.stdout:4/22: dwrite d2/f5 [0,4194304] 0 2024-09-21T00:56:26.995 INFO:tasks.workunit.client.1.smithi187.stdout:5/31: mknod d0/cb 0 2024-09-21T00:56:26.996 INFO:tasks.workunit.client.1.smithi187.stdout:6/35: truncate f1 2343653 0 2024-09-21T00:56:26.997 INFO:tasks.workunit.client.1.smithi187.stdout:4/23: symlink d2/l8 0 2024-09-21T00:56:26.999 INFO:tasks.workunit.client.1.smithi187.stdout:5/32: mkdir d0/dc 0 2024-09-21T00:56:27.001 INFO:tasks.workunit.client.1.smithi187.stdout:4/24: dread d2/f5 [0,4194304] 0 2024-09-21T00:56:27.002 INFO:tasks.workunit.client.1.smithi187.stdout:6/36: mkdir d7 0 2024-09-21T00:56:27.006 INFO:tasks.workunit.client.1.smithi187.stdout:5/33: mkdir d0/dd 0 2024-09-21T00:56:27.006 INFO:tasks.workunit.client.1.smithi187.stdout:5/34: truncate d0/f2 4876821 0 2024-09-21T00:56:27.007 INFO:tasks.workunit.client.1.smithi187.stdout:4/25: unlink f0 0 2024-09-21T00:56:27.012 INFO:tasks.workunit.client.1.smithi187.stdout:6/37: creat d7/f8 x:0 0 0 2024-09-21T00:56:27.013 INFO:tasks.workunit.client.1.smithi187.stdout:4/26: rename d2/l8 to d2/l9 0 2024-09-21T00:56:27.014 INFO:tasks.workunit.client.1.smithi187.stdout:5/35: mknod d0/dd/ce 0 2024-09-21T00:56:27.016 INFO:tasks.workunit.client.1.smithi187.stdout:4/27: dread d2/f5 [0,4194304] 0 2024-09-21T00:56:27.022 INFO:tasks.workunit.client.1.smithi187.stdout:4/28: mkdir d2/d3/da 0 2024-09-21T00:56:27.024 INFO:tasks.workunit.client.1.smithi187.stdout:4/29: write d2/f5 [2102187,4317] 0 2024-09-21T00:56:27.024 INFO:tasks.workunit.client.1.smithi187.stdout:4/30: chown d2/d3/da 151 1 2024-09-21T00:56:27.027 INFO:tasks.workunit.client.1.smithi187.stdout:2/74: sync 2024-09-21T00:56:27.030 INFO:tasks.workunit.client.1.smithi187.stdout:2/75: dread d2/dc/f13 [0,4194304] 0 2024-09-21T00:56:27.032 INFO:tasks.workunit.client.0.smithi112.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T00:56:27.033 INFO:tasks.workunit.client.1.smithi187.stdout:2/76: mkdir d2/d3/d15/d1b/d1c/d1d 0 2024-09-21T00:56:27.035 INFO:tasks.workunit.client.1.smithi187.stdout:2/77: symlink d2/d3/df/l1e 0 2024-09-21T00:56:27.038 INFO:tasks.workunit.client.1.smithi187.stdout:2/78: creat d2/d3/d15/d1b/d1c/f1f x:0 0 0 2024-09-21T00:56:27.038 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T00:56:27.038 INFO:tasks.workunit.client.0.smithi112.stderr:+ make 2024-09-21T00:56:27.040 INFO:tasks.workunit.client.1.smithi187.stdout:2/79: creat d2/d3/d15/d1b/d1c/d1d/f20 x:0 0 0 2024-09-21T00:56:27.041 INFO:tasks.workunit.client.1.smithi187.stdout:2/80: write d2/f8 [384010,97426] 0 2024-09-21T00:56:27.042 INFO:tasks.workunit.client.1.smithi187.stdout:2/81: fdatasync d2/d3/d15/d1b/d1c/f1f 0 2024-09-21T00:56:27.045 INFO:tasks.workunit.client.1.smithi187.stdout:2/82: mkdir d2/dc/d21 0 2024-09-21T00:56:27.047 INFO:tasks.workunit.client.1.smithi187.stdout:2/83: creat d2/d3/d15/d1b/f22 x:0 0 0 2024-09-21T00:56:27.049 INFO:tasks.workunit.client.1.smithi187.stdout:2/84: mknod d2/d3/d15/c23 0 2024-09-21T00:56:27.050 INFO:tasks.workunit.client.1.smithi187.stdout:9/129: write d4/d8/fb [796205,12703] 0 2024-09-21T00:56:27.055 INFO:tasks.workunit.client.1.smithi187.stdout:2/85: dwrite d2/d3/d15/d1b/d1c/d1d/f20 [0,4194304] 0 2024-09-21T00:56:27.056 INFO:tasks.workunit.client.1.smithi187.stdout:2/86: dread - d2/dc/f1a zero size 2024-09-21T00:56:27.057 INFO:tasks.workunit.client.1.smithi187.stdout:2/87: dread - d2/dc/f1a zero size 2024-09-21T00:56:27.062 INFO:tasks.workunit.client.1.smithi187.stdout:9/130: getdents d4/d10 0 2024-09-21T00:56:27.065 INFO:tasks.workunit.client.1.smithi187.stdout:2/88: dwrite d2/d3/d15/d1b/d1c/d1d/f20 [0,4194304] 0 2024-09-21T00:56:27.073 INFO:tasks.workunit.client.1.smithi187.stdout:9/131: dwrite d4/d13/d20/f26 [0,4194304] 0 2024-09-21T00:56:27.076 INFO:tasks.workunit.client.1.smithi187.stdout:9/132: mkdir d4/d13/d20/d2e 0 2024-09-21T00:56:27.079 INFO:tasks.workunit.client.1.smithi187.stdout:9/133: chown d4/d8/c1f 5 1 2024-09-21T00:56:27.080 INFO:tasks.workunit.client.1.smithi187.stdout:9/134: write d4/d10/f23 [673093,15762] 0 2024-09-21T00:56:27.087 INFO:tasks.workunit.client.1.smithi187.stdout:9/135: dwrite d4/d8/f22 [0,4194304] 0 2024-09-21T00:56:27.090 INFO:tasks.workunit.client.1.smithi187.stdout:9/136: creat d4/d8/f2f x:0 0 0 2024-09-21T00:56:27.092 INFO:tasks.workunit.client.1.smithi187.stdout:9/137: mknod d4/d10/d24/c30 0 2024-09-21T00:56:27.093 INFO:tasks.workunit.client.1.smithi187.stdout:9/138: write d4/d13/d14/d1d/f25 [1015286,93762] 0 2024-09-21T00:56:27.097 INFO:tasks.workunit.client.1.smithi187.stdout:1/46: sync 2024-09-21T00:56:27.097 INFO:tasks.workunit.client.1.smithi187.stdout:0/28: sync 2024-09-21T00:56:27.098 INFO:tasks.workunit.client.1.smithi187.stdout:9/139: rename d4/d8/f29 to d4/d13/d14/d1d/f31 0 2024-09-21T00:56:27.098 INFO:tasks.workunit.client.1.smithi187.stdout:0/29: dread - d0/f4 zero size 2024-09-21T00:56:27.102 INFO:tasks.workunit.client.1.smithi187.stdout:0/30: creat d0/f8 x:0 0 0 2024-09-21T00:56:27.102 INFO:tasks.workunit.client.1.smithi187.stdout:0/31: truncate d0/f7 86895 0 2024-09-21T00:56:27.102 INFO:tasks.workunit.client.1.smithi187.stdout:0/32: chown d0 784699 1 2024-09-21T00:56:27.103 INFO:tasks.workunit.client.1.smithi187.stdout:0/33: write d0/f4 [454048,4771] 0 2024-09-21T00:56:27.103 INFO:tasks.workunit.client.1.smithi187.stdout:9/140: unlink d4/d10/d24/c30 0 2024-09-21T00:56:27.104 INFO:tasks.workunit.client.1.smithi187.stdout:0/34: write d0/f8 [33222,108424] 0 2024-09-21T00:56:27.105 INFO:tasks.workunit.client.1.smithi187.stdout:9/141: write d4/d8/fb [1440063,32608] 0 2024-09-21T00:56:27.108 INFO:tasks.workunit.client.1.smithi187.stdout:0/35: unlink d0/f4 0 2024-09-21T00:56:27.108 INFO:tasks.workunit.client.1.smithi187.stdout:0/36: chown d0/c6 7662631 1 2024-09-21T00:56:27.110 INFO:tasks.workunit.client.1.smithi187.stdout:0/37: mknod d0/c9 0 2024-09-21T00:56:27.112 INFO:tasks.workunit.client.1.smithi187.stdout:0/38: mknod d0/ca 0 2024-09-21T00:56:27.112 INFO:tasks.workunit.client.1.smithi187.stdout:0/39: chown d0/f8 476535887 1 2024-09-21T00:56:27.113 INFO:tasks.workunit.client.1.smithi187.stdout:0/40: fdatasync d0/f8 0 2024-09-21T00:56:27.113 INFO:tasks.workunit.client.1.smithi187.stdout:0/41: write d0/f1 [8799913,82010] 0 2024-09-21T00:56:27.114 INFO:tasks.workunit.client.1.smithi187.stdout:0/42: truncate d0/f7 268887 0 2024-09-21T00:56:27.116 INFO:tasks.workunit.client.1.smithi187.stdout:0/43: creat d0/fb x:0 0 0 2024-09-21T00:56:27.117 INFO:tasks.workunit.client.1.smithi187.stdout:0/44: write d0/f7 [742233,46097] 0 2024-09-21T00:56:27.118 INFO:tasks.workunit.client.1.smithi187.stdout:0/45: chown d0/f1 7 1 2024-09-21T00:56:27.119 INFO:tasks.workunit.client.1.smithi187.stdout:0/46: mkdir d0/dc 0 2024-09-21T00:56:27.121 INFO:tasks.workunit.client.1.smithi187.stdout:0/47: dread d0/f8 [0,4194304] 0 2024-09-21T00:56:27.127 INFO:tasks.workunit.client.1.smithi187.stdout:0/48: dwrite d0/f7 [0,4194304] 0 2024-09-21T00:56:27.129 INFO:tasks.workunit.client.1.smithi187.stdout:0/49: rename d0/c6 to d0/cd 0 2024-09-21T00:56:27.131 INFO:tasks.workunit.client.1.smithi187.stdout:0/50: dread d0/f8 [0,4194304] 0 2024-09-21T00:56:27.132 INFO:tasks.workunit.client.1.smithi187.stdout:0/51: truncate d0/fb 241943 0 2024-09-21T00:56:27.137 INFO:tasks.workunit.client.1.smithi187.stdout:8/67: getdents dc 0 2024-09-21T00:56:27.144 INFO:tasks.workunit.client.1.smithi187.stdout:7/38: fsync d1/f2 0 2024-09-21T00:56:27.148 INFO:tasks.workunit.client.1.smithi187.stdout:3/36: dwrite d9/fd [0,4194304] 0 2024-09-21T00:56:27.148 INFO:tasks.workunit.client.1.smithi187.stdout:8/68: dwrite f2 [0,4194304] 0 2024-09-21T00:56:27.152 INFO:tasks.workunit.client.1.smithi187.stdout:3/37: write f2 [472426,7578] 0 2024-09-21T00:56:27.152 INFO:tasks.workunit.client.1.smithi187.stdout:7/39: dread d1/fa [0,4194304] 0 2024-09-21T00:56:27.153 INFO:tasks.workunit.client.1.smithi187.stdout:8/69: creat dc/f12 x:0 0 0 2024-09-21T00:56:27.154 INFO:tasks.workunit.client.1.smithi187.stdout:8/70: read f7 [3280730,107569] 0 2024-09-21T00:56:27.155 INFO:tasks.workunit.client.1.smithi187.stdout:5/36: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:27.157 INFO:tasks.workunit.client.1.smithi187.stdout:5/37: truncate d0/fa 5696407 0 2024-09-21T00:56:27.160 INFO:tasks.workunit.client.1.smithi187.stdout:3/38: mkdir d9/de 0 2024-09-21T00:56:27.160 INFO:tasks.workunit.client.1.smithi187.stdout:5/38: read d0/f7 [607080,8640] 0 2024-09-21T00:56:27.161 INFO:tasks.workunit.client.1.smithi187.stdout:8/71: creat dc/f13 x:0 0 0 2024-09-21T00:56:27.162 INFO:tasks.workunit.client.1.smithi187.stdout:8/72: write dc/f12 [253695,89103] 0 2024-09-21T00:56:27.163 INFO:tasks.workunit.client.1.smithi187.stdout:8/73: chown dc/fe 72092 1 2024-09-21T00:56:27.164 INFO:tasks.workunit.client.1.smithi187.stdout:8/74: read dc/fe [180285,108339] 0 2024-09-21T00:56:27.181 INFO:tasks.workunit.client.1.smithi187.stdout:0/52: rename d0/f7 to d0/dc/fe 0 2024-09-21T00:56:27.182 INFO:tasks.workunit.client.1.smithi187.stdout:3/39: creat d9/ff x:0 0 0 2024-09-21T00:56:27.182 INFO:tasks.workunit.client.1.smithi187.stdout:7/40: mknod d1/dc/ce 0 2024-09-21T00:56:27.183 INFO:tasks.workunit.client.1.smithi187.stdout:8/75: creat dc/f14 x:0 0 0 2024-09-21T00:56:27.188 INFO:tasks.workunit.client.1.smithi187.stdout:6/38: getdents d7 0 2024-09-21T00:56:27.191 INFO:tasks.workunit.client.1.smithi187.stdout:6/39: dread f5 [0,4194304] 0 2024-09-21T00:56:27.193 INFO:tasks.workunit.client.1.smithi187.stdout:6/40: dread f5 [0,4194304] 0 2024-09-21T00:56:27.217 INFO:tasks.workunit.client.1.smithi187.stdout:2/89: truncate d2/dc/f13 2913058 0 2024-09-21T00:56:27.220 INFO:tasks.workunit.client.1.smithi187.stdout:9/142: sync 2024-09-21T00:56:27.220 INFO:tasks.workunit.client.1.smithi187.stdout:2/90: dread d2/d3/f16 [0,4194304] 0 2024-09-21T00:56:27.224 INFO:tasks.workunit.client.0.smithi112.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T00:56:27.225 INFO:tasks.workunit.client.1.smithi187.stdout:1/47: dwrite d4/f7 [0,4194304] 0 2024-09-21T00:56:27.326 INFO:tasks.workunit.client.1.smithi187.stdout:0/53: fdatasync d0/dc/fe 0 2024-09-21T00:56:27.326 INFO:tasks.workunit.client.1.smithi187.stdout:7/41: fsync d1/f9 0 2024-09-21T00:56:27.327 INFO:tasks.workunit.client.1.smithi187.stdout:4/31: unlink d2/c7 0 2024-09-21T00:56:27.329 INFO:tasks.workunit.client.1.smithi187.stdout:8/76: creat dc/f15 x:0 0 0 2024-09-21T00:56:27.329 INFO:tasks.workunit.client.1.smithi187.stdout:8/77: chown dc 180640 1 2024-09-21T00:56:27.331 INFO:tasks.workunit.client.1.smithi187.stdout:2/91: mknod d2/dc/c24 0 2024-09-21T00:56:27.332 INFO:tasks.workunit.client.1.smithi187.stdout:2/92: dread - d2/d3/d15/d1b/f22 zero size 2024-09-21T00:56:27.333 INFO:tasks.workunit.client.1.smithi187.stdout:1/48: rename d4/fb to d4/d6/d8/fd 0 2024-09-21T00:56:27.333 INFO:tasks.workunit.client.1.smithi187.stdout:0/54: dwrite d0/f1 [0,4194304] 0 2024-09-21T00:56:27.336 INFO:tasks.workunit.client.1.smithi187.stdout:4/32: symlink d2/d3/lb 0 2024-09-21T00:56:27.336 INFO:tasks.workunit.client.1.smithi187.stdout:1/49: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:27.340 INFO:tasks.workunit.client.1.smithi187.stdout:8/78: mknod dc/c16 0 2024-09-21T00:56:27.341 INFO:tasks.workunit.client.1.smithi187.stdout:9/143: mknod d4/c32 0 2024-09-21T00:56:27.344 INFO:tasks.workunit.client.1.smithi187.stdout:9/144: dread d4/f1a [0,4194304] 0 2024-09-21T00:56:27.345 INFO:tasks.workunit.client.1.smithi187.stdout:9/145: stat d4/d10/d24 0 2024-09-21T00:56:27.345 INFO:tasks.workunit.client.1.smithi187.stdout:0/55: mkdir d0/dc/df 0 2024-09-21T00:56:27.346 INFO:tasks.workunit.client.1.smithi187.stdout:7/42: write d1/fa [1369851,112779] 0 2024-09-21T00:56:27.347 INFO:tasks.workunit.client.1.smithi187.stdout:3/40: rmdir d9/de 0 2024-09-21T00:56:27.347 INFO:tasks.workunit.client.1.smithi187.stdout:7/43: write d1/fa [794914,39005] 0 2024-09-21T00:56:27.348 INFO:tasks.workunit.client.1.smithi187.stdout:7/44: chown d1/dc 37 1 2024-09-21T00:56:27.349 INFO:tasks.workunit.client.1.smithi187.stdout:4/33: rename d2/f5 to d2/d3/da/fc 0 2024-09-21T00:56:27.351 INFO:tasks.workunit.client.1.smithi187.stdout:8/79: unlink ca 0 2024-09-21T00:56:27.351 INFO:tasks.workunit.client.1.smithi187.stdout:8/80: write f0 [2049202,14329] 0 2024-09-21T00:56:27.353 INFO:tasks.workunit.client.1.smithi187.stdout:2/93: mkdir d2/d25 0 2024-09-21T00:56:27.356 INFO:tasks.workunit.client.1.smithi187.stdout:3/41: fdatasync f3 0 2024-09-21T00:56:27.360 INFO:tasks.workunit.client.1.smithi187.stdout:4/34: stat d2/l9 0 2024-09-21T00:56:27.364 INFO:tasks.workunit.client.1.smithi187.stdout:2/94: rename d2/d3/f16 to d2/dc/d21/f26 0 2024-09-21T00:56:27.365 INFO:tasks.workunit.client.1.smithi187.stdout:2/95: chown d2/dc/d21 621 1 2024-09-21T00:56:27.365 INFO:tasks.workunit.client.1.smithi187.stdout:9/146: creat d4/d13/d20/d2e/f33 x:0 0 0 2024-09-21T00:56:27.366 INFO:tasks.workunit.client.1.smithi187.stdout:9/147: chown d4/d10/f23 81146198 1 2024-09-21T00:56:27.367 INFO:tasks.workunit.client.1.smithi187.stdout:0/56: truncate d0/dc/fe 2358299 0 2024-09-21T00:56:27.368 INFO:tasks.workunit.client.1.smithi187.stdout:9/148: truncate d4/d13/d14/d1d/f31 974953 0 2024-09-21T00:56:27.368 INFO:tasks.workunit.client.1.smithi187.stdout:0/57: write d0/f8 [788350,95161] 0 2024-09-21T00:56:27.369 INFO:tasks.workunit.client.1.smithi187.stdout:0/58: stat d0/dc/df 0 2024-09-21T00:56:27.370 INFO:tasks.workunit.client.1.smithi187.stdout:9/149: write d4/d13/d20/f26 [921499,90981] 0 2024-09-21T00:56:27.371 INFO:tasks.workunit.client.1.smithi187.stdout:4/35: write d2/d3/da/fc [5165861,65571] 0 2024-09-21T00:56:27.372 INFO:tasks.workunit.client.1.smithi187.stdout:0/59: dread d0/fb [0,4194304] 0 2024-09-21T00:56:27.372 INFO:tasks.workunit.client.1.smithi187.stdout:9/150: chown d4/d13/l17 1 1 2024-09-21T00:56:27.373 INFO:tasks.workunit.client.1.smithi187.stdout:4/36: rename d2/d3/da to d2/d3/da/dd 22 2024-09-21T00:56:27.374 INFO:tasks.workunit.client.1.smithi187.stdout:0/60: read d0/fb [65966,91296] 0 2024-09-21T00:56:27.374 INFO:tasks.workunit.client.1.smithi187.stdout:8/81: link dc/c16 dc/c17 0 2024-09-21T00:56:27.375 INFO:tasks.workunit.client.1.smithi187.stdout:8/82: chown c9 101034766 1 2024-09-21T00:56:27.376 INFO:tasks.workunit.client.1.smithi187.stdout:7/45: rename d1/lb to d1/lf 0 2024-09-21T00:56:27.377 INFO:tasks.workunit.client.1.smithi187.stdout:9/151: dread d4/f7 [4194304,4194304] 0 2024-09-21T00:56:27.379 INFO:tasks.workunit.client.1.smithi187.stdout:7/46: chown d1/f2 860938235 1 2024-09-21T00:56:27.380 INFO:tasks.workunit.client.1.smithi187.stdout:7/47: chown d1/f9 19494766 1 2024-09-21T00:56:27.381 INFO:tasks.workunit.client.1.smithi187.stdout:8/83: dread f7 [0,4194304] 0 2024-09-21T00:56:27.381 INFO:tasks.workunit.client.1.smithi187.stdout:9/152: unlink d4/d8/l15 0 2024-09-21T00:56:27.382 INFO:tasks.workunit.client.1.smithi187.stdout:7/48: mknod d1/dc/c10 0 2024-09-21T00:56:27.384 INFO:tasks.workunit.client.1.smithi187.stdout:9/153: mknod d4/d13/c34 0 2024-09-21T00:56:27.387 INFO:tasks.workunit.client.1.smithi187.stdout:9/154: write d4/d13/d14/d1d/f31 [913083,95540] 0 2024-09-21T00:56:27.388 INFO:tasks.workunit.client.1.smithi187.stdout:9/155: chown c2 1673 1 2024-09-21T00:56:27.390 INFO:tasks.workunit.client.1.smithi187.stdout:8/84: dwrite dc/fe [0,4194304] 0 2024-09-21T00:56:27.397 INFO:tasks.workunit.client.1.smithi187.stdout:9/156: dwrite d4/d8/f22 [4194304,4194304] 0 2024-09-21T00:56:27.399 INFO:tasks.workunit.client.1.smithi187.stdout:8/85: dwrite dc/f12 [0,4194304] 0 2024-09-21T00:56:27.400 INFO:tasks.workunit.client.1.smithi187.stdout:8/86: readlink dc/lf 0 2024-09-21T00:56:27.400 INFO:tasks.workunit.client.1.smithi187.stdout:8/87: stat l5 0 2024-09-21T00:56:27.403 INFO:tasks.workunit.client.1.smithi187.stdout:9/157: unlink d4/le 0 2024-09-21T00:56:27.406 INFO:tasks.workunit.client.1.smithi187.stdout:9/158: dread d4/d13/d20/f26 [0,4194304] 0 2024-09-21T00:56:27.409 INFO:tasks.workunit.client.1.smithi187.stdout:9/159: creat d4/d10/f35 x:0 0 0 2024-09-21T00:56:27.411 INFO:tasks.workunit.client.1.smithi187.stdout:9/160: symlink d4/d13/d14/l36 0 2024-09-21T00:56:27.414 INFO:tasks.workunit.client.1.smithi187.stdout:9/161: creat d4/d13/d20/f37 x:0 0 0 2024-09-21T00:56:27.414 INFO:tasks.workunit.client.1.smithi187.stdout:9/162: write d4/d10/f35 [904613,97273] 0 2024-09-21T00:56:27.415 INFO:tasks.workunit.client.1.smithi187.stdout:9/163: chown d4/l21 3 1 2024-09-21T00:56:27.417 INFO:tasks.workunit.client.1.smithi187.stdout:9/164: creat d4/d8/f38 x:0 0 0 2024-09-21T00:56:27.417 INFO:tasks.workunit.client.1.smithi187.stdout:9/165: dread - d4/f9 zero size 2024-09-21T00:56:27.420 INFO:tasks.workunit.client.1.smithi187.stdout:9/166: mkdir d4/d10/d39 0 2024-09-21T00:56:27.420 INFO:tasks.workunit.client.1.smithi187.stdout:9/167: dread - d4/d13/d20/d2e/f33 zero size 2024-09-21T00:56:27.424 INFO:tasks.workunit.client.1.smithi187.stdout:9/168: dread d4/d13/d14/d1d/f31 [0,4194304] 0 2024-09-21T00:56:27.426 INFO:tasks.workunit.client.1.smithi187.stdout:9/169: mkdir d4/d13/d3a 0 2024-09-21T00:56:27.431 INFO:tasks.workunit.client.1.smithi187.stdout:9/170: dwrite d4/d10/f23 [0,4194304] 0 2024-09-21T00:56:27.432 INFO:tasks.workunit.client.1.smithi187.stdout:9/171: chown c2 202059 1 2024-09-21T00:56:27.440 INFO:tasks.workunit.client.1.smithi187.stdout:9/172: creat d4/f3b x:0 0 0 2024-09-21T00:56:27.440 INFO:tasks.workunit.client.1.smithi187.stdout:9/173: dread - d4/f3b zero size 2024-09-21T00:56:27.444 INFO:tasks.workunit.client.1.smithi187.stdout:9/174: unlink d4/d8/c1f 0 2024-09-21T00:56:27.447 INFO:tasks.workunit.client.1.smithi187.stdout:9/175: rename d4/d13/d14/d1d/f25 to d4/d13/d14/d1d/f3c 0 2024-09-21T00:56:27.448 INFO:tasks.workunit.client.1.smithi187.stdout:9/176: truncate d4/d8/f38 574437 0 2024-09-21T00:56:27.448 INFO:tasks.workunit.client.1.smithi187.stdout:5/39: truncate d0/f2 3203282 0 2024-09-21T00:56:27.452 INFO:tasks.workunit.client.1.smithi187.stdout:5/40: rename d0/dd to d0/df 0 2024-09-21T00:56:27.453 INFO:tasks.workunit.client.1.smithi187.stdout:9/177: symlink d4/d13/d3a/l3d 0 2024-09-21T00:56:27.455 INFO:tasks.workunit.client.1.smithi187.stdout:5/41: creat d0/df/f10 x:0 0 0 2024-09-21T00:56:27.456 INFO:tasks.workunit.client.1.smithi187.stdout:6/41: dread f1 [0,4194304] 0 2024-09-21T00:56:27.459 INFO:tasks.workunit.client.1.smithi187.stdout:9/178: mknod d4/d10/d39/c3e 0 2024-09-21T00:56:27.460 INFO:tasks.workunit.client.1.smithi187.stdout:6/42: mkdir d7/d9 0 2024-09-21T00:56:27.464 INFO:tasks.workunit.client.1.smithi187.stdout:4/37: getdents d2/d3/da 0 2024-09-21T00:56:27.467 INFO:tasks.workunit.client.1.smithi187.stdout:6/43: dread f5 [0,4194304] 0 2024-09-21T00:56:27.468 INFO:tasks.workunit.client.1.smithi187.stdout:4/38: dread d2/d3/da/fc [4194304,4194304] 0 2024-09-21T00:56:27.468 INFO:tasks.workunit.client.1.smithi187.stdout:1/50: truncate d4/f7 4143732 0 2024-09-21T00:56:27.473 INFO:tasks.workunit.client.1.smithi187.stdout:6/44: rename c4 to d7/ca 0 2024-09-21T00:56:27.473 INFO:tasks.workunit.client.1.smithi187.stdout:4/39: rename d2 to d2/de 22 2024-09-21T00:56:27.474 INFO:tasks.workunit.client.1.smithi187.stdout:6/45: dread - d7/f8 zero size 2024-09-21T00:56:27.476 INFO:tasks.workunit.client.1.smithi187.stdout:1/51: chown d4/f7 56 1 2024-09-21T00:56:27.476 INFO:tasks.workunit.client.1.smithi187.stdout:2/96: write d2/f7 [1518016,67906] 0 2024-09-21T00:56:27.477 INFO:tasks.workunit.client.1.smithi187.stdout:0/61: dread d0/dc/fe [0,4194304] 0 2024-09-21T00:56:27.477 INFO:tasks.workunit.client.1.smithi187.stdout:6/46: rmdir d7 39 2024-09-21T00:56:27.479 INFO:tasks.workunit.client.1.smithi187.stdout:2/97: read - d2/d3/d15/d1b/d1c/f1f zero size 2024-09-21T00:56:27.481 INFO:tasks.workunit.client.1.smithi187.stdout:7/49: getdents d1/dc 0 2024-09-21T00:56:27.483 INFO:tasks.workunit.client.1.smithi187.stdout:3/42: dwrite f7 [4194304,4194304] 0 2024-09-21T00:56:27.487 INFO:tasks.workunit.client.1.smithi187.stdout:8/88: sync 2024-09-21T00:56:27.488 INFO:tasks.workunit.client.1.smithi187.stdout:0/62: unlink d0/ca 0 2024-09-21T00:56:27.489 INFO:tasks.workunit.client.1.smithi187.stdout:6/47: write d7/f8 [375984,35178] 0 2024-09-21T00:56:27.493 INFO:tasks.workunit.client.1.smithi187.stdout:4/40: dwrite d2/d3/da/fc [4194304,4194304] 0 2024-09-21T00:56:27.499 INFO:tasks.workunit.client.1.smithi187.stdout:2/98: dwrite d2/fa [0,4194304] 0 2024-09-21T00:56:27.500 INFO:tasks.workunit.client.1.smithi187.stdout:6/48: truncate f1 2541866 0 2024-09-21T00:56:27.500 INFO:tasks.workunit.client.1.smithi187.stdout:0/63: fdatasync d0/fb 0 2024-09-21T00:56:27.505 INFO:tasks.workunit.client.1.smithi187.stdout:3/43: dwrite f3 [0,4194304] 0 2024-09-21T00:56:27.508 INFO:tasks.workunit.client.1.smithi187.stdout:2/99: write d2/d3/d15/d1b/d1c/d1d/f20 [1074272,96444] 0 2024-09-21T00:56:27.509 INFO:tasks.workunit.client.1.smithi187.stdout:0/64: dread d0/f8 [0,4194304] 0 2024-09-21T00:56:27.513 INFO:tasks.workunit.client.1.smithi187.stdout:4/41: dwrite d2/d3/da/fc [4194304,4194304] 0 2024-09-21T00:56:27.513 INFO:tasks.workunit.client.1.smithi187.stdout:7/50: link d1/f2 d1/f11 0 2024-09-21T00:56:27.513 INFO:tasks.workunit.client.1.smithi187.stdout:6/49: dwrite d7/f8 [0,4194304] 0 2024-09-21T00:56:27.514 INFO:tasks.workunit.client.1.smithi187.stdout:4/42: stat d2/d3/lb 0 2024-09-21T00:56:27.515 INFO:tasks.workunit.client.1.smithi187.stdout:4/43: chown d2/d3/lb 13177435 1 2024-09-21T00:56:27.518 INFO:tasks.workunit.client.1.smithi187.stdout:3/44: symlink d9/l10 0 2024-09-21T00:56:27.519 INFO:tasks.workunit.client.1.smithi187.stdout:5/42: read d0/f2 [1440123,337] 0 2024-09-21T00:56:27.520 INFO:tasks.workunit.client.1.smithi187.stdout:2/100: mknod d2/d3/df/c27 0 2024-09-21T00:56:27.521 INFO:tasks.workunit.client.1.smithi187.stdout:5/43: read - d0/df/f10 zero size 2024-09-21T00:56:27.522 INFO:tasks.workunit.client.1.smithi187.stdout:5/44: chown d0/fa 1451400 1 2024-09-21T00:56:27.523 INFO:tasks.workunit.client.1.smithi187.stdout:0/65: rename d0/f8 to d0/dc/f10 0 2024-09-21T00:56:27.525 INFO:tasks.workunit.client.1.smithi187.stdout:7/51: creat d1/dc/f12 x:0 0 0 2024-09-21T00:56:27.530 INFO:tasks.workunit.client.1.smithi187.stdout:2/101: dwrite d2/d3/d15/d1b/f22 [0,4194304] 0 2024-09-21T00:56:27.531 INFO:tasks.workunit.client.1.smithi187.stdout:4/44: creat d2/ff x:0 0 0 2024-09-21T00:56:27.531 INFO:tasks.workunit.client.1.smithi187.stdout:2/102: stat d2/d3 0 2024-09-21T00:56:27.533 INFO:tasks.workunit.client.1.smithi187.stdout:4/45: write d2/d3/da/fc [896199,112038] 0 2024-09-21T00:56:27.533 INFO:tasks.workunit.client.1.smithi187.stdout:5/45: rmdir d0/df 39 2024-09-21T00:56:27.534 INFO:tasks.workunit.client.1.smithi187.stdout:0/66: write d0/dc/f10 [41977,62114] 0 2024-09-21T00:56:27.534 INFO:tasks.workunit.client.1.smithi187.stdout:4/46: write d2/ff [715381,91040] 0 2024-09-21T00:56:27.540 INFO:tasks.workunit.client.1.smithi187.stdout:0/67: dread d0/dc/fe [0,4194304] 0 2024-09-21T00:56:27.542 INFO:tasks.workunit.client.1.smithi187.stdout:5/46: dread - d0/df/f10 zero size 2024-09-21T00:56:27.543 INFO:tasks.workunit.client.1.smithi187.stdout:4/47: mknod d2/c10 0 2024-09-21T00:56:27.543 INFO:tasks.workunit.client.1.smithi187.stdout:1/52: read f3 [1123119,126070] 0 2024-09-21T00:56:27.543 INFO:tasks.workunit.client.1.smithi187.stdout:0/68: stat d0/dc/fe 0 2024-09-21T00:56:27.544 INFO:tasks.workunit.client.1.smithi187.stdout:0/69: chown d0/fb 144 1 2024-09-21T00:56:27.545 INFO:tasks.workunit.client.1.smithi187.stdout:4/48: write d2/d3/da/fc [234366,19678] 0 2024-09-21T00:56:27.546 INFO:tasks.workunit.client.1.smithi187.stdout:0/70: chown d0/dc/f10 1 1 2024-09-21T00:56:27.547 INFO:tasks.workunit.client.1.smithi187.stdout:9/179: dwrite d4/d8/f19 [0,4194304] 0 2024-09-21T00:56:27.548 INFO:tasks.workunit.client.1.smithi187.stdout:9/180: chown d4/d10 0 1 2024-09-21T00:56:27.548 INFO:tasks.workunit.client.1.smithi187.stdout:5/47: fsync d0/f2 0 2024-09-21T00:56:27.549 INFO:tasks.workunit.client.1.smithi187.stdout:5/48: write d0/f9 [717110,54603] 0 2024-09-21T00:56:27.551 INFO:tasks.workunit.client.1.smithi187.stdout:1/53: write d4/d6/d8/fd [1438652,8660] 0 2024-09-21T00:56:27.554 INFO:tasks.workunit.client.1.smithi187.stdout:4/49: creat d2/f11 x:0 0 0 2024-09-21T00:56:27.556 INFO:tasks.workunit.client.1.smithi187.stdout:0/71: creat d0/f11 x:0 0 0 2024-09-21T00:56:27.558 INFO:tasks.workunit.client.1.smithi187.stdout:5/49: dwrite d0/f2 [0,4194304] 0 2024-09-21T00:56:27.558 INFO:tasks.workunit.client.1.smithi187.stdout:9/181: creat d4/d10/d24/f3f x:0 0 0 2024-09-21T00:56:27.559 INFO:tasks.workunit.client.1.smithi187.stdout:0/72: chown d0/dc/f10 9 1 2024-09-21T00:56:27.561 INFO:tasks.workunit.client.1.smithi187.stdout:0/73: read d0/f1 [186384,95336] 0 2024-09-21T00:56:27.563 INFO:tasks.workunit.client.1.smithi187.stdout:0/74: fdatasync d0/dc/f10 0 2024-09-21T00:56:27.565 INFO:tasks.workunit.client.1.smithi187.stdout:4/50: dwrite d2/f11 [0,4194304] 0 2024-09-21T00:56:27.569 INFO:tasks.workunit.client.1.smithi187.stdout:9/182: rename d4/l21 to d4/d13/d14/d28/l40 0 2024-09-21T00:56:27.570 INFO:tasks.workunit.client.1.smithi187.stdout:8/89: dwrite f7 [4194304,4194304] 0 2024-09-21T00:56:27.571 INFO:tasks.workunit.client.1.smithi187.stdout:8/90: readlink dc/lf 0 2024-09-21T00:56:27.574 INFO:tasks.workunit.client.1.smithi187.stdout:7/52: getdents d1 0 2024-09-21T00:56:27.575 INFO:tasks.workunit.client.1.smithi187.stdout:4/51: dread d2/ff [0,4194304] 0 2024-09-21T00:56:27.576 INFO:tasks.workunit.client.1.smithi187.stdout:5/50: creat d0/dc/f11 x:0 0 0 2024-09-21T00:56:27.580 INFO:tasks.workunit.client.1.smithi187.stdout:0/75: symlink d0/dc/l12 0 2024-09-21T00:56:27.583 INFO:tasks.workunit.client.1.smithi187.stdout:0/76: chown d0/dc/l12 31240623 1 2024-09-21T00:56:27.584 INFO:tasks.workunit.client.1.smithi187.stdout:9/183: unlink d4/d13/d14/d1d/f31 0 2024-09-21T00:56:27.584 INFO:tasks.workunit.client.1.smithi187.stdout:8/91: dwrite f7 [4194304,4194304] 0 2024-09-21T00:56:27.587 INFO:tasks.workunit.client.1.smithi187.stdout:9/184: write d4/d10/f23 [762539,37426] 0 2024-09-21T00:56:27.587 INFO:tasks.workunit.client.1.smithi187.stdout:4/52: symlink d2/d3/l12 0 2024-09-21T00:56:27.591 INFO:tasks.workunit.client.1.smithi187.stdout:9/185: stat d4/d13/d20/d2e/f33 0 2024-09-21T00:56:27.594 INFO:tasks.workunit.client.1.smithi187.stdout:5/51: dwrite d0/f9 [0,4194304] 0 2024-09-21T00:56:27.596 INFO:tasks.workunit.client.1.smithi187.stdout:5/52: stat d0/df/f10 0 2024-09-21T00:56:27.596 INFO:tasks.workunit.client.1.smithi187.stdout:9/186: truncate d4/d8/fb 2383173 0 2024-09-21T00:56:27.597 INFO:tasks.workunit.client.1.smithi187.stdout:4/53: creat d2/d3/f13 x:0 0 0 2024-09-21T00:56:27.598 INFO:tasks.workunit.client.1.smithi187.stdout:6/50: dwrite f5 [4194304,4194304] 0 2024-09-21T00:56:27.599 INFO:tasks.workunit.client.1.smithi187.stdout:0/77: rename d0/cd to d0/dc/c13 0 2024-09-21T00:56:27.600 INFO:tasks.workunit.client.1.smithi187.stdout:0/78: stat d0/c9 0 2024-09-21T00:56:27.602 INFO:tasks.workunit.client.1.smithi187.stdout:0/79: dread d0/fb [0,4194304] 0 2024-09-21T00:56:27.603 INFO:tasks.workunit.client.1.smithi187.stdout:9/187: mkdir d4/d8/d41 0 2024-09-21T00:56:27.606 INFO:tasks.workunit.client.1.smithi187.stdout:9/188: write d4/d10/f35 [1924781,5144] 0 2024-09-21T00:56:27.609 INFO:tasks.workunit.client.1.smithi187.stdout:4/54: dwrite d2/d3/da/fc [4194304,4194304] 0 2024-09-21T00:56:27.610 INFO:tasks.workunit.client.1.smithi187.stdout:9/189: write d4/f3b [54622,39683] 0 2024-09-21T00:56:27.613 INFO:tasks.workunit.client.1.smithi187.stdout:6/51: creat d7/d9/fb x:0 0 0 2024-09-21T00:56:27.615 INFO:tasks.workunit.client.1.smithi187.stdout:4/55: symlink d2/d3/l14 0 2024-09-21T00:56:27.615 INFO:tasks.workunit.client.1.smithi187.stdout:9/190: dread - d4/d10/d24/f3f zero size 2024-09-21T00:56:27.618 INFO:tasks.workunit.client.1.smithi187.stdout:9/191: chown d4/d13 6534 1 2024-09-21T00:56:27.618 INFO:tasks.workunit.client.1.smithi187.stdout:4/56: dread - d2/d3/f13 zero size 2024-09-21T00:56:27.619 INFO:tasks.workunit.client.1.smithi187.stdout:0/80: dwrite d0/dc/f10 [0,4194304] 0 2024-09-21T00:56:27.621 INFO:tasks.workunit.client.1.smithi187.stdout:1/54: dwrite d4/f7 [0,4194304] 0 2024-09-21T00:56:27.622 INFO:tasks.workunit.client.1.smithi187.stdout:1/55: write d4/d6/d8/fd [2151158,972] 0 2024-09-21T00:56:27.630 INFO:tasks.workunit.client.1.smithi187.stdout:1/56: readlink d4/l9 0 2024-09-21T00:56:27.633 INFO:tasks.workunit.client.1.smithi187.stdout:1/57: mknod d4/ce 0 2024-09-21T00:56:27.651 INFO:tasks.workunit.client.1.smithi187.stdout:8/92: write f8 [1400779,25306] 0 2024-09-21T00:56:27.654 INFO:tasks.workunit.client.1.smithi187.stdout:0/81: chown d0/dc/c13 168623890 1 2024-09-21T00:56:27.655 INFO:tasks.workunit.client.1.smithi187.stdout:8/93: rename f2 to dc/f18 0 2024-09-21T00:56:27.659 INFO:tasks.workunit.client.1.smithi187.stdout:8/94: rmdir dc 39 2024-09-21T00:56:27.661 INFO:tasks.workunit.client.1.smithi187.stdout:2/103: sync 2024-09-21T00:56:27.661 INFO:tasks.workunit.client.1.smithi187.stdout:3/45: sync 2024-09-21T00:56:27.661 INFO:tasks.workunit.client.1.smithi187.stdout:2/104: stat d2/dc 0 2024-09-21T00:56:27.661 INFO:tasks.workunit.client.1.smithi187.stdout:8/95: dread - dc/f14 zero size 2024-09-21T00:56:27.664 INFO:tasks.workunit.client.1.smithi187.stdout:3/46: creat d9/f11 x:0 0 0 2024-09-21T00:56:27.664 INFO:tasks.workunit.client.1.smithi187.stdout:3/47: chown f2 797270276 1 2024-09-21T00:56:27.664 INFO:tasks.workunit.client.1.smithi187.stdout:3/48: read - d9/f11 zero size 2024-09-21T00:56:27.665 INFO:tasks.workunit.client.1.smithi187.stdout:2/105: unlink d2/dc/d21/f26 0 2024-09-21T00:56:27.666 INFO:tasks.workunit.client.1.smithi187.stdout:2/106: truncate d2/fa 4457049 0 2024-09-21T00:56:27.667 INFO:tasks.workunit.client.1.smithi187.stdout:8/96: mkdir dc/d19 0 2024-09-21T00:56:27.668 INFO:tasks.workunit.client.1.smithi187.stdout:3/49: unlink f7 0 2024-09-21T00:56:27.670 INFO:tasks.workunit.client.1.smithi187.stdout:6/52: write f1 [1155189,98622] 0 2024-09-21T00:56:27.671 INFO:tasks.workunit.client.1.smithi187.stdout:6/53: truncate d7/d9/fb 980804 0 2024-09-21T00:56:27.671 INFO:tasks.workunit.client.1.smithi187.stdout:6/54: read d7/f8 [2429823,88303] 0 2024-09-21T00:56:27.674 INFO:tasks.workunit.client.1.smithi187.stdout:3/50: unlink d9/ca 0 2024-09-21T00:56:27.676 INFO:tasks.workunit.client.1.smithi187.stdout:2/107: symlink d2/dc/d17/l28 0 2024-09-21T00:56:27.677 INFO:tasks.workunit.client.1.smithi187.stdout:8/97: symlink dc/d19/l1a 0 2024-09-21T00:56:27.679 INFO:tasks.workunit.client.1.smithi187.stdout:1/58: truncate d4/f7 2011192 0 2024-09-21T00:56:27.681 INFO:tasks.workunit.client.1.smithi187.stdout:6/55: rename d7/d9 to d7/dc 0 2024-09-21T00:56:27.684 INFO:tasks.workunit.client.1.smithi187.stdout:2/108: creat d2/d3/d15/d1b/d1c/f29 x:0 0 0 2024-09-21T00:56:27.689 INFO:tasks.workunit.client.1.smithi187.stdout:6/56: unlink f5 0 2024-09-21T00:56:27.690 INFO:tasks.workunit.client.1.smithi187.stdout:8/98: dwrite dc/f18 [0,4194304] 0 2024-09-21T00:56:27.691 INFO:tasks.workunit.client.1.smithi187.stdout:6/57: truncate d7/dc/fb 1356666 0 2024-09-21T00:56:27.691 INFO:tasks.workunit.client.1.smithi187.stdout:6/58: stat c6 0 2024-09-21T00:56:27.691 INFO:tasks.workunit.client.1.smithi187.stdout:8/99: write dc/f12 [3787920,90342] 0 2024-09-21T00:56:27.691 INFO:tasks.workunit.client.1.smithi187.stdout:6/59: chown f1 37 1 2024-09-21T00:56:27.697 INFO:tasks.workunit.client.1.smithi187.stdout:8/100: mknod dc/c1b 0 2024-09-21T00:56:27.699 INFO:tasks.workunit.client.1.smithi187.stdout:6/60: symlink d7/ld 0 2024-09-21T00:56:27.701 INFO:tasks.workunit.client.1.smithi187.stdout:0/82: dwrite d0/dc/f10 [4194304,4194304] 0 2024-09-21T00:56:27.703 INFO:tasks.workunit.client.1.smithi187.stdout:8/101: unlink l6 0 2024-09-21T00:56:27.705 INFO:tasks.workunit.client.1.smithi187.stdout:2/109: getdents d2/d3/d15 0 2024-09-21T00:56:27.708 INFO:tasks.workunit.client.1.smithi187.stdout:0/83: dwrite d0/f11 [0,4194304] 0 2024-09-21T00:56:27.716 INFO:tasks.workunit.client.1.smithi187.stdout:2/110: dwrite d2/f7 [0,4194304] 0 2024-09-21T00:56:27.716 INFO:tasks.workunit.client.1.smithi187.stdout:3/51: read d9/fb [7979567,9940] 0 2024-09-21T00:56:27.717 INFO:tasks.workunit.client.1.smithi187.stdout:2/111: chown d2/d3/d15/d1b 56684500 1 2024-09-21T00:56:27.718 INFO:tasks.workunit.client.1.smithi187.stdout:0/84: truncate d0/dc/fe 2444459 0 2024-09-21T00:56:27.721 INFO:tasks.workunit.client.1.smithi187.stdout:3/52: creat d9/f12 x:0 0 0 2024-09-21T00:56:27.721 INFO:tasks.workunit.client.1.smithi187.stdout:8/102: rename dc/d19 to dc/d1c 0 2024-09-21T00:56:27.724 INFO:tasks.workunit.client.1.smithi187.stdout:2/112: unlink d2/d3/c11 0 2024-09-21T00:56:27.725 INFO:tasks.workunit.client.1.smithi187.stdout:2/113: fdatasync d2/d3/d15/d1b/d1c/d1d/f20 0 2024-09-21T00:56:27.726 INFO:tasks.workunit.client.1.smithi187.stdout:1/59: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:27.728 INFO:tasks.workunit.client.1.smithi187.stdout:3/53: mkdir d9/d13 0 2024-09-21T00:56:27.728 INFO:tasks.workunit.client.1.smithi187.stdout:1/60: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:27.731 INFO:tasks.workunit.client.1.smithi187.stdout:3/54: dread f3 [0,4194304] 0 2024-09-21T00:56:27.732 INFO:tasks.workunit.client.1.smithi187.stdout:6/61: truncate d7/f8 2492192 0 2024-09-21T00:56:27.732 INFO:tasks.workunit.client.1.smithi187.stdout:3/55: write d9/f12 [897859,44652] 0 2024-09-21T00:56:27.733 INFO:tasks.workunit.client.1.smithi187.stdout:2/114: mknod d2/dc/d17/c2a 0 2024-09-21T00:56:27.734 INFO:tasks.workunit.client.1.smithi187.stdout:2/115: truncate d2/d3/d15/d1b/d1c/f1f 627398 0 2024-09-21T00:56:27.735 INFO:tasks.workunit.client.1.smithi187.stdout:2/116: readlink d2/dc/d17/l28 0 2024-09-21T00:56:27.735 INFO:tasks.workunit.client.1.smithi187.stdout:0/85: link d0/fb d0/f14 0 2024-09-21T00:56:27.738 INFO:tasks.workunit.client.1.smithi187.stdout:8/103: rename dc/c17 to dc/d1c/c1d 0 2024-09-21T00:56:27.745 INFO:tasks.workunit.client.1.smithi187.stdout:1/61: rename d4/d6/d8/fd to d4/d6/ff 0 2024-09-21T00:56:27.748 INFO:tasks.workunit.client.1.smithi187.stdout:3/56: mknod d9/d13/c14 0 2024-09-21T00:56:27.748 INFO:tasks.workunit.client.1.smithi187.stdout:3/57: chown l8 4 1 2024-09-21T00:56:27.748 INFO:tasks.workunit.client.1.smithi187.stdout:3/58: read - d9/f11 zero size 2024-09-21T00:56:27.749 INFO:tasks.workunit.client.1.smithi187.stdout:3/59: stat d9/fd 0 2024-09-21T00:56:27.749 INFO:tasks.workunit.client.1.smithi187.stdout:3/60: chown d9/ff 137 1 2024-09-21T00:56:27.757 INFO:tasks.workunit.client.1.smithi187.stdout:3/61: unlink c5 0 2024-09-21T00:56:27.757 INFO:tasks.workunit.client.1.smithi187.stdout:3/62: chown f3 249600 1 2024-09-21T00:56:27.758 INFO:tasks.workunit.client.1.smithi187.stdout:8/104: link l5 dc/d1c/l1e 0 2024-09-21T00:56:27.759 INFO:tasks.workunit.client.1.smithi187.stdout:8/105: truncate dc/f12 4591905 0 2024-09-21T00:56:27.769 INFO:tasks.workunit.client.1.smithi187.stdout:3/63: creat d9/d13/f15 x:0 0 0 2024-09-21T00:56:27.769 INFO:tasks.workunit.client.1.smithi187.stdout:3/64: stat l8 0 2024-09-21T00:56:27.770 INFO:tasks.workunit.client.1.smithi187.stdout:8/106: mknod dc/c1f 0 2024-09-21T00:56:27.770 INFO:tasks.workunit.client.1.smithi187.stdout:8/107: dread - dc/fd zero size 2024-09-21T00:56:27.771 INFO:tasks.workunit.client.1.smithi187.stdout:7/53: sync 2024-09-21T00:56:27.772 INFO:tasks.workunit.client.1.smithi187.stdout:0/86: rename d0/dc/fe to d0/dc/df/f15 0 2024-09-21T00:56:27.773 INFO:tasks.workunit.client.1.smithi187.stdout:1/62: rmdir d4/d6/dc 0 2024-09-21T00:56:27.773 INFO:tasks.workunit.client.1.smithi187.stdout:0/87: read d0/fb [27770,108088] 0 2024-09-21T00:56:27.774 INFO:tasks.workunit.client.1.smithi187.stdout:3/65: symlink d9/l16 0 2024-09-21T00:56:27.776 INFO:tasks.workunit.client.1.smithi187.stdout:8/108: dread dc/f12 [0,4194304] 0 2024-09-21T00:56:27.776 INFO:tasks.workunit.client.1.smithi187.stdout:3/66: truncate d9/d13/f15 123143 0 2024-09-21T00:56:27.776 INFO:tasks.workunit.client.1.smithi187.stdout:3/67: dread - d9/ff zero size 2024-09-21T00:56:27.780 INFO:tasks.workunit.client.1.smithi187.stdout:2/117: rename d2/d3/d15/d1b/f22 to d2/dc/d17/f2b 0 2024-09-21T00:56:27.782 INFO:tasks.workunit.client.1.smithi187.stdout:1/63: write d4/f7 [2187482,75059] 0 2024-09-21T00:56:27.784 INFO:tasks.workunit.client.1.smithi187.stdout:8/109: rmdir dc/d1c 39 2024-09-21T00:56:27.788 INFO:tasks.workunit.client.1.smithi187.stdout:3/68: mknod d9/c17 0 2024-09-21T00:56:27.788 INFO:tasks.workunit.client.1.smithi187.stdout:1/64: dwrite d4/f7 [0,4194304] 0 2024-09-21T00:56:27.790 INFO:tasks.workunit.client.1.smithi187.stdout:2/118: creat d2/d3/d15/d1b/d1c/d1d/f2c x:0 0 0 2024-09-21T00:56:27.791 INFO:tasks.workunit.client.1.smithi187.stdout:2/119: write d2/fa [4630410,70026] 0 2024-09-21T00:56:27.792 INFO:tasks.workunit.client.1.smithi187.stdout:0/88: link d0/dc/f10 d0/f16 0 2024-09-21T00:56:27.792 INFO:tasks.workunit.client.1.smithi187.stdout:0/89: chown d0/c9 876581856 1 2024-09-21T00:56:27.794 INFO:tasks.workunit.client.1.smithi187.stdout:3/69: mknod d9/d13/c18 0 2024-09-21T00:56:27.798 INFO:tasks.workunit.client.1.smithi187.stdout:8/110: dwrite dc/f12 [0,4194304] 0 2024-09-21T00:56:27.799 INFO:tasks.workunit.client.1.smithi187.stdout:3/70: mkdir d9/d19 0 2024-09-21T00:56:27.800 INFO:tasks.workunit.client.1.smithi187.stdout:6/62: truncate d7/f8 3168496 0 2024-09-21T00:56:27.800 INFO:tasks.workunit.client.1.smithi187.stdout:3/71: fdatasync d9/f11 0 2024-09-21T00:56:27.800 INFO:tasks.workunit.client.1.smithi187.stdout:3/72: stat d9/d13/c14 0 2024-09-21T00:56:27.801 INFO:tasks.workunit.client.1.smithi187.stdout:3/73: write d9/d13/f15 [1157876,46219] 0 2024-09-21T00:56:27.803 INFO:tasks.workunit.client.1.smithi187.stdout:1/65: link d4/l9 d4/d6/d8/l10 0 2024-09-21T00:56:27.808 INFO:tasks.workunit.client.1.smithi187.stdout:8/111: mknod dc/c20 0 2024-09-21T00:56:27.812 INFO:tasks.workunit.client.1.smithi187.stdout:0/90: getdents d0/dc/df 0 2024-09-21T00:56:27.813 INFO:tasks.workunit.client.1.smithi187.stdout:5/53: sync 2024-09-21T00:56:27.813 INFO:tasks.workunit.client.1.smithi187.stdout:9/192: sync 2024-09-21T00:56:27.814 INFO:tasks.workunit.client.1.smithi187.stdout:3/74: link d9/f11 d9/d13/f1a 0 2024-09-21T00:56:27.816 INFO:tasks.workunit.client.1.smithi187.stdout:0/91: rmdir d0/dc 39 2024-09-21T00:56:27.817 INFO:tasks.workunit.client.1.smithi187.stdout:8/112: creat dc/d1c/f21 x:0 0 0 2024-09-21T00:56:27.818 INFO:tasks.workunit.client.1.smithi187.stdout:2/120: fsync d2/d3/d15/d1b/d1c/d1d/f2c 0 2024-09-21T00:56:27.819 INFO:tasks.workunit.client.1.smithi187.stdout:5/54: dread d0/f9 [0,4194304] 0 2024-09-21T00:56:27.820 INFO:tasks.workunit.client.1.smithi187.stdout:9/193: write d4/d13/d14/d1d/f3c [764427,87519] 0 2024-09-21T00:56:27.821 INFO:tasks.workunit.client.1.smithi187.stdout:3/75: mknod d9/d19/c1b 0 2024-09-21T00:56:27.821 INFO:tasks.workunit.client.1.smithi187.stdout:5/55: fsync d0/fa 0 2024-09-21T00:56:27.823 INFO:tasks.workunit.client.1.smithi187.stdout:0/92: mkdir d0/d17 0 2024-09-21T00:56:27.823 INFO:tasks.workunit.client.1.smithi187.stdout:7/54: dwrite d1/f7 [0,4194304] 0 2024-09-21T00:56:27.824 INFO:tasks.workunit.client.1.smithi187.stdout:6/63: write d7/f8 [3065593,64472] 0 2024-09-21T00:56:27.828 INFO:tasks.workunit.client.1.smithi187.stdout:2/121: mkdir d2/d3/d15/d1b/d1c/d2d 0 2024-09-21T00:56:27.828 INFO:tasks.workunit.client.1.smithi187.stdout:1/66: truncate d4/d6/ff 1908551 0 2024-09-21T00:56:27.829 INFO:tasks.workunit.client.1.smithi187.stdout:3/76: mkdir d9/d19/d1c 0 2024-09-21T00:56:27.830 INFO:tasks.workunit.client.1.smithi187.stdout:3/77: chown d9 1706 1 2024-09-21T00:56:27.831 INFO:tasks.workunit.client.1.smithi187.stdout:5/56: dread d0/f9 [0,4194304] 0 2024-09-21T00:56:27.832 INFO:tasks.workunit.client.1.smithi187.stdout:2/122: chown d2/d3/d15/d1b/d1c/d1d/f20 906798738 1 2024-09-21T00:56:27.833 INFO:tasks.workunit.client.1.smithi187.stdout:8/113: truncate f7 88764 0 2024-09-21T00:56:27.833 INFO:tasks.workunit.client.1.smithi187.stdout:7/55: dread d1/f7 [0,4194304] 0 2024-09-21T00:56:27.834 INFO:tasks.workunit.client.1.smithi187.stdout:9/194: write d4/f1a [1508975,46502] 0 2024-09-21T00:56:27.836 INFO:tasks.workunit.client.1.smithi187.stdout:8/114: write dc/d1c/f21 [556805,78831] 0 2024-09-21T00:56:27.836 INFO:tasks.workunit.client.1.smithi187.stdout:2/123: mkdir d2/dc/d2e 0 2024-09-21T00:56:27.838 INFO:tasks.workunit.client.1.smithi187.stdout:7/56: creat d1/dc/f13 x:0 0 0 2024-09-21T00:56:27.839 INFO:tasks.workunit.client.1.smithi187.stdout:0/93: getdents d0 0 2024-09-21T00:56:27.841 INFO:tasks.workunit.client.1.smithi187.stdout:6/64: getdents d7 0 2024-09-21T00:56:27.846 INFO:tasks.workunit.client.1.smithi187.stdout:5/57: dwrite d0/f2 [0,4194304] 0 2024-09-21T00:56:27.846 INFO:tasks.workunit.client.1.smithi187.stdout:6/65: write d7/f8 [2760200,12799] 0 2024-09-21T00:56:27.848 INFO:tasks.workunit.client.1.smithi187.stdout:8/115: fsync f7 0 2024-09-21T00:56:27.849 INFO:tasks.workunit.client.1.smithi187.stdout:7/57: unlink d1/fa 0 2024-09-21T00:56:27.851 INFO:tasks.workunit.client.1.smithi187.stdout:1/67: truncate d4/d6/ff 1019995 0 2024-09-21T00:56:27.853 INFO:tasks.workunit.client.1.smithi187.stdout:9/195: dwrite d4/d13/d20/d2e/f33 [0,4194304] 0 2024-09-21T00:56:27.853 INFO:tasks.workunit.client.1.smithi187.stdout:0/94: mkdir d0/d17/d18 0 2024-09-21T00:56:27.854 INFO:tasks.workunit.client.1.smithi187.stdout:5/58: write d0/f9 [3388814,45398] 0 2024-09-21T00:56:27.855 INFO:tasks.workunit.client.1.smithi187.stdout:8/116: truncate dc/f13 276086 0 2024-09-21T00:56:27.855 INFO:tasks.workunit.client.1.smithi187.stdout:6/66: rename c6 to d7/ce 0 2024-09-21T00:56:27.859 INFO:tasks.workunit.client.1.smithi187.stdout:2/124: dread d2/d3/d15/d1b/d1c/d1d/f20 [0,4194304] 0 2024-09-21T00:56:27.859 INFO:tasks.workunit.client.1.smithi187.stdout:1/68: write f3 [1092164,23096] 0 2024-09-21T00:56:27.861 INFO:tasks.workunit.client.1.smithi187.stdout:4/57: sync 2024-09-21T00:56:27.862 INFO:tasks.workunit.client.1.smithi187.stdout:3/78: dwrite d9/d13/f1a [0,4194304] 0 2024-09-21T00:56:27.862 INFO:tasks.workunit.client.1.smithi187.stdout:0/95: creat d0/dc/f19 x:0 0 0 2024-09-21T00:56:27.865 INFO:tasks.workunit.client.1.smithi187.stdout:6/67: creat d7/ff x:0 0 0 2024-09-21T00:56:27.865 INFO:tasks.workunit.client.1.smithi187.stdout:0/96: readlink d0/dc/l12 0 2024-09-21T00:56:27.866 INFO:tasks.workunit.client.1.smithi187.stdout:2/125: symlink d2/d3/l2f 0 2024-09-21T00:56:27.867 INFO:tasks.workunit.client.1.smithi187.stdout:5/59: symlink d0/l12 0 2024-09-21T00:56:27.868 INFO:tasks.workunit.client.1.smithi187.stdout:4/58: symlink d2/d3/da/l15 0 2024-09-21T00:56:27.868 INFO:tasks.workunit.client.1.smithi187.stdout:3/79: write d9/fd [4498234,113983] 0 2024-09-21T00:56:27.868 INFO:tasks.workunit.client.1.smithi187.stdout:0/97: dread d0/fb [0,4194304] 0 2024-09-21T00:56:27.869 INFO:tasks.workunit.client.1.smithi187.stdout:7/58: creat d1/f14 x:0 0 0 2024-09-21T00:56:27.870 INFO:tasks.workunit.client.1.smithi187.stdout:6/68: rmdir d7 39 2024-09-21T00:56:27.871 INFO:tasks.workunit.client.1.smithi187.stdout:5/60: fdatasync d0/f9 0 2024-09-21T00:56:27.872 INFO:tasks.workunit.client.1.smithi187.stdout:7/59: dread - d1/f14 zero size 2024-09-21T00:56:27.873 INFO:tasks.workunit.client.1.smithi187.stdout:4/59: write d2/d3/da/fc [167835,25858] 0 2024-09-21T00:56:27.874 INFO:tasks.workunit.client.1.smithi187.stdout:9/196: dread d4/d10/f35 [0,4194304] 0 2024-09-21T00:56:27.875 INFO:tasks.workunit.client.1.smithi187.stdout:3/80: mknod d9/d13/c1d 0 2024-09-21T00:56:27.878 INFO:tasks.workunit.client.1.smithi187.stdout:8/117: link l5 dc/l22 0 2024-09-21T00:56:27.878 INFO:tasks.workunit.client.1.smithi187.stdout:5/61: creat d0/dc/f13 x:0 0 0 2024-09-21T00:56:27.878 INFO:tasks.workunit.client.1.smithi187.stdout:1/69: dwrite d4/f7 [4194304,4194304] 0 2024-09-21T00:56:27.879 INFO:tasks.workunit.client.1.smithi187.stdout:4/60: chown d2/d3/l12 150 1 2024-09-21T00:56:27.879 INFO:tasks.workunit.client.1.smithi187.stdout:6/69: creat d7/dc/f10 x:0 0 0 2024-09-21T00:56:27.880 INFO:tasks.workunit.client.1.smithi187.stdout:6/70: dread - d7/ff zero size 2024-09-21T00:56:27.881 INFO:tasks.workunit.client.1.smithi187.stdout:9/197: unlink d4/d13/c27 0 2024-09-21T00:56:27.885 INFO:tasks.workunit.client.1.smithi187.stdout:8/118: rmdir dc 39 2024-09-21T00:56:27.885 INFO:tasks.workunit.client.1.smithi187.stdout:2/126: dread - d2/d3/d15/d1b/d1c/f29 zero size 2024-09-21T00:56:27.887 INFO:tasks.workunit.client.1.smithi187.stdout:6/71: chown d7/dc/f10 5 1 2024-09-21T00:56:27.888 INFO:tasks.workunit.client.1.smithi187.stdout:5/62: mkdir d0/df/d14 0 2024-09-21T00:56:27.888 INFO:tasks.workunit.client.1.smithi187.stdout:8/119: write f8 [503818,73765] 0 2024-09-21T00:56:27.890 INFO:tasks.workunit.client.1.smithi187.stdout:6/72: stat d7/dc 0 2024-09-21T00:56:27.892 INFO:tasks.workunit.client.1.smithi187.stdout:2/127: write d2/f7 [3512381,52486] 0 2024-09-21T00:56:27.896 INFO:tasks.workunit.client.1.smithi187.stdout:2/128: chown d2/ld 28823887 1 2024-09-21T00:56:27.897 INFO:tasks.workunit.client.1.smithi187.stdout:4/61: dwrite d2/f11 [4194304,4194304] 0 2024-09-21T00:56:27.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:27 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:27.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:27 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:27.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:27 smithi112 ceph-mon[28078]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-21T00:56:27.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:27 smithi112 ceph-mon[28078]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-21T00:56:27.898 INFO:tasks.workunit.client.1.smithi187.stdout:1/70: dwrite f3 [0,4194304] 0 2024-09-21T00:56:27.901 INFO:tasks.workunit.client.1.smithi187.stdout:3/81: rename d9/d13/f1a to d9/d13/f1e 0 2024-09-21T00:56:27.902 INFO:tasks.workunit.client.1.smithi187.stdout:8/120: write dc/fe [1443233,74693] 0 2024-09-21T00:56:27.903 INFO:tasks.workunit.client.1.smithi187.stdout:3/82: read f2 [575052,30411] 0 2024-09-21T00:56:27.903 INFO:tasks.workunit.client.1.smithi187.stdout:4/62: mkdir d2/d3/da/d16 0 2024-09-21T00:56:27.904 INFO:tasks.workunit.client.1.smithi187.stdout:8/121: stat dc 0 2024-09-21T00:56:27.905 INFO:tasks.workunit.client.1.smithi187.stdout:1/71: creat d4/f11 x:0 0 0 2024-09-21T00:56:27.905 INFO:tasks.workunit.client.1.smithi187.stdout:3/83: stat d9/fb 0 2024-09-21T00:56:27.906 INFO:tasks.workunit.client.1.smithi187.stdout:5/63: link d0/f2 d0/df/f15 0 2024-09-21T00:56:27.907 INFO:tasks.workunit.client.1.smithi187.stdout:0/98: dwrite d0/f14 [0,4194304] 0 2024-09-21T00:56:27.908 INFO:tasks.workunit.client.1.smithi187.stdout:2/129: mknod d2/dc/d2e/c30 0 2024-09-21T00:56:27.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:27 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:27.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:27 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:56:27.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:27 smithi187 ceph-mon[34997]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-21T00:56:27.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:27 smithi187 ceph-mon[34997]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-21T00:56:27.909 INFO:tasks.workunit.client.1.smithi187.stdout:1/72: write d4/f7 [7109979,82622] 0 2024-09-21T00:56:27.909 INFO:tasks.workunit.client.1.smithi187.stdout:4/63: mkdir d2/d3/d17 0 2024-09-21T00:56:27.910 INFO:tasks.workunit.client.1.smithi187.stdout:0/99: read d0/dc/f10 [3884041,8848] 0 2024-09-21T00:56:27.911 INFO:tasks.workunit.client.1.smithi187.stdout:8/122: creat dc/d1c/f23 x:0 0 0 2024-09-21T00:56:27.911 INFO:tasks.workunit.client.1.smithi187.stdout:0/100: readlink d0/dc/l12 0 2024-09-21T00:56:27.912 INFO:tasks.workunit.client.1.smithi187.stdout:0/101: chown d0/dc/f10 1211841399 1 2024-09-21T00:56:27.913 INFO:tasks.workunit.client.1.smithi187.stdout:0/102: chown d0/dc/f19 115398 1 2024-09-21T00:56:27.914 INFO:tasks.workunit.client.1.smithi187.stdout:9/198: link d4/d13/d14/d28/c2a d4/c42 0 2024-09-21T00:56:27.916 INFO:tasks.workunit.client.1.smithi187.stdout:3/84: dread d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:27.924 INFO:tasks.workunit.client.1.smithi187.stdout:5/64: symlink d0/df/d14/l16 0 2024-09-21T00:56:27.925 INFO:tasks.workunit.client.1.smithi187.stdout:9/199: mkdir d4/d10/d43 0 2024-09-21T00:56:27.926 INFO:tasks.workunit.client.1.smithi187.stdout:2/130: mkdir d2/d31 0 2024-09-21T00:56:27.926 INFO:tasks.workunit.client.1.smithi187.stdout:5/65: chown d0/df/f15 1266 1 2024-09-21T00:56:27.928 INFO:tasks.workunit.client.1.smithi187.stdout:3/85: unlink d9/d13/c1d 0 2024-09-21T00:56:27.929 INFO:tasks.workunit.client.1.smithi187.stdout:9/200: write d4/d8/fb [2871290,49914] 0 2024-09-21T00:56:27.932 INFO:tasks.workunit.client.1.smithi187.stdout:5/66: creat d0/dc/f17 x:0 0 0 2024-09-21T00:56:27.934 INFO:tasks.workunit.client.1.smithi187.stdout:0/103: dwrite d0/fb [4194304,4194304] 0 2024-09-21T00:56:27.936 INFO:tasks.workunit.client.1.smithi187.stdout:4/64: dwrite d2/ff [0,4194304] 0 2024-09-21T00:56:27.936 INFO:tasks.workunit.client.1.smithi187.stdout:9/201: read - d4/d13/d20/f37 zero size 2024-09-21T00:56:27.937 INFO:tasks.workunit.client.1.smithi187.stdout:8/123: link f8 dc/f24 0 2024-09-21T00:56:27.938 INFO:tasks.workunit.client.1.smithi187.stdout:5/67: chown d0/c6 0 1 2024-09-21T00:56:27.939 INFO:tasks.workunit.client.1.smithi187.stdout:8/124: write dc/d1c/f23 [957337,51851] 0 2024-09-21T00:56:27.942 INFO:tasks.workunit.client.1.smithi187.stdout:3/86: dread f2 [0,4194304] 0 2024-09-21T00:56:27.943 INFO:tasks.workunit.client.1.smithi187.stdout:2/131: link d2/dc/d17/f2b d2/d3/d15/d1b/d1c/f32 0 2024-09-21T00:56:27.943 INFO:tasks.workunit.client.1.smithi187.stdout:9/202: dread d4/d13/d14/d1d/f3c [0,4194304] 0 2024-09-21T00:56:27.943 INFO:tasks.workunit.client.1.smithi187.stdout:2/132: stat d2/d3/f12 0 2024-09-21T00:56:27.945 INFO:tasks.workunit.client.1.smithi187.stdout:0/104: mknod d0/d17/d18/c1a 0 2024-09-21T00:56:27.946 INFO:tasks.workunit.client.1.smithi187.stdout:0/105: chown d0/f1 3655767 1 2024-09-21T00:56:27.947 INFO:tasks.workunit.client.1.smithi187.stdout:5/68: fsync d0/df/f15 0 2024-09-21T00:56:27.950 INFO:tasks.workunit.client.1.smithi187.stdout:1/73: truncate f3 82503 0 2024-09-21T00:56:27.952 INFO:tasks.workunit.client.1.smithi187.stdout:2/133: symlink d2/d3/d15/d1b/l33 0 2024-09-21T00:56:27.954 INFO:tasks.workunit.client.1.smithi187.stdout:9/203: dwrite d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:27.955 INFO:tasks.workunit.client.1.smithi187.stdout:9/204: fdatasync d4/f3b 0 2024-09-21T00:56:27.958 INFO:tasks.workunit.client.1.smithi187.stdout:8/125: symlink dc/l25 0 2024-09-21T00:56:27.958 INFO:tasks.workunit.client.1.smithi187.stdout:5/69: dread d0/f2 [0,4194304] 0 2024-09-21T00:56:27.961 INFO:tasks.workunit.client.1.smithi187.stdout:2/134: rename d2/d3/d15/d1b/d1c/d1d to d2/d25/d34 0 2024-09-21T00:56:27.963 INFO:tasks.workunit.client.1.smithi187.stdout:9/205: write d4/d13/d14/d1d/f3c [1098617,117563] 0 2024-09-21T00:56:27.963 INFO:tasks.workunit.client.1.smithi187.stdout:4/65: getdents d2 0 2024-09-21T00:56:27.964 INFO:tasks.workunit.client.1.smithi187.stdout:1/74: fsync d4/d6/ff 0 2024-09-21T00:56:27.965 INFO:tasks.workunit.client.1.smithi187.stdout:4/66: chown d2/d3/l14 84823 1 2024-09-21T00:56:27.965 INFO:tasks.workunit.client.1.smithi187.stdout:9/206: truncate d4/d13/d20/f26 4240562 0 2024-09-21T00:56:27.969 INFO:tasks.workunit.client.1.smithi187.stdout:0/106: write d0/f1 [445316,97602] 0 2024-09-21T00:56:27.969 INFO:tasks.workunit.client.1.smithi187.stdout:2/135: fsync d2/dc/f13 0 2024-09-21T00:56:27.970 INFO:tasks.workunit.client.1.smithi187.stdout:9/207: mkdir d4/d8/d44 0 2024-09-21T00:56:27.970 INFO:tasks.workunit.client.1.smithi187.stdout:0/107: chown d0/dc/df 36054485 1 2024-09-21T00:56:27.971 INFO:tasks.workunit.client.1.smithi187.stdout:9/208: stat d4/d8/d41 0 2024-09-21T00:56:27.972 INFO:tasks.workunit.client.1.smithi187.stdout:0/108: truncate d0/f1 9795902 0 2024-09-21T00:56:27.973 INFO:tasks.workunit.client.1.smithi187.stdout:9/209: chown d4/d8/f22 2 1 2024-09-21T00:56:27.974 INFO:tasks.workunit.client.1.smithi187.stdout:0/109: write d0/f14 [4306886,62774] 0 2024-09-21T00:56:27.974 INFO:tasks.workunit.client.1.smithi187.stdout:4/67: dwrite d2/ff [4194304,4194304] 0 2024-09-21T00:56:27.975 INFO:tasks.workunit.client.1.smithi187.stdout:9/210: readlink d4/d13/d3a/l3d 0 2024-09-21T00:56:27.976 INFO:tasks.workunit.client.1.smithi187.stdout:0/110: symlink d0/d17/l1b 0 2024-09-21T00:56:27.977 INFO:tasks.workunit.client.1.smithi187.stdout:9/211: dread - d4/d10/d24/f3f zero size 2024-09-21T00:56:27.977 INFO:tasks.workunit.client.1.smithi187.stdout:4/68: mkdir d2/d3/da/d16/d18 0 2024-09-21T00:56:27.978 INFO:tasks.workunit.client.1.smithi187.stdout:9/212: rmdir d4/d13/d14 39 2024-09-21T00:56:27.979 INFO:tasks.workunit.client.1.smithi187.stdout:4/69: write d2/d3/f13 [514848,67415] 0 2024-09-21T00:56:27.981 INFO:tasks.workunit.client.1.smithi187.stdout:4/70: mknod d2/d3/c19 0 2024-09-21T00:56:27.982 INFO:tasks.workunit.client.1.smithi187.stdout:4/71: chown d2/d3/c19 318068824 1 2024-09-21T00:56:27.984 INFO:tasks.workunit.client.1.smithi187.stdout:9/213: link d4/c42 d4/d10/c45 0 2024-09-21T00:56:27.986 INFO:tasks.workunit.client.1.smithi187.stdout:9/214: truncate d4/d13/d20/f37 944434 0 2024-09-21T00:56:27.986 INFO:tasks.workunit.client.1.smithi187.stdout:4/72: dread d2/f11 [0,4194304] 0 2024-09-21T00:56:27.987 INFO:tasks.workunit.client.1.smithi187.stdout:9/215: mkdir d4/d8/d46 0 2024-09-21T00:56:27.989 INFO:tasks.workunit.client.1.smithi187.stdout:9/216: stat d4/d13/d14 0 2024-09-21T00:56:27.991 INFO:tasks.workunit.client.1.smithi187.stdout:9/217: unlink d4/d13/d14/d28/l40 0 2024-09-21T00:56:27.993 INFO:tasks.workunit.client.1.smithi187.stdout:9/218: symlink d4/d10/d39/l47 0 2024-09-21T00:56:27.995 INFO:tasks.workunit.client.1.smithi187.stdout:9/219: fsync d4/d10/f35 0 2024-09-21T00:56:27.996 INFO:tasks.workunit.client.1.smithi187.stdout:8/126: write dc/f24 [4964126,110158] 0 2024-09-21T00:56:27.997 INFO:tasks.workunit.client.1.smithi187.stdout:9/220: read - d4/f9 zero size 2024-09-21T00:56:27.998 INFO:tasks.workunit.client.1.smithi187.stdout:1/75: truncate f3 532985 0 2024-09-21T00:56:28.000 INFO:tasks.workunit.client.1.smithi187.stdout:0/111: write d0/dc/df/f15 [3304766,64576] 0 2024-09-21T00:56:28.004 INFO:tasks.workunit.client.1.smithi187.stdout:9/221: truncate d4/d10/f11 511157 0 2024-09-21T00:56:28.004 INFO:tasks.workunit.client.1.smithi187.stdout:4/73: truncate d2/ff 215583 0 2024-09-21T00:56:28.005 INFO:tasks.workunit.client.1.smithi187.stdout:5/70: dwrite d0/f2 [4194304,4194304] 0 2024-09-21T00:56:28.007 INFO:tasks.workunit.client.1.smithi187.stdout:5/71: chown d0/f7 10681 1 2024-09-21T00:56:28.008 INFO:tasks.workunit.client.1.smithi187.stdout:8/127: truncate f8 4968404 0 2024-09-21T00:56:28.010 INFO:tasks.workunit.client.1.smithi187.stdout:4/74: truncate d2/d3/da/fc 9129554 0 2024-09-21T00:56:28.013 INFO:tasks.workunit.client.1.smithi187.stdout:1/76: dwrite d4/f11 [0,4194304] 0 2024-09-21T00:56:28.015 INFO:tasks.workunit.client.1.smithi187.stdout:4/75: write d2/d3/f13 [620621,93489] 0 2024-09-21T00:56:28.016 INFO:tasks.workunit.client.1.smithi187.stdout:8/128: chown dc/d1c/l1e 11 1 2024-09-21T00:56:28.017 INFO:tasks.workunit.client.0.smithi112.stderr:++ readlink -f fsstress 2024-09-21T00:56:28.019 INFO:tasks.workunit.client.1.smithi187.stdout:0/112: dwrite d0/dc/df/f15 [0,4194304] 0 2024-09-21T00:56:28.020 INFO:tasks.workunit.client.0.smithi112.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T00:56:28.020 INFO:tasks.workunit.client.0.smithi112.stderr:+ popd 2024-09-21T00:56:28.022 INFO:tasks.workunit.client.1.smithi187.stdout:4/76: rmdir d2 39 2024-09-21T00:56:28.022 INFO:tasks.workunit.client.1.smithi187.stdout:9/222: dwrite d4/d13/d14/f18 [0,4194304] 0 2024-09-21T00:56:28.023 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T00:56:28.023 INFO:tasks.workunit.client.0.smithi112.stderr:+ popd 2024-09-21T00:56:28.024 INFO:tasks.workunit.client.0.smithi112.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-21T00:56:28.024 INFO:tasks.workunit.client.0.smithi112.stderr:++ mktemp -d -p . 2024-09-21T00:56:28.026 INFO:tasks.workunit.client.1.smithi187.stdout:5/72: link d0/df/ce d0/df/d14/c18 0 2024-09-21T00:56:28.027 INFO:tasks.workunit.client.1.smithi187.stdout:0/113: mkdir d0/d17/d1c 0 2024-09-21T00:56:28.029 INFO:tasks.workunit.client.0.smithi112.stderr:+ T=./tmp.3izx1crvHW 2024-09-21T00:56:28.029 INFO:tasks.workunit.client.0.smithi112.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.3izx1crvHW -l 1 -n 1000 -p 10 -v 2024-09-21T00:56:28.033 INFO:tasks.workunit.client.1.smithi187.stdout:8/129: creat dc/f26 x:0 0 0 2024-09-21T00:56:28.034 INFO:tasks.workunit.client.1.smithi187.stdout:1/77: link d4/ce d4/d6/c12 0 2024-09-21T00:56:28.036 INFO:tasks.workunit.client.0.smithi112.stdout:seed = 1726912495 2024-09-21T00:56:28.038 INFO:tasks.workunit.client.1.smithi187.stdout:9/223: dwrite d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:28.038 INFO:tasks.workunit.client.1.smithi187.stdout:8/130: truncate dc/f18 4963370 0 2024-09-21T00:56:28.038 INFO:tasks.workunit.client.1.smithi187.stdout:4/77: symlink d2/d3/da/d16/l1a 0 2024-09-21T00:56:28.041 INFO:tasks.workunit.client.1.smithi187.stdout:8/131: write dc/f18 [3271035,85654] 0 2024-09-21T00:56:28.042 INFO:tasks.workunit.client.0.smithi112.stdout:0/0: dread - no filename 2024-09-21T00:56:28.042 INFO:tasks.workunit.client.0.smithi112.stdout:0/1: link - no file 2024-09-21T00:56:28.042 INFO:tasks.workunit.client.0.smithi112.stdout:0/2: rename - no filename 2024-09-21T00:56:28.043 INFO:tasks.workunit.client.1.smithi187.stdout:9/224: rmdir d4/d13/d3a 39 2024-09-21T00:56:28.043 INFO:tasks.workunit.client.1.smithi187.stdout:0/114: dwrite d0/f14 [4194304,4194304] 0 2024-09-21T00:56:28.043 INFO:tasks.workunit.client.1.smithi187.stdout:5/73: dread d0/fa [0,4194304] 0 2024-09-21T00:56:28.044 INFO:tasks.workunit.client.1.smithi187.stdout:8/132: readlink dc/lf 0 2024-09-21T00:56:28.044 INFO:tasks.workunit.client.1.smithi187.stdout:4/78: creat d2/d3/da/f1b x:0 0 0 2024-09-21T00:56:28.046 INFO:tasks.workunit.client.1.smithi187.stdout:0/115: readlink d0/dc/l12 0 2024-09-21T00:56:28.046 INFO:tasks.workunit.client.0.smithi112.stdout:1/0: rmdir - no directory 2024-09-21T00:56:28.046 INFO:tasks.workunit.client.1.smithi187.stdout:4/79: chown d2/f11 2450 1 2024-09-21T00:56:28.048 INFO:tasks.workunit.client.1.smithi187.stdout:4/80: chown d2/d3/lb 0 1 2024-09-21T00:56:28.048 INFO:tasks.workunit.client.1.smithi187.stdout:1/78: dwrite d4/f11 [0,4194304] 0 2024-09-21T00:56:28.050 INFO:tasks.workunit.client.1.smithi187.stdout:8/133: creat dc/d1c/f27 x:0 0 0 2024-09-21T00:56:28.051 INFO:tasks.workunit.client.1.smithi187.stdout:8/134: write dc/f14 [221652,33759] 0 2024-09-21T00:56:28.051 INFO:tasks.workunit.client.1.smithi187.stdout:9/225: rename d4/f9 to d4/d8/f48 0 2024-09-21T00:56:28.051 INFO:tasks.workunit.client.0.smithi112.stdout:0/3: symlink l0 0 2024-09-21T00:56:28.051 INFO:tasks.workunit.client.0.smithi112.stdout:0/4: fsync - no filename 2024-09-21T00:56:28.052 INFO:tasks.workunit.client.0.smithi112.stdout:0/5: chown l0 21 1 2024-09-21T00:56:28.052 INFO:tasks.workunit.client.0.smithi112.stdout:0/6: fsync - no filename 2024-09-21T00:56:28.053 INFO:tasks.workunit.client.0.smithi112.stdout:0/7: truncate - no filename 2024-09-21T00:56:28.053 INFO:tasks.workunit.client.1.smithi187.stdout:0/116: creat d0/dc/df/f1d x:0 0 0 2024-09-21T00:56:28.054 INFO:tasks.workunit.client.1.smithi187.stdout:0/117: write d0/f1 [710076,117422] 0 2024-09-21T00:56:28.058 INFO:tasks.workunit.client.0.smithi112.stdout:0/8: rename l0 to l1 0 2024-09-21T00:56:28.058 INFO:tasks.workunit.client.0.smithi112.stdout:0/9: dread - no filename 2024-09-21T00:56:28.059 INFO:tasks.workunit.client.1.smithi187.stdout:1/79: creat d4/d6/d8/f13 x:0 0 0 2024-09-21T00:56:28.062 INFO:tasks.workunit.client.0.smithi112.stdout:3/0: read - no filename 2024-09-21T00:56:28.062 INFO:tasks.workunit.client.0.smithi112.stdout:3/1: truncate - no filename 2024-09-21T00:56:28.062 INFO:tasks.workunit.client.0.smithi112.stdout:3/2: dwrite - no filename 2024-09-21T00:56:28.062 INFO:tasks.workunit.client.0.smithi112.stdout:3/3: stat - no entries 2024-09-21T00:56:28.062 INFO:tasks.workunit.client.0.smithi112.stdout:3/4: rename - no filename 2024-09-21T00:56:28.062 INFO:tasks.workunit.client.0.smithi112.stdout:3/5: dread - no filename 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/6: fdatasync - no filename 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/7: write - no filename 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/8: read - no filename 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/9: truncate - no filename 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/10: write - no filename 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/11: write - no filename 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/12: stat - no entries 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.1.smithi187.stdout:9/226: symlink d4/d13/d20/l49 0 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:1/1: getdents . 0 2024-09-21T00:56:28.063 INFO:tasks.workunit.client.0.smithi112.stdout:1/2: dwrite - no filename 2024-09-21T00:56:28.064 INFO:tasks.workunit.client.1.smithi187.stdout:0/118: unlink d0/c9 0 2024-09-21T00:56:28.065 INFO:tasks.workunit.client.1.smithi187.stdout:5/74: rename d0/df to d0/d19 0 2024-09-21T00:56:28.066 INFO:tasks.workunit.client.1.smithi187.stdout:4/81: symlink d2/d3/da/d16/d18/l1c 0 2024-09-21T00:56:28.066 INFO:tasks.workunit.client.1.smithi187.stdout:5/75: fdatasync d0/dc/f11 0 2024-09-21T00:56:28.067 INFO:tasks.workunit.client.0.smithi112.stdout:2/0: mkdir d0 0 2024-09-21T00:56:28.067 INFO:tasks.workunit.client.1.smithi187.stdout:1/80: creat d4/f14 x:0 0 0 2024-09-21T00:56:28.070 INFO:tasks.workunit.client.1.smithi187.stdout:9/227: rename d4/d10/f35 to d4/d10/f4a 0 2024-09-21T00:56:28.072 INFO:tasks.workunit.client.0.smithi112.stdout:3/13: creat f0 x:0 0 0 2024-09-21T00:56:28.072 INFO:tasks.workunit.client.0.smithi112.stdout:3/14: fdatasync f0 0 2024-09-21T00:56:28.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/3: symlink l0 0 2024-09-21T00:56:28.074 INFO:tasks.workunit.client.0.smithi112.stdout:1/4: fsync - no filename 2024-09-21T00:56:28.075 INFO:tasks.workunit.client.1.smithi187.stdout:8/135: creat dc/f28 x:0 0 0 2024-09-21T00:56:28.077 INFO:tasks.workunit.client.0.smithi112.stdout:6/0: rename - no filename 2024-09-21T00:56:28.079 INFO:tasks.workunit.client.1.smithi187.stdout:4/82: dwrite d2/ff [0,4194304] 0 2024-09-21T00:56:28.080 INFO:tasks.workunit.client.0.smithi112.stdout:4/0: creat f0 x:0 0 0 2024-09-21T00:56:28.080 INFO:tasks.workunit.client.0.smithi112.stdout:4/1: truncate f0 183948 0 2024-09-21T00:56:28.080 INFO:tasks.workunit.client.1.smithi187.stdout:4/83: read d2/d3/da/fc [4475422,75008] 0 2024-09-21T00:56:28.081 INFO:tasks.workunit.client.1.smithi187.stdout:5/76: symlink d0/l1a 0 2024-09-21T00:56:28.081 INFO:tasks.workunit.client.1.smithi187.stdout:4/84: readlink d2/d3/da/d16/d18/l1c 0 2024-09-21T00:56:28.081 INFO:tasks.workunit.client.1.smithi187.stdout:5/77: dread - d0/dc/f11 zero size 2024-09-21T00:56:28.082 INFO:tasks.workunit.client.0.smithi112.stdout:2/1: mknod d0/c1 0 2024-09-21T00:56:28.082 INFO:tasks.workunit.client.0.smithi112.stdout:2/2: dwrite - no filename 2024-09-21T00:56:28.082 INFO:tasks.workunit.client.0.smithi112.stdout:2/3: write - no filename 2024-09-21T00:56:28.082 INFO:tasks.workunit.client.1.smithi187.stdout:4/85: write d2/ff [4199928,83702] 0 2024-09-21T00:56:28.084 INFO:tasks.workunit.client.1.smithi187.stdout:4/86: write d2/d3/da/fc [8449887,27891] 0 2024-09-21T00:56:28.084 INFO:tasks.workunit.client.0.smithi112.stdout:3/15: rename f0 to f1 0 2024-09-21T00:56:28.086 INFO:tasks.workunit.client.1.smithi187.stdout:9/228: mkdir d4/d4b 0 2024-09-21T00:56:28.087 INFO:tasks.workunit.client.1.smithi187.stdout:5/78: dread d0/f9 [0,4194304] 0 2024-09-21T00:56:28.088 INFO:tasks.workunit.client.1.smithi187.stdout:8/136: write dc/fd [3725,100390] 0 2024-09-21T00:56:28.088 INFO:tasks.workunit.client.0.smithi112.stdout:1/5: symlink l1 0 2024-09-21T00:56:28.088 INFO:tasks.workunit.client.0.smithi112.stdout:1/6: dread - no filename 2024-09-21T00:56:28.089 INFO:tasks.workunit.client.0.smithi112.stdout:1/7: readlink l1 0 2024-09-21T00:56:28.091 INFO:tasks.workunit.client.0.smithi112.stdout:4/2: dwrite f0 [0,4194304] 0 2024-09-21T00:56:28.092 INFO:tasks.workunit.client.0.smithi112.stdout:7/0: chown . 2463 1 2024-09-21T00:56:28.092 INFO:tasks.workunit.client.0.smithi112.stdout:7/1: write - no filename 2024-09-21T00:56:28.092 INFO:tasks.workunit.client.0.smithi112.stdout:7/2: dread - no filename 2024-09-21T00:56:28.092 INFO:tasks.workunit.client.0.smithi112.stdout:7/3: readlink - no filename 2024-09-21T00:56:28.093 INFO:tasks.workunit.client.0.smithi112.stdout:7/4: write - no filename 2024-09-21T00:56:28.095 INFO:tasks.workunit.client.1.smithi187.stdout:4/87: creat d2/d3/da/d16/f1d x:0 0 0 2024-09-21T00:56:28.095 INFO:tasks.workunit.client.0.smithi112.stdout:5/0: creat f0 x:0 0 0 2024-09-21T00:56:28.096 INFO:tasks.workunit.client.0.smithi112.stdout:5/1: rmdir - no directory 2024-09-21T00:56:28.097 INFO:tasks.workunit.client.0.smithi112.stdout:5/2: write f0 [557801,77697] 0 2024-09-21T00:56:28.097 INFO:tasks.workunit.client.0.smithi112.stdout:5/3: truncate f0 1187423 0 2024-09-21T00:56:28.098 INFO:tasks.workunit.client.0.smithi112.stdout:0/10: rename l1 to l2 0 2024-09-21T00:56:28.098 INFO:tasks.workunit.client.0.smithi112.stdout:5/4: chown f0 0 1 2024-09-21T00:56:28.099 INFO:tasks.workunit.client.1.smithi187.stdout:9/229: mknod d4/d13/d14/d1d/c4c 0 2024-09-21T00:56:28.100 INFO:tasks.workunit.client.1.smithi187.stdout:4/88: dread d2/f11 [4194304,4194304] 0 2024-09-21T00:56:28.101 INFO:tasks.workunit.client.1.smithi187.stdout:4/89: chown d2/d3/da/d16/l1a 92 1 2024-09-21T00:56:28.101 INFO:tasks.workunit.client.0.smithi112.stdout:2/4: unlink d0/c1 0 2024-09-21T00:56:28.101 INFO:tasks.workunit.client.0.smithi112.stdout:2/5: truncate - no filename 2024-09-21T00:56:28.101 INFO:tasks.workunit.client.0.smithi112.stdout:2/6: truncate - no filename 2024-09-21T00:56:28.102 INFO:tasks.workunit.client.0.smithi112.stdout:2/7: rename d0 to d0/d2 22 2024-09-21T00:56:28.102 INFO:tasks.workunit.client.1.smithi187.stdout:5/79: mkdir d0/d19/d14/d1b 0 2024-09-21T00:56:28.102 INFO:tasks.workunit.client.0.smithi112.stdout:2/8: chown d0 2 1 2024-09-21T00:56:28.102 INFO:tasks.workunit.client.0.smithi112.stdout:2/9: unlink - no file 2024-09-21T00:56:28.103 INFO:tasks.workunit.client.0.smithi112.stdout:2/10: dread - no filename 2024-09-21T00:56:28.103 INFO:tasks.workunit.client.1.smithi187.stdout:5/80: write d0/d19/f10 [589815,60582] 0 2024-09-21T00:56:28.104 INFO:tasks.workunit.client.0.smithi112.stdout:3/16: mkdir d2 0 2024-09-21T00:56:28.104 INFO:tasks.workunit.client.1.smithi187.stdout:0/119: symlink d0/d17/d18/l1e 0 2024-09-21T00:56:28.105 INFO:tasks.workunit.client.0.smithi112.stdout:3/17: chown f1 24717811 1 2024-09-21T00:56:28.106 INFO:tasks.workunit.client.1.smithi187.stdout:9/230: dwrite d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:28.107 INFO:tasks.workunit.client.0.smithi112.stdout:5/5: dwrite f0 [0,4194304] 0 2024-09-21T00:56:28.107 INFO:tasks.workunit.client.0.smithi112.stdout:8/0: dread - no filename 2024-09-21T00:56:28.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/1: dwrite - no filename 2024-09-21T00:56:28.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/2: dwrite - no filename 2024-09-21T00:56:28.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/3: unlink - no file 2024-09-21T00:56:28.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/4: link - no file 2024-09-21T00:56:28.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/5: unlink - no file 2024-09-21T00:56:28.108 INFO:tasks.workunit.client.1.smithi187.stdout:4/90: mknod d2/d3/da/d16/c1e 0 2024-09-21T00:56:28.108 INFO:tasks.workunit.client.0.smithi112.stdout:6/1: mknod c0 0 2024-09-21T00:56:28.112 INFO:tasks.workunit.client.1.smithi187.stdout:0/120: fdatasync d0/dc/df/f1d 0 2024-09-21T00:56:28.112 INFO:tasks.workunit.client.1.smithi187.stdout:9/231: write d4/d13/d20/f26 [752327,92573] 0 2024-09-21T00:56:28.112 INFO:tasks.workunit.client.1.smithi187.stdout:4/91: creat d2/d3/da/f1f x:0 0 0 2024-09-21T00:56:28.114 INFO:tasks.workunit.client.0.smithi112.stdout:2/11: creat d0/f3 x:0 0 0 2024-09-21T00:56:28.114 INFO:tasks.workunit.client.1.smithi187.stdout:4/92: write d2/d3/f13 [955444,72412] 0 2024-09-21T00:56:28.115 INFO:tasks.workunit.client.1.smithi187.stdout:0/121: truncate d0/dc/f19 800076 0 2024-09-21T00:56:28.115 INFO:tasks.workunit.client.0.smithi112.stdout:5/6: dread f0 [0,4194304] 0 2024-09-21T00:56:28.116 INFO:tasks.workunit.client.1.smithi187.stdout:4/93: write d2/ff [1520671,34173] 0 2024-09-21T00:56:28.117 INFO:tasks.workunit.client.0.smithi112.stdout:5/7: write f0 [2025382,87535] 0 2024-09-21T00:56:28.117 INFO:tasks.workunit.client.1.smithi187.stdout:8/137: getdents dc 0 2024-09-21T00:56:28.118 INFO:tasks.workunit.client.0.smithi112.stdout:5/8: chown f0 4570 1 2024-09-21T00:56:28.118 INFO:tasks.workunit.client.1.smithi187.stdout:4/94: dread - d2/d3/da/f1b zero size 2024-09-21T00:56:28.118 INFO:tasks.workunit.client.1.smithi187.stdout:5/81: link d0/d19/f15 d0/d19/d14/d1b/f1c 0 2024-09-21T00:56:28.119 INFO:tasks.workunit.client.1.smithi187.stdout:4/95: read - d2/d3/da/f1f zero size 2024-09-21T00:56:28.123 INFO:tasks.workunit.client.1.smithi187.stdout:9/232: rename d4/d10/d39/l47 to d4/d8/d41/l4d 0 2024-09-21T00:56:28.127 INFO:tasks.workunit.client.0.smithi112.stdout:7/5: mkdir d0 0 2024-09-21T00:56:28.127 INFO:tasks.workunit.client.0.smithi112.stdout:7/6: dread - no filename 2024-09-21T00:56:28.127 INFO:tasks.workunit.client.0.smithi112.stdout:7/7: rename d0 to d0/d1 22 2024-09-21T00:56:28.127 INFO:tasks.workunit.client.1.smithi187.stdout:5/82: creat d0/dc/f1d x:0 0 0 2024-09-21T00:56:28.130 INFO:tasks.workunit.client.1.smithi187.stdout:4/96: creat d2/d3/da/f20 x:0 0 0 2024-09-21T00:56:28.131 INFO:tasks.workunit.client.0.smithi112.stdout:0/11: chown l2 1155406 1 2024-09-21T00:56:28.131 INFO:tasks.workunit.client.0.smithi112.stdout:3/18: symlink d2/l3 0 2024-09-21T00:56:28.134 INFO:tasks.workunit.client.1.smithi187.stdout:0/122: rename d0/dc/c13 to d0/d17/d1c/c1f 0 2024-09-21T00:56:28.135 INFO:tasks.workunit.client.1.smithi187.stdout:9/233: mkdir d4/d13/d14/d1d/d4e 0 2024-09-21T00:56:28.136 INFO:tasks.workunit.client.1.smithi187.stdout:9/234: fdatasync d4/d13/d20/f37 0 2024-09-21T00:56:28.136 INFO:tasks.workunit.client.1.smithi187.stdout:7/60: sync 2024-09-21T00:56:28.136 INFO:tasks.workunit.client.1.smithi187.stdout:6/73: sync 2024-09-21T00:56:28.137 INFO:tasks.workunit.client.1.smithi187.stdout:8/138: truncate dc/f24 70160 0 2024-09-21T00:56:28.137 INFO:tasks.workunit.client.0.smithi112.stdout:8/6: mkdir d0 0 2024-09-21T00:56:28.140 INFO:tasks.workunit.client.1.smithi187.stdout:4/97: fdatasync d2/d3/da/fc 0 2024-09-21T00:56:28.142 INFO:tasks.workunit.client.1.smithi187.stdout:9/235: dwrite d4/d10/f23 [0,4194304] 0 2024-09-21T00:56:28.143 INFO:tasks.workunit.client.0.smithi112.stdout:4/3: dwrite f0 [4194304,4194304] 0 2024-09-21T00:56:28.143 INFO:tasks.workunit.client.0.smithi112.stdout:4/4: rmdir - no directory 2024-09-21T00:56:28.148 INFO:tasks.workunit.client.0.smithi112.stdout:3/19: write f1 [340084,99501] 0 2024-09-21T00:56:28.150 INFO:tasks.workunit.client.0.smithi112.stdout:5/9: rename f0 to f1 0 2024-09-21T00:56:28.154 INFO:tasks.workunit.client.0.smithi112.stdout:9/0: creat f0 x:0 0 0 2024-09-21T00:56:28.155 INFO:tasks.workunit.client.1.smithi187.stdout:6/74: creat d7/dc/f11 x:0 0 0 2024-09-21T00:56:28.155 INFO:tasks.workunit.client.0.smithi112.stdout:9/1: dread - f0 zero size 2024-09-21T00:56:28.156 INFO:tasks.workunit.client.1.smithi187.stdout:2/136: sync 2024-09-21T00:56:28.156 INFO:tasks.workunit.client.1.smithi187.stdout:3/87: sync 2024-09-21T00:56:28.156 INFO:tasks.workunit.client.1.smithi187.stdout:1/81: sync 2024-09-21T00:56:28.156 INFO:tasks.workunit.client.1.smithi187.stdout:8/139: mkdir dc/d1c/d29 0 2024-09-21T00:56:28.158 INFO:tasks.workunit.client.0.smithi112.stdout:3/20: dwrite f1 [0,4194304] 0 2024-09-21T00:56:28.159 INFO:tasks.workunit.client.1.smithi187.stdout:5/83: unlink d0/d19/ce 0 2024-09-21T00:56:28.160 INFO:tasks.workunit.client.0.smithi112.stdout:7/8: mkdir d0/d2 0 2024-09-21T00:56:28.160 INFO:tasks.workunit.client.0.smithi112.stdout:7/9: unlink - no file 2024-09-21T00:56:28.160 INFO:tasks.workunit.client.0.smithi112.stdout:7/10: readlink - no filename 2024-09-21T00:56:28.160 INFO:tasks.workunit.client.0.smithi112.stdout:7/11: dwrite - no filename 2024-09-21T00:56:28.160 INFO:tasks.workunit.client.0.smithi112.stdout:7/12: read - no filename 2024-09-21T00:56:28.163 INFO:tasks.workunit.client.1.smithi187.stdout:6/75: dwrite f1 [0,4194304] 0 2024-09-21T00:56:28.165 INFO:tasks.workunit.client.1.smithi187.stdout:9/236: write d4/d10/f4a [2762520,26323] 0 2024-09-21T00:56:28.166 INFO:tasks.workunit.client.0.smithi112.stdout:4/5: mkdir d1 0 2024-09-21T00:56:28.167 INFO:tasks.workunit.client.1.smithi187.stdout:8/140: dwrite f0 [0,4194304] 0 2024-09-21T00:56:28.170 INFO:tasks.workunit.client.1.smithi187.stdout:8/141: write dc/f14 [1247372,44329] 0 2024-09-21T00:56:28.171 INFO:tasks.workunit.client.1.smithi187.stdout:7/61: mkdir d1/dc/d15 0 2024-09-21T00:56:28.171 INFO:tasks.workunit.client.1.smithi187.stdout:7/62: stat d1/dc 0 2024-09-21T00:56:28.173 INFO:tasks.workunit.client.0.smithi112.stdout:5/10: write f1 [1419348,31415] 0 2024-09-21T00:56:28.176 INFO:tasks.workunit.client.0.smithi112.stdout:6/2: getdents . 0 2024-09-21T00:56:28.177 INFO:tasks.workunit.client.0.smithi112.stdout:6/3: dread - no filename 2024-09-21T00:56:28.177 INFO:tasks.workunit.client.1.smithi187.stdout:8/142: dwrite f0 [0,4194304] 0 2024-09-21T00:56:28.178 INFO:tasks.workunit.client.1.smithi187.stdout:0/123: truncate d0/dc/f19 357282 0 2024-09-21T00:56:28.180 INFO:tasks.workunit.client.1.smithi187.stdout:1/82: mknod d4/c15 0 2024-09-21T00:56:28.181 INFO:tasks.workunit.client.0.smithi112.stdout:8/7: symlink d0/l1 0 2024-09-21T00:56:28.181 INFO:tasks.workunit.client.0.smithi112.stdout:8/8: dwrite - no filename 2024-09-21T00:56:28.181 INFO:tasks.workunit.client.0.smithi112.stdout:5/11: fsync f1 0 2024-09-21T00:56:28.181 INFO:tasks.workunit.client.0.smithi112.stdout:3/21: fsync f1 0 2024-09-21T00:56:28.182 INFO:tasks.workunit.client.0.smithi112.stdout:3/22: stat d2/l3 0 2024-09-21T00:56:28.183 INFO:tasks.workunit.client.0.smithi112.stdout:3/23: write f1 [977048,53332] 0 2024-09-21T00:56:28.186 INFO:tasks.workunit.client.0.smithi112.stdout:2/12: getdents d0 0 2024-09-21T00:56:28.186 INFO:tasks.workunit.client.1.smithi187.stdout:5/84: creat d0/d19/f1e x:0 0 0 2024-09-21T00:56:28.186 INFO:tasks.workunit.client.1.smithi187.stdout:4/98: link d2/d3/da/f1f d2/d3/f21 0 2024-09-21T00:56:28.188 INFO:tasks.workunit.client.0.smithi112.stdout:2/13: dread - d0/f3 zero size 2024-09-21T00:56:28.188 INFO:tasks.workunit.client.0.smithi112.stdout:2/14: stat d0 0 2024-09-21T00:56:28.188 INFO:tasks.workunit.client.0.smithi112.stdout:5/12: dread f1 [0,4194304] 0 2024-09-21T00:56:28.189 INFO:tasks.workunit.client.1.smithi187.stdout:7/63: symlink d1/dc/l16 0 2024-09-21T00:56:28.190 INFO:tasks.workunit.client.1.smithi187.stdout:7/64: write d1/f14 [335937,76989] 0 2024-09-21T00:56:28.190 INFO:tasks.workunit.client.0.smithi112.stdout:6/4: mknod c1 0 2024-09-21T00:56:28.190 INFO:tasks.workunit.client.0.smithi112.stdout:6/5: dread - no filename 2024-09-21T00:56:28.192 INFO:tasks.workunit.client.0.smithi112.stdout:3/24: dread f1 [0,4194304] 0 2024-09-21T00:56:28.193 INFO:tasks.workunit.client.0.smithi112.stdout:8/9: symlink d0/l2 0 2024-09-21T00:56:28.197 INFO:tasks.workunit.client.1.smithi187.stdout:0/124: creat d0/d17/d18/f20 x:0 0 0 2024-09-21T00:56:28.198 INFO:tasks.workunit.client.0.smithi112.stdout:4/6: symlink d1/l2 0 2024-09-21T00:56:28.199 INFO:tasks.workunit.client.0.smithi112.stdout:4/7: read f0 [4784626,102206] 0 2024-09-21T00:56:28.199 INFO:tasks.workunit.client.1.smithi187.stdout:1/83: mknod d4/c16 0 2024-09-21T00:56:28.200 INFO:tasks.workunit.client.1.smithi187.stdout:1/84: chown d4/c15 15 1 2024-09-21T00:56:28.200 INFO:tasks.workunit.client.0.smithi112.stdout:0/12: getdents . 0 2024-09-21T00:56:28.200 INFO:tasks.workunit.client.1.smithi187.stdout:1/85: write d4/f11 [1552323,41582] 0 2024-09-21T00:56:28.201 INFO:tasks.workunit.client.1.smithi187.stdout:3/88: getdents d9/d19/d1c 0 2024-09-21T00:56:28.201 INFO:tasks.workunit.client.0.smithi112.stdout:2/15: rmdir d0 39 2024-09-21T00:56:28.202 INFO:tasks.workunit.client.1.smithi187.stdout:1/86: write d4/d6/d8/f13 [666690,127632] 0 2024-09-21T00:56:28.203 INFO:tasks.workunit.client.0.smithi112.stdout:5/13: creat f2 x:0 0 0 2024-09-21T00:56:28.205 INFO:tasks.workunit.client.0.smithi112.stdout:6/6: creat f2 x:0 0 0 2024-09-21T00:56:28.206 INFO:tasks.workunit.client.0.smithi112.stdout:6/7: dread - f2 zero size 2024-09-21T00:56:28.207 INFO:tasks.workunit.client.0.smithi112.stdout:6/8: write f2 [144051,114084] 0 2024-09-21T00:56:28.209 INFO:tasks.workunit.client.0.smithi112.stdout:3/25: mknod d2/c4 0 2024-09-21T00:56:28.210 INFO:tasks.workunit.client.1.smithi187.stdout:8/143: chown f8 3931 1 2024-09-21T00:56:28.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/10: creat d0/f3 x:0 0 0 2024-09-21T00:56:28.214 INFO:tasks.workunit.client.1.smithi187.stdout:2/137: dwrite d2/fb [0,4194304] 0 2024-09-21T00:56:28.215 INFO:tasks.workunit.client.0.smithi112.stdout:6/9: dwrite f2 [0,4194304] 0 2024-09-21T00:56:28.216 INFO:tasks.workunit.client.0.smithi112.stdout:4/8: mknod d1/c3 0 2024-09-21T00:56:28.217 INFO:tasks.workunit.client.0.smithi112.stdout:0/13: creat f3 x:0 0 0 2024-09-21T00:56:28.217 INFO:tasks.workunit.client.0.smithi112.stdout:0/14: rmdir - no directory 2024-09-21T00:56:28.218 INFO:tasks.workunit.client.0.smithi112.stdout:0/15: fdatasync f3 0 2024-09-21T00:56:28.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/16: dread - d0/f3 zero size 2024-09-21T00:56:28.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/17: chown d0 0 1 2024-09-21T00:56:28.221 INFO:tasks.workunit.client.0.smithi112.stdout:2/18: chown d0 3 1 2024-09-21T00:56:28.221 INFO:tasks.workunit.client.0.smithi112.stdout:5/14: creat f3 x:0 0 0 2024-09-21T00:56:28.222 INFO:tasks.workunit.client.0.smithi112.stdout:9/2: getdents . 0 2024-09-21T00:56:28.223 INFO:tasks.workunit.client.0.smithi112.stdout:5/15: write f2 [491687,46987] 0 2024-09-21T00:56:28.225 INFO:tasks.workunit.client.0.smithi112.stdout:8/11: symlink d0/l4 0 2024-09-21T00:56:28.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/13: getdents d0 0 2024-09-21T00:56:28.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/14: fsync - no filename 2024-09-21T00:56:28.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/15: fdatasync - no filename 2024-09-21T00:56:28.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/16: truncate - no filename 2024-09-21T00:56:28.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/17: dread - no filename 2024-09-21T00:56:28.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/18: readlink - no filename 2024-09-21T00:56:28.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/19: dwrite - no filename 2024-09-21T00:56:28.228 INFO:tasks.workunit.client.0.smithi112.stdout:6/10: creat f3 x:0 0 0 2024-09-21T00:56:28.229 INFO:tasks.workunit.client.0.smithi112.stdout:6/11: write f2 [1802466,111471] 0 2024-09-21T00:56:28.229 INFO:tasks.workunit.client.0.smithi112.stdout:4/9: rename d1/c3 to d1/c4 0 2024-09-21T00:56:28.231 INFO:tasks.workunit.client.0.smithi112.stdout:0/16: symlink l4 0 2024-09-21T00:56:28.233 INFO:tasks.workunit.client.0.smithi112.stdout:2/19: creat d0/f4 x:0 0 0 2024-09-21T00:56:28.234 INFO:tasks.workunit.client.0.smithi112.stdout:9/3: rename f0 to f1 0 2024-09-21T00:56:28.236 INFO:tasks.workunit.client.0.smithi112.stdout:5/16: creat f4 x:0 0 0 2024-09-21T00:56:28.237 INFO:tasks.workunit.client.0.smithi112.stdout:8/12: symlink d0/l5 0 2024-09-21T00:56:28.238 INFO:tasks.workunit.client.0.smithi112.stdout:6/12: dwrite f3 [0,4194304] 0 2024-09-21T00:56:28.240 INFO:tasks.workunit.client.0.smithi112.stdout:4/10: mkdir d1/d5 0 2024-09-21T00:56:28.240 INFO:tasks.workunit.client.0.smithi112.stdout:4/11: readlink d1/l2 0 2024-09-21T00:56:28.241 INFO:tasks.workunit.client.0.smithi112.stdout:4/12: chown d1/l2 3264 1 2024-09-21T00:56:28.245 INFO:tasks.workunit.client.0.smithi112.stdout:2/20: creat d0/f5 x:0 0 0 2024-09-21T00:56:28.246 INFO:tasks.workunit.client.1.smithi187.stdout:6/76: sync 2024-09-21T00:56:28.249 INFO:tasks.workunit.client.1.smithi187.stdout:5/85: mkdir d0/dc/d1f 0 2024-09-21T00:56:28.249 INFO:tasks.workunit.client.1.smithi187.stdout:5/86: fdatasync d0/dc/f1d 0 2024-09-21T00:56:28.249 INFO:tasks.workunit.client.0.smithi112.stdout:9/4: creat f2 x:0 0 0 2024-09-21T00:56:28.250 INFO:tasks.workunit.client.1.smithi187.stdout:4/99: fdatasync d2/d3/da/fc 0 2024-09-21T00:56:28.251 INFO:tasks.workunit.client.1.smithi187.stdout:4/100: chown d2/d3/f13 13 1 2024-09-21T00:56:28.251 INFO:tasks.workunit.client.0.smithi112.stdout:5/17: rename f1 to f5 0 2024-09-21T00:56:28.252 INFO:tasks.workunit.client.0.smithi112.stdout:5/18: truncate f2 945987 0 2024-09-21T00:56:28.252 INFO:tasks.workunit.client.1.smithi187.stdout:7/65: stat d1/f11 0 2024-09-21T00:56:28.253 INFO:tasks.workunit.client.0.smithi112.stdout:7/20: mknod d0/d2/c3 0 2024-09-21T00:56:28.253 INFO:tasks.workunit.client.1.smithi187.stdout:4/101: read d2/d3/f13 [622164,129473] 0 2024-09-21T00:56:28.254 INFO:tasks.workunit.client.0.smithi112.stdout:8/13: mknod d0/c6 0 2024-09-21T00:56:28.256 INFO:tasks.workunit.client.0.smithi112.stdout:6/13: rename c0 to c4 0 2024-09-21T00:56:28.256 INFO:tasks.workunit.client.0.smithi112.stdout:6/14: read f3 [2055525,4280] 0 2024-09-21T00:56:28.257 INFO:tasks.workunit.client.0.smithi112.stdout:6/15: write f3 [1538771,79039] 0 2024-09-21T00:56:28.260 INFO:tasks.workunit.client.1.smithi187.stdout:0/125: dwrite d0/f14 [4194304,4194304] 0 2024-09-21T00:56:28.260 INFO:tasks.workunit.client.1.smithi187.stdout:1/87: creat d4/f17 x:0 0 0 2024-09-21T00:56:28.261 INFO:tasks.workunit.client.0.smithi112.stdout:2/21: mknod d0/c6 0 2024-09-21T00:56:28.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/22: chown d0/f5 355 1 2024-09-21T00:56:28.262 INFO:tasks.workunit.client.0.smithi112.stdout:2/23: read - d0/f3 zero size 2024-09-21T00:56:28.262 INFO:tasks.workunit.client.1.smithi187.stdout:8/144: creat dc/d1c/f2a x:0 0 0 2024-09-21T00:56:28.263 INFO:tasks.workunit.client.0.smithi112.stdout:2/24: dread - d0/f4 zero size 2024-09-21T00:56:28.263 INFO:tasks.workunit.client.1.smithi187.stdout:8/145: chown dc/d1c/f2a 249 1 2024-09-21T00:56:28.263 INFO:tasks.workunit.client.0.smithi112.stdout:3/26: getdents d2 0 2024-09-21T00:56:28.264 INFO:tasks.workunit.client.0.smithi112.stdout:3/27: chown f1 225195344 1 2024-09-21T00:56:28.267 INFO:tasks.workunit.client.0.smithi112.stdout:4/13: truncate f0 5976475 0 2024-09-21T00:56:28.268 INFO:tasks.workunit.client.1.smithi187.stdout:2/138: symlink d2/dc/d21/l35 0 2024-09-21T00:56:28.270 INFO:tasks.workunit.client.1.smithi187.stdout:9/237: link d4/d8/la d4/d4b/l4f 0 2024-09-21T00:56:28.271 INFO:tasks.workunit.client.0.smithi112.stdout:7/21: rename d0/d2/c3 to d0/d2/c4 0 2024-09-21T00:56:28.272 INFO:tasks.workunit.client.1.smithi187.stdout:6/77: symlink d7/dc/l12 0 2024-09-21T00:56:28.273 INFO:tasks.workunit.client.0.smithi112.stdout:9/5: dwrite f1 [0,4194304] 0 2024-09-21T00:56:28.273 INFO:tasks.workunit.client.0.smithi112.stdout:9/6: stat f2 0 2024-09-21T00:56:28.273 INFO:tasks.workunit.client.0.smithi112.stdout:8/14: mknod d0/c7 0 2024-09-21T00:56:28.274 INFO:tasks.workunit.client.0.smithi112.stdout:9/7: write f1 [3430409,2511] 0 2024-09-21T00:56:28.274 INFO:tasks.workunit.client.0.smithi112.stdout:8/15: chown d0/l2 229149 1 2024-09-21T00:56:28.275 INFO:tasks.workunit.client.1.smithi187.stdout:9/238: dwrite d4/f5 [0,4194304] 0 2024-09-21T00:56:28.276 INFO:tasks.workunit.client.0.smithi112.stdout:8/16: write d0/f3 [42923,120226] 0 2024-09-21T00:56:28.280 INFO:tasks.workunit.client.0.smithi112.stdout:0/17: link l2 l5 0 2024-09-21T00:56:28.283 INFO:tasks.workunit.client.1.smithi187.stdout:4/102: unlink d2/d3/da/f20 0 2024-09-21T00:56:28.285 INFO:tasks.workunit.client.0.smithi112.stdout:2/25: mkdir d0/d7 0 2024-09-21T00:56:28.285 INFO:tasks.workunit.client.0.smithi112.stdout:2/26: dread - d0/f3 zero size 2024-09-21T00:56:28.286 INFO:tasks.workunit.client.0.smithi112.stdout:2/27: fsync d0/f3 0 2024-09-21T00:56:28.286 INFO:tasks.workunit.client.0.smithi112.stdout:2/28: chown d0/c6 2 1 2024-09-21T00:56:28.287 INFO:tasks.workunit.client.0.smithi112.stdout:6/16: write f2 [5005730,13440] 0 2024-09-21T00:56:28.287 INFO:tasks.workunit.client.0.smithi112.stdout:3/28: write f1 [1849578,71280] 0 2024-09-21T00:56:28.288 INFO:tasks.workunit.client.0.smithi112.stdout:2/29: read - d0/f5 zero size 2024-09-21T00:56:28.289 INFO:tasks.workunit.client.1.smithi187.stdout:3/89: mkdir d9/d19/d1c/d1f 0 2024-09-21T00:56:28.290 INFO:tasks.workunit.client.0.smithi112.stdout:2/30: dread - d0/f4 zero size 2024-09-21T00:56:28.290 INFO:tasks.workunit.client.0.smithi112.stdout:4/14: rmdir d1 39 2024-09-21T00:56:28.290 INFO:tasks.workunit.client.0.smithi112.stdout:2/31: write d0/f5 [169353,122877] 0 2024-09-21T00:56:28.290 INFO:tasks.workunit.client.1.smithi187.stdout:0/126: mkdir d0/d17/d1c/d21 0 2024-09-21T00:56:28.292 INFO:tasks.workunit.client.0.smithi112.stdout:5/19: link f4 f6 0 2024-09-21T00:56:28.293 INFO:tasks.workunit.client.1.smithi187.stdout:1/88: mknod d4/c18 0 2024-09-21T00:56:28.294 INFO:tasks.workunit.client.1.smithi187.stdout:1/89: truncate d4/d6/d8/f13 1452782 0 2024-09-21T00:56:28.294 INFO:tasks.workunit.client.1.smithi187.stdout:8/146: mknod dc/d1c/c2b 0 2024-09-21T00:56:28.299 INFO:tasks.workunit.client.1.smithi187.stdout:6/78: creat d7/dc/f13 x:0 0 0 2024-09-21T00:56:28.300 INFO:tasks.workunit.client.1.smithi187.stdout:6/79: read - d7/dc/f13 zero size 2024-09-21T00:56:28.300 INFO:tasks.workunit.client.1.smithi187.stdout:6/80: dread - d7/dc/f13 zero size 2024-09-21T00:56:28.302 INFO:tasks.workunit.client.0.smithi112.stdout:8/17: creat d0/f8 x:0 0 0 2024-09-21T00:56:28.304 INFO:tasks.workunit.client.0.smithi112.stdout:0/18: symlink l6 0 2024-09-21T00:56:28.304 INFO:tasks.workunit.client.0.smithi112.stdout:0/19: read - f3 zero size 2024-09-21T00:56:28.305 INFO:tasks.workunit.client.0.smithi112.stdout:0/20: stat l6 0 2024-09-21T00:56:28.308 INFO:tasks.workunit.client.0.smithi112.stdout:3/29: creat d2/f5 x:0 0 0 2024-09-21T00:56:28.312 INFO:tasks.workunit.client.1.smithi187.stdout:4/103: fdatasync d2/d3/f13 0 2024-09-21T00:56:28.313 INFO:tasks.workunit.client.1.smithi187.stdout:3/90: mkdir d9/d13/d20 0 2024-09-21T00:56:28.315 INFO:tasks.workunit.client.1.smithi187.stdout:0/127: rename d0/dc to d0/d17/d22 0 2024-09-21T00:56:28.317 INFO:tasks.workunit.client.1.smithi187.stdout:1/90: rename d4/c18 to d4/c19 0 2024-09-21T00:56:28.319 INFO:tasks.workunit.client.1.smithi187.stdout:8/147: unlink dc/d1c/f23 0 2024-09-21T00:56:28.320 INFO:tasks.workunit.client.1.smithi187.stdout:8/148: readlink dc/d1c/l1e 0 2024-09-21T00:56:28.320 INFO:tasks.workunit.client.0.smithi112.stdout:9/8: link f1 f3 0 2024-09-21T00:56:28.321 INFO:tasks.workunit.client.1.smithi187.stdout:2/139: truncate d2/dc/d17/f2b 766609 0 2024-09-21T00:56:28.322 INFO:tasks.workunit.client.0.smithi112.stdout:8/18: rename d0/f8 to d0/f9 0 2024-09-21T00:56:28.323 INFO:tasks.workunit.client.0.smithi112.stdout:8/19: chown d0/l5 0 1 2024-09-21T00:56:28.325 INFO:tasks.workunit.client.1.smithi187.stdout:5/87: creat d0/f20 x:0 0 0 2024-09-21T00:56:28.328 INFO:tasks.workunit.client.0.smithi112.stdout:2/32: mkdir d0/d7/d8 0 2024-09-21T00:56:28.329 INFO:tasks.workunit.client.0.smithi112.stdout:2/33: fdatasync d0/f3 0 2024-09-21T00:56:28.329 INFO:tasks.workunit.client.1.smithi187.stdout:7/66: creat d1/f17 x:0 0 0 2024-09-21T00:56:28.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/22: getdents d0 0 2024-09-21T00:56:28.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/23: dwrite - no filename 2024-09-21T00:56:28.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/24: write - no filename 2024-09-21T00:56:28.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/25: fsync - no filename 2024-09-21T00:56:28.332 INFO:tasks.workunit.client.0.smithi112.stdout:9/9: creat f4 x:0 0 0 2024-09-21T00:56:28.333 INFO:tasks.workunit.client.1.smithi187.stdout:3/91: creat d9/d19/d1c/f21 x:0 0 0 2024-09-21T00:56:28.336 INFO:tasks.workunit.client.0.smithi112.stdout:2/34: dwrite d0/f3 [0,4194304] 0 2024-09-21T00:56:28.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/20: write d0/f9 [425804,15087] 0 2024-09-21T00:56:28.338 INFO:tasks.workunit.client.0.smithi112.stdout:2/35: write d0/f5 [582691,125483] 0 2024-09-21T00:56:28.339 INFO:tasks.workunit.client.0.smithi112.stdout:5/20: truncate f6 11517 0 2024-09-21T00:56:28.340 INFO:tasks.workunit.client.1.smithi187.stdout:1/91: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:28.343 INFO:tasks.workunit.client.1.smithi187.stdout:8/149: unlink dc/lf 0 2024-09-21T00:56:28.345 INFO:tasks.workunit.client.1.smithi187.stdout:2/140: unlink d2/ld 0 2024-09-21T00:56:28.346 INFO:tasks.workunit.client.0.smithi112.stdout:8/21: dwrite d0/f9 [0,4194304] 0 2024-09-21T00:56:28.347 INFO:tasks.workunit.client.0.smithi112.stdout:4/15: symlink d1/d5/l6 0 2024-09-21T00:56:28.350 INFO:tasks.workunit.client.0.smithi112.stdout:7/26: symlink d0/l5 0 2024-09-21T00:56:28.354 INFO:tasks.workunit.client.1.smithi187.stdout:9/239: truncate d4/d13/f2d 1664013 0 2024-09-21T00:56:28.355 INFO:tasks.workunit.client.1.smithi187.stdout:9/240: fsync d4/d10/f11 0 2024-09-21T00:56:28.355 INFO:tasks.workunit.client.1.smithi187.stdout:9/241: chown d4/d13/d14 1125 1 2024-09-21T00:56:28.356 INFO:tasks.workunit.client.1.smithi187.stdout:3/92: mknod d9/d13/c22 0 2024-09-21T00:56:28.358 INFO:tasks.workunit.client.0.smithi112.stdout:6/17: link c4 c5 0 2024-09-21T00:56:28.358 INFO:tasks.workunit.client.1.smithi187.stdout:1/92: chown d4/d6/c12 35118 1 2024-09-21T00:56:28.360 INFO:tasks.workunit.client.0.smithi112.stdout:3/30: truncate f1 2670683 0 2024-09-21T00:56:28.361 INFO:tasks.workunit.client.1.smithi187.stdout:4/104: dwrite d2/d3/f21 [0,4194304] 0 2024-09-21T00:56:28.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/31: chown d2/c4 8267604 1 2024-09-21T00:56:28.361 INFO:tasks.workunit.client.0.smithi112.stdout:2/36: creat d0/d7/f9 x:0 0 0 2024-09-21T00:56:28.362 INFO:tasks.workunit.client.0.smithi112.stdout:2/37: write d0/f5 [1440481,85085] 0 2024-09-21T00:56:28.363 INFO:tasks.workunit.client.0.smithi112.stdout:2/38: write d0/f3 [1173602,90618] 0 2024-09-21T00:56:28.364 INFO:tasks.workunit.client.0.smithi112.stdout:4/16: stat d1/c4 0 2024-09-21T00:56:28.364 INFO:tasks.workunit.client.0.smithi112.stdout:2/39: fsync d0/f4 0 2024-09-21T00:56:28.365 INFO:tasks.workunit.client.0.smithi112.stdout:4/17: chown d1/l2 96477 1 2024-09-21T00:56:28.366 INFO:tasks.workunit.client.0.smithi112.stdout:2/40: write d0/f3 [3818163,78004] 0 2024-09-21T00:56:28.366 INFO:tasks.workunit.client.0.smithi112.stdout:2/41: stat d0/f4 0 2024-09-21T00:56:28.366 INFO:tasks.workunit.client.0.smithi112.stdout:8/22: symlink d0/la 0 2024-09-21T00:56:28.367 INFO:tasks.workunit.client.0.smithi112.stdout:2/42: chown d0/c6 471258856 1 2024-09-21T00:56:28.370 INFO:tasks.workunit.client.1.smithi187.stdout:7/67: mkdir d1/d18 0 2024-09-21T00:56:28.370 INFO:tasks.workunit.client.1.smithi187.stdout:7/68: dread - d1/f17 zero size 2024-09-21T00:56:28.372 INFO:tasks.workunit.client.1.smithi187.stdout:9/242: symlink d4/d10/d39/l50 0 2024-09-21T00:56:28.374 INFO:tasks.workunit.client.1.smithi187.stdout:1/93: readlink d4/l9 0 2024-09-21T00:56:28.377 INFO:tasks.workunit.client.1.smithi187.stdout:8/150: fsync dc/f24 0 2024-09-21T00:56:28.378 INFO:tasks.workunit.client.0.smithi112.stdout:6/18: dwrite f3 [4194304,4194304] 0 2024-09-21T00:56:28.379 INFO:tasks.workunit.client.1.smithi187.stdout:4/105: mkdir d2/d3/da/d16/d18/d22 0 2024-09-21T00:56:28.380 INFO:tasks.workunit.client.1.smithi187.stdout:4/106: truncate d2/d3/da/f1b 732610 0 2024-09-21T00:56:28.382 INFO:tasks.workunit.client.0.smithi112.stdout:2/43: creat d0/fa x:0 0 0 2024-09-21T00:56:28.383 INFO:tasks.workunit.client.0.smithi112.stdout:2/44: stat d0/f4 0 2024-09-21T00:56:28.384 INFO:tasks.workunit.client.1.smithi187.stdout:6/81: getdents d7/dc 0 2024-09-21T00:56:28.386 INFO:tasks.workunit.client.0.smithi112.stdout:6/19: dwrite f3 [0,4194304] 0 2024-09-21T00:56:28.387 INFO:tasks.workunit.client.0.smithi112.stdout:6/20: fsync f2 0 2024-09-21T00:56:28.388 INFO:tasks.workunit.client.0.smithi112.stdout:7/27: unlink d0/d2/c4 0 2024-09-21T00:56:28.388 INFO:tasks.workunit.client.0.smithi112.stdout:7/28: readlink d0/l5 0 2024-09-21T00:56:28.392 INFO:tasks.workunit.client.0.smithi112.stdout:6/21: dread f3 [4194304,4194304] 0 2024-09-21T00:56:28.397 INFO:tasks.workunit.client.1.smithi187.stdout:1/94: fdatasync d4/f7 0 2024-09-21T00:56:28.397 INFO:tasks.workunit.client.0.smithi112.stdout:4/18: truncate f0 3461081 0 2024-09-21T00:56:28.398 INFO:tasks.workunit.client.1.smithi187.stdout:1/95: truncate d4/f17 869051 0 2024-09-21T00:56:28.401 INFO:tasks.workunit.client.1.smithi187.stdout:4/107: unlink d2/d3/da/l15 0 2024-09-21T00:56:28.402 INFO:tasks.workunit.client.1.smithi187.stdout:4/108: truncate d2/d3/da/f1f 4936504 0 2024-09-21T00:56:28.403 INFO:tasks.workunit.client.1.smithi187.stdout:4/109: dread - d2/d3/da/d16/f1d zero size 2024-09-21T00:56:28.404 INFO:tasks.workunit.client.1.smithi187.stdout:4/110: write d2/d3/da/d16/f1d [26549,111409] 0 2024-09-21T00:56:28.457 INFO:tasks.workunit.client.1.smithi187.stdout:5/88: rename d0/dc/f1d to d0/d19/d14/f21 0 2024-09-21T00:56:28.478 INFO:tasks.workunit.client.0.smithi112.stdout:7/29: symlink d0/d2/l6 0 2024-09-21T00:56:28.478 INFO:tasks.workunit.client.0.smithi112.stdout:7/30: dwrite - no filename 2024-09-21T00:56:28.478 INFO:tasks.workunit.client.0.smithi112.stdout:7/31: dwrite - no filename 2024-09-21T00:56:28.478 INFO:tasks.workunit.client.0.smithi112.stdout:7/32: dwrite - no filename 2024-09-21T00:56:28.478 INFO:tasks.workunit.client.0.smithi112.stdout:7/33: rename d0 to d0/d2/d7 22 2024-09-21T00:56:28.478 INFO:tasks.workunit.client.0.smithi112.stdout:7/34: truncate - no filename 2024-09-21T00:56:28.478 INFO:tasks.workunit.client.0.smithi112.stdout:8/23: truncate d0/f9 1432606 0 2024-09-21T00:56:28.479 INFO:tasks.workunit.client.1.smithi187.stdout:7/69: mknod d1/d18/c19 0 2024-09-21T00:56:28.480 INFO:tasks.workunit.client.0.smithi112.stdout:9/10: getdents . 0 2024-09-21T00:56:28.480 INFO:tasks.workunit.client.0.smithi112.stdout:9/11: stat f4 0 2024-09-21T00:56:28.481 INFO:tasks.workunit.client.0.smithi112.stdout:9/12: rmdir - no directory 2024-09-21T00:56:28.481 INFO:tasks.workunit.client.1.smithi187.stdout:9/243: creat d4/d8/d44/f51 x:0 0 0 2024-09-21T00:56:28.483 INFO:tasks.workunit.client.1.smithi187.stdout:3/93: link d9/d19/c1b d9/d13/d20/c23 0 2024-09-21T00:56:28.484 INFO:tasks.workunit.client.0.smithi112.stdout:6/22: rename c1 to c6 0 2024-09-21T00:56:28.488 INFO:tasks.workunit.client.1.smithi187.stdout:2/141: getdents d2/d25 0 2024-09-21T00:56:28.489 INFO:tasks.workunit.client.1.smithi187.stdout:2/142: write d2/d3/d15/d1b/d1c/f1f [544234,40434] 0 2024-09-21T00:56:28.490 INFO:tasks.workunit.client.1.smithi187.stdout:6/82: link d7/dc/f11 d7/f14 0 2024-09-21T00:56:28.491 INFO:tasks.workunit.client.1.smithi187.stdout:6/83: dread - d7/dc/f10 zero size 2024-09-21T00:56:28.492 INFO:tasks.workunit.client.1.smithi187.stdout:0/128: rename d0/d17/d22 to d0/d17/d1c/d23 0 2024-09-21T00:56:28.494 INFO:tasks.workunit.client.1.smithi187.stdout:9/244: mknod d4/d13/d20/d2e/c52 0 2024-09-21T00:56:28.500 INFO:tasks.workunit.client.1.smithi187.stdout:8/151: creat dc/d1c/d29/f2c x:0 0 0 2024-09-21T00:56:28.505 INFO:tasks.workunit.client.1.smithi187.stdout:2/143: creat d2/dc/d21/f36 x:0 0 0 2024-09-21T00:56:28.507 INFO:tasks.workunit.client.1.smithi187.stdout:6/84: rename d7/dc/l12 to d7/dc/l15 0 2024-09-21T00:56:28.509 INFO:tasks.workunit.client.1.smithi187.stdout:0/129: creat d0/d17/d18/f24 x:0 0 0 2024-09-21T00:56:28.509 INFO:tasks.workunit.client.1.smithi187.stdout:0/130: write d0/d17/d18/f24 [219962,54297] 0 2024-09-21T00:56:28.514 INFO:tasks.workunit.client.1.smithi187.stdout:1/96: link d4/d6/c12 d4/d6/d8/c1a 0 2024-09-21T00:56:28.515 INFO:tasks.workunit.client.1.smithi187.stdout:3/94: write d9/d13/f1e [3218162,45267] 0 2024-09-21T00:56:28.516 INFO:tasks.workunit.client.1.smithi187.stdout:8/152: creat dc/d1c/f2d x:0 0 0 2024-09-21T00:56:28.519 INFO:tasks.workunit.client.1.smithi187.stdout:1/97: dwrite d4/f11 [0,4194304] 0 2024-09-21T00:56:28.521 INFO:tasks.workunit.client.1.smithi187.stdout:6/85: unlink d7/ca 0 2024-09-21T00:56:28.524 INFO:tasks.workunit.client.1.smithi187.stdout:5/89: write d0/d19/d14/f21 [541672,33262] 0 2024-09-21T00:56:28.525 INFO:tasks.workunit.client.1.smithi187.stdout:5/90: truncate d0/f20 304598 0 2024-09-21T00:56:28.527 INFO:tasks.workunit.client.1.smithi187.stdout:0/131: dread d0/d17/d1c/d23/f19 [0,4194304] 0 2024-09-21T00:56:28.529 INFO:tasks.workunit.client.1.smithi187.stdout:4/111: truncate d2/ff 915650 0 2024-09-21T00:56:28.530 INFO:tasks.workunit.client.1.smithi187.stdout:7/70: creat d1/f1a x:0 0 0 2024-09-21T00:56:28.530 INFO:tasks.workunit.client.1.smithi187.stdout:4/112: dread d2/d3/da/f1b [0,4194304] 0 2024-09-21T00:56:28.531 INFO:tasks.workunit.client.1.smithi187.stdout:9/245: link d4/d8/fb d4/d13/d14/d28/f53 0 2024-09-21T00:56:28.532 INFO:tasks.workunit.client.1.smithi187.stdout:9/246: fdatasync d4/f5 0 2024-09-21T00:56:28.532 INFO:tasks.workunit.client.1.smithi187.stdout:0/132: dread d0/d17/d1c/d23/df/f15 [0,4194304] 0 2024-09-21T00:56:28.533 INFO:tasks.workunit.client.1.smithi187.stdout:3/95: creat d9/d19/f24 x:0 0 0 2024-09-21T00:56:28.534 INFO:tasks.workunit.client.1.smithi187.stdout:8/153: creat dc/d1c/f2e x:0 0 0 2024-09-21T00:56:28.534 INFO:tasks.workunit.client.1.smithi187.stdout:8/154: chown c9 109 1 2024-09-21T00:56:28.535 INFO:tasks.workunit.client.1.smithi187.stdout:2/144: link d2/f8 d2/dc/d17/f37 0 2024-09-21T00:56:28.536 INFO:tasks.workunit.client.1.smithi187.stdout:1/98: mkdir d4/d1b 0 2024-09-21T00:56:28.537 INFO:tasks.workunit.client.1.smithi187.stdout:9/247: dread d4/f5 [0,4194304] 0 2024-09-21T00:56:28.538 INFO:tasks.workunit.client.1.smithi187.stdout:3/96: dread d9/f11 [0,4194304] 0 2024-09-21T00:56:28.538 INFO:tasks.workunit.client.1.smithi187.stdout:6/86: creat d7/dc/f16 x:0 0 0 2024-09-21T00:56:28.539 INFO:tasks.workunit.client.1.smithi187.stdout:6/87: rename d7/dc to d7/dc/d17 22 2024-09-21T00:56:28.539 INFO:tasks.workunit.client.1.smithi187.stdout:3/97: chown d9/ff 47 1 2024-09-21T00:56:28.539 INFO:tasks.workunit.client.1.smithi187.stdout:5/91: mknod d0/d19/c22 0 2024-09-21T00:56:28.539 INFO:tasks.workunit.client.1.smithi187.stdout:2/145: dread d2/dc/d17/f37 [0,4194304] 0 2024-09-21T00:56:28.540 INFO:tasks.workunit.client.1.smithi187.stdout:6/88: dread - d7/dc/f11 zero size 2024-09-21T00:56:28.540 INFO:tasks.workunit.client.1.smithi187.stdout:5/92: dread - d0/dc/f11 zero size 2024-09-21T00:56:28.541 INFO:tasks.workunit.client.1.smithi187.stdout:6/89: write d7/f8 [3464951,74647] 0 2024-09-21T00:56:28.543 INFO:tasks.workunit.client.1.smithi187.stdout:7/71: symlink d1/d18/l1b 0 2024-09-21T00:56:28.543 INFO:tasks.workunit.client.1.smithi187.stdout:7/72: write d1/f1a [71847,87171] 0 2024-09-21T00:56:28.547 INFO:tasks.workunit.client.1.smithi187.stdout:0/133: write d0/fb [9117498,13446] 0 2024-09-21T00:56:28.547 INFO:tasks.workunit.client.1.smithi187.stdout:0/134: chown d0/d17/d18 14358 1 2024-09-21T00:56:28.563 INFO:tasks.workunit.client.1.smithi187.stdout:2/146: symlink d2/d3/d15/l38 0 2024-09-21T00:56:28.563 INFO:tasks.workunit.client.1.smithi187.stdout:9/248: fsync d4/d13/d14/d28/f53 0 2024-09-21T00:56:28.569 INFO:tasks.workunit.client.1.smithi187.stdout:5/93: dread d0/d19/d14/d1b/f1c [4194304,4194304] 0 2024-09-21T00:56:28.570 INFO:tasks.workunit.client.1.smithi187.stdout:6/90: rmdir d7/dc 39 2024-09-21T00:56:28.582 INFO:tasks.workunit.client.1.smithi187.stdout:3/98: mknod d9/d13/d20/c25 0 2024-09-21T00:56:28.583 INFO:tasks.workunit.client.1.smithi187.stdout:2/147: symlink d2/d3/d15/l39 0 2024-09-21T00:56:28.584 INFO:tasks.workunit.client.1.smithi187.stdout:2/148: write d2/d3/d15/d1b/d1c/f29 [263058,22219] 0 2024-09-21T00:56:28.589 INFO:tasks.workunit.client.1.smithi187.stdout:5/94: creat d0/d19/f23 x:0 0 0 2024-09-21T00:56:28.590 INFO:tasks.workunit.client.1.smithi187.stdout:6/91: read - d7/dc/f13 zero size 2024-09-21T00:56:28.593 INFO:tasks.workunit.client.1.smithi187.stdout:0/135: truncate d0/d17/d1c/d23/df/f15 125931 0 2024-09-21T00:56:28.593 INFO:tasks.workunit.client.1.smithi187.stdout:1/99: link d4/d6/ff d4/d6/f1c 0 2024-09-21T00:56:28.594 INFO:tasks.workunit.client.1.smithi187.stdout:1/100: rename d4 to d4/d6/d1d 22 2024-09-21T00:56:28.596 INFO:tasks.workunit.client.1.smithi187.stdout:2/149: readlink d2/d3/l9 0 2024-09-21T00:56:28.597 INFO:tasks.workunit.client.1.smithi187.stdout:9/249: mkdir d4/d8/d46/d54 0 2024-09-21T00:56:28.600 INFO:tasks.workunit.client.1.smithi187.stdout:4/113: truncate d2/d3/da/f1b 205536 0 2024-09-21T00:56:28.601 INFO:tasks.workunit.client.1.smithi187.stdout:9/250: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:28.601 INFO:tasks.workunit.client.1.smithi187.stdout:4/114: readlink d2/d3/l12 0 2024-09-21T00:56:28.601 INFO:tasks.workunit.client.1.smithi187.stdout:6/92: mkdir d7/dc/d18 0 2024-09-21T00:56:28.603 INFO:tasks.workunit.client.1.smithi187.stdout:7/73: creat d1/f1c x:0 0 0 2024-09-21T00:56:28.604 INFO:tasks.workunit.client.1.smithi187.stdout:8/155: getdents dc/d1c/d29 0 2024-09-21T00:56:28.607 INFO:tasks.workunit.client.1.smithi187.stdout:6/93: dwrite d7/dc/f16 [0,4194304] 0 2024-09-21T00:56:28.615 INFO:tasks.workunit.client.1.smithi187.stdout:2/150: symlink d2/dc/d2e/l3a 0 2024-09-21T00:56:28.631 INFO:tasks.workunit.client.1.smithi187.stdout:4/115: unlink d2/d3/l12 0 2024-09-21T00:56:28.633 INFO:tasks.workunit.client.1.smithi187.stdout:4/116: write d2/d3/da/d16/f1d [631890,22436] 0 2024-09-21T00:56:28.634 INFO:tasks.workunit.client.1.smithi187.stdout:4/117: chown d2/d3/da/fc 1 1 2024-09-21T00:56:28.635 INFO:tasks.workunit.client.1.smithi187.stdout:7/74: creat d1/d18/f1d x:0 0 0 2024-09-21T00:56:28.640 INFO:tasks.workunit.client.1.smithi187.stdout:5/95: write d0/f7 [1945757,10293] 0 2024-09-21T00:56:28.643 INFO:tasks.workunit.client.1.smithi187.stdout:3/99: rmdir d9/d19/d1c/d1f 0 2024-09-21T00:56:28.647 INFO:tasks.workunit.client.1.smithi187.stdout:9/251: creat d4/d8/d46/d54/f55 x:0 0 0 2024-09-21T00:56:28.650 INFO:tasks.workunit.client.1.smithi187.stdout:8/156: mkdir dc/d2f 0 2024-09-21T00:56:28.652 INFO:tasks.workunit.client.1.smithi187.stdout:9/252: dread d4/d13/d14/f18 [0,4194304] 0 2024-09-21T00:56:28.653 INFO:tasks.workunit.client.1.smithi187.stdout:9/253: chown d4/d8/f22 1 1 2024-09-21T00:56:28.656 INFO:tasks.workunit.client.1.smithi187.stdout:3/100: symlink d9/d19/d1c/l26 0 2024-09-21T00:56:28.657 INFO:tasks.workunit.client.1.smithi187.stdout:2/151: fsync d2/dc/d17/f2b 0 2024-09-21T00:56:28.662 INFO:tasks.workunit.client.1.smithi187.stdout:9/254: dwrite d4/d10/f11 [0,4194304] 0 2024-09-21T00:56:28.663 INFO:tasks.workunit.client.1.smithi187.stdout:4/118: creat d2/d3/da/d16/d18/d22/f23 x:0 0 0 2024-09-21T00:56:28.667 INFO:tasks.workunit.client.1.smithi187.stdout:6/94: rename d7/dc/f11 to d7/f19 0 2024-09-21T00:56:28.668 INFO:tasks.workunit.client.1.smithi187.stdout:1/101: getdents d4 0 2024-09-21T00:56:28.669 INFO:tasks.workunit.client.1.smithi187.stdout:4/119: dread d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:28.672 INFO:tasks.workunit.client.1.smithi187.stdout:3/101: mknod d9/d13/d20/c27 0 2024-09-21T00:56:28.672 INFO:tasks.workunit.client.1.smithi187.stdout:9/255: dread d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:28.673 INFO:tasks.workunit.client.1.smithi187.stdout:1/102: write d4/d6/d8/f13 [2135152,19197] 0 2024-09-21T00:56:28.677 INFO:tasks.workunit.client.1.smithi187.stdout:7/75: link d1/f11 d1/f1e 0 2024-09-21T00:56:28.678 INFO:tasks.workunit.client.1.smithi187.stdout:9/256: dread d4/d8/f19 [0,4194304] 0 2024-09-21T00:56:28.678 INFO:tasks.workunit.client.1.smithi187.stdout:9/257: chown d4/d13/d14/d1d 286917 1 2024-09-21T00:56:28.680 INFO:tasks.workunit.client.1.smithi187.stdout:7/76: dread d1/f14 [0,4194304] 0 2024-09-21T00:56:28.681 INFO:tasks.workunit.client.1.smithi187.stdout:7/77: fsync d1/f14 0 2024-09-21T00:56:28.682 INFO:tasks.workunit.client.1.smithi187.stdout:6/95: chown d7/dc/l15 1508685831 1 2024-09-21T00:56:28.686 INFO:tasks.workunit.client.1.smithi187.stdout:2/152: rename d2/d3/d15/l39 to d2/d25/d34/l3b 0 2024-09-21T00:56:28.690 INFO:tasks.workunit.client.1.smithi187.stdout:3/102: unlink d9/d19/f24 0 2024-09-21T00:56:28.697 INFO:tasks.workunit.client.1.smithi187.stdout:9/258: read d4/d13/d14/f18 [1368912,29931] 0 2024-09-21T00:56:28.700 INFO:tasks.workunit.client.1.smithi187.stdout:7/78: mknod d1/d18/c1f 0 2024-09-21T00:56:28.703 INFO:tasks.workunit.client.1.smithi187.stdout:2/153: mkdir d2/d3/d15/d1b/d3c 0 2024-09-21T00:56:28.704 INFO:tasks.workunit.client.1.smithi187.stdout:2/154: readlink d2/dc/d17/l28 0 2024-09-21T00:56:28.705 INFO:tasks.workunit.client.1.smithi187.stdout:2/155: fdatasync d2/d25/d34/f20 0 2024-09-21T00:56:28.705 INFO:tasks.workunit.client.1.smithi187.stdout:7/79: dwrite d1/dc/f12 [0,4194304] 0 2024-09-21T00:56:28.707 INFO:tasks.workunit.client.1.smithi187.stdout:2/156: write d2/d3/d15/d1b/d1c/f29 [37099,71266] 0 2024-09-21T00:56:28.711 INFO:tasks.workunit.client.1.smithi187.stdout:9/259: fsync d4/d13/d14/d28/f53 0 2024-09-21T00:56:28.713 INFO:tasks.workunit.client.1.smithi187.stdout:8/157: rename dc/f18 to dc/f30 0 2024-09-21T00:56:28.714 INFO:tasks.workunit.client.1.smithi187.stdout:5/96: dwrite d0/d19/d14/d1b/f1c [0,4194304] 0 2024-09-21T00:56:28.715 INFO:tasks.workunit.client.1.smithi187.stdout:5/97: chown d0/d19/d14 56 1 2024-09-21T00:56:28.716 INFO:tasks.workunit.client.1.smithi187.stdout:9/260: dread d4/f3b [0,4194304] 0 2024-09-21T00:56:28.718 INFO:tasks.workunit.client.1.smithi187.stdout:9/261: stat d4/d13/c34 0 2024-09-21T00:56:28.720 INFO:tasks.workunit.client.1.smithi187.stdout:9/262: readlink d4/d13/d20/l49 0 2024-09-21T00:56:28.724 INFO:tasks.workunit.client.1.smithi187.stdout:5/98: dwrite d0/d19/f1e [0,4194304] 0 2024-09-21T00:56:28.823 INFO:tasks.workunit.client.1.smithi187.stdout:4/120: sync 2024-09-21T00:56:28.877 INFO:tasks.workunit.client.1.smithi187.stdout:8/158: rmdir dc 39 2024-09-21T00:56:28.884 INFO:tasks.workunit.client.1.smithi187.stdout:4/121: mkdir d2/d3/da/d16/d18/d24 0 2024-09-21T00:56:28.885 INFO:tasks.workunit.client.1.smithi187.stdout:7/80: symlink d1/dc/d15/l20 0 2024-09-21T00:56:28.886 INFO:tasks.workunit.client.1.smithi187.stdout:2/157: creat d2/d3/d15/d1b/d3c/f3d x:0 0 0 2024-09-21T00:56:28.889 INFO:tasks.workunit.client.1.smithi187.stdout:6/96: getdents d7/dc 0 2024-09-21T00:56:28.889 INFO:tasks.workunit.client.1.smithi187.stdout:6/97: write d7/f8 [2110691,98031] 0 2024-09-21T00:56:28.890 INFO:tasks.workunit.client.1.smithi187.stdout:3/103: getdents d9/d19/d1c 0 2024-09-21T00:56:28.893 INFO:tasks.workunit.client.1.smithi187.stdout:9/263: creat d4/d13/d3a/f56 x:0 0 0 2024-09-21T00:56:28.894 INFO:tasks.workunit.client.1.smithi187.stdout:5/99: creat d0/d19/d14/d1b/f24 x:0 0 0 2024-09-21T00:56:28.895 INFO:tasks.workunit.client.1.smithi187.stdout:6/98: dwrite f1 [4194304,4194304] 0 2024-09-21T00:56:28.896 INFO:tasks.workunit.client.1.smithi187.stdout:4/122: mkdir d2/d3/da/d16/d18/d25 0 2024-09-21T00:56:28.899 INFO:tasks.workunit.client.1.smithi187.stdout:2/158: creat d2/d3/df/f3e x:0 0 0 2024-09-21T00:56:28.899 INFO:tasks.workunit.client.1.smithi187.stdout:4/123: dread d2/d3/da/f1f [0,4194304] 0 2024-09-21T00:56:28.901 INFO:tasks.workunit.client.1.smithi187.stdout:8/159: rename dc/d1c/f27 to dc/d1c/d29/f31 0 2024-09-21T00:56:28.905 INFO:tasks.workunit.client.1.smithi187.stdout:1/103: write f3 [1502546,90789] 0 2024-09-21T00:56:28.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/35: mkdir d0/d8 0 2024-09-21T00:56:28.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/36: dwrite - no filename 2024-09-21T00:56:28.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/37: write - no filename 2024-09-21T00:56:28.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/38: dread - no filename 2024-09-21T00:56:28.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/39: dwrite - no filename 2024-09-21T00:56:28.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/40: truncate - no filename 2024-09-21T00:56:28.908 INFO:tasks.workunit.client.0.smithi112.stdout:7/41: chown d0/d8 3522915 1 2024-09-21T00:56:28.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:28 smithi187 ceph-mon[34997]: pgmap v17: 65 pgs: 65 active+clean; 263 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 175 KiB/s rd, 10 MiB/s wr, 313 op/s 2024-09-21T00:56:28.909 INFO:tasks.workunit.client.1.smithi187.stdout:3/104: unlink d9/d13/d20/c25 0 2024-09-21T00:56:28.909 INFO:tasks.workunit.client.0.smithi112.stdout:8/24: rmdir d0 39 2024-09-21T00:56:28.910 INFO:tasks.workunit.client.1.smithi187.stdout:3/105: chown d9/d19/d1c/l26 119816763 1 2024-09-21T00:56:28.911 INFO:tasks.workunit.client.0.smithi112.stdout:9/13: mkdir d5 0 2024-09-21T00:56:28.912 INFO:tasks.workunit.client.0.smithi112.stdout:9/14: dread - f4 zero size 2024-09-21T00:56:28.912 INFO:tasks.workunit.client.0.smithi112.stdout:9/15: write f4 [56589,44158] 0 2024-09-21T00:56:28.913 INFO:tasks.workunit.client.0.smithi112.stdout:3/32: link f1 d2/f6 0 2024-09-21T00:56:28.914 INFO:tasks.workunit.client.1.smithi187.stdout:6/99: dread - d7/f14 zero size 2024-09-21T00:56:28.919 INFO:tasks.workunit.client.1.smithi187.stdout:2/159: mkdir d2/d3/d15/d1b/d3f 0 2024-09-21T00:56:28.920 INFO:tasks.workunit.client.1.smithi187.stdout:9/264: truncate d4/d8/f19 3700253 0 2024-09-21T00:56:28.920 INFO:tasks.workunit.client.1.smithi187.stdout:6/100: dwrite d7/ff [0,4194304] 0 2024-09-21T00:56:28.921 INFO:tasks.workunit.client.1.smithi187.stdout:4/124: mkdir d2/d3/da/d16/d18/d26 0 2024-09-21T00:56:28.922 INFO:tasks.workunit.client.1.smithi187.stdout:9/265: write d4/d8/f22 [8370799,12017] 0 2024-09-21T00:56:28.925 INFO:tasks.workunit.client.1.smithi187.stdout:0/136: dread d0/d17/d1c/d23/df/f15 [0,4194304] 0 2024-09-21T00:56:28.926 INFO:tasks.workunit.client.1.smithi187.stdout:6/101: dread d7/f8 [0,4194304] 0 2024-09-21T00:56:28.926 INFO:tasks.workunit.client.1.smithi187.stdout:3/106: creat d9/d13/f28 x:0 0 0 2024-09-21T00:56:28.926 INFO:tasks.workunit.client.1.smithi187.stdout:0/137: readlink d0/d17/d1c/d23/l12 0 2024-09-21T00:56:28.927 INFO:tasks.workunit.client.0.smithi112.stdout:9/16: fsync f1 0 2024-09-21T00:56:28.927 INFO:tasks.workunit.client.0.smithi112.stdout:9/17: read f1 [2621175,45441] 0 2024-09-21T00:56:28.927 INFO:tasks.workunit.client.1.smithi187.stdout:5/100: link d0/d19/f23 d0/dc/f25 0 2024-09-21T00:56:28.928 INFO:tasks.workunit.client.0.smithi112.stdout:3/33: rename d2/l3 to d2/l7 0 2024-09-21T00:56:28.929 INFO:tasks.workunit.client.1.smithi187.stdout:5/101: stat d0/d19/f15 0 2024-09-21T00:56:28.931 INFO:tasks.workunit.client.1.smithi187.stdout:6/102: dread d7/f8 [0,4194304] 0 2024-09-21T00:56:28.931 INFO:tasks.workunit.client.0.smithi112.stdout:6/23: unlink c4 0 2024-09-21T00:56:28.932 INFO:tasks.workunit.client.1.smithi187.stdout:7/81: creat d1/f21 x:0 0 0 2024-09-21T00:56:28.933 INFO:tasks.workunit.client.1.smithi187.stdout:9/266: dread d4/d13/d14/d28/f53 [0,4194304] 0 2024-09-21T00:56:28.933 INFO:tasks.workunit.client.1.smithi187.stdout:7/82: stat d1/dc/d15/l20 0 2024-09-21T00:56:28.934 INFO:tasks.workunit.client.0.smithi112.stdout:9/18: dwrite f2 [0,4194304] 0 2024-09-21T00:56:28.935 INFO:tasks.workunit.client.0.smithi112.stdout:2/45: getdents d0 0 2024-09-21T00:56:28.937 INFO:tasks.workunit.client.1.smithi187.stdout:2/160: mkdir d2/d3/d15/d1b/d3c/d40 0 2024-09-21T00:56:28.937 INFO:tasks.workunit.client.1.smithi187.stdout:5/102: dread d0/f7 [0,4194304] 0 2024-09-21T00:56:28.938 INFO:tasks.workunit.client.1.smithi187.stdout:5/103: fdatasync d0/d19/f15 0 2024-09-21T00:56:28.938 INFO:tasks.workunit.client.1.smithi187.stdout:2/161: dread d2/dc/d17/f37 [0,4194304] 0 2024-09-21T00:56:28.939 INFO:tasks.workunit.client.0.smithi112.stdout:8/25: creat d0/fb x:0 0 0 2024-09-21T00:56:28.940 INFO:tasks.workunit.client.1.smithi187.stdout:2/162: readlink d2/dc/d17/l28 0 2024-09-21T00:56:28.940 INFO:tasks.workunit.client.1.smithi187.stdout:2/163: chown d2/d25 1 1 2024-09-21T00:56:28.940 INFO:tasks.workunit.client.1.smithi187.stdout:2/164: fdatasync d2/fa 0 2024-09-21T00:56:28.944 INFO:tasks.workunit.client.1.smithi187.stdout:8/160: symlink dc/l32 0 2024-09-21T00:56:28.944 INFO:tasks.workunit.client.1.smithi187.stdout:1/104: getdents d4/d1b 0 2024-09-21T00:56:28.946 INFO:tasks.workunit.client.1.smithi187.stdout:3/107: fdatasync d9/f11 0 2024-09-21T00:56:28.947 INFO:tasks.workunit.client.1.smithi187.stdout:3/108: stat d9/l10 0 2024-09-21T00:56:28.947 INFO:tasks.workunit.client.1.smithi187.stdout:2/165: dwrite d2/dc/f1a [0,4194304] 0 2024-09-21T00:56:28.948 INFO:tasks.workunit.client.1.smithi187.stdout:0/138: creat d0/d17/d1c/d23/df/f25 x:0 0 0 2024-09-21T00:56:28.949 INFO:tasks.workunit.client.0.smithi112.stdout:4/19: getdents d1/d5 0 2024-09-21T00:56:28.955 INFO:tasks.workunit.client.0.smithi112.stdout:3/34: truncate d2/f6 1631869 0 2024-09-21T00:56:28.957 INFO:tasks.workunit.client.0.smithi112.stdout:6/24: link f2 f7 0 2024-09-21T00:56:28.957 INFO:tasks.workunit.client.1.smithi187.stdout:7/83: dwrite d1/f9 [0,4194304] 0 2024-09-21T00:56:28.958 INFO:tasks.workunit.client.0.smithi112.stdout:4/20: mkdir d1/d7 0 2024-09-21T00:56:28.961 INFO:tasks.workunit.client.0.smithi112.stdout:9/19: mkdir d5/d6 0 2024-09-21T00:56:28.965 INFO:tasks.workunit.client.0.smithi112.stdout:7/42: getdents d0/d2 0 2024-09-21T00:56:28.965 INFO:tasks.workunit.client.0.smithi112.stdout:7/43: dwrite - no filename 2024-09-21T00:56:28.968 INFO:tasks.workunit.client.1.smithi187.stdout:8/161: creat dc/d1c/f33 x:0 0 0 2024-09-21T00:56:28.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/25: mknod c8 0 2024-09-21T00:56:28.971 INFO:tasks.workunit.client.0.smithi112.stdout:4/21: creat d1/f8 x:0 0 0 2024-09-21T00:56:28.974 INFO:tasks.workunit.client.1.smithi187.stdout:2/166: unlink d2/d3/d15/d1b/l33 0 2024-09-21T00:56:28.980 INFO:tasks.workunit.client.0.smithi112.stdout:6/26: mkdir d9 0 2024-09-21T00:56:28.981 INFO:tasks.workunit.client.1.smithi187.stdout:5/104: mkdir d0/dc/d1f/d26 0 2024-09-21T00:56:28.984 INFO:tasks.workunit.client.0.smithi112.stdout:9/20: dwrite f3 [0,4194304] 0 2024-09-21T00:56:28.984 INFO:tasks.workunit.client.0.smithi112.stdout:9/21: readlink - no filename 2024-09-21T00:56:28.984 INFO:tasks.workunit.client.0.smithi112.stdout:2/46: getdents d0/d7 0 2024-09-21T00:56:28.985 INFO:tasks.workunit.client.1.smithi187.stdout:6/103: write d7/ff [4381477,118347] 0 2024-09-21T00:56:28.986 INFO:tasks.workunit.client.0.smithi112.stdout:2/47: dread - d0/d7/f9 zero size 2024-09-21T00:56:28.986 INFO:tasks.workunit.client.0.smithi112.stdout:2/48: fsync d0/d7/f9 0 2024-09-21T00:56:28.986 INFO:tasks.workunit.client.1.smithi187.stdout:8/162: chown dc/d1c/c1d 1025227 1 2024-09-21T00:56:28.987 INFO:tasks.workunit.client.1.smithi187.stdout:5/105: dwrite d0/f2 [4194304,4194304] 0 2024-09-21T00:56:28.991 INFO:tasks.workunit.client.0.smithi112.stdout:8/26: fdatasync d0/f9 0 2024-09-21T00:56:28.991 INFO:tasks.workunit.client.0.smithi112.stdout:8/27: fsync d0/f3 0 2024-09-21T00:56:28.992 INFO:tasks.workunit.client.1.smithi187.stdout:5/106: dread d0/f2 [0,4194304] 0 2024-09-21T00:56:28.993 INFO:tasks.workunit.client.1.smithi187.stdout:2/167: creat d2/d3/df/f41 x:0 0 0 2024-09-21T00:56:28.993 INFO:tasks.workunit.client.0.smithi112.stdout:6/27: read f3 [1790764,5316] 0 2024-09-21T00:56:28.995 INFO:tasks.workunit.client.1.smithi187.stdout:0/139: link d0/d17/d1c/d23/df/f1d d0/d17/f26 0 2024-09-21T00:56:28.997 INFO:tasks.workunit.client.1.smithi187.stdout:0/140: readlink d0/d17/d18/l1e 0 2024-09-21T00:56:28.999 INFO:tasks.workunit.client.1.smithi187.stdout:8/163: stat dc/f26 0 2024-09-21T00:56:28.999 INFO:tasks.workunit.client.1.smithi187.stdout:3/109: dwrite d9/d13/f1e [0,4194304] 0 2024-09-21T00:56:29.000 INFO:tasks.workunit.client.1.smithi187.stdout:8/164: write f0 [4011317,14030] 0 2024-09-21T00:56:29.000 INFO:tasks.workunit.client.1.smithi187.stdout:0/141: truncate d0/d17/d1c/d23/df/f25 855778 0 2024-09-21T00:56:29.001 INFO:tasks.workunit.client.0.smithi112.stdout:2/49: creat d0/fb x:0 0 0 2024-09-21T00:56:29.001 INFO:tasks.workunit.client.1.smithi187.stdout:8/165: readlink dc/d1c/l1e 0 2024-09-21T00:56:29.001 INFO:tasks.workunit.client.0.smithi112.stdout:3/35: read d2/f6 [665189,16082] 0 2024-09-21T00:56:29.002 INFO:tasks.workunit.client.1.smithi187.stdout:8/166: read - dc/d1c/f2d zero size 2024-09-21T00:56:29.005 INFO:tasks.workunit.client.1.smithi187.stdout:2/168: unlink d2/d25/d34/f2c 0 2024-09-21T00:56:29.006 INFO:tasks.workunit.client.0.smithi112.stdout:7/44: link d0/l5 d0/d8/l9 0 2024-09-21T00:56:29.006 INFO:tasks.workunit.client.0.smithi112.stdout:7/45: truncate - no filename 2024-09-21T00:56:29.006 INFO:tasks.workunit.client.0.smithi112.stdout:7/46: truncate - no filename 2024-09-21T00:56:29.006 INFO:tasks.workunit.client.0.smithi112.stdout:7/47: fsync - no filename 2024-09-21T00:56:29.006 INFO:tasks.workunit.client.1.smithi187.stdout:2/169: write d2/d3/d15/d1b/d1c/f29 [545312,25270] 0 2024-09-21T00:56:29.007 INFO:tasks.workunit.client.1.smithi187.stdout:2/170: fsync d2/d25/d34/f20 0 2024-09-21T00:56:29.008 INFO:tasks.workunit.client.1.smithi187.stdout:2/171: write d2/f7 [2253131,120453] 0 2024-09-21T00:56:29.009 INFO:tasks.workunit.client.1.smithi187.stdout:7/84: truncate d1/f7 913424 0 2024-09-21T00:56:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:28 smithi112 ceph-mon[28078]: pgmap v17: 65 pgs: 65 active+clean; 263 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 175 KiB/s rd, 10 MiB/s wr, 313 op/s 2024-09-21T00:56:29.011 INFO:tasks.workunit.client.0.smithi112.stdout:8/28: mknod d0/cc 0 2024-09-21T00:56:29.014 INFO:tasks.workunit.client.1.smithi187.stdout:0/142: mknod d0/d17/d1c/c27 0 2024-09-21T00:56:29.015 INFO:tasks.workunit.client.1.smithi187.stdout:4/125: dwrite d2/ff [0,4194304] 0 2024-09-21T00:56:29.015 INFO:tasks.workunit.client.0.smithi112.stdout:9/22: creat d5/d6/f7 x:0 0 0 2024-09-21T00:56:29.015 INFO:tasks.workunit.client.1.smithi187.stdout:0/143: dread - d0/d17/d1c/d23/df/f1d zero size 2024-09-21T00:56:29.016 INFO:tasks.workunit.client.0.smithi112.stdout:9/23: write f4 [444687,79983] 0 2024-09-21T00:56:29.018 INFO:tasks.workunit.client.0.smithi112.stdout:9/24: rename d5/d6 to d5/d6/d8 22 2024-09-21T00:56:29.018 INFO:tasks.workunit.client.1.smithi187.stdout:8/167: dread f8 [0,4194304] 0 2024-09-21T00:56:29.018 INFO:tasks.workunit.client.0.smithi112.stdout:9/25: chown f4 57217932 1 2024-09-21T00:56:29.019 INFO:tasks.workunit.client.0.smithi112.stdout:2/50: creat d0/fc x:0 0 0 2024-09-21T00:56:29.020 INFO:tasks.workunit.client.0.smithi112.stdout:2/51: dread - d0/fb zero size 2024-09-21T00:56:29.021 INFO:tasks.workunit.client.0.smithi112.stdout:2/52: chown d0/fc 2037 1 2024-09-21T00:56:29.021 INFO:tasks.workunit.client.0.smithi112.stdout:2/53: stat d0/d7/d8 0 2024-09-21T00:56:29.024 INFO:tasks.workunit.client.1.smithi187.stdout:8/168: dread dc/d1c/f21 [0,4194304] 0 2024-09-21T00:56:29.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/36: mkdir d2/d8 0 2024-09-21T00:56:29.027 INFO:tasks.workunit.client.0.smithi112.stdout:7/48: creat d0/fa x:0 0 0 2024-09-21T00:56:29.028 INFO:tasks.workunit.client.0.smithi112.stdout:7/49: write d0/fa [798500,85786] 0 2024-09-21T00:56:29.029 INFO:tasks.workunit.client.1.smithi187.stdout:7/85: mkdir d1/dc/d15/d22 0 2024-09-21T00:56:29.030 INFO:tasks.workunit.client.0.smithi112.stdout:4/22: write f0 [620277,3] 0 2024-09-21T00:56:29.034 INFO:tasks.workunit.client.1.smithi187.stdout:4/126: dread d2/d3/da/fc [0,4194304] 0 2024-09-21T00:56:29.034 INFO:tasks.workunit.client.0.smithi112.stdout:7/50: dread d0/fa [0,4194304] 0 2024-09-21T00:56:29.034 INFO:tasks.workunit.client.0.smithi112.stdout:2/54: rename d0/f4 to d0/d7/d8/fd 0 2024-09-21T00:56:29.036 INFO:tasks.workunit.client.0.smithi112.stdout:7/51: dread d0/fa [0,4194304] 0 2024-09-21T00:56:29.037 INFO:tasks.workunit.client.0.smithi112.stdout:3/37: write f1 [1494282,4990] 0 2024-09-21T00:56:29.038 INFO:tasks.workunit.client.0.smithi112.stdout:6/28: symlink d9/la 0 2024-09-21T00:56:29.043 INFO:tasks.workunit.client.0.smithi112.stdout:2/55: fsync d0/fc 0 2024-09-21T00:56:29.043 INFO:tasks.workunit.client.1.smithi187.stdout:8/169: write dc/d1c/d29/f31 [1038838,52709] 0 2024-09-21T00:56:29.046 INFO:tasks.workunit.client.1.smithi187.stdout:3/110: dwrite d9/fb [4194304,4194304] 0 2024-09-21T00:56:29.048 INFO:tasks.workunit.client.1.smithi187.stdout:5/107: truncate d0/d19/d14/d1b/f1c 7126062 0 2024-09-21T00:56:29.050 INFO:tasks.workunit.client.1.smithi187.stdout:7/86: symlink d1/l23 0 2024-09-21T00:56:29.052 INFO:tasks.workunit.client.1.smithi187.stdout:4/127: mknod d2/d3/d17/c27 0 2024-09-21T00:56:29.052 INFO:tasks.workunit.client.1.smithi187.stdout:8/170: dwrite f7 [0,4194304] 0 2024-09-21T00:56:29.056 INFO:tasks.workunit.client.1.smithi187.stdout:3/111: rename d9/c17 to d9/d19/c29 0 2024-09-21T00:56:29.056 INFO:tasks.workunit.client.0.smithi112.stdout:4/23: getdents d1/d5 0 2024-09-21T00:56:29.058 INFO:tasks.workunit.client.1.smithi187.stdout:3/112: write d9/fb [7907569,113149] 0 2024-09-21T00:56:29.059 INFO:tasks.workunit.client.0.smithi112.stdout:2/56: creat d0/fe x:0 0 0 2024-09-21T00:56:29.061 INFO:tasks.workunit.client.1.smithi187.stdout:4/128: dwrite d2/d3/da/d16/d18/d22/f23 [0,4194304] 0 2024-09-21T00:56:29.062 INFO:tasks.workunit.client.0.smithi112.stdout:9/26: truncate f4 47365 0 2024-09-21T00:56:29.064 INFO:tasks.workunit.client.0.smithi112.stdout:3/38: mknod d2/d8/c9 0 2024-09-21T00:56:29.064 INFO:tasks.workunit.client.1.smithi187.stdout:9/267: sync 2024-09-21T00:56:29.066 INFO:tasks.workunit.client.1.smithi187.stdout:0/144: getdents d0/d17 0 2024-09-21T00:56:29.068 INFO:tasks.workunit.client.0.smithi112.stdout:2/57: dwrite d0/fc [0,4194304] 0 2024-09-21T00:56:29.075 INFO:tasks.workunit.client.0.smithi112.stdout:9/27: creat d5/d6/f9 x:0 0 0 2024-09-21T00:56:29.075 INFO:tasks.workunit.client.0.smithi112.stdout:3/39: dwrite f1 [0,4194304] 0 2024-09-21T00:56:29.079 INFO:tasks.workunit.client.1.smithi187.stdout:3/113: creat d9/d19/d1c/f2a x:0 0 0 2024-09-21T00:56:29.079 INFO:tasks.workunit.client.1.smithi187.stdout:3/114: fdatasync d9/d13/f1e 0 2024-09-21T00:56:29.083 INFO:tasks.workunit.client.0.smithi112.stdout:6/29: write f7 [118773,111460] 0 2024-09-21T00:56:29.084 INFO:tasks.workunit.client.0.smithi112.stdout:4/24: mkdir d1/d7/d9 0 2024-09-21T00:56:29.084 INFO:tasks.workunit.client.0.smithi112.stdout:4/25: chown d1/d5 5509 1 2024-09-21T00:56:29.086 INFO:tasks.workunit.client.0.smithi112.stdout:2/58: mkdir d0/df 0 2024-09-21T00:56:29.088 INFO:tasks.workunit.client.1.smithi187.stdout:8/171: mkdir dc/d2f/d34 0 2024-09-21T00:56:29.088 INFO:tasks.workunit.client.1.smithi187.stdout:4/129: dwrite d2/f11 [4194304,4194304] 0 2024-09-21T00:56:29.088 INFO:tasks.workunit.client.0.smithi112.stdout:7/52: link d0/d8/l9 d0/lb 0 2024-09-21T00:56:29.092 INFO:tasks.workunit.client.1.smithi187.stdout:0/145: creat d0/d17/d1c/d23/f28 x:0 0 0 2024-09-21T00:56:29.095 INFO:tasks.workunit.client.0.smithi112.stdout:4/26: symlink d1/la 0 2024-09-21T00:56:29.097 INFO:tasks.workunit.client.0.smithi112.stdout:3/40: fdatasync d2/f6 0 2024-09-21T00:56:29.098 INFO:tasks.workunit.client.1.smithi187.stdout:0/146: dwrite d0/d17/d1c/d23/f28 [0,4194304] 0 2024-09-21T00:56:29.099 INFO:tasks.workunit.client.0.smithi112.stdout:7/53: mknod d0/d2/cc 0 2024-09-21T00:56:29.100 INFO:tasks.workunit.client.1.smithi187.stdout:7/87: dread d1/f11 [0,4194304] 0 2024-09-21T00:56:29.101 INFO:tasks.workunit.client.0.smithi112.stdout:9/28: link d5/d6/f7 d5/d6/fa 0 2024-09-21T00:56:29.103 INFO:tasks.workunit.client.1.smithi187.stdout:8/172: chown dc/f28 110961 1 2024-09-21T00:56:29.103 INFO:tasks.workunit.client.0.smithi112.stdout:7/54: dread d0/fa [0,4194304] 0 2024-09-21T00:56:29.104 INFO:tasks.workunit.client.0.smithi112.stdout:6/30: dwrite f2 [0,4194304] 0 2024-09-21T00:56:29.104 INFO:tasks.workunit.client.1.smithi187.stdout:4/130: chown d2/d3/da/f1b 0 1 2024-09-21T00:56:29.107 INFO:tasks.workunit.client.1.smithi187.stdout:9/268: creat d4/d4b/f57 x:0 0 0 2024-09-21T00:56:29.108 INFO:tasks.workunit.client.0.smithi112.stdout:3/41: dwrite d2/f6 [0,4194304] 0 2024-09-21T00:56:29.108 INFO:tasks.workunit.client.0.smithi112.stdout:4/27: mknod d1/d5/cb 0 2024-09-21T00:56:29.109 INFO:tasks.workunit.client.0.smithi112.stdout:2/59: mknod d0/df/c10 0 2024-09-21T00:56:29.110 INFO:tasks.workunit.client.0.smithi112.stdout:3/42: dread - d2/f5 zero size 2024-09-21T00:56:29.112 INFO:tasks.workunit.client.0.smithi112.stdout:9/29: unlink d5/d6/fa 0 2024-09-21T00:56:29.112 INFO:tasks.workunit.client.0.smithi112.stdout:7/55: symlink d0/d2/ld 0 2024-09-21T00:56:29.116 INFO:tasks.workunit.client.0.smithi112.stdout:6/31: rename f2 to d9/fb 0 2024-09-21T00:56:29.118 INFO:tasks.workunit.client.0.smithi112.stdout:4/28: creat d1/d5/fc x:0 0 0 2024-09-21T00:56:29.119 INFO:tasks.workunit.client.0.smithi112.stdout:4/29: dread - d1/d5/fc zero size 2024-09-21T00:56:29.121 INFO:tasks.workunit.client.0.smithi112.stdout:3/43: mknod d2/ca 0 2024-09-21T00:56:29.121 INFO:tasks.workunit.client.0.smithi112.stdout:3/44: chown d2 1 1 2024-09-21T00:56:29.122 INFO:tasks.workunit.client.1.smithi187.stdout:1/105: sync 2024-09-21T00:56:29.123 INFO:tasks.workunit.client.1.smithi187.stdout:3/115: link d9/d13/d20/c27 d9/d13/d20/c2b 0 2024-09-21T00:56:29.125 INFO:tasks.workunit.client.1.smithi187.stdout:5/108: dread d0/d19/f15 [0,4194304] 0 2024-09-21T00:56:29.126 INFO:tasks.workunit.client.0.smithi112.stdout:7/56: write d0/fa [1020617,85756] 0 2024-09-21T00:56:29.127 INFO:tasks.workunit.client.1.smithi187.stdout:7/88: creat d1/dc/d15/d22/f24 x:0 0 0 2024-09-21T00:56:29.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/45: dwrite d2/f5 [0,4194304] 0 2024-09-21T00:56:29.130 INFO:tasks.workunit.client.0.smithi112.stdout:3/46: write f1 [1930270,76051] 0 2024-09-21T00:56:29.131 INFO:tasks.workunit.client.1.smithi187.stdout:4/131: creat d2/d3/da/d16/d18/d24/f28 x:0 0 0 2024-09-21T00:56:29.134 INFO:tasks.workunit.client.0.smithi112.stdout:9/30: link f3 d5/fb 0 2024-09-21T00:56:29.135 INFO:tasks.workunit.client.0.smithi112.stdout:9/31: readlink - no filename 2024-09-21T00:56:29.136 INFO:tasks.workunit.client.0.smithi112.stdout:7/57: creat d0/fe x:0 0 0 2024-09-21T00:56:29.137 INFO:tasks.workunit.client.0.smithi112.stdout:7/58: dread - d0/fe zero size 2024-09-21T00:56:29.138 INFO:tasks.workunit.client.0.smithi112.stdout:6/32: fdatasync f7 0 2024-09-21T00:56:29.138 INFO:tasks.workunit.client.0.smithi112.stdout:7/59: write d0/fe [658494,26793] 0 2024-09-21T00:56:29.139 INFO:tasks.workunit.client.1.smithi187.stdout:0/147: creat d0/f29 x:0 0 0 2024-09-21T00:56:29.139 INFO:tasks.workunit.client.0.smithi112.stdout:6/33: readlink d9/la 0 2024-09-21T00:56:29.140 INFO:tasks.workunit.client.1.smithi187.stdout:5/109: mkdir d0/d19/d14/d1b/d27 0 2024-09-21T00:56:29.141 INFO:tasks.workunit.client.0.smithi112.stdout:3/47: symlink d2/d8/lb 0 2024-09-21T00:56:29.142 INFO:tasks.workunit.client.1.smithi187.stdout:5/110: fdatasync d0/dc/f11 0 2024-09-21T00:56:29.143 INFO:tasks.workunit.client.0.smithi112.stdout:3/48: read d2/f5 [3515081,112070] 0 2024-09-21T00:56:29.143 INFO:tasks.workunit.client.0.smithi112.stdout:4/30: link d1/f8 d1/d5/fd 0 2024-09-21T00:56:29.144 INFO:tasks.workunit.client.1.smithi187.stdout:4/132: dwrite d2/f11 [0,4194304] 0 2024-09-21T00:56:29.144 INFO:tasks.workunit.client.1.smithi187.stdout:9/269: link d4/c32 d4/d13/d14/d28/c58 0 2024-09-21T00:56:29.145 INFO:tasks.workunit.client.0.smithi112.stdout:4/31: readlink d1/d5/l6 0 2024-09-21T00:56:29.145 INFO:tasks.workunit.client.1.smithi187.stdout:1/106: dread d4/d6/ff [0,4194304] 0 2024-09-21T00:56:29.146 INFO:tasks.workunit.client.0.smithi112.stdout:4/32: chown d1/d5/l6 389401 1 2024-09-21T00:56:29.147 INFO:tasks.workunit.client.0.smithi112.stdout:9/32: creat d5/fc x:0 0 0 2024-09-21T00:56:29.148 INFO:tasks.workunit.client.0.smithi112.stdout:7/60: dwrite d0/fe [0,4194304] 0 2024-09-21T00:56:29.149 INFO:tasks.workunit.client.1.smithi187.stdout:9/270: read - d4/d4b/f57 zero size 2024-09-21T00:56:29.150 INFO:tasks.workunit.client.0.smithi112.stdout:6/34: rmdir d9 39 2024-09-21T00:56:29.151 INFO:tasks.workunit.client.0.smithi112.stdout:3/49: dread f1 [0,4194304] 0 2024-09-21T00:56:29.151 INFO:tasks.workunit.client.1.smithi187.stdout:9/271: read d4/f5 [2547032,17823] 0 2024-09-21T00:56:29.152 INFO:tasks.workunit.client.1.smithi187.stdout:8/173: dread dc/fe [0,4194304] 0 2024-09-21T00:56:29.152 INFO:tasks.workunit.client.1.smithi187.stdout:3/116: dwrite d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:29.152 INFO:tasks.workunit.client.1.smithi187.stdout:5/111: rename d0/dc/f17 to d0/dc/f28 0 2024-09-21T00:56:29.154 INFO:tasks.workunit.client.0.smithi112.stdout:2/60: getdents d0/df 0 2024-09-21T00:56:29.154 INFO:tasks.workunit.client.1.smithi187.stdout:5/112: stat d0/d19/f10 0 2024-09-21T00:56:29.155 INFO:tasks.workunit.client.0.smithi112.stdout:2/61: write d0/fc [1403131,39129] 0 2024-09-21T00:56:29.159 INFO:tasks.workunit.client.1.smithi187.stdout:1/107: mknod d4/d6/c1e 0 2024-09-21T00:56:29.160 INFO:tasks.workunit.client.1.smithi187.stdout:9/272: dwrite d4/f1a [0,4194304] 0 2024-09-21T00:56:29.165 INFO:tasks.workunit.client.1.smithi187.stdout:2/172: sync 2024-09-21T00:56:29.165 INFO:tasks.workunit.client.1.smithi187.stdout:6/104: sync 2024-09-21T00:56:29.165 INFO:tasks.workunit.client.0.smithi112.stdout:7/61: rmdir d0 39 2024-09-21T00:56:29.167 INFO:tasks.workunit.client.1.smithi187.stdout:8/174: rmdir dc/d1c/d29 39 2024-09-21T00:56:29.167 INFO:tasks.workunit.client.0.smithi112.stdout:3/50: mknod d2/d8/cc 0 2024-09-21T00:56:29.169 INFO:tasks.workunit.client.1.smithi187.stdout:3/117: unlink l8 0 2024-09-21T00:56:29.170 INFO:tasks.workunit.client.1.smithi187.stdout:8/175: chown dc/l32 2429388 1 2024-09-21T00:56:29.171 INFO:tasks.workunit.client.1.smithi187.stdout:1/108: dwrite d4/f14 [0,4194304] 0 2024-09-21T00:56:29.172 INFO:tasks.workunit.client.0.smithi112.stdout:2/62: unlink d0/fc 0 2024-09-21T00:56:29.173 INFO:tasks.workunit.client.0.smithi112.stdout:2/63: write d0/fe [20035,21062] 0 2024-09-21T00:56:29.175 INFO:tasks.workunit.client.1.smithi187.stdout:7/89: dwrite d1/f14 [0,4194304] 0 2024-09-21T00:56:29.179 INFO:tasks.workunit.client.0.smithi112.stdout:9/33: unlink f4 0 2024-09-21T00:56:29.182 INFO:tasks.workunit.client.0.smithi112.stdout:4/33: mknod d1/d7/d9/ce 0 2024-09-21T00:56:29.183 INFO:tasks.workunit.client.0.smithi112.stdout:4/34: chown d1/l2 1118 1 2024-09-21T00:56:29.184 INFO:tasks.workunit.client.0.smithi112.stdout:4/35: write d1/d5/fc [812975,125993] 0 2024-09-21T00:56:29.186 INFO:tasks.workunit.client.0.smithi112.stdout:7/62: read d0/fa [306504,86958] 0 2024-09-21T00:56:29.188 INFO:tasks.workunit.client.1.smithi187.stdout:2/173: unlink d2/d3/d15/d1b/d1c/f29 0 2024-09-21T00:56:29.188 INFO:tasks.workunit.client.0.smithi112.stdout:6/35: creat d9/fc x:0 0 0 2024-09-21T00:56:29.189 INFO:tasks.workunit.client.0.smithi112.stdout:6/36: readlink d9/la 0 2024-09-21T00:56:29.189 INFO:tasks.workunit.client.1.smithi187.stdout:5/113: symlink d0/d19/d14/d1b/d27/l29 0 2024-09-21T00:56:29.190 INFO:tasks.workunit.client.1.smithi187.stdout:3/118: read f3 [616642,22545] 0 2024-09-21T00:56:29.192 INFO:tasks.workunit.client.1.smithi187.stdout:5/114: truncate d0/dc/f28 401290 0 2024-09-21T00:56:29.192 INFO:tasks.workunit.client.1.smithi187.stdout:8/176: mknod dc/d2f/c35 0 2024-09-21T00:56:29.192 INFO:tasks.workunit.client.1.smithi187.stdout:3/119: write d9/f12 [110066,117693] 0 2024-09-21T00:56:29.193 INFO:tasks.workunit.client.0.smithi112.stdout:2/64: rmdir d0 39 2024-09-21T00:56:29.194 INFO:tasks.workunit.client.1.smithi187.stdout:3/120: stat d9/d19/d1c/f2a 0 2024-09-21T00:56:29.195 INFO:tasks.workunit.client.1.smithi187.stdout:2/174: dwrite d2/d3/df/f3e [0,4194304] 0 2024-09-21T00:56:29.196 INFO:tasks.workunit.client.0.smithi112.stdout:4/36: fdatasync d1/d5/fc 0 2024-09-21T00:56:29.197 INFO:tasks.workunit.client.1.smithi187.stdout:9/273: rename d4/d8/d41/l4d to d4/d13/d20/l59 0 2024-09-21T00:56:29.199 INFO:tasks.workunit.client.0.smithi112.stdout:7/63: symlink d0/d2/lf 0 2024-09-21T00:56:29.200 INFO:tasks.workunit.client.1.smithi187.stdout:7/90: rmdir d1/dc 39 2024-09-21T00:56:29.201 INFO:tasks.workunit.client.0.smithi112.stdout:6/37: creat d9/fd x:0 0 0 2024-09-21T00:56:29.201 INFO:tasks.workunit.client.0.smithi112.stdout:6/38: rename d9 to d9/de 22 2024-09-21T00:56:29.202 INFO:tasks.workunit.client.1.smithi187.stdout:4/133: link d2/d3/da/d16/f1d d2/d3/f29 0 2024-09-21T00:56:29.202 INFO:tasks.workunit.client.0.smithi112.stdout:6/39: fsync d9/fc 0 2024-09-21T00:56:29.202 INFO:tasks.workunit.client.1.smithi187.stdout:6/105: unlink d7/ce 0 2024-09-21T00:56:29.208 INFO:tasks.workunit.client.0.smithi112.stdout:2/65: dread d0/f5 [0,4194304] 0 2024-09-21T00:56:29.209 INFO:tasks.workunit.client.0.smithi112.stdout:2/66: dread - d0/fb zero size 2024-09-21T00:56:29.210 INFO:tasks.workunit.client.0.smithi112.stdout:2/67: dread d0/fe [0,4194304] 0 2024-09-21T00:56:29.330 INFO:tasks.workunit.client.0.smithi112.stdout:9/34: truncate f1 2054496 0 2024-09-21T00:56:29.332 INFO:tasks.workunit.client.0.smithi112.stdout:4/37: creat d1/ff x:0 0 0 2024-09-21T00:56:29.332 INFO:tasks.workunit.client.0.smithi112.stdout:4/38: stat d1 0 2024-09-21T00:56:29.333 INFO:tasks.workunit.client.0.smithi112.stdout:7/64: creat d0/f10 x:0 0 0 2024-09-21T00:56:29.334 INFO:tasks.workunit.client.1.smithi187.stdout:8/177: read - dc/f15 zero size 2024-09-21T00:56:29.336 INFO:tasks.workunit.client.0.smithi112.stdout:6/40: stat c6 0 2024-09-21T00:56:29.340 INFO:tasks.workunit.client.0.smithi112.stdout:7/65: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:29.343 INFO:tasks.workunit.client.1.smithi187.stdout:2/175: mknod d2/d25/c42 0 2024-09-21T00:56:29.344 INFO:tasks.workunit.client.0.smithi112.stdout:2/68: write d0/d7/d8/fd [781196,76811] 0 2024-09-21T00:56:29.345 INFO:tasks.workunit.client.1.smithi187.stdout:9/274: mknod d4/d13/d14/d28/c5a 0 2024-09-21T00:56:29.346 INFO:tasks.workunit.client.0.smithi112.stdout:9/35: dread - d5/d6/f7 zero size 2024-09-21T00:56:29.346 INFO:tasks.workunit.client.1.smithi187.stdout:0/148: getdents d0/d17 0 2024-09-21T00:56:29.349 INFO:tasks.workunit.client.0.smithi112.stdout:3/51: getdents d2 0 2024-09-21T00:56:29.350 INFO:tasks.workunit.client.0.smithi112.stdout:3/52: chown d2/f6 873417642 1 2024-09-21T00:56:29.351 INFO:tasks.workunit.client.1.smithi187.stdout:4/134: fdatasync d2/d3/f29 0 2024-09-21T00:56:29.351 INFO:tasks.workunit.client.0.smithi112.stdout:6/41: read f3 [5024114,69256] 0 2024-09-21T00:56:29.353 INFO:tasks.workunit.client.1.smithi187.stdout:8/178: readlink dc/l25 0 2024-09-21T00:56:29.354 INFO:tasks.workunit.client.1.smithi187.stdout:1/109: link d4/c15 d4/d1b/c1f 0 2024-09-21T00:56:29.355 INFO:tasks.workunit.client.0.smithi112.stdout:6/42: dread f7 [0,4194304] 0 2024-09-21T00:56:29.356 INFO:tasks.workunit.client.1.smithi187.stdout:7/91: dwrite d1/dc/f12 [4194304,4194304] 0 2024-09-21T00:56:29.358 INFO:tasks.workunit.client.1.smithi187.stdout:3/121: link d9/f11 d9/d13/f2c 0 2024-09-21T00:56:29.358 INFO:tasks.workunit.client.1.smithi187.stdout:3/122: dread - d9/d19/d1c/f21 zero size 2024-09-21T00:56:29.359 INFO:tasks.workunit.client.1.smithi187.stdout:2/176: chown d2/dc/c10 41870 1 2024-09-21T00:56:29.361 INFO:tasks.workunit.client.0.smithi112.stdout:2/69: symlink d0/d7/d8/l11 0 2024-09-21T00:56:29.362 INFO:tasks.workunit.client.1.smithi187.stdout:9/275: creat d4/d8/d41/f5b x:0 0 0 2024-09-21T00:56:29.363 INFO:tasks.workunit.client.1.smithi187.stdout:7/92: dread d1/f14 [0,4194304] 0 2024-09-21T00:56:29.364 INFO:tasks.workunit.client.1.smithi187.stdout:0/149: mknod d0/d17/d1c/c2a 0 2024-09-21T00:56:29.367 INFO:tasks.workunit.client.1.smithi187.stdout:2/177: dwrite d2/d3/f12 [4194304,4194304] 0 2024-09-21T00:56:29.368 INFO:tasks.workunit.client.1.smithi187.stdout:2/178: readlink d2/d3/l2f 0 2024-09-21T00:56:29.369 INFO:tasks.workunit.client.1.smithi187.stdout:2/179: write d2/fb [2383988,44659] 0 2024-09-21T00:56:29.369 INFO:tasks.workunit.client.1.smithi187.stdout:6/106: mknod d7/dc/d18/c1a 0 2024-09-21T00:56:29.370 INFO:tasks.workunit.client.0.smithi112.stdout:6/43: dwrite f7 [4194304,4194304] 0 2024-09-21T00:56:29.371 INFO:tasks.workunit.client.0.smithi112.stdout:3/53: read f1 [224547,105123] 0 2024-09-21T00:56:29.372 INFO:tasks.workunit.client.1.smithi187.stdout:4/135: symlink d2/d3/da/d16/d18/d22/l2a 0 2024-09-21T00:56:29.373 INFO:tasks.workunit.client.1.smithi187.stdout:4/136: chown d2/d3/da/d16/d18/l1c 85515298 1 2024-09-21T00:56:29.375 INFO:tasks.workunit.client.1.smithi187.stdout:8/179: write dc/f10 [175444,125668] 0 2024-09-21T00:56:29.375 INFO:tasks.workunit.client.0.smithi112.stdout:4/39: dwrite d1/d5/fd [0,4194304] 0 2024-09-21T00:56:29.379 INFO:tasks.workunit.client.0.smithi112.stdout:9/36: fsync f3 0 2024-09-21T00:56:29.379 INFO:tasks.workunit.client.0.smithi112.stdout:4/40: chown f0 0 1 2024-09-21T00:56:29.382 INFO:tasks.workunit.client.1.smithi187.stdout:9/276: creat d4/d8/d46/d54/f5c x:0 0 0 2024-09-21T00:56:29.382 INFO:tasks.workunit.client.0.smithi112.stdout:7/66: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:29.382 INFO:tasks.workunit.client.0.smithi112.stdout:2/70: dread d0/f3 [0,4194304] 0 2024-09-21T00:56:29.383 INFO:tasks.workunit.client.1.smithi187.stdout:9/277: chown d4/d13/d20/f37 3 1 2024-09-21T00:56:29.383 INFO:tasks.workunit.client.0.smithi112.stdout:4/41: chown d1/d5/cb 73710 1 2024-09-21T00:56:29.383 INFO:tasks.workunit.client.0.smithi112.stdout:3/54: rmdir d2 39 2024-09-21T00:56:29.383 INFO:tasks.workunit.client.0.smithi112.stdout:7/67: read d0/f10 [2583242,69180] 0 2024-09-21T00:56:29.383 INFO:tasks.workunit.client.1.smithi187.stdout:0/150: creat d0/d17/f2b x:0 0 0 2024-09-21T00:56:29.385 INFO:tasks.workunit.client.0.smithi112.stdout:4/42: write d1/d5/fd [503464,64989] 0 2024-09-21T00:56:29.386 INFO:tasks.workunit.client.1.smithi187.stdout:7/93: symlink d1/dc/d15/d22/l25 0 2024-09-21T00:56:29.386 INFO:tasks.workunit.client.1.smithi187.stdout:7/94: readlink d1/dc/d15/l20 0 2024-09-21T00:56:29.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/43: fdatasync f0 0 2024-09-21T00:56:29.387 INFO:tasks.workunit.client.0.smithi112.stdout:4/44: truncate d1/ff 397644 0 2024-09-21T00:56:29.389 INFO:tasks.workunit.client.0.smithi112.stdout:9/37: rename f2 to d5/d6/fd 0 2024-09-21T00:56:29.389 INFO:tasks.workunit.client.0.smithi112.stdout:6/44: fdatasync f7 0 2024-09-21T00:56:29.389 INFO:tasks.workunit.client.0.smithi112.stdout:3/55: dread f1 [0,4194304] 0 2024-09-21T00:56:29.389 INFO:tasks.workunit.client.0.smithi112.stdout:6/45: stat f3 0 2024-09-21T00:56:29.390 INFO:tasks.workunit.client.0.smithi112.stdout:7/68: dread d0/f10 [0,4194304] 0 2024-09-21T00:56:29.391 INFO:tasks.workunit.client.0.smithi112.stdout:7/69: read d0/fe [1337870,18912] 0 2024-09-21T00:56:29.393 INFO:tasks.workunit.client.0.smithi112.stdout:2/71: unlink d0/df/c10 0 2024-09-21T00:56:29.394 INFO:tasks.workunit.client.0.smithi112.stdout:2/72: dread - d0/fa zero size 2024-09-21T00:56:29.395 INFO:tasks.workunit.client.1.smithi187.stdout:6/107: symlink d7/dc/l1b 0 2024-09-21T00:56:29.395 INFO:tasks.workunit.client.1.smithi187.stdout:1/110: write d4/d6/ff [1119000,2435] 0 2024-09-21T00:56:29.396 INFO:tasks.workunit.client.1.smithi187.stdout:6/108: stat d7/dc/d18 0 2024-09-21T00:56:29.396 INFO:tasks.workunit.client.1.smithi187.stdout:1/111: chown d4/d1b/c1f 1 1 2024-09-21T00:56:29.396 INFO:tasks.workunit.client.1.smithi187.stdout:6/109: read - d7/dc/f10 zero size 2024-09-21T00:56:29.396 INFO:tasks.workunit.client.1.smithi187.stdout:1/112: readlink d4/l9 0 2024-09-21T00:56:29.398 INFO:tasks.workunit.client.1.smithi187.stdout:4/137: creat d2/d3/f2b x:0 0 0 2024-09-21T00:56:29.400 INFO:tasks.workunit.client.1.smithi187.stdout:5/115: rename d0/d19/d14/c18 to d0/d19/d14/c2a 0 2024-09-21T00:56:29.401 INFO:tasks.workunit.client.0.smithi112.stdout:4/45: mknod d1/d7/c10 0 2024-09-21T00:56:29.404 INFO:tasks.workunit.client.0.smithi112.stdout:9/38: mkdir d5/d6/de 0 2024-09-21T00:56:29.405 INFO:tasks.workunit.client.0.smithi112.stdout:9/39: chown d5/d6/fd 14644 1 2024-09-21T00:56:29.406 INFO:tasks.workunit.client.0.smithi112.stdout:6/46: mkdir d9/df 0 2024-09-21T00:56:29.407 INFO:tasks.workunit.client.1.smithi187.stdout:3/123: truncate d9/d13/f2c 385508 0 2024-09-21T00:56:29.409 INFO:tasks.workunit.client.1.smithi187.stdout:0/151: creat d0/d17/d18/f2c x:0 0 0 2024-09-21T00:56:29.410 INFO:tasks.workunit.client.0.smithi112.stdout:7/70: unlink d0/l5 0 2024-09-21T00:56:29.410 INFO:tasks.workunit.client.0.smithi112.stdout:7/71: stat d0/d2 0 2024-09-21T00:56:29.414 INFO:tasks.workunit.client.0.smithi112.stdout:4/46: symlink d1/d5/l11 0 2024-09-21T00:56:29.415 INFO:tasks.workunit.client.1.smithi187.stdout:2/180: truncate d2/d25/d34/f20 3481013 0 2024-09-21T00:56:29.419 INFO:tasks.workunit.client.0.smithi112.stdout:4/47: dread d1/d5/fc [0,4194304] 0 2024-09-21T00:56:29.419 INFO:tasks.workunit.client.0.smithi112.stdout:9/40: mknod d5/cf 0 2024-09-21T00:56:29.421 INFO:tasks.workunit.client.0.smithi112.stdout:4/48: write f0 [3720585,64691] 0 2024-09-21T00:56:29.421 INFO:tasks.workunit.client.1.smithi187.stdout:1/113: rename d4/c15 to d4/d6/c20 0 2024-09-21T00:56:29.422 INFO:tasks.workunit.client.0.smithi112.stdout:4/49: fsync d1/d5/fd 0 2024-09-21T00:56:29.423 INFO:tasks.workunit.client.0.smithi112.stdout:3/56: dwrite d2/f5 [0,4194304] 0 2024-09-21T00:56:29.423 INFO:tasks.workunit.client.1.smithi187.stdout:4/138: mknod d2/d3/da/d16/d18/d24/c2c 0 2024-09-21T00:56:29.425 INFO:tasks.workunit.client.0.smithi112.stdout:7/72: mknod d0/c11 0 2024-09-21T00:56:29.425 INFO:tasks.workunit.client.1.smithi187.stdout:9/278: dwrite d4/d13/d14/f18 [4194304,4194304] 0 2024-09-21T00:56:29.426 INFO:tasks.workunit.client.1.smithi187.stdout:9/279: write d4/d8/f22 [6794384,129100] 0 2024-09-21T00:56:29.427 INFO:tasks.workunit.client.1.smithi187.stdout:5/116: creat d0/d19/f2b x:0 0 0 2024-09-21T00:56:29.427 INFO:tasks.workunit.client.1.smithi187.stdout:1/114: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:29.429 INFO:tasks.workunit.client.1.smithi187.stdout:5/117: dread - d0/dc/f25 zero size 2024-09-21T00:56:29.430 INFO:tasks.workunit.client.1.smithi187.stdout:8/180: unlink dc/f14 0 2024-09-21T00:56:29.432 INFO:tasks.workunit.client.0.smithi112.stdout:9/41: mknod d5/d6/c10 0 2024-09-21T00:56:29.433 INFO:tasks.workunit.client.1.smithi187.stdout:3/124: symlink d9/d13/d20/l2d 0 2024-09-21T00:56:29.434 INFO:tasks.workunit.client.0.smithi112.stdout:2/73: dwrite d0/f5 [0,4194304] 0 2024-09-21T00:56:29.436 INFO:tasks.workunit.client.0.smithi112.stdout:7/73: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:29.436 INFO:tasks.workunit.client.0.smithi112.stdout:4/50: symlink d1/d7/l12 0 2024-09-21T00:56:29.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/51: fsync d1/f8 0 2024-09-21T00:56:29.439 INFO:tasks.workunit.client.1.smithi187.stdout:0/152: write d0/fb [9702597,71544] 0 2024-09-21T00:56:29.439 INFO:tasks.workunit.client.0.smithi112.stdout:3/57: mkdir d2/d8/dd 0 2024-09-21T00:56:29.441 INFO:tasks.workunit.client.1.smithi187.stdout:9/280: dread d4/d10/f4a [0,4194304] 0 2024-09-21T00:56:29.444 INFO:tasks.workunit.client.1.smithi187.stdout:6/110: mkdir d7/d1c 0 2024-09-21T00:56:29.446 INFO:tasks.workunit.client.0.smithi112.stdout:4/52: dwrite d1/ff [0,4194304] 0 2024-09-21T00:56:29.446 INFO:tasks.workunit.client.0.smithi112.stdout:4/53: stat d1/d7/d9/ce 0 2024-09-21T00:56:29.447 INFO:tasks.workunit.client.0.smithi112.stdout:4/54: chown d1/d5/l11 168 1 2024-09-21T00:56:29.448 INFO:tasks.workunit.client.1.smithi187.stdout:2/181: rename d2/dc/f1a to d2/d25/f43 0 2024-09-21T00:56:29.453 INFO:tasks.workunit.client.0.smithi112.stdout:3/58: truncate f1 1931670 0 2024-09-21T00:56:29.454 INFO:tasks.workunit.client.0.smithi112.stdout:3/59: stat d2/d8/cc 0 2024-09-21T00:56:29.458 INFO:tasks.workunit.client.1.smithi187.stdout:1/115: creat d4/d6/f21 x:0 0 0 2024-09-21T00:56:29.463 INFO:tasks.workunit.client.1.smithi187.stdout:5/118: mknod d0/dc/d1f/c2c 0 2024-09-21T00:56:29.464 INFO:tasks.workunit.client.1.smithi187.stdout:1/116: dwrite d4/f11 [0,4194304] 0 2024-09-21T00:56:29.465 INFO:tasks.workunit.client.1.smithi187.stdout:8/181: chown dc/c1f 24 1 2024-09-21T00:56:29.465 INFO:tasks.workunit.client.1.smithi187.stdout:8/182: chown dc 7323542 1 2024-09-21T00:56:29.467 INFO:tasks.workunit.client.1.smithi187.stdout:3/125: creat d9/d13/d20/f2e x:0 0 0 2024-09-21T00:56:29.470 INFO:tasks.workunit.client.1.smithi187.stdout:7/95: creat d1/f26 x:0 0 0 2024-09-21T00:56:29.471 INFO:tasks.workunit.client.1.smithi187.stdout:7/96: read - d1/f21 zero size 2024-09-21T00:56:29.473 INFO:tasks.workunit.client.1.smithi187.stdout:7/97: read d1/f1e [694357,59703] 0 2024-09-21T00:56:29.473 INFO:tasks.workunit.client.1.smithi187.stdout:0/153: unlink d0/d17/d18/f20 0 2024-09-21T00:56:29.473 INFO:tasks.workunit.client.1.smithi187.stdout:3/126: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:29.475 INFO:tasks.workunit.client.0.smithi112.stdout:4/55: symlink d1/d5/l13 0 2024-09-21T00:56:29.475 INFO:tasks.workunit.client.0.smithi112.stdout:2/74: link d0/fb d0/d7/f12 0 2024-09-21T00:56:29.475 INFO:tasks.workunit.client.0.smithi112.stdout:4/56: stat f0 0 2024-09-21T00:56:29.479 INFO:tasks.workunit.client.1.smithi187.stdout:6/111: creat d7/dc/d18/f1d x:0 0 0 2024-09-21T00:56:29.481 INFO:tasks.workunit.client.1.smithi187.stdout:7/98: dwrite d1/f17 [0,4194304] 0 2024-09-21T00:56:29.482 INFO:tasks.workunit.client.1.smithi187.stdout:3/127: dwrite d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:29.484 INFO:tasks.workunit.client.0.smithi112.stdout:4/57: dwrite d1/f8 [4194304,4194304] 0 2024-09-21T00:56:29.488 INFO:tasks.workunit.client.1.smithi187.stdout:4/139: rename d2/d3/f29 to d2/d3/da/d16/d18/d25/f2d 0 2024-09-21T00:56:29.489 INFO:tasks.workunit.client.1.smithi187.stdout:4/140: dread - d2/d3/f2b zero size 2024-09-21T00:56:29.489 INFO:tasks.workunit.client.1.smithi187.stdout:2/182: creat d2/d25/f44 x:0 0 0 2024-09-21T00:56:29.511 INFO:tasks.workunit.client.1.smithi187.stdout:6/112: creat d7/dc/d18/f1e x:0 0 0 2024-09-21T00:56:29.513 INFO:tasks.workunit.client.1.smithi187.stdout:7/99: creat d1/dc/d15/d22/f27 x:0 0 0 2024-09-21T00:56:29.514 INFO:tasks.workunit.client.1.smithi187.stdout:7/100: write d1/f9 [3521893,122449] 0 2024-09-21T00:56:29.519 INFO:tasks.workunit.client.1.smithi187.stdout:4/141: rename d2/d3/da/f1b to d2/d3/da/d16/d18/d24/f2e 0 2024-09-21T00:56:29.520 INFO:tasks.workunit.client.1.smithi187.stdout:7/101: dwrite d1/f1c [0,4194304] 0 2024-09-21T00:56:29.521 INFO:tasks.workunit.client.1.smithi187.stdout:7/102: chown d1/d18/f1d 290 1 2024-09-21T00:56:29.522 INFO:tasks.workunit.client.1.smithi187.stdout:5/119: truncate d0/f9 3729989 0 2024-09-21T00:56:29.524 INFO:tasks.workunit.client.1.smithi187.stdout:1/117: mkdir d4/d1b/d22 0 2024-09-21T00:56:29.525 INFO:tasks.workunit.client.1.smithi187.stdout:1/118: write d4/d6/d8/f13 [2319036,115172] 0 2024-09-21T00:56:29.525 INFO:tasks.workunit.client.1.smithi187.stdout:1/119: readlink d4/d6/d8/l10 0 2024-09-21T00:56:29.526 INFO:tasks.workunit.client.1.smithi187.stdout:1/120: write d4/f14 [3766708,114119] 0 2024-09-21T00:56:29.530 INFO:tasks.workunit.client.1.smithi187.stdout:9/281: rmdir d4/d13/d14/d1d/d4e 0 2024-09-21T00:56:29.533 INFO:tasks.workunit.client.1.smithi187.stdout:6/113: rename d7/dc/d18/c1a to d7/dc/d18/c1f 0 2024-09-21T00:56:29.540 INFO:tasks.workunit.client.1.smithi187.stdout:6/114: dwrite d7/dc/f13 [0,4194304] 0 2024-09-21T00:56:29.542 INFO:tasks.workunit.client.1.smithi187.stdout:4/142: mkdir d2/d3/da/d2f 0 2024-09-21T00:56:29.544 INFO:tasks.workunit.client.1.smithi187.stdout:5/120: truncate d0/d19/f15 81353 0 2024-09-21T00:56:29.545 INFO:tasks.workunit.client.1.smithi187.stdout:4/143: write d2/d3/da/d16/d18/d22/f23 [4892693,113794] 0 2024-09-21T00:56:29.548 INFO:tasks.workunit.client.1.smithi187.stdout:8/183: link dc/f24 dc/d2f/f36 0 2024-09-21T00:56:29.549 INFO:tasks.workunit.client.1.smithi187.stdout:1/121: rmdir d4/d1b 39 2024-09-21T00:56:29.552 INFO:tasks.workunit.client.1.smithi187.stdout:9/282: unlink d4/d10/d24/f3f 0 2024-09-21T00:56:29.556 INFO:tasks.workunit.client.1.smithi187.stdout:2/183: rmdir d2/d31 0 2024-09-21T00:56:29.558 INFO:tasks.workunit.client.1.smithi187.stdout:6/115: rename d7/f19 to d7/d1c/f20 0 2024-09-21T00:56:29.564 INFO:tasks.workunit.client.1.smithi187.stdout:5/121: truncate d0/f7 1023746 0 2024-09-21T00:56:29.566 INFO:tasks.workunit.client.1.smithi187.stdout:5/122: fdatasync d0/d19/f2b 0 2024-09-21T00:56:29.566 INFO:tasks.workunit.client.1.smithi187.stdout:3/128: dwrite d9/d13/f1e [0,4194304] 0 2024-09-21T00:56:29.567 INFO:tasks.workunit.client.1.smithi187.stdout:3/129: stat f2 0 2024-09-21T00:56:29.567 INFO:tasks.workunit.client.1.smithi187.stdout:8/184: mkdir dc/d2f/d37 0 2024-09-21T00:56:29.569 INFO:tasks.workunit.client.1.smithi187.stdout:1/122: mkdir d4/d6/d23 0 2024-09-21T00:56:29.570 INFO:tasks.workunit.client.1.smithi187.stdout:2/184: dread d2/d3/f12 [0,4194304] 0 2024-09-21T00:56:29.574 INFO:tasks.workunit.client.1.smithi187.stdout:0/154: getdents d0/d17/d1c/d23 0 2024-09-21T00:56:29.576 INFO:tasks.workunit.client.1.smithi187.stdout:0/155: truncate d0/d17/d1c/d23/df/f1d 159807 0 2024-09-21T00:56:29.576 INFO:tasks.workunit.client.1.smithi187.stdout:0/156: fsync d0/f29 0 2024-09-21T00:56:29.577 INFO:tasks.workunit.client.1.smithi187.stdout:9/283: mkdir d4/d13/d14/d5d 0 2024-09-21T00:56:29.578 INFO:tasks.workunit.client.1.smithi187.stdout:9/284: write d4/d4b/f57 [466005,50666] 0 2024-09-21T00:56:29.583 INFO:tasks.workunit.client.1.smithi187.stdout:9/285: dwrite d4/f1a [0,4194304] 0 2024-09-21T00:56:29.585 INFO:tasks.workunit.client.1.smithi187.stdout:7/103: link d1/d18/c19 d1/dc/d15/d22/c28 0 2024-09-21T00:56:29.586 INFO:tasks.workunit.client.1.smithi187.stdout:7/104: chown d1/d18/l1b 10159498 1 2024-09-21T00:56:29.589 INFO:tasks.workunit.client.1.smithi187.stdout:4/144: creat d2/d3/da/d2f/f30 x:0 0 0 2024-09-21T00:56:29.600 INFO:tasks.workunit.client.1.smithi187.stdout:9/286: mknod d4/d13/d14/d28/c5e 0 2024-09-21T00:56:29.601 INFO:tasks.workunit.client.1.smithi187.stdout:9/287: dread - d4/d8/d41/f5b zero size 2024-09-21T00:56:29.601 INFO:tasks.workunit.client.1.smithi187.stdout:6/116: dread - d7/d1c/f20 zero size 2024-09-21T00:56:29.602 INFO:tasks.workunit.client.1.smithi187.stdout:9/288: write d4/f5 [3939843,43276] 0 2024-09-21T00:56:29.603 INFO:tasks.workunit.client.1.smithi187.stdout:7/105: creat d1/d18/f29 x:0 0 0 2024-09-21T00:56:29.604 INFO:tasks.workunit.client.1.smithi187.stdout:7/106: read d1/f11 [358723,120328] 0 2024-09-21T00:56:29.605 INFO:tasks.workunit.client.1.smithi187.stdout:4/145: dread d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:29.612 INFO:tasks.workunit.client.1.smithi187.stdout:0/157: mknod d0/d17/d1c/d21/c2d 0 2024-09-21T00:56:29.614 INFO:tasks.workunit.client.1.smithi187.stdout:6/117: creat d7/dc/f21 x:0 0 0 2024-09-21T00:56:29.617 INFO:tasks.workunit.client.1.smithi187.stdout:4/146: symlink d2/d3/da/l31 0 2024-09-21T00:56:29.617 INFO:tasks.workunit.client.1.smithi187.stdout:4/147: readlink d2/d3/da/d16/d18/d22/l2a 0 2024-09-21T00:56:29.618 INFO:tasks.workunit.client.1.smithi187.stdout:4/148: truncate d2/d3/f2b 802912 0 2024-09-21T00:56:29.618 INFO:tasks.workunit.client.1.smithi187.stdout:5/123: rename d0/d19/f1e to d0/f2d 0 2024-09-21T00:56:29.619 INFO:tasks.workunit.client.1.smithi187.stdout:4/149: write d2/ff [2642082,29317] 0 2024-09-21T00:56:29.619 INFO:tasks.workunit.client.1.smithi187.stdout:3/130: link d9/d19/d1c/l26 d9/d19/d1c/l2f 0 2024-09-21T00:56:29.620 INFO:tasks.workunit.client.1.smithi187.stdout:3/131: fsync d9/d13/f28 0 2024-09-21T00:56:29.622 INFO:tasks.workunit.client.1.smithi187.stdout:0/158: unlink d0/d17/f2b 0 2024-09-21T00:56:29.632 INFO:tasks.workunit.client.1.smithi187.stdout:5/124: mknod d0/d19/d14/d1b/d27/c2e 0 2024-09-21T00:56:29.633 INFO:tasks.workunit.client.1.smithi187.stdout:5/125: truncate d0/dc/f28 1078995 0 2024-09-21T00:56:29.634 INFO:tasks.workunit.client.1.smithi187.stdout:5/126: chown d0/d19/d14/d1b/d27/l29 40 1 2024-09-21T00:56:29.635 INFO:tasks.workunit.client.1.smithi187.stdout:2/185: getdents d2/dc/d2e 0 2024-09-21T00:56:29.636 INFO:tasks.workunit.client.1.smithi187.stdout:2/186: write d2/d3/df/f41 [212380,11206] 0 2024-09-21T00:56:29.644 INFO:tasks.workunit.client.1.smithi187.stdout:1/123: rename d4/d6/c20 to d4/d6/d8/c24 0 2024-09-21T00:56:29.646 INFO:tasks.workunit.client.1.smithi187.stdout:5/127: creat d0/d19/d14/d1b/d27/f2f x:0 0 0 2024-09-21T00:56:29.646 INFO:tasks.workunit.client.1.smithi187.stdout:5/128: read - d0/dc/f13 zero size 2024-09-21T00:56:29.648 INFO:tasks.workunit.client.1.smithi187.stdout:3/132: link d9/f12 d9/d19/f30 0 2024-09-21T00:56:29.651 INFO:tasks.workunit.client.1.smithi187.stdout:1/124: rename d4/d6/d8/l10 to d4/d6/d8/l25 0 2024-09-21T00:56:29.653 INFO:tasks.workunit.client.1.smithi187.stdout:5/129: mkdir d0/d19/d30 0 2024-09-21T00:56:29.654 INFO:tasks.workunit.client.1.smithi187.stdout:3/133: creat d9/d19/d1c/f31 x:0 0 0 2024-09-21T00:56:29.710 INFO:tasks.workunit.client.1.smithi187.stdout:6/118: link d7/f8 d7/f22 0 2024-09-21T00:56:29.716 INFO:tasks.workunit.client.1.smithi187.stdout:6/119: dread d7/ff [0,4194304] 0 2024-09-21T00:56:29.717 INFO:tasks.workunit.client.1.smithi187.stdout:6/120: write d7/dc/f21 [819160,30172] 0 2024-09-21T00:56:29.721 INFO:tasks.workunit.client.1.smithi187.stdout:3/134: mknod d9/d13/c32 0 2024-09-21T00:56:29.721 INFO:tasks.workunit.client.1.smithi187.stdout:3/135: chown d9 119432577 1 2024-09-21T00:56:29.722 INFO:tasks.workunit.client.1.smithi187.stdout:3/136: write d9/d13/d20/f2e [1022397,102307] 0 2024-09-21T00:56:29.722 INFO:tasks.workunit.client.1.smithi187.stdout:5/130: mknod d0/d19/d14/c31 0 2024-09-21T00:56:29.759 INFO:tasks.workunit.client.1.smithi187.stdout:8/185: sync 2024-09-21T00:56:29.760 INFO:tasks.workunit.client.1.smithi187.stdout:8/186: write dc/f26 [462265,17994] 0 2024-09-21T00:56:29.768 INFO:tasks.workunit.client.1.smithi187.stdout:7/107: write d1/f2 [364782,4959] 0 2024-09-21T00:56:29.772 INFO:tasks.workunit.client.1.smithi187.stdout:9/289: dwrite d4/d8/f19 [4194304,4194304] 0 2024-09-21T00:56:29.774 INFO:tasks.workunit.client.1.smithi187.stdout:1/125: symlink d4/d1b/d22/l26 0 2024-09-21T00:56:29.778 INFO:tasks.workunit.client.1.smithi187.stdout:7/108: dread d1/f9 [0,4194304] 0 2024-09-21T00:56:29.781 INFO:tasks.workunit.client.1.smithi187.stdout:8/187: mknod dc/d2f/d37/c38 0 2024-09-21T00:56:29.781 INFO:tasks.workunit.client.1.smithi187.stdout:9/290: mkdir d4/d13/d14/d1d/d5f 0 2024-09-21T00:56:29.782 INFO:tasks.workunit.client.1.smithi187.stdout:6/121: creat d7/f23 x:0 0 0 2024-09-21T00:56:29.785 INFO:tasks.workunit.client.1.smithi187.stdout:8/188: fdatasync dc/d1c/f2d 0 2024-09-21T00:56:29.785 INFO:tasks.workunit.client.1.smithi187.stdout:3/137: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:29.787 INFO:tasks.workunit.client.1.smithi187.stdout:7/109: symlink d1/d18/l2a 0 2024-09-21T00:56:29.788 INFO:tasks.workunit.client.1.smithi187.stdout:3/138: stat d9/l16 0 2024-09-21T00:56:29.788 INFO:tasks.workunit.client.1.smithi187.stdout:4/150: dwrite d2/d3/f21 [0,4194304] 0 2024-09-21T00:56:29.791 INFO:tasks.workunit.client.1.smithi187.stdout:3/139: chown d9/d13/f1e 1 1 2024-09-21T00:56:29.791 INFO:tasks.workunit.client.1.smithi187.stdout:0/159: dwrite d0/d17/d1c/d23/f19 [0,4194304] 0 2024-09-21T00:56:29.794 INFO:tasks.workunit.client.1.smithi187.stdout:3/140: chown d9/d13/f15 1552215820 1 2024-09-21T00:56:29.796 INFO:tasks.workunit.client.1.smithi187.stdout:4/151: dread d2/d3/da/f1f [4194304,4194304] 0 2024-09-21T00:56:29.796 INFO:tasks.workunit.client.1.smithi187.stdout:3/141: stat d9/d19/c1b 0 2024-09-21T00:56:29.798 INFO:tasks.workunit.client.1.smithi187.stdout:7/110: mkdir d1/dc/d15/d2b 0 2024-09-21T00:56:29.798 INFO:tasks.workunit.client.1.smithi187.stdout:4/152: write d2/d3/f13 [815820,2837] 0 2024-09-21T00:56:29.800 INFO:tasks.workunit.client.1.smithi187.stdout:8/189: rename dc/f30 to dc/d2f/d34/f39 0 2024-09-21T00:56:29.800 INFO:tasks.workunit.client.1.smithi187.stdout:2/187: sync 2024-09-21T00:56:29.805 INFO:tasks.workunit.client.1.smithi187.stdout:1/126: link d4/d6/d8/f13 d4/f27 0 2024-09-21T00:56:29.806 INFO:tasks.workunit.client.1.smithi187.stdout:9/291: mknod d4/d13/d14/d1d/d5f/c60 0 2024-09-21T00:56:29.807 INFO:tasks.workunit.client.1.smithi187.stdout:1/127: rename d4/d6 to d4/d6/d8/d28 22 2024-09-21T00:56:29.809 INFO:tasks.workunit.client.1.smithi187.stdout:4/153: dwrite d2/d3/da/f1f [4194304,4194304] 0 2024-09-21T00:56:29.819 INFO:tasks.workunit.client.1.smithi187.stdout:8/190: dwrite dc/fd [0,4194304] 0 2024-09-21T00:56:29.820 INFO:tasks.workunit.client.1.smithi187.stdout:9/292: unlink d4/d13/d20/f37 0 2024-09-21T00:56:29.820 INFO:tasks.workunit.client.1.smithi187.stdout:2/188: dread d2/fa [4194304,4194304] 0 2024-09-21T00:56:29.822 INFO:tasks.workunit.client.1.smithi187.stdout:8/191: chown dc/d2f/c35 59 1 2024-09-21T00:56:29.825 INFO:tasks.workunit.client.1.smithi187.stdout:1/128: rename d4/d6/f21 to d4/d6/f29 0 2024-09-21T00:56:29.825 INFO:tasks.workunit.client.1.smithi187.stdout:2/189: truncate d2/dc/d21/f36 392574 0 2024-09-21T00:56:29.829 INFO:tasks.workunit.client.1.smithi187.stdout:3/142: dread d9/fb [0,4194304] 0 2024-09-21T00:56:29.832 INFO:tasks.workunit.client.1.smithi187.stdout:9/293: dwrite d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:29.833 INFO:tasks.workunit.client.1.smithi187.stdout:0/160: dread d0/d17/d1c/d23/f10 [4194304,4194304] 0 2024-09-21T00:56:29.833 INFO:tasks.workunit.client.1.smithi187.stdout:1/129: dread d4/f14 [0,4194304] 0 2024-09-21T00:56:29.833 INFO:tasks.workunit.client.1.smithi187.stdout:1/130: stat d4/d1b 0 2024-09-21T00:56:29.833 INFO:tasks.workunit.client.1.smithi187.stdout:0/161: chown d0/d17 1252 1 2024-09-21T00:56:29.835 INFO:tasks.workunit.client.1.smithi187.stdout:5/131: write d0/f7 [856345,121682] 0 2024-09-21T00:56:29.836 INFO:tasks.workunit.client.1.smithi187.stdout:2/190: creat d2/dc/d17/f45 x:0 0 0 2024-09-21T00:56:29.838 INFO:tasks.workunit.client.1.smithi187.stdout:3/143: symlink d9/d13/d20/l33 0 2024-09-21T00:56:29.840 INFO:tasks.workunit.client.1.smithi187.stdout:6/122: fsync d7/f23 0 2024-09-21T00:56:29.843 INFO:tasks.workunit.client.1.smithi187.stdout:9/294: write d4/f7 [8658120,57675] 0 2024-09-21T00:56:29.844 INFO:tasks.workunit.client.1.smithi187.stdout:9/295: write d4/d13/d14/d1d/f3c [2109886,12407] 0 2024-09-21T00:56:29.846 INFO:tasks.workunit.client.1.smithi187.stdout:7/111: getdents d1/dc/d15/d22 0 2024-09-21T00:56:29.848 INFO:tasks.workunit.client.1.smithi187.stdout:0/162: rename d0/f29 to d0/d17/f2e 0 2024-09-21T00:56:29.851 INFO:tasks.workunit.client.1.smithi187.stdout:2/191: creat d2/dc/f46 x:0 0 0 2024-09-21T00:56:29.851 INFO:tasks.workunit.client.1.smithi187.stdout:2/192: chown d2/d3/df/c19 16786 1 2024-09-21T00:56:29.857 INFO:tasks.workunit.client.1.smithi187.stdout:7/112: mknod d1/dc/d15/d22/c2c 0 2024-09-21T00:56:29.857 INFO:tasks.workunit.client.1.smithi187.stdout:7/113: chown d1/f14 61839482 1 2024-09-21T00:56:29.864 INFO:tasks.workunit.client.1.smithi187.stdout:2/193: unlink d2/dc/le 0 2024-09-21T00:56:29.865 INFO:tasks.workunit.client.1.smithi187.stdout:8/192: getdents dc/d2f 0 2024-09-21T00:56:29.869 INFO:tasks.workunit.client.1.smithi187.stdout:7/114: creat d1/dc/f2d x:0 0 0 2024-09-21T00:56:29.871 INFO:tasks.workunit.client.1.smithi187.stdout:0/163: dread d0/f1 [4194304,4194304] 0 2024-09-21T00:56:29.874 INFO:tasks.workunit.client.1.smithi187.stdout:1/131: rename d4/ce to d4/c2a 0 2024-09-21T00:56:29.875 INFO:tasks.workunit.client.1.smithi187.stdout:9/296: rename d4/d4b to d4/d61 0 2024-09-21T00:56:29.878 INFO:tasks.workunit.client.1.smithi187.stdout:6/123: rename d7/dc/d18 to d7/d24 0 2024-09-21T00:56:29.879 INFO:tasks.workunit.client.1.smithi187.stdout:6/124: truncate f1 9197739 0 2024-09-21T00:56:29.879 INFO:tasks.workunit.client.1.smithi187.stdout:1/132: dread d4/f27 [0,4194304] 0 2024-09-21T00:56:29.888 INFO:tasks.workunit.client.1.smithi187.stdout:5/132: truncate d0/f7 900462 0 2024-09-21T00:56:29.888 INFO:tasks.workunit.client.1.smithi187.stdout:9/297: link d4/d13/d14/f18 d4/d13/d20/f62 0 2024-09-21T00:56:29.890 INFO:tasks.workunit.client.1.smithi187.stdout:8/193: rename dc/f13 to dc/d2f/d34/f3a 0 2024-09-21T00:56:29.893 INFO:tasks.workunit.client.1.smithi187.stdout:1/133: creat d4/d6/d23/f2b x:0 0 0 2024-09-21T00:56:29.896 INFO:tasks.workunit.client.1.smithi187.stdout:9/298: creat d4/d13/d14/d1d/f63 x:0 0 0 2024-09-21T00:56:29.899 INFO:tasks.workunit.client.1.smithi187.stdout:1/134: dwrite d4/f11 [0,4194304] 0 2024-09-21T00:56:29.902 INFO:tasks.workunit.client.1.smithi187.stdout:6/125: creat d7/f25 x:0 0 0 2024-09-21T00:56:29.903 INFO:tasks.workunit.client.1.smithi187.stdout:2/194: dwrite d2/d3/f12 [0,4194304] 0 2024-09-21T00:56:29.904 INFO:tasks.workunit.client.1.smithi187.stdout:6/126: dread - d7/d24/f1d zero size 2024-09-21T00:56:29.904 INFO:tasks.workunit.client.1.smithi187.stdout:1/135: dread d4/f27 [0,4194304] 0 2024-09-21T00:56:29.914 INFO:tasks.workunit.client.1.smithi187.stdout:0/164: rename d0/f14 to d0/d17/d1c/d21/f2f 0 2024-09-21T00:56:29.917 INFO:tasks.workunit.client.1.smithi187.stdout:2/195: mkdir d2/d3/d15/d1b/d47 0 2024-09-21T00:56:29.918 INFO:tasks.workunit.client.1.smithi187.stdout:9/299: dread d4/f7 [0,4194304] 0 2024-09-21T00:56:29.921 INFO:tasks.workunit.client.1.smithi187.stdout:6/127: mkdir d7/dc/d26 0 2024-09-21T00:56:29.924 INFO:tasks.workunit.client.1.smithi187.stdout:1/136: fdatasync d4/d6/d8/f13 0 2024-09-21T00:56:29.926 INFO:tasks.workunit.client.1.smithi187.stdout:1/137: chown d4/f7 1159 1 2024-09-21T00:56:29.927 INFO:tasks.workunit.client.1.smithi187.stdout:2/196: dwrite d2/d25/f44 [0,4194304] 0 2024-09-21T00:56:29.927 INFO:tasks.workunit.client.1.smithi187.stdout:6/128: dread d7/dc/fb [0,4194304] 0 2024-09-21T00:56:29.928 INFO:tasks.workunit.client.1.smithi187.stdout:9/300: dwrite d4/d8/f19 [0,4194304] 0 2024-09-21T00:56:29.928 INFO:tasks.workunit.client.1.smithi187.stdout:5/133: getdents d0/d19/d14/d1b/d27 0 2024-09-21T00:56:29.935 INFO:tasks.workunit.client.1.smithi187.stdout:8/194: truncate f7 2102824 0 2024-09-21T00:56:29.935 INFO:tasks.workunit.client.1.smithi187.stdout:9/301: rmdir d4/d8 39 2024-09-21T00:56:29.936 INFO:tasks.workunit.client.1.smithi187.stdout:9/302: fdatasync d4/d61/f57 0 2024-09-21T00:56:29.937 INFO:tasks.workunit.client.1.smithi187.stdout:1/138: mkdir d4/d1b/d22/d2c 0 2024-09-21T00:56:29.938 INFO:tasks.workunit.client.1.smithi187.stdout:1/139: dread - d4/d6/d23/f2b zero size 2024-09-21T00:56:29.939 INFO:tasks.workunit.client.1.smithi187.stdout:1/140: truncate d4/d6/f1c 1830565 0 2024-09-21T00:56:29.940 INFO:tasks.workunit.client.1.smithi187.stdout:2/197: mknod d2/d3/d15/d1b/d3c/c48 0 2024-09-21T00:56:29.946 INFO:tasks.workunit.client.1.smithi187.stdout:2/198: dwrite d2/d3/d15/d1b/d1c/f1f [0,4194304] 0 2024-09-21T00:56:29.952 INFO:tasks.workunit.client.1.smithi187.stdout:8/195: dwrite dc/d1c/d29/f2c [0,4194304] 0 2024-09-21T00:56:29.958 INFO:tasks.workunit.client.1.smithi187.stdout:9/303: creat d4/d8/f64 x:0 0 0 2024-09-21T00:56:29.961 INFO:tasks.workunit.client.1.smithi187.stdout:9/304: truncate d4/d8/d46/d54/f55 561082 0 2024-09-21T00:56:29.963 INFO:tasks.workunit.client.1.smithi187.stdout:2/199: mknod d2/d3/d15/d1b/d1c/d2d/c49 0 2024-09-21T00:56:29.965 INFO:tasks.workunit.client.1.smithi187.stdout:6/129: getdents d7/d24 0 2024-09-21T00:56:29.966 INFO:tasks.workunit.client.1.smithi187.stdout:6/130: readlink d7/ld 0 2024-09-21T00:56:29.967 INFO:tasks.workunit.client.1.smithi187.stdout:2/200: rmdir d2/d25 39 2024-09-21T00:56:29.969 INFO:tasks.workunit.client.1.smithi187.stdout:9/305: dwrite d4/d8/f2f [0,4194304] 0 2024-09-21T00:56:29.970 INFO:tasks.workunit.client.1.smithi187.stdout:9/306: chown d4/d13/d14/d28 97 1 2024-09-21T00:56:29.971 INFO:tasks.workunit.client.1.smithi187.stdout:2/201: dread d2/dc/d17/f37 [0,4194304] 0 2024-09-21T00:56:29.972 INFO:tasks.workunit.client.1.smithi187.stdout:6/131: unlink d7/dc/f21 0 2024-09-21T00:56:29.972 INFO:tasks.workunit.client.1.smithi187.stdout:2/202: readlink d2/d3/df/l1e 0 2024-09-21T00:56:29.977 INFO:tasks.workunit.client.1.smithi187.stdout:9/307: creat d4/d10/d24/f65 x:0 0 0 2024-09-21T00:56:29.979 INFO:tasks.workunit.client.1.smithi187.stdout:9/308: dread d4/d8/fb [0,4194304] 0 2024-09-21T00:56:29.980 INFO:tasks.workunit.client.1.smithi187.stdout:2/203: mkdir d2/dc/d2e/d4a 0 2024-09-21T00:56:29.981 INFO:tasks.workunit.client.1.smithi187.stdout:5/134: truncate d0/f7 784133 0 2024-09-21T00:56:29.982 INFO:tasks.workunit.client.1.smithi187.stdout:5/135: chown d0/d19/f10 423 1 2024-09-21T00:56:29.983 INFO:tasks.workunit.client.1.smithi187.stdout:9/309: unlink d4/f7 0 2024-09-21T00:56:29.983 INFO:tasks.workunit.client.1.smithi187.stdout:1/141: truncate d4/f17 153690 0 2024-09-21T00:56:29.983 INFO:tasks.workunit.client.1.smithi187.stdout:9/310: readlink l0 0 2024-09-21T00:56:29.984 INFO:tasks.workunit.client.1.smithi187.stdout:4/154: sync 2024-09-21T00:56:29.986 INFO:tasks.workunit.client.1.smithi187.stdout:5/136: creat d0/d19/f32 x:0 0 0 2024-09-21T00:56:29.986 INFO:tasks.workunit.client.1.smithi187.stdout:2/204: dwrite d2/dc/d21/f36 [0,4194304] 0 2024-09-21T00:56:29.990 INFO:tasks.workunit.client.1.smithi187.stdout:1/142: mknod d4/d6/d23/c2d 0 2024-09-21T00:56:29.991 INFO:tasks.workunit.client.1.smithi187.stdout:8/196: dwrite dc/d1c/f21 [0,4194304] 0 2024-09-21T00:56:29.992 INFO:tasks.workunit.client.1.smithi187.stdout:8/197: truncate dc/d1c/f2e 121488 0 2024-09-21T00:56:29.996 INFO:tasks.workunit.client.1.smithi187.stdout:5/137: chown d0/fa 752 1 2024-09-21T00:56:30.003 INFO:tasks.workunit.client.1.smithi187.stdout:1/143: mkdir d4/d6/d23/d2e 0 2024-09-21T00:56:30.004 INFO:tasks.workunit.client.1.smithi187.stdout:9/311: mkdir d4/d13/d20/d2b/d66 0 2024-09-21T00:56:30.004 INFO:tasks.workunit.client.1.smithi187.stdout:9/312: write d4/f3b [181670,32295] 0 2024-09-21T00:56:30.006 INFO:tasks.workunit.client.1.smithi187.stdout:5/138: fsync d0/d19/f23 0 2024-09-21T00:56:30.008 INFO:tasks.workunit.client.1.smithi187.stdout:5/139: dread d0/fa [0,4194304] 0 2024-09-21T00:56:30.011 INFO:tasks.workunit.client.0.smithi112.stdout:9/42: link d5/cf d5/d6/de/c11 0 2024-09-21T00:56:30.012 INFO:tasks.workunit.client.0.smithi112.stdout:9/43: write d5/fc [770194,67650] 0 2024-09-21T00:56:30.012 INFO:tasks.workunit.client.1.smithi187.stdout:1/144: fsync f3 0 2024-09-21T00:56:30.012 INFO:tasks.workunit.client.0.smithi112.stdout:9/44: chown f1 1497966899 1 2024-09-21T00:56:30.013 INFO:tasks.workunit.client.0.smithi112.stdout:3/60: mkdir d2/d8/dd/de 0 2024-09-21T00:56:30.015 INFO:tasks.workunit.client.0.smithi112.stdout:2/75: creat d0/df/f13 x:0 0 0 2024-09-21T00:56:30.016 INFO:tasks.workunit.client.1.smithi187.stdout:9/313: mknod d4/d8/d46/d54/c67 0 2024-09-21T00:56:30.018 INFO:tasks.workunit.client.0.smithi112.stdout:4/58: mknod d1/d7/d9/c14 0 2024-09-21T00:56:30.019 INFO:tasks.workunit.client.0.smithi112.stdout:7/74: chown d0/c11 57 1 2024-09-21T00:56:30.019 INFO:tasks.workunit.client.0.smithi112.stdout:4/59: dread d1/d5/fc [0,4194304] 0 2024-09-21T00:56:30.023 INFO:tasks.workunit.client.0.smithi112.stdout:9/45: rename f1 to d5/d6/de/f12 0 2024-09-21T00:56:30.023 INFO:tasks.workunit.client.0.smithi112.stdout:4/60: dread d1/ff [0,4194304] 0 2024-09-21T00:56:30.024 INFO:tasks.workunit.client.0.smithi112.stdout:3/61: mknod d2/d8/cf 0 2024-09-21T00:56:30.024 INFO:tasks.workunit.client.0.smithi112.stdout:4/61: write d1/ff [1862142,49875] 0 2024-09-21T00:56:30.025 INFO:tasks.workunit.client.1.smithi187.stdout:1/145: fdatasync d4/d6/d8/f13 0 2024-09-21T00:56:30.025 INFO:tasks.workunit.client.0.smithi112.stdout:4/62: write d1/d5/fd [8831800,49001] 0 2024-09-21T00:56:30.027 INFO:tasks.workunit.client.0.smithi112.stdout:2/76: rename d0/d7 to d0/d14 0 2024-09-21T00:56:30.027 INFO:tasks.workunit.client.0.smithi112.stdout:4/63: write f0 [1007564,67280] 0 2024-09-21T00:56:30.028 INFO:tasks.workunit.client.1.smithi187.stdout:8/198: creat dc/d1c/f3b x:0 0 0 2024-09-21T00:56:30.028 INFO:tasks.workunit.client.1.smithi187.stdout:8/199: stat c9 0 2024-09-21T00:56:30.030 INFO:tasks.workunit.client.1.smithi187.stdout:9/314: creat d4/d61/f68 x:0 0 0 2024-09-21T00:56:30.031 INFO:tasks.workunit.client.1.smithi187.stdout:4/155: getdents d2/d3/da/d16 0 2024-09-21T00:56:30.032 INFO:tasks.workunit.client.0.smithi112.stdout:7/75: dread d0/fe [0,4194304] 0 2024-09-21T00:56:30.032 INFO:tasks.workunit.client.1.smithi187.stdout:5/140: mknod d0/dc/d1f/d26/c33 0 2024-09-21T00:56:30.035 INFO:tasks.workunit.client.0.smithi112.stdout:9/46: mkdir d5/d6/de/d13 0 2024-09-21T00:56:30.036 INFO:tasks.workunit.client.1.smithi187.stdout:1/146: mkdir d4/d1b/d2f 0 2024-09-21T00:56:30.039 INFO:tasks.workunit.client.1.smithi187.stdout:9/315: mkdir d4/d10/d39/d69 0 2024-09-21T00:56:30.040 INFO:tasks.workunit.client.0.smithi112.stdout:2/77: creat d0/d14/f15 x:0 0 0 2024-09-21T00:56:30.041 INFO:tasks.workunit.client.0.smithi112.stdout:2/78: dread - d0/d14/f12 zero size 2024-09-21T00:56:30.041 INFO:tasks.workunit.client.1.smithi187.stdout:4/156: unlink d2/f11 0 2024-09-21T00:56:30.044 INFO:tasks.workunit.client.0.smithi112.stdout:3/62: dread f1 [0,4194304] 0 2024-09-21T00:56:30.045 INFO:tasks.workunit.client.0.smithi112.stdout:7/76: read d0/f10 [3958082,86967] 0 2024-09-21T00:56:30.045 INFO:tasks.workunit.client.1.smithi187.stdout:2/205: link d2/d25/d34/f20 d2/d3/d15/d1b/d1c/f4b 0 2024-09-21T00:56:30.046 INFO:tasks.workunit.client.0.smithi112.stdout:3/63: truncate d2/f5 4793607 0 2024-09-21T00:56:30.047 INFO:tasks.workunit.client.0.smithi112.stdout:9/47: creat d5/f14 x:0 0 0 2024-09-21T00:56:30.047 INFO:tasks.workunit.client.0.smithi112.stdout:9/48: dread - d5/d6/f7 zero size 2024-09-21T00:56:30.051 INFO:tasks.workunit.client.1.smithi187.stdout:9/316: mkdir d4/d61/d6a 0 2024-09-21T00:56:30.052 INFO:tasks.workunit.client.1.smithi187.stdout:9/317: write d4/d13/d3a/f56 [692296,100117] 0 2024-09-21T00:56:30.054 INFO:tasks.workunit.client.0.smithi112.stdout:9/49: dwrite d5/fc [0,4194304] 0 2024-09-21T00:56:30.055 INFO:tasks.workunit.client.1.smithi187.stdout:5/141: creat d0/d19/d30/f34 x:0 0 0 2024-09-21T00:56:30.057 INFO:tasks.workunit.client.0.smithi112.stdout:7/77: write d0/fe [3819736,126492] 0 2024-09-21T00:56:30.059 INFO:tasks.workunit.client.1.smithi187.stdout:4/157: rename d2/d3/da/d16/d18 to d2/d3/da/d2f/d32 0 2024-09-21T00:56:30.060 INFO:tasks.workunit.client.1.smithi187.stdout:4/158: dread d2/d3/f2b [0,4194304] 0 2024-09-21T00:56:30.061 INFO:tasks.workunit.client.1.smithi187.stdout:4/159: chown d2/d3/da/d16/c1e 0 1 2024-09-21T00:56:30.062 INFO:tasks.workunit.client.0.smithi112.stdout:7/78: dread d0/fe [0,4194304] 0 2024-09-21T00:56:30.063 INFO:tasks.workunit.client.0.smithi112.stdout:7/79: fdatasync d0/fe 0 2024-09-21T00:56:30.063 INFO:tasks.workunit.client.1.smithi187.stdout:2/206: mkdir d2/d3/d15/d1b/d1c/d2d/d4c 0 2024-09-21T00:56:30.065 INFO:tasks.workunit.client.0.smithi112.stdout:4/64: truncate d1/ff 2518529 0 2024-09-21T00:56:30.065 INFO:tasks.workunit.client.0.smithi112.stdout:4/65: fdatasync d1/d5/fc 0 2024-09-21T00:56:30.066 INFO:tasks.workunit.client.1.smithi187.stdout:8/200: creat dc/f3c x:0 0 0 2024-09-21T00:56:30.067 INFO:tasks.workunit.client.1.smithi187.stdout:4/160: dwrite d2/d3/da/d2f/d32/d22/f23 [0,4194304] 0 2024-09-21T00:56:30.068 INFO:tasks.workunit.client.1.smithi187.stdout:9/318: mknod d4/d10/c6b 0 2024-09-21T00:56:30.069 INFO:tasks.workunit.client.0.smithi112.stdout:9/50: write d5/d6/de/f12 [1968516,123404] 0 2024-09-21T00:56:30.071 INFO:tasks.workunit.client.1.smithi187.stdout:5/142: rename d0/d19/f2b to d0/d19/d14/d1b/d27/f35 0 2024-09-21T00:56:30.073 INFO:tasks.workunit.client.0.smithi112.stdout:9/51: chown d5/d6/de/d13 200508 1 2024-09-21T00:56:30.074 INFO:tasks.workunit.client.1.smithi187.stdout:3/144: sync 2024-09-21T00:56:30.076 INFO:tasks.workunit.client.0.smithi112.stdout:4/66: dwrite d1/f8 [4194304,4194304] 0 2024-09-21T00:56:30.078 INFO:tasks.workunit.client.1.smithi187.stdout:2/207: fdatasync d2/d25/f43 0 2024-09-21T00:56:30.079 INFO:tasks.workunit.client.1.smithi187.stdout:2/208: chown d2/d3/df/c27 60 1 2024-09-21T00:56:30.079 INFO:tasks.workunit.client.1.smithi187.stdout:8/201: rmdir dc/d2f 39 2024-09-21T00:56:30.081 INFO:tasks.workunit.client.0.smithi112.stdout:2/79: dwrite d0/d14/f12 [0,4194304] 0 2024-09-21T00:56:30.082 INFO:tasks.workunit.client.0.smithi112.stdout:3/64: write f1 [2168520,2062] 0 2024-09-21T00:56:30.086 INFO:tasks.workunit.client.1.smithi187.stdout:4/161: truncate d2/d3/da/fc 1866029 0 2024-09-21T00:56:30.087 INFO:tasks.workunit.client.0.smithi112.stdout:9/52: dwrite f3 [0,4194304] 0 2024-09-21T00:56:30.087 INFO:tasks.workunit.client.1.smithi187.stdout:5/143: readlink d0/d19/d14/l16 0 2024-09-21T00:56:30.088 INFO:tasks.workunit.client.0.smithi112.stdout:7/80: symlink d0/d2/l12 0 2024-09-21T00:56:30.089 INFO:tasks.workunit.client.0.smithi112.stdout:4/67: creat d1/d5/f15 x:0 0 0 2024-09-21T00:56:30.090 INFO:tasks.workunit.client.1.smithi187.stdout:9/319: dread d4/d10/f23 [0,4194304] 0 2024-09-21T00:56:30.091 INFO:tasks.workunit.client.1.smithi187.stdout:9/320: chown d4/d8/f64 1331693 1 2024-09-21T00:56:30.091 INFO:tasks.workunit.client.1.smithi187.stdout:9/321: fsync d4/f1a 0 2024-09-21T00:56:30.092 INFO:tasks.workunit.client.0.smithi112.stdout:2/80: rename d0/f3 to d0/df/f16 0 2024-09-21T00:56:30.092 INFO:tasks.workunit.client.1.smithi187.stdout:9/322: write d4/f1a [2989077,8748] 0 2024-09-21T00:56:30.095 INFO:tasks.workunit.client.0.smithi112.stdout:3/65: creat d2/d8/dd/f10 x:0 0 0 2024-09-21T00:56:30.096 INFO:tasks.workunit.client.1.smithi187.stdout:3/145: mknod d9/d13/d20/c34 0 2024-09-21T00:56:30.096 INFO:tasks.workunit.client.1.smithi187.stdout:2/209: dread d2/dc/d17/f2b [0,4194304] 0 2024-09-21T00:56:30.097 INFO:tasks.workunit.client.0.smithi112.stdout:9/53: creat d5/d6/de/f15 x:0 0 0 2024-09-21T00:56:30.098 INFO:tasks.workunit.client.0.smithi112.stdout:3/66: dread d2/f5 [4194304,4194304] 0 2024-09-21T00:56:30.099 INFO:tasks.workunit.client.0.smithi112.stdout:4/68: rename d1/d5/l13 to d1/l16 0 2024-09-21T00:56:30.100 INFO:tasks.workunit.client.1.smithi187.stdout:5/144: mknod d0/dc/d1f/d26/c36 0 2024-09-21T00:56:30.109 INFO:tasks.workunit.client.0.smithi112.stdout:2/81: fsync d0/d14/f12 0 2024-09-21T00:56:30.141 INFO:tasks.workunit.client.1.smithi187.stdout:0/165: sync 2024-09-21T00:56:30.141 INFO:tasks.workunit.client.1.smithi187.stdout:6/132: sync 2024-09-21T00:56:30.141 INFO:tasks.workunit.client.1.smithi187.stdout:7/115: sync 2024-09-21T00:56:30.142 INFO:tasks.workunit.client.1.smithi187.stdout:7/116: dread - d1/dc/d15/d22/f27 zero size 2024-09-21T00:56:30.142 INFO:tasks.workunit.client.1.smithi187.stdout:7/117: dread - d1/d18/f1d zero size 2024-09-21T00:56:30.175 INFO:tasks.workunit.client.1.smithi187.stdout:1/147: sync 2024-09-21T00:56:30.175 INFO:tasks.workunit.client.1.smithi187.stdout:1/148: fsync d4/d6/d23/f2b 0 2024-09-21T00:56:30.228 INFO:tasks.workunit.client.0.smithi112.stdout:9/54: fdatasync d5/d6/f7 0 2024-09-21T00:56:30.229 INFO:tasks.workunit.client.0.smithi112.stdout:9/55: write f3 [1502097,115107] 0 2024-09-21T00:56:30.229 INFO:tasks.workunit.client.1.smithi187.stdout:3/146: symlink d9/d19/l35 0 2024-09-21T00:56:30.230 INFO:tasks.workunit.client.0.smithi112.stdout:3/67: creat d2/d8/f11 x:0 0 0 2024-09-21T00:56:30.234 INFO:tasks.workunit.client.0.smithi112.stdout:7/81: symlink d0/d8/l13 0 2024-09-21T00:56:30.236 INFO:tasks.workunit.client.0.smithi112.stdout:2/82: mknod d0/d14/d8/c17 0 2024-09-21T00:56:30.238 INFO:tasks.workunit.client.1.smithi187.stdout:8/202: creat dc/d1c/f3d x:0 0 0 2024-09-21T00:56:30.242 INFO:tasks.workunit.client.0.smithi112.stdout:9/56: creat d5/f16 x:0 0 0 2024-09-21T00:56:30.243 INFO:tasks.workunit.client.0.smithi112.stdout:2/83: dwrite d0/fb [0,4194304] 0 2024-09-21T00:56:30.243 INFO:tasks.workunit.client.1.smithi187.stdout:6/133: creat d7/d1c/f27 x:0 0 0 2024-09-21T00:56:30.244 INFO:tasks.workunit.client.1.smithi187.stdout:6/134: chown d7/d24/f1d 257384 1 2024-09-21T00:56:30.245 INFO:tasks.workunit.client.1.smithi187.stdout:0/166: dwrite d0/f1 [0,4194304] 0 2024-09-21T00:56:30.246 INFO:tasks.workunit.client.1.smithi187.stdout:0/167: write d0/d17/d18/f2c [763061,60054] 0 2024-09-21T00:56:30.247 INFO:tasks.workunit.client.0.smithi112.stdout:9/57: dread d5/fb [0,4194304] 0 2024-09-21T00:56:30.248 INFO:tasks.workunit.client.0.smithi112.stdout:9/58: readlink - no filename 2024-09-21T00:56:30.248 INFO:tasks.workunit.client.0.smithi112.stdout:3/68: symlink d2/d8/l12 0 2024-09-21T00:56:30.249 INFO:tasks.workunit.client.1.smithi187.stdout:0/168: write d0/d17/d1c/d23/f28 [3623629,43722] 0 2024-09-21T00:56:30.254 INFO:tasks.workunit.client.0.smithi112.stdout:7/82: fsync d0/fe 0 2024-09-21T00:56:30.256 INFO:tasks.workunit.client.1.smithi187.stdout:3/147: unlink d9/d13/f28 0 2024-09-21T00:56:30.257 INFO:tasks.workunit.client.1.smithi187.stdout:4/162: dwrite d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:30.258 INFO:tasks.workunit.client.1.smithi187.stdout:2/210: creat d2/dc/d2e/d4a/f4d x:0 0 0 2024-09-21T00:56:30.258 INFO:tasks.workunit.client.0.smithi112.stdout:3/69: mknod d2/d8/dd/c13 0 2024-09-21T00:56:30.263 INFO:tasks.workunit.client.0.smithi112.stdout:7/83: rmdir d0/d2 39 2024-09-21T00:56:30.264 INFO:tasks.workunit.client.1.smithi187.stdout:9/323: truncate d4/d13/d3a/f56 394631 0 2024-09-21T00:56:30.267 INFO:tasks.workunit.client.0.smithi112.stdout:3/70: rmdir d2/d8/dd 39 2024-09-21T00:56:30.267 INFO:tasks.workunit.client.0.smithi112.stdout:3/71: read d2/f6 [1260445,30095] 0 2024-09-21T00:56:30.270 INFO:tasks.workunit.client.1.smithi187.stdout:1/149: creat d4/d1b/d22/d2c/f30 x:0 0 0 2024-09-21T00:56:30.270 INFO:tasks.workunit.client.1.smithi187.stdout:1/150: chown d4/d6/d8/f13 2 1 2024-09-21T00:56:30.272 INFO:tasks.workunit.client.1.smithi187.stdout:1/151: truncate d4/d6/d23/f2b 247106 0 2024-09-21T00:56:30.273 INFO:tasks.workunit.client.1.smithi187.stdout:0/169: rename d0/fb to d0/d17/d1c/d23/f30 0 2024-09-21T00:56:30.273 INFO:tasks.workunit.client.0.smithi112.stdout:3/72: dwrite d2/f6 [0,4194304] 0 2024-09-21T00:56:30.273 INFO:tasks.workunit.client.0.smithi112.stdout:3/73: fdatasync d2/d8/f11 0 2024-09-21T00:56:30.274 INFO:tasks.workunit.client.0.smithi112.stdout:3/74: chown d2/d8/c9 15 1 2024-09-21T00:56:30.279 INFO:tasks.workunit.client.0.smithi112.stdout:3/75: dread d2/f6 [0,4194304] 0 2024-09-21T00:56:30.285 INFO:tasks.workunit.client.1.smithi187.stdout:7/118: truncate d1/f1e 138582 0 2024-09-21T00:56:30.286 INFO:tasks.workunit.client.0.smithi112.stdout:7/84: unlink d0/fe 0 2024-09-21T00:56:30.286 INFO:tasks.workunit.client.1.smithi187.stdout:3/148: dwrite d9/fd [0,4194304] 0 2024-09-21T00:56:30.287 INFO:tasks.workunit.client.1.smithi187.stdout:3/149: fsync d9/d19/f30 0 2024-09-21T00:56:30.287 INFO:tasks.workunit.client.1.smithi187.stdout:8/203: mkdir dc/d1c/d3e 0 2024-09-21T00:56:30.288 INFO:tasks.workunit.client.1.smithi187.stdout:8/204: dread - dc/d1c/f33 zero size 2024-09-21T00:56:30.288 INFO:tasks.workunit.client.1.smithi187.stdout:3/150: write d9/d13/d20/f2e [705631,87202] 0 2024-09-21T00:56:30.289 INFO:tasks.workunit.client.1.smithi187.stdout:6/135: unlink d7/f8 0 2024-09-21T00:56:30.289 INFO:tasks.workunit.client.0.smithi112.stdout:7/85: read d0/fa [952038,28942] 0 2024-09-21T00:56:30.298 INFO:tasks.workunit.client.0.smithi112.stdout:3/76: getdents d2/d8 0 2024-09-21T00:56:30.298 INFO:tasks.workunit.client.0.smithi112.stdout:4/69: dwrite d1/ff [0,4194304] 0 2024-09-21T00:56:30.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/70: read d1/d5/fd [4822595,37992] 0 2024-09-21T00:56:30.300 INFO:tasks.workunit.client.0.smithi112.stdout:3/77: chown d2/d8/l12 91 1 2024-09-21T00:56:30.300 INFO:tasks.workunit.client.1.smithi187.stdout:2/211: getdents d2/d3/d15/d1b/d3c/d40 0 2024-09-21T00:56:30.301 INFO:tasks.workunit.client.1.smithi187.stdout:5/145: getdents d0/d19/d14 0 2024-09-21T00:56:30.303 INFO:tasks.workunit.client.1.smithi187.stdout:2/212: write d2/dc/f46 [778205,35456] 0 2024-09-21T00:56:30.304 INFO:tasks.workunit.client.0.smithi112.stdout:3/78: dread d2/f6 [0,4194304] 0 2024-09-21T00:56:30.304 INFO:tasks.workunit.client.1.smithi187.stdout:7/119: symlink d1/dc/d15/l2e 0 2024-09-21T00:56:30.305 INFO:tasks.workunit.client.1.smithi187.stdout:0/170: dwrite d0/d17/d1c/d23/df/f1d [0,4194304] 0 2024-09-21T00:56:30.305 INFO:tasks.workunit.client.0.smithi112.stdout:4/71: creat d1/d7/f17 x:0 0 0 2024-09-21T00:56:30.306 INFO:tasks.workunit.client.1.smithi187.stdout:7/120: chown d1/d18/f29 46794167 1 2024-09-21T00:56:30.306 INFO:tasks.workunit.client.1.smithi187.stdout:7/121: readlink d1/l23 0 2024-09-21T00:56:30.307 INFO:tasks.workunit.client.1.smithi187.stdout:0/171: write d0/d17/d1c/d23/f19 [5141671,57043] 0 2024-09-21T00:56:30.312 INFO:tasks.workunit.client.0.smithi112.stdout:3/79: rename d2/d8/l12 to d2/d8/dd/de/l14 0 2024-09-21T00:56:30.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/72: symlink d1/d5/l18 0 2024-09-21T00:56:30.317 INFO:tasks.workunit.client.1.smithi187.stdout:6/136: dread d7/dc/fb [0,4194304] 0 2024-09-21T00:56:30.318 INFO:tasks.workunit.client.1.smithi187.stdout:5/146: symlink d0/d19/d14/l37 0 2024-09-21T00:56:30.319 INFO:tasks.workunit.client.1.smithi187.stdout:2/213: symlink d2/d3/d15/d1b/d1c/l4e 0 2024-09-21T00:56:30.319 INFO:tasks.workunit.client.1.smithi187.stdout:1/152: dwrite f3 [0,4194304] 0 2024-09-21T00:56:30.321 INFO:tasks.workunit.client.0.smithi112.stdout:4/73: dwrite d1/d5/f15 [0,4194304] 0 2024-09-21T00:56:30.322 INFO:tasks.workunit.client.1.smithi187.stdout:4/163: dwrite d2/d3/da/d2f/d32/d24/f2e [0,4194304] 0 2024-09-21T00:56:30.322 INFO:tasks.workunit.client.1.smithi187.stdout:0/172: symlink d0/d17/l31 0 2024-09-21T00:56:30.324 INFO:tasks.workunit.client.1.smithi187.stdout:8/205: mknod dc/d2f/c3f 0 2024-09-21T00:56:30.325 INFO:tasks.workunit.client.0.smithi112.stdout:4/74: symlink d1/d5/l19 0 2024-09-21T00:56:30.332 INFO:tasks.workunit.client.1.smithi187.stdout:7/122: symlink d1/dc/d15/d2b/l2f 0 2024-09-21T00:56:30.332 INFO:tasks.workunit.client.1.smithi187.stdout:2/214: rmdir d2/dc/d21 39 2024-09-21T00:56:30.333 INFO:tasks.workunit.client.1.smithi187.stdout:7/123: readlink d1/dc/d15/l2e 0 2024-09-21T00:56:30.334 INFO:tasks.workunit.client.0.smithi112.stdout:4/75: dwrite f0 [0,4194304] 0 2024-09-21T00:56:30.336 INFO:tasks.workunit.client.1.smithi187.stdout:4/164: rmdir d2/d3 39 2024-09-21T00:56:30.336 INFO:tasks.workunit.client.1.smithi187.stdout:0/173: creat d0/d17/d1c/d23/df/f32 x:0 0 0 2024-09-21T00:56:30.336 INFO:tasks.workunit.client.1.smithi187.stdout:3/151: link d9/d19/c1b d9/d13/c36 0 2024-09-21T00:56:30.337 INFO:tasks.workunit.client.1.smithi187.stdout:2/215: creat d2/d25/f4f x:0 0 0 2024-09-21T00:56:30.338 INFO:tasks.workunit.client.1.smithi187.stdout:7/124: dread d1/f1c [0,4194304] 0 2024-09-21T00:56:30.340 INFO:tasks.workunit.client.0.smithi112.stdout:7/86: truncate d0/f10 3170844 0 2024-09-21T00:56:30.340 INFO:tasks.workunit.client.1.smithi187.stdout:4/165: write d2/d3/da/d2f/d32/d22/f23 [5313056,42555] 0 2024-09-21T00:56:30.342 INFO:tasks.workunit.client.1.smithi187.stdout:8/206: symlink dc/d1c/l40 0 2024-09-21T00:56:30.342 INFO:tasks.workunit.client.1.smithi187.stdout:4/166: readlink d2/d3/da/d2f/d32/d22/l2a 0 2024-09-21T00:56:30.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/76: dread d1/d5/fd [4194304,4194304] 0 2024-09-21T00:56:30.343 INFO:tasks.workunit.client.1.smithi187.stdout:8/207: write dc/d1c/f21 [3867848,99535] 0 2024-09-21T00:56:30.343 INFO:tasks.workunit.client.1.smithi187.stdout:0/174: mkdir d0/d17/d1c/d21/d33 0 2024-09-21T00:56:30.346 INFO:tasks.workunit.client.1.smithi187.stdout:9/324: truncate d4/d8/d46/d54/f55 40573 0 2024-09-21T00:56:30.348 INFO:tasks.workunit.client.1.smithi187.stdout:3/152: creat d9/f37 x:0 0 0 2024-09-21T00:56:30.349 INFO:tasks.workunit.client.0.smithi112.stdout:4/77: mkdir d1/d7/d9/d1a 0 2024-09-21T00:56:30.351 INFO:tasks.workunit.client.1.smithi187.stdout:3/153: dread d9/d13/d20/f2e [0,4194304] 0 2024-09-21T00:56:30.351 INFO:tasks.workunit.client.1.smithi187.stdout:3/154: stat d9/d13/d20/c34 0 2024-09-21T00:56:30.352 INFO:tasks.workunit.client.0.smithi112.stdout:4/78: dread f0 [0,4194304] 0 2024-09-21T00:56:30.352 INFO:tasks.workunit.client.0.smithi112.stdout:7/87: symlink d0/l14 0 2024-09-21T00:56:30.353 INFO:tasks.workunit.client.1.smithi187.stdout:3/155: truncate d9/d19/d1c/f2a 180650 0 2024-09-21T00:56:30.353 INFO:tasks.workunit.client.0.smithi112.stdout:4/79: write d1/ff [4473741,6873] 0 2024-09-21T00:56:30.356 INFO:tasks.workunit.client.1.smithi187.stdout:8/208: fsync dc/f12 0 2024-09-21T00:56:30.358 INFO:tasks.workunit.client.1.smithi187.stdout:8/209: chown dc/c1f 288341583 1 2024-09-21T00:56:30.359 INFO:tasks.workunit.client.1.smithi187.stdout:9/325: rename d4/d13/d3a to d4/d61/d6c 0 2024-09-21T00:56:30.360 INFO:tasks.workunit.client.1.smithi187.stdout:3/156: dwrite d9/d13/f1e [4194304,4194304] 0 2024-09-21T00:56:30.362 INFO:tasks.workunit.client.1.smithi187.stdout:3/157: write d9/d13/f2c [7592194,18520] 0 2024-09-21T00:56:30.363 INFO:tasks.workunit.client.1.smithi187.stdout:0/175: truncate d0/f16 8776940 0 2024-09-21T00:56:30.364 INFO:tasks.workunit.client.1.smithi187.stdout:8/210: creat dc/d2f/f41 x:0 0 0 2024-09-21T00:56:30.365 INFO:tasks.workunit.client.0.smithi112.stdout:3/80: getdents d2/d8/dd/de 0 2024-09-21T00:56:30.365 INFO:tasks.workunit.client.0.smithi112.stdout:3/81: readlink d2/d8/dd/de/l14 0 2024-09-21T00:56:30.367 INFO:tasks.workunit.client.1.smithi187.stdout:8/211: chown dc/d2f/c3f 342526 1 2024-09-21T00:56:30.367 INFO:tasks.workunit.client.1.smithi187.stdout:5/147: mkdir d0/d19/d14/d38 0 2024-09-21T00:56:30.368 INFO:tasks.workunit.client.0.smithi112.stdout:3/82: mknod d2/d8/dd/de/c15 0 2024-09-21T00:56:30.369 INFO:tasks.workunit.client.1.smithi187.stdout:1/153: write d4/d6/d8/f13 [1958405,69681] 0 2024-09-21T00:56:30.371 INFO:tasks.workunit.client.1.smithi187.stdout:6/137: creat d7/dc/f28 x:0 0 0 2024-09-21T00:56:30.373 INFO:tasks.workunit.client.1.smithi187.stdout:9/326: dwrite d4/d61/f68 [0,4194304] 0 2024-09-21T00:56:30.375 INFO:tasks.workunit.client.0.smithi112.stdout:4/80: write d1/d5/fd [4525408,123838] 0 2024-09-21T00:56:30.377 INFO:tasks.workunit.client.1.smithi187.stdout:9/327: chown d4/d61/d6a 1030807315 1 2024-09-21T00:56:30.378 INFO:tasks.workunit.client.0.smithi112.stdout:4/81: fsync f0 0 2024-09-21T00:56:30.379 INFO:tasks.workunit.client.0.smithi112.stdout:3/83: dwrite d2/d8/f11 [0,4194304] 0 2024-09-21T00:56:30.380 INFO:tasks.workunit.client.1.smithi187.stdout:6/138: write d7/f25 [1022201,75885] 0 2024-09-21T00:56:30.380 INFO:tasks.workunit.client.0.smithi112.stdout:4/82: write d1/d7/f17 [114987,92173] 0 2024-09-21T00:56:30.381 INFO:tasks.workunit.client.0.smithi112.stdout:4/83: readlink d1/d5/l6 0 2024-09-21T00:56:30.382 INFO:tasks.workunit.client.0.smithi112.stdout:4/84: read d1/ff [2008559,99231] 0 2024-09-21T00:56:30.382 INFO:tasks.workunit.client.1.smithi187.stdout:0/176: dwrite d0/d17/d1c/d23/df/f32 [0,4194304] 0 2024-09-21T00:56:30.384 INFO:tasks.workunit.client.0.smithi112.stdout:7/88: write d0/fa [403927,9740] 0 2024-09-21T00:56:30.385 INFO:tasks.workunit.client.1.smithi187.stdout:1/154: rename f3 to d4/d6/d8/f31 0 2024-09-21T00:56:30.387 INFO:tasks.workunit.client.1.smithi187.stdout:0/177: read d0/d17/d1c/d23/f19 [3995642,1548] 0 2024-09-21T00:56:30.389 INFO:tasks.workunit.client.1.smithi187.stdout:8/212: link dc/d2f/f41 dc/d2f/d37/f42 0 2024-09-21T00:56:30.391 INFO:tasks.workunit.client.1.smithi187.stdout:9/328: mknod d4/d13/d20/d2b/c6d 0 2024-09-21T00:56:30.392 INFO:tasks.workunit.client.1.smithi187.stdout:0/178: truncate d0/d17/d18/f2c 1419937 0 2024-09-21T00:56:30.394 INFO:tasks.workunit.client.0.smithi112.stdout:7/89: rmdir d0 39 2024-09-21T00:56:30.397 INFO:tasks.workunit.client.1.smithi187.stdout:5/148: dwrite d0/d19/d14/d1b/d27/f35 [0,4194304] 0 2024-09-21T00:56:30.397 INFO:tasks.workunit.client.1.smithi187.stdout:6/139: dwrite d7/dc/f16 [0,4194304] 0 2024-09-21T00:56:30.398 INFO:tasks.workunit.client.0.smithi112.stdout:4/85: unlink d1/ff 0 2024-09-21T00:56:30.400 INFO:tasks.workunit.client.0.smithi112.stdout:4/86: dread d1/d5/fc [0,4194304] 0 2024-09-21T00:56:30.400 INFO:tasks.workunit.client.0.smithi112.stdout:4/87: readlink d1/l2 0 2024-09-21T00:56:30.401 INFO:tasks.workunit.client.1.smithi187.stdout:1/155: symlink d4/d6/l32 0 2024-09-21T00:56:30.401 INFO:tasks.workunit.client.0.smithi112.stdout:3/84: creat d2/d8/f16 x:0 0 0 2024-09-21T00:56:30.405 INFO:tasks.workunit.client.1.smithi187.stdout:7/125: write d1/f1e [607704,109501] 0 2024-09-21T00:56:30.406 INFO:tasks.workunit.client.0.smithi112.stdout:4/88: unlink d1/f8 0 2024-09-21T00:56:30.406 INFO:tasks.workunit.client.1.smithi187.stdout:8/213: mknod dc/d2f/c43 0 2024-09-21T00:56:30.406 INFO:tasks.workunit.client.0.smithi112.stdout:4/89: stat d1/d7/d9/ce 0 2024-09-21T00:56:30.406 INFO:tasks.workunit.client.0.smithi112.stdout:4/90: chown d1/d7/d9/d1a 834 1 2024-09-21T00:56:30.407 INFO:tasks.workunit.client.0.smithi112.stdout:3/85: symlink d2/l17 0 2024-09-21T00:56:30.408 INFO:tasks.workunit.client.1.smithi187.stdout:9/329: mkdir d4/d8/d44/d6e 0 2024-09-21T00:56:30.410 INFO:tasks.workunit.client.1.smithi187.stdout:9/330: truncate d4/d13/d14/d1d/f63 336006 0 2024-09-21T00:56:30.410 INFO:tasks.workunit.client.1.smithi187.stdout:9/331: fdatasync d4/d8/f22 0 2024-09-21T00:56:30.411 INFO:tasks.workunit.client.1.smithi187.stdout:0/179: fdatasync d0/d17/d1c/d23/df/f15 0 2024-09-21T00:56:30.412 INFO:tasks.workunit.client.0.smithi112.stdout:3/86: dread f1 [0,4194304] 0 2024-09-21T00:56:30.412 INFO:tasks.workunit.client.0.smithi112.stdout:3/87: chown d2/l17 110570208 1 2024-09-21T00:56:30.412 INFO:tasks.workunit.client.1.smithi187.stdout:0/180: read d0/f1 [5566296,94901] 0 2024-09-21T00:56:30.413 INFO:tasks.workunit.client.1.smithi187.stdout:0/181: read d0/d17/d18/f2c [848728,42098] 0 2024-09-21T00:56:30.414 INFO:tasks.workunit.client.1.smithi187.stdout:5/149: write d0/d19/d14/f21 [1306436,35238] 0 2024-09-21T00:56:30.414 INFO:tasks.workunit.client.0.smithi112.stdout:4/91: rmdir d1/d5 39 2024-09-21T00:56:30.415 INFO:tasks.workunit.client.1.smithi187.stdout:5/150: truncate d0/dc/f13 100369 0 2024-09-21T00:56:30.416 INFO:tasks.workunit.client.1.smithi187.stdout:6/140: mkdir d7/dc/d29 0 2024-09-21T00:56:30.418 INFO:tasks.workunit.client.0.smithi112.stdout:7/90: symlink d0/d2/l15 0 2024-09-21T00:56:30.419 INFO:tasks.workunit.client.1.smithi187.stdout:1/156: mknod d4/d6/d8/c33 0 2024-09-21T00:56:30.420 INFO:tasks.workunit.client.0.smithi112.stdout:3/88: write f1 [4953361,52124] 0 2024-09-21T00:56:30.422 INFO:tasks.workunit.client.0.smithi112.stdout:4/92: chown d1/d5/f15 87664831 1 2024-09-21T00:56:30.423 INFO:tasks.workunit.client.0.smithi112.stdout:7/91: mknod d0/d2/c16 0 2024-09-21T00:56:30.425 INFO:tasks.workunit.client.1.smithi187.stdout:1/157: dwrite d4/d1b/d22/d2c/f30 [0,4194304] 0 2024-09-21T00:56:30.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/93: symlink d1/d5/l1b 0 2024-09-21T00:56:30.426 INFO:tasks.workunit.client.1.smithi187.stdout:1/158: dread - d4/d6/f29 zero size 2024-09-21T00:56:30.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/94: fdatasync f0 0 2024-09-21T00:56:30.431 INFO:tasks.workunit.client.0.smithi112.stdout:3/89: unlink d2/d8/c9 0 2024-09-21T00:56:30.435 INFO:tasks.workunit.client.0.smithi112.stdout:7/92: mknod d0/d8/c17 0 2024-09-21T00:56:30.436 INFO:tasks.workunit.client.0.smithi112.stdout:3/90: dread - d2/d8/dd/f10 zero size 2024-09-21T00:56:30.437 INFO:tasks.workunit.client.1.smithi187.stdout:5/151: truncate d0/f2 506008 0 2024-09-21T00:56:30.441 INFO:tasks.workunit.client.0.smithi112.stdout:3/91: dwrite f1 [0,4194304] 0 2024-09-21T00:56:30.454 INFO:tasks.workunit.client.1.smithi187.stdout:3/158: sync 2024-09-21T00:56:30.454 INFO:tasks.workunit.client.1.smithi187.stdout:2/216: sync 2024-09-21T00:56:30.454 INFO:tasks.workunit.client.1.smithi187.stdout:4/167: sync 2024-09-21T00:56:30.455 INFO:tasks.workunit.client.1.smithi187.stdout:4/168: chown d2/d3/d17 27177996 1 2024-09-21T00:56:30.459 INFO:tasks.workunit.client.1.smithi187.stdout:3/159: dwrite d9/d19/d1c/f2a [0,4194304] 0 2024-09-21T00:56:30.466 INFO:tasks.workunit.client.0.smithi112.stdout:7/93: symlink d0/d2/l18 0 2024-09-21T00:56:30.470 INFO:tasks.workunit.client.0.smithi112.stdout:3/92: creat d2/d8/dd/de/f18 x:0 0 0 2024-09-21T00:56:30.474 INFO:tasks.workunit.client.0.smithi112.stdout:4/95: mkdir d1/d5/d1c 0 2024-09-21T00:56:30.475 INFO:tasks.workunit.client.1.smithi187.stdout:9/332: write d4/d13/d14/f1e [4358389,88398] 0 2024-09-21T00:56:30.475 INFO:tasks.workunit.client.1.smithi187.stdout:1/159: fdatasync d4/d6/f29 0 2024-09-21T00:56:30.476 INFO:tasks.workunit.client.1.smithi187.stdout:1/160: chown d4/d1b/d22/d2c/f30 1853734 1 2024-09-21T00:56:30.483 INFO:tasks.workunit.client.1.smithi187.stdout:8/214: write dc/f24 [832899,129548] 0 2024-09-21T00:56:30.488 INFO:tasks.workunit.client.1.smithi187.stdout:2/217: fdatasync d2/d3/d15/d1b/d1c/f32 0 2024-09-21T00:56:30.491 INFO:tasks.workunit.client.1.smithi187.stdout:4/169: creat d2/d3/f33 x:0 0 0 2024-09-21T00:56:30.494 INFO:tasks.workunit.client.1.smithi187.stdout:3/160: unlink d9/ff 0 2024-09-21T00:56:30.495 INFO:tasks.workunit.client.0.smithi112.stdout:4/96: dread f0 [0,4194304] 0 2024-09-21T00:56:30.496 INFO:tasks.workunit.client.0.smithi112.stdout:7/94: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:30.496 INFO:tasks.workunit.client.1.smithi187.stdout:0/182: dwrite d0/f16 [0,4194304] 0 2024-09-21T00:56:30.497 INFO:tasks.workunit.client.1.smithi187.stdout:0/183: write d0/f16 [5912168,5087] 0 2024-09-21T00:56:30.498 INFO:tasks.workunit.client.1.smithi187.stdout:6/141: unlink d7/d1c/f27 0 2024-09-21T00:56:30.503 INFO:tasks.workunit.client.1.smithi187.stdout:7/126: rename d1/dc/d15/d2b/l2f to d1/l30 0 2024-09-21T00:56:30.504 INFO:tasks.workunit.client.0.smithi112.stdout:7/95: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:30.505 INFO:tasks.workunit.client.0.smithi112.stdout:7/96: write d0/f10 [3673428,84215] 0 2024-09-21T00:56:30.509 INFO:tasks.workunit.client.1.smithi187.stdout:5/152: chown d0/d19/d14/d1b/f1c 5178 1 2024-09-21T00:56:30.510 INFO:tasks.workunit.client.1.smithi187.stdout:5/153: chown d0/d19/d14/d1b/d27/c2e 812 1 2024-09-21T00:56:30.511 INFO:tasks.workunit.client.1.smithi187.stdout:2/218: creat d2/d25/f50 x:0 0 0 2024-09-21T00:56:30.518 INFO:tasks.workunit.client.1.smithi187.stdout:6/142: unlink d7/dc/f16 0 2024-09-21T00:56:30.519 INFO:tasks.workunit.client.1.smithi187.stdout:9/333: rename d4 to d4/d6f 22 2024-09-21T00:56:30.520 INFO:tasks.workunit.client.1.smithi187.stdout:2/219: dwrite d2/d25/f50 [0,4194304] 0 2024-09-21T00:56:30.522 INFO:tasks.workunit.client.1.smithi187.stdout:7/127: mkdir d1/d18/d31 0 2024-09-21T00:56:30.522 INFO:tasks.workunit.client.1.smithi187.stdout:1/161: creat d4/d1b/d2f/f34 x:0 0 0 2024-09-21T00:56:30.523 INFO:tasks.workunit.client.1.smithi187.stdout:5/154: mkdir d0/dc/d39 0 2024-09-21T00:56:30.523 INFO:tasks.workunit.client.1.smithi187.stdout:1/162: readlink d4/d6/l32 0 2024-09-21T00:56:30.525 INFO:tasks.workunit.client.1.smithi187.stdout:3/161: link d9/f37 d9/d19/d1c/f38 0 2024-09-21T00:56:30.526 INFO:tasks.workunit.client.1.smithi187.stdout:3/162: fdatasync d9/d19/f30 0 2024-09-21T00:56:30.528 INFO:tasks.workunit.client.1.smithi187.stdout:0/184: mknod d0/d17/d1c/d21/d33/c34 0 2024-09-21T00:56:30.530 INFO:tasks.workunit.client.1.smithi187.stdout:6/143: read - d7/d24/f1e zero size 2024-09-21T00:56:30.532 INFO:tasks.workunit.client.1.smithi187.stdout:1/163: dwrite d4/d6/f1c [0,4194304] 0 2024-09-21T00:56:30.534 INFO:tasks.workunit.client.1.smithi187.stdout:5/155: mkdir d0/d19/d14/d1b/d27/d3a 0 2024-09-21T00:56:30.534 INFO:tasks.workunit.client.1.smithi187.stdout:1/164: dread d4/f27 [0,4194304] 0 2024-09-21T00:56:30.535 INFO:tasks.workunit.client.1.smithi187.stdout:3/163: mknod d9/c39 0 2024-09-21T00:56:30.536 INFO:tasks.workunit.client.1.smithi187.stdout:9/334: symlink d4/d13/d14/d5d/l70 0 2024-09-21T00:56:30.536 INFO:tasks.workunit.client.1.smithi187.stdout:9/335: chown c2 457 1 2024-09-21T00:56:30.538 INFO:tasks.workunit.client.1.smithi187.stdout:7/128: creat d1/d18/d31/f32 x:0 0 0 2024-09-21T00:56:30.542 INFO:tasks.workunit.client.1.smithi187.stdout:7/129: dread d1/f17 [0,4194304] 0 2024-09-21T00:56:30.544 INFO:tasks.workunit.client.1.smithi187.stdout:0/185: rename d0/d17/d1c/d23/df/f1d to d0/d17/f35 0 2024-09-21T00:56:30.546 INFO:tasks.workunit.client.1.smithi187.stdout:4/170: link d2/d3/da/d2f/d32/d24/c2c d2/c34 0 2024-09-21T00:56:30.547 INFO:tasks.workunit.client.1.smithi187.stdout:0/186: dread d0/d17/d1c/d23/df/f15 [0,4194304] 0 2024-09-21T00:56:30.549 INFO:tasks.workunit.client.1.smithi187.stdout:3/164: unlink d9/d13/c14 0 2024-09-21T00:56:30.553 INFO:tasks.workunit.client.1.smithi187.stdout:3/165: dread d9/fd [0,4194304] 0 2024-09-21T00:56:30.559 INFO:tasks.workunit.client.1.smithi187.stdout:9/336: dread d4/d13/f2d [0,4194304] 0 2024-09-21T00:56:30.561 INFO:tasks.workunit.client.1.smithi187.stdout:0/187: mkdir d0/d17/d1c/d23/d36 0 2024-09-21T00:56:30.563 INFO:tasks.workunit.client.1.smithi187.stdout:1/165: rename d4/d1b to d4/d6/d8/d35 0 2024-09-21T00:56:30.566 INFO:tasks.workunit.client.1.smithi187.stdout:1/166: dread d4/d6/d8/f31 [0,4194304] 0 2024-09-21T00:56:30.567 INFO:tasks.workunit.client.1.smithi187.stdout:1/167: dread d4/d6/d23/f2b [0,4194304] 0 2024-09-21T00:56:30.571 INFO:tasks.workunit.client.1.smithi187.stdout:0/188: creat d0/d17/f37 x:0 0 0 2024-09-21T00:56:30.576 INFO:tasks.workunit.client.1.smithi187.stdout:1/168: unlink d4/d6/d8/d35/d2f/f34 0 2024-09-21T00:56:30.577 INFO:tasks.workunit.client.1.smithi187.stdout:1/169: chown d4/d6/d23/c2d 110932 1 2024-09-21T00:56:30.578 INFO:tasks.workunit.client.1.smithi187.stdout:9/337: mkdir d4/d13/d20/d2c/d71 0 2024-09-21T00:56:30.582 INFO:tasks.workunit.client.1.smithi187.stdout:0/189: rename d0/d17/d1c/d23/df/f25 to d0/d17/d1c/d23/d36/f38 0 2024-09-21T00:56:30.585 INFO:tasks.workunit.client.1.smithi187.stdout:2/220: truncate d2/d25/f50 1044452 0 2024-09-21T00:56:30.585 INFO:tasks.workunit.client.1.smithi187.stdout:3/166: link d9/d13/d20/c34 d9/d13/c3a 0 2024-09-21T00:56:30.586 INFO:tasks.workunit.client.1.smithi187.stdout:2/221: write d2/d25/f4f [117719,11211] 0 2024-09-21T00:56:30.586 INFO:tasks.workunit.client.1.smithi187.stdout:3/167: fsync d9/d19/d1c/f2a 0 2024-09-21T00:56:30.594 INFO:tasks.workunit.client.1.smithi187.stdout:5/156: write d0/d19/f23 [955926,100300] 0 2024-09-21T00:56:30.594 INFO:tasks.workunit.client.1.smithi187.stdout:5/157: chown d0/f2 699 1 2024-09-21T00:56:30.596 INFO:tasks.workunit.client.1.smithi187.stdout:0/190: dread d0/d17/d1c/d23/f28 [0,4194304] 0 2024-09-21T00:56:30.598 INFO:tasks.workunit.client.1.smithi187.stdout:2/222: mkdir d2/dc/d2e/d51 0 2024-09-21T00:56:30.600 INFO:tasks.workunit.client.1.smithi187.stdout:1/170: mknod d4/c36 0 2024-09-21T00:56:30.602 INFO:tasks.workunit.client.1.smithi187.stdout:6/144: dwrite d7/f14 [0,4194304] 0 2024-09-21T00:56:30.605 INFO:tasks.workunit.client.1.smithi187.stdout:5/158: creat d0/d19/d30/f3b x:0 0 0 2024-09-21T00:56:30.606 INFO:tasks.workunit.client.1.smithi187.stdout:5/159: read d0/d19/f15 [380200,103187] 0 2024-09-21T00:56:30.608 INFO:tasks.workunit.client.1.smithi187.stdout:0/191: fdatasync d0/d17/d1c/d21/f2f 0 2024-09-21T00:56:30.608 INFO:tasks.workunit.client.1.smithi187.stdout:6/145: dread d7/f25 [0,4194304] 0 2024-09-21T00:56:30.613 INFO:tasks.workunit.client.1.smithi187.stdout:3/168: chown d9/d13/d20/c34 322 1 2024-09-21T00:56:30.616 INFO:tasks.workunit.client.1.smithi187.stdout:3/169: chown d9/f37 15380 1 2024-09-21T00:56:30.616 INFO:tasks.workunit.client.1.smithi187.stdout:5/160: dwrite d0/d19/d30/f3b [0,4194304] 0 2024-09-21T00:56:30.617 INFO:tasks.workunit.client.1.smithi187.stdout:9/338: rmdir d4/d13/d20/d2c/d71 0 2024-09-21T00:56:30.620 INFO:tasks.workunit.client.1.smithi187.stdout:8/215: sync 2024-09-21T00:56:30.620 INFO:tasks.workunit.client.1.smithi187.stdout:0/192: unlink d0/f1 0 2024-09-21T00:56:30.621 INFO:tasks.workunit.client.1.smithi187.stdout:6/146: dwrite d7/d1c/f20 [0,4194304] 0 2024-09-21T00:56:30.626 INFO:tasks.workunit.client.1.smithi187.stdout:4/171: dwrite d2/d3/da/fc [0,4194304] 0 2024-09-21T00:56:30.633 INFO:tasks.workunit.client.1.smithi187.stdout:3/170: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:30.634 INFO:tasks.workunit.client.1.smithi187.stdout:2/223: fsync d2/d25/f50 0 2024-09-21T00:56:30.634 INFO:tasks.workunit.client.1.smithi187.stdout:1/171: dwrite d4/d6/d8/f31 [0,4194304] 0 2024-09-21T00:56:30.639 INFO:tasks.workunit.client.1.smithi187.stdout:9/339: mkdir d4/d13/d14/d28/d72 0 2024-09-21T00:56:30.639 INFO:tasks.workunit.client.1.smithi187.stdout:2/224: dread d2/d25/f44 [0,4194304] 0 2024-09-21T00:56:30.640 INFO:tasks.workunit.client.1.smithi187.stdout:2/225: readlink d2/d3/d15/l38 0 2024-09-21T00:56:30.647 INFO:tasks.workunit.client.1.smithi187.stdout:0/193: mknod d0/d17/d1c/d21/d33/c39 0 2024-09-21T00:56:30.647 INFO:tasks.workunit.client.1.smithi187.stdout:4/172: rmdir d2/d3/d17 39 2024-09-21T00:56:30.648 INFO:tasks.workunit.client.1.smithi187.stdout:8/216: mkdir dc/d44 0 2024-09-21T00:56:30.651 INFO:tasks.workunit.client.1.smithi187.stdout:0/194: dread d0/f16 [0,4194304] 0 2024-09-21T00:56:30.655 INFO:tasks.workunit.client.1.smithi187.stdout:1/172: dread d4/d6/d23/f2b [0,4194304] 0 2024-09-21T00:56:30.656 INFO:tasks.workunit.client.1.smithi187.stdout:9/340: mknod d4/d8/d46/c73 0 2024-09-21T00:56:30.658 INFO:tasks.workunit.client.1.smithi187.stdout:1/173: dread d4/f14 [0,4194304] 0 2024-09-21T00:56:30.659 INFO:tasks.workunit.client.1.smithi187.stdout:1/174: chown d4/d6/d8/f31 499445251 1 2024-09-21T00:56:30.660 INFO:tasks.workunit.client.1.smithi187.stdout:4/173: chown d2/d3/d17 1897 1 2024-09-21T00:56:30.668 INFO:tasks.workunit.client.1.smithi187.stdout:1/175: creat d4/d6/d8/f37 x:0 0 0 2024-09-21T00:56:30.672 INFO:tasks.workunit.client.1.smithi187.stdout:9/341: creat d4/d13/d20/d2b/d66/f74 x:0 0 0 2024-09-21T00:56:30.675 INFO:tasks.workunit.client.1.smithi187.stdout:7/130: sync 2024-09-21T00:56:30.675 INFO:tasks.workunit.client.1.smithi187.stdout:7/131: truncate d1/dc/d15/d22/f24 934126 0 2024-09-21T00:56:30.677 INFO:tasks.workunit.client.1.smithi187.stdout:9/342: mknod d4/d8/d41/c75 0 2024-09-21T00:56:30.679 INFO:tasks.workunit.client.1.smithi187.stdout:4/174: creat d2/d3/f35 x:0 0 0 2024-09-21T00:56:30.682 INFO:tasks.workunit.client.1.smithi187.stdout:5/161: write d0/f9 [3792004,59024] 0 2024-09-21T00:56:30.683 INFO:tasks.workunit.client.1.smithi187.stdout:4/175: dread d2/d3/f21 [0,4194304] 0 2024-09-21T00:56:30.683 INFO:tasks.workunit.client.1.smithi187.stdout:9/343: rename d4/d61/f57 to d4/d10/d43/f76 0 2024-09-21T00:56:30.684 INFO:tasks.workunit.client.1.smithi187.stdout:5/162: write d0/d19/d14/d1b/f24 [498685,120991] 0 2024-09-21T00:56:30.687 INFO:tasks.workunit.client.1.smithi187.stdout:8/217: getdents dc 0 2024-09-21T00:56:30.687 INFO:tasks.workunit.client.1.smithi187.stdout:8/218: dread - dc/f28 zero size 2024-09-21T00:56:30.688 INFO:tasks.workunit.client.1.smithi187.stdout:8/219: fsync dc/d1c/f21 0 2024-09-21T00:56:30.688 INFO:tasks.workunit.client.1.smithi187.stdout:8/220: chown dc/d2f/d37/f42 51531 1 2024-09-21T00:56:30.693 INFO:tasks.workunit.client.1.smithi187.stdout:2/226: write d2/f8 [962231,99077] 0 2024-09-21T00:56:30.699 INFO:tasks.workunit.client.1.smithi187.stdout:8/221: creat dc/d2f/f45 x:0 0 0 2024-09-21T00:56:30.701 INFO:tasks.workunit.client.1.smithi187.stdout:3/171: truncate d9/fb 7453662 0 2024-09-21T00:56:30.706 INFO:tasks.workunit.client.1.smithi187.stdout:8/222: symlink dc/d2f/d34/l46 0 2024-09-21T00:56:30.708 INFO:tasks.workunit.client.1.smithi187.stdout:4/176: creat d2/d3/f36 x:0 0 0 2024-09-21T00:56:30.709 INFO:tasks.workunit.client.1.smithi187.stdout:3/172: stat d9/d19/d1c/l26 0 2024-09-21T00:56:30.710 INFO:tasks.workunit.client.1.smithi187.stdout:3/173: write d9/f12 [2534270,55649] 0 2024-09-21T00:56:30.711 INFO:tasks.workunit.client.1.smithi187.stdout:3/174: dread - d9/d19/d1c/f31 zero size 2024-09-21T00:56:30.712 INFO:tasks.workunit.client.1.smithi187.stdout:9/344: rmdir d4/d13/d20/d2c 0 2024-09-21T00:56:30.712 INFO:tasks.workunit.client.1.smithi187.stdout:1/176: write d4/d6/f1c [4970704,76661] 0 2024-09-21T00:56:30.714 INFO:tasks.workunit.client.1.smithi187.stdout:8/223: creat dc/f47 x:0 0 0 2024-09-21T00:56:30.716 INFO:tasks.workunit.client.1.smithi187.stdout:4/177: dread d2/d3/da/d2f/d32/d22/f23 [4194304,4194304] 0 2024-09-21T00:56:30.717 INFO:tasks.workunit.client.1.smithi187.stdout:4/178: dread - d2/d3/f33 zero size 2024-09-21T00:56:30.718 INFO:tasks.workunit.client.1.smithi187.stdout:9/345: dwrite d4/d61/f68 [0,4194304] 0 2024-09-21T00:56:30.719 INFO:tasks.workunit.client.1.smithi187.stdout:3/175: creat d9/d19/f3b x:0 0 0 2024-09-21T00:56:30.723 INFO:tasks.workunit.client.1.smithi187.stdout:1/177: readlink d4/l9 0 2024-09-21T00:56:30.726 INFO:tasks.workunit.client.1.smithi187.stdout:7/132: dwrite d1/f9 [0,4194304] 0 2024-09-21T00:56:30.730 INFO:tasks.workunit.client.1.smithi187.stdout:4/179: mkdir d2/d3/da/d2f/d32/d22/d37 0 2024-09-21T00:56:30.731 INFO:tasks.workunit.client.1.smithi187.stdout:4/180: write d2/d3/da/d2f/d32/d24/f28 [321192,29041] 0 2024-09-21T00:56:30.733 INFO:tasks.workunit.client.1.smithi187.stdout:5/163: write d0/f2 [266514,71462] 0 2024-09-21T00:56:30.734 INFO:tasks.workunit.client.1.smithi187.stdout:3/176: creat d9/d13/d20/f3c x:0 0 0 2024-09-21T00:56:30.737 INFO:tasks.workunit.client.1.smithi187.stdout:8/224: creat dc/d1c/d29/f48 x:0 0 0 2024-09-21T00:56:30.739 INFO:tasks.workunit.client.1.smithi187.stdout:7/133: mkdir d1/d18/d31/d33 0 2024-09-21T00:56:30.740 INFO:tasks.workunit.client.1.smithi187.stdout:7/134: rename d1/dc to d1/dc/d15/d34 22 2024-09-21T00:56:30.743 INFO:tasks.workunit.client.1.smithi187.stdout:9/346: truncate d4/d8/d46/d54/f55 1049846 0 2024-09-21T00:56:30.744 INFO:tasks.workunit.client.1.smithi187.stdout:9/347: readlink d4/d13/l17 0 2024-09-21T00:56:30.745 INFO:tasks.workunit.client.1.smithi187.stdout:5/164: creat d0/d19/d30/f3c x:0 0 0 2024-09-21T00:56:30.746 INFO:tasks.workunit.client.1.smithi187.stdout:3/177: creat d9/d13/f3d x:0 0 0 2024-09-21T00:56:30.747 INFO:tasks.workunit.client.1.smithi187.stdout:4/181: dwrite d2/d3/da/d2f/d32/d22/f23 [4194304,4194304] 0 2024-09-21T00:56:30.751 INFO:tasks.workunit.client.1.smithi187.stdout:7/135: unlink d1/f11 0 2024-09-21T00:56:30.756 INFO:tasks.workunit.client.1.smithi187.stdout:3/178: rmdir d9/d19/d1c 39 2024-09-21T00:56:30.757 INFO:tasks.workunit.client.1.smithi187.stdout:9/348: dread d4/d13/d20/f26 [0,4194304] 0 2024-09-21T00:56:30.761 INFO:tasks.workunit.client.1.smithi187.stdout:7/136: creat d1/d18/f35 x:0 0 0 2024-09-21T00:56:30.763 INFO:tasks.workunit.client.1.smithi187.stdout:1/178: write d4/f27 [658875,76567] 0 2024-09-21T00:56:30.767 INFO:tasks.workunit.client.1.smithi187.stdout:4/182: creat d2/d3/da/d2f/d32/d22/d37/f38 x:0 0 0 2024-09-21T00:56:30.768 INFO:tasks.workunit.client.1.smithi187.stdout:9/349: symlink d4/d13/d14/d5d/l77 0 2024-09-21T00:56:30.770 INFO:tasks.workunit.client.1.smithi187.stdout:8/225: creat dc/f49 x:0 0 0 2024-09-21T00:56:30.772 INFO:tasks.workunit.client.1.smithi187.stdout:7/137: unlink d1/dc/d15/d22/f27 0 2024-09-21T00:56:30.773 INFO:tasks.workunit.client.1.smithi187.stdout:7/138: stat d1/dc/d15/d2b 0 2024-09-21T00:56:30.774 INFO:tasks.workunit.client.1.smithi187.stdout:9/350: dwrite d4/d13/d14/d1d/f63 [0,4194304] 0 2024-09-21T00:56:30.775 INFO:tasks.workunit.client.1.smithi187.stdout:1/179: creat d4/d6/d8/d35/f38 x:0 0 0 2024-09-21T00:56:30.775 INFO:tasks.workunit.client.1.smithi187.stdout:1/180: write d4/d6/d8/f37 [507978,15843] 0 2024-09-21T00:56:30.776 INFO:tasks.workunit.client.1.smithi187.stdout:1/181: chown d4/d6 3 1 2024-09-21T00:56:30.776 INFO:tasks.workunit.client.1.smithi187.stdout:6/147: sync 2024-09-21T00:56:30.777 INFO:tasks.workunit.client.1.smithi187.stdout:3/179: creat d9/d19/d1c/f3e x:0 0 0 2024-09-21T00:56:30.777 INFO:tasks.workunit.client.1.smithi187.stdout:1/182: truncate d4/d6/f29 584182 0 2024-09-21T00:56:30.778 INFO:tasks.workunit.client.1.smithi187.stdout:1/183: chown d4/d6/d23/c2d 223121946 1 2024-09-21T00:56:30.781 INFO:tasks.workunit.client.1.smithi187.stdout:6/148: dread d7/f14 [0,4194304] 0 2024-09-21T00:56:30.785 INFO:tasks.workunit.client.1.smithi187.stdout:5/165: write d0/f7 [971388,19903] 0 2024-09-21T00:56:30.788 INFO:tasks.workunit.client.1.smithi187.stdout:7/139: creat d1/d18/d31/f36 x:0 0 0 2024-09-21T00:56:30.793 INFO:tasks.workunit.client.1.smithi187.stdout:7/140: dwrite d1/dc/f12 [4194304,4194304] 0 2024-09-21T00:56:30.797 INFO:tasks.workunit.client.1.smithi187.stdout:7/141: dread d1/f1a [0,4194304] 0 2024-09-21T00:56:30.797 INFO:tasks.workunit.client.1.smithi187.stdout:4/183: write d2/d3/f21 [3127507,25266] 0 2024-09-21T00:56:30.801 INFO:tasks.workunit.client.1.smithi187.stdout:4/184: truncate d2/d3/da/d2f/d32/d22/d37/f38 855556 0 2024-09-21T00:56:30.804 INFO:tasks.workunit.client.1.smithi187.stdout:7/142: dwrite d1/f26 [0,4194304] 0 2024-09-21T00:56:30.814 INFO:tasks.workunit.client.1.smithi187.stdout:1/184: rmdir d4/d6/d8/d35/d2f 0 2024-09-21T00:56:30.815 INFO:tasks.workunit.client.1.smithi187.stdout:4/185: rmdir d2/d3/da/d2f/d32/d22/d37 39 2024-09-21T00:56:30.816 INFO:tasks.workunit.client.1.smithi187.stdout:4/186: rename d2 to d2/d3/da/d2f/d32/d39 22 2024-09-21T00:56:30.819 INFO:tasks.workunit.client.1.smithi187.stdout:8/226: link dc/d2f/d34/l46 dc/d2f/l4a 0 2024-09-21T00:56:30.821 INFO:tasks.workunit.client.1.smithi187.stdout:9/351: getdents d4/d13/d20/d2b 0 2024-09-21T00:56:30.822 INFO:tasks.workunit.client.1.smithi187.stdout:9/352: fdatasync d4/d13/d14/f1e 0 2024-09-21T00:56:30.823 INFO:tasks.workunit.client.1.smithi187.stdout:1/185: symlink d4/d6/d8/d35/l39 0 2024-09-21T00:56:30.824 INFO:tasks.workunit.client.1.smithi187.stdout:6/149: dwrite d7/f22 [0,4194304] 0 2024-09-21T00:56:30.825 INFO:tasks.workunit.client.1.smithi187.stdout:4/187: chown d2/d3/da/d2f/d32/d24/c2c 5591668 1 2024-09-21T00:56:30.825 INFO:tasks.workunit.client.1.smithi187.stdout:4/188: fsync d2/d3/f13 0 2024-09-21T00:56:30.827 INFO:tasks.workunit.client.1.smithi187.stdout:8/227: mkdir dc/d2f/d34/d4b 0 2024-09-21T00:56:30.829 INFO:tasks.workunit.client.1.smithi187.stdout:8/228: write dc/f49 [452892,96889] 0 2024-09-21T00:56:30.830 INFO:tasks.workunit.client.1.smithi187.stdout:9/353: creat d4/d13/d14/d1d/d5f/f78 x:0 0 0 2024-09-21T00:56:30.831 INFO:tasks.workunit.client.1.smithi187.stdout:6/150: dwrite d7/d24/f1d [0,4194304] 0 2024-09-21T00:56:30.839 INFO:tasks.workunit.client.1.smithi187.stdout:8/229: creat dc/d1c/d29/f4c x:0 0 0 2024-09-21T00:56:30.840 INFO:tasks.workunit.client.1.smithi187.stdout:9/354: creat d4/d13/d14/d5d/f79 x:0 0 0 2024-09-21T00:56:30.841 INFO:tasks.workunit.client.1.smithi187.stdout:9/355: write d4/f3b [259446,84988] 0 2024-09-21T00:56:30.842 INFO:tasks.workunit.client.1.smithi187.stdout:1/186: fdatasync d4/f17 0 2024-09-21T00:56:30.843 INFO:tasks.workunit.client.1.smithi187.stdout:1/187: stat d4/d6/f1c 0 2024-09-21T00:56:30.844 INFO:tasks.workunit.client.1.smithi187.stdout:6/151: fsync d7/d1c/f20 0 2024-09-21T00:56:30.845 INFO:tasks.workunit.client.1.smithi187.stdout:6/152: write d7/dc/f13 [3572296,130266] 0 2024-09-21T00:56:30.845 INFO:tasks.workunit.client.1.smithi187.stdout:6/153: stat f1 0 2024-09-21T00:56:30.846 INFO:tasks.workunit.client.1.smithi187.stdout:6/154: read d7/f22 [1001939,108082] 0 2024-09-21T00:56:30.847 INFO:tasks.workunit.client.1.smithi187.stdout:6/155: chown d7/dc/f28 1794538 1 2024-09-21T00:56:30.856 INFO:tasks.workunit.client.1.smithi187.stdout:7/143: link d1/f7 d1/f37 0 2024-09-21T00:56:30.860 INFO:tasks.workunit.client.1.smithi187.stdout:0/195: sync 2024-09-21T00:56:30.861 INFO:tasks.workunit.client.1.smithi187.stdout:9/356: mknod d4/d8/d44/d6e/c7a 0 2024-09-21T00:56:30.862 INFO:tasks.workunit.client.1.smithi187.stdout:1/188: mknod d4/d6/d23/d2e/c3a 0 2024-09-21T00:56:30.865 INFO:tasks.workunit.client.1.smithi187.stdout:9/357: dread d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:30.867 INFO:tasks.workunit.client.1.smithi187.stdout:4/189: getdents d2/d3/da/d2f/d32/d22 0 2024-09-21T00:56:30.867 INFO:tasks.workunit.client.1.smithi187.stdout:1/189: dwrite d4/f7 [0,4194304] 0 2024-09-21T00:56:30.870 INFO:tasks.workunit.client.1.smithi187.stdout:8/230: link dc/f15 dc/d2f/d34/f4d 0 2024-09-21T00:56:30.872 INFO:tasks.workunit.client.1.smithi187.stdout:0/196: mkdir d0/d17/d18/d3a 0 2024-09-21T00:56:30.873 INFO:tasks.workunit.client.1.smithi187.stdout:4/190: dwrite d2/d3/da/d2f/f30 [0,4194304] 0 2024-09-21T00:56:30.878 INFO:tasks.workunit.client.1.smithi187.stdout:9/358: creat d4/d13/d20/d2b/f7b x:0 0 0 2024-09-21T00:56:30.878 INFO:tasks.workunit.client.1.smithi187.stdout:4/191: dread d2/d3/da/fc [0,4194304] 0 2024-09-21T00:56:30.880 INFO:tasks.workunit.client.1.smithi187.stdout:4/192: fdatasync d2/d3/da/d2f/d32/d22/f23 0 2024-09-21T00:56:30.882 INFO:tasks.workunit.client.1.smithi187.stdout:0/197: truncate d0/f16 8849595 0 2024-09-21T00:56:30.884 INFO:tasks.workunit.client.1.smithi187.stdout:4/193: dread d2/d3/da/d2f/d32/d24/f28 [0,4194304] 0 2024-09-21T00:56:30.884 INFO:tasks.workunit.client.1.smithi187.stdout:7/144: truncate d1/f7 439385 0 2024-09-21T00:56:30.885 INFO:tasks.workunit.client.1.smithi187.stdout:1/190: unlink d4/d6/c12 0 2024-09-21T00:56:30.889 INFO:tasks.workunit.client.1.smithi187.stdout:6/156: dwrite d7/f25 [0,4194304] 0 2024-09-21T00:56:30.890 INFO:tasks.workunit.client.1.smithi187.stdout:4/194: dread d2/d3/da/d2f/d32/d22/d37/f38 [0,4194304] 0 2024-09-21T00:56:30.890 INFO:tasks.workunit.client.1.smithi187.stdout:6/157: fdatasync f1 0 2024-09-21T00:56:30.893 INFO:tasks.workunit.client.1.smithi187.stdout:0/198: dread d0/d17/d1c/d23/df/f32 [0,4194304] 0 2024-09-21T00:56:30.893 INFO:tasks.workunit.client.1.smithi187.stdout:6/158: dread - d7/dc/f10 zero size 2024-09-21T00:56:30.900 INFO:tasks.workunit.client.1.smithi187.stdout:6/159: dwrite d7/dc/f28 [0,4194304] 0 2024-09-21T00:56:30.900 INFO:tasks.workunit.client.1.smithi187.stdout:6/160: readlink d7/dc/l15 0 2024-09-21T00:56:30.901 INFO:tasks.workunit.client.1.smithi187.stdout:6/161: chown d7/dc/d29 32 1 2024-09-21T00:56:30.906 INFO:tasks.workunit.client.1.smithi187.stdout:4/195: rename d2/d3/d17 to d2/d3/da/d2f/d32/d22/d37/d3a 0 2024-09-21T00:56:30.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:30 smithi187 ceph-mon[34997]: pgmap v18: 65 pgs: 65 active+clean; 263 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 175 KiB/s rd, 10 MiB/s wr, 313 op/s 2024-09-21T00:56:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:30 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:30.909 INFO:tasks.workunit.client.1.smithi187.stdout:7/145: rename d1/l23 to d1/l38 0 2024-09-21T00:56:30.911 INFO:tasks.workunit.client.1.smithi187.stdout:1/191: link d4/d6/l32 d4/d6/d8/l3b 0 2024-09-21T00:56:30.912 INFO:tasks.workunit.client.1.smithi187.stdout:4/196: dwrite d2/d3/da/d2f/d32/d25/f2d [4194304,4194304] 0 2024-09-21T00:56:30.918 INFO:tasks.workunit.client.1.smithi187.stdout:9/359: truncate d4/d8/f38 188746 0 2024-09-21T00:56:30.921 INFO:tasks.workunit.client.1.smithi187.stdout:4/197: unlink d2/d3/da/d16/l1a 0 2024-09-21T00:56:30.928 INFO:tasks.workunit.client.1.smithi187.stdout:6/162: rename d7/dc to d7/d2a 0 2024-09-21T00:56:30.929 INFO:tasks.workunit.client.1.smithi187.stdout:9/360: write d4/d13/d20/f26 [123943,51400] 0 2024-09-21T00:56:30.932 INFO:tasks.workunit.client.1.smithi187.stdout:0/199: getdents d0/d17/d1c/d23/df 0 2024-09-21T00:56:30.935 INFO:tasks.workunit.client.1.smithi187.stdout:1/192: rename d4/f17 to d4/f3c 0 2024-09-21T00:56:30.938 INFO:tasks.workunit.client.1.smithi187.stdout:4/198: mkdir d2/d3/d3b 0 2024-09-21T00:56:30.939 INFO:tasks.workunit.client.1.smithi187.stdout:7/146: dread d1/f14 [0,4194304] 0 2024-09-21T00:56:30.939 INFO:tasks.workunit.client.1.smithi187.stdout:0/200: fdatasync d0/d17/f35 0 2024-09-21T00:56:30.940 INFO:tasks.workunit.client.1.smithi187.stdout:0/201: fdatasync d0/d17/d1c/d23/f30 0 2024-09-21T00:56:30.941 INFO:tasks.workunit.client.1.smithi187.stdout:1/193: creat d4/d6/d23/f3d x:0 0 0 2024-09-21T00:56:30.944 INFO:tasks.workunit.client.1.smithi187.stdout:2/227: sync 2024-09-21T00:56:30.944 INFO:tasks.workunit.client.1.smithi187.stdout:3/180: sync 2024-09-21T00:56:30.945 INFO:tasks.workunit.client.1.smithi187.stdout:2/228: readlink d2/d3/l2f 0 2024-09-21T00:56:30.945 INFO:tasks.workunit.client.1.smithi187.stdout:4/199: dwrite d2/d3/da/f1f [0,4194304] 0 2024-09-21T00:56:30.947 INFO:tasks.workunit.client.1.smithi187.stdout:0/202: mkdir d0/d17/d1c/d21/d33/d3b 0 2024-09-21T00:56:30.949 INFO:tasks.workunit.client.1.smithi187.stdout:1/194: mknod d4/d6/d8/c3e 0 2024-09-21T00:56:30.951 INFO:tasks.workunit.client.1.smithi187.stdout:3/181: mknod d9/c3f 0 2024-09-21T00:56:30.953 INFO:tasks.workunit.client.1.smithi187.stdout:3/182: dread - d9/d19/d1c/f38 zero size 2024-09-21T00:56:30.953 INFO:tasks.workunit.client.1.smithi187.stdout:4/200: dwrite d2/d3/f21 [0,4194304] 0 2024-09-21T00:56:30.955 INFO:tasks.workunit.client.1.smithi187.stdout:3/183: write d9/d13/f15 [526980,68644] 0 2024-09-21T00:56:30.958 INFO:tasks.workunit.client.1.smithi187.stdout:2/229: mkdir d2/dc/d17/d52 0 2024-09-21T00:56:30.960 INFO:tasks.workunit.client.1.smithi187.stdout:0/203: mknod d0/d17/d1c/d21/d33/c3c 0 2024-09-21T00:56:30.962 INFO:tasks.workunit.client.1.smithi187.stdout:1/195: rename d4/d6/ff to d4/d6/d23/d2e/f3f 0 2024-09-21T00:56:30.963 INFO:tasks.workunit.client.1.smithi187.stdout:4/201: dwrite d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:30.971 INFO:tasks.workunit.client.1.smithi187.stdout:5/166: sync 2024-09-21T00:56:30.971 INFO:tasks.workunit.client.1.smithi187.stdout:1/196: dwrite d4/d6/d23/f3d [0,4194304] 0 2024-09-21T00:56:30.973 INFO:tasks.workunit.client.1.smithi187.stdout:5/167: write d0/dc/f11 [53309,130505] 0 2024-09-21T00:56:30.977 INFO:tasks.workunit.client.1.smithi187.stdout:5/168: truncate d0/d19/f32 350467 0 2024-09-21T00:56:30.978 INFO:tasks.workunit.client.1.smithi187.stdout:2/230: symlink d2/d3/d15/d1b/d1c/l53 0 2024-09-21T00:56:30.981 INFO:tasks.workunit.client.1.smithi187.stdout:6/163: chown d7/f25 11 1 2024-09-21T00:56:30.982 INFO:tasks.workunit.client.1.smithi187.stdout:9/361: dwrite d4/d61/d6c/f56 [0,4194304] 0 2024-09-21T00:56:30.984 INFO:tasks.workunit.client.1.smithi187.stdout:3/184: dread d9/d13/f2c [0,4194304] 0 2024-09-21T00:56:30.984 INFO:tasks.workunit.client.1.smithi187.stdout:9/362: write d4/f3b [79555,51] 0 2024-09-21T00:56:30.984 INFO:tasks.workunit.client.1.smithi187.stdout:1/197: mknod d4/d6/d23/c40 0 2024-09-21T00:56:30.993 INFO:tasks.workunit.client.1.smithi187.stdout:2/231: creat d2/d3/d15/d1b/d1c/f54 x:0 0 0 2024-09-21T00:56:30.996 INFO:tasks.workunit.client.1.smithi187.stdout:3/185: creat d9/d13/d20/f40 x:0 0 0 2024-09-21T00:56:30.997 INFO:tasks.workunit.client.1.smithi187.stdout:3/186: stat d9/c3f 0 2024-09-21T00:56:31.000 INFO:tasks.workunit.client.1.smithi187.stdout:7/147: read d1/f7 [348963,6042] 0 2024-09-21T00:56:31.001 INFO:tasks.workunit.client.1.smithi187.stdout:7/148: dread - d1/d18/f1d zero size 2024-09-21T00:56:31.001 INFO:tasks.workunit.client.1.smithi187.stdout:9/363: creat d4/d8/d46/d54/f7c x:0 0 0 2024-09-21T00:56:31.002 INFO:tasks.workunit.client.1.smithi187.stdout:9/364: truncate d4/d8/d44/f51 329012 0 2024-09-21T00:56:31.003 INFO:tasks.workunit.client.1.smithi187.stdout:0/204: link d0/d17/d1c/d21/d33/c3c d0/d17/d1c/d21/d33/c3d 0 2024-09-21T00:56:31.007 INFO:tasks.workunit.client.1.smithi187.stdout:9/365: dwrite d4/d13/d14/d1d/f63 [0,4194304] 0 2024-09-21T00:56:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:30 smithi112 ceph-mon[28078]: pgmap v18: 65 pgs: 65 active+clean; 263 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 175 KiB/s rd, 10 MiB/s wr, 313 op/s 2024-09-21T00:56:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:30 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:31.022 INFO:tasks.workunit.client.0.smithi112.stdout:3/93: mknod d2/d8/c19 0 2024-09-21T00:56:31.023 INFO:tasks.workunit.client.1.smithi187.stdout:3/187: truncate f2 2873068 0 2024-09-21T00:56:31.024 INFO:tasks.workunit.client.1.smithi187.stdout:3/188: chown d9/d13/d20/f3c 30 1 2024-09-21T00:56:31.027 INFO:tasks.workunit.client.1.smithi187.stdout:7/149: unlink d1/f26 0 2024-09-21T00:56:31.029 INFO:tasks.workunit.client.1.smithi187.stdout:5/169: creat d0/d19/d14/f3d x:0 0 0 2024-09-21T00:56:31.029 INFO:tasks.workunit.client.1.smithi187.stdout:3/189: dwrite d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:31.030 INFO:tasks.workunit.client.0.smithi112.stdout:3/94: mknod d2/c1a 0 2024-09-21T00:56:31.030 INFO:tasks.workunit.client.0.smithi112.stdout:3/95: stat d2/d8/dd/f10 0 2024-09-21T00:56:31.031 INFO:tasks.workunit.client.1.smithi187.stdout:5/170: read d0/d19/d14/d1b/f24 [150229,126633] 0 2024-09-21T00:56:31.031 INFO:tasks.workunit.client.0.smithi112.stdout:3/96: chown d2/l7 12 1 2024-09-21T00:56:31.033 INFO:tasks.workunit.client.1.smithi187.stdout:0/205: rename d0/d17/f37 to d0/d17/d1c/d23/d36/f3e 0 2024-09-21T00:56:31.036 INFO:tasks.workunit.client.1.smithi187.stdout:5/171: dread d0/d19/f15 [0,4194304] 0 2024-09-21T00:56:31.037 INFO:tasks.workunit.client.1.smithi187.stdout:1/198: write d4/d6/d23/f2b [902833,35907] 0 2024-09-21T00:56:31.038 INFO:tasks.workunit.client.0.smithi112.stdout:4/97: truncate d1/d5/fd 6129007 0 2024-09-21T00:56:31.038 INFO:tasks.workunit.client.1.smithi187.stdout:5/172: write d0/d19/f23 [661456,86812] 0 2024-09-21T00:56:31.038 INFO:tasks.workunit.client.0.smithi112.stdout:4/98: chown d1/d5/d1c 19553 1 2024-09-21T00:56:31.039 INFO:tasks.workunit.client.1.smithi187.stdout:1/199: write d4/d6/f29 [1462204,36571] 0 2024-09-21T00:56:31.040 INFO:tasks.workunit.client.0.smithi112.stdout:7/97: creat d0/f19 x:0 0 0 2024-09-21T00:56:31.043 INFO:tasks.workunit.client.0.smithi112.stdout:3/97: dwrite d2/d8/f11 [0,4194304] 0 2024-09-21T00:56:31.045 INFO:tasks.workunit.client.1.smithi187.stdout:5/173: dwrite d0/d19/f23 [0,4194304] 0 2024-09-21T00:56:31.046 INFO:tasks.workunit.client.1.smithi187.stdout:5/174: read d0/f2 [156654,48402] 0 2024-09-21T00:56:31.046 INFO:tasks.workunit.client.1.smithi187.stdout:5/175: chown d0/f2d 43849916 1 2024-09-21T00:56:31.047 INFO:tasks.workunit.client.0.smithi112.stdout:7/98: unlink d0/d2/c16 0 2024-09-21T00:56:31.047 INFO:tasks.workunit.client.0.smithi112.stdout:7/99: stat d0/fa 0 2024-09-21T00:56:31.048 INFO:tasks.workunit.client.0.smithi112.stdout:7/100: write d0/fa [581207,28283] 0 2024-09-21T00:56:31.049 INFO:tasks.workunit.client.1.smithi187.stdout:7/150: creat d1/d18/d31/f39 x:0 0 0 2024-09-21T00:56:31.051 INFO:tasks.workunit.client.0.smithi112.stdout:3/98: symlink d2/l1b 0 2024-09-21T00:56:31.053 INFO:tasks.workunit.client.1.smithi187.stdout:3/190: fsync d9/f11 0 2024-09-21T00:56:31.053 INFO:tasks.workunit.client.0.smithi112.stdout:3/99: chown d2/d8/dd/de 300 1 2024-09-21T00:56:31.057 INFO:tasks.workunit.client.1.smithi187.stdout:5/176: dread d0/f7 [0,4194304] 0 2024-09-21T00:56:31.058 INFO:tasks.workunit.client.0.smithi112.stdout:7/101: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:31.058 INFO:tasks.workunit.client.1.smithi187.stdout:5/177: dread d0/f7 [0,4194304] 0 2024-09-21T00:56:31.059 INFO:tasks.workunit.client.1.smithi187.stdout:5/178: fsync d0/d19/d14/f3d 0 2024-09-21T00:56:31.059 INFO:tasks.workunit.client.0.smithi112.stdout:7/102: chown d0/fa 232147856 1 2024-09-21T00:56:31.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/100: dwrite d2/d8/dd/de/f18 [0,4194304] 0 2024-09-21T00:56:31.064 INFO:tasks.workunit.client.1.smithi187.stdout:0/206: creat d0/d17/d1c/d23/d36/f3f x:0 0 0 2024-09-21T00:56:31.065 INFO:tasks.workunit.client.0.smithi112.stdout:3/101: write d2/d8/dd/de/f18 [414891,108061] 0 2024-09-21T00:56:31.067 INFO:tasks.workunit.client.1.smithi187.stdout:9/366: link d4/d8/f22 d4/d13/d20/d2b/d66/f7d 0 2024-09-21T00:56:31.068 INFO:tasks.workunit.client.0.smithi112.stdout:7/103: mkdir d0/d8/d1a 0 2024-09-21T00:56:31.069 INFO:tasks.workunit.client.1.smithi187.stdout:8/231: sync 2024-09-21T00:56:31.071 INFO:tasks.workunit.client.0.smithi112.stdout:4/99: rename d1/l16 to d1/l1d 0 2024-09-21T00:56:31.073 INFO:tasks.workunit.client.1.smithi187.stdout:2/232: rmdir d2/d3/d15/d1b/d47 0 2024-09-21T00:56:31.073 INFO:tasks.workunit.client.1.smithi187.stdout:2/233: stat d2/dc/d17 0 2024-09-21T00:56:31.075 INFO:tasks.workunit.client.0.smithi112.stdout:3/102: creat d2/d8/dd/de/f1c x:0 0 0 2024-09-21T00:56:31.076 INFO:tasks.workunit.client.0.smithi112.stdout:3/103: chown d2/d8/dd/de/l14 729931 1 2024-09-21T00:56:31.078 INFO:tasks.workunit.client.0.smithi112.stdout:7/104: rename d0/d2/l12 to d0/d8/l1b 0 2024-09-21T00:56:31.079 INFO:tasks.workunit.client.1.smithi187.stdout:1/200: creat d4/d6/f41 x:0 0 0 2024-09-21T00:56:31.079 INFO:tasks.workunit.client.1.smithi187.stdout:1/201: read - d4/d6/f41 zero size 2024-09-21T00:56:31.082 INFO:tasks.workunit.client.0.smithi112.stdout:3/104: creat d2/d8/dd/de/f1d x:0 0 0 2024-09-21T00:56:31.083 INFO:tasks.workunit.client.1.smithi187.stdout:1/202: dread d4/d6/f29 [0,4194304] 0 2024-09-21T00:56:31.084 INFO:tasks.workunit.client.1.smithi187.stdout:1/203: chown d4/d6/c1e 477533 1 2024-09-21T00:56:31.084 INFO:tasks.workunit.client.0.smithi112.stdout:7/105: rename d0/d2/l18 to d0/d2/l1c 0 2024-09-21T00:56:31.084 INFO:tasks.workunit.client.0.smithi112.stdout:7/106: dread - d0/f19 zero size 2024-09-21T00:56:31.085 INFO:tasks.workunit.client.1.smithi187.stdout:7/151: truncate d1/f1a 111874 0 2024-09-21T00:56:31.086 INFO:tasks.workunit.client.1.smithi187.stdout:4/202: sync 2024-09-21T00:56:31.086 INFO:tasks.workunit.client.0.smithi112.stdout:4/100: mkdir d1/d5/d1c/d1e 0 2024-09-21T00:56:31.091 INFO:tasks.workunit.client.0.smithi112.stdout:3/105: symlink d2/l1e 0 2024-09-21T00:56:31.092 INFO:tasks.workunit.client.0.smithi112.stdout:7/107: creat d0/d2/f1d x:0 0 0 2024-09-21T00:56:31.095 INFO:tasks.workunit.client.1.smithi187.stdout:0/207: chown d0/d17/d1c/d21/d33/c3d 41501 1 2024-09-21T00:56:31.096 INFO:tasks.workunit.client.0.smithi112.stdout:3/106: rename d2/f6 to d2/d8/dd/f1f 0 2024-09-21T00:56:31.097 INFO:tasks.workunit.client.0.smithi112.stdout:3/107: fsync d2/d8/dd/de/f1c 0 2024-09-21T00:56:31.098 INFO:tasks.workunit.client.0.smithi112.stdout:3/108: chown d2/d8/f16 953502653 1 2024-09-21T00:56:31.098 INFO:tasks.workunit.client.1.smithi187.stdout:0/208: dread d0/d17/d1c/d23/f28 [0,4194304] 0 2024-09-21T00:56:31.098 INFO:tasks.workunit.client.0.smithi112.stdout:4/101: symlink d1/d5/d1c/d1e/l1f 0 2024-09-21T00:56:31.098 INFO:tasks.workunit.client.0.smithi112.stdout:4/102: write f0 [4420248,4367] 0 2024-09-21T00:56:31.103 INFO:tasks.workunit.client.0.smithi112.stdout:4/103: creat d1/d5/d1c/d1e/f20 x:0 0 0 2024-09-21T00:56:31.103 INFO:tasks.workunit.client.1.smithi187.stdout:2/234: write d2/dc/d21/f36 [4091099,24389] 0 2024-09-21T00:56:31.105 INFO:tasks.workunit.client.1.smithi187.stdout:2/235: write d2/d3/d15/d1b/d1c/f1f [370830,32857] 0 2024-09-21T00:56:31.106 INFO:tasks.workunit.client.0.smithi112.stdout:3/109: rename d2/d8/lb to d2/l20 0 2024-09-21T00:56:31.106 INFO:tasks.workunit.client.1.smithi187.stdout:6/164: link d7/d24/c1f d7/c2b 0 2024-09-21T00:56:31.106 INFO:tasks.workunit.client.0.smithi112.stdout:3/110: dread - d2/d8/f16 zero size 2024-09-21T00:56:31.107 INFO:tasks.workunit.client.1.smithi187.stdout:3/191: dwrite d9/d19/d1c/f38 [0,4194304] 0 2024-09-21T00:56:31.109 INFO:tasks.workunit.client.1.smithi187.stdout:1/204: rmdir d4/d6/d23/d2e 39 2024-09-21T00:56:31.112 INFO:tasks.workunit.client.1.smithi187.stdout:7/152: creat d1/d18/d31/f3a x:0 0 0 2024-09-21T00:56:31.115 INFO:tasks.workunit.client.0.smithi112.stdout:3/111: dwrite d2/d8/dd/de/f18 [0,4194304] 0 2024-09-21T00:56:31.116 INFO:tasks.workunit.client.1.smithi187.stdout:4/203: dread d2/d3/f2b [0,4194304] 0 2024-09-21T00:56:31.116 INFO:tasks.workunit.client.0.smithi112.stdout:3/112: chown d2/l1b 6746 1 2024-09-21T00:56:31.118 INFO:tasks.workunit.client.1.smithi187.stdout:5/179: symlink d0/d19/d14/d1b/d27/d3a/l3e 0 2024-09-21T00:56:31.121 INFO:tasks.workunit.client.1.smithi187.stdout:0/209: fdatasync d0/f11 0 2024-09-21T00:56:31.122 INFO:tasks.workunit.client.0.smithi112.stdout:3/113: write f1 [227023,101645] 0 2024-09-21T00:56:31.123 INFO:tasks.workunit.client.1.smithi187.stdout:8/232: symlink dc/l4e 0 2024-09-21T00:56:31.124 INFO:tasks.workunit.client.0.smithi112.stdout:3/114: chown d2/l1e 1394196714 1 2024-09-21T00:56:31.125 INFO:tasks.workunit.client.0.smithi112.stdout:3/115: write d2/d8/dd/de/f1d [85640,4145] 0 2024-09-21T00:56:31.127 INFO:tasks.workunit.client.0.smithi112.stdout:3/116: write d2/d8/dd/de/f1c [322662,39577] 0 2024-09-21T00:56:31.129 INFO:tasks.workunit.client.1.smithi187.stdout:3/192: rename d9/d13/d20/f40 to d9/d19/d1c/f41 0 2024-09-21T00:56:31.130 INFO:tasks.workunit.client.1.smithi187.stdout:3/193: write d9/f12 [2145455,22511] 0 2024-09-21T00:56:31.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/104: dwrite d1/d5/fd [0,4194304] 0 2024-09-21T00:56:31.131 INFO:tasks.workunit.client.1.smithi187.stdout:9/367: write d4/d8/d46/d54/f55 [725430,39363] 0 2024-09-21T00:56:31.133 INFO:tasks.workunit.client.0.smithi112.stdout:3/117: dread d2/d8/f11 [0,4194304] 0 2024-09-21T00:56:31.136 INFO:tasks.workunit.client.1.smithi187.stdout:4/204: creat d2/d3/da/d16/f3c x:0 0 0 2024-09-21T00:56:31.138 INFO:tasks.workunit.client.1.smithi187.stdout:4/205: truncate d2/d3/f35 355401 0 2024-09-21T00:56:31.138 INFO:tasks.workunit.client.1.smithi187.stdout:8/233: mknod dc/d2f/d37/c4f 0 2024-09-21T00:56:31.139 INFO:tasks.workunit.client.0.smithi112.stdout:4/105: rename d1/d7/d9/ce to d1/d5/c21 0 2024-09-21T00:56:31.140 INFO:tasks.workunit.client.1.smithi187.stdout:2/236: fdatasync d2/d25/d34/f20 0 2024-09-21T00:56:31.141 INFO:tasks.workunit.client.0.smithi112.stdout:4/106: mkdir d1/d7/d9/d1a/d22 0 2024-09-21T00:56:31.142 INFO:tasks.workunit.client.1.smithi187.stdout:1/205: write d4/d6/d23/d2e/f3f [3191441,89605] 0 2024-09-21T00:56:31.143 INFO:tasks.workunit.client.1.smithi187.stdout:7/153: mkdir d1/d18/d31/d33/d3b 0 2024-09-21T00:56:31.144 INFO:tasks.workunit.client.1.smithi187.stdout:0/210: dread d0/f11 [0,4194304] 0 2024-09-21T00:56:31.145 INFO:tasks.workunit.client.0.smithi112.stdout:4/107: symlink d1/d7/d9/d1a/l23 0 2024-09-21T00:56:31.146 INFO:tasks.workunit.client.0.smithi112.stdout:4/108: truncate d1/d7/f17 773260 0 2024-09-21T00:56:31.148 INFO:tasks.workunit.client.1.smithi187.stdout:6/165: creat d7/f2c x:0 0 0 2024-09-21T00:56:31.149 INFO:tasks.workunit.client.1.smithi187.stdout:4/206: fdatasync d2/d3/da/d2f/d32/d22/d37/f38 0 2024-09-21T00:56:31.149 INFO:tasks.workunit.client.1.smithi187.stdout:1/206: dwrite d4/f27 [0,4194304] 0 2024-09-21T00:56:31.150 INFO:tasks.workunit.client.0.smithi112.stdout:4/109: write d1/d5/fc [1362694,104646] 0 2024-09-21T00:56:31.151 INFO:tasks.workunit.client.1.smithi187.stdout:4/207: chown d2/d3/da/d2f/d32/d24 3046 1 2024-09-21T00:56:31.152 INFO:tasks.workunit.client.1.smithi187.stdout:1/207: write d4/d6/d23/f2b [1002777,67275] 0 2024-09-21T00:56:31.152 INFO:tasks.workunit.client.1.smithi187.stdout:3/194: mkdir d9/d19/d42 0 2024-09-21T00:56:31.153 INFO:tasks.workunit.client.0.smithi112.stdout:3/118: dwrite d2/f5 [0,4194304] 0 2024-09-21T00:56:31.154 INFO:tasks.workunit.client.1.smithi187.stdout:9/368: mknod d4/d10/d39/d69/c7e 0 2024-09-21T00:56:31.158 INFO:tasks.workunit.client.1.smithi187.stdout:7/154: mknod d1/dc/d15/d2b/c3c 0 2024-09-21T00:56:31.160 INFO:tasks.workunit.client.0.smithi112.stdout:3/119: dread d2/d8/dd/de/f1c [0,4194304] 0 2024-09-21T00:56:31.161 INFO:tasks.workunit.client.1.smithi187.stdout:5/180: link d0/d19/d14/f21 d0/f3f 0 2024-09-21T00:56:31.161 INFO:tasks.workunit.client.1.smithi187.stdout:1/208: dwrite d4/d6/d23/f3d [4194304,4194304] 0 2024-09-21T00:56:31.161 INFO:tasks.workunit.client.0.smithi112.stdout:3/120: fdatasync d2/d8/dd/de/f1d 0 2024-09-21T00:56:31.162 INFO:tasks.workunit.client.0.smithi112.stdout:3/121: fsync d2/d8/f16 0 2024-09-21T00:56:31.164 INFO:tasks.workunit.client.0.smithi112.stdout:4/110: getdents d1 0 2024-09-21T00:56:31.165 INFO:tasks.workunit.client.0.smithi112.stdout:3/122: mkdir d2/d8/dd/d21 0 2024-09-21T00:56:31.165 INFO:tasks.workunit.client.1.smithi187.stdout:8/234: symlink dc/l50 0 2024-09-21T00:56:31.169 INFO:tasks.workunit.client.1.smithi187.stdout:1/209: dread d4/d6/d23/f3d [0,4194304] 0 2024-09-21T00:56:31.170 INFO:tasks.workunit.client.0.smithi112.stdout:4/111: dwrite d1/d5/fd [4194304,4194304] 0 2024-09-21T00:56:31.170 INFO:tasks.workunit.client.1.smithi187.stdout:4/208: creat d2/d3/da/d2f/d32/d22/f3d x:0 0 0 2024-09-21T00:56:31.171 INFO:tasks.workunit.client.1.smithi187.stdout:9/369: symlink d4/d10/d39/d69/l7f 0 2024-09-21T00:56:31.173 INFO:tasks.workunit.client.1.smithi187.stdout:3/195: mkdir d9/d19/d43 0 2024-09-21T00:56:31.173 INFO:tasks.workunit.client.1.smithi187.stdout:1/210: truncate d4/d6/f41 684826 0 2024-09-21T00:56:31.175 INFO:tasks.workunit.client.1.smithi187.stdout:8/235: read dc/fe [2758918,9334] 0 2024-09-21T00:56:31.175 INFO:tasks.workunit.client.1.smithi187.stdout:9/370: write d4/f5 [826666,105808] 0 2024-09-21T00:56:31.175 INFO:tasks.workunit.client.1.smithi187.stdout:7/155: link d1/d18/f1d d1/dc/d15/d22/f3d 0 2024-09-21T00:56:31.175 INFO:tasks.workunit.client.1.smithi187.stdout:4/209: write d2/d3/f13 [660115,94892] 0 2024-09-21T00:56:31.176 INFO:tasks.workunit.client.1.smithi187.stdout:5/181: creat d0/d19/d14/d38/f40 x:0 0 0 2024-09-21T00:56:31.178 INFO:tasks.workunit.client.1.smithi187.stdout:8/236: stat dc/d1c/d29 0 2024-09-21T00:56:31.178 INFO:tasks.workunit.client.0.smithi112.stdout:4/112: link d1/d5/c21 d1/d7/d9/d1a/c24 0 2024-09-21T00:56:31.179 INFO:tasks.workunit.client.1.smithi187.stdout:7/156: readlink d1/d18/l1b 0 2024-09-21T00:56:31.182 INFO:tasks.workunit.client.1.smithi187.stdout:0/211: dread d0/d17/f26 [0,4194304] 0 2024-09-21T00:56:31.182 INFO:tasks.workunit.client.1.smithi187.stdout:3/196: read f2 [1039774,45101] 0 2024-09-21T00:56:31.183 INFO:tasks.workunit.client.1.smithi187.stdout:5/182: write d0/dc/f28 [7968,113702] 0 2024-09-21T00:56:31.184 INFO:tasks.workunit.client.1.smithi187.stdout:1/211: symlink d4/d6/d23/l42 0 2024-09-21T00:56:31.185 INFO:tasks.workunit.client.1.smithi187.stdout:6/166: dwrite d7/d2a/f28 [0,4194304] 0 2024-09-21T00:56:31.186 INFO:tasks.workunit.client.1.smithi187.stdout:7/157: mkdir d1/dc/d15/d22/d3e 0 2024-09-21T00:56:31.186 INFO:tasks.workunit.client.0.smithi112.stdout:3/123: fdatasync d2/f5 0 2024-09-21T00:56:31.186 INFO:tasks.workunit.client.1.smithi187.stdout:9/371: write d4/d13/d20/d2b/d66/f74 [474920,76420] 0 2024-09-21T00:56:31.187 INFO:tasks.workunit.client.1.smithi187.stdout:8/237: write dc/d1c/f3d [429834,31143] 0 2024-09-21T00:56:31.190 INFO:tasks.workunit.client.1.smithi187.stdout:0/212: mknod d0/d17/d18/c40 0 2024-09-21T00:56:31.190 INFO:tasks.workunit.client.1.smithi187.stdout:6/167: chown d7/d2a/f10 2 1 2024-09-21T00:56:31.190 INFO:tasks.workunit.client.0.smithi112.stdout:3/124: dread f1 [4194304,4194304] 0 2024-09-21T00:56:31.191 INFO:tasks.workunit.client.0.smithi112.stdout:3/125: chown d2/d8/dd/de/f18 351 1 2024-09-21T00:56:31.194 INFO:tasks.workunit.client.1.smithi187.stdout:5/183: write d0/dc/f25 [3704634,94831] 0 2024-09-21T00:56:31.195 INFO:tasks.workunit.client.1.smithi187.stdout:8/238: fdatasync dc/d1c/f21 0 2024-09-21T00:56:31.196 INFO:tasks.workunit.client.1.smithi187.stdout:0/213: stat d0/d17/l31 0 2024-09-21T00:56:31.196 INFO:tasks.workunit.client.1.smithi187.stdout:4/210: dread d2/d3/da/f1f [4194304,4194304] 0 2024-09-21T00:56:31.197 INFO:tasks.workunit.client.1.smithi187.stdout:7/158: creat d1/d18/d31/d33/d3b/f3f x:0 0 0 2024-09-21T00:56:31.199 INFO:tasks.workunit.client.1.smithi187.stdout:8/239: write dc/d1c/f21 [361615,97546] 0 2024-09-21T00:56:31.200 INFO:tasks.workunit.client.1.smithi187.stdout:5/184: creat d0/dc/d1f/f41 x:0 0 0 2024-09-21T00:56:31.201 INFO:tasks.workunit.client.1.smithi187.stdout:4/211: read d2/d3/da/f1f [3800561,31694] 0 2024-09-21T00:56:31.202 INFO:tasks.workunit.client.1.smithi187.stdout:8/240: chown dc/d1c/c1d 2868050 1 2024-09-21T00:56:31.204 INFO:tasks.workunit.client.1.smithi187.stdout:6/168: rename d7/d1c to d7/d2a/d29/d2d 0 2024-09-21T00:56:31.204 INFO:tasks.workunit.client.1.smithi187.stdout:1/212: dwrite d4/d6/d23/f3d [0,4194304] 0 2024-09-21T00:56:31.208 INFO:tasks.workunit.client.1.smithi187.stdout:9/372: getdents d4/d10/d39/d69 0 2024-09-21T00:56:31.210 INFO:tasks.workunit.client.1.smithi187.stdout:7/159: dread d1/f9 [0,4194304] 0 2024-09-21T00:56:31.210 INFO:tasks.workunit.client.0.smithi112.stdout:4/113: truncate f0 3467513 0 2024-09-21T00:56:31.212 INFO:tasks.workunit.client.1.smithi187.stdout:0/214: rename d0/d17/d1c/d21/d33 to d0/d17/d1c/d23/df/d41 0 2024-09-21T00:56:31.212 INFO:tasks.workunit.client.0.smithi112.stdout:4/114: write d1/d5/d1c/d1e/f20 [650018,69731] 0 2024-09-21T00:56:31.214 INFO:tasks.workunit.client.1.smithi187.stdout:9/373: write d4/d8/d46/d54/f5c [674788,107632] 0 2024-09-21T00:56:31.215 INFO:tasks.workunit.client.0.smithi112.stdout:4/115: dread d1/d5/fc [0,4194304] 0 2024-09-21T00:56:31.215 INFO:tasks.workunit.client.1.smithi187.stdout:4/212: dwrite d2/d3/f36 [0,4194304] 0 2024-09-21T00:56:31.216 INFO:tasks.workunit.client.1.smithi187.stdout:7/160: mknod d1/d18/c40 0 2024-09-21T00:56:31.216 INFO:tasks.workunit.client.0.smithi112.stdout:4/116: chown d1/d5/d1c/d1e/f20 1417 1 2024-09-21T00:56:31.216 INFO:tasks.workunit.client.1.smithi187.stdout:4/213: chown d2 675586 1 2024-09-21T00:56:31.217 INFO:tasks.workunit.client.0.smithi112.stdout:3/126: truncate d2/d8/dd/f1f 1131693 0 2024-09-21T00:56:31.218 INFO:tasks.workunit.client.1.smithi187.stdout:9/374: readlink d4/d13/d14/l36 0 2024-09-21T00:56:31.220 INFO:tasks.workunit.client.1.smithi187.stdout:4/214: read d2/d3/f35 [325616,102038] 0 2024-09-21T00:56:31.221 INFO:tasks.workunit.client.1.smithi187.stdout:1/213: dwrite d4/d6/d23/f3d [4194304,4194304] 0 2024-09-21T00:56:31.221 INFO:tasks.workunit.client.0.smithi112.stdout:4/117: unlink d1/d5/l6 0 2024-09-21T00:56:31.222 INFO:tasks.workunit.client.1.smithi187.stdout:4/215: stat d2/d3/f36 0 2024-09-21T00:56:31.225 INFO:tasks.workunit.client.1.smithi187.stdout:8/241: getdents dc/d2f/d37 0 2024-09-21T00:56:31.225 INFO:tasks.workunit.client.1.smithi187.stdout:3/197: dwrite d9/fd [0,4194304] 0 2024-09-21T00:56:31.227 INFO:tasks.workunit.client.1.smithi187.stdout:8/242: fdatasync dc/d1c/d29/f4c 0 2024-09-21T00:56:31.228 INFO:tasks.workunit.client.1.smithi187.stdout:7/161: unlink d1/dc/d15/l2e 0 2024-09-21T00:56:31.228 INFO:tasks.workunit.client.0.smithi112.stdout:4/118: dwrite d1/d7/f17 [0,4194304] 0 2024-09-21T00:56:31.230 INFO:tasks.workunit.client.0.smithi112.stdout:3/127: creat d2/d8/f22 x:0 0 0 2024-09-21T00:56:31.231 INFO:tasks.workunit.client.1.smithi187.stdout:3/198: write d9/d19/d1c/f21 [417515,77202] 0 2024-09-21T00:56:31.232 INFO:tasks.workunit.client.1.smithi187.stdout:8/243: chown dc/d2f/d37/f42 1835 1 2024-09-21T00:56:31.234 INFO:tasks.workunit.client.0.smithi112.stdout:4/119: mknod d1/d7/d9/d1a/c25 0 2024-09-21T00:56:31.237 INFO:tasks.workunit.client.1.smithi187.stdout:9/375: symlink d4/d10/d24/l80 0 2024-09-21T00:56:31.237 INFO:tasks.workunit.client.1.smithi187.stdout:5/185: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:31.239 INFO:tasks.workunit.client.1.smithi187.stdout:5/186: truncate d0/d19/d14/f3d 660697 0 2024-09-21T00:56:31.240 INFO:tasks.workunit.client.1.smithi187.stdout:6/169: truncate d7/d24/f1d 3737610 0 2024-09-21T00:56:31.241 INFO:tasks.workunit.client.1.smithi187.stdout:6/170: write d7/f2c [202907,2879] 0 2024-09-21T00:56:31.243 INFO:tasks.workunit.client.1.smithi187.stdout:7/162: rmdir d1/d18/d31/d33 39 2024-09-21T00:56:31.244 INFO:tasks.workunit.client.0.smithi112.stdout:3/128: link d2/d8/cc d2/c23 0 2024-09-21T00:56:31.246 INFO:tasks.workunit.client.1.smithi187.stdout:4/216: truncate d2/d3/da/d2f/d32/d22/f3d 1010564 0 2024-09-21T00:56:31.246 INFO:tasks.workunit.client.1.smithi187.stdout:2/237: sync 2024-09-21T00:56:31.247 INFO:tasks.workunit.client.1.smithi187.stdout:9/376: mknod d4/d10/d43/c81 0 2024-09-21T00:56:31.248 INFO:tasks.workunit.client.1.smithi187.stdout:1/214: mkdir d4/d43 0 2024-09-21T00:56:31.249 INFO:tasks.workunit.client.1.smithi187.stdout:6/171: mknod d7/d2a/c2e 0 2024-09-21T00:56:31.249 INFO:tasks.workunit.client.1.smithi187.stdout:3/199: symlink d9/d19/d42/l44 0 2024-09-21T00:56:31.250 INFO:tasks.workunit.client.1.smithi187.stdout:8/244: link dc/d1c/f2d dc/d2f/f51 0 2024-09-21T00:56:31.252 INFO:tasks.workunit.client.1.smithi187.stdout:1/215: chown d4/f27 31072553 1 2024-09-21T00:56:31.253 INFO:tasks.workunit.client.1.smithi187.stdout:5/187: dwrite d0/d19/f10 [0,4194304] 0 2024-09-21T00:56:31.254 INFO:tasks.workunit.client.1.smithi187.stdout:3/200: dread - d9/d13/d20/f3c zero size 2024-09-21T00:56:31.255 INFO:tasks.workunit.client.1.smithi187.stdout:6/172: creat d7/d2a/f2f x:0 0 0 2024-09-21T00:56:31.257 INFO:tasks.workunit.client.1.smithi187.stdout:7/163: dread d1/f37 [0,4194304] 0 2024-09-21T00:56:31.258 INFO:tasks.workunit.client.1.smithi187.stdout:8/245: write dc/d1c/f2e [236433,68901] 0 2024-09-21T00:56:31.261 INFO:tasks.workunit.client.1.smithi187.stdout:3/201: read f3 [338081,94466] 0 2024-09-21T00:56:31.262 INFO:tasks.workunit.client.1.smithi187.stdout:6/173: unlink d7/f25 0 2024-09-21T00:56:31.266 INFO:tasks.workunit.client.1.smithi187.stdout:4/217: dwrite d2/d3/f36 [0,4194304] 0 2024-09-21T00:56:31.268 INFO:tasks.workunit.client.1.smithi187.stdout:3/202: write d9/d13/f1e [4917524,12141] 0 2024-09-21T00:56:31.269 INFO:tasks.workunit.client.1.smithi187.stdout:7/164: mkdir d1/d18/d31/d41 0 2024-09-21T00:56:31.270 INFO:tasks.workunit.client.1.smithi187.stdout:7/165: stat d1/f2 0 2024-09-21T00:56:31.271 INFO:tasks.workunit.client.1.smithi187.stdout:0/215: truncate d0/d17/d18/f24 168768 0 2024-09-21T00:56:31.271 INFO:tasks.workunit.client.1.smithi187.stdout:3/203: read d9/d19/f30 [1846631,50596] 0 2024-09-21T00:56:31.272 INFO:tasks.workunit.client.1.smithi187.stdout:1/216: dwrite d4/d6/d23/f3d [0,4194304] 0 2024-09-21T00:56:31.273 INFO:tasks.workunit.client.0.smithi112.stdout:4/120: rename f0 to d1/d5/d1c/f26 0 2024-09-21T00:56:31.274 INFO:tasks.workunit.client.0.smithi112.stdout:4/121: chown d1/l1d 390880675 1 2024-09-21T00:56:31.275 INFO:tasks.workunit.client.1.smithi187.stdout:1/217: write d4/d6/d8/d35/d22/d2c/f30 [491025,66768] 0 2024-09-21T00:56:31.281 INFO:tasks.workunit.client.1.smithi187.stdout:6/174: rmdir d7/d2a/d26 0 2024-09-21T00:56:31.282 INFO:tasks.workunit.client.0.smithi112.stdout:4/122: fsync d1/d5/f15 0 2024-09-21T00:56:31.283 INFO:tasks.workunit.client.1.smithi187.stdout:7/166: symlink d1/dc/d15/l42 0 2024-09-21T00:56:31.285 INFO:tasks.workunit.client.1.smithi187.stdout:3/204: creat d9/d19/d42/f45 x:0 0 0 2024-09-21T00:56:31.285 INFO:tasks.workunit.client.1.smithi187.stdout:3/205: chown d9/fd 20859 1 2024-09-21T00:56:31.288 INFO:tasks.workunit.client.1.smithi187.stdout:0/216: rename d0/d17/f35 to d0/d17/d1c/d23/df/d41/f42 0 2024-09-21T00:56:31.289 INFO:tasks.workunit.client.0.smithi112.stdout:4/123: symlink d1/d7/d9/l27 0 2024-09-21T00:56:31.290 INFO:tasks.workunit.client.0.smithi112.stdout:3/129: dwrite f1 [0,4194304] 0 2024-09-21T00:56:31.290 INFO:tasks.workunit.client.1.smithi187.stdout:4/218: mknod d2/d3/c3e 0 2024-09-21T00:56:31.290 INFO:tasks.workunit.client.0.smithi112.stdout:4/124: fsync d1/d7/f17 0 2024-09-21T00:56:31.291 INFO:tasks.workunit.client.0.smithi112.stdout:3/130: dread - d2/d8/dd/f10 zero size 2024-09-21T00:56:31.291 INFO:tasks.workunit.client.1.smithi187.stdout:4/219: write d2/ff [3493125,79417] 0 2024-09-21T00:56:31.292 INFO:tasks.workunit.client.0.smithi112.stdout:3/131: chown d2/d8/dd/de/f18 12911355 1 2024-09-21T00:56:31.295 INFO:tasks.workunit.client.1.smithi187.stdout:2/238: dwrite d2/d25/d34/f20 [0,4194304] 0 2024-09-21T00:56:31.296 INFO:tasks.workunit.client.0.smithi112.stdout:4/125: creat d1/d7/f28 x:0 0 0 2024-09-21T00:56:31.297 INFO:tasks.workunit.client.1.smithi187.stdout:1/218: symlink d4/d6/d8/d35/l44 0 2024-09-21T00:56:31.300 INFO:tasks.workunit.client.1.smithi187.stdout:9/377: truncate d4/d13/d14/d1d/f63 3462699 0 2024-09-21T00:56:31.303 INFO:tasks.workunit.client.0.smithi112.stdout:3/132: symlink d2/d8/l24 0 2024-09-21T00:56:31.304 INFO:tasks.workunit.client.1.smithi187.stdout:5/188: dwrite d0/d19/d14/f21 [0,4194304] 0 2024-09-21T00:56:31.304 INFO:tasks.workunit.client.1.smithi187.stdout:7/167: symlink d1/dc/d15/d22/l43 0 2024-09-21T00:56:31.306 INFO:tasks.workunit.client.0.smithi112.stdout:3/133: rmdir d2/d8/dd/de 39 2024-09-21T00:56:31.307 INFO:tasks.workunit.client.1.smithi187.stdout:5/189: write d0/d19/d14/f21 [1607689,63414] 0 2024-09-21T00:56:31.308 INFO:tasks.workunit.client.1.smithi187.stdout:3/206: rename d9/c39 to d9/d19/d42/c46 0 2024-09-21T00:56:31.309 INFO:tasks.workunit.client.1.smithi187.stdout:3/207: read - d9/d13/f3d zero size 2024-09-21T00:56:31.313 INFO:tasks.workunit.client.1.smithi187.stdout:4/220: fdatasync d2/d3/f2b 0 2024-09-21T00:56:31.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/126: getdents d1/d5/d1c/d1e 0 2024-09-21T00:56:31.315 INFO:tasks.workunit.client.1.smithi187.stdout:2/239: symlink d2/dc/d2e/d4a/l55 0 2024-09-21T00:56:31.318 INFO:tasks.workunit.client.1.smithi187.stdout:8/246: link dc/c11 dc/d2f/c52 0 2024-09-21T00:56:31.319 INFO:tasks.workunit.client.1.smithi187.stdout:8/247: write dc/d1c/f2e [435731,86326] 0 2024-09-21T00:56:31.324 INFO:tasks.workunit.client.0.smithi112.stdout:3/134: dwrite d2/d8/dd/de/f1c [0,4194304] 0 2024-09-21T00:56:31.324 INFO:tasks.workunit.client.0.smithi112.stdout:3/135: dread - d2/d8/f22 zero size 2024-09-21T00:56:31.326 INFO:tasks.workunit.client.0.smithi112.stdout:4/127: getdents d1/d7 0 2024-09-21T00:56:31.327 INFO:tasks.workunit.client.1.smithi187.stdout:5/190: mknod d0/d19/d30/c42 0 2024-09-21T00:56:31.330 INFO:tasks.workunit.client.1.smithi187.stdout:0/217: truncate d0/d17/d1c/d23/f30 3534572 0 2024-09-21T00:56:31.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/136: dwrite f1 [0,4194304] 0 2024-09-21T00:56:31.333 INFO:tasks.workunit.client.0.smithi112.stdout:4/128: symlink d1/d5/l29 0 2024-09-21T00:56:31.334 INFO:tasks.workunit.client.0.smithi112.stdout:4/129: write d1/d5/f15 [4553624,491] 0 2024-09-21T00:56:31.339 INFO:tasks.workunit.client.0.smithi112.stdout:4/130: read d1/d5/d1c/f26 [542900,57422] 0 2024-09-21T00:56:31.340 INFO:tasks.workunit.client.1.smithi187.stdout:9/378: write d4/d10/f4a [2603301,130597] 0 2024-09-21T00:56:31.343 INFO:tasks.workunit.client.0.smithi112.stdout:4/131: mknod d1/d7/d9/d1a/c2a 0 2024-09-21T00:56:31.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/132: chown d1/d7/l12 5646801 1 2024-09-21T00:56:31.344 INFO:tasks.workunit.client.1.smithi187.stdout:8/248: unlink c3 0 2024-09-21T00:56:31.344 INFO:tasks.workunit.client.1.smithi187.stdout:8/249: readlink dc/d1c/l40 0 2024-09-21T00:56:31.346 INFO:tasks.workunit.client.1.smithi187.stdout:6/175: fdatasync d7/d24/f1d 0 2024-09-21T00:56:31.346 INFO:tasks.workunit.client.1.smithi187.stdout:6/176: chown d7/d2a/f13 119012 1 2024-09-21T00:56:31.347 INFO:tasks.workunit.client.0.smithi112.stdout:4/133: fdatasync d1/d5/fc 0 2024-09-21T00:56:31.347 INFO:tasks.workunit.client.1.smithi187.stdout:3/208: write d9/f12 [2072129,50989] 0 2024-09-21T00:56:31.347 INFO:tasks.workunit.client.1.smithi187.stdout:6/177: chown d7/d2a/fb 12 1 2024-09-21T00:56:31.348 INFO:tasks.workunit.client.1.smithi187.stdout:3/209: readlink d9/d19/d1c/l26 0 2024-09-21T00:56:31.349 INFO:tasks.workunit.client.1.smithi187.stdout:6/178: write d7/d2a/f2f [953073,6197] 0 2024-09-21T00:56:31.349 INFO:tasks.workunit.client.0.smithi112.stdout:3/137: truncate d2/d8/dd/f1f 1158483 0 2024-09-21T00:56:31.350 INFO:tasks.workunit.client.0.smithi112.stdout:4/134: symlink d1/d7/d9/d1a/l2b 0 2024-09-21T00:56:31.351 INFO:tasks.workunit.client.1.smithi187.stdout:5/191: symlink d0/d19/d14/d1b/d27/d3a/l43 0 2024-09-21T00:56:31.353 INFO:tasks.workunit.client.0.smithi112.stdout:3/138: mkdir d2/d25 0 2024-09-21T00:56:31.354 INFO:tasks.workunit.client.0.smithi112.stdout:3/139: chown d2/l1e 172364 1 2024-09-21T00:56:31.354 INFO:tasks.workunit.client.1.smithi187.stdout:3/210: dwrite d9/f37 [0,4194304] 0 2024-09-21T00:56:31.354 INFO:tasks.workunit.client.0.smithi112.stdout:4/135: dread d1/d5/f15 [0,4194304] 0 2024-09-21T00:56:31.359 INFO:tasks.workunit.client.0.smithi112.stdout:3/140: creat d2/d25/f26 x:0 0 0 2024-09-21T00:56:31.359 INFO:tasks.workunit.client.0.smithi112.stdout:3/141: read - d2/d8/f22 zero size 2024-09-21T00:56:31.359 INFO:tasks.workunit.client.1.smithi187.stdout:2/240: mknod d2/dc/d17/d52/c56 0 2024-09-21T00:56:31.361 INFO:tasks.workunit.client.0.smithi112.stdout:4/136: creat d1/d7/d9/d1a/d22/f2c x:0 0 0 2024-09-21T00:56:31.363 INFO:tasks.workunit.client.1.smithi187.stdout:2/241: dread d2/f8 [0,4194304] 0 2024-09-21T00:56:31.365 INFO:tasks.workunit.client.1.smithi187.stdout:1/219: rmdir d4/d43 0 2024-09-21T00:56:31.366 INFO:tasks.workunit.client.0.smithi112.stdout:4/137: mkdir d1/d2d 0 2024-09-21T00:56:31.367 INFO:tasks.workunit.client.1.smithi187.stdout:9/379: mknod d4/d10/d39/c82 0 2024-09-21T00:56:31.369 INFO:tasks.workunit.client.0.smithi112.stdout:4/138: rename d1/d5/d1c/f26 to d1/d7/f2e 0 2024-09-21T00:56:31.370 INFO:tasks.workunit.client.1.smithi187.stdout:1/220: dwrite d4/f11 [0,4194304] 0 2024-09-21T00:56:31.370 INFO:tasks.workunit.client.1.smithi187.stdout:4/221: truncate d2/d3/da/d2f/d32/d25/f2d 4222041 0 2024-09-21T00:56:31.371 INFO:tasks.workunit.client.1.smithi187.stdout:1/221: chown d4/d6/c1e 0 1 2024-09-21T00:56:31.371 INFO:tasks.workunit.client.0.smithi112.stdout:3/142: creat d2/d8/dd/f27 x:0 0 0 2024-09-21T00:56:31.371 INFO:tasks.workunit.client.1.smithi187.stdout:7/168: link d1/dc/d15/d2b/c3c d1/dc/d15/d22/d3e/c44 0 2024-09-21T00:56:31.372 INFO:tasks.workunit.client.0.smithi112.stdout:3/143: chown d2/l17 1542925838 1 2024-09-21T00:56:31.372 INFO:tasks.workunit.client.1.smithi187.stdout:7/169: dread - d1/f21 zero size 2024-09-21T00:56:31.373 INFO:tasks.workunit.client.0.smithi112.stdout:4/139: rename d1/d7/d9/d1a/c2a to d1/d5/d1c/c2f 0 2024-09-21T00:56:31.375 INFO:tasks.workunit.client.0.smithi112.stdout:4/140: write d1/d7/f17 [4885171,63290] 0 2024-09-21T00:56:31.376 INFO:tasks.workunit.client.0.smithi112.stdout:4/141: stat d1/d5/f15 0 2024-09-21T00:56:31.376 INFO:tasks.workunit.client.1.smithi187.stdout:5/192: mknod d0/d19/d30/c44 0 2024-09-21T00:56:31.378 INFO:tasks.workunit.client.0.smithi112.stdout:4/142: mkdir d1/d7/d30 0 2024-09-21T00:56:31.381 INFO:tasks.workunit.client.1.smithi187.stdout:0/218: link d0/f11 d0/d17/d18/f43 0 2024-09-21T00:56:31.382 INFO:tasks.workunit.client.0.smithi112.stdout:4/143: dread d1/d7/f17 [0,4194304] 0 2024-09-21T00:56:31.383 INFO:tasks.workunit.client.0.smithi112.stdout:4/144: chown d1/d7/d9/d1a/l23 925 1 2024-09-21T00:56:31.385 INFO:tasks.workunit.client.0.smithi112.stdout:4/145: dread d1/d5/fc [0,4194304] 0 2024-09-21T00:56:31.386 INFO:tasks.workunit.client.1.smithi187.stdout:2/242: rename d2/dc/d2e/l3a to d2/d3/d15/l57 0 2024-09-21T00:56:31.388 INFO:tasks.workunit.client.0.smithi112.stdout:3/144: rename d2/d25 to d2/d8/d28 0 2024-09-21T00:56:31.390 INFO:tasks.workunit.client.1.smithi187.stdout:8/250: getdents dc/d2f/d37 0 2024-09-21T00:56:31.391 INFO:tasks.workunit.client.1.smithi187.stdout:8/251: chown dc/d1c/l1a 380068982 1 2024-09-21T00:56:31.391 INFO:tasks.workunit.client.1.smithi187.stdout:8/252: read - dc/d1c/f3b zero size 2024-09-21T00:56:31.392 INFO:tasks.workunit.client.1.smithi187.stdout:8/253: stat dc/d1c 0 2024-09-21T00:56:31.392 INFO:tasks.workunit.client.0.smithi112.stdout:4/146: creat d1/d5/d1c/d1e/f31 x:0 0 0 2024-09-21T00:56:31.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/145: creat d2/f29 x:0 0 0 2024-09-21T00:56:31.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/146: dread - d2/d8/dd/f10 zero size 2024-09-21T00:56:31.397 INFO:tasks.workunit.client.0.smithi112.stdout:3/147: dread - d2/d8/d28/f26 zero size 2024-09-21T00:56:31.397 INFO:tasks.workunit.client.0.smithi112.stdout:3/148: read - d2/d8/f16 zero size 2024-09-21T00:56:31.399 INFO:tasks.workunit.client.0.smithi112.stdout:4/147: truncate d1/d7/f2e 3952559 0 2024-09-21T00:56:31.399 INFO:tasks.workunit.client.0.smithi112.stdout:4/148: fsync d1/d5/fc 0 2024-09-21T00:56:31.401 INFO:tasks.workunit.client.0.smithi112.stdout:4/149: mkdir d1/d5/d1c/d1e/d32 0 2024-09-21T00:56:31.404 INFO:tasks.workunit.client.0.smithi112.stdout:4/150: symlink d1/d7/d9/d1a/l33 0 2024-09-21T00:56:31.406 INFO:tasks.workunit.client.1.smithi187.stdout:9/380: mkdir d4/d13/d14/d83 0 2024-09-21T00:56:31.407 INFO:tasks.workunit.client.1.smithi187.stdout:4/222: mknod d2/d3/da/d2f/d32/d25/c3f 0 2024-09-21T00:56:31.407 INFO:tasks.workunit.client.1.smithi187.stdout:8/254: truncate f0 4424864 0 2024-09-21T00:56:31.408 INFO:tasks.workunit.client.1.smithi187.stdout:0/219: symlink d0/d17/d1c/d23/df/d41/l44 0 2024-09-21T00:56:31.408 INFO:tasks.workunit.client.1.smithi187.stdout:5/193: rename d0/d19/d14/d1b/d27/l29 to d0/d19/l45 0 2024-09-21T00:56:31.408 INFO:tasks.workunit.client.1.smithi187.stdout:2/243: mknod d2/dc/d17/c58 0 2024-09-21T00:56:31.409 INFO:tasks.workunit.client.0.smithi112.stdout:4/151: mkdir d1/d2d/d34 0 2024-09-21T00:56:31.409 INFO:tasks.workunit.client.1.smithi187.stdout:7/170: creat d1/d18/d31/d41/f45 x:0 0 0 2024-09-21T00:56:31.413 INFO:tasks.workunit.client.1.smithi187.stdout:3/211: truncate d9/f37 3761211 0 2024-09-21T00:56:31.413 INFO:tasks.workunit.client.1.smithi187.stdout:0/220: creat d0/d17/d1c/f45 x:0 0 0 2024-09-21T00:56:31.415 INFO:tasks.workunit.client.1.smithi187.stdout:3/212: chown d9/d19/d42 4514 1 2024-09-21T00:56:31.415 INFO:tasks.workunit.client.1.smithi187.stdout:2/244: creat d2/d25/d34/f59 x:0 0 0 2024-09-21T00:56:31.416 INFO:tasks.workunit.client.1.smithi187.stdout:6/179: dwrite d7/d2a/d29/d2d/f20 [4194304,4194304] 0 2024-09-21T00:56:31.416 INFO:tasks.workunit.client.0.smithi112.stdout:4/152: link d1/d5/d1c/d1e/l1f d1/d5/d1c/d1e/l35 0 2024-09-21T00:56:31.418 INFO:tasks.workunit.client.1.smithi187.stdout:5/194: mkdir d0/dc/d39/d46 0 2024-09-21T00:56:31.419 INFO:tasks.workunit.client.1.smithi187.stdout:9/381: dwrite d4/d8/f2f [0,4194304] 0 2024-09-21T00:56:31.420 INFO:tasks.workunit.client.0.smithi112.stdout:4/153: unlink d1/d7/l12 0 2024-09-21T00:56:31.422 INFO:tasks.workunit.client.0.smithi112.stdout:4/154: readlink d1/d5/l11 0 2024-09-21T00:56:31.422 INFO:tasks.workunit.client.0.smithi112.stdout:4/155: dread - d1/d7/f28 zero size 2024-09-21T00:56:31.423 INFO:tasks.workunit.client.1.smithi187.stdout:7/171: dread d1/f9 [0,4194304] 0 2024-09-21T00:56:31.425 INFO:tasks.workunit.client.1.smithi187.stdout:3/213: unlink d9/d19/d1c/l2f 0 2024-09-21T00:56:31.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/156: fsync d1/d5/f15 0 2024-09-21T00:56:31.427 INFO:tasks.workunit.client.1.smithi187.stdout:7/172: write d1/d18/f29 [140161,73927] 0 2024-09-21T00:56:31.427 INFO:tasks.workunit.client.1.smithi187.stdout:5/195: symlink d0/d19/d14/d1b/l47 0 2024-09-21T00:56:31.428 INFO:tasks.workunit.client.1.smithi187.stdout:9/382: mknod d4/d8/c84 0 2024-09-21T00:56:31.429 INFO:tasks.workunit.client.1.smithi187.stdout:0/221: mkdir d0/d17/d1c/d23/df/d41/d3b/d46 0 2024-09-21T00:56:31.429 INFO:tasks.workunit.client.1.smithi187.stdout:6/180: dwrite d7/d24/f1d [4194304,4194304] 0 2024-09-21T00:56:31.432 INFO:tasks.workunit.client.1.smithi187.stdout:2/245: mknod d2/d3/d15/d1b/d3c/d40/c5a 0 2024-09-21T00:56:31.434 INFO:tasks.workunit.client.0.smithi112.stdout:4/157: symlink d1/d7/d30/l36 0 2024-09-21T00:56:31.438 INFO:tasks.workunit.client.1.smithi187.stdout:5/196: creat d0/dc/d1f/f48 x:0 0 0 2024-09-21T00:56:31.438 INFO:tasks.workunit.client.1.smithi187.stdout:8/255: truncate dc/fd 3285092 0 2024-09-21T00:56:31.439 INFO:tasks.workunit.client.1.smithi187.stdout:0/222: dread d0/d17/d1c/d23/f28 [0,4194304] 0 2024-09-21T00:56:31.440 INFO:tasks.workunit.client.0.smithi112.stdout:4/158: unlink d1/d5/fc 0 2024-09-21T00:56:31.440 INFO:tasks.workunit.client.1.smithi187.stdout:6/181: dwrite d7/d24/f1e [0,4194304] 0 2024-09-21T00:56:31.441 INFO:tasks.workunit.client.1.smithi187.stdout:5/197: chown d0/d19/d30/f3b 3 1 2024-09-21T00:56:31.442 INFO:tasks.workunit.client.0.smithi112.stdout:4/159: truncate d1/d5/d1c/d1e/f31 49572 0 2024-09-21T00:56:31.442 INFO:tasks.workunit.client.1.smithi187.stdout:6/182: chown d7/d2a/f10 141828 1 2024-09-21T00:56:31.444 INFO:tasks.workunit.client.1.smithi187.stdout:5/198: write d0/d19/f23 [4014120,68609] 0 2024-09-21T00:56:31.445 INFO:tasks.workunit.client.1.smithi187.stdout:2/246: mknod d2/dc/d21/c5b 0 2024-09-21T00:56:31.448 INFO:tasks.workunit.client.1.smithi187.stdout:7/173: rename d1/dc/f2d to d1/d18/d31/d33/f46 0 2024-09-21T00:56:31.450 INFO:tasks.workunit.client.1.smithi187.stdout:0/223: dwrite d0/d17/d1c/d23/d36/f3f [0,4194304] 0 2024-09-21T00:56:31.457 INFO:tasks.workunit.client.1.smithi187.stdout:2/247: symlink d2/d3/d15/d1b/d3c/d40/l5c 0 2024-09-21T00:56:31.457 INFO:tasks.workunit.client.1.smithi187.stdout:5/199: dwrite d0/dc/d1f/f41 [0,4194304] 0 2024-09-21T00:56:31.458 INFO:tasks.workunit.client.1.smithi187.stdout:7/174: truncate d1/f37 735044 0 2024-09-21T00:56:31.463 INFO:tasks.workunit.client.1.smithi187.stdout:0/224: creat d0/d17/d18/f47 x:0 0 0 2024-09-21T00:56:31.463 INFO:tasks.workunit.client.1.smithi187.stdout:9/383: link d4/d10/d39/c82 d4/d13/d14/c85 0 2024-09-21T00:56:31.463 INFO:tasks.workunit.client.1.smithi187.stdout:7/175: rename d1/dc/d15/d22 to d1/dc/d15/d22/d47 22 2024-09-21T00:56:31.464 INFO:tasks.workunit.client.1.smithi187.stdout:3/214: truncate d9/f12 2267637 0 2024-09-21T00:56:31.464 INFO:tasks.workunit.client.1.smithi187.stdout:7/176: chown d1/d18/d31/f3a 2045594 1 2024-09-21T00:56:31.465 INFO:tasks.workunit.client.1.smithi187.stdout:2/248: mknod d2/d25/c5d 0 2024-09-21T00:56:31.465 INFO:tasks.workunit.client.1.smithi187.stdout:5/200: mknod d0/d19/c49 0 2024-09-21T00:56:31.466 INFO:tasks.workunit.client.1.smithi187.stdout:6/183: creat d7/f30 x:0 0 0 2024-09-21T00:56:31.467 INFO:tasks.workunit.client.1.smithi187.stdout:7/177: write d1/dc/d15/d22/f24 [1213383,17987] 0 2024-09-21T00:56:31.468 INFO:tasks.workunit.client.1.smithi187.stdout:0/225: mknod d0/d17/d18/d3a/c48 0 2024-09-21T00:56:31.468 INFO:tasks.workunit.client.1.smithi187.stdout:6/184: mknod d7/d24/c31 0 2024-09-21T00:56:31.470 INFO:tasks.workunit.client.1.smithi187.stdout:6/185: fsync d7/f2c 0 2024-09-21T00:56:31.471 INFO:tasks.workunit.client.1.smithi187.stdout:0/226: chown d0/d17/d1c/d23 1318324 1 2024-09-21T00:56:31.471 INFO:tasks.workunit.client.1.smithi187.stdout:7/178: write d1/f14 [4923972,87225] 0 2024-09-21T00:56:31.472 INFO:tasks.workunit.client.1.smithi187.stdout:5/201: rename d0/f9 to d0/d19/d14/d1b/d27/f4a 0 2024-09-21T00:56:31.473 INFO:tasks.workunit.client.1.smithi187.stdout:1/222: sync 2024-09-21T00:56:31.474 INFO:tasks.workunit.client.1.smithi187.stdout:3/215: dread d9/d19/d1c/f38 [0,4194304] 0 2024-09-21T00:56:31.475 INFO:tasks.workunit.client.1.smithi187.stdout:3/216: readlink d9/l16 0 2024-09-21T00:56:31.480 INFO:tasks.workunit.client.1.smithi187.stdout:3/217: creat d9/d19/d1c/f47 x:0 0 0 2024-09-21T00:56:31.484 INFO:tasks.workunit.client.1.smithi187.stdout:1/223: dread d4/f14 [0,4194304] 0 2024-09-21T00:56:31.485 INFO:tasks.workunit.client.1.smithi187.stdout:3/218: unlink d9/c3f 0 2024-09-21T00:56:31.486 INFO:tasks.workunit.client.1.smithi187.stdout:0/227: dread d0/d17/d1c/d23/d36/f3f [0,4194304] 0 2024-09-21T00:56:31.486 INFO:tasks.workunit.client.1.smithi187.stdout:5/202: dread d0/dc/f25 [0,4194304] 0 2024-09-21T00:56:31.487 INFO:tasks.workunit.client.1.smithi187.stdout:2/249: write d2/d3/d15/d1b/d1c/f32 [1089969,53323] 0 2024-09-21T00:56:31.489 INFO:tasks.workunit.client.1.smithi187.stdout:7/179: dwrite d1/d18/d31/f39 [0,4194304] 0 2024-09-21T00:56:31.489 INFO:tasks.workunit.client.1.smithi187.stdout:6/186: write d7/d2a/fb [1745167,30488] 0 2024-09-21T00:56:31.491 INFO:tasks.workunit.client.1.smithi187.stdout:1/224: readlink d4/d6/d8/l3b 0 2024-09-21T00:56:31.499 INFO:tasks.workunit.client.1.smithi187.stdout:8/256: dread dc/fd [0,4194304] 0 2024-09-21T00:56:31.499 INFO:tasks.workunit.client.1.smithi187.stdout:5/203: creat d0/dc/d39/f4b x:0 0 0 2024-09-21T00:56:31.501 INFO:tasks.workunit.client.1.smithi187.stdout:9/384: dread d4/d13/d20/d2e/f33 [0,4194304] 0 2024-09-21T00:56:31.502 INFO:tasks.workunit.client.1.smithi187.stdout:6/187: dread d7/d2a/fb [0,4194304] 0 2024-09-21T00:56:31.503 INFO:tasks.workunit.client.1.smithi187.stdout:4/223: sync 2024-09-21T00:56:31.503 INFO:tasks.workunit.client.1.smithi187.stdout:2/250: dwrite d2/d3/df/f3e [0,4194304] 0 2024-09-21T00:56:31.503 INFO:tasks.workunit.client.1.smithi187.stdout:2/251: stat d2/dc/d21 0 2024-09-21T00:56:31.505 INFO:tasks.workunit.client.1.smithi187.stdout:2/252: chown d2/d3/d15/d1b/d1c/l4e 0 1 2024-09-21T00:56:31.505 INFO:tasks.workunit.client.1.smithi187.stdout:3/219: unlink d9/d19/f30 0 2024-09-21T00:56:31.506 INFO:tasks.workunit.client.1.smithi187.stdout:7/180: truncate d1/f37 766387 0 2024-09-21T00:56:31.508 INFO:tasks.workunit.client.1.smithi187.stdout:5/204: creat d0/dc/d39/f4c x:0 0 0 2024-09-21T00:56:31.510 INFO:tasks.workunit.client.1.smithi187.stdout:9/385: rename d4/d8/d41/c75 to d4/d8/c86 0 2024-09-21T00:56:31.512 INFO:tasks.workunit.client.1.smithi187.stdout:9/386: dread - d4/d13/d14/d5d/f79 zero size 2024-09-21T00:56:31.513 INFO:tasks.workunit.client.1.smithi187.stdout:3/220: dwrite d9/d19/d1c/f31 [0,4194304] 0 2024-09-21T00:56:31.513 INFO:tasks.workunit.client.1.smithi187.stdout:2/253: unlink d2/d3/df/c27 0 2024-09-21T00:56:31.515 INFO:tasks.workunit.client.1.smithi187.stdout:7/181: symlink d1/d18/l48 0 2024-09-21T00:56:31.515 INFO:tasks.workunit.client.1.smithi187.stdout:2/254: write d2/d25/f43 [2523054,16771] 0 2024-09-21T00:56:31.517 INFO:tasks.workunit.client.1.smithi187.stdout:7/182: dread - d1/dc/f13 zero size 2024-09-21T00:56:31.519 INFO:tasks.workunit.client.1.smithi187.stdout:8/257: creat dc/d1c/d3e/f53 x:0 0 0 2024-09-21T00:56:31.519 INFO:tasks.workunit.client.1.smithi187.stdout:5/205: creat d0/dc/d39/f4d x:0 0 0 2024-09-21T00:56:31.521 INFO:tasks.workunit.client.1.smithi187.stdout:7/183: readlink d1/dc/d15/l42 0 2024-09-21T00:56:31.521 INFO:tasks.workunit.client.1.smithi187.stdout:2/255: dread - d2/d3/d15/d1b/d3c/f3d zero size 2024-09-21T00:56:31.521 INFO:tasks.workunit.client.1.smithi187.stdout:1/225: creat d4/d6/d23/f45 x:0 0 0 2024-09-21T00:56:31.524 INFO:tasks.workunit.client.1.smithi187.stdout:9/387: dwrite d4/d13/d20/d2b/d66/f74 [0,4194304] 0 2024-09-21T00:56:31.526 INFO:tasks.workunit.client.1.smithi187.stdout:0/228: getdents d0/d17/d1c/d23/df/d41/d3b 0 2024-09-21T00:56:31.528 INFO:tasks.workunit.client.1.smithi187.stdout:3/221: creat d9/d13/f48 x:0 0 0 2024-09-21T00:56:31.528 INFO:tasks.workunit.client.1.smithi187.stdout:8/258: readlink dc/d2f/l4a 0 2024-09-21T00:56:31.529 INFO:tasks.workunit.client.1.smithi187.stdout:5/206: symlink d0/d19/d30/l4e 0 2024-09-21T00:56:31.530 INFO:tasks.workunit.client.1.smithi187.stdout:3/222: write d9/d13/f1e [1807005,76509] 0 2024-09-21T00:56:31.533 INFO:tasks.workunit.client.1.smithi187.stdout:3/223: chown d9/d19/d1c/f2a 479394 1 2024-09-21T00:56:31.533 INFO:tasks.workunit.client.1.smithi187.stdout:1/226: dwrite d4/d6/d8/f31 [4194304,4194304] 0 2024-09-21T00:56:31.534 INFO:tasks.workunit.client.1.smithi187.stdout:7/184: mknod d1/dc/c49 0 2024-09-21T00:56:31.535 INFO:tasks.workunit.client.1.smithi187.stdout:7/185: write d1/d18/d31/f32 [142117,94642] 0 2024-09-21T00:56:31.536 INFO:tasks.workunit.client.1.smithi187.stdout:7/186: readlink d1/d18/l2a 0 2024-09-21T00:56:31.537 INFO:tasks.workunit.client.1.smithi187.stdout:2/256: unlink d2/dc/d21/f36 0 2024-09-21T00:56:31.539 INFO:tasks.workunit.client.1.smithi187.stdout:9/388: symlink d4/d13/d20/d2b/l87 0 2024-09-21T00:56:31.543 INFO:tasks.workunit.client.1.smithi187.stdout:8/259: mkdir dc/d2f/d54 0 2024-09-21T00:56:31.543 INFO:tasks.workunit.client.1.smithi187.stdout:8/260: dread - dc/d1c/d29/f4c zero size 2024-09-21T00:56:31.544 INFO:tasks.workunit.client.1.smithi187.stdout:8/261: truncate dc/d2f/f41 502637 0 2024-09-21T00:56:31.545 INFO:tasks.workunit.client.1.smithi187.stdout:6/188: rename d7/d2a/f13 to d7/f32 0 2024-09-21T00:56:31.546 INFO:tasks.workunit.client.1.smithi187.stdout:5/207: unlink d0/dc/f13 0 2024-09-21T00:56:31.548 INFO:tasks.workunit.client.1.smithi187.stdout:4/224: getdents d2/d3/da/d2f/d32/d22 0 2024-09-21T00:56:31.563 INFO:tasks.workunit.client.1.smithi187.stdout:3/224: chown d9/d13/d20/c23 2300 1 2024-09-21T00:56:31.563 INFO:tasks.workunit.client.1.smithi187.stdout:2/257: creat d2/d3/d15/d1b/f5e x:0 0 0 2024-09-21T00:56:31.564 INFO:tasks.workunit.client.1.smithi187.stdout:3/225: stat d9/fd 0 2024-09-21T00:56:31.564 INFO:tasks.workunit.client.1.smithi187.stdout:5/208: dread d0/d19/d14/d1b/f1c [0,4194304] 0 2024-09-21T00:56:31.565 INFO:tasks.workunit.client.1.smithi187.stdout:2/258: write d2/d25/f50 [1027658,108270] 0 2024-09-21T00:56:31.565 INFO:tasks.workunit.client.1.smithi187.stdout:7/187: fsync d1/f2 0 2024-09-21T00:56:31.567 INFO:tasks.workunit.client.1.smithi187.stdout:2/259: readlink d2/d3/l2f 0 2024-09-21T00:56:31.568 INFO:tasks.workunit.client.1.smithi187.stdout:6/189: mknod d7/c33 0 2024-09-21T00:56:31.568 INFO:tasks.workunit.client.1.smithi187.stdout:6/190: stat d7/c2b 0 2024-09-21T00:56:31.572 INFO:tasks.workunit.client.1.smithi187.stdout:4/225: truncate d2/d3/da/d2f/d32/d24/f28 191275 0 2024-09-21T00:56:31.573 INFO:tasks.workunit.client.1.smithi187.stdout:4/226: readlink d2/d3/lb 0 2024-09-21T00:56:31.575 INFO:tasks.workunit.client.1.smithi187.stdout:8/262: creat dc/d44/f55 x:0 0 0 2024-09-21T00:56:31.578 INFO:tasks.workunit.client.1.smithi187.stdout:2/260: fsync d2/dc/f13 0 2024-09-21T00:56:31.580 INFO:tasks.workunit.client.1.smithi187.stdout:7/188: rename d1/d18/d31/f3a to d1/d18/d31/d33/d3b/f4a 0 2024-09-21T00:56:31.582 INFO:tasks.workunit.client.1.smithi187.stdout:6/191: creat d7/d24/f34 x:0 0 0 2024-09-21T00:56:31.583 INFO:tasks.workunit.client.1.smithi187.stdout:3/226: symlink d9/d19/l49 0 2024-09-21T00:56:31.584 INFO:tasks.workunit.client.1.smithi187.stdout:6/192: dread - d7/d2a/f10 zero size 2024-09-21T00:56:31.586 INFO:tasks.workunit.client.1.smithi187.stdout:8/263: symlink dc/d2f/l56 0 2024-09-21T00:56:31.587 INFO:tasks.workunit.client.1.smithi187.stdout:3/227: readlink d9/d13/d20/l33 0 2024-09-21T00:56:31.588 INFO:tasks.workunit.client.1.smithi187.stdout:5/209: link d0/d19/d14/d1b/f1c d0/d19/d14/d38/f4f 0 2024-09-21T00:56:31.588 INFO:tasks.workunit.client.1.smithi187.stdout:1/227: truncate d4/d6/f41 64886 0 2024-09-21T00:56:31.590 INFO:tasks.workunit.client.1.smithi187.stdout:3/228: stat d9/d13/c36 0 2024-09-21T00:56:31.590 INFO:tasks.workunit.client.1.smithi187.stdout:2/261: dwrite d2/d3/d15/d1b/f5e [0,4194304] 0 2024-09-21T00:56:31.595 INFO:tasks.workunit.client.1.smithi187.stdout:0/229: dwrite d0/d17/d18/f24 [0,4194304] 0 2024-09-21T00:56:31.600 INFO:tasks.workunit.client.1.smithi187.stdout:7/189: dwrite d1/dc/f13 [0,4194304] 0 2024-09-21T00:56:31.600 INFO:tasks.workunit.client.1.smithi187.stdout:8/264: creat dc/d2f/d37/f57 x:0 0 0 2024-09-21T00:56:31.602 INFO:tasks.workunit.client.1.smithi187.stdout:8/265: fsync dc/f47 0 2024-09-21T00:56:31.604 INFO:tasks.workunit.client.1.smithi187.stdout:8/266: fdatasync dc/d1c/d29/f48 0 2024-09-21T00:56:31.606 INFO:tasks.workunit.client.1.smithi187.stdout:5/210: dread d0/f3f [0,4194304] 0 2024-09-21T00:56:31.607 INFO:tasks.workunit.client.1.smithi187.stdout:8/267: write f0 [3343736,61211] 0 2024-09-21T00:56:31.608 INFO:tasks.workunit.client.1.smithi187.stdout:7/190: truncate d1/d18/d31/d41/f45 788668 0 2024-09-21T00:56:31.608 INFO:tasks.workunit.client.1.smithi187.stdout:6/193: truncate d7/ff 3014179 0 2024-09-21T00:56:31.609 INFO:tasks.workunit.client.1.smithi187.stdout:3/229: dread d9/d19/d1c/f31 [0,4194304] 0 2024-09-21T00:56:31.611 INFO:tasks.workunit.client.1.smithi187.stdout:7/191: dread d1/d18/f29 [0,4194304] 0 2024-09-21T00:56:31.615 INFO:tasks.workunit.client.1.smithi187.stdout:2/262: rename d2/dc/d17/l28 to d2/d3/d15/d1b/d3f/l5f 0 2024-09-21T00:56:31.617 INFO:tasks.workunit.client.1.smithi187.stdout:0/230: mknod d0/d17/d1c/d21/c49 0 2024-09-21T00:56:31.618 INFO:tasks.workunit.client.1.smithi187.stdout:7/192: dwrite d1/d18/f29 [0,4194304] 0 2024-09-21T00:56:31.618 INFO:tasks.workunit.client.1.smithi187.stdout:0/231: truncate d0/d17/f2e 743991 0 2024-09-21T00:56:31.623 INFO:tasks.workunit.client.1.smithi187.stdout:4/227: write d2/d3/da/d2f/d32/d22/d37/f38 [670075,126364] 0 2024-09-21T00:56:31.624 INFO:tasks.workunit.client.1.smithi187.stdout:8/268: fdatasync dc/d1c/f2d 0 2024-09-21T00:56:31.626 INFO:tasks.workunit.client.1.smithi187.stdout:1/228: link d4/f14 d4/d6/d8/d35/d22/f46 0 2024-09-21T00:56:31.627 INFO:tasks.workunit.client.1.smithi187.stdout:1/229: readlink d4/d6/d8/d35/d22/l26 0 2024-09-21T00:56:31.628 INFO:tasks.workunit.client.1.smithi187.stdout:6/194: symlink d7/d2a/d29/d2d/l35 0 2024-09-21T00:56:31.634 INFO:tasks.workunit.client.1.smithi187.stdout:3/230: rename d9/d19/l35 to d9/d13/d20/l4a 0 2024-09-21T00:56:31.635 INFO:tasks.workunit.client.1.smithi187.stdout:3/231: chown d9/d19/d1c/f2a 15045 1 2024-09-21T00:56:31.636 INFO:tasks.workunit.client.1.smithi187.stdout:2/263: creat d2/d3/d15/f60 x:0 0 0 2024-09-21T00:56:31.646 INFO:tasks.workunit.client.1.smithi187.stdout:8/269: write dc/d2f/d34/f39 [5459490,62679] 0 2024-09-21T00:56:31.647 INFO:tasks.workunit.client.1.smithi187.stdout:8/270: chown dc/d2f/l4a 5902 1 2024-09-21T00:56:31.648 INFO:tasks.workunit.client.1.smithi187.stdout:1/230: unlink d4/d6/d23/c2d 0 2024-09-21T00:56:31.650 INFO:tasks.workunit.client.1.smithi187.stdout:6/195: rename d7 to d7/d36 22 2024-09-21T00:56:31.655 INFO:tasks.workunit.client.1.smithi187.stdout:7/193: mknod d1/c4b 0 2024-09-21T00:56:31.655 INFO:tasks.workunit.client.1.smithi187.stdout:3/232: dread d9/d13/d20/f2e [0,4194304] 0 2024-09-21T00:56:31.656 INFO:tasks.workunit.client.1.smithi187.stdout:7/194: truncate d1/f1c 4453131 0 2024-09-21T00:56:31.657 INFO:tasks.workunit.client.1.smithi187.stdout:0/232: fsync d0/d17/d1c/d23/f10 0 2024-09-21T00:56:31.663 INFO:tasks.workunit.client.1.smithi187.stdout:7/195: dwrite d1/f21 [0,4194304] 0 2024-09-21T00:56:31.665 INFO:tasks.workunit.client.1.smithi187.stdout:1/231: mknod d4/d6/d8/d35/c47 0 2024-09-21T00:56:31.666 INFO:tasks.workunit.client.1.smithi187.stdout:0/233: dwrite d0/d17/d18/f47 [0,4194304] 0 2024-09-21T00:56:31.667 INFO:tasks.workunit.client.1.smithi187.stdout:6/196: mknod d7/d2a/d29/d2d/c37 0 2024-09-21T00:56:31.668 INFO:tasks.workunit.client.1.smithi187.stdout:6/197: fdatasync d7/f2c 0 2024-09-21T00:56:31.669 INFO:tasks.workunit.client.1.smithi187.stdout:6/198: chown d7/d24/c31 85494 1 2024-09-21T00:56:31.671 INFO:tasks.workunit.client.1.smithi187.stdout:6/199: write d7/d2a/f2f [920688,79993] 0 2024-09-21T00:56:31.672 INFO:tasks.workunit.client.1.smithi187.stdout:8/271: dread f7 [0,4194304] 0 2024-09-21T00:56:31.672 INFO:tasks.workunit.client.1.smithi187.stdout:0/234: dread d0/d17/d1c/d23/df/d41/f42 [0,4194304] 0 2024-09-21T00:56:31.674 INFO:tasks.workunit.client.1.smithi187.stdout:3/233: mknod d9/d13/c4b 0 2024-09-21T00:56:31.674 INFO:tasks.workunit.client.1.smithi187.stdout:0/235: fdatasync d0/d17/d18/f24 0 2024-09-21T00:56:31.675 INFO:tasks.workunit.client.1.smithi187.stdout:3/234: write d9/d19/d1c/f3e [405608,112351] 0 2024-09-21T00:56:31.677 INFO:tasks.workunit.client.1.smithi187.stdout:9/389: sync 2024-09-21T00:56:31.682 INFO:tasks.workunit.client.1.smithi187.stdout:9/390: dread d4/d8/d46/d54/f5c [0,4194304] 0 2024-09-21T00:56:31.685 INFO:tasks.workunit.client.1.smithi187.stdout:6/200: creat d7/d2a/d29/f38 x:0 0 0 2024-09-21T00:56:31.686 INFO:tasks.workunit.client.1.smithi187.stdout:8/272: mknod dc/d2f/d34/c58 0 2024-09-21T00:56:31.687 INFO:tasks.workunit.client.1.smithi187.stdout:8/273: dread - dc/f47 zero size 2024-09-21T00:56:31.688 INFO:tasks.workunit.client.1.smithi187.stdout:8/274: dread - dc/d44/f55 zero size 2024-09-21T00:56:31.689 INFO:tasks.workunit.client.1.smithi187.stdout:0/236: creat d0/d17/d1c/d23/df/d41/f4a x:0 0 0 2024-09-21T00:56:31.690 INFO:tasks.workunit.client.1.smithi187.stdout:9/391: dwrite d4/d8/d46/d54/f7c [0,4194304] 0 2024-09-21T00:56:31.690 INFO:tasks.workunit.client.1.smithi187.stdout:8/275: dread - dc/d2f/d37/f57 zero size 2024-09-21T00:56:31.692 INFO:tasks.workunit.client.1.smithi187.stdout:3/235: creat d9/f4c x:0 0 0 2024-09-21T00:56:31.692 INFO:tasks.workunit.client.1.smithi187.stdout:9/392: truncate d4/d8/d41/f5b 975211 0 2024-09-21T00:56:31.694 INFO:tasks.workunit.client.1.smithi187.stdout:3/236: fdatasync d9/d13/d20/f3c 0 2024-09-21T00:56:31.695 INFO:tasks.workunit.client.1.smithi187.stdout:3/237: stat d9/f37 0 2024-09-21T00:56:31.696 INFO:tasks.workunit.client.1.smithi187.stdout:9/393: chown d4/d13/d14/d1d/f3c 3560 1 2024-09-21T00:56:31.696 INFO:tasks.workunit.client.1.smithi187.stdout:5/211: sync 2024-09-21T00:56:31.697 INFO:tasks.workunit.client.1.smithi187.stdout:7/196: fdatasync d1/f1a 0 2024-09-21T00:56:31.697 INFO:tasks.workunit.client.1.smithi187.stdout:5/212: read - d0/dc/d39/f4d zero size 2024-09-21T00:56:31.698 INFO:tasks.workunit.client.1.smithi187.stdout:1/232: rename d4/d6/f41 to d4/d6/f48 0 2024-09-21T00:56:31.699 INFO:tasks.workunit.client.1.smithi187.stdout:7/197: readlink d1/dc/d15/l20 0 2024-09-21T00:56:31.700 INFO:tasks.workunit.client.1.smithi187.stdout:6/201: mknod d7/d2a/c39 0 2024-09-21T00:56:31.700 INFO:tasks.workunit.client.1.smithi187.stdout:5/213: truncate d0/dc/d39/f4c 514635 0 2024-09-21T00:56:31.701 INFO:tasks.workunit.client.1.smithi187.stdout:9/394: dread d4/d8/d46/d54/f7c [0,4194304] 0 2024-09-21T00:56:31.701 INFO:tasks.workunit.client.1.smithi187.stdout:6/202: fdatasync d7/d24/f34 0 2024-09-21T00:56:31.701 INFO:tasks.workunit.client.1.smithi187.stdout:4/228: truncate d2/d3/da/d2f/f30 2605757 0 2024-09-21T00:56:31.703 INFO:tasks.workunit.client.1.smithi187.stdout:0/237: symlink d0/d17/d1c/l4b 0 2024-09-21T00:56:31.703 INFO:tasks.workunit.client.1.smithi187.stdout:4/229: write d2/d3/da/d16/f3c [581029,117206] 0 2024-09-21T00:56:31.704 INFO:tasks.workunit.client.1.smithi187.stdout:4/230: rename d2/d3/da to d2/d3/da/d2f/d32/d22/d37/d3a/d40 22 2024-09-21T00:56:31.707 INFO:tasks.workunit.client.1.smithi187.stdout:2/264: truncate d2/d25/f43 1844187 0 2024-09-21T00:56:31.711 INFO:tasks.workunit.client.1.smithi187.stdout:8/276: dread dc/d2f/d34/f39 [0,4194304] 0 2024-09-21T00:56:31.711 INFO:tasks.workunit.client.1.smithi187.stdout:8/277: read - dc/d44/f55 zero size 2024-09-21T00:56:31.713 INFO:tasks.workunit.client.1.smithi187.stdout:7/198: mknod d1/dc/d15/d22/c4c 0 2024-09-21T00:56:31.713 INFO:tasks.workunit.client.1.smithi187.stdout:8/278: write dc/d1c/f33 [342871,71480] 0 2024-09-21T00:56:31.713 INFO:tasks.workunit.client.1.smithi187.stdout:1/233: dread d4/d6/f29 [0,4194304] 0 2024-09-21T00:56:31.715 INFO:tasks.workunit.client.1.smithi187.stdout:5/214: creat d0/d19/f50 x:0 0 0 2024-09-21T00:56:31.717 INFO:tasks.workunit.client.1.smithi187.stdout:9/395: mknod d4/d13/d14/c88 0 2024-09-21T00:56:31.718 INFO:tasks.workunit.client.1.smithi187.stdout:5/215: dread d0/fa [0,4194304] 0 2024-09-21T00:56:31.718 INFO:tasks.workunit.client.1.smithi187.stdout:0/238: fdatasync d0/d17/d1c/d23/df/f15 0 2024-09-21T00:56:31.719 INFO:tasks.workunit.client.1.smithi187.stdout:5/216: chown d0/dc/d1f/f41 923062 1 2024-09-21T00:56:31.719 INFO:tasks.workunit.client.1.smithi187.stdout:5/217: chown d0/d19/d30 73349954 1 2024-09-21T00:56:31.721 INFO:tasks.workunit.client.1.smithi187.stdout:3/238: mknod d9/d19/d43/c4d 0 2024-09-21T00:56:31.723 INFO:tasks.workunit.client.1.smithi187.stdout:2/265: symlink d2/d25/d34/l61 0 2024-09-21T00:56:31.724 INFO:tasks.workunit.client.1.smithi187.stdout:2/266: write d2/f7 [2635435,69391] 0 2024-09-21T00:56:31.727 INFO:tasks.workunit.client.1.smithi187.stdout:8/279: symlink dc/d2f/d37/l59 0 2024-09-21T00:56:31.730 INFO:tasks.workunit.client.1.smithi187.stdout:7/199: rename d1/d18/f1d to d1/d18/f4d 0 2024-09-21T00:56:31.730 INFO:tasks.workunit.client.1.smithi187.stdout:7/200: chown d1/dc/d15/d22/l43 111 1 2024-09-21T00:56:31.731 INFO:tasks.workunit.client.1.smithi187.stdout:6/203: mknod d7/c3a 0 2024-09-21T00:56:31.731 INFO:tasks.workunit.client.1.smithi187.stdout:8/280: dread dc/d1c/d29/f31 [0,4194304] 0 2024-09-21T00:56:31.735 INFO:tasks.workunit.client.1.smithi187.stdout:6/204: dread d7/d2a/f2f [0,4194304] 0 2024-09-21T00:56:31.739 INFO:tasks.workunit.client.1.smithi187.stdout:3/239: creat d9/f4e x:0 0 0 2024-09-21T00:56:31.742 INFO:tasks.workunit.client.1.smithi187.stdout:2/267: dread d2/dc/d17/f37 [0,4194304] 0 2024-09-21T00:56:31.743 INFO:tasks.workunit.client.1.smithi187.stdout:2/268: write d2/dc/d2e/d4a/f4d [996503,82917] 0 2024-09-21T00:56:31.747 INFO:tasks.workunit.client.1.smithi187.stdout:0/239: write d0/d17/d1c/d23/df/f15 [578842,18439] 0 2024-09-21T00:56:31.751 INFO:tasks.workunit.client.1.smithi187.stdout:6/205: mknod d7/d24/c3b 0 2024-09-21T00:56:31.751 INFO:tasks.workunit.client.1.smithi187.stdout:7/201: dwrite d1/d18/f29 [0,4194304] 0 2024-09-21T00:56:31.751 INFO:tasks.workunit.client.1.smithi187.stdout:6/206: readlink d7/d2a/l1b 0 2024-09-21T00:56:31.754 INFO:tasks.workunit.client.1.smithi187.stdout:3/240: symlink d9/d19/d43/l4f 0 2024-09-21T00:56:31.757 INFO:tasks.workunit.client.1.smithi187.stdout:2/269: rename d2/dc/d17 to d2/d3/d15/d1b/d1c/d2d/d62 0 2024-09-21T00:56:31.758 INFO:tasks.workunit.client.1.smithi187.stdout:1/234: truncate d4/d6/f48 997168 0 2024-09-21T00:56:31.759 INFO:tasks.workunit.client.1.smithi187.stdout:1/235: truncate d4/d6/d23/f2b 1181440 0 2024-09-21T00:56:31.763 INFO:tasks.workunit.client.1.smithi187.stdout:8/281: link dc/d1c/f3b dc/d44/f5a 0 2024-09-21T00:56:31.765 INFO:tasks.workunit.client.1.smithi187.stdout:0/240: creat d0/d17/d1c/f4c x:0 0 0 2024-09-21T00:56:31.767 INFO:tasks.workunit.client.1.smithi187.stdout:4/231: truncate d2/d3/da/d2f/d32/d22/d37/f38 764645 0 2024-09-21T00:56:31.769 INFO:tasks.workunit.client.1.smithi187.stdout:7/202: fsync d1/dc/d15/d22/f3d 0 2024-09-21T00:56:31.770 INFO:tasks.workunit.client.1.smithi187.stdout:5/218: link d0/dc/d1f/d26/c33 d0/d19/d14/d1b/d27/c51 0 2024-09-21T00:56:31.772 INFO:tasks.workunit.client.1.smithi187.stdout:4/232: dread d2/d3/da/d16/f3c [0,4194304] 0 2024-09-21T00:56:31.772 INFO:tasks.workunit.client.1.smithi187.stdout:6/207: dread d7/d24/f1d [0,4194304] 0 2024-09-21T00:56:31.773 INFO:tasks.workunit.client.1.smithi187.stdout:2/270: creat d2/d3/d15/f63 x:0 0 0 2024-09-21T00:56:31.775 INFO:tasks.workunit.client.1.smithi187.stdout:1/236: mkdir d4/d6/d49 0 2024-09-21T00:56:31.789 INFO:tasks.workunit.client.1.smithi187.stdout:4/233: symlink d2/d3/da/d2f/d32/d22/d37/l41 0 2024-09-21T00:56:31.790 INFO:tasks.workunit.client.1.smithi187.stdout:2/271: creat d2/d3/d15/d1b/d1c/d2d/d62/d52/f64 x:0 0 0 2024-09-21T00:56:31.791 INFO:tasks.workunit.client.1.smithi187.stdout:2/272: readlink d2/d3/d15/l38 0 2024-09-21T00:56:31.792 INFO:tasks.workunit.client.1.smithi187.stdout:2/273: stat d2/d3/d15/d1b/d1c/d2d/d62/f2b 0 2024-09-21T00:56:31.793 INFO:tasks.workunit.client.1.smithi187.stdout:8/282: symlink dc/d1c/l5b 0 2024-09-21T00:56:31.796 INFO:tasks.workunit.client.1.smithi187.stdout:0/241: symlink d0/l4d 0 2024-09-21T00:56:31.797 INFO:tasks.workunit.client.1.smithi187.stdout:0/242: write d0/d17/d1c/d23/df/d41/f4a [730672,74644] 0 2024-09-21T00:56:31.800 INFO:tasks.workunit.client.1.smithi187.stdout:3/241: write f3 [1342573,111697] 0 2024-09-21T00:56:31.802 INFO:tasks.workunit.client.1.smithi187.stdout:6/208: dread d7/f14 [0,4194304] 0 2024-09-21T00:56:31.810 INFO:tasks.workunit.client.1.smithi187.stdout:1/237: symlink d4/d6/d23/l4a 0 2024-09-21T00:56:31.812 INFO:tasks.workunit.client.1.smithi187.stdout:8/283: mknod dc/d2f/d37/c5c 0 2024-09-21T00:56:31.814 INFO:tasks.workunit.client.1.smithi187.stdout:1/238: dread d4/f14 [0,4194304] 0 2024-09-21T00:56:31.819 INFO:tasks.workunit.client.1.smithi187.stdout:5/219: getdents d0/d19/d14/d1b 0 2024-09-21T00:56:31.820 INFO:tasks.workunit.client.1.smithi187.stdout:8/284: write dc/f12 [418879,129521] 0 2024-09-21T00:56:31.822 INFO:tasks.workunit.client.1.smithi187.stdout:4/234: creat d2/d3/f42 x:0 0 0 2024-09-21T00:56:31.822 INFO:tasks.workunit.client.1.smithi187.stdout:9/396: sync 2024-09-21T00:56:31.823 INFO:tasks.workunit.client.1.smithi187.stdout:8/285: fsync f0 0 2024-09-21T00:56:31.823 INFO:tasks.workunit.client.1.smithi187.stdout:7/203: dwrite d1/f1a [0,4194304] 0 2024-09-21T00:56:31.825 INFO:tasks.workunit.client.1.smithi187.stdout:4/235: chown d2/d3/f21 3 1 2024-09-21T00:56:31.828 INFO:tasks.workunit.client.1.smithi187.stdout:7/204: chown d1/dc/d15/l42 71126 1 2024-09-21T00:56:31.829 INFO:tasks.workunit.client.1.smithi187.stdout:9/397: creat d4/d61/f89 x:0 0 0 2024-09-21T00:56:31.829 INFO:tasks.workunit.client.1.smithi187.stdout:0/243: dread d0/d17/d1c/d21/f2f [0,4194304] 0 2024-09-21T00:56:31.829 INFO:tasks.workunit.client.1.smithi187.stdout:8/286: creat dc/d44/f5d x:0 0 0 2024-09-21T00:56:31.832 INFO:tasks.workunit.client.1.smithi187.stdout:5/220: rename d0/d19/d30/l4e to d0/dc/d1f/d26/l52 0 2024-09-21T00:56:31.834 INFO:tasks.workunit.client.1.smithi187.stdout:8/287: creat dc/d2f/d34/f5e x:0 0 0 2024-09-21T00:56:31.834 INFO:tasks.workunit.client.1.smithi187.stdout:2/274: truncate d2/fb 1680955 0 2024-09-21T00:56:31.835 INFO:tasks.workunit.client.1.smithi187.stdout:9/398: truncate d4/d8/f22 2895895 0 2024-09-21T00:56:31.836 INFO:tasks.workunit.client.1.smithi187.stdout:6/209: write d7/ff [3663539,108993] 0 2024-09-21T00:56:31.836 INFO:tasks.workunit.client.1.smithi187.stdout:8/288: dread - dc/d44/f55 zero size 2024-09-21T00:56:31.836 INFO:tasks.workunit.client.1.smithi187.stdout:4/236: link d2/d3/da/d2f/d32/d24/c2c d2/d3/da/d2f/d32/d26/c43 0 2024-09-21T00:56:31.839 INFO:tasks.workunit.client.1.smithi187.stdout:9/399: chown d4/d13/d14/d83 2787693 1 2024-09-21T00:56:31.839 INFO:tasks.workunit.client.1.smithi187.stdout:8/289: chown f7 866161 1 2024-09-21T00:56:31.839 INFO:tasks.workunit.client.1.smithi187.stdout:4/237: readlink d2/d3/lb 0 2024-09-21T00:56:31.839 INFO:tasks.workunit.client.1.smithi187.stdout:5/221: link d0/f3f d0/dc/d1f/d26/f53 0 2024-09-21T00:56:31.842 INFO:tasks.workunit.client.1.smithi187.stdout:0/244: dwrite d0/d17/d18/f24 [0,4194304] 0 2024-09-21T00:56:31.842 INFO:tasks.workunit.client.1.smithi187.stdout:1/239: truncate d4/d6/d23/f2b 749573 0 2024-09-21T00:56:31.844 INFO:tasks.workunit.client.1.smithi187.stdout:2/275: creat d2/dc/f65 x:0 0 0 2024-09-21T00:56:31.844 INFO:tasks.workunit.client.1.smithi187.stdout:8/290: dread - dc/d1c/f3b zero size 2024-09-21T00:56:31.844 INFO:tasks.workunit.client.1.smithi187.stdout:6/210: fdatasync d7/d2a/d29/d2d/f20 0 2024-09-21T00:56:31.846 INFO:tasks.workunit.client.1.smithi187.stdout:3/242: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:31.851 INFO:tasks.workunit.client.1.smithi187.stdout:7/205: write d1/f37 [508003,86513] 0 2024-09-21T00:56:31.851 INFO:tasks.workunit.client.1.smithi187.stdout:5/222: symlink d0/d19/d14/d1b/d27/d3a/l54 0 2024-09-21T00:56:31.853 INFO:tasks.workunit.client.1.smithi187.stdout:0/245: fdatasync d0/d17/d1c/d23/d36/f3f 0 2024-09-21T00:56:31.853 INFO:tasks.workunit.client.1.smithi187.stdout:8/291: symlink dc/d2f/l5f 0 2024-09-21T00:56:31.858 INFO:tasks.workunit.client.1.smithi187.stdout:9/400: truncate d4/d8/f38 441880 0 2024-09-21T00:56:31.859 INFO:tasks.workunit.client.1.smithi187.stdout:1/240: creat d4/d6/d23/d2e/f4b x:0 0 0 2024-09-21T00:56:31.859 INFO:tasks.workunit.client.1.smithi187.stdout:3/243: dwrite d9/d13/f2c [4194304,4194304] 0 2024-09-21T00:56:31.860 INFO:tasks.workunit.client.1.smithi187.stdout:6/211: creat d7/d2a/d29/f3c x:0 0 0 2024-09-21T00:56:31.863 INFO:tasks.workunit.client.1.smithi187.stdout:5/223: rmdir d0/d19/d14/d38 39 2024-09-21T00:56:31.863 INFO:tasks.workunit.client.1.smithi187.stdout:6/212: readlink d7/d2a/l1b 0 2024-09-21T00:56:31.863 INFO:tasks.workunit.client.1.smithi187.stdout:9/401: truncate d4/d8/f48 724337 0 2024-09-21T00:56:31.863 INFO:tasks.workunit.client.1.smithi187.stdout:1/241: truncate d4/d6/d8/f37 1405754 0 2024-09-21T00:56:31.864 INFO:tasks.workunit.client.1.smithi187.stdout:4/238: write d2/d3/da/fc [3243543,82163] 0 2024-09-21T00:56:31.865 INFO:tasks.workunit.client.1.smithi187.stdout:7/206: rename d1/dc/ce to d1/dc/d15/d22/d3e/c4e 0 2024-09-21T00:56:31.866 INFO:tasks.workunit.client.1.smithi187.stdout:5/224: read d0/d19/d14/d1b/f1c [2544011,70171] 0 2024-09-21T00:56:31.867 INFO:tasks.workunit.client.1.smithi187.stdout:3/244: creat d9/d19/d1c/f50 x:0 0 0 2024-09-21T00:56:31.867 INFO:tasks.workunit.client.1.smithi187.stdout:7/207: chown d1/dc/f13 1 1 2024-09-21T00:56:31.868 INFO:tasks.workunit.client.1.smithi187.stdout:1/242: stat d4/d6/d23/d2e/c3a 0 2024-09-21T00:56:31.868 INFO:tasks.workunit.client.1.smithi187.stdout:2/276: write d2/d25/f44 [190458,5670] 0 2024-09-21T00:56:31.869 INFO:tasks.workunit.client.1.smithi187.stdout:0/246: symlink d0/d17/d1c/d23/df/d41/d3b/d46/l4e 0 2024-09-21T00:56:31.870 INFO:tasks.workunit.client.1.smithi187.stdout:9/402: fsync d4/d8/fb 0 2024-09-21T00:56:31.873 INFO:tasks.workunit.client.1.smithi187.stdout:7/208: rmdir d1/dc 39 2024-09-21T00:56:31.875 INFO:tasks.workunit.client.1.smithi187.stdout:3/245: symlink d9/d19/d42/l51 0 2024-09-21T00:56:31.876 INFO:tasks.workunit.client.1.smithi187.stdout:1/243: mkdir d4/d6/d8/d35/d4c 0 2024-09-21T00:56:31.877 INFO:tasks.workunit.client.1.smithi187.stdout:1/244: write d4/d6/d8/f13 [1406789,83492] 0 2024-09-21T00:56:31.880 INFO:tasks.workunit.client.1.smithi187.stdout:6/213: fdatasync d7/f22 0 2024-09-21T00:56:31.881 INFO:tasks.workunit.client.1.smithi187.stdout:4/239: creat d2/d3/da/d2f/d32/d26/f44 x:0 0 0 2024-09-21T00:56:31.882 INFO:tasks.workunit.client.1.smithi187.stdout:0/247: creat d0/d17/d1c/d23/df/d41/d3b/d46/f4f x:0 0 0 2024-09-21T00:56:31.883 INFO:tasks.workunit.client.1.smithi187.stdout:4/240: read d2/ff [1435761,89779] 0 2024-09-21T00:56:31.884 INFO:tasks.workunit.client.1.smithi187.stdout:4/241: write d2/d3/f42 [893003,86209] 0 2024-09-21T00:56:31.886 INFO:tasks.workunit.client.1.smithi187.stdout:3/246: unlink d9/d13/d20/l2d 0 2024-09-21T00:56:31.887 INFO:tasks.workunit.client.1.smithi187.stdout:8/292: dread dc/d1c/f21 [0,4194304] 0 2024-09-21T00:56:31.888 INFO:tasks.workunit.client.1.smithi187.stdout:9/403: symlink d4/l8a 0 2024-09-21T00:56:31.889 INFO:tasks.workunit.client.1.smithi187.stdout:2/277: creat d2/dc/d2e/d51/f66 x:0 0 0 2024-09-21T00:56:31.891 INFO:tasks.workunit.client.1.smithi187.stdout:5/225: dread d0/f2d [0,4194304] 0 2024-09-21T00:56:31.891 INFO:tasks.workunit.client.1.smithi187.stdout:8/293: dread dc/d1c/f33 [0,4194304] 0 2024-09-21T00:56:31.892 INFO:tasks.workunit.client.1.smithi187.stdout:8/294: chown dc/d44/f5a 466274914 1 2024-09-21T00:56:31.892 INFO:tasks.workunit.client.1.smithi187.stdout:6/214: rename d7/d24/f34 to d7/d24/f3d 0 2024-09-21T00:56:31.893 INFO:tasks.workunit.client.1.smithi187.stdout:7/209: creat d1/dc/d15/d22/f4f x:0 0 0 2024-09-21T00:56:31.895 INFO:tasks.workunit.client.1.smithi187.stdout:0/248: rename d0/d17/d1c/d23/df/d41/c3d to d0/d17/d1c/d23/df/d41/d3b/c50 0 2024-09-21T00:56:31.895 INFO:tasks.workunit.client.1.smithi187.stdout:4/242: creat d2/d3/da/d2f/d32/d24/f45 x:0 0 0 2024-09-21T00:56:31.896 INFO:tasks.workunit.client.1.smithi187.stdout:0/249: chown d0/d17/d1c/d23/l12 4 1 2024-09-21T00:56:31.896 INFO:tasks.workunit.client.1.smithi187.stdout:3/247: creat d9/d19/d43/f52 x:0 0 0 2024-09-21T00:56:31.898 INFO:tasks.workunit.client.1.smithi187.stdout:4/243: fdatasync d2/d3/da/d2f/d32/d26/f44 0 2024-09-21T00:56:31.898 INFO:tasks.workunit.client.1.smithi187.stdout:1/245: unlink d4/d6/d8/d35/c1f 0 2024-09-21T00:56:31.898 INFO:tasks.workunit.client.1.smithi187.stdout:0/250: write d0/d17/d18/f24 [2388602,15802] 0 2024-09-21T00:56:31.899 INFO:tasks.workunit.client.1.smithi187.stdout:3/248: chown d9/d19/d43/c4d 104596 1 2024-09-21T00:56:31.901 INFO:tasks.workunit.client.1.smithi187.stdout:8/295: mkdir dc/d2f/d60 0 2024-09-21T00:56:31.902 INFO:tasks.workunit.client.1.smithi187.stdout:7/210: rename d1/f17 to d1/dc/d15/d22/d3e/f50 0 2024-09-21T00:56:31.904 INFO:tasks.workunit.client.1.smithi187.stdout:7/211: dread - d1/d18/f35 zero size 2024-09-21T00:56:31.907 INFO:tasks.workunit.client.1.smithi187.stdout:3/249: mkdir d9/d19/d42/d53 0 2024-09-21T00:56:31.907 INFO:tasks.workunit.client.1.smithi187.stdout:6/215: dwrite d7/f22 [0,4194304] 0 2024-09-21T00:56:31.908 INFO:tasks.workunit.client.1.smithi187.stdout:8/296: dread dc/d2f/d34/f39 [0,4194304] 0 2024-09-21T00:56:31.909 INFO:tasks.workunit.client.1.smithi187.stdout:9/404: write d4/d13/f2d [132672,55524] 0 2024-09-21T00:56:31.909 INFO:tasks.workunit.client.1.smithi187.stdout:5/226: dread d0/d19/d14/d1b/d27/f35 [0,4194304] 0 2024-09-21T00:56:31.909 INFO:tasks.workunit.client.1.smithi187.stdout:0/251: rename d0/d17/d1c/d21 to d0/d17/d1c/d23/df/d51 0 2024-09-21T00:56:31.910 INFO:tasks.workunit.client.1.smithi187.stdout:8/297: stat dc/d2f/d34/f4d 0 2024-09-21T00:56:31.911 INFO:tasks.workunit.client.1.smithi187.stdout:5/227: chown d0/d19/d30/f3c 134 1 2024-09-21T00:56:31.912 INFO:tasks.workunit.client.1.smithi187.stdout:2/278: link d2/d3/d15/d1b/d1c/f1f d2/dc/f67 0 2024-09-21T00:56:31.912 INFO:tasks.workunit.client.1.smithi187.stdout:5/228: stat d0/d19/d14/d1b 0 2024-09-21T00:56:31.913 INFO:tasks.workunit.client.1.smithi187.stdout:1/246: creat d4/d6/d8/d35/d4c/f4d x:0 0 0 2024-09-21T00:56:31.914 INFO:tasks.workunit.client.1.smithi187.stdout:2/279: chown d2/dc/d21/l35 190674 1 2024-09-21T00:56:31.914 INFO:tasks.workunit.client.1.smithi187.stdout:4/244: unlink d2/d3/da/d2f/d32/d26/c43 0 2024-09-21T00:56:31.917 INFO:tasks.workunit.client.1.smithi187.stdout:3/250: creat d9/d13/f54 x:0 0 0 2024-09-21T00:56:31.917 INFO:tasks.workunit.client.1.smithi187.stdout:2/280: chown d2/dc/d2e/d51/f66 2753 1 2024-09-21T00:56:31.918 INFO:tasks.workunit.client.1.smithi187.stdout:1/247: dread - d4/d6/d8/d35/d4c/f4d zero size 2024-09-21T00:56:31.919 INFO:tasks.workunit.client.1.smithi187.stdout:8/298: dwrite f8 [0,4194304] 0 2024-09-21T00:56:31.919 INFO:tasks.workunit.client.1.smithi187.stdout:4/245: readlink d2/d3/da/d2f/d32/d22/l2a 0 2024-09-21T00:56:31.921 INFO:tasks.workunit.client.1.smithi187.stdout:0/252: mknod d0/d17/d1c/d23/df/d51/c52 0 2024-09-21T00:56:31.923 INFO:tasks.workunit.client.1.smithi187.stdout:6/216: symlink d7/l3e 0 2024-09-21T00:56:31.924 INFO:tasks.workunit.client.1.smithi187.stdout:7/212: creat d1/d18/d31/f51 x:0 0 0 2024-09-21T00:56:31.924 INFO:tasks.workunit.client.1.smithi187.stdout:8/299: mknod dc/d44/c61 0 2024-09-21T00:56:31.924 INFO:tasks.workunit.client.1.smithi187.stdout:4/246: symlink d2/d3/da/d16/l46 0 2024-09-21T00:56:31.925 INFO:tasks.workunit.client.1.smithi187.stdout:0/253: write d0/d17/d1c/f45 [177250,13566] 0 2024-09-21T00:56:31.926 INFO:tasks.workunit.client.1.smithi187.stdout:6/217: creat d7/d2a/d29/f3f x:0 0 0 2024-09-21T00:56:31.926 INFO:tasks.workunit.client.1.smithi187.stdout:4/247: stat d2/d3/da/d2f/d32/d24 0 2024-09-21T00:56:31.927 INFO:tasks.workunit.client.1.smithi187.stdout:6/218: readlink d7/d2a/l1b 0 2024-09-21T00:56:31.928 INFO:tasks.workunit.client.1.smithi187.stdout:2/281: link d2/d3/df/f41 d2/d25/f68 0 2024-09-21T00:56:31.929 INFO:tasks.workunit.client.1.smithi187.stdout:6/219: chown d7/d2a/d29/d2d/c37 826 1 2024-09-21T00:56:31.930 INFO:tasks.workunit.client.1.smithi187.stdout:9/405: dread d4/f1a [0,4194304] 0 2024-09-21T00:56:31.930 INFO:tasks.workunit.client.1.smithi187.stdout:5/229: rename d0/dc/d1f/f48 to d0/f55 0 2024-09-21T00:56:31.930 INFO:tasks.workunit.client.1.smithi187.stdout:6/220: fsync f1 0 2024-09-21T00:56:31.931 INFO:tasks.workunit.client.1.smithi187.stdout:9/406: chown d4/d13/d14/c88 100786894 1 2024-09-21T00:56:31.931 INFO:tasks.workunit.client.1.smithi187.stdout:7/213: mknod d1/d18/d31/d33/d3b/c52 0 2024-09-21T00:56:31.932 INFO:tasks.workunit.client.1.smithi187.stdout:2/282: truncate d2/d3/d15/d1b/d1c/d2d/d62/f2b 1627260 0 2024-09-21T00:56:31.934 INFO:tasks.workunit.client.1.smithi187.stdout:6/221: rmdir d7/d2a/d29/d2d 39 2024-09-21T00:56:31.935 INFO:tasks.workunit.client.1.smithi187.stdout:9/407: read d4/d13/d14/f1e [2139243,107458] 0 2024-09-21T00:56:31.935 INFO:tasks.workunit.client.1.smithi187.stdout:4/248: mknod d2/d3/c47 0 2024-09-21T00:56:31.937 INFO:tasks.workunit.client.1.smithi187.stdout:9/408: write d4/d8/f64 [728419,65995] 0 2024-09-21T00:56:31.937 INFO:tasks.workunit.client.1.smithi187.stdout:2/283: unlink d2/d3/f12 0 2024-09-21T00:56:31.937 INFO:tasks.workunit.client.1.smithi187.stdout:0/254: dread d0/d17/d1c/f45 [0,4194304] 0 2024-09-21T00:56:31.939 INFO:tasks.workunit.client.1.smithi187.stdout:0/255: dread d0/d17/f2e [0,4194304] 0 2024-09-21T00:56:31.939 INFO:tasks.workunit.client.1.smithi187.stdout:1/248: rename d4/f3c to d4/d6/d8/f4e 0 2024-09-21T00:56:31.940 INFO:tasks.workunit.client.1.smithi187.stdout:0/256: stat d0/d17/d1c/d23/df/d41/l44 0 2024-09-21T00:56:31.941 INFO:tasks.workunit.client.1.smithi187.stdout:1/249: write d4/d6/d8/d35/f38 [38221,83296] 0 2024-09-21T00:56:31.942 INFO:tasks.workunit.client.1.smithi187.stdout:0/257: readlink d0/d17/d1c/d23/df/d41/l44 0 2024-09-21T00:56:31.942 INFO:tasks.workunit.client.1.smithi187.stdout:1/250: write d4/d6/d23/f3d [1451594,121002] 0 2024-09-21T00:56:31.942 INFO:tasks.workunit.client.1.smithi187.stdout:7/214: symlink d1/d18/d31/l53 0 2024-09-21T00:56:31.944 INFO:tasks.workunit.client.1.smithi187.stdout:1/251: dread d4/d6/d8/d35/f38 [0,4194304] 0 2024-09-21T00:56:31.945 INFO:tasks.workunit.client.1.smithi187.stdout:4/249: chown d2/d3/da/d2f/d32/d25/f2d 122533869 1 2024-09-21T00:56:31.945 INFO:tasks.workunit.client.1.smithi187.stdout:1/252: dread - d4/d6/d23/f45 zero size 2024-09-21T00:56:31.945 INFO:tasks.workunit.client.1.smithi187.stdout:9/409: creat d4/d13/d14/d5d/f8b x:0 0 0 2024-09-21T00:56:31.946 INFO:tasks.workunit.client.1.smithi187.stdout:4/250: dread - d2/d3/da/d2f/d32/d26/f44 zero size 2024-09-21T00:56:31.947 INFO:tasks.workunit.client.1.smithi187.stdout:2/284: fdatasync d2/d3/d15/d1b/d1c/d2d/d62/f37 0 2024-09-21T00:56:31.950 INFO:tasks.workunit.client.1.smithi187.stdout:2/285: read d2/d3/d15/d1b/f5e [142820,113544] 0 2024-09-21T00:56:31.951 INFO:tasks.workunit.client.1.smithi187.stdout:7/215: chown d1/l30 50 1 2024-09-21T00:56:31.953 INFO:tasks.workunit.client.1.smithi187.stdout:1/253: symlink d4/d6/d8/l4f 0 2024-09-21T00:56:31.953 INFO:tasks.workunit.client.1.smithi187.stdout:7/216: write d1/dc/f12 [5615798,61779] 0 2024-09-21T00:56:31.954 INFO:tasks.workunit.client.1.smithi187.stdout:5/230: getdents d0/d19 0 2024-09-21T00:56:31.955 INFO:tasks.workunit.client.1.smithi187.stdout:4/251: dwrite d2/d3/da/d2f/d32/d24/f45 [0,4194304] 0 2024-09-21T00:56:31.959 INFO:tasks.workunit.client.1.smithi187.stdout:1/254: write d4/d6/d8/d35/d4c/f4d [837911,27182] 0 2024-09-21T00:56:31.959 INFO:tasks.workunit.client.1.smithi187.stdout:4/252: readlink d2/l9 0 2024-09-21T00:56:31.962 INFO:tasks.workunit.client.1.smithi187.stdout:2/286: mkdir d2/d3/d15/d1b/d3c/d69 0 2024-09-21T00:56:31.962 INFO:tasks.workunit.client.1.smithi187.stdout:1/255: chown d4/d6/d8/d35/d22/d2c/f30 612 1 2024-09-21T00:56:31.963 INFO:tasks.workunit.client.1.smithi187.stdout:7/217: mknod d1/dc/c54 0 2024-09-21T00:56:31.963 INFO:tasks.workunit.client.1.smithi187.stdout:8/300: dwrite dc/d1c/f2d [0,4194304] 0 2024-09-21T00:56:31.965 INFO:tasks.workunit.client.1.smithi187.stdout:5/231: fsync d0/f2 0 2024-09-21T00:56:31.967 INFO:tasks.workunit.client.1.smithi187.stdout:6/222: write d7/d2a/d29/d2d/f20 [6029000,55256] 0 2024-09-21T00:56:31.969 INFO:tasks.workunit.client.1.smithi187.stdout:1/256: symlink d4/d6/d8/d35/d22/l50 0 2024-09-21T00:56:31.971 INFO:tasks.workunit.client.1.smithi187.stdout:4/253: dwrite d2/d3/da/d2f/d32/d22/f3d [0,4194304] 0 2024-09-21T00:56:31.971 INFO:tasks.workunit.client.1.smithi187.stdout:9/410: getdents d4/d13 0 2024-09-21T00:56:31.971 INFO:tasks.workunit.client.1.smithi187.stdout:2/287: read d2/fb [974214,16817] 0 2024-09-21T00:56:31.971 INFO:tasks.workunit.client.1.smithi187.stdout:0/258: truncate d0/d17/d1c/d23/df/f32 3426859 0 2024-09-21T00:56:31.974 INFO:tasks.workunit.client.1.smithi187.stdout:5/232: creat d0/dc/d1f/d26/f56 x:0 0 0 2024-09-21T00:56:31.974 INFO:tasks.workunit.client.1.smithi187.stdout:7/218: mkdir d1/d55 0 2024-09-21T00:56:31.974 INFO:tasks.workunit.client.1.smithi187.stdout:1/257: chown d4/d6/d23/d2e/f3f 0 1 2024-09-21T00:56:31.975 INFO:tasks.workunit.client.1.smithi187.stdout:9/411: symlink d4/d61/l8c 0 2024-09-21T00:56:31.976 INFO:tasks.workunit.client.1.smithi187.stdout:4/254: mkdir d2/d3/da/d48 0 2024-09-21T00:56:31.978 INFO:tasks.workunit.client.1.smithi187.stdout:8/301: creat dc/f62 x:0 0 0 2024-09-21T00:56:31.979 INFO:tasks.workunit.client.1.smithi187.stdout:2/288: creat d2/d3/d15/d1b/d1c/f6a x:0 0 0 2024-09-21T00:56:31.980 INFO:tasks.workunit.client.1.smithi187.stdout:1/258: truncate d4/f11 4214818 0 2024-09-21T00:56:31.981 INFO:tasks.workunit.client.1.smithi187.stdout:9/412: stat d4/d61/d6c/l3d 0 2024-09-21T00:56:31.985 INFO:tasks.workunit.client.1.smithi187.stdout:1/259: stat d4/d6/d23/l4a 0 2024-09-21T00:56:31.993 INFO:tasks.workunit.client.1.smithi187.stdout:2/289: write d2/d3/d15/d1b/d1c/d2d/d62/f2b [737118,101708] 0 2024-09-21T00:56:31.994 INFO:tasks.workunit.client.1.smithi187.stdout:0/259: dwrite d0/d17/d1c/f4c [0,4194304] 0 2024-09-21T00:56:31.995 INFO:tasks.workunit.client.1.smithi187.stdout:4/255: link d2/d3/da/d2f/d32/d22/f3d d2/d3/da/d2f/d32/d22/f49 0 2024-09-21T00:56:31.996 INFO:tasks.workunit.client.1.smithi187.stdout:5/233: dwrite d0/d19/f50 [0,4194304] 0 2024-09-21T00:56:31.997 INFO:tasks.workunit.client.1.smithi187.stdout:1/260: creat d4/d6/d8/d35/f51 x:0 0 0 2024-09-21T00:56:31.999 INFO:tasks.workunit.client.1.smithi187.stdout:5/234: chown d0/d19/d14 939 1 2024-09-21T00:56:32.003 INFO:tasks.workunit.client.1.smithi187.stdout:9/413: link d4/d61/d6c/f56 d4/d13/d14/d1d/f8d 0 2024-09-21T00:56:32.004 INFO:tasks.workunit.client.1.smithi187.stdout:7/219: dwrite d1/d18/d31/d33/d3b/f3f [0,4194304] 0 2024-09-21T00:56:32.004 INFO:tasks.workunit.client.1.smithi187.stdout:2/290: write d2/d25/d34/f59 [613475,74892] 0 2024-09-21T00:56:32.007 INFO:tasks.workunit.client.1.smithi187.stdout:5/235: chown d0/dc/f28 1033 1 2024-09-21T00:56:32.010 INFO:tasks.workunit.client.1.smithi187.stdout:0/260: creat d0/d17/d1c/d23/df/f53 x:0 0 0 2024-09-21T00:56:32.010 INFO:tasks.workunit.client.1.smithi187.stdout:5/236: write d0/f2 [1115959,28663] 0 2024-09-21T00:56:32.010 INFO:tasks.workunit.client.1.smithi187.stdout:4/256: mkdir d2/d3/da/d2f/d32/d26/d4a 0 2024-09-21T00:56:32.011 INFO:tasks.workunit.client.1.smithi187.stdout:2/291: chown d2/d25/c42 10855 1 2024-09-21T00:56:32.011 INFO:tasks.workunit.client.1.smithi187.stdout:1/261: dread d4/d6/f29 [0,4194304] 0 2024-09-21T00:56:32.011 INFO:tasks.workunit.client.1.smithi187.stdout:7/220: mknod d1/dc/d15/c56 0 2024-09-21T00:56:32.012 INFO:tasks.workunit.client.1.smithi187.stdout:9/414: fsync d4/d8/d46/d54/f5c 0 2024-09-21T00:56:32.014 INFO:tasks.workunit.client.1.smithi187.stdout:2/292: rmdir d2/dc 39 2024-09-21T00:56:32.014 INFO:tasks.workunit.client.1.smithi187.stdout:7/221: chown d1 360120084 1 2024-09-21T00:56:32.014 INFO:tasks.workunit.client.1.smithi187.stdout:5/237: fdatasync d0/d19/d14/d1b/f24 0 2024-09-21T00:56:32.015 INFO:tasks.workunit.client.1.smithi187.stdout:6/223: dread d7/f32 [0,4194304] 0 2024-09-21T00:56:32.015 INFO:tasks.workunit.client.1.smithi187.stdout:9/415: chown d4/d8/c1c 6765 1 2024-09-21T00:56:32.016 INFO:tasks.workunit.client.1.smithi187.stdout:0/261: creat d0/d17/d1c/d23/df/d41/d3b/f54 x:0 0 0 2024-09-21T00:56:32.016 INFO:tasks.workunit.client.1.smithi187.stdout:4/257: mkdir d2/d3/da/d2f/d4b 0 2024-09-21T00:56:32.018 INFO:tasks.workunit.client.1.smithi187.stdout:9/416: chown d4/d10/d43/c81 780 1 2024-09-21T00:56:32.020 INFO:tasks.workunit.client.1.smithi187.stdout:2/293: mkdir d2/dc/d6b 0 2024-09-21T00:56:32.022 INFO:tasks.workunit.client.1.smithi187.stdout:4/258: truncate d2/d3/da/d16/f3c 1369296 0 2024-09-21T00:56:32.022 INFO:tasks.workunit.client.1.smithi187.stdout:6/224: rename d7/d2a/d29/d2d to d7/d2a/d29/d40 0 2024-09-21T00:56:32.025 INFO:tasks.workunit.client.1.smithi187.stdout:5/238: getdents d0/d19/d30 0 2024-09-21T00:56:32.026 INFO:tasks.workunit.client.1.smithi187.stdout:2/294: mkdir d2/d3/d15/d1b/d6c 0 2024-09-21T00:56:32.028 INFO:tasks.workunit.client.1.smithi187.stdout:6/225: write d7/d24/f1d [2586108,15770] 0 2024-09-21T00:56:32.030 INFO:tasks.workunit.client.1.smithi187.stdout:0/262: getdents d0/d17/d1c/d23/d36 0 2024-09-21T00:56:32.031 INFO:tasks.workunit.client.1.smithi187.stdout:0/263: dread d0/d17/f2e [0,4194304] 0 2024-09-21T00:56:32.031 INFO:tasks.workunit.client.1.smithi187.stdout:2/295: symlink d2/dc/d2e/d4a/l6d 0 2024-09-21T00:56:32.032 INFO:tasks.workunit.client.1.smithi187.stdout:4/259: write d2/d3/da/d2f/d32/d22/f23 [1725028,79843] 0 2024-09-21T00:56:32.033 INFO:tasks.workunit.client.1.smithi187.stdout:6/226: mknod d7/d2a/c41 0 2024-09-21T00:56:32.034 INFO:tasks.workunit.client.1.smithi187.stdout:5/239: mkdir d0/d19/d14/d57 0 2024-09-21T00:56:32.035 INFO:tasks.workunit.client.1.smithi187.stdout:0/264: symlink d0/d17/l55 0 2024-09-21T00:56:32.035 INFO:tasks.workunit.client.1.smithi187.stdout:7/222: write d1/dc/d15/d22/f3d [455963,80198] 0 2024-09-21T00:56:32.036 INFO:tasks.workunit.client.1.smithi187.stdout:1/262: truncate d4/d6/d8/f13 3413389 0 2024-09-21T00:56:32.037 INFO:tasks.workunit.client.1.smithi187.stdout:6/227: creat d7/d24/f42 x:0 0 0 2024-09-21T00:56:32.039 INFO:tasks.workunit.client.1.smithi187.stdout:2/296: fsync d2/fa 0 2024-09-21T00:56:32.042 INFO:tasks.workunit.client.1.smithi187.stdout:0/265: write d0/d17/f2e [241172,116715] 0 2024-09-21T00:56:32.043 INFO:tasks.workunit.client.1.smithi187.stdout:5/240: mknod d0/c58 0 2024-09-21T00:56:32.045 INFO:tasks.workunit.client.1.smithi187.stdout:4/260: write d2/ff [4735323,43304] 0 2024-09-21T00:56:32.049 INFO:tasks.workunit.client.1.smithi187.stdout:2/297: creat d2/d3/d15/d1b/d3c/d40/f6e x:0 0 0 2024-09-21T00:56:32.053 INFO:tasks.workunit.client.1.smithi187.stdout:6/228: dwrite d7/d2a/d29/d40/f20 [8388608,4194304] 0 2024-09-21T00:56:32.054 INFO:tasks.workunit.client.1.smithi187.stdout:0/266: symlink d0/l56 0 2024-09-21T00:56:32.055 INFO:tasks.workunit.client.1.smithi187.stdout:9/417: dwrite d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:32.055 INFO:tasks.workunit.client.1.smithi187.stdout:1/263: write d4/d6/d8/f13 [3318545,44691] 0 2024-09-21T00:56:32.055 INFO:tasks.workunit.client.1.smithi187.stdout:4/261: dread - d2/d3/da/d2f/d32/d26/f44 zero size 2024-09-21T00:56:32.058 INFO:tasks.workunit.client.1.smithi187.stdout:7/223: dwrite d1/f9 [4194304,4194304] 0 2024-09-21T00:56:32.058 INFO:tasks.workunit.client.1.smithi187.stdout:2/298: dread d2/d25/f4f [0,4194304] 0 2024-09-21T00:56:32.060 INFO:tasks.workunit.client.1.smithi187.stdout:5/241: truncate d0/d19/d14/d1b/d27/f2f 961222 0 2024-09-21T00:56:32.062 INFO:tasks.workunit.client.1.smithi187.stdout:0/267: read - d0/d17/d1c/d23/df/f53 zero size 2024-09-21T00:56:32.063 INFO:tasks.workunit.client.1.smithi187.stdout:6/229: creat d7/d2a/d29/f43 x:0 0 0 2024-09-21T00:56:32.064 INFO:tasks.workunit.client.1.smithi187.stdout:7/224: chown d1/dc/d15/d22/c4c 34 1 2024-09-21T00:56:32.065 INFO:tasks.workunit.client.1.smithi187.stdout:2/299: mkdir d2/dc/d2e/d6f 0 2024-09-21T00:56:32.066 INFO:tasks.workunit.client.1.smithi187.stdout:9/418: symlink d4/d13/d20/d2b/d66/l8e 0 2024-09-21T00:56:32.067 INFO:tasks.workunit.client.1.smithi187.stdout:2/300: chown d2/d25/f68 378257839 1 2024-09-21T00:56:32.068 INFO:tasks.workunit.client.1.smithi187.stdout:5/242: mknod d0/d19/d14/d1b/d27/c59 0 2024-09-21T00:56:32.068 INFO:tasks.workunit.client.1.smithi187.stdout:1/264: dwrite d4/f11 [0,4194304] 0 2024-09-21T00:56:32.071 INFO:tasks.workunit.client.1.smithi187.stdout:7/225: rename d1/d18/f4d to d1/dc/d15/f57 0 2024-09-21T00:56:32.072 INFO:tasks.workunit.client.1.smithi187.stdout:7/226: chown d1/dc 143481714 1 2024-09-21T00:56:32.073 INFO:tasks.workunit.client.1.smithi187.stdout:6/230: dread d7/d24/f1e [0,4194304] 0 2024-09-21T00:56:32.074 INFO:tasks.workunit.client.1.smithi187.stdout:1/265: mknod d4/c52 0 2024-09-21T00:56:32.077 INFO:tasks.workunit.client.1.smithi187.stdout:6/231: rmdir d7/d2a/d29 39 2024-09-21T00:56:32.077 INFO:tasks.workunit.client.1.smithi187.stdout:1/266: stat d4/d6/d8/d35/d22/d2c/f30 0 2024-09-21T00:56:32.079 INFO:tasks.workunit.client.1.smithi187.stdout:2/301: dwrite d2/d3/d15/f63 [0,4194304] 0 2024-09-21T00:56:32.080 INFO:tasks.workunit.client.1.smithi187.stdout:7/227: getdents d1/dc 0 2024-09-21T00:56:32.081 INFO:tasks.workunit.client.1.smithi187.stdout:1/267: read d4/d6/d8/f13 [2996492,35613] 0 2024-09-21T00:56:32.082 INFO:tasks.workunit.client.1.smithi187.stdout:6/232: rename d7/f30 to d7/f44 0 2024-09-21T00:56:32.084 INFO:tasks.workunit.client.1.smithi187.stdout:2/302: mknod d2/d3/d15/d1b/d3c/d40/c70 0 2024-09-21T00:56:32.085 INFO:tasks.workunit.client.1.smithi187.stdout:7/228: mknod d1/dc/c58 0 2024-09-21T00:56:32.087 INFO:tasks.workunit.client.1.smithi187.stdout:6/233: write d7/d24/f3d [259597,57727] 0 2024-09-21T00:56:32.089 INFO:tasks.workunit.client.1.smithi187.stdout:2/303: getdents d2 0 2024-09-21T00:56:32.093 INFO:tasks.workunit.client.1.smithi187.stdout:2/304: mknod d2/d3/d15/d1b/d1c/c71 0 2024-09-21T00:56:32.094 INFO:tasks.workunit.client.1.smithi187.stdout:7/229: rename d1/f1e to d1/dc/d15/d22/d3e/f59 0 2024-09-21T00:56:32.094 INFO:tasks.workunit.client.1.smithi187.stdout:1/268: dwrite d4/d6/d8/d35/f51 [0,4194304] 0 2024-09-21T00:56:32.095 INFO:tasks.workunit.client.1.smithi187.stdout:6/234: mkdir d7/d2a/d29/d40/d45 0 2024-09-21T00:56:32.096 INFO:tasks.workunit.client.1.smithi187.stdout:2/305: dread - d2/d3/d15/d1b/d1c/f54 zero size 2024-09-21T00:56:32.097 INFO:tasks.workunit.client.1.smithi187.stdout:1/269: rmdir d4 39 2024-09-21T00:56:32.099 INFO:tasks.workunit.client.1.smithi187.stdout:6/235: rmdir d7 39 2024-09-21T00:56:32.100 INFO:tasks.workunit.client.1.smithi187.stdout:7/230: mkdir d1/d18/d31/d5a 0 2024-09-21T00:56:32.102 INFO:tasks.workunit.client.1.smithi187.stdout:1/270: chown d4/d6/d49 1 1 2024-09-21T00:56:32.103 INFO:tasks.workunit.client.1.smithi187.stdout:7/231: stat d1/dc/d15/d22/f4f 0 2024-09-21T00:56:32.104 INFO:tasks.workunit.client.1.smithi187.stdout:6/236: unlink d7/d2a/d29/d40/c37 0 2024-09-21T00:56:32.105 INFO:tasks.workunit.client.1.smithi187.stdout:1/271: chown d4/d6/d23/f2b 537 1 2024-09-21T00:56:32.107 INFO:tasks.workunit.client.1.smithi187.stdout:7/232: mknod d1/dc/d15/d2b/c5b 0 2024-09-21T00:56:32.109 INFO:tasks.workunit.client.1.smithi187.stdout:7/233: symlink d1/d18/d31/d41/l5c 0 2024-09-21T00:56:32.110 INFO:tasks.workunit.client.1.smithi187.stdout:5/243: dread d0/d19/d14/d1b/d27/f4a [0,4194304] 0 2024-09-21T00:56:32.111 INFO:tasks.workunit.client.1.smithi187.stdout:4/262: dread d2/d3/da/f1f [4194304,4194304] 0 2024-09-21T00:56:32.113 INFO:tasks.workunit.client.1.smithi187.stdout:7/234: mkdir d1/d18/d31/d5a/d5d 0 2024-09-21T00:56:32.113 INFO:tasks.workunit.client.1.smithi187.stdout:7/235: chown d1/f21 0 1 2024-09-21T00:56:32.114 INFO:tasks.workunit.client.1.smithi187.stdout:5/244: mkdir d0/d19/d14/d38/d5a 0 2024-09-21T00:56:32.115 INFO:tasks.workunit.client.1.smithi187.stdout:5/245: read d0/dc/f11 [101534,1158] 0 2024-09-21T00:56:32.117 INFO:tasks.workunit.client.1.smithi187.stdout:1/272: write d4/f14 [2368735,78308] 0 2024-09-21T00:56:32.119 INFO:tasks.workunit.client.1.smithi187.stdout:5/246: creat d0/d19/d14/d38/f5b x:0 0 0 2024-09-21T00:56:32.120 INFO:tasks.workunit.client.1.smithi187.stdout:1/273: stat d4/d6/d8/d35/l44 0 2024-09-21T00:56:32.121 INFO:tasks.workunit.client.1.smithi187.stdout:4/263: truncate d2/d3/da/d2f/d32/d24/f2e 2217683 0 2024-09-21T00:56:32.123 INFO:tasks.workunit.client.1.smithi187.stdout:1/274: mkdir d4/d6/d23/d2e/d53 0 2024-09-21T00:56:32.123 INFO:tasks.workunit.client.1.smithi187.stdout:2/306: dread d2/d3/d15/d1b/d1c/f1f [0,4194304] 0 2024-09-21T00:56:32.123 INFO:tasks.workunit.client.1.smithi187.stdout:6/237: dread d7/ff [0,4194304] 0 2024-09-21T00:56:32.124 INFO:tasks.workunit.client.1.smithi187.stdout:7/236: dwrite d1/d18/f29 [0,4194304] 0 2024-09-21T00:56:32.129 INFO:tasks.workunit.client.1.smithi187.stdout:1/275: write d4/d6/d8/d35/d22/f46 [4146100,53503] 0 2024-09-21T00:56:32.134 INFO:tasks.workunit.client.1.smithi187.stdout:5/247: dwrite d0/d19/f23 [0,4194304] 0 2024-09-21T00:56:32.134 INFO:tasks.workunit.client.1.smithi187.stdout:7/237: rename d1/dc/d15/d22/f3d to d1/dc/d15/d22/f5e 0 2024-09-21T00:56:32.136 INFO:tasks.workunit.client.1.smithi187.stdout:1/276: unlink d4/d6/d8/l25 0 2024-09-21T00:56:32.138 INFO:tasks.workunit.client.1.smithi187.stdout:2/307: dwrite d2/d3/d15/f63 [0,4194304] 0 2024-09-21T00:56:32.138 INFO:tasks.workunit.client.1.smithi187.stdout:7/238: symlink d1/dc/d15/d22/d3e/l5f 0 2024-09-21T00:56:32.138 INFO:tasks.workunit.client.1.smithi187.stdout:1/277: chown d4/c36 1749 1 2024-09-21T00:56:32.143 INFO:tasks.workunit.client.1.smithi187.stdout:5/248: dread d0/f2d [0,4194304] 0 2024-09-21T00:56:32.145 INFO:tasks.workunit.client.1.smithi187.stdout:1/278: creat d4/d6/d23/f54 x:0 0 0 2024-09-21T00:56:32.145 INFO:tasks.workunit.client.1.smithi187.stdout:5/249: dread - d0/dc/d39/f4b zero size 2024-09-21T00:56:32.147 INFO:tasks.workunit.client.1.smithi187.stdout:1/279: readlink d4/d6/d23/l42 0 2024-09-21T00:56:32.150 INFO:tasks.workunit.client.1.smithi187.stdout:1/280: read d4/f14 [1918435,13102] 0 2024-09-21T00:56:32.150 INFO:tasks.workunit.client.1.smithi187.stdout:2/308: dread d2/d3/d15/d1b/d1c/f1f [0,4194304] 0 2024-09-21T00:56:32.151 INFO:tasks.workunit.client.1.smithi187.stdout:5/250: unlink d0/d19/d14/d1b/l47 0 2024-09-21T00:56:32.152 INFO:tasks.workunit.client.1.smithi187.stdout:4/264: dread d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:32.153 INFO:tasks.workunit.client.1.smithi187.stdout:7/239: dwrite d1/d18/d31/d33/f46 [0,4194304] 0 2024-09-21T00:56:32.155 INFO:tasks.workunit.client.1.smithi187.stdout:5/251: write d0/d19/d14/d1b/d27/f2f [1924805,75355] 0 2024-09-21T00:56:32.156 INFO:tasks.workunit.client.1.smithi187.stdout:2/309: creat d2/d3/df/f72 x:0 0 0 2024-09-21T00:56:32.156 INFO:tasks.workunit.client.1.smithi187.stdout:4/265: truncate d2/d3/da/d2f/d32/d26/f44 1019988 0 2024-09-21T00:56:32.157 INFO:tasks.workunit.client.1.smithi187.stdout:7/240: readlink d1/lf 0 2024-09-21T00:56:32.157 INFO:tasks.workunit.client.1.smithi187.stdout:1/281: mknod d4/d6/d49/c55 0 2024-09-21T00:56:32.158 INFO:tasks.workunit.client.1.smithi187.stdout:2/310: chown d2/dc/d2e/d6f 14557 1 2024-09-21T00:56:32.158 INFO:tasks.workunit.client.1.smithi187.stdout:7/241: read - d1/d18/d31/f36 zero size 2024-09-21T00:56:32.159 INFO:tasks.workunit.client.1.smithi187.stdout:5/252: mkdir d0/d19/d14/d57/d5c 0 2024-09-21T00:56:32.161 INFO:tasks.workunit.client.1.smithi187.stdout:5/253: readlink d0/d19/d14/d1b/d27/d3a/l3e 0 2024-09-21T00:56:32.162 INFO:tasks.workunit.client.1.smithi187.stdout:2/311: truncate d2/d3/d15/d1b/d1c/f54 208010 0 2024-09-21T00:56:32.163 INFO:tasks.workunit.client.1.smithi187.stdout:4/266: creat d2/d3/f4c x:0 0 0 2024-09-21T00:56:32.163 INFO:tasks.workunit.client.1.smithi187.stdout:5/254: read d0/d19/d14/d1b/f1c [2288208,23912] 0 2024-09-21T00:56:32.167 INFO:tasks.workunit.client.1.smithi187.stdout:4/267: chown d2/d3/da/d2f/d32/d25/f2d 65926245 1 2024-09-21T00:56:32.167 INFO:tasks.workunit.client.1.smithi187.stdout:7/242: dwrite d1/d18/d31/f32 [0,4194304] 0 2024-09-21T00:56:32.167 INFO:tasks.workunit.client.1.smithi187.stdout:5/255: symlink d0/d19/d14/d1b/l5d 0 2024-09-21T00:56:32.171 INFO:tasks.workunit.client.1.smithi187.stdout:4/268: creat d2/d3/da/f4d x:0 0 0 2024-09-21T00:56:32.172 INFO:tasks.workunit.client.1.smithi187.stdout:2/312: link d2/d3/d15/d1b/d1c/d2d/d62/c58 d2/d3/d15/c73 0 2024-09-21T00:56:32.175 INFO:tasks.workunit.client.1.smithi187.stdout:4/269: fsync d2/d3/f35 0 2024-09-21T00:56:32.179 INFO:tasks.workunit.client.1.smithi187.stdout:1/282: truncate d4/d6/d8/f31 5998869 0 2024-09-21T00:56:32.180 INFO:tasks.workunit.client.1.smithi187.stdout:8/302: sync 2024-09-21T00:56:32.180 INFO:tasks.workunit.client.1.smithi187.stdout:3/251: sync 2024-09-21T00:56:32.181 INFO:tasks.workunit.client.1.smithi187.stdout:4/270: dwrite d2/d3/da/d2f/d32/d26/f44 [0,4194304] 0 2024-09-21T00:56:32.183 INFO:tasks.workunit.client.1.smithi187.stdout:3/252: truncate d9/d13/f3d 929756 0 2024-09-21T00:56:32.184 INFO:tasks.workunit.client.1.smithi187.stdout:8/303: truncate dc/d1c/d29/f4c 112423 0 2024-09-21T00:56:32.185 INFO:tasks.workunit.client.1.smithi187.stdout:8/304: stat dc/d44/c61 0 2024-09-21T00:56:32.185 INFO:tasks.workunit.client.1.smithi187.stdout:4/271: rename d2/ff to d2/d3/da/d2f/d32/f4e 0 2024-09-21T00:56:32.185 INFO:tasks.workunit.client.1.smithi187.stdout:8/305: fdatasync dc/f49 0 2024-09-21T00:56:32.189 INFO:tasks.workunit.client.1.smithi187.stdout:7/243: truncate d1/f1c 2168234 0 2024-09-21T00:56:32.191 INFO:tasks.workunit.client.1.smithi187.stdout:7/244: write d1/d18/d31/d33/d3b/f3f [2213811,13747] 0 2024-09-21T00:56:32.191 INFO:tasks.workunit.client.1.smithi187.stdout:8/306: symlink dc/l63 0 2024-09-21T00:56:32.192 INFO:tasks.workunit.client.1.smithi187.stdout:5/256: truncate d0/d19/d14/d1b/d27/f2f 1141470 0 2024-09-21T00:56:32.193 INFO:tasks.workunit.client.1.smithi187.stdout:4/272: mkdir d2/d3/da/d2f/d32/d22/d4f 0 2024-09-21T00:56:32.193 INFO:tasks.workunit.client.1.smithi187.stdout:2/313: write d2/dc/f13 [2290924,108844] 0 2024-09-21T00:56:32.194 INFO:tasks.workunit.client.1.smithi187.stdout:5/257: rename d0 to d0/dc/d39/d46/d5e 22 2024-09-21T00:56:32.203 INFO:tasks.workunit.client.1.smithi187.stdout:5/258: write d0/d19/d14/f3d [1707570,80324] 0 2024-09-21T00:56:32.203 INFO:tasks.workunit.client.1.smithi187.stdout:8/307: mknod dc/d2f/d54/c64 0 2024-09-21T00:56:32.204 INFO:tasks.workunit.client.1.smithi187.stdout:1/283: dread d4/d6/d8/f13 [0,4194304] 0 2024-09-21T00:56:32.205 INFO:tasks.workunit.client.1.smithi187.stdout:4/273: read d2/d3/da/d2f/d32/d22/f3d [1909265,35647] 0 2024-09-21T00:56:32.205 INFO:tasks.workunit.client.1.smithi187.stdout:7/245: symlink d1/d18/d31/d5a/d5d/l60 0 2024-09-21T00:56:32.207 INFO:tasks.workunit.client.1.smithi187.stdout:5/259: write d0/d19/d14/d38/f5b [68020,27286] 0 2024-09-21T00:56:32.209 INFO:tasks.workunit.client.1.smithi187.stdout:1/284: mknod d4/d6/d49/c56 0 2024-09-21T00:56:32.210 INFO:tasks.workunit.client.1.smithi187.stdout:7/246: write d1/d18/d31/f51 [101346,54144] 0 2024-09-21T00:56:32.210 INFO:tasks.workunit.client.1.smithi187.stdout:2/314: link d2/d3/d15/d1b/d1c/d2d/d62/f37 d2/d3/d15/d1b/d3c/f74 0 2024-09-21T00:56:32.212 INFO:tasks.workunit.client.1.smithi187.stdout:3/253: dwrite d9/d19/d1c/f38 [0,4194304] 0 2024-09-21T00:56:32.213 INFO:tasks.workunit.client.1.smithi187.stdout:1/285: fdatasync d4/d6/d23/f54 0 2024-09-21T00:56:32.213 INFO:tasks.workunit.client.1.smithi187.stdout:5/260: write d0/d19/f10 [1740151,16996] 0 2024-09-21T00:56:32.214 INFO:tasks.workunit.client.1.smithi187.stdout:7/247: chown d1/f21 89685501 1 2024-09-21T00:56:32.215 INFO:tasks.workunit.client.1.smithi187.stdout:4/274: dread d2/d3/da/d2f/d32/d24/f28 [0,4194304] 0 2024-09-21T00:56:32.217 INFO:tasks.workunit.client.1.smithi187.stdout:5/261: readlink d0/d19/d14/d1b/l5d 0 2024-09-21T00:56:32.217 INFO:tasks.workunit.client.1.smithi187.stdout:2/315: mkdir d2/d3/d15/d1b/d3c/d40/d75 0 2024-09-21T00:56:32.218 INFO:tasks.workunit.client.1.smithi187.stdout:7/248: chown d1/dc/d15/d22/d3e/l5f 50314 1 2024-09-21T00:56:32.218 INFO:tasks.workunit.client.1.smithi187.stdout:3/254: readlink d9/d19/d1c/l26 0 2024-09-21T00:56:32.219 INFO:tasks.workunit.client.1.smithi187.stdout:1/286: creat d4/d6/d8/d35/d22/f57 x:0 0 0 2024-09-21T00:56:32.220 INFO:tasks.workunit.client.1.smithi187.stdout:3/255: chown d9/f37 151320177 1 2024-09-21T00:56:32.222 INFO:tasks.workunit.client.1.smithi187.stdout:8/308: dwrite dc/d1c/d29/f31 [0,4194304] 0 2024-09-21T00:56:32.222 INFO:tasks.workunit.client.1.smithi187.stdout:7/249: write d1/d18/f29 [1517517,80426] 0 2024-09-21T00:56:32.222 INFO:tasks.workunit.client.1.smithi187.stdout:4/275: mknod d2/d3/da/d2f/d4b/c50 0 2024-09-21T00:56:32.225 INFO:tasks.workunit.client.1.smithi187.stdout:8/309: write dc/d1c/d3e/f53 [638365,97077] 0 2024-09-21T00:56:32.230 INFO:tasks.workunit.client.1.smithi187.stdout:5/262: rename d0/f2 to d0/d19/d14/d38/f5f 0 2024-09-21T00:56:32.230 INFO:tasks.workunit.client.1.smithi187.stdout:4/276: write d2/d3/da/d2f/d32/d24/f45 [3458249,86543] 0 2024-09-21T00:56:32.230 INFO:tasks.workunit.client.1.smithi187.stdout:7/250: creat d1/dc/d15/d2b/f61 x:0 0 0 2024-09-21T00:56:32.231 INFO:tasks.workunit.client.1.smithi187.stdout:3/256: fsync d9/f37 0 2024-09-21T00:56:32.237 INFO:tasks.workunit.client.1.smithi187.stdout:1/287: dwrite d4/d6/d8/d35/d4c/f4d [0,4194304] 0 2024-09-21T00:56:32.242 INFO:tasks.workunit.client.1.smithi187.stdout:7/251: dwrite d1/f21 [0,4194304] 0 2024-09-21T00:56:32.243 INFO:tasks.workunit.client.1.smithi187.stdout:3/257: dwrite d9/f11 [4194304,4194304] 0 2024-09-21T00:56:32.243 INFO:tasks.workunit.client.1.smithi187.stdout:8/310: write dc/d44/f5a [737710,24460] 0 2024-09-21T00:56:32.245 INFO:tasks.workunit.client.1.smithi187.stdout:1/288: symlink d4/d6/d8/d35/l58 0 2024-09-21T00:56:32.245 INFO:tasks.workunit.client.1.smithi187.stdout:3/258: chown d9/d13/f2c 33635800 1 2024-09-21T00:56:32.247 INFO:tasks.workunit.client.1.smithi187.stdout:5/263: truncate d0/d19/d30/f3b 4004453 0 2024-09-21T00:56:32.249 INFO:tasks.workunit.client.1.smithi187.stdout:3/259: write d9/f4c [218470,107620] 0 2024-09-21T00:56:32.254 INFO:tasks.workunit.client.1.smithi187.stdout:5/264: fsync d0/dc/d1f/f41 0 2024-09-21T00:56:32.255 INFO:tasks.workunit.client.1.smithi187.stdout:8/311: dread f7 [0,4194304] 0 2024-09-21T00:56:32.259 INFO:tasks.workunit.client.1.smithi187.stdout:1/289: rename d4/d6/d8/d35/c47 to d4/d6/d23/d2e/d53/c59 0 2024-09-21T00:56:32.261 INFO:tasks.workunit.client.1.smithi187.stdout:4/277: dwrite d2/d3/da/d2f/d32/d24/f2e [0,4194304] 0 2024-09-21T00:56:32.266 INFO:tasks.workunit.client.1.smithi187.stdout:7/252: dwrite d1/d18/d31/d33/f46 [0,4194304] 0 2024-09-21T00:56:32.266 INFO:tasks.workunit.client.1.smithi187.stdout:8/312: rmdir dc/d2f/d60 0 2024-09-21T00:56:32.267 INFO:tasks.workunit.client.1.smithi187.stdout:5/265: rename d0/d19/d14/d38/f40 to d0/d19/d30/f60 0 2024-09-21T00:56:32.268 INFO:tasks.workunit.client.1.smithi187.stdout:3/260: dwrite d9/fd [0,4194304] 0 2024-09-21T00:56:32.276 INFO:tasks.workunit.client.1.smithi187.stdout:5/266: unlink d0/dc/f25 0 2024-09-21T00:56:32.276 INFO:tasks.workunit.client.1.smithi187.stdout:8/313: truncate dc/f28 654901 0 2024-09-21T00:56:32.277 INFO:tasks.workunit.client.1.smithi187.stdout:1/290: rename d4/f11 to d4/d6/f5a 0 2024-09-21T00:56:32.279 INFO:tasks.workunit.client.1.smithi187.stdout:8/314: fdatasync dc/d44/f55 0 2024-09-21T00:56:32.282 INFO:tasks.workunit.client.1.smithi187.stdout:8/315: write dc/f62 [353049,84476] 0 2024-09-21T00:56:32.283 INFO:tasks.workunit.client.1.smithi187.stdout:4/278: dwrite d2/d3/da/f1f [4194304,4194304] 0 2024-09-21T00:56:32.285 INFO:tasks.workunit.client.1.smithi187.stdout:8/316: read dc/d1c/d3e/f53 [226456,18628] 0 2024-09-21T00:56:32.286 INFO:tasks.workunit.client.1.smithi187.stdout:3/261: dwrite d9/d19/d1c/f38 [0,4194304] 0 2024-09-21T00:56:32.286 INFO:tasks.workunit.client.1.smithi187.stdout:8/317: read f8 [2736358,34384] 0 2024-09-21T00:56:32.286 INFO:tasks.workunit.client.1.smithi187.stdout:4/279: write d2/d3/f33 [671881,23435] 0 2024-09-21T00:56:32.289 INFO:tasks.workunit.client.1.smithi187.stdout:8/318: readlink dc/l22 0 2024-09-21T00:56:32.290 INFO:tasks.workunit.client.1.smithi187.stdout:1/291: dread d4/d6/d8/f37 [0,4194304] 0 2024-09-21T00:56:32.291 INFO:tasks.workunit.client.1.smithi187.stdout:8/319: creat dc/d2f/f65 x:0 0 0 2024-09-21T00:56:32.292 INFO:tasks.workunit.client.1.smithi187.stdout:4/280: mkdir d2/d3/da/d2f/d32/d22/d37/d51 0 2024-09-21T00:56:32.294 INFO:tasks.workunit.client.1.smithi187.stdout:1/292: mkdir d4/d6/d8/d35/d4c/d5b 0 2024-09-21T00:56:32.294 INFO:tasks.workunit.client.1.smithi187.stdout:4/281: readlink d2/d3/lb 0 2024-09-21T00:56:32.295 INFO:tasks.workunit.client.1.smithi187.stdout:8/320: creat dc/d2f/d37/f66 x:0 0 0 2024-09-21T00:56:32.296 INFO:tasks.workunit.client.1.smithi187.stdout:9/419: sync 2024-09-21T00:56:32.296 INFO:tasks.workunit.client.1.smithi187.stdout:0/268: sync 2024-09-21T00:56:32.297 INFO:tasks.workunit.client.1.smithi187.stdout:1/293: write d4/d6/d23/f54 [810962,72071] 0 2024-09-21T00:56:32.300 INFO:tasks.workunit.client.1.smithi187.stdout:9/420: chown d4/d13/d20/d2b 197222250 1 2024-09-21T00:56:32.301 INFO:tasks.workunit.client.1.smithi187.stdout:0/269: readlink d0/d17/d18/l1e 0 2024-09-21T00:56:32.301 INFO:tasks.workunit.client.1.smithi187.stdout:3/262: dwrite d9/d19/d1c/f41 [0,4194304] 0 2024-09-21T00:56:32.301 INFO:tasks.workunit.client.1.smithi187.stdout:4/282: symlink d2/d3/da/d2f/d32/d26/l52 0 2024-09-21T00:56:32.304 INFO:tasks.workunit.client.1.smithi187.stdout:7/253: truncate d1/dc/f12 1260605 0 2024-09-21T00:56:32.305 INFO:tasks.workunit.client.1.smithi187.stdout:9/421: mkdir d4/d10/d8f 0 2024-09-21T00:56:32.305 INFO:tasks.workunit.client.1.smithi187.stdout:1/294: mknod d4/d6/d23/d2e/c5c 0 2024-09-21T00:56:32.306 INFO:tasks.workunit.client.1.smithi187.stdout:5/267: rename d0/d19/f23 to d0/d19/f61 0 2024-09-21T00:56:32.310 INFO:tasks.workunit.client.1.smithi187.stdout:8/321: dwrite dc/d1c/f2d [0,4194304] 0 2024-09-21T00:56:32.310 INFO:tasks.workunit.client.1.smithi187.stdout:4/283: write d2/d3/da/d2f/d32/f4e [1480450,6924] 0 2024-09-21T00:56:32.312 INFO:tasks.workunit.client.1.smithi187.stdout:7/254: mkdir d1/d18/d31/d33/d3b/d62 0 2024-09-21T00:56:32.313 INFO:tasks.workunit.client.1.smithi187.stdout:5/268: mkdir d0/dc/d1f/d26/d62 0 2024-09-21T00:56:32.313 INFO:tasks.workunit.client.1.smithi187.stdout:9/422: mkdir d4/d61/d6a/d90 0 2024-09-21T00:56:32.314 INFO:tasks.workunit.client.1.smithi187.stdout:0/270: dread d0/d17/d1c/d23/f19 [4194304,4194304] 0 2024-09-21T00:56:32.314 INFO:tasks.workunit.client.1.smithi187.stdout:8/322: rmdir dc/d44 39 2024-09-21T00:56:32.316 INFO:tasks.workunit.client.1.smithi187.stdout:8/323: fdatasync dc/d2f/d34/f5e 0 2024-09-21T00:56:32.316 INFO:tasks.workunit.client.1.smithi187.stdout:9/423: rmdir d4/d61/d6a 39 2024-09-21T00:56:32.316 INFO:tasks.workunit.client.1.smithi187.stdout:4/284: read d2/d3/da/d16/f3c [1080287,96758] 0 2024-09-21T00:56:32.318 INFO:tasks.workunit.client.1.smithi187.stdout:8/324: read - dc/f47 zero size 2024-09-21T00:56:32.319 INFO:tasks.workunit.client.1.smithi187.stdout:0/271: unlink d0/d17/d1c/d23/d36/f3f 0 2024-09-21T00:56:32.323 INFO:tasks.workunit.client.1.smithi187.stdout:5/269: dwrite d0/d19/d14/d1b/d27/f35 [0,4194304] 0 2024-09-21T00:56:32.325 INFO:tasks.workunit.client.1.smithi187.stdout:8/325: symlink dc/d2f/d34/l67 0 2024-09-21T00:56:32.327 INFO:tasks.workunit.client.1.smithi187.stdout:3/263: truncate d9/d19/d1c/f21 451903 0 2024-09-21T00:56:32.328 INFO:tasks.workunit.client.1.smithi187.stdout:3/264: chown d9/d13/c4b 4465404 1 2024-09-21T00:56:32.329 INFO:tasks.workunit.client.1.smithi187.stdout:8/326: symlink dc/d2f/d34/l68 0 2024-09-21T00:56:32.330 INFO:tasks.workunit.client.1.smithi187.stdout:5/270: dread d0/f7 [0,4194304] 0 2024-09-21T00:56:32.331 INFO:tasks.workunit.client.1.smithi187.stdout:7/255: truncate d1/d18/d31/d33/f46 146753 0 2024-09-21T00:56:32.332 INFO:tasks.workunit.client.1.smithi187.stdout:7/256: stat d1/d55 0 2024-09-21T00:56:32.333 INFO:tasks.workunit.client.1.smithi187.stdout:3/265: symlink d9/d13/d20/l55 0 2024-09-21T00:56:32.334 INFO:tasks.workunit.client.1.smithi187.stdout:9/424: link d4/d8/d46/d54/c67 d4/c91 0 2024-09-21T00:56:32.336 INFO:tasks.workunit.client.1.smithi187.stdout:7/257: symlink d1/dc/d15/d22/d3e/l63 0 2024-09-21T00:56:32.337 INFO:tasks.workunit.client.1.smithi187.stdout:9/425: mkdir d4/d8/d44/d6e/d92 0 2024-09-21T00:56:32.338 INFO:tasks.workunit.client.1.smithi187.stdout:3/266: mkdir d9/d19/d42/d53/d56 0 2024-09-21T00:56:32.339 INFO:tasks.workunit.client.1.smithi187.stdout:9/426: rmdir d4/d8/d44/d6e 39 2024-09-21T00:56:32.344 INFO:tasks.workunit.client.1.smithi187.stdout:8/327: write dc/d2f/f41 [83573,2131] 0 2024-09-21T00:56:32.345 INFO:tasks.workunit.client.1.smithi187.stdout:3/267: dread d9/d13/f2c [4194304,4194304] 0 2024-09-21T00:56:32.346 INFO:tasks.workunit.client.1.smithi187.stdout:5/271: write d0/d19/d14/f21 [2387994,90580] 0 2024-09-21T00:56:32.348 INFO:tasks.workunit.client.1.smithi187.stdout:8/328: write dc/f62 [625255,23173] 0 2024-09-21T00:56:32.350 INFO:tasks.workunit.client.1.smithi187.stdout:9/427: dwrite d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:32.350 INFO:tasks.workunit.client.1.smithi187.stdout:8/329: chown dc/d1c/f21 10 1 2024-09-21T00:56:32.354 INFO:tasks.workunit.client.1.smithi187.stdout:8/330: mkdir dc/d2f/d54/d69 0 2024-09-21T00:56:32.357 INFO:tasks.workunit.client.1.smithi187.stdout:5/272: write d0/d19/f15 [215381,62969] 0 2024-09-21T00:56:32.361 INFO:tasks.workunit.client.1.smithi187.stdout:7/258: dread d1/d18/d31/f39 [0,4194304] 0 2024-09-21T00:56:32.361 INFO:tasks.workunit.client.1.smithi187.stdout:8/331: creat dc/d44/f6a x:0 0 0 2024-09-21T00:56:32.363 INFO:tasks.workunit.client.1.smithi187.stdout:3/268: dwrite d9/d19/d43/f52 [0,4194304] 0 2024-09-21T00:56:32.364 INFO:tasks.workunit.client.1.smithi187.stdout:8/332: write dc/f26 [1010083,62571] 0 2024-09-21T00:56:32.365 INFO:tasks.workunit.client.1.smithi187.stdout:9/428: dwrite d4/d10/f4a [0,4194304] 0 2024-09-21T00:56:32.365 INFO:tasks.workunit.client.1.smithi187.stdout:3/269: chown d9/d19/d1c/f38 4645 1 2024-09-21T00:56:32.367 INFO:tasks.workunit.client.1.smithi187.stdout:3/270: write d9/d13/f3d [1478442,92916] 0 2024-09-21T00:56:32.372 INFO:tasks.workunit.client.1.smithi187.stdout:9/429: read d4/d8/f22 [105474,90228] 0 2024-09-21T00:56:32.372 INFO:tasks.workunit.client.1.smithi187.stdout:7/259: dread d1/dc/d15/d22/d3e/f59 [0,4194304] 0 2024-09-21T00:56:32.373 INFO:tasks.workunit.client.1.smithi187.stdout:5/273: rename d0/d19/d14/d1b/d27/d3a/l3e to d0/d19/d14/l63 0 2024-09-21T00:56:32.374 INFO:tasks.workunit.client.1.smithi187.stdout:8/333: symlink dc/l6b 0 2024-09-21T00:56:32.374 INFO:tasks.workunit.client.1.smithi187.stdout:3/271: unlink d9/d13/d20/l4a 0 2024-09-21T00:56:32.375 INFO:tasks.workunit.client.1.smithi187.stdout:8/334: write dc/f62 [504909,74330] 0 2024-09-21T00:56:32.378 INFO:tasks.workunit.client.1.smithi187.stdout:9/430: symlink d4/d13/d14/d28/d72/l93 0 2024-09-21T00:56:32.378 INFO:tasks.workunit.client.1.smithi187.stdout:5/274: creat d0/dc/d1f/d26/f64 x:0 0 0 2024-09-21T00:56:32.378 INFO:tasks.workunit.client.1.smithi187.stdout:8/335: dread - dc/d44/f55 zero size 2024-09-21T00:56:32.378 INFO:tasks.workunit.client.1.smithi187.stdout:3/272: creat d9/d19/d43/f57 x:0 0 0 2024-09-21T00:56:32.380 INFO:tasks.workunit.client.1.smithi187.stdout:9/431: chown d4/d13/d14/d1d/f63 147652444 1 2024-09-21T00:56:32.381 INFO:tasks.workunit.client.1.smithi187.stdout:3/273: read d9/f4c [305033,110779] 0 2024-09-21T00:56:32.381 INFO:tasks.workunit.client.1.smithi187.stdout:9/432: stat d4/d13/d14 0 2024-09-21T00:56:32.385 INFO:tasks.workunit.client.1.smithi187.stdout:9/433: fdatasync d4/d13/d14/d5d/f79 0 2024-09-21T00:56:32.386 INFO:tasks.workunit.client.1.smithi187.stdout:7/260: dwrite d1/dc/d15/f57 [0,4194304] 0 2024-09-21T00:56:32.387 INFO:tasks.workunit.client.1.smithi187.stdout:6/238: sync 2024-09-21T00:56:32.389 INFO:tasks.workunit.client.1.smithi187.stdout:6/239: chown d7/f32 26465 1 2024-09-21T00:56:32.391 INFO:tasks.workunit.client.1.smithi187.stdout:9/434: chown d4/d13/d20/d2b/f7b 0 1 2024-09-21T00:56:32.392 INFO:tasks.workunit.client.1.smithi187.stdout:8/336: dwrite dc/d2f/f65 [0,4194304] 0 2024-09-21T00:56:32.392 INFO:tasks.workunit.client.1.smithi187.stdout:3/274: dread d9/d19/d1c/f3e [0,4194304] 0 2024-09-21T00:56:32.396 INFO:tasks.workunit.client.1.smithi187.stdout:5/275: dwrite d0/d19/d30/f60 [0,4194304] 0 2024-09-21T00:56:32.398 INFO:tasks.workunit.client.1.smithi187.stdout:3/275: symlink d9/d19/d42/l58 0 2024-09-21T00:56:32.399 INFO:tasks.workunit.client.1.smithi187.stdout:6/240: mknod d7/d2a/d29/c46 0 2024-09-21T00:56:32.401 INFO:tasks.workunit.client.1.smithi187.stdout:8/337: read dc/f12 [2703525,121460] 0 2024-09-21T00:56:32.401 INFO:tasks.workunit.client.1.smithi187.stdout:9/435: dread d4/f1a [0,4194304] 0 2024-09-21T00:56:32.403 INFO:tasks.workunit.client.1.smithi187.stdout:3/276: creat d9/d19/d42/d53/f59 x:0 0 0 2024-09-21T00:56:32.403 INFO:tasks.workunit.client.1.smithi187.stdout:8/338: readlink dc/l25 0 2024-09-21T00:56:32.404 INFO:tasks.workunit.client.1.smithi187.stdout:9/436: truncate d4/f3b 529666 0 2024-09-21T00:56:32.404 INFO:tasks.workunit.client.1.smithi187.stdout:6/241: mknod d7/d2a/d29/d40/c47 0 2024-09-21T00:56:32.405 INFO:tasks.workunit.client.1.smithi187.stdout:8/339: creat dc/d44/f6c x:0 0 0 2024-09-21T00:56:32.406 INFO:tasks.workunit.client.1.smithi187.stdout:3/277: fsync d9/d13/d20/f2e 0 2024-09-21T00:56:32.406 INFO:tasks.workunit.client.1.smithi187.stdout:6/242: dread - d7/d2a/d29/f3f zero size 2024-09-21T00:56:32.407 INFO:tasks.workunit.client.1.smithi187.stdout:9/437: mkdir d4/d13/d20/d2b/d94 0 2024-09-21T00:56:32.407 INFO:tasks.workunit.client.1.smithi187.stdout:3/278: dread - d9/d19/d42/f45 zero size 2024-09-21T00:56:32.408 INFO:tasks.workunit.client.1.smithi187.stdout:8/340: symlink dc/d2f/d54/l6d 0 2024-09-21T00:56:32.410 INFO:tasks.workunit.client.1.smithi187.stdout:8/341: chown dc/d2f/l56 155407 1 2024-09-21T00:56:32.410 INFO:tasks.workunit.client.1.smithi187.stdout:6/243: rename d7/d2a/f10 to d7/d2a/d29/f48 0 2024-09-21T00:56:32.412 INFO:tasks.workunit.client.1.smithi187.stdout:8/342: write dc/f26 [328885,60378] 0 2024-09-21T00:56:32.416 INFO:tasks.workunit.client.1.smithi187.stdout:5/276: write d0/dc/f11 [63273,40838] 0 2024-09-21T00:56:32.418 INFO:tasks.workunit.client.1.smithi187.stdout:9/438: dwrite d4/d8/f64 [0,4194304] 0 2024-09-21T00:56:32.420 INFO:tasks.workunit.client.1.smithi187.stdout:3/279: dwrite d9/d19/d1c/f50 [0,4194304] 0 2024-09-21T00:56:32.421 INFO:tasks.workunit.client.1.smithi187.stdout:7/261: dread d1/f1c [0,4194304] 0 2024-09-21T00:56:32.424 INFO:tasks.workunit.client.1.smithi187.stdout:3/280: chown d9/f4e 1 1 2024-09-21T00:56:32.427 INFO:tasks.workunit.client.1.smithi187.stdout:6/244: dwrite d7/f14 [8388608,4194304] 0 2024-09-21T00:56:32.428 INFO:tasks.workunit.client.1.smithi187.stdout:7/262: chown d1/d18/f29 6 1 2024-09-21T00:56:32.431 INFO:tasks.workunit.client.1.smithi187.stdout:7/263: write d1/f1a [2556420,114971] 0 2024-09-21T00:56:32.432 INFO:tasks.workunit.client.1.smithi187.stdout:8/343: dread dc/d1c/d29/f31 [0,4194304] 0 2024-09-21T00:56:32.433 INFO:tasks.workunit.client.1.smithi187.stdout:3/281: rename d9/d19/d42/l51 to d9/d19/d43/l5a 0 2024-09-21T00:56:32.435 INFO:tasks.workunit.client.1.smithi187.stdout:5/277: dread d0/d19/f61 [0,4194304] 0 2024-09-21T00:56:32.436 INFO:tasks.workunit.client.1.smithi187.stdout:5/278: readlink d0/l12 0 2024-09-21T00:56:32.437 INFO:tasks.workunit.client.1.smithi187.stdout:6/245: creat d7/d2a/d29/f49 x:0 0 0 2024-09-21T00:56:32.438 INFO:tasks.workunit.client.1.smithi187.stdout:9/439: getdents d4/d61/d6a 0 2024-09-21T00:56:32.440 INFO:tasks.workunit.client.1.smithi187.stdout:8/344: getdents dc/d2f 0 2024-09-21T00:56:32.443 INFO:tasks.workunit.client.1.smithi187.stdout:9/440: chown d4/d13/d14/f1e 71 1 2024-09-21T00:56:32.443 INFO:tasks.workunit.client.1.smithi187.stdout:3/282: dread d9/f11 [4194304,4194304] 0 2024-09-21T00:56:32.443 INFO:tasks.workunit.client.1.smithi187.stdout:8/345: dread - dc/d2f/d34/f5e zero size 2024-09-21T00:56:32.444 INFO:tasks.workunit.client.1.smithi187.stdout:7/264: dwrite d1/d18/d31/d33/d3b/f3f [0,4194304] 0 2024-09-21T00:56:32.445 INFO:tasks.workunit.client.1.smithi187.stdout:6/246: link d7/d2a/fb d7/f4a 0 2024-09-21T00:56:32.445 INFO:tasks.workunit.client.1.smithi187.stdout:5/279: dread d0/d19/d14/f3d [0,4194304] 0 2024-09-21T00:56:32.446 INFO:tasks.workunit.client.1.smithi187.stdout:2/316: sync 2024-09-21T00:56:32.446 INFO:tasks.workunit.client.1.smithi187.stdout:6/247: stat d7/d24/f1e 0 2024-09-21T00:56:32.449 INFO:tasks.workunit.client.1.smithi187.stdout:8/346: symlink dc/d2f/d34/d4b/l6e 0 2024-09-21T00:56:32.469 INFO:tasks.workunit.client.1.smithi187.stdout:6/248: creat d7/d2a/d29/d40/f4b x:0 0 0 2024-09-21T00:56:32.469 INFO:tasks.workunit.client.1.smithi187.stdout:8/347: stat dc/d44/f5d 0 2024-09-21T00:56:32.470 INFO:tasks.workunit.client.1.smithi187.stdout:5/280: rmdir d0/dc/d1f/d26/d62 0 2024-09-21T00:56:32.471 INFO:tasks.workunit.client.1.smithi187.stdout:2/317: fsync d2/d3/d15/d1b/d3c/f74 0 2024-09-21T00:56:32.471 INFO:tasks.workunit.client.1.smithi187.stdout:6/249: fsync d7/d24/f42 0 2024-09-21T00:56:32.472 INFO:tasks.workunit.client.1.smithi187.stdout:8/348: write dc/f26 [1949091,38172] 0 2024-09-21T00:56:32.474 INFO:tasks.workunit.client.1.smithi187.stdout:3/283: dwrite d9/d13/f54 [0,4194304] 0 2024-09-21T00:56:32.476 INFO:tasks.workunit.client.1.smithi187.stdout:7/265: dwrite d1/d18/d31/f39 [0,4194304] 0 2024-09-21T00:56:32.476 INFO:tasks.workunit.client.1.smithi187.stdout:5/281: creat d0/d19/d30/f65 x:0 0 0 2024-09-21T00:56:32.478 INFO:tasks.workunit.client.1.smithi187.stdout:8/349: read dc/d2f/f36 [792772,63623] 0 2024-09-21T00:56:32.479 INFO:tasks.workunit.client.1.smithi187.stdout:6/250: fsync d7/d2a/fb 0 2024-09-21T00:56:32.479 INFO:tasks.workunit.client.1.smithi187.stdout:3/284: creat d9/d19/d1c/f5b x:0 0 0 2024-09-21T00:56:32.480 INFO:tasks.workunit.client.1.smithi187.stdout:2/318: mknod d2/d3/d15/d1b/d1c/d2d/d4c/c76 0 2024-09-21T00:56:32.481 INFO:tasks.workunit.client.1.smithi187.stdout:8/350: dread - dc/d2f/d34/f4d zero size 2024-09-21T00:56:32.483 INFO:tasks.workunit.client.1.smithi187.stdout:7/266: mkdir d1/d18/d31/d41/d64 0 2024-09-21T00:56:32.486 INFO:tasks.workunit.client.1.smithi187.stdout:6/251: creat d7/d24/f4c x:0 0 0 2024-09-21T00:56:32.489 INFO:tasks.workunit.client.1.smithi187.stdout:2/319: creat d2/dc/d2e/d4a/f77 x:0 0 0 2024-09-21T00:56:32.490 INFO:tasks.workunit.client.1.smithi187.stdout:7/267: dwrite d1/dc/f13 [0,4194304] 0 2024-09-21T00:56:32.490 INFO:tasks.workunit.client.1.smithi187.stdout:7/268: chown d1/c4b 3918274 1 2024-09-21T00:56:32.493 INFO:tasks.workunit.client.1.smithi187.stdout:6/252: unlink d7/f14 0 2024-09-21T00:56:32.500 INFO:tasks.workunit.client.1.smithi187.stdout:5/282: link d0/dc/d1f/d26/l52 d0/d19/d14/d57/l66 0 2024-09-21T00:56:32.501 INFO:tasks.workunit.client.1.smithi187.stdout:3/285: link d9/d19/c1b d9/d19/c5c 0 2024-09-21T00:56:32.501 INFO:tasks.workunit.client.1.smithi187.stdout:6/253: dwrite d7/d24/f3d [0,4194304] 0 2024-09-21T00:56:32.504 INFO:tasks.workunit.client.1.smithi187.stdout:8/351: dwrite dc/d1c/f33 [0,4194304] 0 2024-09-21T00:56:32.505 INFO:tasks.workunit.client.1.smithi187.stdout:6/254: creat d7/d2a/d29/d40/f4d x:0 0 0 2024-09-21T00:56:32.506 INFO:tasks.workunit.client.1.smithi187.stdout:8/352: fdatasync dc/f26 0 2024-09-21T00:56:32.506 INFO:tasks.workunit.client.1.smithi187.stdout:3/286: unlink d9/d19/c1b 0 2024-09-21T00:56:32.511 INFO:tasks.workunit.client.1.smithi187.stdout:8/353: dread dc/d2f/f36 [0,4194304] 0 2024-09-21T00:56:32.512 INFO:tasks.workunit.client.1.smithi187.stdout:8/354: chown dc/d2f/d37/f57 169279 1 2024-09-21T00:56:32.515 INFO:tasks.workunit.client.1.smithi187.stdout:3/287: write d9/f4c [1274443,116263] 0 2024-09-21T00:56:32.515 INFO:tasks.workunit.client.1.smithi187.stdout:2/320: dwrite d2/d3/d15/d1b/f5e [0,4194304] 0 2024-09-21T00:56:32.518 INFO:tasks.workunit.client.1.smithi187.stdout:7/269: truncate d1/dc/d15/f57 2798082 0 2024-09-21T00:56:32.520 INFO:tasks.workunit.client.1.smithi187.stdout:8/355: creat dc/d2f/d54/f6f x:0 0 0 2024-09-21T00:56:32.526 INFO:tasks.workunit.client.1.smithi187.stdout:6/255: write d7/f4a [2107751,92268] 0 2024-09-21T00:56:32.527 INFO:tasks.workunit.client.1.smithi187.stdout:2/321: dwrite d2/d3/d15/d1b/d1c/f6a [0,4194304] 0 2024-09-21T00:56:32.528 INFO:tasks.workunit.client.1.smithi187.stdout:3/288: creat d9/d19/d42/d53/d56/f5d x:0 0 0 2024-09-21T00:56:32.529 INFO:tasks.workunit.client.1.smithi187.stdout:8/356: symlink dc/d1c/d3e/l70 0 2024-09-21T00:56:32.530 INFO:tasks.workunit.client.1.smithi187.stdout:0/272: sync 2024-09-21T00:56:32.530 INFO:tasks.workunit.client.1.smithi187.stdout:4/285: sync 2024-09-21T00:56:32.530 INFO:tasks.workunit.client.1.smithi187.stdout:1/295: sync 2024-09-21T00:56:32.534 INFO:tasks.workunit.client.1.smithi187.stdout:7/270: dwrite d1/dc/d15/d2b/f61 [0,4194304] 0 2024-09-21T00:56:32.537 INFO:tasks.workunit.client.1.smithi187.stdout:5/283: dread d0/f3f [0,4194304] 0 2024-09-21T00:56:32.541 INFO:tasks.workunit.client.1.smithi187.stdout:8/357: unlink dc/d2f/d34/f4d 0 2024-09-21T00:56:32.543 INFO:tasks.workunit.client.1.smithi187.stdout:0/273: symlink d0/d17/d1c/l57 0 2024-09-21T00:56:32.544 INFO:tasks.workunit.client.1.smithi187.stdout:1/296: truncate d4/d6/d23/f2b 77866 0 2024-09-21T00:56:32.546 INFO:tasks.workunit.client.1.smithi187.stdout:4/286: rename d2/d3/f4c to d2/d3/da/d2f/d32/d24/f53 0 2024-09-21T00:56:32.548 INFO:tasks.workunit.client.1.smithi187.stdout:6/256: truncate d7/d2a/d29/d40/f20 1705929 0 2024-09-21T00:56:32.549 INFO:tasks.workunit.client.1.smithi187.stdout:2/322: dread d2/fb [0,4194304] 0 2024-09-21T00:56:32.552 INFO:tasks.workunit.client.1.smithi187.stdout:7/271: rename d1/dc/d15/l42 to d1/d55/l65 0 2024-09-21T00:56:32.554 INFO:tasks.workunit.client.1.smithi187.stdout:3/289: dwrite d9/d19/d1c/f41 [4194304,4194304] 0 2024-09-21T00:56:32.556 INFO:tasks.workunit.client.1.smithi187.stdout:0/274: fdatasync d0/d17/d1c/d23/df/f32 0 2024-09-21T00:56:32.557 INFO:tasks.workunit.client.1.smithi187.stdout:1/297: dwrite d4/d6/f5a [0,4194304] 0 2024-09-21T00:56:32.558 INFO:tasks.workunit.client.1.smithi187.stdout:4/287: creat d2/d3/da/d2f/d32/d22/d4f/f54 x:0 0 0 2024-09-21T00:56:32.559 INFO:tasks.workunit.client.1.smithi187.stdout:1/298: readlink d4/d6/d8/d35/l58 0 2024-09-21T00:56:32.560 INFO:tasks.workunit.client.1.smithi187.stdout:5/284: rename d0/d19 to d0/dc/d39/d46/d67 0 2024-09-21T00:56:32.564 INFO:tasks.workunit.client.1.smithi187.stdout:7/272: dwrite d1/d18/d31/d41/f45 [0,4194304] 0 2024-09-21T00:56:32.566 INFO:tasks.workunit.client.1.smithi187.stdout:7/273: chown d1/dc/d15/l20 4263581 1 2024-09-21T00:56:32.567 INFO:tasks.workunit.client.1.smithi187.stdout:7/274: chown d1/dc/d15/d2b 1339164 1 2024-09-21T00:56:32.571 INFO:tasks.workunit.client.1.smithi187.stdout:0/275: dwrite d0/d17/d1c/d23/df/d41/d3b/d46/f4f [0,4194304] 0 2024-09-21T00:56:32.572 INFO:tasks.workunit.client.1.smithi187.stdout:3/290: dread d9/d13/f3d [0,4194304] 0 2024-09-21T00:56:32.577 INFO:tasks.workunit.client.1.smithi187.stdout:1/299: mkdir d4/d6/d49/d5d 0 2024-09-21T00:56:32.582 INFO:tasks.workunit.client.1.smithi187.stdout:8/358: rename dc/d1c/f2d to dc/d44/f71 0 2024-09-21T00:56:32.582 INFO:tasks.workunit.client.1.smithi187.stdout:8/359: chown dc/d2f/d54 4 1 2024-09-21T00:56:32.582 INFO:tasks.workunit.client.1.smithi187.stdout:5/285: mkdir d0/dc/d39/d46/d67/d30/d68 0 2024-09-21T00:56:32.584 INFO:tasks.workunit.client.1.smithi187.stdout:6/257: creat d7/f4e x:0 0 0 2024-09-21T00:56:32.585 INFO:tasks.workunit.client.1.smithi187.stdout:5/286: write d0/dc/d39/d46/d67/d14/d1b/f1c [3910984,126266] 0 2024-09-21T00:56:32.587 INFO:tasks.workunit.client.1.smithi187.stdout:8/360: dwrite dc/d44/f55 [0,4194304] 0 2024-09-21T00:56:32.589 INFO:tasks.workunit.client.1.smithi187.stdout:7/275: creat d1/d18/d31/d33/d3b/f66 x:0 0 0 2024-09-21T00:56:32.591 INFO:tasks.workunit.client.1.smithi187.stdout:7/276: truncate d1/d18/d31/f36 529844 0 2024-09-21T00:56:32.595 INFO:tasks.workunit.client.1.smithi187.stdout:4/288: mknod d2/d3/da/d2f/d32/d22/d37/d51/c55 0 2024-09-21T00:56:32.595 INFO:tasks.workunit.client.1.smithi187.stdout:4/289: stat d2/d3/f33 0 2024-09-21T00:56:32.596 INFO:tasks.workunit.client.1.smithi187.stdout:4/290: write d2/d3/da/f4d [126241,15715] 0 2024-09-21T00:56:32.597 INFO:tasks.workunit.client.1.smithi187.stdout:1/300: unlink d4/d6/d8/d35/f51 0 2024-09-21T00:56:32.612 INFO:tasks.workunit.client.1.smithi187.stdout:9/441: sync 2024-09-21T00:56:32.627 INFO:tasks.workunit.client.1.smithi187.stdout:6/258: unlink d7/f32 0 2024-09-21T00:56:32.627 INFO:tasks.workunit.client.1.smithi187.stdout:5/287: unlink d0/dc/d1f/d26/f56 0 2024-09-21T00:56:32.629 INFO:tasks.workunit.client.1.smithi187.stdout:3/291: rename d9/d19/d1c/f21 to d9/d19/d1c/f5e 0 2024-09-21T00:56:32.629 INFO:tasks.workunit.client.1.smithi187.stdout:7/277: creat d1/dc/d15/f67 x:0 0 0 2024-09-21T00:56:32.629 INFO:tasks.workunit.client.1.smithi187.stdout:5/288: chown d0/dc/d39/f4c 1831803207 1 2024-09-21T00:56:32.632 INFO:tasks.workunit.client.1.smithi187.stdout:7/278: chown d1/dc/c10 749466989 1 2024-09-21T00:56:32.632 INFO:tasks.workunit.client.1.smithi187.stdout:1/301: dread d4/d6/d8/f4e [0,4194304] 0 2024-09-21T00:56:32.633 INFO:tasks.workunit.client.1.smithi187.stdout:4/291: dwrite d2/d3/da/d2f/d32/f4e [0,4194304] 0 2024-09-21T00:56:32.635 INFO:tasks.workunit.client.1.smithi187.stdout:5/289: dread d0/f7 [0,4194304] 0 2024-09-21T00:56:32.636 INFO:tasks.workunit.client.1.smithi187.stdout:7/279: dread - d1/dc/d15/f67 zero size 2024-09-21T00:56:32.636 INFO:tasks.workunit.client.1.smithi187.stdout:1/302: read - d4/d6/d23/f45 zero size 2024-09-21T00:56:32.640 INFO:tasks.workunit.client.1.smithi187.stdout:6/259: creat d7/f4f x:0 0 0 2024-09-21T00:56:32.640 INFO:tasks.workunit.client.1.smithi187.stdout:4/292: mkdir d2/d3/d56 0 2024-09-21T00:56:32.640 INFO:tasks.workunit.client.1.smithi187.stdout:0/276: dwrite d0/d17/d1c/d23/f30 [0,4194304] 0 2024-09-21T00:56:32.642 INFO:tasks.workunit.client.1.smithi187.stdout:3/292: dwrite d9/fd [0,4194304] 0 2024-09-21T00:56:32.642 INFO:tasks.workunit.client.1.smithi187.stdout:7/280: dread d1/d18/d31/f51 [0,4194304] 0 2024-09-21T00:56:32.644 INFO:tasks.workunit.client.1.smithi187.stdout:1/303: mknod d4/d6/d8/d35/d4c/d5b/c5e 0 2024-09-21T00:56:32.648 INFO:tasks.workunit.client.1.smithi187.stdout:7/281: chown d1/d18/d31/d33/d3b/f4a 75592159 1 2024-09-21T00:56:32.648 INFO:tasks.workunit.client.1.smithi187.stdout:3/293: chown d9/d13/d20/f3c 16 1 2024-09-21T00:56:32.649 INFO:tasks.workunit.client.1.smithi187.stdout:6/260: mkdir d7/d2a/d29/d40/d50 0 2024-09-21T00:56:32.649 INFO:tasks.workunit.client.1.smithi187.stdout:0/277: symlink d0/d17/d1c/d23/df/d41/d3b/d46/l58 0 2024-09-21T00:56:32.651 INFO:tasks.workunit.client.1.smithi187.stdout:1/304: creat d4/d6/d8/d35/d4c/f5f x:0 0 0 2024-09-21T00:56:32.652 INFO:tasks.workunit.client.1.smithi187.stdout:6/261: write d7/d2a/d29/d40/f4d [56831,108697] 0 2024-09-21T00:56:32.654 INFO:tasks.workunit.client.1.smithi187.stdout:5/290: rename d0/dc/d39/d46/d67/d14/d1b/d27/d3a/l43 to d0/dc/d39/d46/d67/d14/d1b/d27/d3a/l69 0 2024-09-21T00:56:32.654 INFO:tasks.workunit.client.1.smithi187.stdout:1/305: read - d4/d6/d23/f45 zero size 2024-09-21T00:56:32.656 INFO:tasks.workunit.client.1.smithi187.stdout:5/291: dread - d0/dc/d39/d46/d67/d30/f65 zero size 2024-09-21T00:56:32.656 INFO:tasks.workunit.client.1.smithi187.stdout:6/262: symlink d7/d2a/d29/d40/l51 0 2024-09-21T00:56:32.657 INFO:tasks.workunit.client.1.smithi187.stdout:5/292: stat d0/cb 0 2024-09-21T00:56:32.658 INFO:tasks.workunit.client.1.smithi187.stdout:5/293: dread - d0/dc/d39/f4d zero size 2024-09-21T00:56:32.658 INFO:tasks.workunit.client.1.smithi187.stdout:7/282: creat d1/f68 x:0 0 0 2024-09-21T00:56:32.661 INFO:tasks.workunit.client.1.smithi187.stdout:5/294: fsync d0/dc/d39/d46/d67/d14/d38/f5b 0 2024-09-21T00:56:32.662 INFO:tasks.workunit.client.1.smithi187.stdout:7/283: chown d1/d55/l65 36379 1 2024-09-21T00:56:32.662 INFO:tasks.workunit.client.1.smithi187.stdout:6/263: creat d7/f52 x:0 0 0 2024-09-21T00:56:32.662 INFO:tasks.workunit.client.1.smithi187.stdout:0/278: dwrite d0/d17/d1c/f45 [0,4194304] 0 2024-09-21T00:56:32.663 INFO:tasks.workunit.client.1.smithi187.stdout:7/284: fsync d1/d18/d31/f36 0 2024-09-21T00:56:32.663 INFO:tasks.workunit.client.1.smithi187.stdout:6/264: chown d7/d2a/c2e 11 1 2024-09-21T00:56:32.665 INFO:tasks.workunit.client.1.smithi187.stdout:5/295: write d0/dc/d39/d46/d67/d14/f3d [507022,22499] 0 2024-09-21T00:56:32.666 INFO:tasks.workunit.client.1.smithi187.stdout:7/285: write d1/d18/d31/d33/d3b/f66 [141000,105404] 0 2024-09-21T00:56:32.666 INFO:tasks.workunit.client.1.smithi187.stdout:0/279: creat d0/d17/d1c/d23/df/d41/d3b/f59 x:0 0 0 2024-09-21T00:56:32.672 INFO:tasks.workunit.client.1.smithi187.stdout:6/265: dwrite d7/f52 [0,4194304] 0 2024-09-21T00:56:32.675 INFO:tasks.workunit.client.1.smithi187.stdout:7/286: symlink d1/d18/d31/d41/d64/l69 0 2024-09-21T00:56:32.675 INFO:tasks.workunit.client.1.smithi187.stdout:5/296: dread d0/dc/d39/d46/d67/d14/d38/f4f [0,4194304] 0 2024-09-21T00:56:32.678 INFO:tasks.workunit.client.1.smithi187.stdout:6/266: dread d7/f2c [0,4194304] 0 2024-09-21T00:56:32.679 INFO:tasks.workunit.client.1.smithi187.stdout:5/297: creat d0/dc/d39/d46/d67/d30/f6a x:0 0 0 2024-09-21T00:56:32.680 INFO:tasks.workunit.client.1.smithi187.stdout:6/267: fsync d7/d2a/f28 0 2024-09-21T00:56:32.680 INFO:tasks.workunit.client.1.smithi187.stdout:6/268: chown d7/f4a 14224 1 2024-09-21T00:56:32.680 INFO:tasks.workunit.client.1.smithi187.stdout:6/269: stat d7/c2b 0 2024-09-21T00:56:32.682 INFO:tasks.workunit.client.1.smithi187.stdout:5/298: unlink d0/cb 0 2024-09-21T00:56:32.684 INFO:tasks.workunit.client.1.smithi187.stdout:5/299: mkdir d0/dc/d39/d46/d67/d30/d6b 0 2024-09-21T00:56:32.684 INFO:tasks.workunit.client.1.smithi187.stdout:5/300: chown d0/dc/d39/d46/d67/d14/l37 67285177 1 2024-09-21T00:56:32.687 INFO:tasks.workunit.client.1.smithi187.stdout:5/301: getdents d0/dc/d39/d46/d67/d14/d57/d5c 0 2024-09-21T00:56:32.688 INFO:tasks.workunit.client.1.smithi187.stdout:2/323: sync 2024-09-21T00:56:32.688 INFO:tasks.workunit.client.1.smithi187.stdout:4/293: truncate d2/d3/da/d2f/d32/d26/f44 1903211 0 2024-09-21T00:56:32.689 INFO:tasks.workunit.client.1.smithi187.stdout:3/294: truncate d9/f4c 1039829 0 2024-09-21T00:56:32.690 INFO:tasks.workunit.client.1.smithi187.stdout:2/324: write d2/dc/d2e/d4a/f4d [1196968,56871] 0 2024-09-21T00:56:32.691 INFO:tasks.workunit.client.1.smithi187.stdout:5/302: mkdir d0/dc/d39/d46/d67/d14/d38/d5a/d6c 0 2024-09-21T00:56:32.693 INFO:tasks.workunit.client.1.smithi187.stdout:2/325: creat d2/f78 x:0 0 0 2024-09-21T00:56:32.693 INFO:tasks.workunit.client.1.smithi187.stdout:4/294: truncate d2/d3/da/d2f/d32/d24/f45 4623825 0 2024-09-21T00:56:32.694 INFO:tasks.workunit.client.1.smithi187.stdout:5/303: unlink d0/fa 0 2024-09-21T00:56:32.696 INFO:tasks.workunit.client.1.smithi187.stdout:4/295: read d2/d3/f42 [696226,83022] 0 2024-09-21T00:56:32.696 INFO:tasks.workunit.client.1.smithi187.stdout:1/306: dwrite d4/d6/d8/f4e [0,4194304] 0 2024-09-21T00:56:32.696 INFO:tasks.workunit.client.1.smithi187.stdout:5/304: chown d0/dc/d39/d46/d67/d14 112786 1 2024-09-21T00:56:32.697 INFO:tasks.workunit.client.1.smithi187.stdout:3/295: dread d9/d19/d1c/f41 [4194304,4194304] 0 2024-09-21T00:56:32.698 INFO:tasks.workunit.client.1.smithi187.stdout:5/305: chown d0/f2d 47445 1 2024-09-21T00:56:32.699 INFO:tasks.workunit.client.1.smithi187.stdout:7/287: truncate d1/f7 597165 0 2024-09-21T00:56:32.700 INFO:tasks.workunit.client.1.smithi187.stdout:1/307: symlink d4/d6/d8/d35/d4c/d5b/l60 0 2024-09-21T00:56:32.700 INFO:tasks.workunit.client.1.smithi187.stdout:4/296: dread d2/d3/da/d2f/d32/d24/f28 [0,4194304] 0 2024-09-21T00:56:32.702 INFO:tasks.workunit.client.1.smithi187.stdout:6/270: write d7/d2a/f2f [727270,70084] 0 2024-09-21T00:56:32.707 INFO:tasks.workunit.client.1.smithi187.stdout:3/296: dwrite d9/d19/d1c/f38 [0,4194304] 0 2024-09-21T00:56:32.708 INFO:tasks.workunit.client.1.smithi187.stdout:4/297: symlink d2/d3/da/d2f/d32/d22/d4f/l57 0 2024-09-21T00:56:32.708 INFO:tasks.workunit.client.1.smithi187.stdout:1/308: rmdir d4/d6/d23/d2e/d53 39 2024-09-21T00:56:32.708 INFO:tasks.workunit.client.1.smithi187.stdout:3/297: chown d9/d13/c18 140 1 2024-09-21T00:56:32.710 INFO:tasks.workunit.client.1.smithi187.stdout:6/271: mknod d7/d2a/c53 0 2024-09-21T00:56:32.710 INFO:tasks.workunit.client.1.smithi187.stdout:3/298: write d9/fd [1170053,47295] 0 2024-09-21T00:56:32.712 INFO:tasks.workunit.client.1.smithi187.stdout:1/309: symlink d4/d6/d8/l61 0 2024-09-21T00:56:32.714 INFO:tasks.workunit.client.1.smithi187.stdout:3/299: chown d9/d19/d1c/f50 22153 1 2024-09-21T00:56:32.715 INFO:tasks.workunit.client.1.smithi187.stdout:4/298: mkdir d2/d3/da/d2f/d32/d26/d4a/d58 0 2024-09-21T00:56:32.715 INFO:tasks.workunit.client.1.smithi187.stdout:1/310: fsync d4/d6/d8/d35/d22/f57 0 2024-09-21T00:56:32.718 INFO:tasks.workunit.client.1.smithi187.stdout:6/272: creat d7/f54 x:0 0 0 2024-09-21T00:56:32.719 INFO:tasks.workunit.client.1.smithi187.stdout:3/300: mkdir d9/d19/d1c/d5f 0 2024-09-21T00:56:32.719 INFO:tasks.workunit.client.1.smithi187.stdout:2/326: read d2/f8 [938408,48281] 0 2024-09-21T00:56:32.721 INFO:tasks.workunit.client.1.smithi187.stdout:6/273: dread - d7/d2a/d29/f38 zero size 2024-09-21T00:56:32.721 INFO:tasks.workunit.client.1.smithi187.stdout:5/306: dwrite d0/dc/d39/d46/d67/d14/d38/f4f [0,4194304] 0 2024-09-21T00:56:32.722 INFO:tasks.workunit.client.1.smithi187.stdout:4/299: mknod d2/d3/d3b/c59 0 2024-09-21T00:56:32.723 INFO:tasks.workunit.client.1.smithi187.stdout:6/274: rename d7 to d7/d2a/d29/d55 22 2024-09-21T00:56:32.725 INFO:tasks.workunit.client.1.smithi187.stdout:1/311: dread d4/d6/f5a [0,4194304] 0 2024-09-21T00:56:32.725 INFO:tasks.workunit.client.1.smithi187.stdout:4/300: symlink d2/d3/da/d2f/l5a 0 2024-09-21T00:56:32.726 INFO:tasks.workunit.client.1.smithi187.stdout:6/275: fsync d7/d2a/d29/f49 0 2024-09-21T00:56:32.726 INFO:tasks.workunit.client.1.smithi187.stdout:2/327: creat d2/d3/d15/d1b/d1c/d2d/d62/f79 x:0 0 0 2024-09-21T00:56:32.727 INFO:tasks.workunit.client.1.smithi187.stdout:6/276: dread - d7/d2a/d29/f43 zero size 2024-09-21T00:56:32.728 INFO:tasks.workunit.client.1.smithi187.stdout:3/301: dread d9/f11 [4194304,4194304] 0 2024-09-21T00:56:32.728 INFO:tasks.workunit.client.1.smithi187.stdout:5/307: mkdir d0/dc/d39/d46/d67/d14/d38/d5a/d6d 0 2024-09-21T00:56:32.730 INFO:tasks.workunit.client.1.smithi187.stdout:6/277: rename d7/d2a/d29/d40/d50 to d7/d2a/d29/d40/d50/d56 22 2024-09-21T00:56:32.739 INFO:tasks.workunit.client.1.smithi187.stdout:3/302: write d9/d19/d1c/f5e [665540,128507] 0 2024-09-21T00:56:32.741 INFO:tasks.workunit.client.1.smithi187.stdout:5/308: dwrite d0/f55 [0,4194304] 0 2024-09-21T00:56:32.744 INFO:tasks.workunit.client.1.smithi187.stdout:6/278: dwrite d7/d2a/f28 [0,4194304] 0 2024-09-21T00:56:32.749 INFO:tasks.workunit.client.1.smithi187.stdout:6/279: stat d7/d2a 0 2024-09-21T00:56:32.751 INFO:tasks.workunit.client.1.smithi187.stdout:4/301: dwrite d2/d3/da/d2f/d32/d25/f2d [0,4194304] 0 2024-09-21T00:56:32.753 INFO:tasks.workunit.client.1.smithi187.stdout:6/280: dread - d7/f23 zero size 2024-09-21T00:56:32.754 INFO:tasks.workunit.client.1.smithi187.stdout:1/312: dread d4/d6/d8/d35/d22/f46 [0,4194304] 0 2024-09-21T00:56:32.754 INFO:tasks.workunit.client.1.smithi187.stdout:3/303: truncate d9/d19/d42/d53/d56/f5d 818103 0 2024-09-21T00:56:32.756 INFO:tasks.workunit.client.1.smithi187.stdout:5/309: dread d0/dc/d39/d46/d67/d14/f3d [0,4194304] 0 2024-09-21T00:56:32.757 INFO:tasks.workunit.client.1.smithi187.stdout:3/304: chown d9/f12 66081897 1 2024-09-21T00:56:32.757 INFO:tasks.workunit.client.1.smithi187.stdout:2/328: dread d2/d3/d15/d1b/d1c/f4b [0,4194304] 0 2024-09-21T00:56:32.759 INFO:tasks.workunit.client.1.smithi187.stdout:3/305: dread - d9/d13/d20/f3c zero size 2024-09-21T00:56:32.762 INFO:tasks.workunit.client.1.smithi187.stdout:2/329: symlink d2/d3/df/l7a 0 2024-09-21T00:56:32.762 INFO:tasks.workunit.client.1.smithi187.stdout:6/281: link d7/d2a/fb d7/f57 0 2024-09-21T00:56:32.764 INFO:tasks.workunit.client.1.smithi187.stdout:5/310: getdents d0/dc/d39/d46/d67/d14/d57/d5c 0 2024-09-21T00:56:32.766 INFO:tasks.workunit.client.1.smithi187.stdout:6/282: write d7/d24/f1e [571217,52123] 0 2024-09-21T00:56:32.767 INFO:tasks.workunit.client.1.smithi187.stdout:6/283: write d7/f52 [5227364,118090] 0 2024-09-21T00:56:32.768 INFO:tasks.workunit.client.1.smithi187.stdout:3/306: rename d9/d19/f3b to d9/d19/d1c/d5f/f60 0 2024-09-21T00:56:32.769 INFO:tasks.workunit.client.1.smithi187.stdout:3/307: read d9/f11 [4667814,116684] 0 2024-09-21T00:56:32.769 INFO:tasks.workunit.client.1.smithi187.stdout:5/311: creat d0/dc/d39/d46/f6e x:0 0 0 2024-09-21T00:56:32.770 INFO:tasks.workunit.client.1.smithi187.stdout:2/330: symlink d2/dc/d21/l7b 0 2024-09-21T00:56:32.770 INFO:tasks.workunit.client.1.smithi187.stdout:1/313: getdents d4/d6/d8/d35/d22/d2c 0 2024-09-21T00:56:32.771 INFO:tasks.workunit.client.1.smithi187.stdout:4/302: getdents d2/d3/da/d2f 0 2024-09-21T00:56:32.772 INFO:tasks.workunit.client.1.smithi187.stdout:6/284: creat d7/d24/f58 x:0 0 0 2024-09-21T00:56:32.773 INFO:tasks.workunit.client.1.smithi187.stdout:6/285: chown d7/d24 8756353 1 2024-09-21T00:56:32.773 INFO:tasks.workunit.client.1.smithi187.stdout:5/312: mkdir d0/dc/d6f 0 2024-09-21T00:56:32.775 INFO:tasks.workunit.client.1.smithi187.stdout:4/303: creat d2/d3/da/f5b x:0 0 0 2024-09-21T00:56:32.775 INFO:tasks.workunit.client.1.smithi187.stdout:2/331: dread d2/d3/d15/d1b/d1c/f4b [0,4194304] 0 2024-09-21T00:56:32.775 INFO:tasks.workunit.client.1.smithi187.stdout:3/308: fsync d9/fb 0 2024-09-21T00:56:32.776 INFO:tasks.workunit.client.1.smithi187.stdout:1/314: creat d4/f62 x:0 0 0 2024-09-21T00:56:32.778 INFO:tasks.workunit.client.1.smithi187.stdout:5/313: mknod d0/dc/d39/d46/d67/d14/c70 0 2024-09-21T00:56:32.779 INFO:tasks.workunit.client.1.smithi187.stdout:2/332: unlink c1 0 2024-09-21T00:56:32.780 INFO:tasks.workunit.client.1.smithi187.stdout:6/286: dread d7/ff [0,4194304] 0 2024-09-21T00:56:32.782 INFO:tasks.workunit.client.1.smithi187.stdout:5/314: creat d0/dc/d1f/d26/f71 x:0 0 0 2024-09-21T00:56:32.784 INFO:tasks.workunit.client.1.smithi187.stdout:4/304: fdatasync d2/d3/da/d2f/d32/d26/f44 0 2024-09-21T00:56:32.785 INFO:tasks.workunit.client.1.smithi187.stdout:6/287: unlink d7/f57 0 2024-09-21T00:56:32.787 INFO:tasks.workunit.client.1.smithi187.stdout:5/315: creat d0/dc/d39/d46/d67/d14/d1b/d27/d3a/f72 x:0 0 0 2024-09-21T00:56:32.788 INFO:tasks.workunit.client.1.smithi187.stdout:5/316: fsync d0/dc/d39/d46/d67/d14/d1b/f1c 0 2024-09-21T00:56:32.788 INFO:tasks.workunit.client.1.smithi187.stdout:5/317: dread - d0/dc/d39/d46/d67/d30/f34 zero size 2024-09-21T00:56:32.789 INFO:tasks.workunit.client.1.smithi187.stdout:4/305: creat d2/d3/da/d16/f5c x:0 0 0 2024-09-21T00:56:32.790 INFO:tasks.workunit.client.1.smithi187.stdout:3/309: mkdir d9/d19/d42/d53/d56/d61 0 2024-09-21T00:56:32.792 INFO:tasks.workunit.client.1.smithi187.stdout:5/318: creat d0/dc/d39/d46/d67/f73 x:0 0 0 2024-09-21T00:56:32.793 INFO:tasks.workunit.client.1.smithi187.stdout:4/306: mknod d2/d3/da/d2f/d32/d26/d4a/c5d 0 2024-09-21T00:56:32.795 INFO:tasks.workunit.client.1.smithi187.stdout:4/307: truncate d2/d3/da/d2f/d32/d24/f53 156992 0 2024-09-21T00:56:32.795 INFO:tasks.workunit.client.1.smithi187.stdout:6/288: rename d7/d24 to d7/d59 0 2024-09-21T00:56:32.798 INFO:tasks.workunit.client.1.smithi187.stdout:3/310: getdents d9 0 2024-09-21T00:56:32.799 INFO:tasks.workunit.client.1.smithi187.stdout:4/308: symlink d2/d3/da/d2f/d32/d26/d4a/d58/l5e 0 2024-09-21T00:56:32.799 INFO:tasks.workunit.client.1.smithi187.stdout:5/319: truncate d0/dc/d39/d46/d67/d14/d1b/d27/f2f 673772 0 2024-09-21T00:56:32.800 INFO:tasks.workunit.client.1.smithi187.stdout:4/309: dread d2/d3/da/d2f/d32/d24/f53 [0,4194304] 0 2024-09-21T00:56:32.800 INFO:tasks.workunit.client.1.smithi187.stdout:8/361: sync 2024-09-21T00:56:32.801 INFO:tasks.workunit.client.1.smithi187.stdout:4/310: chown d2/d3/f13 14488779 1 2024-09-21T00:56:32.801 INFO:tasks.workunit.client.1.smithi187.stdout:3/311: write d9/d19/d1c/f38 [3064237,36045] 0 2024-09-21T00:56:32.805 INFO:tasks.workunit.client.1.smithi187.stdout:8/362: mknod dc/d2f/d34/d4b/c72 0 2024-09-21T00:56:32.806 INFO:tasks.workunit.client.1.smithi187.stdout:4/311: mkdir d2/d3/da/d16/d5f 0 2024-09-21T00:56:32.807 INFO:tasks.workunit.client.1.smithi187.stdout:6/289: write d7/f4a [1223581,129323] 0 2024-09-21T00:56:32.809 INFO:tasks.workunit.client.1.smithi187.stdout:8/363: creat dc/d1c/d29/f73 x:0 0 0 2024-09-21T00:56:32.811 INFO:tasks.workunit.client.1.smithi187.stdout:5/320: write d0/dc/d39/d46/d67/f61 [1241170,126154] 0 2024-09-21T00:56:32.813 INFO:tasks.workunit.client.1.smithi187.stdout:8/364: creat dc/d2f/d54/f74 x:0 0 0 2024-09-21T00:56:32.814 INFO:tasks.workunit.client.1.smithi187.stdout:4/312: dwrite d2/d3/da/d2f/d32/d22/d4f/f54 [0,4194304] 0 2024-09-21T00:56:32.814 INFO:tasks.workunit.client.1.smithi187.stdout:6/290: getdents d7/d2a/d29/d40/d45 0 2024-09-21T00:56:32.817 INFO:tasks.workunit.client.1.smithi187.stdout:6/291: fdatasync d7/d2a/d29/f48 0 2024-09-21T00:56:32.817 INFO:tasks.workunit.client.1.smithi187.stdout:5/321: read d0/dc/d39/d46/d67/d30/f3b [3406707,62246] 0 2024-09-21T00:56:32.817 INFO:tasks.workunit.client.1.smithi187.stdout:8/365: write dc/f12 [256133,108230] 0 2024-09-21T00:56:32.818 INFO:tasks.workunit.client.1.smithi187.stdout:4/313: mkdir d2/d3/da/d2f/d32/d26/d4a/d60 0 2024-09-21T00:56:32.819 INFO:tasks.workunit.client.1.smithi187.stdout:8/366: dread - dc/d44/f6a zero size 2024-09-21T00:56:32.820 INFO:tasks.workunit.client.1.smithi187.stdout:3/312: dread d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:32.821 INFO:tasks.workunit.client.1.smithi187.stdout:5/322: write d0/dc/d39/d46/d67/d14/f21 [3479601,121802] 0 2024-09-21T00:56:32.822 INFO:tasks.workunit.client.1.smithi187.stdout:3/313: read - d9/f4e zero size 2024-09-21T00:56:32.823 INFO:tasks.workunit.client.1.smithi187.stdout:8/367: mkdir dc/d1c/d3e/d75 0 2024-09-21T00:56:32.823 INFO:tasks.workunit.client.1.smithi187.stdout:3/314: stat d9/l16 0 2024-09-21T00:56:32.823 INFO:tasks.workunit.client.1.smithi187.stdout:6/292: dread d7/d2a/f2f [0,4194304] 0 2024-09-21T00:56:32.824 INFO:tasks.workunit.client.1.smithi187.stdout:3/315: stat d9/d19/d1c/d5f/f60 0 2024-09-21T00:56:32.825 INFO:tasks.workunit.client.1.smithi187.stdout:4/314: link d2/d3/f33 d2/d3/da/d16/f61 0 2024-09-21T00:56:32.825 INFO:tasks.workunit.client.1.smithi187.stdout:8/368: unlink dc/d2f/d37/c4f 0 2024-09-21T00:56:32.826 INFO:tasks.workunit.client.1.smithi187.stdout:6/293: truncate d7/d59/f4c 603970 0 2024-09-21T00:56:32.828 INFO:tasks.workunit.client.1.smithi187.stdout:5/323: rename d0/dc/d39/d46/d67/d14/d57/l66 to d0/dc/d39/d46/l74 0 2024-09-21T00:56:32.829 INFO:tasks.workunit.client.1.smithi187.stdout:3/316: dread d9/f37 [0,4194304] 0 2024-09-21T00:56:32.829 INFO:tasks.workunit.client.1.smithi187.stdout:4/315: creat d2/d3/da/d2f/d32/d22/d4f/f62 x:0 0 0 2024-09-21T00:56:32.831 INFO:tasks.workunit.client.1.smithi187.stdout:6/294: creat d7/d2a/d29/d40/d45/f5a x:0 0 0 2024-09-21T00:56:32.832 INFO:tasks.workunit.client.1.smithi187.stdout:3/317: chown d9/d19/d42/d53/d56/d61 482975 1 2024-09-21T00:56:32.832 INFO:tasks.workunit.client.1.smithi187.stdout:5/324: creat d0/f75 x:0 0 0 2024-09-21T00:56:32.832 INFO:tasks.workunit.client.1.smithi187.stdout:4/316: chown d2/d3/da/d2f/l5a 43628472 1 2024-09-21T00:56:32.835 INFO:tasks.workunit.client.1.smithi187.stdout:5/325: mknod d0/dc/d39/c76 0 2024-09-21T00:56:32.835 INFO:tasks.workunit.client.1.smithi187.stdout:8/369: dwrite dc/d1c/d3e/f53 [0,4194304] 0 2024-09-21T00:56:32.836 INFO:tasks.workunit.client.1.smithi187.stdout:3/318: rmdir d9/d19/d42/d53/d56 39 2024-09-21T00:56:32.837 INFO:tasks.workunit.client.1.smithi187.stdout:6/295: link d7/f44 d7/d2a/f5b 0 2024-09-21T00:56:32.837 INFO:tasks.workunit.client.1.smithi187.stdout:4/317: fsync d2/d3/da/d2f/d32/d22/f3d 0 2024-09-21T00:56:32.839 INFO:tasks.workunit.client.1.smithi187.stdout:8/370: mknod dc/d2f/d54/c76 0 2024-09-21T00:56:32.839 INFO:tasks.workunit.client.1.smithi187.stdout:6/296: truncate d7/d2a/f2f 1287510 0 2024-09-21T00:56:32.840 INFO:tasks.workunit.client.1.smithi187.stdout:3/319: stat d9/d19/d42/d53/d56/d61 0 2024-09-21T00:56:32.841 INFO:tasks.workunit.client.1.smithi187.stdout:6/297: dread - d7/d2a/f5b zero size 2024-09-21T00:56:32.842 INFO:tasks.workunit.client.1.smithi187.stdout:4/318: mkdir d2/d3/da/d2f/d32/d22/d37/d63 0 2024-09-21T00:56:32.842 INFO:tasks.workunit.client.1.smithi187.stdout:8/371: write dc/d1c/d29/f48 [661934,48419] 0 2024-09-21T00:56:32.844 INFO:tasks.workunit.client.1.smithi187.stdout:8/372: write dc/d1c/d29/f73 [344057,87558] 0 2024-09-21T00:56:32.845 INFO:tasks.workunit.client.1.smithi187.stdout:8/373: readlink dc/l50 0 2024-09-21T00:56:32.846 INFO:tasks.workunit.client.1.smithi187.stdout:8/374: readlink dc/l4e 0 2024-09-21T00:56:32.848 INFO:tasks.workunit.client.1.smithi187.stdout:3/320: creat d9/d19/d42/d53/d56/f62 x:0 0 0 2024-09-21T00:56:32.848 INFO:tasks.workunit.client.1.smithi187.stdout:8/375: read dc/d1c/f21 [967706,113697] 0 2024-09-21T00:56:32.848 INFO:tasks.workunit.client.1.smithi187.stdout:6/298: dwrite d7/d59/f1e [0,4194304] 0 2024-09-21T00:56:32.849 INFO:tasks.workunit.client.1.smithi187.stdout:4/319: mknod d2/d3/da/d2f/d32/d26/d4a/d60/c64 0 2024-09-21T00:56:32.850 INFO:tasks.workunit.client.1.smithi187.stdout:3/321: write d9/d19/d1c/f47 [54769,69028] 0 2024-09-21T00:56:32.851 INFO:tasks.workunit.client.1.smithi187.stdout:4/320: chown d2/d3/da/f5b 492946 1 2024-09-21T00:56:32.853 INFO:tasks.workunit.client.1.smithi187.stdout:6/299: rename d7/d2a/c39 to d7/d2a/d29/d40/d45/c5c 0 2024-09-21T00:56:32.853 INFO:tasks.workunit.client.1.smithi187.stdout:5/326: write d0/dc/d39/d46/d67/d14/d1b/d27/f2f [59646,93254] 0 2024-09-21T00:56:32.854 INFO:tasks.workunit.client.1.smithi187.stdout:6/300: dread - d7/d59/f42 zero size 2024-09-21T00:56:32.856 INFO:tasks.workunit.client.1.smithi187.stdout:4/321: getdents d2/d3/da/d2f/d32/d25 0 2024-09-21T00:56:32.858 INFO:tasks.workunit.client.1.smithi187.stdout:5/327: rename d0/dc/d39/d46/d67/d30/c44 to d0/dc/d39/d46/c77 0 2024-09-21T00:56:32.859 INFO:tasks.workunit.client.1.smithi187.stdout:6/301: dread d7/f52 [0,4194304] 0 2024-09-21T00:56:32.861 INFO:tasks.workunit.client.1.smithi187.stdout:4/322: creat d2/f65 x:0 0 0 2024-09-21T00:56:32.861 INFO:tasks.workunit.client.1.smithi187.stdout:5/328: mknod d0/dc/d1f/d26/c78 0 2024-09-21T00:56:32.861 INFO:tasks.workunit.client.1.smithi187.stdout:6/302: mknod d7/d2a/d29/d40/d45/c5d 0 2024-09-21T00:56:32.864 INFO:tasks.workunit.client.1.smithi187.stdout:4/323: mkdir d2/d3/da/d2f/d32/d26/d66 0 2024-09-21T00:56:32.865 INFO:tasks.workunit.client.1.smithi187.stdout:5/329: mknod d0/dc/d39/d46/d67/d30/d68/c79 0 2024-09-21T00:56:32.866 INFO:tasks.workunit.client.1.smithi187.stdout:4/324: creat d2/d3/da/d2f/d32/d24/f67 x:0 0 0 2024-09-21T00:56:32.867 INFO:tasks.workunit.client.1.smithi187.stdout:4/325: chown d2/d3/da/d16/f3c 74310 1 2024-09-21T00:56:32.869 INFO:tasks.workunit.client.1.smithi187.stdout:5/330: dread d0/dc/d1f/d26/f53 [0,4194304] 0 2024-09-21T00:56:32.872 INFO:tasks.workunit.client.1.smithi187.stdout:5/331: symlink d0/dc/d39/d46/d67/d14/d38/d5a/l7a 0 2024-09-21T00:56:32.874 INFO:tasks.workunit.client.1.smithi187.stdout:4/326: dwrite d2/d3/da/d2f/d32/d22/d4f/f54 [0,4194304] 0 2024-09-21T00:56:32.879 INFO:tasks.workunit.client.1.smithi187.stdout:4/327: getdents d2/d3/da/d2f 0 2024-09-21T00:56:32.879 INFO:tasks.workunit.client.1.smithi187.stdout:4/328: dread - d2/f65 zero size 2024-09-21T00:56:32.881 INFO:tasks.workunit.client.1.smithi187.stdout:6/303: dread d7/f22 [0,4194304] 0 2024-09-21T00:56:32.883 INFO:tasks.workunit.client.1.smithi187.stdout:6/304: mkdir d7/d2a/d29/d40/d5e 0 2024-09-21T00:56:32.885 INFO:tasks.workunit.client.1.smithi187.stdout:6/305: creat d7/f5f x:0 0 0 2024-09-21T00:56:32.887 INFO:tasks.workunit.client.1.smithi187.stdout:6/306: creat d7/d2a/d29/f60 x:0 0 0 2024-09-21T00:56:32.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:32 smithi187 ceph-mon[34997]: pgmap v19: 65 pgs: 65 active+clean; 635 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 68 MiB/s wr, 438 op/s 2024-09-21T00:56:32.925 INFO:tasks.workunit.client.1.smithi187.stdout:9/442: sync 2024-09-21T00:56:32.925 INFO:tasks.workunit.client.1.smithi187.stdout:0/280: sync 2024-09-21T00:56:32.931 INFO:tasks.workunit.client.1.smithi187.stdout:9/443: dwrite d4/d8/d44/f51 [0,4194304] 0 2024-09-21T00:56:32.932 INFO:tasks.workunit.client.1.smithi187.stdout:0/281: dwrite d0/d17/d1c/d23/df/d41/d3b/f59 [0,4194304] 0 2024-09-21T00:56:32.932 INFO:tasks.workunit.client.1.smithi187.stdout:9/444: fsync d4/d13/f2d 0 2024-09-21T00:56:32.933 INFO:tasks.workunit.client.1.smithi187.stdout:0/282: stat d0/d17/d1c/d23/f28 0 2024-09-21T00:56:32.940 INFO:tasks.workunit.client.1.smithi187.stdout:0/283: dread d0/d17/d1c/d23/f19 [4194304,4194304] 0 2024-09-21T00:56:32.942 INFO:tasks.workunit.client.1.smithi187.stdout:9/445: dwrite d4/d13/d20/d2e/f33 [0,4194304] 0 2024-09-21T00:56:32.944 INFO:tasks.workunit.client.1.smithi187.stdout:9/446: write d4/d61/f89 [992560,100341] 0 2024-09-21T00:56:32.944 INFO:tasks.workunit.client.1.smithi187.stdout:9/447: readlink d4/d8/lf 0 2024-09-21T00:56:32.946 INFO:tasks.workunit.client.1.smithi187.stdout:0/284: unlink d0/d17/d1c/d23/f28 0 2024-09-21T00:56:32.948 INFO:tasks.workunit.client.1.smithi187.stdout:9/448: creat d4/d10/d8f/f95 x:0 0 0 2024-09-21T00:56:32.951 INFO:tasks.workunit.client.1.smithi187.stdout:9/449: mknod d4/d10/d39/d69/c96 0 2024-09-21T00:56:32.954 INFO:tasks.workunit.client.1.smithi187.stdout:0/285: dwrite d0/d17/d18/f24 [0,4194304] 0 2024-09-21T00:56:32.956 INFO:tasks.workunit.client.1.smithi187.stdout:9/450: rename d4/d8/d46/d54/f5c to d4/d8/d44/d6e/d92/f97 0 2024-09-21T00:56:32.957 INFO:tasks.workunit.client.1.smithi187.stdout:9/451: stat d4/d8/d44/f51 0 2024-09-21T00:56:32.964 INFO:tasks.workunit.client.1.smithi187.stdout:9/452: dwrite d4/d10/d24/f65 [0,4194304] 0 2024-09-21T00:56:32.968 INFO:tasks.workunit.client.1.smithi187.stdout:9/453: rename d4/d13/d14/d1d/d5f/c60 to d4/d8/d44/d6e/c98 0 2024-09-21T00:56:32.971 INFO:tasks.workunit.client.1.smithi187.stdout:9/454: creat d4/d61/d6c/f99 x:0 0 0 2024-09-21T00:56:32.974 INFO:tasks.workunit.client.1.smithi187.stdout:9/455: mkdir d4/d13/d20/d2e/d9a 0 2024-09-21T00:56:32.974 INFO:tasks.workunit.client.1.smithi187.stdout:9/456: chown d4/d8 34 1 2024-09-21T00:56:32.979 INFO:tasks.workunit.client.1.smithi187.stdout:9/457: dwrite d4/f3b [0,4194304] 0 2024-09-21T00:56:32.982 INFO:tasks.workunit.client.1.smithi187.stdout:9/458: mknod d4/d13/d14/d83/c9b 0 2024-09-21T00:56:32.983 INFO:tasks.workunit.client.1.smithi187.stdout:9/459: chown d4/d13/d20/d2b/f7b 8839225 1 2024-09-21T00:56:32.994 INFO:tasks.workunit.client.1.smithi187.stdout:9/460: dwrite d4/d13/d14/d1d/f63 [0,4194304] 0 2024-09-21T00:56:33.000 INFO:tasks.workunit.client.1.smithi187.stdout:9/461: dwrite d4/d13/d20/f26 [4194304,4194304] 0 2024-09-21T00:56:33.002 INFO:tasks.workunit.client.1.smithi187.stdout:9/462: write d4/d8/f19 [3095767,121323] 0 2024-09-21T00:56:33.003 INFO:tasks.workunit.client.1.smithi187.stdout:9/463: rmdir d4/d8/d44/d6e/d92 39 2024-09-21T00:56:33.005 INFO:tasks.workunit.client.1.smithi187.stdout:9/464: chown d4/d8/d44/d6e/d92 19972 1 2024-09-21T00:56:33.009 INFO:tasks.workunit.client.1.smithi187.stdout:9/465: unlink d4/d13/d14/d1d/d5f/f78 0 2024-09-21T00:56:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:32 smithi112 ceph-mon[28078]: pgmap v19: 65 pgs: 65 active+clean; 635 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 68 MiB/s wr, 438 op/s 2024-09-21T00:56:33.011 INFO:tasks.workunit.client.1.smithi187.stdout:9/466: symlink d4/d13/d20/d2b/d66/l9c 0 2024-09-21T00:56:33.017 INFO:tasks.workunit.client.1.smithi187.stdout:9/467: dwrite d4/d13/d14/d5d/f79 [0,4194304] 0 2024-09-21T00:56:33.018 INFO:tasks.workunit.client.1.smithi187.stdout:9/468: write d4/d10/d24/f65 [1407400,62015] 0 2024-09-21T00:56:33.022 INFO:tasks.workunit.client.1.smithi187.stdout:9/469: creat d4/d13/d14/d28/d72/f9d x:0 0 0 2024-09-21T00:56:33.023 INFO:tasks.workunit.client.1.smithi187.stdout:9/470: rmdir d4/d13/d20/d2b 39 2024-09-21T00:56:33.025 INFO:tasks.workunit.client.1.smithi187.stdout:7/288: sync 2024-09-21T00:56:33.028 INFO:tasks.workunit.client.1.smithi187.stdout:7/289: truncate d1/dc/d15/f57 1606571 0 2024-09-21T00:56:33.029 INFO:tasks.workunit.client.1.smithi187.stdout:7/290: creat d1/d18/d31/d41/f6a x:0 0 0 2024-09-21T00:56:33.031 INFO:tasks.workunit.client.1.smithi187.stdout:7/291: creat d1/d18/f6b x:0 0 0 2024-09-21T00:56:33.035 INFO:tasks.workunit.client.1.smithi187.stdout:7/292: dread d1/dc/d15/d2b/f61 [0,4194304] 0 2024-09-21T00:56:33.039 INFO:tasks.workunit.client.1.smithi187.stdout:7/293: write d1/f2 [1558338,28647] 0 2024-09-21T00:56:33.041 INFO:tasks.workunit.client.1.smithi187.stdout:7/294: creat d1/d18/d31/d5a/d5d/f6c x:0 0 0 2024-09-21T00:56:33.042 INFO:tasks.workunit.client.1.smithi187.stdout:9/471: dread d4/d10/f11 [0,4194304] 0 2024-09-21T00:56:33.043 INFO:tasks.workunit.client.1.smithi187.stdout:7/295: write d1/d18/d31/d41/f6a [202638,62939] 0 2024-09-21T00:56:33.046 INFO:tasks.workunit.client.1.smithi187.stdout:7/296: creat d1/d18/d31/f6d x:0 0 0 2024-09-21T00:56:33.049 INFO:tasks.workunit.client.1.smithi187.stdout:9/472: dwrite d4/d10/d8f/f95 [0,4194304] 0 2024-09-21T00:56:33.055 INFO:tasks.workunit.client.1.smithi187.stdout:7/297: dwrite d1/d18/f6b [0,4194304] 0 2024-09-21T00:56:33.057 INFO:tasks.workunit.client.1.smithi187.stdout:7/298: write d1/f2 [869275,73990] 0 2024-09-21T00:56:33.061 INFO:tasks.workunit.client.1.smithi187.stdout:9/473: dwrite d4/d8/f38 [4194304,4194304] 0 2024-09-21T00:56:33.061 INFO:tasks.workunit.client.1.smithi187.stdout:7/299: mkdir d1/dc/d15/d22/d3e/d6e 0 2024-09-21T00:56:33.064 INFO:tasks.workunit.client.1.smithi187.stdout:9/474: creat d4/d61/d6a/f9e x:0 0 0 2024-09-21T00:56:33.065 INFO:tasks.workunit.client.1.smithi187.stdout:7/300: unlink d1/d18/d31/d41/f45 0 2024-09-21T00:56:33.066 INFO:tasks.workunit.client.1.smithi187.stdout:9/475: mknod d4/d8/d41/c9f 0 2024-09-21T00:56:33.067 INFO:tasks.workunit.client.1.smithi187.stdout:7/301: mknod d1/d55/c6f 0 2024-09-21T00:56:33.067 INFO:tasks.workunit.client.1.smithi187.stdout:9/476: write d4/d13/d14/d28/d72/f9d [1017950,95567] 0 2024-09-21T00:56:33.070 INFO:tasks.workunit.client.1.smithi187.stdout:2/333: sync 2024-09-21T00:56:33.070 INFO:tasks.workunit.client.1.smithi187.stdout:6/307: sync 2024-09-21T00:56:33.070 INFO:tasks.workunit.client.1.smithi187.stdout:8/376: sync 2024-09-21T00:56:33.070 INFO:tasks.workunit.client.1.smithi187.stdout:1/315: sync 2024-09-21T00:56:33.070 INFO:tasks.workunit.client.1.smithi187.stdout:5/332: sync 2024-09-21T00:56:33.071 INFO:tasks.workunit.client.1.smithi187.stdout:4/329: sync 2024-09-21T00:56:33.071 INFO:tasks.workunit.client.1.smithi187.stdout:3/322: sync 2024-09-21T00:56:33.071 INFO:tasks.workunit.client.1.smithi187.stdout:9/477: mkdir d4/d10/d24/da0 0 2024-09-21T00:56:33.076 INFO:tasks.workunit.client.1.smithi187.stdout:2/334: write d2/d3/d15/f63 [135992,20142] 0 2024-09-21T00:56:33.076 INFO:tasks.workunit.client.1.smithi187.stdout:1/316: symlink d4/d6/d49/d5d/l63 0 2024-09-21T00:56:33.078 INFO:tasks.workunit.client.1.smithi187.stdout:8/377: rename f0 to dc/d2f/d34/d4b/f77 0 2024-09-21T00:56:33.079 INFO:tasks.workunit.client.1.smithi187.stdout:5/333: fdatasync d0/dc/d39/d46/d67/d14/f3d 0 2024-09-21T00:56:33.080 INFO:tasks.workunit.client.1.smithi187.stdout:4/330: mknod d2/d3/da/d2f/d32/d22/d4f/c68 0 2024-09-21T00:56:33.081 INFO:tasks.workunit.client.1.smithi187.stdout:7/302: dwrite d1/f7 [0,4194304] 0 2024-09-21T00:56:33.081 INFO:tasks.workunit.client.1.smithi187.stdout:3/323: creat d9/d19/d42/d53/d56/d61/f63 x:0 0 0 2024-09-21T00:56:33.083 INFO:tasks.workunit.client.1.smithi187.stdout:1/317: readlink d4/d6/d8/d35/d4c/d5b/l60 0 2024-09-21T00:56:33.085 INFO:tasks.workunit.client.1.smithi187.stdout:4/331: chown d2/d3/f36 1170297 1 2024-09-21T00:56:33.085 INFO:tasks.workunit.client.1.smithi187.stdout:8/378: symlink dc/d2f/d34/l78 0 2024-09-21T00:56:33.088 INFO:tasks.workunit.client.1.smithi187.stdout:5/334: unlink d0/dc/d1f/c2c 0 2024-09-21T00:56:33.089 INFO:tasks.workunit.client.1.smithi187.stdout:6/308: dwrite d7/f54 [0,4194304] 0 2024-09-21T00:56:33.091 INFO:tasks.workunit.client.1.smithi187.stdout:9/478: dwrite d4/d61/d6a/f9e [0,4194304] 0 2024-09-21T00:56:33.091 INFO:tasks.workunit.client.1.smithi187.stdout:2/335: rename d2/d3/d15/d1b/d1c/d2d/d62 to d2/dc/d2e/d4a/d7c 0 2024-09-21T00:56:33.092 INFO:tasks.workunit.client.1.smithi187.stdout:5/335: dread - d0/dc/d39/d46/d67/f73 zero size 2024-09-21T00:56:33.093 INFO:tasks.workunit.client.1.smithi187.stdout:3/324: mknod d9/d19/c64 0 2024-09-21T00:56:33.093 INFO:tasks.workunit.client.1.smithi187.stdout:9/479: read d4/d13/d14/d5d/f79 [3548304,63327] 0 2024-09-21T00:56:33.094 INFO:tasks.workunit.client.1.smithi187.stdout:8/379: mknod dc/d1c/d29/c79 0 2024-09-21T00:56:33.100 INFO:tasks.workunit.client.1.smithi187.stdout:8/380: dwrite dc/f26 [0,4194304] 0 2024-09-21T00:56:33.110 INFO:tasks.workunit.client.1.smithi187.stdout:7/303: rmdir d1/dc/d15/d22/d3e/d6e 0 2024-09-21T00:56:33.111 INFO:tasks.workunit.client.1.smithi187.stdout:7/304: chown d1/d55 2438216 1 2024-09-21T00:56:33.112 INFO:tasks.workunit.client.1.smithi187.stdout:6/309: getdents d7/d2a/d29/d40/d5e 0 2024-09-21T00:56:33.113 INFO:tasks.workunit.client.1.smithi187.stdout:5/336: mkdir d0/dc/d39/d46/d67/d14/d38/d5a/d6c/d7b 0 2024-09-21T00:56:33.114 INFO:tasks.workunit.client.1.smithi187.stdout:8/381: mknod dc/d1c/c7a 0 2024-09-21T00:56:33.114 INFO:tasks.workunit.client.1.smithi187.stdout:2/336: truncate d2/d25/f68 118302 0 2024-09-21T00:56:33.116 INFO:tasks.workunit.client.1.smithi187.stdout:7/305: symlink d1/dc/d15/l70 0 2024-09-21T00:56:33.117 INFO:tasks.workunit.client.1.smithi187.stdout:6/310: symlink d7/l61 0 2024-09-21T00:56:33.117 INFO:tasks.workunit.client.1.smithi187.stdout:1/318: dwrite d4/d6/f48 [0,4194304] 0 2024-09-21T00:56:33.118 INFO:tasks.workunit.client.1.smithi187.stdout:8/382: creat dc/d2f/d54/f7b x:0 0 0 2024-09-21T00:56:33.119 INFO:tasks.workunit.client.1.smithi187.stdout:2/337: chown d2/d3/d15/l38 1380444 1 2024-09-21T00:56:33.119 INFO:tasks.workunit.client.1.smithi187.stdout:4/332: dwrite d2/d3/da/d2f/d32/d26/f44 [0,4194304] 0 2024-09-21T00:56:33.120 INFO:tasks.workunit.client.1.smithi187.stdout:9/480: write d4/d13/d20/d2b/d66/f74 [4864142,37848] 0 2024-09-21T00:56:33.121 INFO:tasks.workunit.client.1.smithi187.stdout:7/306: fsync d1/d18/d31/d33/d3b/f66 0 2024-09-21T00:56:33.123 INFO:tasks.workunit.client.1.smithi187.stdout:1/319: mkdir d4/d6/d64 0 2024-09-21T00:56:33.124 INFO:tasks.workunit.client.1.smithi187.stdout:8/383: write dc/d44/f55 [1092204,98826] 0 2024-09-21T00:56:33.124 INFO:tasks.workunit.client.1.smithi187.stdout:2/338: truncate d2/dc/f65 99492 0 2024-09-21T00:56:33.125 INFO:tasks.workunit.client.1.smithi187.stdout:4/333: truncate d2/d3/da/f5b 694514 0 2024-09-21T00:56:33.125 INFO:tasks.workunit.client.1.smithi187.stdout:8/384: fsync dc/d44/f6c 0 2024-09-21T00:56:33.126 INFO:tasks.workunit.client.1.smithi187.stdout:6/311: mknod d7/d2a/c62 0 2024-09-21T00:56:33.129 INFO:tasks.workunit.client.1.smithi187.stdout:9/481: readlink d4/d8/la 0 2024-09-21T00:56:33.131 INFO:tasks.workunit.client.1.smithi187.stdout:2/339: rename d2/d3/l9 to d2/d25/l7d 0 2024-09-21T00:56:33.134 INFO:tasks.workunit.client.1.smithi187.stdout:5/337: link d0/c58 d0/dc/d39/d46/d67/d14/c7c 0 2024-09-21T00:56:33.138 INFO:tasks.workunit.client.1.smithi187.stdout:6/312: symlink d7/d2a/d29/d40/l63 0 2024-09-21T00:56:33.138 INFO:tasks.workunit.client.1.smithi187.stdout:9/482: mknod d4/d8/ca1 0 2024-09-21T00:56:33.138 INFO:tasks.workunit.client.1.smithi187.stdout:2/340: rmdir d2/d3/d15/d1b/d3c/d40 39 2024-09-21T00:56:33.139 INFO:tasks.workunit.client.1.smithi187.stdout:8/385: getdents dc/d1c/d29 0 2024-09-21T00:56:33.141 INFO:tasks.workunit.client.1.smithi187.stdout:6/313: creat d7/f64 x:0 0 0 2024-09-21T00:56:33.141 INFO:tasks.workunit.client.1.smithi187.stdout:2/341: mknod d2/dc/c7e 0 2024-09-21T00:56:33.143 INFO:tasks.workunit.client.1.smithi187.stdout:6/314: dread - d7/d2a/d29/f48 zero size 2024-09-21T00:56:33.143 INFO:tasks.workunit.client.1.smithi187.stdout:5/338: dwrite d0/dc/d1f/d26/f71 [0,4194304] 0 2024-09-21T00:56:33.144 INFO:tasks.workunit.client.1.smithi187.stdout:8/386: creat dc/d2f/d34/f7c x:0 0 0 2024-09-21T00:56:33.148 INFO:tasks.workunit.client.1.smithi187.stdout:8/387: mkdir dc/d2f/d34/d7d 0 2024-09-21T00:56:33.150 INFO:tasks.workunit.client.1.smithi187.stdout:8/388: readlink dc/l6b 0 2024-09-21T00:56:33.151 INFO:tasks.workunit.client.1.smithi187.stdout:9/483: truncate d4/d13/d20/d2b/d66/f74 1888216 0 2024-09-21T00:56:33.152 INFO:tasks.workunit.client.1.smithi187.stdout:8/389: chown dc/f47 15963204 1 2024-09-21T00:56:33.153 INFO:tasks.workunit.client.1.smithi187.stdout:5/339: getdents d0/dc/d39/d46/d67/d14/d38/d5a/d6c/d7b 0 2024-09-21T00:56:33.155 INFO:tasks.workunit.client.1.smithi187.stdout:1/320: dread d4/d6/d23/d2e/f3f [0,4194304] 0 2024-09-21T00:56:33.156 INFO:tasks.workunit.client.1.smithi187.stdout:4/334: dwrite d2/d3/f42 [0,4194304] 0 2024-09-21T00:56:33.156 INFO:tasks.workunit.client.1.smithi187.stdout:8/390: symlink dc/d44/l7e 0 2024-09-21T00:56:33.160 INFO:tasks.workunit.client.1.smithi187.stdout:1/321: mkdir d4/d6/d8/d35/d22/d65 0 2024-09-21T00:56:33.160 INFO:tasks.workunit.client.1.smithi187.stdout:4/335: dread d2/d3/da/d2f/d32/d24/f28 [0,4194304] 0 2024-09-21T00:56:33.160 INFO:tasks.workunit.client.1.smithi187.stdout:8/391: creat dc/d2f/d54/f7f x:0 0 0 2024-09-21T00:56:33.164 INFO:tasks.workunit.client.1.smithi187.stdout:1/322: dread d4/d6/d8/f4e [0,4194304] 0 2024-09-21T00:56:33.165 INFO:tasks.workunit.client.1.smithi187.stdout:1/323: read - d4/d6/d23/f45 zero size 2024-09-21T00:56:33.166 INFO:tasks.workunit.client.1.smithi187.stdout:8/392: mkdir dc/d2f/d80 0 2024-09-21T00:56:33.166 INFO:tasks.workunit.client.1.smithi187.stdout:2/342: dread d2/d25/f43 [0,4194304] 0 2024-09-21T00:56:33.167 INFO:tasks.workunit.client.1.smithi187.stdout:8/393: fsync dc/d2f/d54/f7b 0 2024-09-21T00:56:33.167 INFO:tasks.workunit.client.1.smithi187.stdout:8/394: readlink dc/d1c/l1a 0 2024-09-21T00:56:33.168 INFO:tasks.workunit.client.1.smithi187.stdout:4/336: rename d2/d3/f35 to d2/d3/da/d2f/d32/d22/d37/d63/f69 0 2024-09-21T00:56:33.168 INFO:tasks.workunit.client.1.smithi187.stdout:2/343: read d2/f8 [688043,31380] 0 2024-09-21T00:56:33.169 INFO:tasks.workunit.client.1.smithi187.stdout:1/324: mkdir d4/d6/d8/d66 0 2024-09-21T00:56:33.169 INFO:tasks.workunit.client.1.smithi187.stdout:8/395: chown dc/d2f/d37/f42 443004 1 2024-09-21T00:56:33.169 INFO:tasks.workunit.client.1.smithi187.stdout:5/340: link d0/dc/d39/d46/d67/d14/d1b/f24 d0/dc/d39/d46/d67/d14/d38/d5a/f7d 0 2024-09-21T00:56:33.170 INFO:tasks.workunit.client.1.smithi187.stdout:2/344: chown d2/dc/d2e/d4a/d7c/f79 817360 1 2024-09-21T00:56:33.170 INFO:tasks.workunit.client.1.smithi187.stdout:4/337: write d2/d3/da/d2f/d32/d24/f45 [3144693,111355] 0 2024-09-21T00:56:33.171 INFO:tasks.workunit.client.1.smithi187.stdout:5/341: fsync d0/dc/d39/d46/d67/d30/f6a 0 2024-09-21T00:56:33.174 INFO:tasks.workunit.client.1.smithi187.stdout:0/286: sync 2024-09-21T00:56:33.174 INFO:tasks.workunit.client.1.smithi187.stdout:2/345: read d2/f7 [38848,26335] 0 2024-09-21T00:56:33.174 INFO:tasks.workunit.client.1.smithi187.stdout:8/396: rename dc/d2f/f36 to dc/d2f/d34/d7d/f81 0 2024-09-21T00:56:33.175 INFO:tasks.workunit.client.1.smithi187.stdout:4/338: creat d2/d3/da/d2f/d4b/f6a x:0 0 0 2024-09-21T00:56:33.180 INFO:tasks.workunit.client.1.smithi187.stdout:9/484: write d4/d13/d20/d2b/d66/f74 [2313914,11980] 0 2024-09-21T00:56:33.181 INFO:tasks.workunit.client.1.smithi187.stdout:0/287: dread d0/d17/f2e [0,4194304] 0 2024-09-21T00:56:33.181 INFO:tasks.workunit.client.1.smithi187.stdout:1/325: dwrite d4/d6/f5a [0,4194304] 0 2024-09-21T00:56:33.182 INFO:tasks.workunit.client.1.smithi187.stdout:2/346: mknod d2/d3/d15/d1b/d3c/d69/c7f 0 2024-09-21T00:56:33.184 INFO:tasks.workunit.client.1.smithi187.stdout:5/342: dwrite d0/dc/f11 [0,4194304] 0 2024-09-21T00:56:33.185 INFO:tasks.workunit.client.1.smithi187.stdout:9/485: stat d4/d10/d39/d69/c96 0 2024-09-21T00:56:33.185 INFO:tasks.workunit.client.1.smithi187.stdout:2/347: chown d2/dc/d2e/d51 272481622 1 2024-09-21T00:56:33.185 INFO:tasks.workunit.client.1.smithi187.stdout:4/339: rename d2/d3/da/d2f/d32/l1c to d2/d3/da/d16/d5f/l6b 0 2024-09-21T00:56:33.189 INFO:tasks.workunit.client.1.smithi187.stdout:4/340: readlink d2/d3/da/d2f/d32/d22/d37/l41 0 2024-09-21T00:56:33.189 INFO:tasks.workunit.client.1.smithi187.stdout:2/348: creat d2/d3/d15/d1b/f80 x:0 0 0 2024-09-21T00:56:33.195 INFO:tasks.workunit.client.1.smithi187.stdout:5/343: creat d0/dc/d39/d46/d67/d14/d38/d5a/d6c/d7b/f7e x:0 0 0 2024-09-21T00:56:33.196 INFO:tasks.workunit.client.1.smithi187.stdout:1/326: link d4/d6/f29 d4/d6/d8/d35/d4c/d5b/f67 0 2024-09-21T00:56:33.196 INFO:tasks.workunit.client.1.smithi187.stdout:2/349: fsync d2/d3/d15/d1b/d1c/f4b 0 2024-09-21T00:56:33.197 INFO:tasks.workunit.client.1.smithi187.stdout:9/486: dwrite d4/d13/d14/d28/d72/f9d [0,4194304] 0 2024-09-21T00:56:33.199 INFO:tasks.workunit.client.1.smithi187.stdout:8/397: dread dc/d44/f71 [0,4194304] 0 2024-09-21T00:56:33.199 INFO:tasks.workunit.client.1.smithi187.stdout:9/487: fdatasync d4/d61/f68 0 2024-09-21T00:56:33.203 INFO:tasks.workunit.client.1.smithi187.stdout:2/350: symlink d2/dc/d2e/l81 0 2024-09-21T00:56:33.204 INFO:tasks.workunit.client.1.smithi187.stdout:5/344: creat d0/dc/d39/d46/d67/d14/d38/f7f x:0 0 0 2024-09-21T00:56:33.205 INFO:tasks.workunit.client.1.smithi187.stdout:1/327: symlink d4/d6/d23/d2e/d53/l68 0 2024-09-21T00:56:33.206 INFO:tasks.workunit.client.1.smithi187.stdout:8/398: write dc/d44/f71 [193505,114835] 0 2024-09-21T00:56:33.207 INFO:tasks.workunit.client.1.smithi187.stdout:8/399: truncate dc/d2f/d34/f3a 969933 0 2024-09-21T00:56:33.208 INFO:tasks.workunit.client.1.smithi187.stdout:2/351: creat d2/dc/d2e/f82 x:0 0 0 2024-09-21T00:56:33.209 INFO:tasks.workunit.client.1.smithi187.stdout:1/328: stat d4/d6/d8/c1a 0 2024-09-21T00:56:33.210 INFO:tasks.workunit.client.1.smithi187.stdout:5/345: write d0/f2d [3865013,12716] 0 2024-09-21T00:56:33.210 INFO:tasks.workunit.client.1.smithi187.stdout:2/352: chown d2/dc/d21/c5b 0 1 2024-09-21T00:56:33.212 INFO:tasks.workunit.client.1.smithi187.stdout:2/353: dread d2/d3/d15/d1b/d1c/f54 [0,4194304] 0 2024-09-21T00:56:33.214 INFO:tasks.workunit.client.1.smithi187.stdout:8/400: creat dc/d1c/f82 x:0 0 0 2024-09-21T00:56:33.216 INFO:tasks.workunit.client.1.smithi187.stdout:2/354: creat d2/d3/d15/d1b/d1c/d2d/f83 x:0 0 0 2024-09-21T00:56:33.217 INFO:tasks.workunit.client.1.smithi187.stdout:4/341: truncate d2/d3/da/d2f/d32/d22/f23 4480058 0 2024-09-21T00:56:33.219 INFO:tasks.workunit.client.1.smithi187.stdout:8/401: symlink dc/l83 0 2024-09-21T00:56:33.220 INFO:tasks.workunit.client.1.smithi187.stdout:5/346: dwrite d0/dc/d39/d46/d67/d14/d1b/f1c [4194304,4194304] 0 2024-09-21T00:56:33.220 INFO:tasks.workunit.client.1.smithi187.stdout:2/355: mknod d2/dc/d2e/d4a/d7c/d52/c84 0 2024-09-21T00:56:33.222 INFO:tasks.workunit.client.1.smithi187.stdout:9/488: dread d4/d13/d14/f18 [0,4194304] 0 2024-09-21T00:56:33.224 INFO:tasks.workunit.client.1.smithi187.stdout:9/489: read - d4/d13/d20/d2b/f7b zero size 2024-09-21T00:56:33.225 INFO:tasks.workunit.client.1.smithi187.stdout:8/402: write dc/f10 [572971,129344] 0 2024-09-21T00:56:33.226 INFO:tasks.workunit.client.1.smithi187.stdout:9/490: chown d4/d10/d43 0 1 2024-09-21T00:56:33.226 INFO:tasks.workunit.client.1.smithi187.stdout:9/491: readlink l1 0 2024-09-21T00:56:33.229 INFO:tasks.workunit.client.1.smithi187.stdout:9/492: write d4/d61/d6c/f99 [114893,109230] 0 2024-09-21T00:56:33.230 INFO:tasks.workunit.client.1.smithi187.stdout:2/356: write d2/f7 [3380618,51376] 0 2024-09-21T00:56:33.232 INFO:tasks.workunit.client.1.smithi187.stdout:9/493: rmdir d4/d10/d39/d69 39 2024-09-21T00:56:33.236 INFO:tasks.workunit.client.1.smithi187.stdout:2/357: rmdir d2/d3/d15/d1b/d1c/d2d/d4c 39 2024-09-21T00:56:33.237 INFO:tasks.workunit.client.1.smithi187.stdout:9/494: write d4/d13/f2d [1245325,9332] 0 2024-09-21T00:56:33.237 INFO:tasks.workunit.client.1.smithi187.stdout:1/329: dread d4/d6/d8/f31 [0,4194304] 0 2024-09-21T00:56:33.238 INFO:tasks.workunit.client.1.smithi187.stdout:8/403: dwrite dc/d1c/f2e [0,4194304] 0 2024-09-21T00:56:33.238 INFO:tasks.workunit.client.1.smithi187.stdout:2/358: fdatasync d2/dc/f46 0 2024-09-21T00:56:33.240 INFO:tasks.workunit.client.1.smithi187.stdout:4/342: dwrite d2/d3/da/d16/f3c [0,4194304] 0 2024-09-21T00:56:33.245 INFO:tasks.workunit.client.1.smithi187.stdout:2/359: truncate d2/d3/df/f72 822724 0 2024-09-21T00:56:33.246 INFO:tasks.workunit.client.1.smithi187.stdout:4/343: rmdir d2/d3/da/d2f/d32 39 2024-09-21T00:56:33.249 INFO:tasks.workunit.client.1.smithi187.stdout:1/330: getdents d4/d6/d8/d35/d4c/d5b 0 2024-09-21T00:56:33.250 INFO:tasks.workunit.client.1.smithi187.stdout:8/404: dwrite dc/d2f/d34/d4b/f77 [0,4194304] 0 2024-09-21T00:56:33.251 INFO:tasks.workunit.client.1.smithi187.stdout:1/331: chown d4/d6/d8/d35/d4c/f5f 623215086 1 2024-09-21T00:56:33.251 INFO:tasks.workunit.client.1.smithi187.stdout:4/344: mkdir d2/d3/da/d2f/d32/d26/d4a/d60/d6c 0 2024-09-21T00:56:33.252 INFO:tasks.workunit.client.1.smithi187.stdout:1/332: fdatasync d4/d6/d8/d35/d4c/f4d 0 2024-09-21T00:56:33.252 INFO:tasks.workunit.client.1.smithi187.stdout:4/345: chown d2/d3/f36 301512 1 2024-09-21T00:56:33.256 INFO:tasks.workunit.client.1.smithi187.stdout:1/333: symlink d4/d6/d23/l69 0 2024-09-21T00:56:33.259 INFO:tasks.workunit.client.1.smithi187.stdout:8/405: dwrite dc/f3c [0,4194304] 0 2024-09-21T00:56:33.264 INFO:tasks.workunit.client.1.smithi187.stdout:1/334: dread d4/d6/d23/d2e/f3f [0,4194304] 0 2024-09-21T00:56:33.264 INFO:tasks.workunit.client.1.smithi187.stdout:8/406: creat dc/d2f/d54/d69/f84 x:0 0 0 2024-09-21T00:56:33.267 INFO:tasks.workunit.client.1.smithi187.stdout:1/335: mkdir d4/d6/d23/d2e/d53/d6a 0 2024-09-21T00:56:33.269 INFO:tasks.workunit.client.1.smithi187.stdout:1/336: chown d4/d6/d23/d2e/d53/l68 20213 1 2024-09-21T00:56:33.269 INFO:tasks.workunit.client.1.smithi187.stdout:4/346: write d2/d3/da/d2f/d32/d22/d37/d63/f69 [1233258,94000] 0 2024-09-21T00:56:33.271 INFO:tasks.workunit.client.1.smithi187.stdout:8/407: dwrite dc/f26 [0,4194304] 0 2024-09-21T00:56:33.273 INFO:tasks.workunit.client.1.smithi187.stdout:1/337: creat d4/d6/d64/f6b x:0 0 0 2024-09-21T00:56:33.274 INFO:tasks.workunit.client.1.smithi187.stdout:8/408: mkdir dc/d2f/d34/d4b/d85 0 2024-09-21T00:56:33.275 INFO:tasks.workunit.client.1.smithi187.stdout:4/347: truncate d2/d3/da/d2f/d32/d24/f28 587492 0 2024-09-21T00:56:33.277 INFO:tasks.workunit.client.1.smithi187.stdout:4/348: fsync d2/d3/f2b 0 2024-09-21T00:56:33.277 INFO:tasks.workunit.client.1.smithi187.stdout:9/495: dread d4/d13/d20/d2b/d66/f7d [0,4194304] 0 2024-09-21T00:56:33.279 INFO:tasks.workunit.client.1.smithi187.stdout:4/349: read - d2/d3/da/d2f/d4b/f6a zero size 2024-09-21T00:56:33.279 INFO:tasks.workunit.client.1.smithi187.stdout:9/496: chown d4/d10/d24/f65 483 1 2024-09-21T00:56:33.280 INFO:tasks.workunit.client.1.smithi187.stdout:8/409: getdents dc/d2f 0 2024-09-21T00:56:33.281 INFO:tasks.workunit.client.1.smithi187.stdout:8/410: chown dc/f15 2734835 1 2024-09-21T00:56:33.282 INFO:tasks.workunit.client.1.smithi187.stdout:4/350: creat d2/d3/da/d48/f6d x:0 0 0 2024-09-21T00:56:33.282 INFO:tasks.workunit.client.1.smithi187.stdout:1/338: dread d4/d6/d23/f54 [0,4194304] 0 2024-09-21T00:56:33.284 INFO:tasks.workunit.client.1.smithi187.stdout:4/351: truncate d2/d3/da/d48/f6d 761326 0 2024-09-21T00:56:33.284 INFO:tasks.workunit.client.1.smithi187.stdout:8/411: fdatasync dc/d2f/d34/d7d/f81 0 2024-09-21T00:56:33.286 INFO:tasks.workunit.client.1.smithi187.stdout:8/412: write dc/d1c/f82 [229845,50299] 0 2024-09-21T00:56:33.287 INFO:tasks.workunit.client.1.smithi187.stdout:3/325: sync 2024-09-21T00:56:33.288 INFO:tasks.workunit.client.1.smithi187.stdout:1/339: truncate d4/d6/d8/d35/d4c/d5b/f67 865925 0 2024-09-21T00:56:33.288 INFO:tasks.workunit.client.1.smithi187.stdout:9/497: truncate d4/d8/f38 137911 0 2024-09-21T00:56:33.289 INFO:tasks.workunit.client.1.smithi187.stdout:8/413: mknod dc/d2f/c86 0 2024-09-21T00:56:33.289 INFO:tasks.workunit.client.1.smithi187.stdout:3/326: rmdir d9/d13/d20 39 2024-09-21T00:56:33.290 INFO:tasks.workunit.client.1.smithi187.stdout:9/498: fdatasync d4/d8/fb 0 2024-09-21T00:56:33.292 INFO:tasks.workunit.client.1.smithi187.stdout:8/414: mknod dc/d44/c87 0 2024-09-21T00:56:33.292 INFO:tasks.workunit.client.1.smithi187.stdout:4/352: dwrite d2/d3/da/d2f/d32/d22/d37/d63/f69 [0,4194304] 0 2024-09-21T00:56:33.293 INFO:tasks.workunit.client.1.smithi187.stdout:1/340: rename d4/d6/d49/d5d to d4/d6/d8/d6c 0 2024-09-21T00:56:33.296 INFO:tasks.workunit.client.1.smithi187.stdout:3/327: dread d9/d19/d1c/f47 [0,4194304] 0 2024-09-21T00:56:33.297 INFO:tasks.workunit.client.1.smithi187.stdout:9/499: stat d4/d10/c45 0 2024-09-21T00:56:33.299 INFO:tasks.workunit.client.1.smithi187.stdout:8/415: rmdir dc/d2f/d54/d69 39 2024-09-21T00:56:33.304 INFO:tasks.workunit.client.1.smithi187.stdout:3/328: chown d9/d13/d20/f3c 414 1 2024-09-21T00:56:33.304 INFO:tasks.workunit.client.1.smithi187.stdout:4/353: mkdir d2/d3/da/d2f/d32/d26/d66/d6e 0 2024-09-21T00:56:33.306 INFO:tasks.workunit.client.1.smithi187.stdout:1/341: creat d4/d6/d8/d35/d22/d65/f6d x:0 0 0 2024-09-21T00:56:33.308 INFO:tasks.workunit.client.1.smithi187.stdout:3/329: chown d9/d19/d42/d53/d56 79628 1 2024-09-21T00:56:33.309 INFO:tasks.workunit.client.1.smithi187.stdout:4/354: mknod d2/d3/da/d2f/d32/d26/d4a/d60/c6f 0 2024-09-21T00:56:33.310 INFO:tasks.workunit.client.1.smithi187.stdout:8/416: dwrite dc/d2f/d54/d69/f84 [0,4194304] 0 2024-09-21T00:56:33.312 INFO:tasks.workunit.client.1.smithi187.stdout:8/417: write dc/d1c/f82 [838321,39134] 0 2024-09-21T00:56:33.312 INFO:tasks.workunit.client.1.smithi187.stdout:3/330: unlink d9/d19/d43/f57 0 2024-09-21T00:56:33.314 INFO:tasks.workunit.client.1.smithi187.stdout:4/355: mknod d2/d3/da/d2f/d32/d26/d4a/c70 0 2024-09-21T00:56:33.314 INFO:tasks.workunit.client.1.smithi187.stdout:1/342: link d4/d6/d8/f37 d4/d6/d8/d35/f6e 0 2024-09-21T00:56:33.317 INFO:tasks.workunit.client.1.smithi187.stdout:3/331: creat d9/d19/d42/f65 x:0 0 0 2024-09-21T00:56:33.320 INFO:tasks.workunit.client.1.smithi187.stdout:4/356: mknod d2/d3/da/d2f/d32/d26/d4a/d58/c71 0 2024-09-21T00:56:33.320 INFO:tasks.workunit.client.1.smithi187.stdout:9/500: truncate d4/d8/f38 921200 0 2024-09-21T00:56:33.321 INFO:tasks.workunit.client.1.smithi187.stdout:3/332: creat d9/d19/d1c/f66 x:0 0 0 2024-09-21T00:56:33.322 INFO:tasks.workunit.client.1.smithi187.stdout:8/418: creat dc/d2f/d80/f88 x:0 0 0 2024-09-21T00:56:33.322 INFO:tasks.workunit.client.1.smithi187.stdout:1/343: mkdir d4/d6/d23/d6f 0 2024-09-21T00:56:33.323 INFO:tasks.workunit.client.1.smithi187.stdout:4/357: creat d2/d3/da/d2f/d32/d22/d37/d63/f72 x:0 0 0 2024-09-21T00:56:33.324 INFO:tasks.workunit.client.1.smithi187.stdout:8/419: dread dc/d2f/d34/f3a [0,4194304] 0 2024-09-21T00:56:33.325 INFO:tasks.workunit.client.1.smithi187.stdout:3/333: write d9/f11 [568643,116682] 0 2024-09-21T00:56:33.329 INFO:tasks.workunit.client.1.smithi187.stdout:9/501: dwrite d4/d13/d14/d28/d72/f9d [0,4194304] 0 2024-09-21T00:56:33.331 INFO:tasks.workunit.client.1.smithi187.stdout:8/420: dread dc/d1c/f3d [0,4194304] 0 2024-09-21T00:56:33.332 INFO:tasks.workunit.client.1.smithi187.stdout:4/358: symlink d2/d3/da/d2f/d32/d26/d66/d6e/l73 0 2024-09-21T00:56:33.333 INFO:tasks.workunit.client.1.smithi187.stdout:9/502: creat d4/d13/d14/d5d/fa2 x:0 0 0 2024-09-21T00:56:33.334 INFO:tasks.workunit.client.1.smithi187.stdout:1/344: link d4/d6/d8/d35/d4c/d5b/l60 d4/d6/d23/d2e/l70 0 2024-09-21T00:56:33.334 INFO:tasks.workunit.client.1.smithi187.stdout:9/503: fsync d4/d61/f89 0 2024-09-21T00:56:33.335 INFO:tasks.workunit.client.1.smithi187.stdout:1/345: write d4/d6/d8/d35/d22/d65/f6d [185312,27948] 0 2024-09-21T00:56:33.339 INFO:tasks.workunit.client.1.smithi187.stdout:3/334: rename d9/d19/d1c/f50 to d9/d19/d42/d53/f67 0 2024-09-21T00:56:33.339 INFO:tasks.workunit.client.1.smithi187.stdout:3/335: dread - d9/d13/f48 zero size 2024-09-21T00:56:33.340 INFO:tasks.workunit.client.1.smithi187.stdout:4/359: mkdir d2/d3/d74 0 2024-09-21T00:56:33.341 INFO:tasks.workunit.client.1.smithi187.stdout:8/421: link dc/d44/c61 dc/d1c/d3e/d75/c89 0 2024-09-21T00:56:33.342 INFO:tasks.workunit.client.1.smithi187.stdout:9/504: dread d4/d13/d14/d5d/f79 [0,4194304] 0 2024-09-21T00:56:33.346 INFO:tasks.workunit.client.1.smithi187.stdout:8/422: symlink dc/d1c/d3e/d75/l8a 0 2024-09-21T00:56:33.349 INFO:tasks.workunit.client.1.smithi187.stdout:1/346: dwrite d4/f14 [4194304,4194304] 0 2024-09-21T00:56:33.352 INFO:tasks.workunit.client.1.smithi187.stdout:4/360: dwrite d2/d3/f13 [0,4194304] 0 2024-09-21T00:56:33.352 INFO:tasks.workunit.client.1.smithi187.stdout:9/505: write d4/d13/d14/d28/f53 [2369086,82882] 0 2024-09-21T00:56:33.352 INFO:tasks.workunit.client.1.smithi187.stdout:8/423: truncate dc/fd 4181566 0 2024-09-21T00:56:33.353 INFO:tasks.workunit.client.1.smithi187.stdout:3/336: dwrite d9/d19/d1c/f3e [0,4194304] 0 2024-09-21T00:56:33.358 INFO:tasks.workunit.client.1.smithi187.stdout:1/347: creat d4/d6/d64/f71 x:0 0 0 2024-09-21T00:56:33.362 INFO:tasks.workunit.client.1.smithi187.stdout:8/424: unlink dc/d2f/c43 0 2024-09-21T00:56:33.364 INFO:tasks.workunit.client.1.smithi187.stdout:3/337: creat d9/d13/d20/f68 x:0 0 0 2024-09-21T00:56:33.364 INFO:tasks.workunit.client.1.smithi187.stdout:9/506: rename d4/d10/d24/l80 to d4/d61/d6a/d90/la3 0 2024-09-21T00:56:33.366 INFO:tasks.workunit.client.1.smithi187.stdout:4/361: dwrite d2/d3/da/d16/f3c [0,4194304] 0 2024-09-21T00:56:33.367 INFO:tasks.workunit.client.1.smithi187.stdout:1/348: symlink d4/d6/d8/d35/d4c/l72 0 2024-09-21T00:56:33.369 INFO:tasks.workunit.client.1.smithi187.stdout:3/338: mknod d9/d13/d20/c69 0 2024-09-21T00:56:33.371 INFO:tasks.workunit.client.1.smithi187.stdout:3/339: write d9/d19/d1c/f3e [503518,12861] 0 2024-09-21T00:56:33.373 INFO:tasks.workunit.client.1.smithi187.stdout:3/340: dread - d9/d13/d20/f68 zero size 2024-09-21T00:56:33.375 INFO:tasks.workunit.client.1.smithi187.stdout:9/507: write d4/d13/d20/d2b/d66/f7d [3341363,4649] 0 2024-09-21T00:56:33.377 INFO:tasks.workunit.client.1.smithi187.stdout:3/341: mknod d9/d19/d43/c6a 0 2024-09-21T00:56:33.377 INFO:tasks.workunit.client.1.smithi187.stdout:4/362: write d2/d3/da/d2f/d32/d22/f49 [4659475,6577] 0 2024-09-21T00:56:33.381 INFO:tasks.workunit.client.1.smithi187.stdout:8/425: dwrite dc/d1c/f2e [4194304,4194304] 0 2024-09-21T00:56:33.386 INFO:tasks.workunit.client.1.smithi187.stdout:1/349: dwrite d4/d6/d8/f31 [0,4194304] 0 2024-09-21T00:56:33.388 INFO:tasks.workunit.client.1.smithi187.stdout:8/426: creat dc/d1c/d3e/d75/f8b x:0 0 0 2024-09-21T00:56:33.390 INFO:tasks.workunit.client.1.smithi187.stdout:3/342: write d9/d19/d1c/f47 [1105039,80969] 0 2024-09-21T00:56:33.393 INFO:tasks.workunit.client.1.smithi187.stdout:8/427: truncate dc/f47 524586 0 2024-09-21T00:56:33.395 INFO:tasks.workunit.client.1.smithi187.stdout:4/363: dwrite d2/f65 [0,4194304] 0 2024-09-21T00:56:33.397 INFO:tasks.workunit.client.1.smithi187.stdout:9/508: dwrite d4/d61/d6c/f56 [0,4194304] 0 2024-09-21T00:56:33.398 INFO:tasks.workunit.client.1.smithi187.stdout:1/350: truncate d4/f7 4806276 0 2024-09-21T00:56:33.399 INFO:tasks.workunit.client.1.smithi187.stdout:8/428: symlink dc/d1c/l8c 0 2024-09-21T00:56:33.400 INFO:tasks.workunit.client.1.smithi187.stdout:9/509: symlink d4/d13/d14/d28/d72/la4 0 2024-09-21T00:56:33.402 INFO:tasks.workunit.client.1.smithi187.stdout:1/351: mknod d4/d6/d64/c73 0 2024-09-21T00:56:33.405 INFO:tasks.workunit.client.1.smithi187.stdout:8/429: rename dc/l32 to dc/d2f/d34/d4b/d85/l8d 0 2024-09-21T00:56:33.407 INFO:tasks.workunit.client.1.smithi187.stdout:1/352: mknod d4/d6/d8/d35/c74 0 2024-09-21T00:56:33.410 INFO:tasks.workunit.client.1.smithi187.stdout:9/510: rename d4/d10/d24/f65 to d4/d13/d14/d28/fa5 0 2024-09-21T00:56:33.412 INFO:tasks.workunit.client.1.smithi187.stdout:1/353: mkdir d4/d75 0 2024-09-21T00:56:33.414 INFO:tasks.workunit.client.1.smithi187.stdout:8/430: link dc/d44/c61 dc/d2f/c8e 0 2024-09-21T00:56:33.417 INFO:tasks.workunit.client.1.smithi187.stdout:1/354: rename d4/d6/d8/d35/f38 to d4/f76 0 2024-09-21T00:56:33.419 INFO:tasks.workunit.client.1.smithi187.stdout:1/355: symlink d4/d6/d8/l77 0 2024-09-21T00:56:33.420 INFO:tasks.workunit.client.1.smithi187.stdout:8/431: getdents dc/d44 0 2024-09-21T00:56:33.421 INFO:tasks.workunit.client.1.smithi187.stdout:1/356: symlink d4/d6/d64/l78 0 2024-09-21T00:56:33.422 INFO:tasks.workunit.client.1.smithi187.stdout:8/432: creat dc/d2f/f8f x:0 0 0 2024-09-21T00:56:33.423 INFO:tasks.workunit.client.1.smithi187.stdout:8/433: stat dc/f47 0 2024-09-21T00:56:33.424 INFO:tasks.workunit.client.1.smithi187.stdout:8/434: chown dc/d1c/d29/f31 3069 1 2024-09-21T00:56:33.427 INFO:tasks.workunit.client.1.smithi187.stdout:1/357: dwrite d4/d6/d8/d35/d22/d65/f6d [0,4194304] 0 2024-09-21T00:56:33.429 INFO:tasks.workunit.client.1.smithi187.stdout:1/358: chown d4/d6/d49/c55 5 1 2024-09-21T00:56:33.431 INFO:tasks.workunit.client.1.smithi187.stdout:8/435: dwrite dc/f49 [0,4194304] 0 2024-09-21T00:56:33.431 INFO:tasks.workunit.client.1.smithi187.stdout:3/343: dread d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:33.434 INFO:tasks.workunit.client.1.smithi187.stdout:3/344: creat d9/f6b x:0 0 0 2024-09-21T00:56:33.435 INFO:tasks.workunit.client.1.smithi187.stdout:8/436: unlink dc/d2f/d34/d4b/c72 0 2024-09-21T00:56:33.435 INFO:tasks.workunit.client.1.smithi187.stdout:7/307: sync 2024-09-21T00:56:33.436 INFO:tasks.workunit.client.1.smithi187.stdout:6/315: sync 2024-09-21T00:56:33.438 INFO:tasks.workunit.client.1.smithi187.stdout:1/359: getdents d4/d6 0 2024-09-21T00:56:33.438 INFO:tasks.workunit.client.1.smithi187.stdout:7/308: chown d1/dc/d15/d22/d3e/l63 98687 1 2024-09-21T00:56:33.438 INFO:tasks.workunit.client.1.smithi187.stdout:1/360: read d4/d6/f5a [874087,39477] 0 2024-09-21T00:56:33.439 INFO:tasks.workunit.client.1.smithi187.stdout:8/437: symlink dc/d2f/l90 0 2024-09-21T00:56:33.442 INFO:tasks.workunit.client.1.smithi187.stdout:1/361: mkdir d4/d6/d8/d35/d79 0 2024-09-21T00:56:33.449 INFO:tasks.workunit.client.1.smithi187.stdout:6/316: dwrite d7/d2a/d29/f38 [0,4194304] 0 2024-09-21T00:56:33.452 INFO:tasks.workunit.client.1.smithi187.stdout:7/309: dwrite d1/d18/f35 [0,4194304] 0 2024-09-21T00:56:33.453 INFO:tasks.workunit.client.1.smithi187.stdout:1/362: creat d4/d6/d23/d2e/f7a x:0 0 0 2024-09-21T00:56:33.455 INFO:tasks.workunit.client.1.smithi187.stdout:8/438: dwrite dc/d2f/d80/f88 [0,4194304] 0 2024-09-21T00:56:33.455 INFO:tasks.workunit.client.1.smithi187.stdout:6/317: symlink d7/l65 0 2024-09-21T00:56:33.460 INFO:tasks.workunit.client.1.smithi187.stdout:1/363: creat d4/d6/d8/d35/d22/f7b x:0 0 0 2024-09-21T00:56:33.465 INFO:tasks.workunit.client.1.smithi187.stdout:3/345: dread d9/fd [0,4194304] 0 2024-09-21T00:56:33.465 INFO:tasks.workunit.client.1.smithi187.stdout:6/318: mknod d7/d2a/c66 0 2024-09-21T00:56:33.511 INFO:tasks.workunit.client.1.smithi187.stdout:8/439: getdents dc 0 2024-09-21T00:56:33.512 INFO:tasks.workunit.client.1.smithi187.stdout:8/440: fsync dc/d1c/d3e/f53 0 2024-09-21T00:56:33.513 INFO:tasks.workunit.client.1.smithi187.stdout:7/310: dwrite d1/d18/d31/d5a/d5d/f6c [0,4194304] 0 2024-09-21T00:56:33.513 INFO:tasks.workunit.client.1.smithi187.stdout:1/364: creat d4/d6/d8/d35/f7c x:0 0 0 2024-09-21T00:56:33.515 INFO:tasks.workunit.client.1.smithi187.stdout:3/346: mknod d9/d13/d20/c6c 0 2024-09-21T00:56:33.516 INFO:tasks.workunit.client.1.smithi187.stdout:3/347: read - d9/d13/f48 zero size 2024-09-21T00:56:33.520 INFO:tasks.workunit.client.1.smithi187.stdout:7/311: creat d1/dc/d15/d22/d3e/f71 x:0 0 0 2024-09-21T00:56:33.520 INFO:tasks.workunit.client.1.smithi187.stdout:6/319: creat d7/d2a/d29/d40/d5e/f67 x:0 0 0 2024-09-21T00:56:33.522 INFO:tasks.workunit.client.1.smithi187.stdout:7/312: symlink d1/dc/l72 0 2024-09-21T00:56:33.522 INFO:tasks.workunit.client.1.smithi187.stdout:6/320: read d7/d2a/fb [1756062,67810] 0 2024-09-21T00:56:33.523 INFO:tasks.workunit.client.1.smithi187.stdout:1/365: creat d4/d6/d23/d2e/f7d x:0 0 0 2024-09-21T00:56:33.524 INFO:tasks.workunit.client.1.smithi187.stdout:1/366: read d4/d6/d8/f31 [1769204,85669] 0 2024-09-21T00:56:33.525 INFO:tasks.workunit.client.1.smithi187.stdout:1/367: fdatasync d4/d6/d23/d2e/f7d 0 2024-09-21T00:56:33.525 INFO:tasks.workunit.client.1.smithi187.stdout:7/313: mkdir d1/dc/d15/d22/d3e/d73 0 2024-09-21T00:56:33.525 INFO:tasks.workunit.client.1.smithi187.stdout:6/321: dread d7/f2c [0,4194304] 0 2024-09-21T00:56:33.525 INFO:tasks.workunit.client.1.smithi187.stdout:6/322: dread - d7/f64 zero size 2024-09-21T00:56:33.527 INFO:tasks.workunit.client.1.smithi187.stdout:7/314: symlink d1/d18/l74 0 2024-09-21T00:56:33.528 INFO:tasks.workunit.client.1.smithi187.stdout:1/368: symlink d4/d75/l7e 0 2024-09-21T00:56:33.530 INFO:tasks.workunit.client.1.smithi187.stdout:7/315: mkdir d1/d18/d31/d5a/d75 0 2024-09-21T00:56:33.531 INFO:tasks.workunit.client.1.smithi187.stdout:6/323: dwrite d7/d2a/d29/f49 [0,4194304] 0 2024-09-21T00:56:33.532 INFO:tasks.workunit.client.1.smithi187.stdout:1/369: link d4/f27 d4/d6/d23/d2e/d53/f7f 0 2024-09-21T00:56:33.533 INFO:tasks.workunit.client.1.smithi187.stdout:1/370: dread - d4/d6/d23/d2e/f7d zero size 2024-09-21T00:56:33.536 INFO:tasks.workunit.client.1.smithi187.stdout:1/371: write d4/d6/d8/d35/d22/f57 [701872,26974] 0 2024-09-21T00:56:33.539 INFO:tasks.workunit.client.1.smithi187.stdout:1/372: chown d4/d6/d23/d2e/f7d 113243935 1 2024-09-21T00:56:33.539 INFO:tasks.workunit.client.1.smithi187.stdout:6/324: dwrite d7/d2a/d29/f60 [0,4194304] 0 2024-09-21T00:56:33.543 INFO:tasks.workunit.client.1.smithi187.stdout:1/373: mknod d4/d6/d8/d66/c80 0 2024-09-21T00:56:33.544 INFO:tasks.workunit.client.1.smithi187.stdout:6/325: mkdir d7/d2a/d29/d40/d50/d68 0 2024-09-21T00:56:33.544 INFO:tasks.workunit.client.1.smithi187.stdout:1/374: readlink d4/d6/d8/l4f 0 2024-09-21T00:56:33.545 INFO:tasks.workunit.client.1.smithi187.stdout:6/326: write d7/d2a/d29/d40/f4b [653024,76638] 0 2024-09-21T00:56:33.547 INFO:tasks.workunit.client.1.smithi187.stdout:1/375: symlink d4/d6/d8/d35/d4c/d5b/l81 0 2024-09-21T00:56:33.549 INFO:tasks.workunit.client.1.smithi187.stdout:1/376: creat d4/d6/d8/d35/f82 x:0 0 0 2024-09-21T00:56:33.553 INFO:tasks.workunit.client.1.smithi187.stdout:2/360: sync 2024-09-21T00:56:33.553 INFO:tasks.workunit.client.1.smithi187.stdout:0/288: sync 2024-09-21T00:56:33.553 INFO:tasks.workunit.client.1.smithi187.stdout:5/347: sync 2024-09-21T00:56:33.555 INFO:tasks.workunit.client.1.smithi187.stdout:1/377: write d4/d6/d23/f2b [589288,20405] 0 2024-09-21T00:56:33.555 INFO:tasks.workunit.client.1.smithi187.stdout:0/289: mkdir d0/d5a 0 2024-09-21T00:56:33.555 INFO:tasks.workunit.client.1.smithi187.stdout:1/378: readlink d4/d6/d8/d35/l39 0 2024-09-21T00:56:33.557 INFO:tasks.workunit.client.1.smithi187.stdout:5/348: truncate d0/dc/d39/d46/d67/d14/d1b/d27/d3a/f72 205158 0 2024-09-21T00:56:33.558 INFO:tasks.workunit.client.1.smithi187.stdout:0/290: creat d0/d17/d1c/d23/f5b x:0 0 0 2024-09-21T00:56:33.558 INFO:tasks.workunit.client.1.smithi187.stdout:1/379: mkdir d4/d6/d8/d35/d4c/d5b/d83 0 2024-09-21T00:56:33.562 INFO:tasks.workunit.client.1.smithi187.stdout:5/349: rmdir d0/dc/d39/d46/d67/d14/d38/d5a/d6d 0 2024-09-21T00:56:33.562 INFO:tasks.workunit.client.1.smithi187.stdout:5/350: chown d0/dc/d39/d46/d67/d30 2 1 2024-09-21T00:56:33.563 INFO:tasks.workunit.client.1.smithi187.stdout:1/380: creat d4/d6/d8/d35/d4c/d5b/d83/f84 x:0 0 0 2024-09-21T00:56:33.564 INFO:tasks.workunit.client.1.smithi187.stdout:0/291: write d0/f11 [4844713,85030] 0 2024-09-21T00:56:33.564 INFO:tasks.workunit.client.1.smithi187.stdout:1/381: chown d4/c52 1 1 2024-09-21T00:56:33.564 INFO:tasks.workunit.client.1.smithi187.stdout:6/327: dread d7/d2a/f28 [0,4194304] 0 2024-09-21T00:56:33.566 INFO:tasks.workunit.client.1.smithi187.stdout:6/328: dread - d7/d2a/d29/f48 zero size 2024-09-21T00:56:33.566 INFO:tasks.workunit.client.1.smithi187.stdout:5/351: mknod d0/dc/d39/d46/d67/d14/d1b/d27/c80 0 2024-09-21T00:56:33.567 INFO:tasks.workunit.client.1.smithi187.stdout:5/352: readlink d0/l1a 0 2024-09-21T00:56:33.568 INFO:tasks.workunit.client.1.smithi187.stdout:0/292: rename d0/d17/d1c/d23/d36/f3e to d0/d17/d1c/d23/d36/f5c 0 2024-09-21T00:56:33.568 INFO:tasks.workunit.client.1.smithi187.stdout:5/353: truncate d0/dc/d39/d46/d67/d14/d1b/f1c 8797657 0 2024-09-21T00:56:33.570 INFO:tasks.workunit.client.1.smithi187.stdout:6/329: link d7/f4f d7/d2a/d29/d40/d45/f69 0 2024-09-21T00:56:33.571 INFO:tasks.workunit.client.1.smithi187.stdout:6/330: chown d7/d2a/d29/d40/l35 2 1 2024-09-21T00:56:33.571 INFO:tasks.workunit.client.1.smithi187.stdout:5/354: unlink d0/dc/d39/f4d 0 2024-09-21T00:56:33.573 INFO:tasks.workunit.client.1.smithi187.stdout:5/355: mknod d0/dc/d1f/c81 0 2024-09-21T00:56:33.577 INFO:tasks.workunit.client.1.smithi187.stdout:5/356: creat d0/dc/d39/d46/d67/d14/d38/f82 x:0 0 0 2024-09-21T00:56:33.578 INFO:tasks.workunit.client.1.smithi187.stdout:0/293: dread d0/d17/d1c/d23/df/d41/f42 [0,4194304] 0 2024-09-21T00:56:33.579 INFO:tasks.workunit.client.1.smithi187.stdout:0/294: readlink d0/d17/d1c/d23/df/d41/d3b/d46/l58 0 2024-09-21T00:56:33.581 INFO:tasks.workunit.client.1.smithi187.stdout:0/295: creat d0/d17/d1c/f5d x:0 0 0 2024-09-21T00:56:33.582 INFO:tasks.workunit.client.1.smithi187.stdout:5/357: rename d0/dc/d1f/d26/l52 to d0/dc/l83 0 2024-09-21T00:56:33.586 INFO:tasks.workunit.client.1.smithi187.stdout:6/331: dwrite d7/d2a/fb [0,4194304] 0 2024-09-21T00:56:33.587 INFO:tasks.workunit.client.1.smithi187.stdout:6/332: chown d7/d59/c1f 86 1 2024-09-21T00:56:33.589 INFO:tasks.workunit.client.1.smithi187.stdout:0/296: dwrite d0/d17/d1c/d23/df/f53 [0,4194304] 0 2024-09-21T00:56:33.590 INFO:tasks.workunit.client.1.smithi187.stdout:6/333: mkdir d7/d2a/d29/d40/d6a 0 2024-09-21T00:56:33.594 INFO:tasks.workunit.client.1.smithi187.stdout:0/297: rename d0/d17/d1c/d23/f5b to d0/d17/d18/d3a/f5e 0 2024-09-21T00:56:33.597 INFO:tasks.workunit.client.1.smithi187.stdout:0/298: dread d0/d17/f2e [0,4194304] 0 2024-09-21T00:56:33.599 INFO:tasks.workunit.client.1.smithi187.stdout:6/334: dwrite d7/d59/f1d [4194304,4194304] 0 2024-09-21T00:56:33.600 INFO:tasks.workunit.client.1.smithi187.stdout:6/335: rename d7 to d7/d2a/d29/d40/d50/d68/d6b 22 2024-09-21T00:56:33.601 INFO:tasks.workunit.client.1.smithi187.stdout:6/336: fdatasync d7/d59/f1e 0 2024-09-21T00:56:33.607 INFO:tasks.workunit.client.1.smithi187.stdout:0/299: write d0/d17/d1c/d23/f19 [2945795,88133] 0 2024-09-21T00:56:33.609 INFO:tasks.workunit.client.1.smithi187.stdout:0/300: write d0/d17/d18/f47 [1401010,10862] 0 2024-09-21T00:56:33.632 INFO:tasks.workunit.client.1.smithi187.stdout:6/337: dread d7/d59/f1e [0,4194304] 0 2024-09-21T00:56:33.632 INFO:tasks.workunit.client.1.smithi187.stdout:6/338: stat d7/d2a/d29/f3c 0 2024-09-21T00:56:33.632 INFO:tasks.workunit.client.1.smithi187.stdout:6/339: readlink d7/l65 0 2024-09-21T00:56:33.640 INFO:tasks.workunit.client.1.smithi187.stdout:4/364: sync 2024-09-21T00:56:33.650 INFO:tasks.workunit.client.1.smithi187.stdout:6/340: write d7/d2a/f2f [714977,54626] 0 2024-09-21T00:56:33.651 INFO:tasks.workunit.client.1.smithi187.stdout:6/341: rename d7 to d7/d2a/d29/d40/d5e/d6c 22 2024-09-21T00:56:33.656 INFO:tasks.workunit.client.1.smithi187.stdout:0/301: dwrite d0/d17/d1c/d23/f10 [0,4194304] 0 2024-09-21T00:56:33.658 INFO:tasks.workunit.client.1.smithi187.stdout:0/302: truncate d0/d17/d1c/d23/d36/f5c 991344 0 2024-09-21T00:56:33.663 INFO:tasks.workunit.client.1.smithi187.stdout:0/303: mknod d0/d17/d1c/d23/d36/c5f 0 2024-09-21T00:56:33.664 INFO:tasks.workunit.client.1.smithi187.stdout:6/342: link d7/d2a/d29/d40/d45/c5d d7/d59/c6d 0 2024-09-21T00:56:33.665 INFO:tasks.workunit.client.1.smithi187.stdout:6/343: dread d7/f2c [0,4194304] 0 2024-09-21T00:56:33.669 INFO:tasks.workunit.client.1.smithi187.stdout:6/344: rename d7/d59/f3d to d7/d59/f6e 0 2024-09-21T00:56:33.670 INFO:tasks.workunit.client.1.smithi187.stdout:6/345: fdatasync d7/d2a/d29/d40/f4d 0 2024-09-21T00:56:33.671 INFO:tasks.workunit.client.1.smithi187.stdout:6/346: write d7/f4a [2192279,74458] 0 2024-09-21T00:56:33.681 INFO:tasks.workunit.client.1.smithi187.stdout:6/347: link d7/d2a/c62 d7/d2a/d29/d40/d50/c6f 0 2024-09-21T00:56:33.684 INFO:tasks.workunit.client.1.smithi187.stdout:6/348: creat d7/d2a/d29/d40/d6a/f70 x:0 0 0 2024-09-21T00:56:33.689 INFO:tasks.workunit.client.1.smithi187.stdout:6/349: creat d7/d2a/d29/d40/d50/d68/f71 x:0 0 0 2024-09-21T00:56:33.692 INFO:tasks.workunit.client.1.smithi187.stdout:6/350: creat d7/d2a/d29/d40/f72 x:0 0 0 2024-09-21T00:56:33.692 INFO:tasks.workunit.client.1.smithi187.stdout:6/351: dread - d7/f5f zero size 2024-09-21T00:56:33.702 INFO:tasks.workunit.client.1.smithi187.stdout:6/352: dread d7/f52 [0,4194304] 0 2024-09-21T00:56:33.703 INFO:tasks.workunit.client.1.smithi187.stdout:6/353: dread - d7/f4e zero size 2024-09-21T00:56:33.713 INFO:tasks.workunit.client.1.smithi187.stdout:4/365: truncate d2/d3/da/d16/f3c 3554480 0 2024-09-21T00:56:33.730 INFO:tasks.workunit.client.1.smithi187.stdout:0/304: mkdir d0/d60 0 2024-09-21T00:56:33.735 INFO:tasks.workunit.client.1.smithi187.stdout:0/305: dread d0/d17/d1c/d23/df/f53 [0,4194304] 0 2024-09-21T00:56:33.735 INFO:tasks.workunit.client.1.smithi187.stdout:6/354: dwrite d7/f4f [0,4194304] 0 2024-09-21T00:56:33.736 INFO:tasks.workunit.client.1.smithi187.stdout:0/306: stat d0/d17/d18/d3a/f5e 0 2024-09-21T00:56:33.739 INFO:tasks.workunit.client.1.smithi187.stdout:0/307: dread d0/d17/f2e [0,4194304] 0 2024-09-21T00:56:33.741 INFO:tasks.workunit.client.1.smithi187.stdout:6/355: truncate d7/ff 356093 0 2024-09-21T00:56:33.742 INFO:tasks.workunit.client.1.smithi187.stdout:0/308: mknod d0/d5a/c61 0 2024-09-21T00:56:33.742 INFO:tasks.workunit.client.1.smithi187.stdout:6/356: fsync d7/d2a/d29/d40/d50/d68/f71 0 2024-09-21T00:56:33.743 INFO:tasks.workunit.client.1.smithi187.stdout:6/357: fdatasync d7/d2a/d29/f3f 0 2024-09-21T00:56:33.744 INFO:tasks.workunit.client.1.smithi187.stdout:6/358: fsync d7/f54 0 2024-09-21T00:56:33.747 INFO:tasks.workunit.client.1.smithi187.stdout:9/511: sync 2024-09-21T00:56:33.748 INFO:tasks.workunit.client.1.smithi187.stdout:0/309: dwrite d0/d17/d1c/d23/f30 [0,4194304] 0 2024-09-21T00:56:33.748 INFO:tasks.workunit.client.1.smithi187.stdout:6/359: rename d7/d2a/d29/d40/d5e/f67 to d7/d2a/d29/d40/d50/f73 0 2024-09-21T00:56:33.749 INFO:tasks.workunit.client.1.smithi187.stdout:0/310: chown d0/d17/d1c 443 1 2024-09-21T00:56:33.750 INFO:tasks.workunit.client.1.smithi187.stdout:0/311: readlink d0/d17/l1b 0 2024-09-21T00:56:33.752 INFO:tasks.workunit.client.1.smithi187.stdout:6/360: mknod d7/d2a/d29/d40/d6a/c74 0 2024-09-21T00:56:33.753 INFO:tasks.workunit.client.1.smithi187.stdout:0/312: symlink d0/d17/d1c/d23/df/d41/l62 0 2024-09-21T00:56:33.755 INFO:tasks.workunit.client.1.smithi187.stdout:9/512: dwrite d4/d13/d20/d2b/f7b [0,4194304] 0 2024-09-21T00:56:33.762 INFO:tasks.workunit.client.1.smithi187.stdout:9/513: rename d4/d13/d14/d28/f53 to d4/d8/d41/fa6 0 2024-09-21T00:56:33.762 INFO:tasks.workunit.client.1.smithi187.stdout:6/361: dwrite d7/f4e [0,4194304] 0 2024-09-21T00:56:33.765 INFO:tasks.workunit.client.1.smithi187.stdout:0/313: dwrite d0/d17/d1c/d23/df/d41/d3b/f59 [0,4194304] 0 2024-09-21T00:56:33.770 INFO:tasks.workunit.client.1.smithi187.stdout:9/514: dwrite d4/d13/d14/d1d/f8d [4194304,4194304] 0 2024-09-21T00:56:33.773 INFO:tasks.workunit.client.1.smithi187.stdout:9/515: mknod d4/d13/d14/d83/ca7 0 2024-09-21T00:56:33.814 INFO:tasks.workunit.client.1.smithi187.stdout:9/516: rename d4/cc to d4/d61/d6a/d90/ca8 0 2024-09-21T00:56:33.815 INFO:tasks.workunit.client.1.smithi187.stdout:9/517: write d4/d13/d14/d5d/f8b [70135,81798] 0 2024-09-21T00:56:33.825 INFO:tasks.workunit.client.1.smithi187.stdout:9/518: dread d4/d61/f68 [0,4194304] 0 2024-09-21T00:56:33.827 INFO:tasks.workunit.client.1.smithi187.stdout:9/519: unlink d4/d13/d14/d28/d72/f9d 0 2024-09-21T00:56:33.829 INFO:tasks.workunit.client.1.smithi187.stdout:9/520: creat d4/d13/fa9 x:0 0 0 2024-09-21T00:56:33.830 INFO:tasks.workunit.client.1.smithi187.stdout:9/521: readlink d4/d10/d39/d69/l7f 0 2024-09-21T00:56:33.856 INFO:tasks.workunit.client.1.smithi187.stdout:3/348: sync 2024-09-21T00:56:33.856 INFO:tasks.workunit.client.1.smithi187.stdout:8/441: sync 2024-09-21T00:56:33.857 INFO:tasks.workunit.client.1.smithi187.stdout:9/522: write d4/d8/f19 [1985097,119967] 0 2024-09-21T00:56:33.859 INFO:tasks.workunit.client.1.smithi187.stdout:9/523: mkdir d4/d61/d6a/d90/daa 0 2024-09-21T00:56:33.862 INFO:tasks.workunit.client.1.smithi187.stdout:3/349: dwrite f3 [0,4194304] 0 2024-09-21T00:56:33.869 INFO:tasks.workunit.client.1.smithi187.stdout:3/350: dwrite d9/d19/d1c/f3e [4194304,4194304] 0 2024-09-21T00:56:33.922 INFO:tasks.workunit.client.1.smithi187.stdout:5/358: sync 2024-09-21T00:56:33.922 INFO:tasks.workunit.client.1.smithi187.stdout:4/366: sync 2024-09-21T00:56:33.922 INFO:tasks.workunit.client.1.smithi187.stdout:7/316: sync 2024-09-21T00:56:33.922 INFO:tasks.workunit.client.1.smithi187.stdout:1/382: sync 2024-09-21T00:56:33.922 INFO:tasks.workunit.client.1.smithi187.stdout:2/361: sync 2024-09-21T00:56:33.926 INFO:tasks.workunit.client.1.smithi187.stdout:2/362: dread d2/f8 [0,4194304] 0 2024-09-21T00:56:33.934 INFO:tasks.workunit.client.1.smithi187.stdout:7/317: dread d1/d18/d31/d33/d3b/f3f [0,4194304] 0 2024-09-21T00:56:33.935 INFO:tasks.workunit.client.1.smithi187.stdout:7/318: stat d1/d18/d31/d5a/d5d/l60 0 2024-09-21T00:56:33.945 INFO:tasks.workunit.client.1.smithi187.stdout:7/319: dread d1/d18/f6b [0,4194304] 0 2024-09-21T00:56:33.945 INFO:tasks.workunit.client.1.smithi187.stdout:7/320: fsync d1/d18/d31/d33/d3b/f66 0 2024-09-21T00:56:33.947 INFO:tasks.workunit.client.1.smithi187.stdout:7/321: dread d1/d18/d31/f51 [0,4194304] 0 2024-09-21T00:56:33.953 INFO:tasks.workunit.client.1.smithi187.stdout:0/314: sync 2024-09-21T00:56:33.953 INFO:tasks.workunit.client.1.smithi187.stdout:8/442: sync 2024-09-21T00:56:33.953 INFO:tasks.workunit.client.1.smithi187.stdout:6/362: sync 2024-09-21T00:56:33.954 INFO:tasks.workunit.client.1.smithi187.stdout:6/363: dread - d7/d2a/d29/d40/d6a/f70 zero size 2024-09-21T00:56:33.954 INFO:tasks.workunit.client.1.smithi187.stdout:0/315: write d0/d17/d1c/d23/f19 [1685226,103199] 0 2024-09-21T00:56:33.965 INFO:tasks.workunit.client.1.smithi187.stdout:9/524: link d4/f5 d4/d61/d6c/fab 0 2024-09-21T00:56:33.966 INFO:tasks.workunit.client.1.smithi187.stdout:9/525: chown d4/d8/d44/d6e/c7a 0 1 2024-09-21T00:56:33.966 INFO:tasks.workunit.client.1.smithi187.stdout:3/351: symlink d9/d19/d42/l6d 0 2024-09-21T00:56:33.967 INFO:tasks.workunit.client.1.smithi187.stdout:3/352: chown d9 119030 1 2024-09-21T00:56:33.967 INFO:tasks.workunit.client.1.smithi187.stdout:1/383: fdatasync d4/d6/d23/f54 0 2024-09-21T00:56:33.971 INFO:tasks.workunit.client.1.smithi187.stdout:9/526: dwrite d4/d8/f64 [0,4194304] 0 2024-09-21T00:56:33.973 INFO:tasks.workunit.client.1.smithi187.stdout:1/384: dwrite d4/d6/d64/f71 [0,4194304] 0 2024-09-21T00:56:33.981 INFO:tasks.workunit.client.1.smithi187.stdout:1/385: dwrite d4/d6/d8/d35/d22/f57 [0,4194304] 0 2024-09-21T00:56:33.986 INFO:tasks.workunit.client.1.smithi187.stdout:7/322: creat d1/d18/f76 x:0 0 0 2024-09-21T00:56:33.988 INFO:tasks.workunit.client.1.smithi187.stdout:8/443: rename dc/d44/f5d to dc/d1c/d29/f91 0 2024-09-21T00:56:33.988 INFO:tasks.workunit.client.1.smithi187.stdout:6/364: symlink d7/d2a/d29/d40/d50/l75 0 2024-09-21T00:56:33.990 INFO:tasks.workunit.client.1.smithi187.stdout:5/359: mknod d0/c84 0 2024-09-21T00:56:33.992 INFO:tasks.workunit.client.1.smithi187.stdout:1/386: dwrite d4/f62 [0,4194304] 0 2024-09-21T00:56:33.994 INFO:tasks.workunit.client.1.smithi187.stdout:7/323: dread d1/dc/d15/d22/f24 [0,4194304] 0 2024-09-21T00:56:33.995 INFO:tasks.workunit.client.1.smithi187.stdout:8/444: creat dc/f92 x:0 0 0 2024-09-21T00:56:33.996 INFO:tasks.workunit.client.1.smithi187.stdout:2/363: creat d2/d3/d15/d1b/d3c/f85 x:0 0 0 2024-09-21T00:56:33.997 INFO:tasks.workunit.client.1.smithi187.stdout:6/365: creat d7/d2a/d29/d40/d45/f76 x:0 0 0 2024-09-21T00:56:33.997 INFO:tasks.workunit.client.1.smithi187.stdout:5/360: symlink d0/dc/d39/d46/d67/d14/d38/l85 0 2024-09-21T00:56:33.998 INFO:tasks.workunit.client.1.smithi187.stdout:1/387: creat d4/d6/d8/d35/d4c/f85 x:0 0 0 2024-09-21T00:56:33.999 INFO:tasks.workunit.client.1.smithi187.stdout:0/316: creat d0/f63 x:0 0 0 2024-09-21T00:56:33.999 INFO:tasks.workunit.client.1.smithi187.stdout:2/364: truncate d2/d3/d15/f60 897365 0 2024-09-21T00:56:33.999 INFO:tasks.workunit.client.1.smithi187.stdout:1/388: stat d4/d6 0 2024-09-21T00:56:33.999 INFO:tasks.workunit.client.1.smithi187.stdout:7/324: mknod d1/d18/d31/d5a/c77 0 2024-09-21T00:56:34.001 INFO:tasks.workunit.client.1.smithi187.stdout:6/366: write d7/f52 [710705,37756] 0 2024-09-21T00:56:34.001 INFO:tasks.workunit.client.1.smithi187.stdout:5/361: symlink d0/dc/d39/d46/l86 0 2024-09-21T00:56:34.002 INFO:tasks.workunit.client.1.smithi187.stdout:7/325: write d1/d18/d31/f32 [3541534,80031] 0 2024-09-21T00:56:34.003 INFO:tasks.workunit.client.1.smithi187.stdout:1/389: mkdir d4/d86 0 2024-09-21T00:56:34.004 INFO:tasks.workunit.client.1.smithi187.stdout:7/326: fdatasync d1/dc/d15/d22/f4f 0 2024-09-21T00:56:34.004 INFO:tasks.workunit.client.1.smithi187.stdout:2/365: truncate d2/dc/f46 405790 0 2024-09-21T00:56:34.006 INFO:tasks.workunit.client.1.smithi187.stdout:2/366: write d2/d25/d34/f59 [1289239,103352] 0 2024-09-21T00:56:34.006 INFO:tasks.workunit.client.1.smithi187.stdout:6/367: unlink d7/d2a/l1b 0 2024-09-21T00:56:34.007 INFO:tasks.workunit.client.1.smithi187.stdout:6/368: stat d7/d2a/f2f 0 2024-09-21T00:56:34.007 INFO:tasks.workunit.client.1.smithi187.stdout:2/367: fsync d2/dc/d2e/d4a/d7c/d52/f64 0 2024-09-21T00:56:34.014 INFO:tasks.workunit.client.1.smithi187.stdout:1/390: creat d4/d6/d8/d35/d79/f87 x:0 0 0 2024-09-21T00:56:34.016 INFO:tasks.workunit.client.1.smithi187.stdout:7/327: mknod d1/d18/d31/d33/d3b/d62/c78 0 2024-09-21T00:56:34.016 INFO:tasks.workunit.client.1.smithi187.stdout:0/317: link d0/d17/d1c/d23/df/d41/l62 d0/d17/d1c/d23/df/d41/l64 0 2024-09-21T00:56:34.021 INFO:tasks.workunit.client.1.smithi187.stdout:4/367: write d2/d3/da/d16/f61 [1253885,119013] 0 2024-09-21T00:56:34.022 INFO:tasks.workunit.client.1.smithi187.stdout:7/328: creat d1/dc/d15/d22/f79 x:0 0 0 2024-09-21T00:56:34.023 INFO:tasks.workunit.client.1.smithi187.stdout:0/318: mkdir d0/d17/d1c/d65 0 2024-09-21T00:56:34.024 INFO:tasks.workunit.client.1.smithi187.stdout:7/329: truncate d1/f1a 5137773 0 2024-09-21T00:56:34.025 INFO:tasks.workunit.client.1.smithi187.stdout:7/330: stat d1/d18/f76 0 2024-09-21T00:56:34.026 INFO:tasks.workunit.client.1.smithi187.stdout:6/369: rename d7/d2a/d29/d40/d50/d68/f71 to d7/d2a/f77 0 2024-09-21T00:56:34.026 INFO:tasks.workunit.client.1.smithi187.stdout:7/331: chown d1/f7 13 1 2024-09-21T00:56:34.028 INFO:tasks.workunit.client.1.smithi187.stdout:2/368: getdents d2/d3/df 0 2024-09-21T00:56:34.029 INFO:tasks.workunit.client.1.smithi187.stdout:4/368: dwrite d2/d3/f13 [0,4194304] 0 2024-09-21T00:56:34.035 INFO:tasks.workunit.client.1.smithi187.stdout:4/369: creat d2/d3/da/d16/d5f/f75 x:0 0 0 2024-09-21T00:56:34.035 INFO:tasks.workunit.client.1.smithi187.stdout:7/332: mknod d1/d18/d31/c7a 0 2024-09-21T00:56:34.036 INFO:tasks.workunit.client.1.smithi187.stdout:9/527: dread d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:34.036 INFO:tasks.workunit.client.1.smithi187.stdout:6/370: dwrite d7/d2a/fb [0,4194304] 0 2024-09-21T00:56:34.037 INFO:tasks.workunit.client.1.smithi187.stdout:2/369: dread d2/d3/df/f41 [0,4194304] 0 2024-09-21T00:56:34.037 INFO:tasks.workunit.client.1.smithi187.stdout:8/445: chown dc/l25 11 1 2024-09-21T00:56:34.038 INFO:tasks.workunit.client.1.smithi187.stdout:9/528: chown d4/d13 398 1 2024-09-21T00:56:34.038 INFO:tasks.workunit.client.1.smithi187.stdout:6/371: readlink d7/d2a/l15 0 2024-09-21T00:56:34.039 INFO:tasks.workunit.client.1.smithi187.stdout:0/319: getdents d0/d17/d18/d3a 0 2024-09-21T00:56:34.042 INFO:tasks.workunit.client.1.smithi187.stdout:9/529: write d4/d61/d6c/f99 [251286,19151] 0 2024-09-21T00:56:34.042 INFO:tasks.workunit.client.1.smithi187.stdout:8/446: fdatasync dc/d2f/d54/f7f 0 2024-09-21T00:56:34.044 INFO:tasks.workunit.client.1.smithi187.stdout:4/370: rename d2/d3/l14 to d2/d3/da/d2f/d32/d22/d37/d51/l76 0 2024-09-21T00:56:34.045 INFO:tasks.workunit.client.1.smithi187.stdout:1/391: write d4/d6/d23/d2e/d53/f7f [206874,39292] 0 2024-09-21T00:56:34.046 INFO:tasks.workunit.client.1.smithi187.stdout:2/370: creat d2/dc/d2e/f86 x:0 0 0 2024-09-21T00:56:34.047 INFO:tasks.workunit.client.1.smithi187.stdout:6/372: symlink d7/d2a/d29/d40/d6a/l78 0 2024-09-21T00:56:34.048 INFO:tasks.workunit.client.1.smithi187.stdout:9/530: creat d4/d10/fac x:0 0 0 2024-09-21T00:56:34.049 INFO:tasks.workunit.client.1.smithi187.stdout:8/447: readlink dc/d1c/l40 0 2024-09-21T00:56:34.050 INFO:tasks.workunit.client.1.smithi187.stdout:0/320: mknod d0/d17/d1c/d65/c66 0 2024-09-21T00:56:34.050 INFO:tasks.workunit.client.1.smithi187.stdout:2/371: read d2/d3/d15/d1b/d1c/f54 [193111,40928] 0 2024-09-21T00:56:34.052 INFO:tasks.workunit.client.1.smithi187.stdout:6/373: mknod d7/c79 0 2024-09-21T00:56:34.054 INFO:tasks.workunit.client.1.smithi187.stdout:1/392: getdents d4/d6/d8/d35/d22/d65 0 2024-09-21T00:56:34.054 INFO:tasks.workunit.client.1.smithi187.stdout:4/371: dwrite d2/d3/da/d16/f61 [0,4194304] 0 2024-09-21T00:56:34.058 INFO:tasks.workunit.client.1.smithi187.stdout:6/374: mkdir d7/d2a/d7a 0 2024-09-21T00:56:34.059 INFO:tasks.workunit.client.1.smithi187.stdout:9/531: dwrite d4/d10/f4a [0,4194304] 0 2024-09-21T00:56:34.060 INFO:tasks.workunit.client.1.smithi187.stdout:6/375: dread d7/f2c [0,4194304] 0 2024-09-21T00:56:34.064 INFO:tasks.workunit.client.1.smithi187.stdout:2/372: rename d2/dc/d2e/d51/f66 to d2/d3/d15/f87 0 2024-09-21T00:56:34.066 INFO:tasks.workunit.client.1.smithi187.stdout:1/393: creat d4/d6/d8/d35/d79/f88 x:0 0 0 2024-09-21T00:56:34.069 INFO:tasks.workunit.client.1.smithi187.stdout:9/532: creat d4/d13/d14/d1d/fad x:0 0 0 2024-09-21T00:56:34.069 INFO:tasks.workunit.client.1.smithi187.stdout:1/394: dread d4/f62 [0,4194304] 0 2024-09-21T00:56:34.070 INFO:tasks.workunit.client.1.smithi187.stdout:6/376: creat d7/d2a/d29/d40/d50/f7b x:0 0 0 2024-09-21T00:56:34.070 INFO:tasks.workunit.client.1.smithi187.stdout:1/395: readlink d4/d6/d8/d35/l39 0 2024-09-21T00:56:34.072 INFO:tasks.workunit.client.1.smithi187.stdout:2/373: mkdir d2/dc/d2e/d4a/d7c/d88 0 2024-09-21T00:56:34.073 INFO:tasks.workunit.client.1.smithi187.stdout:4/372: mkdir d2/d3/da/d2f/d32/d26/d4a/d60/d6c/d77 0 2024-09-21T00:56:34.074 INFO:tasks.workunit.client.1.smithi187.stdout:8/448: truncate dc/f12 1750801 0 2024-09-21T00:56:34.076 INFO:tasks.workunit.client.1.smithi187.stdout:3/353: sync 2024-09-21T00:56:34.080 INFO:tasks.workunit.client.1.smithi187.stdout:4/373: symlink d2/d3/da/d2f/d32/d26/d4a/d58/l78 0 2024-09-21T00:56:34.083 INFO:tasks.workunit.client.1.smithi187.stdout:0/321: truncate d0/d17/d1c/d23/df/d41/d3b/f59 1408020 0 2024-09-21T00:56:34.083 INFO:tasks.workunit.client.1.smithi187.stdout:3/354: dread d9/d13/f3d [0,4194304] 0 2024-09-21T00:56:34.088 INFO:tasks.workunit.client.1.smithi187.stdout:4/374: dwrite d2/d3/da/d2f/d32/d22/f49 [0,4194304] 0 2024-09-21T00:56:34.090 INFO:tasks.workunit.client.1.smithi187.stdout:6/377: creat d7/d2a/d29/f7c x:0 0 0 2024-09-21T00:56:34.090 INFO:tasks.workunit.client.1.smithi187.stdout:9/533: truncate d4/d8/d41/fa6 216755 0 2024-09-21T00:56:34.091 INFO:tasks.workunit.client.1.smithi187.stdout:0/322: symlink d0/d17/d18/d3a/l67 0 2024-09-21T00:56:34.092 INFO:tasks.workunit.client.1.smithi187.stdout:3/355: dwrite d9/d19/d42/d53/f59 [0,4194304] 0 2024-09-21T00:56:34.093 INFO:tasks.workunit.client.1.smithi187.stdout:0/323: write d0/d17/d18/f43 [4153544,5300] 0 2024-09-21T00:56:34.094 INFO:tasks.workunit.client.1.smithi187.stdout:1/396: link d4/d6/d8/d35/f82 d4/f89 0 2024-09-21T00:56:34.095 INFO:tasks.workunit.client.1.smithi187.stdout:0/324: chown d0/d17/d1c/d23/df/d41/d3b 14452 1 2024-09-21T00:56:34.096 INFO:tasks.workunit.client.1.smithi187.stdout:1/397: fdatasync d4/d6/d8/d35/d79/f87 0 2024-09-21T00:56:34.099 INFO:tasks.workunit.client.1.smithi187.stdout:2/374: getdents d2/dc/d2e/d4a/d7c/d52 0 2024-09-21T00:56:34.099 INFO:tasks.workunit.client.1.smithi187.stdout:3/356: mknod d9/c6e 0 2024-09-21T00:56:34.100 INFO:tasks.workunit.client.1.smithi187.stdout:8/449: dread dc/fd [0,4194304] 0 2024-09-21T00:56:34.101 INFO:tasks.workunit.client.1.smithi187.stdout:2/375: truncate d2/dc/d2e/f82 213332 0 2024-09-21T00:56:34.102 INFO:tasks.workunit.client.1.smithi187.stdout:4/375: symlink d2/d3/da/d2f/l79 0 2024-09-21T00:56:34.103 INFO:tasks.workunit.client.1.smithi187.stdout:2/376: dread - d2/dc/d2e/d4a/d7c/f45 zero size 2024-09-21T00:56:34.104 INFO:tasks.workunit.client.1.smithi187.stdout:1/398: dread d4/d6/d8/d35/d22/d65/f6d [0,4194304] 0 2024-09-21T00:56:34.105 INFO:tasks.workunit.client.1.smithi187.stdout:1/399: stat d4/d75/l7e 0 2024-09-21T00:56:34.106 INFO:tasks.workunit.client.1.smithi187.stdout:2/377: dread - d2/dc/d2e/d4a/d7c/f45 zero size 2024-09-21T00:56:34.107 INFO:tasks.workunit.client.1.smithi187.stdout:3/357: symlink d9/d19/d42/d53/d56/d61/l6f 0 2024-09-21T00:56:34.108 INFO:tasks.workunit.client.1.smithi187.stdout:4/376: read d2/d3/da/d2f/d32/d22/d37/d63/f69 [3239856,16380] 0 2024-09-21T00:56:34.108 INFO:tasks.workunit.client.1.smithi187.stdout:8/450: creat dc/d2f/d80/f93 x:0 0 0 2024-09-21T00:56:34.110 INFO:tasks.workunit.client.1.smithi187.stdout:4/377: stat d2/d3/da/d2f/d32/d25 0 2024-09-21T00:56:34.110 INFO:tasks.workunit.client.1.smithi187.stdout:6/378: rename d7/c3a to d7/d2a/d29/c7d 0 2024-09-21T00:56:34.111 INFO:tasks.workunit.client.1.smithi187.stdout:9/534: dwrite d4/d13/d20/f62 [4194304,4194304] 0 2024-09-21T00:56:34.112 INFO:tasks.workunit.client.1.smithi187.stdout:1/400: creat d4/d6/d8/d35/d4c/d5b/f8a x:0 0 0 2024-09-21T00:56:34.113 INFO:tasks.workunit.client.1.smithi187.stdout:3/358: mknod d9/d19/d1c/d5f/c70 0 2024-09-21T00:56:34.115 INFO:tasks.workunit.client.1.smithi187.stdout:0/325: link d0/d17/d1c/d23/df/f32 d0/d17/d18/f68 0 2024-09-21T00:56:34.115 INFO:tasks.workunit.client.1.smithi187.stdout:8/451: chown dc/l4e 139 1 2024-09-21T00:56:34.115 INFO:tasks.workunit.client.1.smithi187.stdout:4/378: rmdir d2/d3/da/d2f/d32/d22/d37 39 2024-09-21T00:56:34.116 INFO:tasks.workunit.client.1.smithi187.stdout:6/379: fdatasync d7/d2a/d29/d40/d50/f73 0 2024-09-21T00:56:34.116 INFO:tasks.workunit.client.1.smithi187.stdout:1/401: rmdir d4/d6/d8/d35/d22/d65 39 2024-09-21T00:56:34.120 INFO:tasks.workunit.client.1.smithi187.stdout:9/535: creat d4/d13/d20/d2b/d94/fae x:0 0 0 2024-09-21T00:56:34.121 INFO:tasks.workunit.client.1.smithi187.stdout:0/326: creat d0/d17/d1c/d23/df/f69 x:0 0 0 2024-09-21T00:56:34.123 INFO:tasks.workunit.client.1.smithi187.stdout:4/379: dwrite d2/d3/da/d16/f61 [0,4194304] 0 2024-09-21T00:56:34.125 INFO:tasks.workunit.client.1.smithi187.stdout:4/380: dread - d2/d3/da/d16/d5f/f75 zero size 2024-09-21T00:56:34.125 INFO:tasks.workunit.client.1.smithi187.stdout:1/402: creat d4/d6/d8/d35/d4c/f8b x:0 0 0 2024-09-21T00:56:34.127 INFO:tasks.workunit.client.1.smithi187.stdout:8/452: mkdir dc/d94 0 2024-09-21T00:56:34.128 INFO:tasks.workunit.client.1.smithi187.stdout:9/536: dwrite d4/d13/d20/d2b/f7b [0,4194304] 0 2024-09-21T00:56:34.129 INFO:tasks.workunit.client.1.smithi187.stdout:9/537: read d4/d10/f4a [1013936,59817] 0 2024-09-21T00:56:34.131 INFO:tasks.workunit.client.1.smithi187.stdout:0/327: rename d0/d17/d18/c1a to d0/d17/c6a 0 2024-09-21T00:56:34.135 INFO:tasks.workunit.client.1.smithi187.stdout:6/380: creat d7/d2a/d7a/f7e x:0 0 0 2024-09-21T00:56:34.136 INFO:tasks.workunit.client.1.smithi187.stdout:1/403: fsync d4/f62 0 2024-09-21T00:56:34.137 INFO:tasks.workunit.client.1.smithi187.stdout:4/381: creat d2/d3/da/d2f/d4b/f7a x:0 0 0 2024-09-21T00:56:34.140 INFO:tasks.workunit.client.1.smithi187.stdout:4/382: chown d2/d3/da/d48 940 1 2024-09-21T00:56:34.140 INFO:tasks.workunit.client.1.smithi187.stdout:9/538: dwrite d4/d61/d6a/f9e [0,4194304] 0 2024-09-21T00:56:34.144 INFO:tasks.workunit.client.1.smithi187.stdout:6/381: creat d7/d59/f7f x:0 0 0 2024-09-21T00:56:34.144 INFO:tasks.workunit.client.1.smithi187.stdout:9/539: write d4/d13/fa9 [8588,5469] 0 2024-09-21T00:56:34.145 INFO:tasks.workunit.client.1.smithi187.stdout:2/378: dwrite d2/dc/d2e/d4a/d7c/f37 [0,4194304] 0 2024-09-21T00:56:34.145 INFO:tasks.workunit.client.1.smithi187.stdout:5/362: sync 2024-09-21T00:56:34.152 INFO:tasks.workunit.client.1.smithi187.stdout:4/383: read - d2/d3/da/d2f/d32/d22/d37/d63/f72 zero size 2024-09-21T00:56:34.153 INFO:tasks.workunit.client.1.smithi187.stdout:9/540: stat d4/d8/f48 0 2024-09-21T00:56:34.155 INFO:tasks.workunit.client.1.smithi187.stdout:3/359: dread d9/d19/d43/f52 [0,4194304] 0 2024-09-21T00:56:34.156 INFO:tasks.workunit.client.1.smithi187.stdout:9/541: fsync d4/f3b 0 2024-09-21T00:56:34.156 INFO:tasks.workunit.client.1.smithi187.stdout:6/382: write d7/d59/f7f [796988,56670] 0 2024-09-21T00:56:34.156 INFO:tasks.workunit.client.1.smithi187.stdout:8/453: dwrite dc/d2f/f8f [0,4194304] 0 2024-09-21T00:56:34.157 INFO:tasks.workunit.client.1.smithi187.stdout:1/404: creat d4/f8c x:0 0 0 2024-09-21T00:56:34.157 INFO:tasks.workunit.client.1.smithi187.stdout:5/363: write d0/dc/d39/d46/d67/d14/d1b/d27/d3a/f72 [927398,28499] 0 2024-09-21T00:56:34.184 INFO:tasks.workunit.client.1.smithi187.stdout:6/383: rmdir d7/d2a 39 2024-09-21T00:56:34.186 INFO:tasks.workunit.client.1.smithi187.stdout:1/405: dread - d4/d6/d8/d35/d4c/f85 zero size 2024-09-21T00:56:34.188 INFO:tasks.workunit.client.1.smithi187.stdout:1/406: chown d4/d75 0 1 2024-09-21T00:56:34.189 INFO:tasks.workunit.client.1.smithi187.stdout:8/454: symlink dc/d2f/d54/l95 0 2024-09-21T00:56:34.191 INFO:tasks.workunit.client.1.smithi187.stdout:6/384: unlink d7/ld 0 2024-09-21T00:56:34.193 INFO:tasks.workunit.client.1.smithi187.stdout:3/360: dwrite d9/d19/d1c/f47 [0,4194304] 0 2024-09-21T00:56:34.195 INFO:tasks.workunit.client.1.smithi187.stdout:2/379: dread d2/dc/f13 [0,4194304] 0 2024-09-21T00:56:34.198 INFO:tasks.workunit.client.1.smithi187.stdout:1/407: mkdir d4/d6/d8/d35/d22/d8d 0 2024-09-21T00:56:34.199 INFO:tasks.workunit.client.1.smithi187.stdout:3/361: symlink d9/d19/d43/l71 0 2024-09-21T00:56:34.200 INFO:tasks.workunit.client.1.smithi187.stdout:2/380: fsync d2/d3/d15/f63 0 2024-09-21T00:56:34.201 INFO:tasks.workunit.client.1.smithi187.stdout:0/328: dread d0/d17/d1c/f45 [0,4194304] 0 2024-09-21T00:56:34.201 INFO:tasks.workunit.client.1.smithi187.stdout:6/385: mknod d7/d2a/d29/d40/d45/c80 0 2024-09-21T00:56:34.201 INFO:tasks.workunit.client.1.smithi187.stdout:9/542: dwrite d4/d13/d14/d5d/f79 [0,4194304] 0 2024-09-21T00:56:34.203 INFO:tasks.workunit.client.1.smithi187.stdout:5/364: dwrite d0/dc/d39/d46/d67/d30/f3b [0,4194304] 0 2024-09-21T00:56:34.210 INFO:tasks.workunit.client.1.smithi187.stdout:5/365: write d0/dc/d39/f4b [95696,21820] 0 2024-09-21T00:56:34.210 INFO:tasks.workunit.client.1.smithi187.stdout:8/455: link dc/l50 dc/d2f/d34/d4b/d85/l96 0 2024-09-21T00:56:34.211 INFO:tasks.workunit.client.1.smithi187.stdout:0/329: mkdir d0/d60/d6b 0 2024-09-21T00:56:34.212 INFO:tasks.workunit.client.1.smithi187.stdout:6/386: creat d7/d2a/d29/d40/d50/f81 x:0 0 0 2024-09-21T00:56:34.212 INFO:tasks.workunit.client.1.smithi187.stdout:9/543: mknod d4/d13/d14/d1d/d5f/caf 0 2024-09-21T00:56:34.215 INFO:tasks.workunit.client.1.smithi187.stdout:5/366: dread d0/dc/d39/f4b [0,4194304] 0 2024-09-21T00:56:34.217 INFO:tasks.workunit.client.1.smithi187.stdout:7/333: sync 2024-09-21T00:56:34.217 INFO:tasks.workunit.client.1.smithi187.stdout:8/456: creat dc/d2f/d34/d4b/f97 x:0 0 0 2024-09-21T00:56:34.221 INFO:tasks.workunit.client.1.smithi187.stdout:2/381: link d2/d3/d15/d1b/d3c/f85 d2/dc/d2e/d4a/d7c/f89 0 2024-09-21T00:56:34.222 INFO:tasks.workunit.client.1.smithi187.stdout:2/382: fdatasync d2/d3/df/f3e 0 2024-09-21T00:56:34.223 INFO:tasks.workunit.client.1.smithi187.stdout:5/367: symlink d0/dc/d39/d46/d67/d14/d38/l87 0 2024-09-21T00:56:34.227 INFO:tasks.workunit.client.1.smithi187.stdout:2/383: write d2/dc/d2e/d4a/d7c/f45 [3716,89724] 0 2024-09-21T00:56:34.228 INFO:tasks.workunit.client.1.smithi187.stdout:9/544: mkdir d4/db0 0 2024-09-21T00:56:34.230 INFO:tasks.workunit.client.1.smithi187.stdout:3/362: truncate d9/d19/d1c/f5e 726689 0 2024-09-21T00:56:34.231 INFO:tasks.workunit.client.1.smithi187.stdout:1/408: dread d4/d6/d8/d35/d4c/f4d [0,4194304] 0 2024-09-21T00:56:34.232 INFO:tasks.workunit.client.1.smithi187.stdout:7/334: fdatasync d1/dc/f12 0 2024-09-21T00:56:34.232 INFO:tasks.workunit.client.1.smithi187.stdout:8/457: creat dc/d94/f98 x:0 0 0 2024-09-21T00:56:34.233 INFO:tasks.workunit.client.1.smithi187.stdout:1/409: fdatasync d4/d6/d8/f13 0 2024-09-21T00:56:34.233 INFO:tasks.workunit.client.1.smithi187.stdout:6/387: link d7/d2a/d29/d40/f20 d7/d2a/d29/d40/d50/f82 0 2024-09-21T00:56:34.233 INFO:tasks.workunit.client.1.smithi187.stdout:5/368: dwrite d0/dc/d39/d46/d67/d14/d1b/d27/f2f [0,4194304] 0 2024-09-21T00:56:34.234 INFO:tasks.workunit.client.1.smithi187.stdout:2/384: rename d2/d3/d15/d1b/d3c/f3d to d2/dc/d2e/d6f/f8a 0 2024-09-21T00:56:34.235 INFO:tasks.workunit.client.1.smithi187.stdout:5/369: readlink d0/dc/d39/d46/l86 0 2024-09-21T00:56:34.245 INFO:tasks.workunit.client.1.smithi187.stdout:2/385: dread - d2/dc/d2e/d4a/d7c/d52/f64 zero size 2024-09-21T00:56:34.246 INFO:tasks.workunit.client.1.smithi187.stdout:5/370: chown d0/dc/d39/d46/d67/d30/f65 40345 1 2024-09-21T00:56:34.246 INFO:tasks.workunit.client.1.smithi187.stdout:0/330: write d0/d17/d1c/d23/df/f32 [411288,37581] 0 2024-09-21T00:56:34.246 INFO:tasks.workunit.client.1.smithi187.stdout:8/458: unlink dc/d2f/d80/f88 0 2024-09-21T00:56:34.247 INFO:tasks.workunit.client.1.smithi187.stdout:6/388: mkdir d7/d2a/d29/d40/d50/d83 0 2024-09-21T00:56:34.251 INFO:tasks.workunit.client.1.smithi187.stdout:8/459: write dc/f49 [1133909,28733] 0 2024-09-21T00:56:34.253 INFO:tasks.workunit.client.1.smithi187.stdout:5/371: truncate d0/f20 682481 0 2024-09-21T00:56:34.253 INFO:tasks.workunit.client.1.smithi187.stdout:1/410: dwrite d4/d6/d23/f54 [0,4194304] 0 2024-09-21T00:56:34.254 INFO:tasks.workunit.client.1.smithi187.stdout:3/363: dwrite d9/d19/d1c/f38 [4194304,4194304] 0 2024-09-21T00:56:34.254 INFO:tasks.workunit.client.1.smithi187.stdout:9/545: rename c2 to d4/d8/d44/cb1 0 2024-09-21T00:56:34.260 INFO:tasks.workunit.client.1.smithi187.stdout:8/460: dwrite dc/d2f/d37/f42 [0,4194304] 0 2024-09-21T00:56:34.263 INFO:tasks.workunit.client.1.smithi187.stdout:9/546: write d4/d10/d8f/f95 [385396,63482] 0 2024-09-21T00:56:34.264 INFO:tasks.workunit.client.1.smithi187.stdout:6/389: creat d7/f84 x:0 0 0 2024-09-21T00:56:34.265 INFO:tasks.workunit.client.1.smithi187.stdout:3/364: symlink d9/d19/d1c/d5f/l72 0 2024-09-21T00:56:34.266 INFO:tasks.workunit.client.1.smithi187.stdout:2/386: mkdir d2/d3/d15/d1b/d3c/d40/d75/d8b 0 2024-09-21T00:56:34.267 INFO:tasks.workunit.client.1.smithi187.stdout:2/387: write d2/d3/d15/f60 [1157517,81212] 0 2024-09-21T00:56:34.268 INFO:tasks.workunit.client.1.smithi187.stdout:8/461: readlink dc/d44/l7e 0 2024-09-21T00:56:34.269 INFO:tasks.workunit.client.1.smithi187.stdout:1/411: creat d4/d86/f8e x:0 0 0 2024-09-21T00:56:34.271 INFO:tasks.workunit.client.1.smithi187.stdout:1/412: truncate d4/f89 841246 0 2024-09-21T00:56:34.271 INFO:tasks.workunit.client.1.smithi187.stdout:9/547: symlink d4/d10/lb2 0 2024-09-21T00:56:34.272 INFO:tasks.workunit.client.1.smithi187.stdout:6/390: symlink d7/d2a/d29/d40/d45/l85 0 2024-09-21T00:56:34.275 INFO:tasks.workunit.client.1.smithi187.stdout:2/388: mkdir d2/d3/d15/d1b/d3c/d69/d8c 0 2024-09-21T00:56:34.278 INFO:tasks.workunit.client.1.smithi187.stdout:5/372: dwrite d0/dc/d39/f4b [0,4194304] 0 2024-09-21T00:56:34.278 INFO:tasks.workunit.client.1.smithi187.stdout:2/389: creat d2/d3/f8d x:0 0 0 2024-09-21T00:56:34.278 INFO:tasks.workunit.client.1.smithi187.stdout:4/384: sync 2024-09-21T00:56:34.278 INFO:tasks.workunit.client.1.smithi187.stdout:1/413: creat d4/d6/d23/d2e/d53/d6a/f8f x:0 0 0 2024-09-21T00:56:34.279 INFO:tasks.workunit.client.1.smithi187.stdout:9/548: creat d4/d10/d39/fb3 x:0 0 0 2024-09-21T00:56:34.282 INFO:tasks.workunit.client.1.smithi187.stdout:1/414: chown d4/d6/d8/d35/d22/d2c 11 1 2024-09-21T00:56:34.282 INFO:tasks.workunit.client.1.smithi187.stdout:4/385: chown d2/d3/da/d2f/d32/d22/d37/d51/c55 410 1 2024-09-21T00:56:34.282 INFO:tasks.workunit.client.1.smithi187.stdout:2/390: mknod d2/d3/d15/c8e 0 2024-09-21T00:56:34.283 INFO:tasks.workunit.client.1.smithi187.stdout:6/391: link d7/d2a/d29/d40/d50/c6f d7/d2a/d7a/c86 0 2024-09-21T00:56:34.285 INFO:tasks.workunit.client.1.smithi187.stdout:5/373: symlink d0/dc/d1f/l88 0 2024-09-21T00:56:34.286 INFO:tasks.workunit.client.1.smithi187.stdout:5/374: chown d0 184132 1 2024-09-21T00:56:34.289 INFO:tasks.workunit.client.1.smithi187.stdout:5/375: readlink d0/dc/d39/d46/d67/d14/d38/l87 0 2024-09-21T00:56:34.290 INFO:tasks.workunit.client.1.smithi187.stdout:9/549: dwrite d4/d13/d14/d1d/f8d [4194304,4194304] 0 2024-09-21T00:56:34.290 INFO:tasks.workunit.client.1.smithi187.stdout:5/376: fdatasync d0/dc/d39/d46/d67/f15 0 2024-09-21T00:56:34.290 INFO:tasks.workunit.client.1.smithi187.stdout:1/415: mkdir d4/d6/d8/d35/d22/d65/d90 0 2024-09-21T00:56:34.291 INFO:tasks.workunit.client.1.smithi187.stdout:3/365: write d9/d13/d20/f2e [1927408,117549] 0 2024-09-21T00:56:34.292 INFO:tasks.workunit.client.1.smithi187.stdout:9/550: readlink d4/d61/d6c/l3d 0 2024-09-21T00:56:34.292 INFO:tasks.workunit.client.1.smithi187.stdout:6/392: creat d7/d2a/d29/d40/d50/d83/f87 x:0 0 0 2024-09-21T00:56:34.293 INFO:tasks.workunit.client.1.smithi187.stdout:1/416: chown d4/d6/d8/d35/d79/f87 46441 1 2024-09-21T00:56:34.294 INFO:tasks.workunit.client.1.smithi187.stdout:2/391: rename d2/d25/d34 to d2/d3/d15/d1b/d1c/d2d/d8f 0 2024-09-21T00:56:34.295 INFO:tasks.workunit.client.1.smithi187.stdout:3/366: unlink d9/fb 0 2024-09-21T00:56:34.295 INFO:tasks.workunit.client.1.smithi187.stdout:6/393: write d7/d2a/d7a/f7e [66389,30082] 0 2024-09-21T00:56:34.296 INFO:tasks.workunit.client.1.smithi187.stdout:5/377: symlink d0/dc/d39/d46/d67/d30/l89 0 2024-09-21T00:56:34.296 INFO:tasks.workunit.client.1.smithi187.stdout:9/551: mkdir d4/d13/d14/d28/db4 0 2024-09-21T00:56:34.298 INFO:tasks.workunit.client.1.smithi187.stdout:1/417: truncate d4/f27 1520624 0 2024-09-21T00:56:34.298 INFO:tasks.workunit.client.1.smithi187.stdout:3/367: write d9/d19/d1c/f3e [5100905,125011] 0 2024-09-21T00:56:34.299 INFO:tasks.workunit.client.1.smithi187.stdout:6/394: mkdir d7/d2a/d29/d40/d6a/d88 0 2024-09-21T00:56:34.299 INFO:tasks.workunit.client.1.smithi187.stdout:9/552: mknod d4/d61/d6a/d90/cb5 0 2024-09-21T00:56:34.300 INFO:tasks.workunit.client.1.smithi187.stdout:1/418: readlink d4/d6/d23/l42 0 2024-09-21T00:56:34.301 INFO:tasks.workunit.client.1.smithi187.stdout:6/395: chown d7/d2a/d29/d40/d45/f76 13 1 2024-09-21T00:56:34.301 INFO:tasks.workunit.client.1.smithi187.stdout:9/553: readlink d4/d13/d14/d5d/l70 0 2024-09-21T00:56:34.301 INFO:tasks.workunit.client.1.smithi187.stdout:3/368: mknod d9/d19/c73 0 2024-09-21T00:56:34.302 INFO:tasks.workunit.client.1.smithi187.stdout:5/378: truncate d0/dc/d39/d46/d67/d30/f65 62811 0 2024-09-21T00:56:34.303 INFO:tasks.workunit.client.1.smithi187.stdout:3/369: write d9/d13/f48 [279911,50706] 0 2024-09-21T00:56:34.304 INFO:tasks.workunit.client.1.smithi187.stdout:1/419: symlink d4/d6/d8/d35/d22/d65/l91 0 2024-09-21T00:56:34.305 INFO:tasks.workunit.client.1.smithi187.stdout:6/396: mknod d7/d2a/d29/d40/d50/c89 0 2024-09-21T00:56:34.308 INFO:tasks.workunit.client.1.smithi187.stdout:4/386: dread d2/f65 [0,4194304] 0 2024-09-21T00:56:34.310 INFO:tasks.workunit.client.1.smithi187.stdout:6/397: creat d7/d2a/f8a x:0 0 0 2024-09-21T00:56:34.313 INFO:tasks.workunit.client.1.smithi187.stdout:9/554: dwrite d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:34.313 INFO:tasks.workunit.client.1.smithi187.stdout:3/370: dread d9/d19/d42/d53/f59 [0,4194304] 0 2024-09-21T00:56:34.315 INFO:tasks.workunit.client.1.smithi187.stdout:6/398: unlink d7/d2a/f2f 0 2024-09-21T00:56:34.317 INFO:tasks.workunit.client.1.smithi187.stdout:1/420: dwrite d4/d6/d23/d2e/f3f [0,4194304] 0 2024-09-21T00:56:34.320 INFO:tasks.workunit.client.1.smithi187.stdout:5/379: dread d0/f55 [0,4194304] 0 2024-09-21T00:56:34.321 INFO:tasks.workunit.client.1.smithi187.stdout:5/380: write d0/dc/d39/d46/d67/f10 [5213825,643] 0 2024-09-21T00:56:34.323 INFO:tasks.workunit.client.1.smithi187.stdout:5/381: fdatasync d0/dc/d39/d46/d67/d30/f6a 0 2024-09-21T00:56:34.325 INFO:tasks.workunit.client.1.smithi187.stdout:1/421: dwrite d4/d6/d8/d35/d4c/f4d [4194304,4194304] 0 2024-09-21T00:56:34.326 INFO:tasks.workunit.client.1.smithi187.stdout:1/422: write d4/f14 [3036358,28939] 0 2024-09-21T00:56:34.326 INFO:tasks.workunit.client.1.smithi187.stdout:1/423: chown d4/d6/d8/d6c 12820883 1 2024-09-21T00:56:34.327 INFO:tasks.workunit.client.1.smithi187.stdout:7/335: sync 2024-09-21T00:56:34.356 INFO:tasks.workunit.client.1.smithi187.stdout:4/387: rename d2/d3/f2b to d2/d3/da/d2f/d32/d26/d66/d6e/f7b 0 2024-09-21T00:56:34.357 INFO:tasks.workunit.client.1.smithi187.stdout:4/388: chown d2/d3/da/d2f/d32/d26 722527581 1 2024-09-21T00:56:34.359 INFO:tasks.workunit.client.1.smithi187.stdout:3/371: creat d9/d19/d42/d53/d56/d61/f74 x:0 0 0 2024-09-21T00:56:34.359 INFO:tasks.workunit.client.1.smithi187.stdout:9/555: mkdir d4/d13/d20/d2b/d66/db6 0 2024-09-21T00:56:34.360 INFO:tasks.workunit.client.1.smithi187.stdout:9/556: write d4/d10/d8f/f95 [4475248,43605] 0 2024-09-21T00:56:34.361 INFO:tasks.workunit.client.1.smithi187.stdout:6/399: creat d7/d59/f8b x:0 0 0 2024-09-21T00:56:34.362 INFO:tasks.workunit.client.1.smithi187.stdout:6/400: truncate d7/f64 455726 0 2024-09-21T00:56:34.362 INFO:tasks.workunit.client.1.smithi187.stdout:5/382: chown d0/dc/d39/d46/d67/d14/d1b/d27/c51 1070 1 2024-09-21T00:56:34.364 INFO:tasks.workunit.client.1.smithi187.stdout:5/383: read - d0/dc/d39/d46/d67/f73 zero size 2024-09-21T00:56:34.368 INFO:tasks.workunit.client.1.smithi187.stdout:4/389: stat d2/d3/da/d2f/d32/d22/d37/f38 0 2024-09-21T00:56:34.370 INFO:tasks.workunit.client.1.smithi187.stdout:9/557: creat d4/d10/d39/d69/fb7 x:0 0 0 2024-09-21T00:56:34.372 INFO:tasks.workunit.client.1.smithi187.stdout:3/372: mkdir d9/d19/d42/d53/d75 0 2024-09-21T00:56:34.374 INFO:tasks.workunit.client.1.smithi187.stdout:6/401: dwrite d7/d2a/d29/d40/f4d [0,4194304] 0 2024-09-21T00:56:34.380 INFO:tasks.workunit.client.1.smithi187.stdout:6/402: fsync d7/d59/f6e 0 2024-09-21T00:56:34.382 INFO:tasks.workunit.client.1.smithi187.stdout:2/392: truncate d2/d3/d15/d1b/d1c/f6a 2779026 0 2024-09-21T00:56:34.385 INFO:tasks.workunit.client.1.smithi187.stdout:1/424: dwrite d4/d6/d8/d35/d22/d65/f6d [4194304,4194304] 0 2024-09-21T00:56:34.386 INFO:tasks.workunit.client.1.smithi187.stdout:9/558: creat d4/d13/fb8 x:0 0 0 2024-09-21T00:56:34.387 INFO:tasks.workunit.client.1.smithi187.stdout:6/403: mknod d7/d2a/d29/d40/c8c 0 2024-09-21T00:56:34.389 INFO:tasks.workunit.client.1.smithi187.stdout:8/462: dread dc/d44/f71 [0,4194304] 0 2024-09-21T00:56:34.392 INFO:tasks.workunit.client.1.smithi187.stdout:4/390: dwrite d2/d3/da/fc [0,4194304] 0 2024-09-21T00:56:34.394 INFO:tasks.workunit.client.1.smithi187.stdout:0/331: sync 2024-09-21T00:56:34.394 INFO:tasks.workunit.client.1.smithi187.stdout:9/559: unlink d4/d10/d39/d69/c96 0 2024-09-21T00:56:34.395 INFO:tasks.workunit.client.1.smithi187.stdout:6/404: dread d7/d2a/d7a/f7e [0,4194304] 0 2024-09-21T00:56:34.396 INFO:tasks.workunit.client.1.smithi187.stdout:5/384: dread d0/dc/d1f/f41 [0,4194304] 0 2024-09-21T00:56:34.398 INFO:tasks.workunit.client.1.smithi187.stdout:1/425: dread d4/f76 [0,4194304] 0 2024-09-21T00:56:34.398 INFO:tasks.workunit.client.1.smithi187.stdout:4/391: readlink d2/d3/da/d2f/d32/d26/d4a/d58/l78 0 2024-09-21T00:56:34.399 INFO:tasks.workunit.client.1.smithi187.stdout:8/463: fsync dc/d1c/d29/f4c 0 2024-09-21T00:56:34.405 INFO:tasks.workunit.client.1.smithi187.stdout:2/393: rename d2/d3/d15/d1b/d1c/l4e to d2/d3/d15/d1b/d1c/l90 0 2024-09-21T00:56:34.405 INFO:tasks.workunit.client.1.smithi187.stdout:9/560: symlink d4/d10/d39/d69/lb9 0 2024-09-21T00:56:34.405 INFO:tasks.workunit.client.1.smithi187.stdout:4/392: write d2/d3/da/d2f/d32/d22/d4f/f62 [500400,121928] 0 2024-09-21T00:56:34.406 INFO:tasks.workunit.client.1.smithi187.stdout:3/373: dread d9/f11 [0,4194304] 0 2024-09-21T00:56:34.408 INFO:tasks.workunit.client.1.smithi187.stdout:0/332: creat d0/d17/d1c/d23/df/d41/d3b/f6c x:0 0 0 2024-09-21T00:56:34.409 INFO:tasks.workunit.client.1.smithi187.stdout:2/394: dread - d2/d3/d15/f87 zero size 2024-09-21T00:56:34.411 INFO:tasks.workunit.client.1.smithi187.stdout:8/464: creat dc/d2f/d34/d4b/f99 x:0 0 0 2024-09-21T00:56:34.414 INFO:tasks.workunit.client.1.smithi187.stdout:6/405: dwrite d7/f2c [0,4194304] 0 2024-09-21T00:56:34.416 INFO:tasks.workunit.client.1.smithi187.stdout:9/561: write d4/d10/f23 [3860791,29977] 0 2024-09-21T00:56:34.417 INFO:tasks.workunit.client.1.smithi187.stdout:1/426: dwrite d4/d6/d8/d35/f7c [0,4194304] 0 2024-09-21T00:56:34.417 INFO:tasks.workunit.client.1.smithi187.stdout:5/385: dread d0/dc/d39/d46/d67/d30/f3b [0,4194304] 0 2024-09-21T00:56:34.417 INFO:tasks.workunit.client.1.smithi187.stdout:0/333: symlink d0/d17/d1c/l6d 0 2024-09-21T00:56:34.419 INFO:tasks.workunit.client.1.smithi187.stdout:8/465: read dc/fd [2167939,103147] 0 2024-09-21T00:56:34.420 INFO:tasks.workunit.client.1.smithi187.stdout:0/334: mkdir d0/d60/d6e 0 2024-09-21T00:56:34.421 INFO:tasks.workunit.client.1.smithi187.stdout:5/386: chown d0/dc/d39 3961 1 2024-09-21T00:56:34.423 INFO:tasks.workunit.client.1.smithi187.stdout:3/374: creat d9/d19/d42/d53/f76 x:0 0 0 2024-09-21T00:56:34.423 INFO:tasks.workunit.client.1.smithi187.stdout:0/335: stat d0/d17/d18/d3a/l67 0 2024-09-21T00:56:34.425 INFO:tasks.workunit.client.1.smithi187.stdout:2/395: write d2/d3/d15/d1b/d1c/f6a [1393124,130885] 0 2024-09-21T00:56:34.426 INFO:tasks.workunit.client.1.smithi187.stdout:5/387: rmdir d0/dc/d39/d46/d67/d14/d1b/d27 39 2024-09-21T00:56:34.427 INFO:tasks.workunit.client.1.smithi187.stdout:2/396: chown d2/d3 187 1 2024-09-21T00:56:34.428 INFO:tasks.workunit.client.1.smithi187.stdout:8/466: symlink dc/l9a 0 2024-09-21T00:56:34.429 INFO:tasks.workunit.client.1.smithi187.stdout:6/406: getdents d7/d2a/d7a 0 2024-09-21T00:56:34.431 INFO:tasks.workunit.client.1.smithi187.stdout:2/397: write d2/d3/d15/d1b/d1c/d2d/d8f/f20 [2811854,117779] 0 2024-09-21T00:56:34.431 INFO:tasks.workunit.client.1.smithi187.stdout:5/388: chown d0/dc/d39/d46/d67/d14/d1b/d27/c59 591 1 2024-09-21T00:56:34.432 INFO:tasks.workunit.client.1.smithi187.stdout:6/407: symlink d7/d2a/d29/d40/d6a/l8d 0 2024-09-21T00:56:34.433 INFO:tasks.workunit.client.1.smithi187.stdout:0/336: dwrite d0/d17/d18/f43 [0,4194304] 0 2024-09-21T00:56:34.433 INFO:tasks.workunit.client.1.smithi187.stdout:2/398: readlink d2/d25/l7d 0 2024-09-21T00:56:34.437 INFO:tasks.workunit.client.1.smithi187.stdout:9/562: truncate d4/d8/f64 684704 0 2024-09-21T00:56:34.437 INFO:tasks.workunit.client.1.smithi187.stdout:9/563: chown d4/d10/lb2 1208 1 2024-09-21T00:56:34.441 INFO:tasks.workunit.client.1.smithi187.stdout:6/408: creat d7/f8e x:0 0 0 2024-09-21T00:56:34.441 INFO:tasks.workunit.client.1.smithi187.stdout:9/564: stat d4/d61/d6a/d90/daa 0 2024-09-21T00:56:34.442 INFO:tasks.workunit.client.1.smithi187.stdout:5/389: creat d0/dc/d39/d46/d67/d30/d68/f8a x:0 0 0 2024-09-21T00:56:34.443 INFO:tasks.workunit.client.1.smithi187.stdout:2/399: mknod d2/dc/d2e/d4a/d7c/d88/c91 0 2024-09-21T00:56:34.443 INFO:tasks.workunit.client.1.smithi187.stdout:6/409: rmdir d7 39 2024-09-21T00:56:34.445 INFO:tasks.workunit.client.1.smithi187.stdout:8/467: dwrite dc/d1c/d3e/d75/f8b [0,4194304] 0 2024-09-21T00:56:34.446 INFO:tasks.workunit.client.1.smithi187.stdout:7/336: sync 2024-09-21T00:56:34.447 INFO:tasks.workunit.client.1.smithi187.stdout:9/565: chown d4/d13/d14/d28/c5e 35 1 2024-09-21T00:56:34.449 INFO:tasks.workunit.client.1.smithi187.stdout:1/427: dwrite d4/f27 [0,4194304] 0 2024-09-21T00:56:34.449 INFO:tasks.workunit.client.1.smithi187.stdout:5/390: write d0/dc/d39/d46/d67/d30/f6a [416757,116238] 0 2024-09-21T00:56:34.452 INFO:tasks.workunit.client.1.smithi187.stdout:6/410: truncate d7/d2a/d29/f48 487059 0 2024-09-21T00:56:34.454 INFO:tasks.workunit.client.1.smithi187.stdout:7/337: unlink d1/dc/f12 0 2024-09-21T00:56:34.454 INFO:tasks.workunit.client.1.smithi187.stdout:2/400: mknod d2/d3/d15/d1b/d3c/d40/c92 0 2024-09-21T00:56:34.456 INFO:tasks.workunit.client.1.smithi187.stdout:1/428: fsync d4/d6/d23/f45 0 2024-09-21T00:56:34.456 INFO:tasks.workunit.client.1.smithi187.stdout:0/337: dread d0/d17/d1c/d23/df/f15 [0,4194304] 0 2024-09-21T00:56:34.457 INFO:tasks.workunit.client.1.smithi187.stdout:8/468: mknod dc/d2f/d54/d69/c9b 0 2024-09-21T00:56:34.458 INFO:tasks.workunit.client.1.smithi187.stdout:6/411: creat d7/d2a/d7a/f8f x:0 0 0 2024-09-21T00:56:34.459 INFO:tasks.workunit.client.1.smithi187.stdout:5/391: chown d0/dc/f11 16580084 1 2024-09-21T00:56:34.459 INFO:tasks.workunit.client.1.smithi187.stdout:1/429: fsync d4/d86/f8e 0 2024-09-21T00:56:34.462 INFO:tasks.workunit.client.1.smithi187.stdout:8/469: chown dc/d2f/d34/d4b/l6e 9406 1 2024-09-21T00:56:34.464 INFO:tasks.workunit.client.1.smithi187.stdout:0/338: unlink d0/d17/d1c/f45 0 2024-09-21T00:56:34.464 INFO:tasks.workunit.client.1.smithi187.stdout:9/566: dwrite d4/d13/fb8 [0,4194304] 0 2024-09-21T00:56:34.466 INFO:tasks.workunit.client.1.smithi187.stdout:1/430: mknod d4/d75/c92 0 2024-09-21T00:56:34.473 INFO:tasks.workunit.client.1.smithi187.stdout:0/339: write d0/d17/d1c/d23/df/f69 [66996,103982] 0 2024-09-21T00:56:34.474 INFO:tasks.workunit.client.1.smithi187.stdout:7/338: truncate d1/d18/f35 167282 0 2024-09-21T00:56:34.475 INFO:tasks.workunit.client.1.smithi187.stdout:1/431: write d4/f76 [1010883,55749] 0 2024-09-21T00:56:34.475 INFO:tasks.workunit.client.1.smithi187.stdout:6/412: dwrite d7/d2a/d29/f38 [0,4194304] 0 2024-09-21T00:56:34.477 INFO:tasks.workunit.client.1.smithi187.stdout:2/401: dwrite d2/d3/d15/d1b/d1c/d2d/d8f/f59 [0,4194304] 0 2024-09-21T00:56:34.477 INFO:tasks.workunit.client.1.smithi187.stdout:8/470: link dc/d1c/d29/f4c dc/d2f/d54/d69/f9c 0 2024-09-21T00:56:34.481 INFO:tasks.workunit.client.1.smithi187.stdout:7/339: unlink d1/d18/d31/f39 0 2024-09-21T00:56:34.482 INFO:tasks.workunit.client.1.smithi187.stdout:6/413: unlink d7/f54 0 2024-09-21T00:56:34.482 INFO:tasks.workunit.client.1.smithi187.stdout:6/414: readlink d7/l61 0 2024-09-21T00:56:34.485 INFO:tasks.workunit.client.1.smithi187.stdout:7/340: chown d1/d18/d31/d33/d3b/f3f 18314 1 2024-09-21T00:56:34.486 INFO:tasks.workunit.client.1.smithi187.stdout:8/471: stat dc/f10 0 2024-09-21T00:56:34.488 INFO:tasks.workunit.client.1.smithi187.stdout:2/402: rmdir d2/d25 39 2024-09-21T00:56:34.489 INFO:tasks.workunit.client.1.smithi187.stdout:1/432: dwrite d4/d6/d8/d35/d4c/d5b/d83/f84 [0,4194304] 0 2024-09-21T00:56:34.489 INFO:tasks.workunit.client.1.smithi187.stdout:8/472: dread - dc/d2f/d80/f93 zero size 2024-09-21T00:56:34.490 INFO:tasks.workunit.client.1.smithi187.stdout:0/340: rename d0/d17/f26 to d0/d60/d6b/f6f 0 2024-09-21T00:56:34.495 INFO:tasks.workunit.client.1.smithi187.stdout:5/392: dread d0/dc/d39/d46/d67/d14/d1b/d27/f4a [0,4194304] 0 2024-09-21T00:56:34.495 INFO:tasks.workunit.client.1.smithi187.stdout:7/341: symlink d1/dc/l7b 0 2024-09-21T00:56:34.495 INFO:tasks.workunit.client.1.smithi187.stdout:9/567: dread d4/d13/d20/d2e/f33 [0,4194304] 0 2024-09-21T00:56:34.499 INFO:tasks.workunit.client.1.smithi187.stdout:1/433: creat d4/d6/d8/d6c/f93 x:0 0 0 2024-09-21T00:56:34.500 INFO:tasks.workunit.client.1.smithi187.stdout:9/568: chown d4/d13/d20/d2b/d66/f7d 3 1 2024-09-21T00:56:34.502 INFO:tasks.workunit.client.1.smithi187.stdout:6/415: write d7/f44 [644297,30557] 0 2024-09-21T00:56:34.503 INFO:tasks.workunit.client.1.smithi187.stdout:7/342: mkdir d1/dc/d15/d22/d3e/d7c 0 2024-09-21T00:56:34.503 INFO:tasks.workunit.client.1.smithi187.stdout:5/393: write d0/dc/d39/d46/d67/d14/d1b/d27/f2f [2015578,12105] 0 2024-09-21T00:56:34.504 INFO:tasks.workunit.client.1.smithi187.stdout:9/569: chown d4/d8/d44/f51 386231163 1 2024-09-21T00:56:34.504 INFO:tasks.workunit.client.1.smithi187.stdout:6/416: stat d7/d2a/d7a/f7e 0 2024-09-21T00:56:34.505 INFO:tasks.workunit.client.1.smithi187.stdout:1/434: unlink d4/d6/d8/d35/f7c 0 2024-09-21T00:56:34.507 INFO:tasks.workunit.client.1.smithi187.stdout:0/341: creat d0/f70 x:0 0 0 2024-09-21T00:56:34.508 INFO:tasks.workunit.client.1.smithi187.stdout:2/403: dread d2/dc/f46 [0,4194304] 0 2024-09-21T00:56:34.508 INFO:tasks.workunit.client.1.smithi187.stdout:9/570: dread d4/d10/d8f/f95 [4194304,4194304] 0 2024-09-21T00:56:34.511 INFO:tasks.workunit.client.1.smithi187.stdout:8/473: truncate dc/fe 3389248 0 2024-09-21T00:56:34.513 INFO:tasks.workunit.client.1.smithi187.stdout:8/474: write dc/d2f/d54/f7b [651765,101868] 0 2024-09-21T00:56:34.514 INFO:tasks.workunit.client.1.smithi187.stdout:0/342: creat d0/d17/d1c/f71 x:0 0 0 2024-09-21T00:56:34.515 INFO:tasks.workunit.client.1.smithi187.stdout:0/343: chown d0/d17/d1c 190772082 1 2024-09-21T00:56:34.519 INFO:tasks.workunit.client.1.smithi187.stdout:1/435: dwrite d4/f7 [0,4194304] 0 2024-09-21T00:56:34.522 INFO:tasks.workunit.client.1.smithi187.stdout:3/375: sync 2024-09-21T00:56:34.522 INFO:tasks.workunit.client.1.smithi187.stdout:4/393: sync 2024-09-21T00:56:34.528 INFO:tasks.workunit.client.1.smithi187.stdout:6/417: dread d7/d2a/f5b [0,4194304] 0 2024-09-21T00:56:34.531 INFO:tasks.workunit.client.1.smithi187.stdout:8/475: rename dc/l63 to dc/d1c/d3e/d75/l9d 0 2024-09-21T00:56:34.532 INFO:tasks.workunit.client.1.smithi187.stdout:3/376: dread d9/f4c [0,4194304] 0 2024-09-21T00:56:34.532 INFO:tasks.workunit.client.1.smithi187.stdout:2/404: mknod d2/d3/d15/d1b/d3c/d69/d8c/c93 0 2024-09-21T00:56:34.533 INFO:tasks.workunit.client.1.smithi187.stdout:7/343: dread d1/d18/d31/d33/d3b/f3f [0,4194304] 0 2024-09-21T00:56:34.533 INFO:tasks.workunit.client.1.smithi187.stdout:6/418: symlink d7/d2a/d29/d40/l90 0 2024-09-21T00:56:34.535 INFO:tasks.workunit.client.1.smithi187.stdout:8/476: symlink dc/d2f/d34/l9e 0 2024-09-21T00:56:34.535 INFO:tasks.workunit.client.1.smithi187.stdout:5/394: dwrite d0/f20 [0,4194304] 0 2024-09-21T00:56:34.536 INFO:tasks.workunit.client.1.smithi187.stdout:9/571: dread d4/d61/d6c/fab [0,4194304] 0 2024-09-21T00:56:34.537 INFO:tasks.workunit.client.1.smithi187.stdout:3/377: truncate d9/d13/f48 768022 0 2024-09-21T00:56:34.538 INFO:tasks.workunit.client.1.smithi187.stdout:7/344: chown d1/dc/d15/d22/c2c 923 1 2024-09-21T00:56:34.539 INFO:tasks.workunit.client.1.smithi187.stdout:5/395: chown d0/dc/f28 0 1 2024-09-21T00:56:34.539 INFO:tasks.workunit.client.1.smithi187.stdout:3/378: chown d9/d13 481289885 1 2024-09-21T00:56:34.541 INFO:tasks.workunit.client.1.smithi187.stdout:1/436: rename d4/d6/d8 to d4/d6/d23/d2e/d94 0 2024-09-21T00:56:34.541 INFO:tasks.workunit.client.1.smithi187.stdout:8/477: mkdir dc/d1c/d29/d9f 0 2024-09-21T00:56:34.544 INFO:tasks.workunit.client.1.smithi187.stdout:6/419: getdents d7/d2a/d29/d40/d6a/d88 0 2024-09-21T00:56:34.544 INFO:tasks.workunit.client.1.smithi187.stdout:5/396: write d0/dc/d1f/d26/f71 [5195526,20366] 0 2024-09-21T00:56:34.546 INFO:tasks.workunit.client.1.smithi187.stdout:1/437: stat d4/d6/d23/d2e/d94 0 2024-09-21T00:56:34.546 INFO:tasks.workunit.client.1.smithi187.stdout:8/478: chown dc/d1c/d3e/f53 1 1 2024-09-21T00:56:34.547 INFO:tasks.workunit.client.1.smithi187.stdout:3/379: rmdir d9/d19/d42/d53/d56/d61 39 2024-09-21T00:56:34.548 INFO:tasks.workunit.client.1.smithi187.stdout:2/405: dwrite d2/f8 [4194304,4194304] 0 2024-09-21T00:56:34.549 INFO:tasks.workunit.client.1.smithi187.stdout:0/344: dread d0/d17/d1c/d23/df/f32 [0,4194304] 0 2024-09-21T00:56:34.550 INFO:tasks.workunit.client.1.smithi187.stdout:7/345: creat d1/dc/d15/d22/d3e/d73/f7d x:0 0 0 2024-09-21T00:56:34.551 INFO:tasks.workunit.client.1.smithi187.stdout:5/397: mkdir d0/dc/d1f/d26/d8b 0 2024-09-21T00:56:34.552 INFO:tasks.workunit.client.1.smithi187.stdout:1/438: symlink d4/d86/l95 0 2024-09-21T00:56:34.553 INFO:tasks.workunit.client.1.smithi187.stdout:3/380: rmdir d9/d19/d42/d53 39 2024-09-21T00:56:34.553 INFO:tasks.workunit.client.1.smithi187.stdout:0/345: mknod d0/d17/d1c/d23/df/d41/d3b/c72 0 2024-09-21T00:56:34.554 INFO:tasks.workunit.client.1.smithi187.stdout:5/398: fdatasync d0/dc/d39/d46/d67/d14/d38/f5f 0 2024-09-21T00:56:34.556 INFO:tasks.workunit.client.1.smithi187.stdout:6/420: write d7/d2a/d7a/f7e [1021218,125967] 0 2024-09-21T00:56:34.557 INFO:tasks.workunit.client.1.smithi187.stdout:7/346: creat d1/d18/d31/d33/d3b/f7e x:0 0 0 2024-09-21T00:56:34.557 INFO:tasks.workunit.client.1.smithi187.stdout:9/572: link d4/d13/d20/d2b/d66/l8e d4/d8/d46/d54/lba 0 2024-09-21T00:56:34.559 INFO:tasks.workunit.client.1.smithi187.stdout:1/439: creat d4/d6/d23/d6f/f96 x:0 0 0 2024-09-21T00:56:34.559 INFO:tasks.workunit.client.1.smithi187.stdout:6/421: mknod d7/d2a/d29/d40/c91 0 2024-09-21T00:56:34.560 INFO:tasks.workunit.client.1.smithi187.stdout:5/399: mkdir d0/dc/d39/d46/d67/d14/d38/d5a/d6c/d7b/d8c 0 2024-09-21T00:56:34.560 INFO:tasks.workunit.client.1.smithi187.stdout:1/440: write d4/d6/d23/d6f/f96 [616724,127169] 0 2024-09-21T00:56:34.561 INFO:tasks.workunit.client.1.smithi187.stdout:3/381: rmdir d9/d19/d42/d53/d56/d61 39 2024-09-21T00:56:34.561 INFO:tasks.workunit.client.1.smithi187.stdout:6/422: symlink d7/d2a/d7a/l92 0 2024-09-21T00:56:34.562 INFO:tasks.workunit.client.1.smithi187.stdout:6/423: fdatasync d7/f64 0 2024-09-21T00:56:34.563 INFO:tasks.workunit.client.1.smithi187.stdout:2/406: rename d2/d3/d15/d1b/d1c/d2d/d4c to d2/d3/d15/d1b/d3c/d94 0 2024-09-21T00:56:34.564 INFO:tasks.workunit.client.1.smithi187.stdout:1/441: symlink d4/d6/l97 0 2024-09-21T00:56:34.566 INFO:tasks.workunit.client.1.smithi187.stdout:6/424: chown d7/d2a/d29/d40/d45/c5c 3 1 2024-09-21T00:56:34.568 INFO:tasks.workunit.client.1.smithi187.stdout:0/346: rename d0/d17/d1c/l4b to d0/d60/d6e/l73 0 2024-09-21T00:56:34.571 INFO:tasks.workunit.client.1.smithi187.stdout:1/442: creat d4/d6/d23/d2e/d94/d35/d22/d2c/f98 x:0 0 0 2024-09-21T00:56:34.573 INFO:tasks.workunit.client.1.smithi187.stdout:6/425: dwrite d7/d59/f8b [0,4194304] 0 2024-09-21T00:56:34.575 INFO:tasks.workunit.client.1.smithi187.stdout:7/347: truncate d1/d18/d31/d5a/d5d/f6c 2087362 0 2024-09-21T00:56:34.578 INFO:tasks.workunit.client.1.smithi187.stdout:5/400: getdents d0/dc/d39/d46 0 2024-09-21T00:56:34.578 INFO:tasks.workunit.client.1.smithi187.stdout:6/426: truncate d7/d2a/d29/f3c 470203 0 2024-09-21T00:56:34.579 INFO:tasks.workunit.client.1.smithi187.stdout:2/407: link d2/d3/d15/d1b/d3c/d40/c5a d2/d3/d15/d1b/d3c/d69/c95 0 2024-09-21T00:56:34.586 INFO:tasks.workunit.client.1.smithi187.stdout:1/443: dwrite d4/d6/d23/d2e/d94/f31 [0,4194304] 0 2024-09-21T00:56:34.588 INFO:tasks.workunit.client.1.smithi187.stdout:3/382: dread d9/d19/d1c/f41 [0,4194304] 0 2024-09-21T00:56:34.589 INFO:tasks.workunit.client.1.smithi187.stdout:0/347: dwrite d0/d17/d1c/d23/df/f53 [4194304,4194304] 0 2024-09-21T00:56:34.589 INFO:tasks.workunit.client.1.smithi187.stdout:5/401: creat d0/dc/d39/d46/d67/d14/d38/d5a/f8d x:0 0 0 2024-09-21T00:56:34.594 INFO:tasks.workunit.client.1.smithi187.stdout:0/348: fsync d0/d17/d1c/d23/df/d51/f2f 0 2024-09-21T00:56:34.595 INFO:tasks.workunit.client.1.smithi187.stdout:7/348: link d1/dc/d15/f67 d1/dc/d15/d22/d3e/d7c/f7f 0 2024-09-21T00:56:34.595 INFO:tasks.workunit.client.1.smithi187.stdout:6/427: dwrite d7/f52 [4194304,4194304] 0 2024-09-21T00:56:34.596 INFO:tasks.workunit.client.1.smithi187.stdout:3/383: mknod d9/d13/d20/c77 0 2024-09-21T00:56:34.597 INFO:tasks.workunit.client.1.smithi187.stdout:1/444: symlink d4/d6/d23/d2e/d94/d35/d22/d2c/l99 0 2024-09-21T00:56:34.597 INFO:tasks.workunit.client.1.smithi187.stdout:7/349: chown d1/dc 49421541 1 2024-09-21T00:56:34.597 INFO:tasks.workunit.client.1.smithi187.stdout:6/428: fsync f1 0 2024-09-21T00:56:34.597 INFO:tasks.workunit.client.1.smithi187.stdout:5/402: chown d0/dc/l83 1 1 2024-09-21T00:56:34.601 INFO:tasks.workunit.client.1.smithi187.stdout:3/384: write d9/d19/d42/f45 [46146,33003] 0 2024-09-21T00:56:34.602 INFO:tasks.workunit.client.1.smithi187.stdout:6/429: write d7/d2a/d29/f43 [684976,120348] 0 2024-09-21T00:56:34.602 INFO:tasks.workunit.client.1.smithi187.stdout:0/349: rename d0/d17/d1c/d23/f10 to d0/d60/d6e/f74 0 2024-09-21T00:56:34.602 INFO:tasks.workunit.client.1.smithi187.stdout:5/403: chown d0/dc/d39/d46/d67/d14/d1b/d27/d3a/f72 9 1 2024-09-21T00:56:34.603 INFO:tasks.workunit.client.1.smithi187.stdout:7/350: mkdir d1/d55/d80 0 2024-09-21T00:56:34.605 INFO:tasks.workunit.client.1.smithi187.stdout:0/350: chown d0/d17/d1c/d23/d36/c5f 118696759 1 2024-09-21T00:56:34.605 INFO:tasks.workunit.client.1.smithi187.stdout:3/385: rename d9/f4c to d9/d19/d1c/d5f/f78 0 2024-09-21T00:56:34.608 INFO:tasks.workunit.client.1.smithi187.stdout:0/351: symlink d0/d17/l75 0 2024-09-21T00:56:34.608 INFO:tasks.workunit.client.1.smithi187.stdout:5/404: mkdir d0/dc/d39/d46/d67/d30/d6b/d8e 0 2024-09-21T00:56:34.610 INFO:tasks.workunit.client.1.smithi187.stdout:6/430: getdents d7/d2a/d29/d40/d45 0 2024-09-21T00:56:34.612 INFO:tasks.workunit.client.1.smithi187.stdout:0/352: symlink d0/d17/d1c/l76 0 2024-09-21T00:56:34.615 INFO:tasks.workunit.client.1.smithi187.stdout:7/351: dwrite d1/dc/d15/d22/f79 [0,4194304] 0 2024-09-21T00:56:34.617 INFO:tasks.workunit.client.1.smithi187.stdout:0/353: write d0/f16 [5625212,58653] 0 2024-09-21T00:56:34.617 INFO:tasks.workunit.client.1.smithi187.stdout:6/431: creat d7/d2a/d29/d40/d5e/f93 x:0 0 0 2024-09-21T00:56:34.618 INFO:tasks.workunit.client.1.smithi187.stdout:3/386: dwrite d9/f11 [4194304,4194304] 0 2024-09-21T00:56:34.622 INFO:tasks.workunit.client.1.smithi187.stdout:7/352: write d1/f68 [979102,13524] 0 2024-09-21T00:56:34.626 INFO:tasks.workunit.client.1.smithi187.stdout:0/354: fdatasync d0/d17/d18/f68 0 2024-09-21T00:56:34.628 INFO:tasks.workunit.client.1.smithi187.stdout:0/355: stat d0/d17/d1c 0 2024-09-21T00:56:34.628 INFO:tasks.workunit.client.1.smithi187.stdout:6/432: mkdir d7/d2a/d29/d94 0 2024-09-21T00:56:34.629 INFO:tasks.workunit.client.1.smithi187.stdout:5/405: dwrite d0/dc/d39/d46/d67/d14/d38/d5a/d6c/d7b/f7e [0,4194304] 0 2024-09-21T00:56:34.631 INFO:tasks.workunit.client.1.smithi187.stdout:6/433: write d7/d2a/d29/d40/d50/d83/f87 [298197,11225] 0 2024-09-21T00:56:34.639 INFO:tasks.workunit.client.1.smithi187.stdout:5/406: symlink d0/dc/d39/d46/d67/d14/d57/l8f 0 2024-09-21T00:56:34.641 INFO:tasks.workunit.client.1.smithi187.stdout:0/356: link d0/d17/d1c/d23/df/d41/d3b/f54 d0/d17/d18/d3a/f77 0 2024-09-21T00:56:34.642 INFO:tasks.workunit.client.1.smithi187.stdout:1/445: dwrite d4/d6/d23/d2e/d94/d35/f6e [0,4194304] 0 2024-09-21T00:56:34.643 INFO:tasks.workunit.client.1.smithi187.stdout:7/353: link d1/dc/d15/d22/c28 d1/d18/d31/d41/c81 0 2024-09-21T00:56:34.645 INFO:tasks.workunit.client.1.smithi187.stdout:7/354: readlink d1/l30 0 2024-09-21T00:56:34.646 INFO:tasks.workunit.client.1.smithi187.stdout:0/357: creat d0/d17/d18/f78 x:0 0 0 2024-09-21T00:56:34.650 INFO:tasks.workunit.client.1.smithi187.stdout:7/355: chown d1/dc/d15/d22/f5e 0 1 2024-09-21T00:56:34.650 INFO:tasks.workunit.client.1.smithi187.stdout:6/434: dwrite d7/d2a/d29/f7c [0,4194304] 0 2024-09-21T00:56:34.651 INFO:tasks.workunit.client.1.smithi187.stdout:0/358: write d0/d17/d1c/d23/df/f53 [4220729,15881] 0 2024-09-21T00:56:34.653 INFO:tasks.workunit.client.1.smithi187.stdout:6/435: fdatasync d7/d59/f42 0 2024-09-21T00:56:34.655 INFO:tasks.workunit.client.1.smithi187.stdout:0/359: write d0/d60/d6e/f74 [8600141,38063] 0 2024-09-21T00:56:34.656 INFO:tasks.workunit.client.1.smithi187.stdout:5/407: dwrite d0/dc/d39/d46/d67/d14/d38/d5a/f8d [0,4194304] 0 2024-09-21T00:56:34.657 INFO:tasks.workunit.client.1.smithi187.stdout:1/446: link d4/d6/d23/d2e/d94/d35/c74 d4/d6/d23/d2e/d53/d6a/c9a 0 2024-09-21T00:56:34.658 INFO:tasks.workunit.client.1.smithi187.stdout:3/387: dread d9/d19/d1c/f38 [0,4194304] 0 2024-09-21T00:56:34.659 INFO:tasks.workunit.client.1.smithi187.stdout:0/360: write d0/d17/d1c/f4c [717370,110236] 0 2024-09-21T00:56:34.660 INFO:tasks.workunit.client.1.smithi187.stdout:5/408: write d0/dc/d39/f4c [932240,23927] 0 2024-09-21T00:56:34.662 INFO:tasks.workunit.client.1.smithi187.stdout:1/447: write d4/d6/d23/d2e/f7d [232922,101210] 0 2024-09-21T00:56:34.662 INFO:tasks.workunit.client.1.smithi187.stdout:0/361: readlink d0/d17/d1c/l6d 0 2024-09-21T00:56:34.663 INFO:tasks.workunit.client.1.smithi187.stdout:3/388: truncate d9/d19/d1c/f5b 543896 0 2024-09-21T00:56:34.664 INFO:tasks.workunit.client.1.smithi187.stdout:7/356: getdents d1/d18/d31/d33/d3b 0 2024-09-21T00:56:34.664 INFO:tasks.workunit.client.1.smithi187.stdout:4/394: sync 2024-09-21T00:56:34.667 INFO:tasks.workunit.client.1.smithi187.stdout:0/362: rmdir d0/d17/d1c/d23/df 39 2024-09-21T00:56:34.670 INFO:tasks.workunit.client.1.smithi187.stdout:3/389: symlink d9/d13/d20/l79 0 2024-09-21T00:56:34.671 INFO:tasks.workunit.client.1.smithi187.stdout:7/357: dread d1/d18/d31/d41/f6a [0,4194304] 0 2024-09-21T00:56:34.671 INFO:tasks.workunit.client.1.smithi187.stdout:3/390: write d9/d13/f1e [7420974,13079] 0 2024-09-21T00:56:34.673 INFO:tasks.workunit.client.1.smithi187.stdout:5/409: rename d0/dc/l83 to d0/dc/d39/d46/d67/d14/d57/l90 0 2024-09-21T00:56:34.673 INFO:tasks.workunit.client.1.smithi187.stdout:6/436: link d7/d2a/d29/d40/l63 d7/d2a/d29/l95 0 2024-09-21T00:56:34.673 INFO:tasks.workunit.client.1.smithi187.stdout:6/437: dread - d7/f84 zero size 2024-09-21T00:56:34.674 INFO:tasks.workunit.client.1.smithi187.stdout:1/448: symlink d4/l9b 0 2024-09-21T00:56:34.675 INFO:tasks.workunit.client.1.smithi187.stdout:4/395: mkdir d2/d3/d74/d7c 0 2024-09-21T00:56:34.677 INFO:tasks.workunit.client.1.smithi187.stdout:7/358: mknod d1/d18/d31/d41/c82 0 2024-09-21T00:56:34.682 INFO:tasks.workunit.client.1.smithi187.stdout:6/438: creat d7/d2a/d29/d40/d50/f96 x:0 0 0 2024-09-21T00:56:34.683 INFO:tasks.workunit.client.1.smithi187.stdout:1/449: chown d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 803476 1 2024-09-21T00:56:34.683 INFO:tasks.workunit.client.1.smithi187.stdout:0/363: symlink d0/d17/d1c/d23/l79 0 2024-09-21T00:56:34.684 INFO:tasks.workunit.client.1.smithi187.stdout:3/391: dwrite d9/d19/d42/d53/f67 [0,4194304] 0 2024-09-21T00:56:34.684 INFO:tasks.workunit.client.1.smithi187.stdout:6/439: write d7/d2a/d7a/f8f [431120,73956] 0 2024-09-21T00:56:34.687 INFO:tasks.workunit.client.1.smithi187.stdout:4/396: rename d2/d3/da/d2f/d32/d22/l2a to d2/d3/da/d2f/d32/d24/l7d 0 2024-09-21T00:56:34.688 INFO:tasks.workunit.client.1.smithi187.stdout:1/450: write d4/d6/d23/d2e/d53/d6a/f8f [616138,51432] 0 2024-09-21T00:56:34.689 INFO:tasks.workunit.client.1.smithi187.stdout:0/364: creat d0/d17/d1c/f7a x:0 0 0 2024-09-21T00:56:34.689 INFO:tasks.workunit.client.1.smithi187.stdout:5/410: rmdir d0/dc/d6f 0 2024-09-21T00:56:34.692 INFO:tasks.workunit.client.1.smithi187.stdout:4/397: fsync d2/f65 0 2024-09-21T00:56:34.692 INFO:tasks.workunit.client.1.smithi187.stdout:3/392: symlink d9/d19/d42/d53/d75/l7a 0 2024-09-21T00:56:34.695 INFO:tasks.workunit.client.1.smithi187.stdout:1/451: rmdir d4/d6/d23/d2e/d94/d35/d22/d2c 39 2024-09-21T00:56:34.698 INFO:tasks.workunit.client.1.smithi187.stdout:0/365: creat d0/d17/d1c/d23/df/d51/f7b x:0 0 0 2024-09-21T00:56:34.698 INFO:tasks.workunit.client.1.smithi187.stdout:5/411: creat d0/dc/d1f/d26/d8b/f91 x:0 0 0 2024-09-21T00:56:34.701 INFO:tasks.workunit.client.1.smithi187.stdout:1/452: dwrite d4/d6/d23/d2e/d94/d35/f6e [0,4194304] 0 2024-09-21T00:56:34.701 INFO:tasks.workunit.client.1.smithi187.stdout:7/359: write d1/d18/f35 [816760,31849] 0 2024-09-21T00:56:34.703 INFO:tasks.workunit.client.1.smithi187.stdout:3/393: rename d9/d13/d20/l79 to d9/d19/d42/d53/d56/d61/l7b 0 2024-09-21T00:56:34.705 INFO:tasks.workunit.client.1.smithi187.stdout:6/440: truncate d7/f52 617245 0 2024-09-21T00:56:34.708 INFO:tasks.workunit.client.1.smithi187.stdout:7/360: symlink d1/d18/d31/d33/d3b/d62/l83 0 2024-09-21T00:56:34.709 INFO:tasks.workunit.client.1.smithi187.stdout:5/412: dwrite d0/f20 [0,4194304] 0 2024-09-21T00:56:34.710 INFO:tasks.workunit.client.1.smithi187.stdout:4/398: truncate d2/d3/f42 525142 0 2024-09-21T00:56:34.710 INFO:tasks.workunit.client.1.smithi187.stdout:1/453: chown d4/d6/d23/d2e/d94/d35/d22/d2c/f30 3 1 2024-09-21T00:56:34.714 INFO:tasks.workunit.client.1.smithi187.stdout:6/441: dread d7/d59/f7f [0,4194304] 0 2024-09-21T00:56:34.716 INFO:tasks.workunit.client.1.smithi187.stdout:4/399: readlink d2/d3/da/d2f/d32/d22/d37/l41 0 2024-09-21T00:56:34.716 INFO:tasks.workunit.client.1.smithi187.stdout:1/454: readlink d4/d6/d23/d2e/d94/l3b 0 2024-09-21T00:56:34.717 INFO:tasks.workunit.client.1.smithi187.stdout:1/455: stat d4/f27 0 2024-09-21T00:56:34.718 INFO:tasks.workunit.client.1.smithi187.stdout:7/361: getdents d1/d18/d31/d41 0 2024-09-21T00:56:34.719 INFO:tasks.workunit.client.1.smithi187.stdout:0/366: dread d0/d17/d1c/d23/df/d41/f42 [0,4194304] 0 2024-09-21T00:56:34.719 INFO:tasks.workunit.client.1.smithi187.stdout:6/442: dread - d7/d2a/d29/d40/d50/f7b zero size 2024-09-21T00:56:34.719 INFO:tasks.workunit.client.1.smithi187.stdout:3/394: dwrite d9/d13/d20/f68 [0,4194304] 0 2024-09-21T00:56:34.721 INFO:tasks.workunit.client.1.smithi187.stdout:4/400: fsync d2/d3/da/d2f/d32/d25/f2d 0 2024-09-21T00:56:34.723 INFO:tasks.workunit.client.1.smithi187.stdout:1/456: write d4/d6/d23/d2e/d94/f37 [4214807,122320] 0 2024-09-21T00:56:34.725 INFO:tasks.workunit.client.1.smithi187.stdout:0/367: readlink d0/d17/d1c/d23/df/d41/d3b/d46/l4e 0 2024-09-21T00:56:34.727 INFO:tasks.workunit.client.1.smithi187.stdout:6/443: write d7/d2a/d29/d40/d5e/f93 [609436,26649] 0 2024-09-21T00:56:34.728 INFO:tasks.workunit.client.1.smithi187.stdout:1/457: chown d4/c2a 191339 1 2024-09-21T00:56:34.730 INFO:tasks.workunit.client.1.smithi187.stdout:0/368: chown d0/d17/d1c/d23/df/d41/d3b/c72 14 1 2024-09-21T00:56:34.731 INFO:tasks.workunit.client.1.smithi187.stdout:5/413: dwrite d0/dc/d39/d46/d67/d14/d38/f4f [0,4194304] 0 2024-09-21T00:56:34.731 INFO:tasks.workunit.client.1.smithi187.stdout:4/401: dread d2/d3/da/d48/f6d [0,4194304] 0 2024-09-21T00:56:34.731 INFO:tasks.workunit.client.1.smithi187.stdout:1/458: chown d4/d6/d23/d2e/d94/d6c 2766625 1 2024-09-21T00:56:34.734 INFO:tasks.workunit.client.1.smithi187.stdout:3/395: getdents d9/d19/d42/d53/d56/d61 0 2024-09-21T00:56:34.735 INFO:tasks.workunit.client.1.smithi187.stdout:0/369: creat d0/d17/d1c/d23/d36/f7c x:0 0 0 2024-09-21T00:56:34.735 INFO:tasks.workunit.client.1.smithi187.stdout:7/362: truncate d1/f68 344173 0 2024-09-21T00:56:34.736 INFO:tasks.workunit.client.1.smithi187.stdout:4/402: write d2/d3/da/d2f/d32/d24/f53 [876587,42113] 0 2024-09-21T00:56:34.736 INFO:tasks.workunit.client.1.smithi187.stdout:1/459: rmdir d4/d6/d23/d2e/d94/d35/d79 39 2024-09-21T00:56:34.738 INFO:tasks.workunit.client.1.smithi187.stdout:0/370: write d0/d17/d1c/d23/df/d41/f4a [1069923,124474] 0 2024-09-21T00:56:34.738 INFO:tasks.workunit.client.1.smithi187.stdout:5/414: rename d0/dc/d39/f4c to d0/dc/d39/d46/d67/d30/d68/f92 0 2024-09-21T00:56:34.739 INFO:tasks.workunit.client.1.smithi187.stdout:0/371: readlink d0/d17/l31 0 2024-09-21T00:56:34.740 INFO:tasks.workunit.client.1.smithi187.stdout:4/403: chown d2/d3/da/d2f/d4b/f6a 1221059241 1 2024-09-21T00:56:34.740 INFO:tasks.workunit.client.1.smithi187.stdout:3/396: mknod d9/d19/d1c/d5f/c7c 0 2024-09-21T00:56:34.742 INFO:tasks.workunit.client.1.smithi187.stdout:4/404: write d2/d3/da/d2f/d4b/f6a [133841,59612] 0 2024-09-21T00:56:34.743 INFO:tasks.workunit.client.1.smithi187.stdout:6/444: getdents d7/d2a/d29/d40 0 2024-09-21T00:56:34.745 INFO:tasks.workunit.client.1.smithi187.stdout:7/363: creat d1/d55/d80/f84 x:0 0 0 2024-09-21T00:56:34.745 INFO:tasks.workunit.client.1.smithi187.stdout:4/405: fsync d2/d3/da/d2f/d32/d24/f45 0 2024-09-21T00:56:34.745 INFO:tasks.workunit.client.1.smithi187.stdout:5/415: unlink d0/dc/d39/d46/d67/d14/d1b/f1c 0 2024-09-21T00:56:34.745 INFO:tasks.workunit.client.1.smithi187.stdout:0/372: rmdir d0/d17/d1c/d23/d36 39 2024-09-21T00:56:34.746 INFO:tasks.workunit.client.1.smithi187.stdout:1/460: mknod d4/d6/d23/d2e/c9c 0 2024-09-21T00:56:34.747 INFO:tasks.workunit.client.1.smithi187.stdout:8/479: sync 2024-09-21T00:56:34.748 INFO:tasks.workunit.client.1.smithi187.stdout:6/445: mknod d7/d2a/d29/d40/d45/c97 0 2024-09-21T00:56:34.748 INFO:tasks.workunit.client.1.smithi187.stdout:0/373: write d0/f16 [3041206,56999] 0 2024-09-21T00:56:34.750 INFO:tasks.workunit.client.1.smithi187.stdout:0/374: dread - d0/d17/d18/f78 zero size 2024-09-21T00:56:34.750 INFO:tasks.workunit.client.1.smithi187.stdout:1/461: chown d4/d6/d23/d2e/d94/d35/d4c/f5f 31 1 2024-09-21T00:56:34.750 INFO:tasks.workunit.client.1.smithi187.stdout:7/364: rename d1/dc/c58 to d1/dc/c85 0 2024-09-21T00:56:34.751 INFO:tasks.workunit.client.1.smithi187.stdout:0/375: dread - d0/f63 zero size 2024-09-21T00:56:34.751 INFO:tasks.workunit.client.1.smithi187.stdout:4/406: rename d2/d3/d3b to d2/d3/da/d2f/d4b/d7e 0 2024-09-21T00:56:34.753 INFO:tasks.workunit.client.1.smithi187.stdout:4/407: rename d2 to d2/d3/da/d2f/d32/d26/d4a/d7f 22 2024-09-21T00:56:34.754 INFO:tasks.workunit.client.1.smithi187.stdout:1/462: read d4/f62 [3388015,29786] 0 2024-09-21T00:56:34.756 INFO:tasks.workunit.client.1.smithi187.stdout:7/365: creat d1/dc/d15/d22/f86 x:0 0 0 2024-09-21T00:56:34.757 INFO:tasks.workunit.client.1.smithi187.stdout:6/446: creat d7/d2a/d29/d94/f98 x:0 0 0 2024-09-21T00:56:34.758 INFO:tasks.workunit.client.1.smithi187.stdout:0/376: creat d0/d17/d1c/d65/f7d x:0 0 0 2024-09-21T00:56:34.760 INFO:tasks.workunit.client.1.smithi187.stdout:4/408: dwrite d2/d3/da/d2f/d32/d24/f45 [0,4194304] 0 2024-09-21T00:56:34.761 INFO:tasks.workunit.client.1.smithi187.stdout:6/447: truncate d7/d2a/d29/d94/f98 287709 0 2024-09-21T00:56:34.762 INFO:tasks.workunit.client.1.smithi187.stdout:7/366: mkdir d1/d55/d80/d87 0 2024-09-21T00:56:34.762 INFO:tasks.workunit.client.1.smithi187.stdout:5/416: link d0/c58 d0/dc/d39/d46/d67/d30/c93 0 2024-09-21T00:56:34.763 INFO:tasks.workunit.client.1.smithi187.stdout:0/377: mknod d0/d60/d6e/c7e 0 2024-09-21T00:56:34.764 INFO:tasks.workunit.client.1.smithi187.stdout:1/463: dwrite d4/d6/d23/d2e/d94/d35/d22/f46 [4194304,4194304] 0 2024-09-21T00:56:34.764 INFO:tasks.workunit.client.1.smithi187.stdout:4/409: creat d2/d3/d74/f80 x:0 0 0 2024-09-21T00:56:34.765 INFO:tasks.workunit.client.1.smithi187.stdout:5/417: write d0/dc/d39/d46/f6e [91441,104852] 0 2024-09-21T00:56:34.765 INFO:tasks.workunit.client.1.smithi187.stdout:6/448: creat d7/d2a/d7a/f99 x:0 0 0 2024-09-21T00:56:34.765 INFO:tasks.workunit.client.1.smithi187.stdout:3/397: truncate d9/d13/f54 3504404 0 2024-09-21T00:56:34.767 INFO:tasks.workunit.client.1.smithi187.stdout:5/418: stat d0 0 2024-09-21T00:56:34.772 INFO:tasks.workunit.client.1.smithi187.stdout:5/419: fsync d0/dc/d39/d46/d67/d30/f65 0 2024-09-21T00:56:34.775 INFO:tasks.workunit.client.1.smithi187.stdout:4/410: creat d2/d3/da/d2f/d32/d22/d37/d51/f81 x:0 0 0 2024-09-21T00:56:34.777 INFO:tasks.workunit.client.1.smithi187.stdout:6/449: dread d7/f52 [0,4194304] 0 2024-09-21T00:56:34.777 INFO:tasks.workunit.client.1.smithi187.stdout:8/480: truncate dc/d2f/d34/d4b/f77 2350092 0 2024-09-21T00:56:34.777 INFO:tasks.workunit.client.1.smithi187.stdout:0/378: dwrite d0/d17/d1c/f5d [0,4194304] 0 2024-09-21T00:56:34.777 INFO:tasks.workunit.client.1.smithi187.stdout:7/367: link d1/dc/d15/f57 d1/d18/d31/d5a/d75/f88 0 2024-09-21T00:56:34.778 INFO:tasks.workunit.client.1.smithi187.stdout:1/464: dread d4/d6/d23/d2e/d94/f31 [0,4194304] 0 2024-09-21T00:56:34.781 INFO:tasks.workunit.client.1.smithi187.stdout:8/481: chown dc/d2f/l56 354436 1 2024-09-21T00:56:34.782 INFO:tasks.workunit.client.1.smithi187.stdout:8/482: stat dc/d1c/d29/f4c 0 2024-09-21T00:56:34.783 INFO:tasks.workunit.client.1.smithi187.stdout:0/379: dread - d0/d17/d1c/d23/df/d41/d3b/f54 zero size 2024-09-21T00:56:34.784 INFO:tasks.workunit.client.1.smithi187.stdout:4/411: symlink d2/d3/da/d2f/d32/d26/d4a/d60/d6c/l82 0 2024-09-21T00:56:34.786 INFO:tasks.workunit.client.1.smithi187.stdout:5/420: rename d0/dc/d39/d46/d67/d14/d38/l85 to d0/dc/d39/d46/d67/d30/l94 0 2024-09-21T00:56:34.788 INFO:tasks.workunit.client.1.smithi187.stdout:9/573: sync 2024-09-21T00:56:34.788 INFO:tasks.workunit.client.1.smithi187.stdout:6/450: dwrite d7/d2a/d29/f49 [4194304,4194304] 0 2024-09-21T00:56:34.790 INFO:tasks.workunit.client.1.smithi187.stdout:5/421: chown d0/dc/d39/d46/d67/d14/d1b/d27/d3a/l54 684 1 2024-09-21T00:56:34.791 INFO:tasks.workunit.client.1.smithi187.stdout:2/408: sync 2024-09-21T00:56:34.794 INFO:tasks.workunit.client.1.smithi187.stdout:0/380: creat d0/d17/d1c/d23/df/f7f x:0 0 0 2024-09-21T00:56:34.794 INFO:tasks.workunit.client.1.smithi187.stdout:6/451: truncate d7/d2a/d29/f7c 4542457 0 2024-09-21T00:56:34.802 INFO:tasks.workunit.client.1.smithi187.stdout:9/574: creat d4/d13/d20/d2e/fbb x:0 0 0 2024-09-21T00:56:34.803 INFO:tasks.workunit.client.1.smithi187.stdout:9/575: chown d4/f1a 19 1 2024-09-21T00:56:34.803 INFO:tasks.workunit.client.1.smithi187.stdout:1/465: link d4/d6/f29 d4/d6/d23/d2e/d94/d35/d22/d65/f9d 0 2024-09-21T00:56:34.804 INFO:tasks.workunit.client.1.smithi187.stdout:9/576: fdatasync d4/d8/d41/f5b 0 2024-09-21T00:56:34.806 INFO:tasks.workunit.client.1.smithi187.stdout:4/412: creat d2/d3/da/d2f/f83 x:0 0 0 2024-09-21T00:56:34.807 INFO:tasks.workunit.client.1.smithi187.stdout:4/413: chown d2/d3/da/d2f/d32/d26/d4a 0 1 2024-09-21T00:56:34.808 INFO:tasks.workunit.client.1.smithi187.stdout:2/409: creat d2/dc/d6b/f96 x:0 0 0 2024-09-21T00:56:34.809 INFO:tasks.workunit.client.1.smithi187.stdout:1/466: dread d4/f76 [0,4194304] 0 2024-09-21T00:56:34.811 INFO:tasks.workunit.client.1.smithi187.stdout:1/467: chown d4/d6/f1c 0 1 2024-09-21T00:56:34.812 INFO:tasks.workunit.client.1.smithi187.stdout:4/414: write d2/d3/da/d2f/d32/d22/f49 [243915,30448] 0 2024-09-21T00:56:34.813 INFO:tasks.workunit.client.1.smithi187.stdout:8/483: truncate dc/d1c/f33 3509817 0 2024-09-21T00:56:34.814 INFO:tasks.workunit.client.1.smithi187.stdout:2/410: rmdir d2/d3/df 39 2024-09-21T00:56:34.814 INFO:tasks.workunit.client.1.smithi187.stdout:3/398: dread d9/d13/f54 [0,4194304] 0 2024-09-21T00:56:34.815 INFO:tasks.workunit.client.1.smithi187.stdout:7/368: dread d1/f14 [0,4194304] 0 2024-09-21T00:56:34.816 INFO:tasks.workunit.client.1.smithi187.stdout:0/381: getdents d0/d17 0 2024-09-21T00:56:34.817 INFO:tasks.workunit.client.1.smithi187.stdout:1/468: dread d4/d6/d23/d2e/d94/d35/f82 [0,4194304] 0 2024-09-21T00:56:34.817 INFO:tasks.workunit.client.1.smithi187.stdout:5/422: dread d0/dc/d1f/d26/f71 [0,4194304] 0 2024-09-21T00:56:34.818 INFO:tasks.workunit.client.1.smithi187.stdout:9/577: rmdir d4/db0 0 2024-09-21T00:56:34.819 INFO:tasks.workunit.client.1.smithi187.stdout:9/578: chown d4/d13/d14/d28 457438865 1 2024-09-21T00:56:34.820 INFO:tasks.workunit.client.1.smithi187.stdout:4/415: unlink d2/d3/da/d2f/d32/d26/d4a/d58/l5e 0 2024-09-21T00:56:34.822 INFO:tasks.workunit.client.1.smithi187.stdout:7/369: dread d1/dc/d15/d22/f79 [0,4194304] 0 2024-09-21T00:56:34.823 INFO:tasks.workunit.client.1.smithi187.stdout:0/382: mknod d0/d60/d6b/c80 0 2024-09-21T00:56:34.824 INFO:tasks.workunit.client.1.smithi187.stdout:4/416: dread d2/d3/da/d2f/d32/d24/f53 [0,4194304] 0 2024-09-21T00:56:34.825 INFO:tasks.workunit.client.1.smithi187.stdout:4/417: chown d2/d3/da/f1f 67870005 1 2024-09-21T00:56:34.826 INFO:tasks.workunit.client.1.smithi187.stdout:1/469: unlink d4/d75/c92 0 2024-09-21T00:56:34.829 INFO:tasks.workunit.client.1.smithi187.stdout:3/399: mkdir d9/d19/d42/d53/d56/d7d 0 2024-09-21T00:56:34.830 INFO:tasks.workunit.client.1.smithi187.stdout:8/484: dwrite f8 [0,4194304] 0 2024-09-21T00:56:34.832 INFO:tasks.workunit.client.1.smithi187.stdout:0/383: read d0/d17/d1c/d23/df/d41/d3b/f59 [1325421,108243] 0 2024-09-21T00:56:34.832 INFO:tasks.workunit.client.1.smithi187.stdout:4/418: readlink d2/d3/da/d2f/d32/d24/l7d 0 2024-09-21T00:56:34.834 INFO:tasks.workunit.client.1.smithi187.stdout:9/579: link d4/d13/d20/f26 d4/d8/d41/fbc 0 2024-09-21T00:56:34.836 INFO:tasks.workunit.client.1.smithi187.stdout:2/411: rmdir d2/d3/d15/d1b/d3c/d40/d75/d8b 0 2024-09-21T00:56:34.836 INFO:tasks.workunit.client.1.smithi187.stdout:7/370: mknod d1/d18/d31/c89 0 2024-09-21T00:56:34.837 INFO:tasks.workunit.client.1.smithi187.stdout:8/485: creat dc/d2f/d54/d69/fa0 x:0 0 0 2024-09-21T00:56:34.838 INFO:tasks.workunit.client.1.smithi187.stdout:8/486: chown dc/d2f/d34/f7c 382 1 2024-09-21T00:56:34.841 INFO:tasks.workunit.client.1.smithi187.stdout:4/419: rename d2/d3/da/d2f/d32/d26/d4a to d2/d3/d56/d84 0 2024-09-21T00:56:34.842 INFO:tasks.workunit.client.1.smithi187.stdout:9/580: unlink d4/d13/d20/f26 0 2024-09-21T00:56:34.843 INFO:tasks.workunit.client.1.smithi187.stdout:9/581: dread d4/d8/d41/f5b [0,4194304] 0 2024-09-21T00:56:34.844 INFO:tasks.workunit.client.1.smithi187.stdout:3/400: mkdir d9/d19/d7e 0 2024-09-21T00:56:34.845 INFO:tasks.workunit.client.1.smithi187.stdout:9/582: chown d4/d13/d14/d1d/f3c 1376 1 2024-09-21T00:56:34.845 INFO:tasks.workunit.client.1.smithi187.stdout:7/371: fdatasync d1/f14 0 2024-09-21T00:56:34.846 INFO:tasks.workunit.client.1.smithi187.stdout:7/372: write d1/f2 [2703825,102002] 0 2024-09-21T00:56:34.846 INFO:tasks.workunit.client.1.smithi187.stdout:7/373: stat d1/d18/f76 0 2024-09-21T00:56:34.847 INFO:tasks.workunit.client.1.smithi187.stdout:8/487: creat dc/d2f/fa1 x:0 0 0 2024-09-21T00:56:34.847 INFO:tasks.workunit.client.1.smithi187.stdout:7/374: readlink d1/dc/l16 0 2024-09-21T00:56:34.847 INFO:tasks.workunit.client.1.smithi187.stdout:8/488: chown dc/d2f/d54/f74 0 1 2024-09-21T00:56:34.848 INFO:tasks.workunit.client.1.smithi187.stdout:4/420: creat d2/d3/da/d2f/d32/d22/d37/d3a/f85 x:0 0 0 2024-09-21T00:56:34.852 INFO:tasks.workunit.client.1.smithi187.stdout:2/412: mkdir d2/d3/d15/d1b/d6c/d97 0 2024-09-21T00:56:34.853 INFO:tasks.workunit.client.1.smithi187.stdout:7/375: dwrite d1/dc/d15/d22/d3e/f71 [0,4194304] 0 2024-09-21T00:56:34.853 INFO:tasks.workunit.client.1.smithi187.stdout:3/401: mkdir d9/d7f 0 2024-09-21T00:56:34.853 INFO:tasks.workunit.client.1.smithi187.stdout:1/470: write d4/d6/d23/d2e/d94/d35/d22/d65/f9d [820422,130511] 0 2024-09-21T00:56:34.856 INFO:tasks.workunit.client.1.smithi187.stdout:7/376: dread d1/d18/d31/d41/f6a [0,4194304] 0 2024-09-21T00:56:34.857 INFO:tasks.workunit.client.1.smithi187.stdout:7/377: write d1/dc/d15/d22/d3e/f71 [2941522,16816] 0 2024-09-21T00:56:34.858 INFO:tasks.workunit.client.1.smithi187.stdout:8/489: symlink dc/d1c/d3e/la2 0 2024-09-21T00:56:34.863 INFO:tasks.workunit.client.1.smithi187.stdout:0/384: truncate d0/d17/d1c/d23/df/f15 375359 0 2024-09-21T00:56:34.864 INFO:tasks.workunit.client.1.smithi187.stdout:0/385: chown d0/d17/d1c/l57 1 1 2024-09-21T00:56:34.866 INFO:tasks.workunit.client.1.smithi187.stdout:3/402: creat d9/d19/d1c/f80 x:0 0 0 2024-09-21T00:56:34.867 INFO:tasks.workunit.client.1.smithi187.stdout:1/471: chown d4/d6/d23/d2e/d94/d35/d4c/d5b/l60 17692 1 2024-09-21T00:56:34.868 INFO:tasks.workunit.client.1.smithi187.stdout:2/413: dwrite d2/d25/f44 [0,4194304] 0 2024-09-21T00:56:34.869 INFO:tasks.workunit.client.1.smithi187.stdout:7/378: mkdir d1/d18/d31/d41/d8a 0 2024-09-21T00:56:34.870 INFO:tasks.workunit.client.1.smithi187.stdout:8/490: creat dc/d2f/d34/d7d/fa3 x:0 0 0 2024-09-21T00:56:34.870 INFO:tasks.workunit.client.1.smithi187.stdout:2/414: stat d2/d3/d15/d1b/d3c/c48 0 2024-09-21T00:56:34.872 INFO:tasks.workunit.client.1.smithi187.stdout:3/403: write d9/d13/f3d [2508039,16287] 0 2024-09-21T00:56:34.874 INFO:tasks.workunit.client.1.smithi187.stdout:8/491: write dc/d2f/f45 [135196,62364] 0 2024-09-21T00:56:34.876 INFO:tasks.workunit.client.1.smithi187.stdout:2/415: fdatasync d2/d3/d15/f87 0 2024-09-21T00:56:34.877 INFO:tasks.workunit.client.1.smithi187.stdout:3/404: rmdir d9/d19/d1c 39 2024-09-21T00:56:34.878 INFO:tasks.workunit.client.1.smithi187.stdout:2/416: readlink d2/dc/d2e/d4a/l6d 0 2024-09-21T00:56:34.879 INFO:tasks.workunit.client.1.smithi187.stdout:1/472: dwrite d4/d6/f48 [0,4194304] 0 2024-09-21T00:56:34.880 INFO:tasks.workunit.client.1.smithi187.stdout:4/421: dread d2/d3/da/d2f/d32/d26/f44 [0,4194304] 0 2024-09-21T00:56:34.880 INFO:tasks.workunit.client.1.smithi187.stdout:8/492: mknod dc/d1c/ca4 0 2024-09-21T00:56:34.883 INFO:tasks.workunit.client.1.smithi187.stdout:3/405: chown d9/d19/d42/c46 1448 1 2024-09-21T00:56:34.884 INFO:tasks.workunit.client.1.smithi187.stdout:1/473: mknod d4/d6/d64/c9e 0 2024-09-21T00:56:34.885 INFO:tasks.workunit.client.1.smithi187.stdout:4/422: mknod d2/d3/d56/c86 0 2024-09-21T00:56:34.886 INFO:tasks.workunit.client.1.smithi187.stdout:8/493: dread - dc/d1c/f2a zero size 2024-09-21T00:56:34.887 INFO:tasks.workunit.client.1.smithi187.stdout:9/583: dwrite d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:34.890 INFO:tasks.workunit.client.1.smithi187.stdout:9/584: fsync d4/d13/d14/d5d/fa2 0 2024-09-21T00:56:34.890 INFO:tasks.workunit.client.1.smithi187.stdout:4/423: creat d2/d3/d56/f87 x:0 0 0 2024-09-21T00:56:34.891 INFO:tasks.workunit.client.1.smithi187.stdout:3/406: mkdir d9/d19/d42/d53/d56/d7d/d81 0 2024-09-21T00:56:34.893 INFO:tasks.workunit.client.1.smithi187.stdout:8/494: mknod dc/d1c/d29/ca5 0 2024-09-21T00:56:34.895 INFO:tasks.workunit.client.1.smithi187.stdout:1/474: dread d4/d6/d23/d2e/d94/d35/d22/d65/f9d [0,4194304] 0 2024-09-21T00:56:34.896 INFO:tasks.workunit.client.1.smithi187.stdout:4/424: stat d2/d3/da/d2f/d32/d22/d37/d63/f72 0 2024-09-21T00:56:34.898 INFO:tasks.workunit.client.1.smithi187.stdout:7/379: dwrite d1/d18/d31/d33/d3b/f3f [0,4194304] 0 2024-09-21T00:56:34.898 INFO:tasks.workunit.client.1.smithi187.stdout:8/495: write dc/d1c/d29/f2c [4105752,107250] 0 2024-09-21T00:56:34.903 INFO:tasks.workunit.client.1.smithi187.stdout:1/475: fdatasync d4/d6/d23/d2e/f7a 0 2024-09-21T00:56:34.905 INFO:tasks.workunit.client.1.smithi187.stdout:4/425: chown d2/d3/da/d2f/d32/d26 52853157 1 2024-09-21T00:56:34.908 INFO:tasks.workunit.client.1.smithi187.stdout:2/417: dwrite d2/fb [0,4194304] 0 2024-09-21T00:56:34.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:34 smithi187 ceph-mon[34997]: pgmap v20: 65 pgs: 65 active+clean; 635 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 66 MiB/s wr, 258 op/s 2024-09-21T00:56:34.909 INFO:tasks.workunit.client.1.smithi187.stdout:9/585: dwrite d4/d10/f23 [4194304,4194304] 0 2024-09-21T00:56:34.914 INFO:tasks.workunit.client.1.smithi187.stdout:4/426: fsync d2/d3/da/d2f/d32/d22/f49 0 2024-09-21T00:56:34.914 INFO:tasks.workunit.client.1.smithi187.stdout:3/407: dread f2 [0,4194304] 0 2024-09-21T00:56:34.914 INFO:tasks.workunit.client.1.smithi187.stdout:7/380: mkdir d1/dc/d15/d22/d3e/d73/d8b 0 2024-09-21T00:56:34.916 INFO:tasks.workunit.client.1.smithi187.stdout:1/476: mkdir d4/d6/d23/d2e/d94/d35/d22/d2c/d9f 0 2024-09-21T00:56:34.917 INFO:tasks.workunit.client.1.smithi187.stdout:8/496: rename dc/d2f/d37/c5c to dc/d1c/d3e/ca6 0 2024-09-21T00:56:34.918 INFO:tasks.workunit.client.1.smithi187.stdout:4/427: write d2/d3/da/d16/f1d [5248858,77575] 0 2024-09-21T00:56:34.919 INFO:tasks.workunit.client.1.smithi187.stdout:8/497: dread - dc/d2f/d34/d4b/f99 zero size 2024-09-21T00:56:34.919 INFO:tasks.workunit.client.1.smithi187.stdout:1/477: dread d4/f89 [0,4194304] 0 2024-09-21T00:56:34.920 INFO:tasks.workunit.client.1.smithi187.stdout:9/586: creat d4/d61/d6c/fbd x:0 0 0 2024-09-21T00:56:34.920 INFO:tasks.workunit.client.1.smithi187.stdout:7/381: symlink d1/dc/d15/d22/d3e/d73/l8c 0 2024-09-21T00:56:34.923 INFO:tasks.workunit.client.1.smithi187.stdout:4/428: symlink d2/d3/d56/d84/d60/d6c/l88 0 2024-09-21T00:56:34.925 INFO:tasks.workunit.client.1.smithi187.stdout:8/498: truncate dc/f47 1379265 0 2024-09-21T00:56:34.925 INFO:tasks.workunit.client.1.smithi187.stdout:7/382: dread d1/f1a [4194304,4194304] 0 2024-09-21T00:56:34.925 INFO:tasks.workunit.client.1.smithi187.stdout:4/429: stat d2/d3/da/d16/d5f/f75 0 2024-09-21T00:56:34.928 INFO:tasks.workunit.client.1.smithi187.stdout:9/587: dread d4/d13/d14/d5d/f8b [0,4194304] 0 2024-09-21T00:56:34.928 INFO:tasks.workunit.client.1.smithi187.stdout:7/383: rmdir d1/dc/d15/d22/d3e/d7c 39 2024-09-21T00:56:34.928 INFO:tasks.workunit.client.1.smithi187.stdout:4/430: dread - d2/d3/da/d2f/d4b/f7a zero size 2024-09-21T00:56:34.930 INFO:tasks.workunit.client.1.smithi187.stdout:2/418: dread d2/dc/d2e/d4a/f4d [0,4194304] 0 2024-09-21T00:56:34.930 INFO:tasks.workunit.client.1.smithi187.stdout:8/499: getdents dc/d2f/d34 0 2024-09-21T00:56:34.982 INFO:tasks.workunit.client.1.smithi187.stdout:6/452: sync 2024-09-21T00:56:34.996 INFO:tasks.workunit.client.1.smithi187.stdout:8/500: mkdir dc/d1c/d29/da7 0 2024-09-21T00:56:34.996 INFO:tasks.workunit.client.1.smithi187.stdout:2/419: write d2/dc/d6b/f96 [1011627,61424] 0 2024-09-21T00:56:34.996 INFO:tasks.workunit.client.1.smithi187.stdout:4/431: read d2/d3/da/d16/f1d [1693356,68628] 0 2024-09-21T00:56:34.996 INFO:tasks.workunit.client.1.smithi187.stdout:1/478: dwrite d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [0,4194304] 0 2024-09-21T00:56:34.996 INFO:tasks.workunit.client.1.smithi187.stdout:6/453: write d7/d2a/d29/d40/d50/f73 [72634,13977] 0 2024-09-21T00:56:34.998 INFO:tasks.workunit.client.1.smithi187.stdout:7/384: link d1/dc/d15/f67 d1/d18/f8d 0 2024-09-21T00:56:35.000 INFO:tasks.workunit.client.1.smithi187.stdout:2/420: mkdir d2/d3/df/d98 0 2024-09-21T00:56:35.001 INFO:tasks.workunit.client.1.smithi187.stdout:1/479: write d4/d6/f29 [1843254,51818] 0 2024-09-21T00:56:35.002 INFO:tasks.workunit.client.1.smithi187.stdout:8/501: dread dc/d2f/d34/f3a [0,4194304] 0 2024-09-21T00:56:35.003 INFO:tasks.workunit.client.1.smithi187.stdout:6/454: mknod d7/d2a/d29/d40/d50/c9a 0 2024-09-21T00:56:35.003 INFO:tasks.workunit.client.1.smithi187.stdout:1/480: readlink d4/d6/l97 0 2024-09-21T00:56:35.005 INFO:tasks.workunit.client.1.smithi187.stdout:2/421: mknod d2/dc/d6b/c99 0 2024-09-21T00:56:35.007 INFO:tasks.workunit.client.1.smithi187.stdout:6/455: mknod d7/d2a/d29/d40/d5e/c9b 0 2024-09-21T00:56:35.008 INFO:tasks.workunit.client.1.smithi187.stdout:2/422: truncate d2/dc/f65 980061 0 2024-09-21T00:56:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:34 smithi112 ceph-mon[28078]: pgmap v20: 65 pgs: 65 active+clean; 635 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 66 MiB/s wr, 258 op/s 2024-09-21T00:56:35.010 INFO:tasks.workunit.client.1.smithi187.stdout:7/385: dwrite d1/dc/d15/d22/d3e/d73/f7d [0,4194304] 0 2024-09-21T00:56:35.016 INFO:tasks.workunit.client.1.smithi187.stdout:1/481: dwrite d4/d6/d23/d2e/d94/d35/d79/f87 [0,4194304] 0 2024-09-21T00:56:35.027 INFO:tasks.workunit.client.1.smithi187.stdout:8/502: truncate dc/d2f/d54/d69/f84 2539497 0 2024-09-21T00:56:35.027 INFO:tasks.workunit.client.1.smithi187.stdout:2/423: dread d2/d3/d15/d1b/d1c/f32 [0,4194304] 0 2024-09-21T00:56:35.027 INFO:tasks.workunit.client.1.smithi187.stdout:7/386: truncate d1/f9 7241166 0 2024-09-21T00:56:35.028 INFO:tasks.workunit.client.1.smithi187.stdout:7/387: chown d1/d55/d80/d87 26443531 1 2024-09-21T00:56:35.030 INFO:tasks.workunit.client.1.smithi187.stdout:4/432: dread d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:35.030 INFO:tasks.workunit.client.1.smithi187.stdout:7/388: chown d1/d18/d31/l53 130821 1 2024-09-21T00:56:35.033 INFO:tasks.workunit.client.1.smithi187.stdout:4/433: mkdir d2/d3/da/d2f/d32/d22/d4f/d89 0 2024-09-21T00:56:35.036 INFO:tasks.workunit.client.1.smithi187.stdout:2/424: dwrite d2/d3/d15/d1b/d3c/d40/f6e [0,4194304] 0 2024-09-21T00:56:35.036 INFO:tasks.workunit.client.1.smithi187.stdout:4/434: read d2/d3/f13 [371205,55002] 0 2024-09-21T00:56:35.037 INFO:tasks.workunit.client.1.smithi187.stdout:2/425: chown d2/dc/d6b/c99 13 1 2024-09-21T00:56:35.039 INFO:tasks.workunit.client.1.smithi187.stdout:4/435: truncate d2/d3/da/d2f/d32/d26/f44 4373650 0 2024-09-21T00:56:35.041 INFO:tasks.workunit.client.1.smithi187.stdout:2/426: dread d2/d3/d15/d1b/d1c/f32 [0,4194304] 0 2024-09-21T00:56:35.042 INFO:tasks.workunit.client.1.smithi187.stdout:2/427: fsync d2/f78 0 2024-09-21T00:56:35.044 INFO:tasks.workunit.client.1.smithi187.stdout:2/428: write d2/dc/d2e/d4a/d7c/f45 [1113529,17273] 0 2024-09-21T00:56:35.046 INFO:tasks.workunit.client.1.smithi187.stdout:4/436: dread d2/d3/da/d2f/d32/f4e [4194304,4194304] 0 2024-09-21T00:56:35.046 INFO:tasks.workunit.client.1.smithi187.stdout:1/482: dread d4/d6/d23/d2e/f3f [0,4194304] 0 2024-09-21T00:56:35.049 INFO:tasks.workunit.client.1.smithi187.stdout:4/437: write d2/d3/da/f5b [1549051,84728] 0 2024-09-21T00:56:35.049 INFO:tasks.workunit.client.1.smithi187.stdout:2/429: symlink d2/d3/d15/l9a 0 2024-09-21T00:56:35.050 INFO:tasks.workunit.client.1.smithi187.stdout:1/483: write d4/d6/d23/d2e/d94/f13 [240815,55076] 0 2024-09-21T00:56:35.050 INFO:tasks.workunit.client.1.smithi187.stdout:2/430: rmdir d2 39 2024-09-21T00:56:35.051 INFO:tasks.workunit.client.1.smithi187.stdout:4/438: read d2/d3/da/d2f/d32/d24/f2e [2497866,19897] 0 2024-09-21T00:56:35.054 INFO:tasks.workunit.client.1.smithi187.stdout:2/431: creat d2/d3/d15/d1b/d6c/f9b x:0 0 0 2024-09-21T00:56:35.054 INFO:tasks.workunit.client.1.smithi187.stdout:1/484: link d4/d6/d23/l4a d4/d6/d49/la0 0 2024-09-21T00:56:35.056 INFO:tasks.workunit.client.1.smithi187.stdout:2/432: chown d2/d25/c42 1815567 1 2024-09-21T00:56:35.056 INFO:tasks.workunit.client.1.smithi187.stdout:1/485: fdatasync d4/f76 0 2024-09-21T00:56:35.058 INFO:tasks.workunit.client.1.smithi187.stdout:4/439: dwrite d2/d3/da/d2f/d32/d22/d37/d51/f81 [0,4194304] 0 2024-09-21T00:56:35.059 INFO:tasks.workunit.client.1.smithi187.stdout:1/486: truncate d4/d6/d23/d2e/d94/d6c/f93 1001324 0 2024-09-21T00:56:35.060 INFO:tasks.workunit.client.1.smithi187.stdout:2/433: getdents d2/d3/df 0 2024-09-21T00:56:35.062 INFO:tasks.workunit.client.1.smithi187.stdout:2/434: symlink d2/dc/d2e/d6f/l9c 0 2024-09-21T00:56:35.063 INFO:tasks.workunit.client.1.smithi187.stdout:1/487: symlink d4/d6/d23/d2e/d94/d35/d79/la1 0 2024-09-21T00:56:35.065 INFO:tasks.workunit.client.1.smithi187.stdout:2/435: mkdir d2/d3/d15/d1b/d9d 0 2024-09-21T00:56:35.066 INFO:tasks.workunit.client.1.smithi187.stdout:8/503: dread dc/d2f/d54/d69/f84 [0,4194304] 0 2024-09-21T00:56:35.067 INFO:tasks.workunit.client.1.smithi187.stdout:4/440: dwrite d2/d3/da/d2f/d4b/f7a [0,4194304] 0 2024-09-21T00:56:35.069 INFO:tasks.workunit.client.1.smithi187.stdout:8/504: unlink dc/d2f/d34/f5e 0 2024-09-21T00:56:35.070 INFO:tasks.workunit.client.1.smithi187.stdout:2/436: rename d2/d25/f4f to d2/dc/d2e/f9e 0 2024-09-21T00:56:35.073 INFO:tasks.workunit.client.1.smithi187.stdout:4/441: fdatasync d2/d3/da/d2f/d32/d24/f28 0 2024-09-21T00:56:35.074 INFO:tasks.workunit.client.1.smithi187.stdout:8/505: dwrite dc/d2f/f45 [0,4194304] 0 2024-09-21T00:56:35.074 INFO:tasks.workunit.client.1.smithi187.stdout:2/437: rename d2/d3/d15/d1b/d3c/d69 to d2/d3/d15/d1b/d1c/d2d/d8f/d9f 0 2024-09-21T00:56:35.076 INFO:tasks.workunit.client.1.smithi187.stdout:2/438: truncate d2/dc/d2e/d4a/d7c/f79 881910 0 2024-09-21T00:56:35.077 INFO:tasks.workunit.client.1.smithi187.stdout:8/506: creat dc/d2f/d34/d4b/d85/fa8 x:0 0 0 2024-09-21T00:56:35.077 INFO:tasks.workunit.client.1.smithi187.stdout:8/507: chown dc/d1c/d29/d9f 1387 1 2024-09-21T00:56:35.078 INFO:tasks.workunit.client.1.smithi187.stdout:1/488: truncate d4/d6/d23/d2e/d94/d35/f6e 1602515 0 2024-09-21T00:56:35.080 INFO:tasks.workunit.client.1.smithi187.stdout:1/489: rmdir d4/d6/d23/d2e/d53/d6a 39 2024-09-21T00:56:35.084 INFO:tasks.workunit.client.1.smithi187.stdout:8/508: dread dc/d44/f5a [0,4194304] 0 2024-09-21T00:56:35.084 INFO:tasks.workunit.client.1.smithi187.stdout:2/439: write d2/d3/d15/d1b/d3c/f85 [1013892,20869] 0 2024-09-21T00:56:35.087 INFO:tasks.workunit.client.1.smithi187.stdout:8/509: dread dc/d2f/d54/d69/f84 [0,4194304] 0 2024-09-21T00:56:35.087 INFO:tasks.workunit.client.1.smithi187.stdout:2/440: rename d2/d3/d15/f60 to d2/d3/d15/d1b/fa0 0 2024-09-21T00:56:35.088 INFO:tasks.workunit.client.1.smithi187.stdout:8/510: write dc/f92 [962421,116330] 0 2024-09-21T00:56:35.089 INFO:tasks.workunit.client.1.smithi187.stdout:8/511: truncate dc/d44/f6c 363348 0 2024-09-21T00:56:35.090 INFO:tasks.workunit.client.1.smithi187.stdout:2/441: mkdir d2/d3/d15/d1b/d6c/d97/da1 0 2024-09-21T00:56:35.095 INFO:tasks.workunit.client.1.smithi187.stdout:8/512: dwrite dc/d1c/f2e [0,4194304] 0 2024-09-21T00:56:35.098 INFO:tasks.workunit.client.1.smithi187.stdout:8/513: symlink dc/d1c/d29/la9 0 2024-09-21T00:56:35.098 INFO:tasks.workunit.client.1.smithi187.stdout:2/442: truncate d2/d3/d15/d1b/d3c/d40/f6e 1831227 0 2024-09-21T00:56:35.099 INFO:tasks.workunit.client.1.smithi187.stdout:1/490: dwrite d4/f62 [4194304,4194304] 0 2024-09-21T00:56:35.101 INFO:tasks.workunit.client.1.smithi187.stdout:1/491: write d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 [2722756,76813] 0 2024-09-21T00:56:35.103 INFO:tasks.workunit.client.1.smithi187.stdout:2/443: creat d2/d3/d15/d1b/d1c/d2d/d8f/d9f/fa2 x:0 0 0 2024-09-21T00:56:35.104 INFO:tasks.workunit.client.1.smithi187.stdout:1/492: unlink d4/d6/d23/l69 0 2024-09-21T00:56:35.107 INFO:tasks.workunit.client.1.smithi187.stdout:2/444: rename d2/d3/df/d98 to d2/dc/d2e/d4a/d7c/d52/da3 0 2024-09-21T00:56:35.109 INFO:tasks.workunit.client.1.smithi187.stdout:1/493: symlink d4/d6/d49/la2 0 2024-09-21T00:56:35.111 INFO:tasks.workunit.client.1.smithi187.stdout:1/494: write d4/d6/d23/d2e/d94/d35/d4c/f85 [651304,39877] 0 2024-09-21T00:56:35.111 INFO:tasks.workunit.client.1.smithi187.stdout:2/445: write d2/d3/d15/d1b/d1c/f1f [2996979,60649] 0 2024-09-21T00:56:35.111 INFO:tasks.workunit.client.1.smithi187.stdout:5/423: sync 2024-09-21T00:56:35.112 INFO:tasks.workunit.client.1.smithi187.stdout:1/495: read d4/f14 [4237051,57457] 0 2024-09-21T00:56:35.113 INFO:tasks.workunit.client.1.smithi187.stdout:5/424: write d0/f75 [416381,70275] 0 2024-09-21T00:56:35.113 INFO:tasks.workunit.client.1.smithi187.stdout:2/446: write d2/fb [4726741,54635] 0 2024-09-21T00:56:35.122 INFO:tasks.workunit.client.1.smithi187.stdout:1/496: dwrite d4/d6/d64/f71 [0,4194304] 0 2024-09-21T00:56:35.126 INFO:tasks.workunit.client.1.smithi187.stdout:2/447: dwrite d2/d3/f8d [0,4194304] 0 2024-09-21T00:56:35.128 INFO:tasks.workunit.client.1.smithi187.stdout:1/497: write d4/f14 [3716464,80312] 0 2024-09-21T00:56:35.129 INFO:tasks.workunit.client.1.smithi187.stdout:2/448: write d2/d3/d15/d1b/d3c/f85 [704423,70498] 0 2024-09-21T00:56:35.132 INFO:tasks.workunit.client.1.smithi187.stdout:2/449: read d2/d25/f68 [9577,82468] 0 2024-09-21T00:56:35.134 INFO:tasks.workunit.client.1.smithi187.stdout:1/498: dread d4/d6/d23/d2e/d53/d6a/f8f [0,4194304] 0 2024-09-21T00:56:35.135 INFO:tasks.workunit.client.1.smithi187.stdout:2/450: write d2/d3/d15/d1b/d1c/f32 [693725,120041] 0 2024-09-21T00:56:35.136 INFO:tasks.workunit.client.1.smithi187.stdout:1/499: write d4/d6/d23/d2e/d53/f7f [562716,36211] 0 2024-09-21T00:56:35.138 INFO:tasks.workunit.client.1.smithi187.stdout:2/451: write d2/d3/d15/d1b/d3c/f74 [9426318,108150] 0 2024-09-21T00:56:35.217 INFO:tasks.workunit.client.1.smithi187.stdout:3/408: sync 2024-09-21T00:56:35.218 INFO:tasks.workunit.client.1.smithi187.stdout:0/386: sync 2024-09-21T00:56:35.225 INFO:tasks.workunit.client.1.smithi187.stdout:2/452: creat d2/d3/d15/d1b/d6c/d97/da1/fa4 x:0 0 0 2024-09-21T00:56:35.226 INFO:tasks.workunit.client.1.smithi187.stdout:0/387: creat d0/d17/d18/f81 x:0 0 0 2024-09-21T00:56:35.227 INFO:tasks.workunit.client.1.smithi187.stdout:2/453: truncate d2/dc/d2e/d4a/d7c/f79 1102487 0 2024-09-21T00:56:35.227 INFO:tasks.workunit.client.1.smithi187.stdout:3/409: mknod d9/d19/d42/d53/d75/c82 0 2024-09-21T00:56:35.228 INFO:tasks.workunit.client.1.smithi187.stdout:1/500: getdents d4/d6/d23 0 2024-09-21T00:56:35.229 INFO:tasks.workunit.client.1.smithi187.stdout:2/454: creat d2/dc/d2e/d4a/fa5 x:0 0 0 2024-09-21T00:56:35.229 INFO:tasks.workunit.client.1.smithi187.stdout:1/501: readlink d4/l9 0 2024-09-21T00:56:35.230 INFO:tasks.workunit.client.1.smithi187.stdout:2/455: dread - d2/d3/d15/d1b/d1c/d2d/f83 zero size 2024-09-21T00:56:35.232 INFO:tasks.workunit.client.1.smithi187.stdout:0/388: link d0/l56 d0/d17/d1c/d23/l82 0 2024-09-21T00:56:35.232 INFO:tasks.workunit.client.1.smithi187.stdout:0/389: stat d0/d17/d18/d3a/f77 0 2024-09-21T00:56:35.233 INFO:tasks.workunit.client.1.smithi187.stdout:0/390: write d0/f63 [21051,32620] 0 2024-09-21T00:56:35.233 INFO:tasks.workunit.client.1.smithi187.stdout:3/410: creat d9/d19/d42/d53/d56/f83 x:0 0 0 2024-09-21T00:56:35.234 INFO:tasks.workunit.client.1.smithi187.stdout:0/391: chown d0/d17/d1c/d65/c66 3 1 2024-09-21T00:56:35.234 INFO:tasks.workunit.client.1.smithi187.stdout:1/502: creat d4/d6/d23/d2e/d94/d35/d22/d65/fa3 x:0 0 0 2024-09-21T00:56:35.235 INFO:tasks.workunit.client.1.smithi187.stdout:1/503: readlink d4/d6/d49/la2 0 2024-09-21T00:56:35.238 INFO:tasks.workunit.client.1.smithi187.stdout:0/392: rename d0/d17/d18/f47 to d0/d17/f83 0 2024-09-21T00:56:35.263 INFO:tasks.workunit.client.1.smithi187.stdout:0/393: rename d0/d17/d1c/d23/df/d51/f7b to d0/d60/f84 0 2024-09-21T00:56:35.264 INFO:tasks.workunit.client.1.smithi187.stdout:2/456: write d2/d25/f43 [1405397,25879] 0 2024-09-21T00:56:35.265 INFO:tasks.workunit.client.1.smithi187.stdout:1/504: dwrite d4/d6/d23/d2e/d94/d35/d22/d65/f9d [0,4194304] 0 2024-09-21T00:56:35.265 INFO:tasks.workunit.client.1.smithi187.stdout:0/394: read - d0/d17/d18/d3a/f5e zero size 2024-09-21T00:56:35.269 INFO:tasks.workunit.client.1.smithi187.stdout:2/457: mknod d2/d3/d15/d1b/d3c/d40/ca6 0 2024-09-21T00:56:35.270 INFO:tasks.workunit.client.1.smithi187.stdout:0/395: creat d0/d5a/f85 x:0 0 0 2024-09-21T00:56:35.271 INFO:tasks.workunit.client.1.smithi187.stdout:2/458: read d2/dc/f67 [2830205,98359] 0 2024-09-21T00:56:35.271 INFO:tasks.workunit.client.1.smithi187.stdout:1/505: write d4/f89 [1319333,7204] 0 2024-09-21T00:56:35.272 INFO:tasks.workunit.client.1.smithi187.stdout:0/396: mknod d0/d17/d18/d3a/c86 0 2024-09-21T00:56:35.273 INFO:tasks.workunit.client.1.smithi187.stdout:0/397: chown d0/d17/l75 111496 1 2024-09-21T00:56:35.274 INFO:tasks.workunit.client.1.smithi187.stdout:0/398: dread - d0/d17/d1c/d23/df/d41/d3b/f54 zero size 2024-09-21T00:56:35.276 INFO:tasks.workunit.client.1.smithi187.stdout:0/399: stat d0/l56 0 2024-09-21T00:56:35.277 INFO:tasks.workunit.client.1.smithi187.stdout:2/459: getdents d2/dc 0 2024-09-21T00:56:35.278 INFO:tasks.workunit.client.1.smithi187.stdout:0/400: symlink d0/d17/l87 0 2024-09-21T00:56:35.279 INFO:tasks.workunit.client.1.smithi187.stdout:0/401: fsync d0/d17/d1c/d23/df/f69 0 2024-09-21T00:56:35.279 INFO:tasks.workunit.client.1.smithi187.stdout:1/506: write d4/d6/f5a [4348276,104685] 0 2024-09-21T00:56:35.280 INFO:tasks.workunit.client.1.smithi187.stdout:1/507: readlink d4/d6/d23/d2e/d94/l77 0 2024-09-21T00:56:35.281 INFO:tasks.workunit.client.1.smithi187.stdout:2/460: rename d2/dc/d2e/d4a/d7c/c58 to d2/dc/d2e/ca7 0 2024-09-21T00:56:35.282 INFO:tasks.workunit.client.1.smithi187.stdout:0/402: symlink d0/d17/d1c/d23/df/d41/l88 0 2024-09-21T00:56:35.283 INFO:tasks.workunit.client.1.smithi187.stdout:1/508: unlink d4/d6/d23/d2e/d94/d35/c74 0 2024-09-21T00:56:35.285 INFO:tasks.workunit.client.1.smithi187.stdout:2/461: rename d2/d3/d15/d1b to d2/da8 0 2024-09-21T00:56:35.285 INFO:tasks.workunit.client.1.smithi187.stdout:1/509: creat d4/d6/d23/d2e/d94/d6c/fa4 x:0 0 0 2024-09-21T00:56:35.287 INFO:tasks.workunit.client.1.smithi187.stdout:1/510: rmdir d4/d6/d23/d2e/d94/d35/d4c/d5b/d83 39 2024-09-21T00:56:35.288 INFO:tasks.workunit.client.1.smithi187.stdout:1/511: read - d4/d6/d23/d2e/d94/d35/d22/d65/fa3 zero size 2024-09-21T00:56:35.289 INFO:tasks.workunit.client.1.smithi187.stdout:1/512: read d4/d6/d23/d6f/f96 [644131,66673] 0 2024-09-21T00:56:35.295 INFO:tasks.workunit.client.1.smithi187.stdout:2/462: dwrite d2/da8/d1c/f1f [0,4194304] 0 2024-09-21T00:56:35.296 INFO:tasks.workunit.client.1.smithi187.stdout:1/513: truncate d4/f62 6892569 0 2024-09-21T00:56:35.297 INFO:tasks.workunit.client.1.smithi187.stdout:1/514: stat d4/f27 0 2024-09-21T00:56:35.299 INFO:tasks.workunit.client.1.smithi187.stdout:2/463: creat d2/dc/d2e/d4a/d7c/d88/fa9 x:0 0 0 2024-09-21T00:56:35.302 INFO:tasks.workunit.client.1.smithi187.stdout:2/464: dread d2/da8/d1c/f32 [0,4194304] 0 2024-09-21T00:56:35.304 INFO:tasks.workunit.client.1.smithi187.stdout:1/515: dwrite d4/d6/d23/d2e/d94/d35/d22/f57 [0,4194304] 0 2024-09-21T00:56:35.307 INFO:tasks.workunit.client.1.smithi187.stdout:2/465: symlink d2/da8/d3c/d40/d75/laa 0 2024-09-21T00:56:35.311 INFO:tasks.workunit.client.1.smithi187.stdout:2/466: mknod d2/dc/d21/cab 0 2024-09-21T00:56:35.312 INFO:tasks.workunit.client.1.smithi187.stdout:1/516: mknod d4/d6/d23/d2e/d94/d35/d4c/d5b/d83/ca5 0 2024-09-21T00:56:35.313 INFO:tasks.workunit.client.1.smithi187.stdout:2/467: truncate d2/dc/d2e/d4a/d7c/d88/fa9 546240 0 2024-09-21T00:56:35.314 INFO:tasks.workunit.client.1.smithi187.stdout:1/517: symlink d4/d6/d23/d2e/d94/d35/d22/d2c/d9f/la6 0 2024-09-21T00:56:35.315 INFO:tasks.workunit.client.1.smithi187.stdout:2/468: fsync d2/dc/d2e/f9e 0 2024-09-21T00:56:35.316 INFO:tasks.workunit.client.1.smithi187.stdout:2/469: dread d2/d25/f68 [0,4194304] 0 2024-09-21T00:56:35.316 INFO:tasks.workunit.client.1.smithi187.stdout:1/518: creat d4/d6/d23/d2e/d94/d35/d4c/fa7 x:0 0 0 2024-09-21T00:56:35.317 INFO:tasks.workunit.client.1.smithi187.stdout:2/470: write d2/d3/d15/f87 [480662,18259] 0 2024-09-21T00:56:35.318 INFO:tasks.workunit.client.1.smithi187.stdout:1/519: creat d4/d6/d49/fa8 x:0 0 0 2024-09-21T00:56:35.320 INFO:tasks.workunit.client.1.smithi187.stdout:2/471: unlink d2/da8/d6c/f9b 0 2024-09-21T00:56:35.320 INFO:tasks.workunit.client.1.smithi187.stdout:2/472: readlink d2/d3/df/l1e 0 2024-09-21T00:56:35.322 INFO:tasks.workunit.client.1.smithi187.stdout:2/473: mkdir d2/dc/d2e/d4a/d7c/d52/dac 0 2024-09-21T00:56:35.325 INFO:tasks.workunit.client.1.smithi187.stdout:2/474: creat d2/da8/d6c/d97/da1/fad x:0 0 0 2024-09-21T00:56:35.325 INFO:tasks.workunit.client.1.smithi187.stdout:1/520: link d4/d6/d23/d6f/f96 d4/d6/fa9 0 2024-09-21T00:56:35.326 INFO:tasks.workunit.client.1.smithi187.stdout:1/521: stat d4/d6/d23/d2e/d94/d35/d22/d2c/f30 0 2024-09-21T00:56:35.327 INFO:tasks.workunit.client.1.smithi187.stdout:9/588: sync 2024-09-21T00:56:35.329 INFO:tasks.workunit.client.1.smithi187.stdout:1/522: creat d4/faa x:0 0 0 2024-09-21T00:56:35.329 INFO:tasks.workunit.client.1.smithi187.stdout:2/475: dwrite d2/dc/f67 [0,4194304] 0 2024-09-21T00:56:35.330 INFO:tasks.workunit.client.1.smithi187.stdout:1/523: dread - d4/d6/d23/d2e/d94/d6c/fa4 zero size 2024-09-21T00:56:35.338 INFO:tasks.workunit.client.1.smithi187.stdout:9/589: dwrite d4/d10/d43/f76 [0,4194304] 0 2024-09-21T00:56:35.338 INFO:tasks.workunit.client.1.smithi187.stdout:2/476: dwrite d2/da8/fa0 [0,4194304] 0 2024-09-21T00:56:35.339 INFO:tasks.workunit.client.1.smithi187.stdout:9/590: chown d4/d13/d14/d28/c5a 177198 1 2024-09-21T00:56:35.340 INFO:tasks.workunit.client.1.smithi187.stdout:2/477: stat d2/da8/d1c/d2d/d8f 0 2024-09-21T00:56:35.342 INFO:tasks.workunit.client.1.smithi187.stdout:2/478: creat d2/dc/d2e/fae x:0 0 0 2024-09-21T00:56:35.343 INFO:tasks.workunit.client.1.smithi187.stdout:9/591: creat d4/d13/d14/d5d/fbe x:0 0 0 2024-09-21T00:56:35.347 INFO:tasks.workunit.client.1.smithi187.stdout:9/592: rmdir d4/d61/d6a 39 2024-09-21T00:56:35.352 INFO:tasks.workunit.client.1.smithi187.stdout:1/524: dread d4/d6/d23/f2b [0,4194304] 0 2024-09-21T00:56:35.352 INFO:tasks.workunit.client.1.smithi187.stdout:2/479: getdents d2/dc/d2e/d4a/d7c 0 2024-09-21T00:56:35.355 INFO:tasks.workunit.client.1.smithi187.stdout:1/525: write d4/d6/d23/f3d [2887181,38639] 0 2024-09-21T00:56:35.355 INFO:tasks.workunit.client.1.smithi187.stdout:2/480: write d2/dc/d2e/d4a/fa5 [152566,34105] 0 2024-09-21T00:56:35.357 INFO:tasks.workunit.client.1.smithi187.stdout:9/593: dwrite d4/d10/fac [0,4194304] 0 2024-09-21T00:56:35.358 INFO:tasks.workunit.client.1.smithi187.stdout:2/481: read d2/dc/d2e/d4a/f4d [884177,83534] 0 2024-09-21T00:56:35.359 INFO:tasks.workunit.client.1.smithi187.stdout:2/482: dread - d2/f78 zero size 2024-09-21T00:56:35.367 INFO:tasks.workunit.client.1.smithi187.stdout:1/526: dwrite d4/d6/d49/fa8 [0,4194304] 0 2024-09-21T00:56:35.373 INFO:tasks.workunit.client.1.smithi187.stdout:2/483: dwrite d2/dc/d2e/d4a/d7c/d52/f64 [0,4194304] 0 2024-09-21T00:56:35.373 INFO:tasks.workunit.client.1.smithi187.stdout:1/527: write d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [449507,44785] 0 2024-09-21T00:56:35.378 INFO:tasks.workunit.client.1.smithi187.stdout:9/594: dwrite d4/d8/fb [0,4194304] 0 2024-09-21T00:56:35.379 INFO:tasks.workunit.client.1.smithi187.stdout:9/595: dread - d4/d10/d39/fb3 zero size 2024-09-21T00:56:35.382 INFO:tasks.workunit.client.1.smithi187.stdout:9/596: mkdir d4/d13/d20/d2b/dbf 0 2024-09-21T00:56:35.384 INFO:tasks.workunit.client.1.smithi187.stdout:9/597: write d4/d13/fb8 [802573,95593] 0 2024-09-21T00:56:35.385 INFO:tasks.workunit.client.1.smithi187.stdout:1/528: dread d4/d6/d23/d6f/f96 [0,4194304] 0 2024-09-21T00:56:35.386 INFO:tasks.workunit.client.1.smithi187.stdout:9/598: mkdir d4/d8/d46/dc0 0 2024-09-21T00:56:35.387 INFO:tasks.workunit.client.1.smithi187.stdout:1/529: mknod d4/d6/d64/cab 0 2024-09-21T00:56:35.387 INFO:tasks.workunit.client.1.smithi187.stdout:1/530: stat d4/d6/d23/f3d 0 2024-09-21T00:56:35.388 INFO:tasks.workunit.client.1.smithi187.stdout:9/599: creat d4/d13/d20/d2b/d66/fc1 x:0 0 0 2024-09-21T00:56:35.391 INFO:tasks.workunit.client.1.smithi187.stdout:9/600: creat d4/d13/d14/fc2 x:0 0 0 2024-09-21T00:56:35.392 INFO:tasks.workunit.client.1.smithi187.stdout:1/531: dread d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [0,4194304] 0 2024-09-21T00:56:35.392 INFO:tasks.workunit.client.1.smithi187.stdout:9/601: creat d4/d10/fc3 x:0 0 0 2024-09-21T00:56:35.394 INFO:tasks.workunit.client.1.smithi187.stdout:9/602: truncate d4/d13/d14/d5d/fa2 788791 0 2024-09-21T00:56:35.395 INFO:tasks.workunit.client.1.smithi187.stdout:1/532: mkdir d4/d6/d23/d2e/d94/d35/d22/dac 0 2024-09-21T00:56:35.396 INFO:tasks.workunit.client.1.smithi187.stdout:1/533: symlink d4/d6/d49/lad 0 2024-09-21T00:56:35.400 INFO:tasks.workunit.client.1.smithi187.stdout:1/534: truncate d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 4593492 0 2024-09-21T00:56:35.400 INFO:tasks.workunit.client.1.smithi187.stdout:9/603: dwrite d4/d13/d20/d2b/d94/fae [0,4194304] 0 2024-09-21T00:56:35.401 INFO:tasks.workunit.client.1.smithi187.stdout:1/535: read d4/d6/d23/f2b [508142,40659] 0 2024-09-21T00:56:35.401 INFO:tasks.workunit.client.1.smithi187.stdout:9/604: read d4/d10/f23 [8253252,22739] 0 2024-09-21T00:56:35.407 INFO:tasks.workunit.client.1.smithi187.stdout:9/605: rmdir d4/d8/d46/dc0 0 2024-09-21T00:56:35.408 INFO:tasks.workunit.client.1.smithi187.stdout:9/606: chown d4 36 1 2024-09-21T00:56:35.408 INFO:tasks.workunit.client.1.smithi187.stdout:1/536: write d4/d6/d23/d2e/d94/d35/f6e [1830407,45312] 0 2024-09-21T00:56:35.409 INFO:tasks.workunit.client.1.smithi187.stdout:9/607: chown d4/d13/d20/d2b/d66/f7d 6972880 1 2024-09-21T00:56:35.410 INFO:tasks.workunit.client.1.smithi187.stdout:1/537: fsync d4/d6/d23/d2e/d94/d35/d22/d65/f9d 0 2024-09-21T00:56:35.411 INFO:tasks.workunit.client.1.smithi187.stdout:1/538: readlink d4/d6/d23/d2e/d94/l4f 0 2024-09-21T00:56:35.411 INFO:tasks.workunit.client.1.smithi187.stdout:9/608: symlink d4/d61/d6a/lc4 0 2024-09-21T00:56:35.412 INFO:tasks.workunit.client.1.smithi187.stdout:1/539: readlink d4/d6/d23/d2e/d94/d35/d4c/d5b/l81 0 2024-09-21T00:56:35.413 INFO:tasks.workunit.client.1.smithi187.stdout:1/540: write d4/d6/f48 [2128923,86785] 0 2024-09-21T00:56:35.418 INFO:tasks.workunit.client.1.smithi187.stdout:1/541: dwrite d4/d6/d49/fa8 [0,4194304] 0 2024-09-21T00:56:35.418 INFO:tasks.workunit.client.1.smithi187.stdout:9/609: truncate d4/d13/d20/d2b/f7b 1688215 0 2024-09-21T00:56:35.419 INFO:tasks.workunit.client.1.smithi187.stdout:9/610: chown d4/d61/d6c/fbd 0 1 2024-09-21T00:56:35.422 INFO:tasks.workunit.client.1.smithi187.stdout:9/611: chown d4/d61/d6a/d90/ca8 1 1 2024-09-21T00:56:35.426 INFO:tasks.workunit.client.1.smithi187.stdout:1/542: truncate d4/d6/d23/f2b 501895 0 2024-09-21T00:56:35.426 INFO:tasks.workunit.client.1.smithi187.stdout:9/612: dread d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:35.427 INFO:tasks.workunit.client.1.smithi187.stdout:9/613: readlink d4/d13/d20/d2b/d66/l9c 0 2024-09-21T00:56:35.428 INFO:tasks.workunit.client.1.smithi187.stdout:1/543: mkdir d4/d6/d23/d2e/d94/dae 0 2024-09-21T00:56:35.429 INFO:tasks.workunit.client.1.smithi187.stdout:9/614: creat d4/d10/fc5 x:0 0 0 2024-09-21T00:56:35.429 INFO:tasks.workunit.client.1.smithi187.stdout:1/544: fdatasync d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 0 2024-09-21T00:56:35.430 INFO:tasks.workunit.client.1.smithi187.stdout:9/615: chown d4/d10/c45 5 1 2024-09-21T00:56:35.433 INFO:tasks.workunit.client.1.smithi187.stdout:1/545: creat d4/d6/d23/d2e/d53/d6a/faf x:0 0 0 2024-09-21T00:56:35.436 INFO:tasks.workunit.client.1.smithi187.stdout:9/616: dwrite d4/d8/fb [4194304,4194304] 0 2024-09-21T00:56:35.436 INFO:tasks.workunit.client.1.smithi187.stdout:1/546: write d4/d6/d23/d2e/d94/d35/f82 [102552,63307] 0 2024-09-21T00:56:35.439 INFO:tasks.workunit.client.1.smithi187.stdout:6/456: sync 2024-09-21T00:56:35.439 INFO:tasks.workunit.client.1.smithi187.stdout:4/442: sync 2024-09-21T00:56:35.439 INFO:tasks.workunit.client.1.smithi187.stdout:8/514: sync 2024-09-21T00:56:35.439 INFO:tasks.workunit.client.1.smithi187.stdout:7/389: sync 2024-09-21T00:56:35.439 INFO:tasks.workunit.client.1.smithi187.stdout:5/425: sync 2024-09-21T00:56:35.439 INFO:tasks.workunit.client.1.smithi187.stdout:9/617: creat d4/d13/d14/d1d/d5f/fc6 x:0 0 0 2024-09-21T00:56:35.441 INFO:tasks.workunit.client.1.smithi187.stdout:6/457: chown d7/d59/f1d 31132 1 2024-09-21T00:56:35.442 INFO:tasks.workunit.client.1.smithi187.stdout:7/390: mknod d1/d55/c8e 0 2024-09-21T00:56:35.442 INFO:tasks.workunit.client.1.smithi187.stdout:4/443: chown d2/d3/da/fc 768192 1 2024-09-21T00:56:35.442 INFO:tasks.workunit.client.1.smithi187.stdout:1/547: mkdir d4/d6/d23/d2e/d94/d35/d4c/d5b/db0 0 2024-09-21T00:56:35.443 INFO:tasks.workunit.client.1.smithi187.stdout:8/515: unlink dc/d2f/d34/d4b/f97 0 2024-09-21T00:56:35.444 INFO:tasks.workunit.client.1.smithi187.stdout:6/458: write d7/d2a/d29/f43 [10338,34227] 0 2024-09-21T00:56:35.444 INFO:tasks.workunit.client.1.smithi187.stdout:5/426: stat d0/dc/d39/d46/d67/d14/l63 0 2024-09-21T00:56:35.446 INFO:tasks.workunit.client.1.smithi187.stdout:7/391: fdatasync d1/dc/d15/d22/f79 0 2024-09-21T00:56:35.447 INFO:tasks.workunit.client.1.smithi187.stdout:1/548: write d4/d6/d23/d2e/d94/d35/d4c/fa7 [282671,112931] 0 2024-09-21T00:56:35.447 INFO:tasks.workunit.client.1.smithi187.stdout:6/459: write d7/d59/f4c [603612,53720] 0 2024-09-21T00:56:35.448 INFO:tasks.workunit.client.1.smithi187.stdout:8/516: symlink dc/d2f/d54/laa 0 2024-09-21T00:56:35.448 INFO:tasks.workunit.client.1.smithi187.stdout:7/392: chown d1/d55/l65 236482024 1 2024-09-21T00:56:35.449 INFO:tasks.workunit.client.1.smithi187.stdout:6/460: chown d7/d59/f1d 1736437 1 2024-09-21T00:56:35.450 INFO:tasks.workunit.client.1.smithi187.stdout:4/444: link d2/d3/da/f1f d2/d3/da/d2f/d32/f8a 0 2024-09-21T00:56:35.451 INFO:tasks.workunit.client.1.smithi187.stdout:7/393: chown d1/d18/d31/d33/d3b/d62/c78 90977480 1 2024-09-21T00:56:35.451 INFO:tasks.workunit.client.1.smithi187.stdout:5/427: creat d0/dc/d39/d46/d67/d30/d6b/d8e/f95 x:0 0 0 2024-09-21T00:56:35.454 INFO:tasks.workunit.client.1.smithi187.stdout:8/517: write dc/f26 [734590,30398] 0 2024-09-21T00:56:35.454 INFO:tasks.workunit.client.1.smithi187.stdout:1/549: dread d4/d6/f48 [0,4194304] 0 2024-09-21T00:56:35.458 INFO:tasks.workunit.client.1.smithi187.stdout:1/550: chown d4/d6/d23/d2e/d94/d35/d4c/f4d 534379341 1 2024-09-21T00:56:35.460 INFO:tasks.workunit.client.1.smithi187.stdout:1/551: stat d4/d6/d23/d2e/d94/d35/d22/d65/d90 0 2024-09-21T00:56:35.461 INFO:tasks.workunit.client.1.smithi187.stdout:7/394: fsync d1/d18/d31/d5a/d5d/f6c 0 2024-09-21T00:56:35.462 INFO:tasks.workunit.client.1.smithi187.stdout:5/428: dwrite d0/dc/d39/d46/d67/f32 [0,4194304] 0 2024-09-21T00:56:35.462 INFO:tasks.workunit.client.1.smithi187.stdout:6/461: getdents d7/d2a/d7a 0 2024-09-21T00:56:35.465 INFO:tasks.workunit.client.1.smithi187.stdout:9/618: dread d4/d61/d6a/f9e [0,4194304] 0 2024-09-21T00:56:35.465 INFO:tasks.workunit.client.1.smithi187.stdout:7/395: rmdir d1/d18/d31/d41/d64 39 2024-09-21T00:56:35.466 INFO:tasks.workunit.client.1.smithi187.stdout:2/484: sync 2024-09-21T00:56:35.466 INFO:tasks.workunit.client.1.smithi187.stdout:0/403: sync 2024-09-21T00:56:35.466 INFO:tasks.workunit.client.1.smithi187.stdout:3/411: sync 2024-09-21T00:56:35.467 INFO:tasks.workunit.client.1.smithi187.stdout:5/429: mknod d0/dc/d39/d46/c96 0 2024-09-21T00:56:35.467 INFO:tasks.workunit.client.1.smithi187.stdout:7/396: chown d1/f14 165156 1 2024-09-21T00:56:35.469 INFO:tasks.workunit.client.1.smithi187.stdout:0/404: chown d0/d17/d1c/l6d 50425811 1 2024-09-21T00:56:35.470 INFO:tasks.workunit.client.1.smithi187.stdout:7/397: stat d1/dc/d15/l20 0 2024-09-21T00:56:35.470 INFO:tasks.workunit.client.1.smithi187.stdout:6/462: creat d7/d2a/d29/d40/d6a/d88/f9c x:0 0 0 2024-09-21T00:56:35.471 INFO:tasks.workunit.client.1.smithi187.stdout:9/619: mknod d4/d8/d44/cc7 0 2024-09-21T00:56:35.472 INFO:tasks.workunit.client.1.smithi187.stdout:8/518: dread dc/d44/f55 [0,4194304] 0 2024-09-21T00:56:35.472 INFO:tasks.workunit.client.1.smithi187.stdout:2/485: symlink d2/da8/d9d/laf 0 2024-09-21T00:56:35.475 INFO:tasks.workunit.client.1.smithi187.stdout:0/405: creat d0/d5a/f89 x:0 0 0 2024-09-21T00:56:35.476 INFO:tasks.workunit.client.1.smithi187.stdout:3/412: creat d9/d19/d42/d53/d56/d7d/d81/f84 x:0 0 0 2024-09-21T00:56:35.476 INFO:tasks.workunit.client.1.smithi187.stdout:5/430: symlink d0/dc/d39/d46/d67/d14/d38/d5a/d6c/l97 0 2024-09-21T00:56:35.476 INFO:tasks.workunit.client.1.smithi187.stdout:7/398: read - d1/d18/d31/d33/d3b/f4a zero size 2024-09-21T00:56:35.477 INFO:tasks.workunit.client.1.smithi187.stdout:9/620: read - d4/d10/d39/d69/fb7 zero size 2024-09-21T00:56:35.477 INFO:tasks.workunit.client.1.smithi187.stdout:8/519: write dc/f10 [1068603,128644] 0 2024-09-21T00:56:35.477 INFO:tasks.workunit.client.1.smithi187.stdout:1/552: dwrite d4/d6/d23/d2e/d94/d35/d22/f57 [0,4194304] 0 2024-09-21T00:56:35.478 INFO:tasks.workunit.client.1.smithi187.stdout:6/463: dread - d7/d2a/d29/d40/d6a/f70 zero size 2024-09-21T00:56:35.480 INFO:tasks.workunit.client.1.smithi187.stdout:4/445: dwrite d2/d3/da/d16/f3c [0,4194304] 0 2024-09-21T00:56:35.486 INFO:tasks.workunit.client.1.smithi187.stdout:9/621: chown d4/d13/d14/d83/ca7 747419 1 2024-09-21T00:56:35.487 INFO:tasks.workunit.client.1.smithi187.stdout:2/486: rename d2/dc/d2e/d4a/d7c/d88 to d2/da8/d6c/d97/db0 0 2024-09-21T00:56:35.491 INFO:tasks.workunit.client.1.smithi187.stdout:4/446: read - d2/d3/da/d2f/f83 zero size 2024-09-21T00:56:35.493 INFO:tasks.workunit.client.1.smithi187.stdout:6/464: dread d7/d2a/d29/d40/f4b [0,4194304] 0 2024-09-21T00:56:35.493 INFO:tasks.workunit.client.1.smithi187.stdout:7/399: mkdir d1/dc/d15/d22/d3e/d73/d8b/d8f 0 2024-09-21T00:56:35.495 INFO:tasks.workunit.client.1.smithi187.stdout:9/622: chown d4/d8/d44/cb1 63 1 2024-09-21T00:56:35.497 INFO:tasks.workunit.client.1.smithi187.stdout:2/487: creat d2/d3/d15/fb1 x:0 0 0 2024-09-21T00:56:35.499 INFO:tasks.workunit.client.1.smithi187.stdout:8/520: dread dc/f10 [0,4194304] 0 2024-09-21T00:56:35.502 INFO:tasks.workunit.client.1.smithi187.stdout:3/413: dwrite d9/d19/d1c/f47 [0,4194304] 0 2024-09-21T00:56:35.505 INFO:tasks.workunit.client.1.smithi187.stdout:9/623: mknod d4/d8/d46/cc8 0 2024-09-21T00:56:35.507 INFO:tasks.workunit.client.1.smithi187.stdout:0/406: dwrite d0/d17/d1c/d23/df/d41/d3b/f6c [0,4194304] 0 2024-09-21T00:56:35.509 INFO:tasks.workunit.client.1.smithi187.stdout:7/400: rename d1/d55/c8e to d1/d55/c90 0 2024-09-21T00:56:35.510 INFO:tasks.workunit.client.1.smithi187.stdout:0/407: fsync d0/f16 0 2024-09-21T00:56:35.511 INFO:tasks.workunit.client.1.smithi187.stdout:1/553: dwrite d4/d6/d23/d2e/d94/d35/d79/f88 [0,4194304] 0 2024-09-21T00:56:35.516 INFO:tasks.workunit.client.1.smithi187.stdout:3/414: rmdir d9/d19/d42/d53/d56/d7d/d81 39 2024-09-21T00:56:35.516 INFO:tasks.workunit.client.1.smithi187.stdout:8/521: chown dc/d2f/d34/d4b/d85/l96 1394102 1 2024-09-21T00:56:35.517 INFO:tasks.workunit.client.1.smithi187.stdout:2/488: dread d2/d25/f43 [0,4194304] 0 2024-09-21T00:56:35.519 INFO:tasks.workunit.client.1.smithi187.stdout:4/447: dread d2/d3/da/d2f/d32/d22/d37/d51/f81 [0,4194304] 0 2024-09-21T00:56:35.522 INFO:tasks.workunit.client.1.smithi187.stdout:3/415: creat d9/d7f/f85 x:0 0 0 2024-09-21T00:56:35.523 INFO:tasks.workunit.client.1.smithi187.stdout:3/416: stat f3 0 2024-09-21T00:56:35.523 INFO:tasks.workunit.client.1.smithi187.stdout:2/489: creat d2/da8/fb2 x:0 0 0 2024-09-21T00:56:35.524 INFO:tasks.workunit.client.1.smithi187.stdout:1/554: rmdir d4/d6/d23/d2e/d94/d35/d4c/d5b/d83 39 2024-09-21T00:56:35.527 INFO:tasks.workunit.client.1.smithi187.stdout:9/624: dwrite d4/d13/d14/d28/fa5 [0,4194304] 0 2024-09-21T00:56:35.529 INFO:tasks.workunit.client.1.smithi187.stdout:7/401: dread d1/dc/d15/d22/d3e/f71 [0,4194304] 0 2024-09-21T00:56:35.529 INFO:tasks.workunit.client.1.smithi187.stdout:2/490: write d2/da8/d6c/d97/db0/fa9 [741792,47551] 0 2024-09-21T00:56:35.531 INFO:tasks.workunit.client.1.smithi187.stdout:4/448: symlink d2/d3/da/d2f/l8b 0 2024-09-21T00:56:35.532 INFO:tasks.workunit.client.1.smithi187.stdout:9/625: dread - d4/d13/d14/d1d/d5f/fc6 zero size 2024-09-21T00:56:35.533 INFO:tasks.workunit.client.1.smithi187.stdout:0/408: getdents d0/d17/d1c/d23/df/d41 0 2024-09-21T00:56:35.533 INFO:tasks.workunit.client.1.smithi187.stdout:6/465: dread d7/d59/f8b [0,4194304] 0 2024-09-21T00:56:35.536 INFO:tasks.workunit.client.1.smithi187.stdout:2/491: write d2/f7 [1629524,33906] 0 2024-09-21T00:56:35.541 INFO:tasks.workunit.client.1.smithi187.stdout:0/409: rename d0/d60/d6b/f6f to d0/d17/d18/f8a 0 2024-09-21T00:56:35.541 INFO:tasks.workunit.client.1.smithi187.stdout:7/402: dwrite d1/dc/d15/d2b/f61 [0,4194304] 0 2024-09-21T00:56:35.542 INFO:tasks.workunit.client.1.smithi187.stdout:4/449: symlink d2/d3/da/d2f/d32/d22/d4f/d89/l8c 0 2024-09-21T00:56:35.544 INFO:tasks.workunit.client.1.smithi187.stdout:6/466: creat d7/d2a/f9d x:0 0 0 2024-09-21T00:56:35.544 INFO:tasks.workunit.client.1.smithi187.stdout:4/450: chown d2/d3/d56/d84/d60/d6c/l88 7 1 2024-09-21T00:56:35.546 INFO:tasks.workunit.client.1.smithi187.stdout:0/410: rename d0/d17/d18/d3a/l67 to d0/d5a/l8b 0 2024-09-21T00:56:35.549 INFO:tasks.workunit.client.1.smithi187.stdout:8/522: truncate dc/d1c/d3e/d75/f8b 855259 0 2024-09-21T00:56:35.549 INFO:tasks.workunit.client.1.smithi187.stdout:6/467: write d7/d2a/d29/d40/d45/f69 [1717807,128035] 0 2024-09-21T00:56:35.550 INFO:tasks.workunit.client.1.smithi187.stdout:3/417: truncate d9/d13/f1e 3573326 0 2024-09-21T00:56:35.550 INFO:tasks.workunit.client.1.smithi187.stdout:0/411: fsync d0/d17/f2e 0 2024-09-21T00:56:35.553 INFO:tasks.workunit.client.1.smithi187.stdout:3/418: truncate d9/d7f/f85 667338 0 2024-09-21T00:56:35.554 INFO:tasks.workunit.client.1.smithi187.stdout:3/419: chown d9/d13/f15 34816 1 2024-09-21T00:56:35.555 INFO:tasks.workunit.client.1.smithi187.stdout:6/468: mkdir d7/d2a/d29/d40/d6a/d9e 0 2024-09-21T00:56:35.556 INFO:tasks.workunit.client.1.smithi187.stdout:2/492: truncate d2/dc/d2e/d4a/d7c/f37 8594876 0 2024-09-21T00:56:35.559 INFO:tasks.workunit.client.1.smithi187.stdout:0/412: write d0/d17/d1c/d23/d36/f38 [80838,121993] 0 2024-09-21T00:56:35.560 INFO:tasks.workunit.client.1.smithi187.stdout:6/469: truncate d7/d2a/d29/d40/d50/f81 804545 0 2024-09-21T00:56:35.563 INFO:tasks.workunit.client.1.smithi187.stdout:2/493: symlink d2/da8/d3f/lb3 0 2024-09-21T00:56:35.564 INFO:tasks.workunit.client.1.smithi187.stdout:2/494: readlink d2/da8/d9d/laf 0 2024-09-21T00:56:35.565 INFO:tasks.workunit.client.1.smithi187.stdout:9/626: dread d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:35.567 INFO:tasks.workunit.client.1.smithi187.stdout:8/523: link dc/d1c/d29/la9 dc/d2f/d34/d4b/lab 0 2024-09-21T00:56:35.568 INFO:tasks.workunit.client.1.smithi187.stdout:1/555: dread d4/d6/d23/d2e/d94/d35/d4c/d5b/d83/f84 [0,4194304] 0 2024-09-21T00:56:35.568 INFO:tasks.workunit.client.1.smithi187.stdout:4/451: dread d2/d3/da/d2f/d32/d24/f45 [0,4194304] 0 2024-09-21T00:56:35.569 INFO:tasks.workunit.client.1.smithi187.stdout:3/420: rename d9/d19/d1c/f38 to d9/d19/d42/d53/d56/d7d/f86 0 2024-09-21T00:56:35.570 INFO:tasks.workunit.client.1.smithi187.stdout:3/421: fsync d9/d19/d1c/f66 0 2024-09-21T00:56:35.572 INFO:tasks.workunit.client.1.smithi187.stdout:0/413: write d0/d17/d18/d3a/f77 [317048,34655] 0 2024-09-21T00:56:35.572 INFO:tasks.workunit.client.1.smithi187.stdout:1/556: truncate d4/d6/d23/d2e/d94/d35/d22/d65/fa3 934893 0 2024-09-21T00:56:35.572 INFO:tasks.workunit.client.1.smithi187.stdout:8/524: creat dc/d94/fac x:0 0 0 2024-09-21T00:56:35.574 INFO:tasks.workunit.client.1.smithi187.stdout:2/495: rename d2/dc/d2e/d4a/fa5 to d2/da8/d1c/d2d/d8f/fb4 0 2024-09-21T00:56:35.575 INFO:tasks.workunit.client.1.smithi187.stdout:6/470: creat d7/f9f x:0 0 0 2024-09-21T00:56:35.576 INFO:tasks.workunit.client.1.smithi187.stdout:0/414: write d0/d17/d1c/d23/df/f69 [798927,122642] 0 2024-09-21T00:56:35.576 INFO:tasks.workunit.client.1.smithi187.stdout:4/452: creat d2/d3/da/d2f/d32/d22/d37/d3a/f8d x:0 0 0 2024-09-21T00:56:35.577 INFO:tasks.workunit.client.1.smithi187.stdout:1/557: chown d4/d6/d23/d2e/d94/d35/d4c/f4d 2005642457 1 2024-09-21T00:56:35.579 INFO:tasks.workunit.client.1.smithi187.stdout:1/558: chown d4/d6/fa9 209439628 1 2024-09-21T00:56:35.580 INFO:tasks.workunit.client.1.smithi187.stdout:9/627: dwrite d4/d61/d6c/fab [4194304,4194304] 0 2024-09-21T00:56:35.580 INFO:tasks.workunit.client.1.smithi187.stdout:6/471: write d7/d2a/f28 [631463,6809] 0 2024-09-21T00:56:35.580 INFO:tasks.workunit.client.1.smithi187.stdout:4/453: chown d2/d3/da/d2f/d4b/d7e/c59 906 1 2024-09-21T00:56:35.582 INFO:tasks.workunit.client.1.smithi187.stdout:1/559: chown d4/f76 1396 1 2024-09-21T00:56:35.583 INFO:tasks.workunit.client.1.smithi187.stdout:9/628: chown d4/d13/d20/d2b/d66/l9c 1510728 1 2024-09-21T00:56:35.583 INFO:tasks.workunit.client.1.smithi187.stdout:3/422: fsync d9/d13/f1e 0 2024-09-21T00:56:35.588 INFO:tasks.workunit.client.1.smithi187.stdout:1/560: chown d4/d6/d23/l4a 225 1 2024-09-21T00:56:35.589 INFO:tasks.workunit.client.1.smithi187.stdout:6/472: mknod d7/d2a/d29/d40/ca0 0 2024-09-21T00:56:35.590 INFO:tasks.workunit.client.1.smithi187.stdout:8/525: truncate dc/d2f/d34/f3a 944431 0 2024-09-21T00:56:35.592 INFO:tasks.workunit.client.1.smithi187.stdout:4/454: creat d2/d3/da/d2f/d32/d26/d66/d6e/f8e x:0 0 0 2024-09-21T00:56:35.593 INFO:tasks.workunit.client.1.smithi187.stdout:3/423: fdatasync d9/d19/d1c/f31 0 2024-09-21T00:56:35.593 INFO:tasks.workunit.client.1.smithi187.stdout:2/496: link d2/c4 d2/dc/d2e/d4a/d7c/cb5 0 2024-09-21T00:56:35.595 INFO:tasks.workunit.client.1.smithi187.stdout:2/497: chown d2/da8/d1c/d2d/d8f 2967 1 2024-09-21T00:56:35.597 INFO:tasks.workunit.client.1.smithi187.stdout:6/473: dwrite d7/d2a/d29/f3f [0,4194304] 0 2024-09-21T00:56:35.599 INFO:tasks.workunit.client.1.smithi187.stdout:3/424: dread d9/d19/d1c/f47 [0,4194304] 0 2024-09-21T00:56:35.599 INFO:tasks.workunit.client.1.smithi187.stdout:8/526: creat dc/d1c/d29/d9f/fad x:0 0 0 2024-09-21T00:56:35.600 INFO:tasks.workunit.client.1.smithi187.stdout:9/629: truncate d4/d8/d44/d6e/d92/f97 131006 0 2024-09-21T00:56:35.601 INFO:tasks.workunit.client.1.smithi187.stdout:1/561: link d4/d6/d23/d6f/f96 d4/d75/fb1 0 2024-09-21T00:56:35.603 INFO:tasks.workunit.client.1.smithi187.stdout:0/415: truncate d0/d17/d1c/d23/f19 896600 0 2024-09-21T00:56:35.604 INFO:tasks.workunit.client.1.smithi187.stdout:2/498: creat d2/da8/d6c/fb6 x:0 0 0 2024-09-21T00:56:35.605 INFO:tasks.workunit.client.1.smithi187.stdout:2/499: fdatasync d2/da8/fa0 0 2024-09-21T00:56:35.607 INFO:tasks.workunit.client.1.smithi187.stdout:8/527: creat dc/d1c/d3e/fae x:0 0 0 2024-09-21T00:56:35.607 INFO:tasks.workunit.client.1.smithi187.stdout:6/474: dread d7/d2a/d7a/f7e [0,4194304] 0 2024-09-21T00:56:35.609 INFO:tasks.workunit.client.1.smithi187.stdout:1/562: creat d4/d6/d23/fb2 x:0 0 0 2024-09-21T00:56:35.610 INFO:tasks.workunit.client.1.smithi187.stdout:4/455: rmdir d2/d3/d74/d7c 0 2024-09-21T00:56:35.611 INFO:tasks.workunit.client.1.smithi187.stdout:0/416: dwrite d0/d17/d1c/d23/df/d51/f2f [0,4194304] 0 2024-09-21T00:56:35.614 INFO:tasks.workunit.client.1.smithi187.stdout:5/431: sync 2024-09-21T00:56:35.616 INFO:tasks.workunit.client.1.smithi187.stdout:2/500: rmdir d2/d25 39 2024-09-21T00:56:35.616 INFO:tasks.workunit.client.1.smithi187.stdout:1/563: dwrite d4/d6/d49/fa8 [0,4194304] 0 2024-09-21T00:56:35.616 INFO:tasks.workunit.client.1.smithi187.stdout:3/425: mkdir d9/d13/d87 0 2024-09-21T00:56:35.617 INFO:tasks.workunit.client.1.smithi187.stdout:2/501: fsync d2/dc/d2e/d4a/d7c/f45 0 2024-09-21T00:56:35.619 INFO:tasks.workunit.client.1.smithi187.stdout:8/528: creat dc/d1c/d29/faf x:0 0 0 2024-09-21T00:56:35.621 INFO:tasks.workunit.client.1.smithi187.stdout:6/475: mkdir d7/d2a/d29/d40/d6a/da1 0 2024-09-21T00:56:35.622 INFO:tasks.workunit.client.1.smithi187.stdout:6/476: chown d7/d59/f1d 121974519 1 2024-09-21T00:56:35.623 INFO:tasks.workunit.client.1.smithi187.stdout:9/630: symlink d4/d13/d14/d28/db4/lc9 0 2024-09-21T00:56:35.624 INFO:tasks.workunit.client.1.smithi187.stdout:6/477: dread d7/d2a/d29/d40/d50/f73 [0,4194304] 0 2024-09-21T00:56:35.625 INFO:tasks.workunit.client.1.smithi187.stdout:0/417: creat d0/d17/f8c x:0 0 0 2024-09-21T00:56:35.626 INFO:tasks.workunit.client.1.smithi187.stdout:0/418: write d0/f63 [275824,68380] 0 2024-09-21T00:56:35.627 INFO:tasks.workunit.client.1.smithi187.stdout:5/432: write d0/dc/d1f/d26/f71 [5408610,69645] 0 2024-09-21T00:56:35.629 INFO:tasks.workunit.client.1.smithi187.stdout:2/502: creat d2/da8/d6c/d97/fb7 x:0 0 0 2024-09-21T00:56:35.635 INFO:tasks.workunit.client.1.smithi187.stdout:1/564: link d4/faa d4/d6/d64/fb3 0 2024-09-21T00:56:35.635 INFO:tasks.workunit.client.1.smithi187.stdout:5/433: dwrite d0/dc/d39/d46/d67/d30/f3c [0,4194304] 0 2024-09-21T00:56:35.635 INFO:tasks.workunit.client.1.smithi187.stdout:0/419: creat d0/d60/d6b/f8d x:0 0 0 2024-09-21T00:56:35.636 INFO:tasks.workunit.client.1.smithi187.stdout:0/420: stat d0 0 2024-09-21T00:56:35.637 INFO:tasks.workunit.client.1.smithi187.stdout:1/565: fsync d4/d6/d23/d2e/d94/d35/d79/f88 0 2024-09-21T00:56:35.637 INFO:tasks.workunit.client.1.smithi187.stdout:0/421: dread - d0/d17/d1c/f7a zero size 2024-09-21T00:56:35.637 INFO:tasks.workunit.client.1.smithi187.stdout:5/434: dread - d0/dc/d39/d46/d67/d30/d68/f8a zero size 2024-09-21T00:56:35.638 INFO:tasks.workunit.client.1.smithi187.stdout:8/529: truncate dc/d1c/d3e/d75/f8b 1351516 0 2024-09-21T00:56:35.638 INFO:tasks.workunit.client.1.smithi187.stdout:1/566: chown d4/d6/d64 3 1 2024-09-21T00:56:35.638 INFO:tasks.workunit.client.1.smithi187.stdout:0/422: fsync d0/f11 0 2024-09-21T00:56:35.640 INFO:tasks.workunit.client.1.smithi187.stdout:8/530: write dc/f47 [1711025,21014] 0 2024-09-21T00:56:35.642 INFO:tasks.workunit.client.1.smithi187.stdout:3/426: rename d9/d19/d1c/d5f/l72 to d9/d19/d42/d53/d56/d7d/l88 0 2024-09-21T00:56:35.647 INFO:tasks.workunit.client.1.smithi187.stdout:6/478: getdents d7/d2a/d29/d40/d45 0 2024-09-21T00:56:35.648 INFO:tasks.workunit.client.1.smithi187.stdout:5/435: dwrite d0/dc/d39/d46/d67/f50 [4194304,4194304] 0 2024-09-21T00:56:35.649 INFO:tasks.workunit.client.1.smithi187.stdout:0/423: dwrite d0/d17/d1c/d23/df/d41/d3b/f54 [0,4194304] 0 2024-09-21T00:56:35.649 INFO:tasks.workunit.client.1.smithi187.stdout:2/503: rename d2/da8/d3c to d2/da8/d6c/db8 0 2024-09-21T00:56:35.652 INFO:tasks.workunit.client.1.smithi187.stdout:9/631: fsync d4/d8/d44/d6e/d92/f97 0 2024-09-21T00:56:35.654 INFO:tasks.workunit.client.1.smithi187.stdout:5/436: fdatasync d0/dc/d39/d46/d67/d14/d38/d5a/f8d 0 2024-09-21T00:56:35.655 INFO:tasks.workunit.client.1.smithi187.stdout:3/427: mkdir d9/d19/d42/d89 0 2024-09-21T00:56:35.655 INFO:tasks.workunit.client.1.smithi187.stdout:0/424: truncate d0/d17/d1c/f71 1043615 0 2024-09-21T00:56:35.658 INFO:tasks.workunit.client.1.smithi187.stdout:0/425: dread - d0/d17/d18/d3a/f5e zero size 2024-09-21T00:56:35.660 INFO:tasks.workunit.client.1.smithi187.stdout:6/479: mkdir d7/d2a/da2 0 2024-09-21T00:56:35.660 INFO:tasks.workunit.client.1.smithi187.stdout:2/504: dwrite d2/dc/d6b/f96 [0,4194304] 0 2024-09-21T00:56:35.662 INFO:tasks.workunit.client.1.smithi187.stdout:6/480: truncate d7/d2a/d7a/f99 986182 0 2024-09-21T00:56:35.663 INFO:tasks.workunit.client.1.smithi187.stdout:2/505: dread d2/d3/df/f72 [0,4194304] 0 2024-09-21T00:56:35.663 INFO:tasks.workunit.client.1.smithi187.stdout:1/567: getdents d4/d6/d64 0 2024-09-21T00:56:35.664 INFO:tasks.workunit.client.1.smithi187.stdout:1/568: chown d4/d86 112955 1 2024-09-21T00:56:35.667 INFO:tasks.workunit.client.1.smithi187.stdout:5/437: mkdir d0/dc/d39/d46/d98 0 2024-09-21T00:56:35.672 INFO:tasks.workunit.client.1.smithi187.stdout:8/531: rename dc/d94/f98 to dc/fb0 0 2024-09-21T00:56:35.672 INFO:tasks.workunit.client.1.smithi187.stdout:8/532: dread - dc/d1c/d29/faf zero size 2024-09-21T00:56:35.672 INFO:tasks.workunit.client.1.smithi187.stdout:2/506: creat d2/da8/d3f/fb9 x:0 0 0 2024-09-21T00:56:35.673 INFO:tasks.workunit.client.1.smithi187.stdout:6/481: symlink d7/d2a/d29/d40/d6a/d88/la3 0 2024-09-21T00:56:35.673 INFO:tasks.workunit.client.1.smithi187.stdout:2/507: chown d2/da8/d6c 895 1 2024-09-21T00:56:35.674 INFO:tasks.workunit.client.1.smithi187.stdout:8/533: chown dc/d2f/d37/f66 7 1 2024-09-21T00:56:35.674 INFO:tasks.workunit.client.1.smithi187.stdout:1/569: mknod d4/d6/d23/d2e/d94/d66/cb4 0 2024-09-21T00:56:35.674 INFO:tasks.workunit.client.1.smithi187.stdout:9/632: creat d4/d13/fca x:0 0 0 2024-09-21T00:56:35.676 INFO:tasks.workunit.client.1.smithi187.stdout:3/428: creat d9/d19/d42/f8a x:0 0 0 2024-09-21T00:56:35.677 INFO:tasks.workunit.client.1.smithi187.stdout:1/570: dread d4/d6/d23/d2e/d94/d6c/f93 [0,4194304] 0 2024-09-21T00:56:35.677 INFO:tasks.workunit.client.1.smithi187.stdout:2/508: mkdir d2/dc/d2e/d4a/d7c/d52/dba 0 2024-09-21T00:56:35.679 INFO:tasks.workunit.client.1.smithi187.stdout:2/509: write d2/f7 [4217166,59118] 0 2024-09-21T00:56:35.679 INFO:tasks.workunit.client.1.smithi187.stdout:6/482: mkdir d7/da4 0 2024-09-21T00:56:35.681 INFO:tasks.workunit.client.1.smithi187.stdout:1/571: fsync d4/d6/d23/f2b 0 2024-09-21T00:56:35.682 INFO:tasks.workunit.client.1.smithi187.stdout:6/483: fdatasync d7/d2a/d29/d40/d50/f7b 0 2024-09-21T00:56:35.686 INFO:tasks.workunit.client.1.smithi187.stdout:3/429: dwrite f3 [0,4194304] 0 2024-09-21T00:56:35.688 INFO:tasks.workunit.client.1.smithi187.stdout:0/426: fsync d0/d17/d1c/d23/d36/f5c 0 2024-09-21T00:56:35.689 INFO:tasks.workunit.client.1.smithi187.stdout:6/484: dread d7/d2a/f5b [0,4194304] 0 2024-09-21T00:56:35.693 INFO:tasks.workunit.client.1.smithi187.stdout:7/403: sync 2024-09-21T00:56:35.695 INFO:tasks.workunit.client.1.smithi187.stdout:0/427: dread d0/f63 [0,4194304] 0 2024-09-21T00:56:35.695 INFO:tasks.workunit.client.1.smithi187.stdout:2/510: dwrite d2/dc/d2e/d4a/d7c/f79 [0,4194304] 0 2024-09-21T00:56:35.697 INFO:tasks.workunit.client.1.smithi187.stdout:1/572: write d4/d75/fb1 [646911,128344] 0 2024-09-21T00:56:35.699 INFO:tasks.workunit.client.1.smithi187.stdout:6/485: rmdir d7/da4 0 2024-09-21T00:56:35.700 INFO:tasks.workunit.client.1.smithi187.stdout:5/438: dread d0/dc/d1f/d26/f53 [0,4194304] 0 2024-09-21T00:56:35.701 INFO:tasks.workunit.client.1.smithi187.stdout:7/404: symlink d1/dc/d15/d22/d3e/d7c/l91 0 2024-09-21T00:56:35.703 INFO:tasks.workunit.client.1.smithi187.stdout:9/633: dread d4/d61/f68 [0,4194304] 0 2024-09-21T00:56:35.703 INFO:tasks.workunit.client.1.smithi187.stdout:6/486: chown d7/d2a/d29/d40/d45 4659 1 2024-09-21T00:56:35.705 INFO:tasks.workunit.client.1.smithi187.stdout:2/511: getdents d2/da8/d1c/d2d 0 2024-09-21T00:56:35.706 INFO:tasks.workunit.client.1.smithi187.stdout:3/430: dwrite d9/d13/f1e [0,4194304] 0 2024-09-21T00:56:35.708 INFO:tasks.workunit.client.1.smithi187.stdout:5/439: mkdir d0/dc/d39/d46/d67/d14/d38/d5a/d99 0 2024-09-21T00:56:35.710 INFO:tasks.workunit.client.1.smithi187.stdout:8/534: dread dc/d1c/f33 [0,4194304] 0 2024-09-21T00:56:35.710 INFO:tasks.workunit.client.1.smithi187.stdout:5/440: chown d0/dc/d39/d46/d67 6 1 2024-09-21T00:56:35.711 INFO:tasks.workunit.client.1.smithi187.stdout:2/512: truncate d2/dc/f65 1596789 0 2024-09-21T00:56:35.711 INFO:tasks.workunit.client.1.smithi187.stdout:0/428: link d0/d17/d1c/d23/df/f15 d0/d17/d1c/d23/df/d41/f8e 0 2024-09-21T00:56:35.712 INFO:tasks.workunit.client.1.smithi187.stdout:1/573: fdatasync d4/d75/fb1 0 2024-09-21T00:56:35.713 INFO:tasks.workunit.client.1.smithi187.stdout:5/441: chown d0/c84 18 1 2024-09-21T00:56:35.716 INFO:tasks.workunit.client.1.smithi187.stdout:1/574: readlink d4/d6/d23/d2e/d94/d35/d22/d2c/d9f/la6 0 2024-09-21T00:56:35.716 INFO:tasks.workunit.client.1.smithi187.stdout:6/487: dwrite d7/f22 [0,4194304] 0 2024-09-21T00:56:35.750 INFO:tasks.workunit.client.1.smithi187.stdout:3/431: unlink d9/d19/d42/d53/f59 0 2024-09-21T00:56:35.750 INFO:tasks.workunit.client.1.smithi187.stdout:8/535: rmdir dc/d1c 39 2024-09-21T00:56:35.751 INFO:tasks.workunit.client.1.smithi187.stdout:0/429: mknod d0/d60/d6b/c8f 0 2024-09-21T00:56:35.752 INFO:tasks.workunit.client.1.smithi187.stdout:2/513: rename d2/da8/f80 to d2/dc/d2e/fbb 0 2024-09-21T00:56:35.753 INFO:tasks.workunit.client.1.smithi187.stdout:7/405: link d1/d18/d31/d41/c82 d1/dc/d15/d22/d3e/d73/d8b/c92 0 2024-09-21T00:56:35.753 INFO:tasks.workunit.client.1.smithi187.stdout:8/536: creat dc/d2f/fb1 x:0 0 0 2024-09-21T00:56:35.756 INFO:tasks.workunit.client.1.smithi187.stdout:0/430: mkdir d0/d17/d18/d90 0 2024-09-21T00:56:35.756 INFO:tasks.workunit.client.1.smithi187.stdout:5/442: fdatasync d0/dc/d39/d46/d67/f15 0 2024-09-21T00:56:35.756 INFO:tasks.workunit.client.1.smithi187.stdout:8/537: chown dc/f26 78360 1 2024-09-21T00:56:35.756 INFO:tasks.workunit.client.1.smithi187.stdout:6/488: rename f1 to d7/d2a/d29/d40/d45/fa5 0 2024-09-21T00:56:35.756 INFO:tasks.workunit.client.1.smithi187.stdout:0/431: dread d0/f63 [0,4194304] 0 2024-09-21T00:56:35.758 INFO:tasks.workunit.client.1.smithi187.stdout:3/432: dwrite d9/d19/d42/d53/d56/f83 [0,4194304] 0 2024-09-21T00:56:35.760 INFO:tasks.workunit.client.1.smithi187.stdout:8/538: chown dc/d1c/l1e 71341414 1 2024-09-21T00:56:35.761 INFO:tasks.workunit.client.1.smithi187.stdout:2/514: unlink d2/da8/d1c/d2d/d8f/d9f/c95 0 2024-09-21T00:56:35.761 INFO:tasks.workunit.client.1.smithi187.stdout:6/489: symlink d7/d2a/d29/d40/d6a/la6 0 2024-09-21T00:56:35.762 INFO:tasks.workunit.client.1.smithi187.stdout:7/406: mkdir d1/d18/d31/d41/d64/d93 0 2024-09-21T00:56:35.762 INFO:tasks.workunit.client.1.smithi187.stdout:7/407: readlink d1/dc/d15/d22/d3e/l5f 0 2024-09-21T00:56:35.764 INFO:tasks.workunit.client.1.smithi187.stdout:1/575: link d4/d6/d23/d2e/d94/d35/d22/d2c/l99 d4/d6/d23/d2e/d53/lb5 0 2024-09-21T00:56:35.766 INFO:tasks.workunit.client.1.smithi187.stdout:0/432: rename d0/d17/d1c/d23/d36/f7c to d0/d17/d1c/d23/d36/f91 0 2024-09-21T00:56:35.768 INFO:tasks.workunit.client.1.smithi187.stdout:2/515: dwrite d2/da8/d6c/d97/da1/fa4 [0,4194304] 0 2024-09-21T00:56:35.768 INFO:tasks.workunit.client.1.smithi187.stdout:8/539: rename dc/d1c/f82 to dc/d44/fb2 0 2024-09-21T00:56:35.777 INFO:tasks.workunit.client.1.smithi187.stdout:4/456: sync 2024-09-21T00:56:35.778 INFO:tasks.workunit.client.1.smithi187.stdout:3/433: rmdir d9/d19/d7e 0 2024-09-21T00:56:35.779 INFO:tasks.workunit.client.1.smithi187.stdout:0/433: symlink d0/l92 0 2024-09-21T00:56:35.781 INFO:tasks.workunit.client.1.smithi187.stdout:4/457: mknod d2/d3/d56/d84/c8f 0 2024-09-21T00:56:35.781 INFO:tasks.workunit.client.1.smithi187.stdout:7/408: getdents d1/d18/d31/d33/d3b 0 2024-09-21T00:56:35.781 INFO:tasks.workunit.client.1.smithi187.stdout:1/576: link d4/d6/d23/d2e/d94/d35/d22/d2c/l99 d4/d6/d23/d2e/d94/d35/d22/d8d/lb6 0 2024-09-21T00:56:35.783 INFO:tasks.workunit.client.1.smithi187.stdout:6/490: rename d7/d59/f8b to d7/d2a/fa7 0 2024-09-21T00:56:35.784 INFO:tasks.workunit.client.1.smithi187.stdout:6/491: chown d7/f2c 168409453 1 2024-09-21T00:56:35.784 INFO:tasks.workunit.client.1.smithi187.stdout:3/434: symlink d9/d13/d87/l8b 0 2024-09-21T00:56:35.785 INFO:tasks.workunit.client.1.smithi187.stdout:4/458: creat d2/d3/d56/f90 x:0 0 0 2024-09-21T00:56:35.787 INFO:tasks.workunit.client.1.smithi187.stdout:2/516: rename d2/dc/d21/l7b to d2/dc/d6b/lbc 0 2024-09-21T00:56:35.788 INFO:tasks.workunit.client.1.smithi187.stdout:3/435: dread d9/d19/d1c/f5b [0,4194304] 0 2024-09-21T00:56:35.791 INFO:tasks.workunit.client.1.smithi187.stdout:0/434: dwrite d0/d17/d1c/d23/df/d41/f42 [0,4194304] 0 2024-09-21T00:56:35.792 INFO:tasks.workunit.client.1.smithi187.stdout:2/517: creat d2/da8/d1c/fbd x:0 0 0 2024-09-21T00:56:35.796 INFO:tasks.workunit.client.1.smithi187.stdout:0/435: symlink d0/d17/d1c/l93 0 2024-09-21T00:56:35.797 INFO:tasks.workunit.client.1.smithi187.stdout:6/492: dwrite d7/d2a/d29/d40/d45/f5a [0,4194304] 0 2024-09-21T00:56:35.803 INFO:tasks.workunit.client.1.smithi187.stdout:7/409: write d1/dc/d15/d22/d3e/f50 [2891643,123451] 0 2024-09-21T00:56:35.806 INFO:tasks.workunit.client.1.smithi187.stdout:0/436: write d0/f63 [1305681,90553] 0 2024-09-21T00:56:35.806 INFO:tasks.workunit.client.1.smithi187.stdout:3/436: dwrite d9/d19/d42/d53/f76 [0,4194304] 0 2024-09-21T00:56:35.807 INFO:tasks.workunit.client.1.smithi187.stdout:2/518: dread d2/da8/d6c/db8/f85 [0,4194304] 0 2024-09-21T00:56:35.810 INFO:tasks.workunit.client.1.smithi187.stdout:7/410: truncate d1/d18/d31/f36 1513106 0 2024-09-21T00:56:35.812 INFO:tasks.workunit.client.1.smithi187.stdout:3/437: truncate d9/d13/f2c 4539399 0 2024-09-21T00:56:35.813 INFO:tasks.workunit.client.1.smithi187.stdout:2/519: chown d2/d25/f50 23436 1 2024-09-21T00:56:35.816 INFO:tasks.workunit.client.1.smithi187.stdout:0/437: creat d0/d17/d1c/d23/df/d41/d3b/f94 x:0 0 0 2024-09-21T00:56:35.817 INFO:tasks.workunit.client.1.smithi187.stdout:6/493: dwrite d7/d2a/d29/d40/d5e/f93 [0,4194304] 0 2024-09-21T00:56:35.817 INFO:tasks.workunit.client.1.smithi187.stdout:4/459: dread d2/d3/da/d16/f61 [0,4194304] 0 2024-09-21T00:56:35.819 INFO:tasks.workunit.client.1.smithi187.stdout:0/438: read d0/f16 [6644566,9410] 0 2024-09-21T00:56:35.820 INFO:tasks.workunit.client.1.smithi187.stdout:4/460: chown d2/d3/da/d2f/d32/d22/d4f/d89/l8c 50 1 2024-09-21T00:56:35.821 INFO:tasks.workunit.client.1.smithi187.stdout:6/494: symlink d7/d2a/d29/d94/la8 0 2024-09-21T00:56:35.824 INFO:tasks.workunit.client.1.smithi187.stdout:0/439: dread d0/d17/d1c/d23/df/d51/f2f [0,4194304] 0 2024-09-21T00:56:35.824 INFO:tasks.workunit.client.1.smithi187.stdout:4/461: creat d2/d3/d56/d84/d60/d6c/f91 x:0 0 0 2024-09-21T00:56:35.829 INFO:tasks.workunit.client.1.smithi187.stdout:4/462: creat d2/d3/d74/f92 x:0 0 0 2024-09-21T00:56:35.829 INFO:tasks.workunit.client.1.smithi187.stdout:3/438: write d9/d19/d1c/f5b [789544,2331] 0 2024-09-21T00:56:35.833 INFO:tasks.workunit.client.1.smithi187.stdout:0/440: dwrite d0/d17/d18/f81 [0,4194304] 0 2024-09-21T00:56:35.834 INFO:tasks.workunit.client.1.smithi187.stdout:3/439: unlink d9/d19/d1c/f80 0 2024-09-21T00:56:35.836 INFO:tasks.workunit.client.1.smithi187.stdout:2/520: dwrite d2/da8/d6c/db8/f74 [0,4194304] 0 2024-09-21T00:56:35.836 INFO:tasks.workunit.client.1.smithi187.stdout:4/463: creat d2/d3/d56/d84/d60/d6c/d77/f93 x:0 0 0 2024-09-21T00:56:35.837 INFO:tasks.workunit.client.1.smithi187.stdout:0/441: chown d0/d17/d1c/d23/df/d41/d3b/f94 1 1 2024-09-21T00:56:35.838 INFO:tasks.workunit.client.1.smithi187.stdout:2/521: dread - d2/da8/fb2 zero size 2024-09-21T00:56:35.838 INFO:tasks.workunit.client.1.smithi187.stdout:3/440: creat d9/d19/d1c/f8c x:0 0 0 2024-09-21T00:56:35.839 INFO:tasks.workunit.client.1.smithi187.stdout:6/495: truncate d7/d59/f7f 706106 0 2024-09-21T00:56:35.842 INFO:tasks.workunit.client.1.smithi187.stdout:3/441: write d9/d19/d42/d53/f76 [1779038,122824] 0 2024-09-21T00:56:35.843 INFO:tasks.workunit.client.1.smithi187.stdout:2/522: creat d2/dc/d2e/d4a/d7c/d52/fbe x:0 0 0 2024-09-21T00:56:35.843 INFO:tasks.workunit.client.1.smithi187.stdout:9/634: sync 2024-09-21T00:56:35.844 INFO:tasks.workunit.client.1.smithi187.stdout:2/523: stat d2/f8 0 2024-09-21T00:56:35.846 INFO:tasks.workunit.client.1.smithi187.stdout:6/496: creat d7/d2a/d29/d40/d50/d68/fa9 x:0 0 0 2024-09-21T00:56:35.846 INFO:tasks.workunit.client.1.smithi187.stdout:7/411: dread d1/f21 [0,4194304] 0 2024-09-21T00:56:35.850 INFO:tasks.workunit.client.1.smithi187.stdout:9/635: creat d4/d13/d14/d28/d72/fcb x:0 0 0 2024-09-21T00:56:35.852 INFO:tasks.workunit.client.1.smithi187.stdout:0/442: link d0/d17/d18/d3a/c86 d0/d17/d1c/d23/df/d41/c95 0 2024-09-21T00:56:35.854 INFO:tasks.workunit.client.1.smithi187.stdout:3/442: mknod d9/d19/d42/d89/c8d 0 2024-09-21T00:56:35.855 INFO:tasks.workunit.client.1.smithi187.stdout:9/636: mknod d4/d61/d6a/d90/ccc 0 2024-09-21T00:56:35.857 INFO:tasks.workunit.client.1.smithi187.stdout:4/464: fsync d2/d3/da/d2f/d32/d26/f44 0 2024-09-21T00:56:35.858 INFO:tasks.workunit.client.1.smithi187.stdout:2/524: getdents d2/da8/d6c/db8/d94 0 2024-09-21T00:56:35.859 INFO:tasks.workunit.client.1.smithi187.stdout:7/412: getdents d1/d18/d31/d5a/d5d 0 2024-09-21T00:56:35.861 INFO:tasks.workunit.client.1.smithi187.stdout:9/637: creat d4/d13/d14/fcd x:0 0 0 2024-09-21T00:56:35.861 INFO:tasks.workunit.client.1.smithi187.stdout:0/443: dwrite d0/d17/d1c/d23/df/f69 [0,4194304] 0 2024-09-21T00:56:35.862 INFO:tasks.workunit.client.1.smithi187.stdout:6/497: rename d7/d2a/d29/d40/d50/f82 to d7/d2a/faa 0 2024-09-21T00:56:35.862 INFO:tasks.workunit.client.1.smithi187.stdout:9/638: chown d4/d13/d14/d28/d72 116086 1 2024-09-21T00:56:35.864 INFO:tasks.workunit.client.1.smithi187.stdout:7/413: creat d1/dc/d15/d22/d3e/d73/d8b/f94 x:0 0 0 2024-09-21T00:56:35.864 INFO:tasks.workunit.client.1.smithi187.stdout:6/498: write d7/d59/f42 [1018547,121423] 0 2024-09-21T00:56:35.865 INFO:tasks.workunit.client.1.smithi187.stdout:4/465: rename d2/d3/d56/d84/d58/c71 to d2/d3/da/d2f/d32/d26/d66/c94 0 2024-09-21T00:56:35.868 INFO:tasks.workunit.client.1.smithi187.stdout:9/639: write d4/d8/d41/fa6 [8888505,21671] 0 2024-09-21T00:56:35.869 INFO:tasks.workunit.client.1.smithi187.stdout:6/499: truncate d7/d2a/f77 903016 0 2024-09-21T00:56:35.870 INFO:tasks.workunit.client.1.smithi187.stdout:4/466: dread - d2/d3/da/d2f/f83 zero size 2024-09-21T00:56:35.879 INFO:tasks.workunit.client.1.smithi187.stdout:0/444: dwrite d0/d60/f84 [0,4194304] 0 2024-09-21T00:56:35.883 INFO:tasks.workunit.client.1.smithi187.stdout:2/525: dread d2/da8/f5e [0,4194304] 0 2024-09-21T00:56:35.883 INFO:tasks.workunit.client.1.smithi187.stdout:4/467: write d2/d3/f42 [1343647,70547] 0 2024-09-21T00:56:35.883 INFO:tasks.workunit.client.1.smithi187.stdout:3/443: dread d9/d19/d1c/f2a [0,4194304] 0 2024-09-21T00:56:35.884 INFO:tasks.workunit.client.1.smithi187.stdout:5/443: sync 2024-09-21T00:56:35.886 INFO:tasks.workunit.client.1.smithi187.stdout:2/526: fsync d2/da8/fa0 0 2024-09-21T00:56:35.887 INFO:tasks.workunit.client.1.smithi187.stdout:6/500: dread d7/d2a/d29/d40/d45/f5a [0,4194304] 0 2024-09-21T00:56:35.889 INFO:tasks.workunit.client.1.smithi187.stdout:2/527: stat d2/da8/d9d 0 2024-09-21T00:56:35.891 INFO:tasks.workunit.client.1.smithi187.stdout:3/444: creat d9/d19/d42/d53/d56/f8e x:0 0 0 2024-09-21T00:56:35.893 INFO:tasks.workunit.client.1.smithi187.stdout:2/528: write d2/f8 [9387881,101136] 0 2024-09-21T00:56:35.893 INFO:tasks.workunit.client.1.smithi187.stdout:9/640: dwrite d4/d10/f4a [0,4194304] 0 2024-09-21T00:56:35.893 INFO:tasks.workunit.client.1.smithi187.stdout:7/414: dwrite d1/d18/d31/d33/f46 [0,4194304] 0 2024-09-21T00:56:35.898 INFO:tasks.workunit.client.1.smithi187.stdout:7/415: stat d1/dc/d15/d22/d3e/d73/d8b/d8f 0 2024-09-21T00:56:35.946 INFO:tasks.workunit.client.1.smithi187.stdout:9/641: mknod d4/d61/d6a/d90/cce 0 2024-09-21T00:56:35.946 INFO:tasks.workunit.client.1.smithi187.stdout:2/529: symlink d2/dc/d2e/d4a/d7c/lbf 0 2024-09-21T00:56:35.948 INFO:tasks.workunit.client.1.smithi187.stdout:6/501: dwrite d7/f9f [0,4194304] 0 2024-09-21T00:56:35.949 INFO:tasks.workunit.client.1.smithi187.stdout:5/444: getdents d0/dc/d39/d46/d67/d14/d38/d5a 0 2024-09-21T00:56:35.950 INFO:tasks.workunit.client.1.smithi187.stdout:7/416: read d1/d18/f6b [3995026,90884] 0 2024-09-21T00:56:35.950 INFO:tasks.workunit.client.1.smithi187.stdout:9/642: getdents d4/d10/d24/da0 0 2024-09-21T00:56:35.951 INFO:tasks.workunit.client.1.smithi187.stdout:6/502: fsync d7/d2a/d29/d40/d45/f69 0 2024-09-21T00:56:35.952 INFO:tasks.workunit.client.1.smithi187.stdout:9/643: fdatasync d4/d61/d6c/fbd 0 2024-09-21T00:56:35.952 INFO:tasks.workunit.client.1.smithi187.stdout:2/530: read d2/dc/d2e/f9e [99017,35127] 0 2024-09-21T00:56:35.954 INFO:tasks.workunit.client.1.smithi187.stdout:0/445: dread d0/d17/d1c/d23/df/f53 [0,4194304] 0 2024-09-21T00:56:35.955 INFO:tasks.workunit.client.1.smithi187.stdout:2/531: chown d2/dc/d2e/d4a/d7c/d52/dac 5 1 2024-09-21T00:56:35.955 INFO:tasks.workunit.client.1.smithi187.stdout:9/644: dread - d4/d13/d20/d2b/d66/fc1 zero size 2024-09-21T00:56:35.958 INFO:tasks.workunit.client.1.smithi187.stdout:0/446: read d0/d60/d6e/f74 [8603687,67476] 0 2024-09-21T00:56:35.960 INFO:tasks.workunit.client.1.smithi187.stdout:0/447: write d0/d17/d18/f8a [2598137,45907] 0 2024-09-21T00:56:35.965 INFO:tasks.workunit.client.1.smithi187.stdout:5/445: dread d0/f20 [0,4194304] 0 2024-09-21T00:56:36.011 INFO:tasks.workunit.client.1.smithi187.stdout:8/540: sync 2024-09-21T00:56:36.012 INFO:tasks.workunit.client.1.smithi187.stdout:1/577: sync 2024-09-21T00:56:36.042 INFO:tasks.workunit.client.1.smithi187.stdout:3/445: sync 2024-09-21T00:56:36.097 INFO:tasks.workunit.client.1.smithi187.stdout:6/503: unlink d7/d2a/d29/d40/c47 0 2024-09-21T00:56:36.097 INFO:tasks.workunit.client.1.smithi187.stdout:2/532: chown d2/fa 155 1 2024-09-21T00:56:36.098 INFO:tasks.workunit.client.1.smithi187.stdout:6/504: truncate d7/d59/f58 1036383 0 2024-09-21T00:56:36.099 INFO:tasks.workunit.client.1.smithi187.stdout:6/505: read - d7/d2a/d29/d40/d45/f76 zero size 2024-09-21T00:56:36.101 INFO:tasks.workunit.client.1.smithi187.stdout:4/468: dread d2/d3/da/d2f/d32/d22/f49 [0,4194304] 0 2024-09-21T00:56:36.101 INFO:tasks.workunit.client.1.smithi187.stdout:5/446: creat d0/dc/d39/d46/d67/d14/d1b/d27/f9a x:0 0 0 2024-09-21T00:56:36.102 INFO:tasks.workunit.client.1.smithi187.stdout:8/541: mkdir dc/d2f/d54/d69/db3 0 2024-09-21T00:56:36.103 INFO:tasks.workunit.client.1.smithi187.stdout:0/448: dread d0/d17/d18/f2c [0,4194304] 0 2024-09-21T00:56:36.104 INFO:tasks.workunit.client.1.smithi187.stdout:5/447: truncate d0/dc/d39/d46/d67/d14/d38/f7f 16597 0 2024-09-21T00:56:36.105 INFO:tasks.workunit.client.1.smithi187.stdout:2/533: creat d2/dc/d2e/d4a/fc0 x:0 0 0 2024-09-21T00:56:36.106 INFO:tasks.workunit.client.1.smithi187.stdout:0/449: write d0/f70 [407867,130446] 0 2024-09-21T00:56:36.106 INFO:tasks.workunit.client.1.smithi187.stdout:4/469: symlink d2/d3/d56/l95 0 2024-09-21T00:56:36.107 INFO:tasks.workunit.client.1.smithi187.stdout:2/534: fdatasync d2/d3/f8d 0 2024-09-21T00:56:36.109 INFO:tasks.workunit.client.1.smithi187.stdout:1/578: rename d4/d6/d23/d2e/d94/d35/d22/d2c/l99 to d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/lb7 0 2024-09-21T00:56:36.110 INFO:tasks.workunit.client.1.smithi187.stdout:5/448: fdatasync d0/dc/d39/d46/d67/d14/d1b/d27/f9a 0 2024-09-21T00:56:36.110 INFO:tasks.workunit.client.1.smithi187.stdout:4/470: write d2/d3/d74/f92 [1005000,21641] 0 2024-09-21T00:56:36.111 INFO:tasks.workunit.client.1.smithi187.stdout:9/645: truncate d4/d61/d6a/f9e 2089576 0 2024-09-21T00:56:36.114 INFO:tasks.workunit.client.1.smithi187.stdout:0/450: symlink d0/d60/l96 0 2024-09-21T00:56:36.114 INFO:tasks.workunit.client.1.smithi187.stdout:8/542: dread dc/f62 [0,4194304] 0 2024-09-21T00:56:36.115 INFO:tasks.workunit.client.1.smithi187.stdout:7/417: dwrite d1/d18/d31/d5a/d5d/f6c [0,4194304] 0 2024-09-21T00:56:36.119 INFO:tasks.workunit.client.1.smithi187.stdout:5/449: write d0/dc/d39/d46/d67/d30/d68/f8a [898823,14025] 0 2024-09-21T00:56:36.119 INFO:tasks.workunit.client.1.smithi187.stdout:6/506: dwrite d7/d2a/d29/d40/d45/f5a [0,4194304] 0 2024-09-21T00:56:36.120 INFO:tasks.workunit.client.1.smithi187.stdout:9/646: read d4/d10/fac [890223,86527] 0 2024-09-21T00:56:36.122 INFO:tasks.workunit.client.1.smithi187.stdout:8/543: dread - dc/d2f/d37/f57 zero size 2024-09-21T00:56:36.122 INFO:tasks.workunit.client.1.smithi187.stdout:7/418: dread - d1/d18/f8d zero size 2024-09-21T00:56:36.125 INFO:tasks.workunit.client.1.smithi187.stdout:9/647: readlink d4/l8a 0 2024-09-21T00:56:36.125 INFO:tasks.workunit.client.1.smithi187.stdout:0/451: mkdir d0/d17/d18/d3a/d97 0 2024-09-21T00:56:36.126 INFO:tasks.workunit.client.1.smithi187.stdout:2/535: dread d2/dc/d2e/d4a/d7c/f2b [0,4194304] 0 2024-09-21T00:56:36.127 INFO:tasks.workunit.client.1.smithi187.stdout:3/446: rename d9/d13/f15 to d9/d19/d42/f8f 0 2024-09-21T00:56:36.128 INFO:tasks.workunit.client.1.smithi187.stdout:6/507: write d7/d2a/d29/f38 [3087850,15787] 0 2024-09-21T00:56:36.129 INFO:tasks.workunit.client.1.smithi187.stdout:1/579: mknod d4/d6/d23/d2e/d53/d6a/cb8 0 2024-09-21T00:56:36.130 INFO:tasks.workunit.client.1.smithi187.stdout:9/648: chown d4/d13/d14/d28/d72/l93 30483 1 2024-09-21T00:56:36.130 INFO:tasks.workunit.client.1.smithi187.stdout:5/450: unlink d0/dc/d39/d46/d67/d14/d38/f7f 0 2024-09-21T00:56:36.130 INFO:tasks.workunit.client.1.smithi187.stdout:3/447: dread - d9/d19/d42/f65 zero size 2024-09-21T00:56:36.131 INFO:tasks.workunit.client.1.smithi187.stdout:8/544: creat dc/d44/fb4 x:0 0 0 2024-09-21T00:56:36.131 INFO:tasks.workunit.client.1.smithi187.stdout:2/536: creat d2/dc/d2e/d6f/fc1 x:0 0 0 2024-09-21T00:56:36.133 INFO:tasks.workunit.client.1.smithi187.stdout:7/419: rename d1/dc/d15/f67 to d1/d18/d31/d33/f95 0 2024-09-21T00:56:36.134 INFO:tasks.workunit.client.1.smithi187.stdout:1/580: mkdir d4/d6/d23/d2e/d94/d35/d22/d65/db9 0 2024-09-21T00:56:36.135 INFO:tasks.workunit.client.1.smithi187.stdout:5/451: write d0/dc/d39/d46/d67/f50 [8005822,109596] 0 2024-09-21T00:56:36.142 INFO:tasks.workunit.client.1.smithi187.stdout:7/420: read - d1/dc/d15/d22/d3e/d73/d8b/f94 zero size 2024-09-21T00:56:36.142 INFO:tasks.workunit.client.1.smithi187.stdout:8/545: link dc/d2f/d80/f93 dc/d1c/d29/da7/fb5 0 2024-09-21T00:56:36.149 INFO:tasks.workunit.client.1.smithi187.stdout:8/546: unlink dc/d1c/f3b 0 2024-09-21T00:56:36.153 INFO:tasks.workunit.client.1.smithi187.stdout:6/508: dwrite d7/d2a/d29/d40/d6a/d88/f9c [0,4194304] 0 2024-09-21T00:56:36.153 INFO:tasks.workunit.client.1.smithi187.stdout:3/448: dwrite d9/d19/d1c/f3e [0,4194304] 0 2024-09-21T00:56:36.156 INFO:tasks.workunit.client.1.smithi187.stdout:9/649: dwrite d4/d10/fc5 [0,4194304] 0 2024-09-21T00:56:36.158 INFO:tasks.workunit.client.1.smithi187.stdout:2/537: dwrite d2/dc/d2e/d4a/f4d [0,4194304] 0 2024-09-21T00:56:36.158 INFO:tasks.workunit.client.1.smithi187.stdout:7/421: creat d1/dc/d15/d22/d3e/d73/d8b/f96 x:0 0 0 2024-09-21T00:56:36.161 INFO:tasks.workunit.client.1.smithi187.stdout:6/509: readlink d7/d2a/d29/d40/d6a/l78 0 2024-09-21T00:56:36.166 INFO:tasks.workunit.client.1.smithi187.stdout:8/547: getdents dc/d2f/d54/d69 0 2024-09-21T00:56:36.167 INFO:tasks.workunit.client.1.smithi187.stdout:2/538: write d2/f7 [315176,108993] 0 2024-09-21T00:56:36.168 INFO:tasks.workunit.client.1.smithi187.stdout:9/650: truncate d4/d8/d46/d54/f55 1412845 0 2024-09-21T00:56:36.168 INFO:tasks.workunit.client.1.smithi187.stdout:5/452: dwrite d0/dc/d39/d46/d67/d14/d1b/d27/f35 [0,4194304] 0 2024-09-21T00:56:36.169 INFO:tasks.workunit.client.1.smithi187.stdout:3/449: write d9/d19/d42/d53/d56/d7d/f86 [1275434,87021] 0 2024-09-21T00:56:36.171 INFO:tasks.workunit.client.1.smithi187.stdout:4/471: dread d2/d3/da/d2f/d4b/f7a [0,4194304] 0 2024-09-21T00:56:36.173 INFO:tasks.workunit.client.1.smithi187.stdout:8/548: unlink dc/l9a 0 2024-09-21T00:56:36.177 INFO:tasks.workunit.client.1.smithi187.stdout:6/510: link d7/d2a/fa7 d7/d2a/da2/fab 0 2024-09-21T00:56:36.179 INFO:tasks.workunit.client.1.smithi187.stdout:4/472: mknod d2/d3/da/d2f/d32/d25/c96 0 2024-09-21T00:56:36.181 INFO:tasks.workunit.client.1.smithi187.stdout:7/422: dread d1/d18/d31/d5a/d5d/f6c [0,4194304] 0 2024-09-21T00:56:36.181 INFO:tasks.workunit.client.1.smithi187.stdout:0/452: dread d0/d17/d18/f43 [0,4194304] 0 2024-09-21T00:56:36.181 INFO:tasks.workunit.client.1.smithi187.stdout:3/450: creat d9/d19/d42/f90 x:0 0 0 2024-09-21T00:56:36.181 INFO:tasks.workunit.client.1.smithi187.stdout:9/651: creat d4/fcf x:0 0 0 2024-09-21T00:56:36.182 INFO:tasks.workunit.client.1.smithi187.stdout:2/539: rename d2/dc/d2e/d4a/d7c/f79 to d2/da8/d6c/db8/d40/d75/fc2 0 2024-09-21T00:56:36.183 INFO:tasks.workunit.client.1.smithi187.stdout:8/549: creat dc/d2f/d54/d69/db3/fb6 x:0 0 0 2024-09-21T00:56:36.185 INFO:tasks.workunit.client.1.smithi187.stdout:5/453: dwrite d0/dc/d1f/d26/f64 [0,4194304] 0 2024-09-21T00:56:36.185 INFO:tasks.workunit.client.1.smithi187.stdout:6/511: mknod d7/d2a/d29/d40/d6a/cac 0 2024-09-21T00:56:36.185 INFO:tasks.workunit.client.1.smithi187.stdout:0/453: dread - d0/d17/d18/d3a/f5e zero size 2024-09-21T00:56:36.186 INFO:tasks.workunit.client.1.smithi187.stdout:4/473: write d2/d3/da/d2f/d32/f4e [3992166,106659] 0 2024-09-21T00:56:36.188 INFO:tasks.workunit.client.1.smithi187.stdout:7/423: mkdir d1/dc/d15/d22/d3e/d7c/d97 0 2024-09-21T00:56:36.189 INFO:tasks.workunit.client.1.smithi187.stdout:8/550: fdatasync dc/fd 0 2024-09-21T00:56:36.189 INFO:tasks.workunit.client.1.smithi187.stdout:2/540: truncate d2/da8/d1c/f54 1164813 0 2024-09-21T00:56:36.190 INFO:tasks.workunit.client.1.smithi187.stdout:3/451: chown d9/d13/d20/c23 2274532 1 2024-09-21T00:56:36.190 INFO:tasks.workunit.client.1.smithi187.stdout:0/454: fdatasync d0/d17/d18/d3a/f5e 0 2024-09-21T00:56:36.190 INFO:tasks.workunit.client.1.smithi187.stdout:4/474: fdatasync d2/d3/d56/f90 0 2024-09-21T00:56:36.191 INFO:tasks.workunit.client.1.smithi187.stdout:8/551: chown dc/c16 112837784 1 2024-09-21T00:56:36.192 INFO:tasks.workunit.client.1.smithi187.stdout:6/512: creat d7/d2a/d29/d40/d6a/d9e/fad x:0 0 0 2024-09-21T00:56:36.193 INFO:tasks.workunit.client.1.smithi187.stdout:8/552: chown l5 324870080 1 2024-09-21T00:56:36.193 INFO:tasks.workunit.client.1.smithi187.stdout:4/475: stat d2/d3/da/d2f/d32/d24/f2e 0 2024-09-21T00:56:36.194 INFO:tasks.workunit.client.1.smithi187.stdout:5/454: creat d0/dc/d39/d46/d67/d30/d6b/f9b x:0 0 0 2024-09-21T00:56:36.195 INFO:tasks.workunit.client.1.smithi187.stdout:5/455: read d0/f3f [3369375,99227] 0 2024-09-21T00:56:36.196 INFO:tasks.workunit.client.1.smithi187.stdout:8/553: dread dc/f62 [0,4194304] 0 2024-09-21T00:56:36.196 INFO:tasks.workunit.client.1.smithi187.stdout:7/424: creat d1/dc/d15/d22/d3e/f98 x:0 0 0 2024-09-21T00:56:36.197 INFO:tasks.workunit.client.1.smithi187.stdout:6/513: creat d7/d2a/d29/d40/fae x:0 0 0 2024-09-21T00:56:36.197 INFO:tasks.workunit.client.1.smithi187.stdout:4/476: mkdir d2/d3/da/d2f/d32/d22/d4f/d97 0 2024-09-21T00:56:36.201 INFO:tasks.workunit.client.1.smithi187.stdout:6/514: chown d7/d2a/c62 19 1 2024-09-21T00:56:36.201 INFO:tasks.workunit.client.1.smithi187.stdout:8/554: truncate dc/d2f/d37/f66 907018 0 2024-09-21T00:56:36.201 INFO:tasks.workunit.client.1.smithi187.stdout:4/477: write d2/d3/da/f5b [2561545,128165] 0 2024-09-21T00:56:36.204 INFO:tasks.workunit.client.1.smithi187.stdout:8/555: stat dc/fd 0 2024-09-21T00:56:36.204 INFO:tasks.workunit.client.1.smithi187.stdout:7/425: creat d1/dc/d15/d22/d3e/f99 x:0 0 0 2024-09-21T00:56:36.204 INFO:tasks.workunit.client.1.smithi187.stdout:6/515: symlink d7/d59/laf 0 2024-09-21T00:56:36.204 INFO:tasks.workunit.client.1.smithi187.stdout:2/541: dwrite d2/dc/d2e/d4a/d7c/f2b [0,4194304] 0 2024-09-21T00:56:36.205 INFO:tasks.workunit.client.1.smithi187.stdout:2/542: fdatasync d2/da8/d6c/d97/fb7 0 2024-09-21T00:56:36.206 INFO:tasks.workunit.client.1.smithi187.stdout:4/478: mkdir d2/d3/d74/d98 0 2024-09-21T00:56:36.207 INFO:tasks.workunit.client.1.smithi187.stdout:7/426: mknod d1/d18/c9a 0 2024-09-21T00:56:36.207 INFO:tasks.workunit.client.1.smithi187.stdout:6/516: read d7/f4a [1414780,42848] 0 2024-09-21T00:56:36.208 INFO:tasks.workunit.client.1.smithi187.stdout:8/556: rename dc/d1c/d29/ca5 to dc/d1c/d29/cb7 0 2024-09-21T00:56:36.209 INFO:tasks.workunit.client.1.smithi187.stdout:2/543: mknod d2/da8/d1c/d2d/cc3 0 2024-09-21T00:56:36.216 INFO:tasks.workunit.client.1.smithi187.stdout:8/557: mkdir dc/d2f/d80/db8 0 2024-09-21T00:56:36.216 INFO:tasks.workunit.client.1.smithi187.stdout:6/517: rename d7/f2c to d7/d2a/d29/d40/d50/fb0 0 2024-09-21T00:56:36.216 INFO:tasks.workunit.client.1.smithi187.stdout:2/544: rmdir d2/d3/d15 39 2024-09-21T00:56:36.216 INFO:tasks.workunit.client.1.smithi187.stdout:4/479: getdents d2/d3/da 0 2024-09-21T00:56:36.217 INFO:tasks.workunit.client.1.smithi187.stdout:2/545: chown d2/da8/d6c/d97/db0 97 1 2024-09-21T00:56:36.218 INFO:tasks.workunit.client.1.smithi187.stdout:4/480: dread - d2/d3/da/d2f/d32/d24/f67 zero size 2024-09-21T00:56:36.220 INFO:tasks.workunit.client.1.smithi187.stdout:6/518: rename d7/d2a/f28 to d7/d2a/d29/d40/fb1 0 2024-09-21T00:56:36.220 INFO:tasks.workunit.client.1.smithi187.stdout:8/558: link dc/d44/c87 dc/d2f/cb9 0 2024-09-21T00:56:36.220 INFO:tasks.workunit.client.1.smithi187.stdout:6/519: chown d7/d2a/d29/d94/f98 1 1 2024-09-21T00:56:36.221 INFO:tasks.workunit.client.1.smithi187.stdout:4/481: chown d2/d3/da/d2f/d32/d22/f23 237206365 1 2024-09-21T00:56:36.223 INFO:tasks.workunit.client.1.smithi187.stdout:6/520: mknod d7/d2a/da2/cb2 0 2024-09-21T00:56:36.223 INFO:tasks.workunit.client.1.smithi187.stdout:2/546: getdents d2/da8/d6c/db8/d40 0 2024-09-21T00:56:36.224 INFO:tasks.workunit.client.1.smithi187.stdout:6/521: write d7/d2a/d29/d40/d6a/d9e/fad [189484,62870] 0 2024-09-21T00:56:36.225 INFO:tasks.workunit.client.1.smithi187.stdout:2/547: readlink d2/da8/d3f/l5f 0 2024-09-21T00:56:36.226 INFO:tasks.workunit.client.1.smithi187.stdout:4/482: dread d2/d3/da/d2f/d4b/f6a [0,4194304] 0 2024-09-21T00:56:36.227 INFO:tasks.workunit.client.1.smithi187.stdout:6/522: rename d7/f23 to d7/d2a/d7a/fb3 0 2024-09-21T00:56:36.227 INFO:tasks.workunit.client.1.smithi187.stdout:4/483: chown d2/f65 3500 1 2024-09-21T00:56:36.228 INFO:tasks.workunit.client.1.smithi187.stdout:4/484: chown d2/d3/da/d2f/d32/d22/d37/l41 0 1 2024-09-21T00:56:36.228 INFO:tasks.workunit.client.1.smithi187.stdout:6/523: write d7/d2a/d29/d40/d50/d68/fa9 [1032498,82374] 0 2024-09-21T00:56:36.229 INFO:tasks.workunit.client.1.smithi187.stdout:4/485: fsync d2/d3/d56/f90 0 2024-09-21T00:56:36.229 INFO:tasks.workunit.client.1.smithi187.stdout:6/524: fdatasync d7/d2a/d29/d40/f72 0 2024-09-21T00:56:36.229 INFO:tasks.workunit.client.1.smithi187.stdout:6/525: chown d7/d2a/d29 352313 1 2024-09-21T00:56:36.231 INFO:tasks.workunit.client.1.smithi187.stdout:8/559: read dc/f92 [4706,111355] 0 2024-09-21T00:56:36.231 INFO:tasks.workunit.client.1.smithi187.stdout:8/560: chown dc/d2f/fa1 733787701 1 2024-09-21T00:56:36.232 INFO:tasks.workunit.client.1.smithi187.stdout:6/526: mknod d7/d2a/d29/d40/cb4 0 2024-09-21T00:56:36.233 INFO:tasks.workunit.client.1.smithi187.stdout:6/527: chown d7/d2a/c62 26 1 2024-09-21T00:56:36.233 INFO:tasks.workunit.client.1.smithi187.stdout:8/561: rmdir dc/d2f/d37 39 2024-09-21T00:56:36.233 INFO:tasks.workunit.client.1.smithi187.stdout:6/528: chown d7/d2a/d29/d40/f72 18 1 2024-09-21T00:56:36.234 INFO:tasks.workunit.client.1.smithi187.stdout:6/529: chown d7/d2a/d29/f7c 1557550 1 2024-09-21T00:56:36.235 INFO:tasks.workunit.client.1.smithi187.stdout:6/530: fsync d7/d2a/d29/f3f 0 2024-09-21T00:56:36.235 INFO:tasks.workunit.client.1.smithi187.stdout:8/562: chown dc/f15 25935460 1 2024-09-21T00:56:36.243 INFO:tasks.workunit.client.1.smithi187.stdout:1/581: chown d4/d6/d23/d2e/d53/d6a/f8f 2306 1 2024-09-21T00:56:36.250 INFO:tasks.workunit.client.1.smithi187.stdout:1/582: dwrite d4/d6/d23/d2e/d94/d35/d4c/fa7 [0,4194304] 0 2024-09-21T00:56:36.252 INFO:tasks.workunit.client.1.smithi187.stdout:1/583: write d4/d6/d23/d2e/d94/d35/d4c/f8b [595590,115887] 0 2024-09-21T00:56:36.263 INFO:tasks.workunit.client.1.smithi187.stdout:0/455: write d0/d17/d1c/d23/df/d41/d3b/f59 [1792555,45543] 0 2024-09-21T00:56:36.265 INFO:tasks.workunit.client.1.smithi187.stdout:5/456: write d0/dc/d39/d46/d67/d14/d1b/f24 [1466334,118788] 0 2024-09-21T00:56:36.265 INFO:tasks.workunit.client.1.smithi187.stdout:0/456: chown d0/d17/c6a 449101 1 2024-09-21T00:56:36.266 INFO:tasks.workunit.client.1.smithi187.stdout:4/486: dread d2/d3/da/d2f/d32/d26/f44 [0,4194304] 0 2024-09-21T00:56:36.267 INFO:tasks.workunit.client.1.smithi187.stdout:5/457: readlink d0/l12 0 2024-09-21T00:56:36.267 INFO:tasks.workunit.client.1.smithi187.stdout:3/452: dread d9/f37 [0,4194304] 0 2024-09-21T00:56:36.268 INFO:tasks.workunit.client.1.smithi187.stdout:8/563: rename dc/d1c to dc/d2f/d80/db8/dba 0 2024-09-21T00:56:36.270 INFO:tasks.workunit.client.1.smithi187.stdout:0/457: mkdir d0/d17/d18/d90/d98 0 2024-09-21T00:56:36.270 INFO:tasks.workunit.client.1.smithi187.stdout:1/584: dread d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 [0,4194304] 0 2024-09-21T00:56:36.271 INFO:tasks.workunit.client.1.smithi187.stdout:8/564: mknod dc/d2f/d80/cbb 0 2024-09-21T00:56:36.272 INFO:tasks.workunit.client.1.smithi187.stdout:5/458: creat d0/dc/d1f/d26/f9c x:0 0 0 2024-09-21T00:56:36.273 INFO:tasks.workunit.client.1.smithi187.stdout:4/487: write d2/d3/da/d2f/d32/d22/d37/d3a/f8d [168725,9957] 0 2024-09-21T00:56:36.274 INFO:tasks.workunit.client.1.smithi187.stdout:3/453: write d9/d19/d1c/f41 [6796840,69060] 0 2024-09-21T00:56:36.275 INFO:tasks.workunit.client.1.smithi187.stdout:1/585: stat d4/d6/d23/d2e/d94/l77 0 2024-09-21T00:56:36.275 INFO:tasks.workunit.client.1.smithi187.stdout:9/652: sync 2024-09-21T00:56:36.276 INFO:tasks.workunit.client.1.smithi187.stdout:6/531: dread d7/f4e [0,4194304] 0 2024-09-21T00:56:36.278 INFO:tasks.workunit.client.1.smithi187.stdout:8/565: unlink dc/d2f/d80/db8/dba/l1e 0 2024-09-21T00:56:36.279 INFO:tasks.workunit.client.1.smithi187.stdout:2/548: truncate d2/dc/f13 778334 0 2024-09-21T00:56:36.279 INFO:tasks.workunit.client.1.smithi187.stdout:1/586: write d4/d6/d23/d2e/f7a [322262,29301] 0 2024-09-21T00:56:36.280 INFO:tasks.workunit.client.1.smithi187.stdout:7/427: dwrite d1/d18/f8d [0,4194304] 0 2024-09-21T00:56:36.281 INFO:tasks.workunit.client.1.smithi187.stdout:5/459: symlink d0/dc/d39/l9d 0 2024-09-21T00:56:36.282 INFO:tasks.workunit.client.1.smithi187.stdout:4/488: symlink d2/l99 0 2024-09-21T00:56:36.283 INFO:tasks.workunit.client.1.smithi187.stdout:9/653: creat d4/d61/d6a/d90/fd0 x:0 0 0 2024-09-21T00:56:36.284 INFO:tasks.workunit.client.1.smithi187.stdout:4/489: chown d2/d3/da/d2f/d32/d22/d4f/l57 990322 1 2024-09-21T00:56:36.284 INFO:tasks.workunit.client.1.smithi187.stdout:6/532: creat d7/d2a/d29/d40/d5e/fb5 x:0 0 0 2024-09-21T00:56:36.284 INFO:tasks.workunit.client.1.smithi187.stdout:9/654: dread - d4/d13/d14/d1d/fad zero size 2024-09-21T00:56:36.285 INFO:tasks.workunit.client.1.smithi187.stdout:0/458: creat d0/d17/d1c/d23/f99 x:0 0 0 2024-09-21T00:56:36.288 INFO:tasks.workunit.client.1.smithi187.stdout:7/428: fdatasync d1/f21 0 2024-09-21T00:56:36.289 INFO:tasks.workunit.client.1.smithi187.stdout:7/429: fdatasync d1/dc/d15/d22/f4f 0 2024-09-21T00:56:36.291 INFO:tasks.workunit.client.1.smithi187.stdout:5/460: creat d0/dc/d39/f9e x:0 0 0 2024-09-21T00:56:36.292 INFO:tasks.workunit.client.1.smithi187.stdout:4/490: symlink d2/d3/da/d2f/d32/d22/d37/l9a 0 2024-09-21T00:56:36.293 INFO:tasks.workunit.client.1.smithi187.stdout:5/461: write d0/dc/d39/d46/d67/f50 [3113819,123872] 0 2024-09-21T00:56:36.293 INFO:tasks.workunit.client.1.smithi187.stdout:9/655: symlink d4/d10/d24/ld1 0 2024-09-21T00:56:36.294 INFO:tasks.workunit.client.1.smithi187.stdout:9/656: chown d4/d13/d14/d1d/fad 411864592 1 2024-09-21T00:56:36.295 INFO:tasks.workunit.client.1.smithi187.stdout:7/430: write d1/d18/d31/d5a/d5d/f6c [4434772,108268] 0 2024-09-21T00:56:36.297 INFO:tasks.workunit.client.1.smithi187.stdout:4/491: creat d2/d3/da/d2f/d32/d26/d66/f9b x:0 0 0 2024-09-21T00:56:36.299 INFO:tasks.workunit.client.1.smithi187.stdout:4/492: stat d2/d3/da/f1f 0 2024-09-21T00:56:36.299 INFO:tasks.workunit.client.1.smithi187.stdout:3/454: rename d9/d19/c5c to d9/d19/d42/d53/c91 0 2024-09-21T00:56:36.301 INFO:tasks.workunit.client.1.smithi187.stdout:4/493: fdatasync d2/d3/da/f4d 0 2024-09-21T00:56:36.301 INFO:tasks.workunit.client.1.smithi187.stdout:0/459: creat d0/f9a x:0 0 0 2024-09-21T00:56:36.302 INFO:tasks.workunit.client.1.smithi187.stdout:1/587: getdents d4/d6/d49 0 2024-09-21T00:56:36.302 INFO:tasks.workunit.client.1.smithi187.stdout:5/462: dwrite d0/dc/d1f/d26/d8b/f91 [0,4194304] 0 2024-09-21T00:56:36.304 INFO:tasks.workunit.client.1.smithi187.stdout:4/494: write d2/d3/da/d2f/f83 [814372,90476] 0 2024-09-21T00:56:36.308 INFO:tasks.workunit.client.1.smithi187.stdout:4/495: write d2/d3/da/d2f/d32/d22/d37/d3a/f8d [139065,782] 0 2024-09-21T00:56:36.308 INFO:tasks.workunit.client.1.smithi187.stdout:3/455: write d9/d19/d43/f52 [3408381,15908] 0 2024-09-21T00:56:36.309 INFO:tasks.workunit.client.1.smithi187.stdout:9/657: creat d4/d13/fd2 x:0 0 0 2024-09-21T00:56:36.310 INFO:tasks.workunit.client.1.smithi187.stdout:8/566: write dc/d2f/d37/f42 [4564255,50404] 0 2024-09-21T00:56:36.311 INFO:tasks.workunit.client.1.smithi187.stdout:4/496: chown d2/d3/da/d16/c1e 14609 1 2024-09-21T00:56:36.312 INFO:tasks.workunit.client.1.smithi187.stdout:6/533: dread d7/d2a/d29/f7c [0,4194304] 0 2024-09-21T00:56:36.312 INFO:tasks.workunit.client.1.smithi187.stdout:8/567: fsync dc/d2f/d80/db8/dba/d29/f48 0 2024-09-21T00:56:36.313 INFO:tasks.workunit.client.1.smithi187.stdout:2/549: rename d2/dc/d6b/lbc to d2/da8/d6c/lc4 0 2024-09-21T00:56:36.314 INFO:tasks.workunit.client.1.smithi187.stdout:8/568: write f8 [333273,78912] 0 2024-09-21T00:56:36.314 INFO:tasks.workunit.client.1.smithi187.stdout:4/497: fdatasync d2/d3/da/d2f/d32/d22/d37/d63/f72 0 2024-09-21T00:56:36.315 INFO:tasks.workunit.client.1.smithi187.stdout:4/498: fdatasync d2/d3/da/d2f/d32/d24/f67 0 2024-09-21T00:56:36.316 INFO:tasks.workunit.client.1.smithi187.stdout:1/588: mknod d4/d6/d23/d2e/d94/d35/d4c/d5b/cba 0 2024-09-21T00:56:36.318 INFO:tasks.workunit.client.1.smithi187.stdout:1/589: write d4/d6/d23/d2e/d94/d35/d79/f88 [2288645,123242] 0 2024-09-21T00:56:36.318 INFO:tasks.workunit.client.1.smithi187.stdout:9/658: creat d4/d8/d46/fd3 x:0 0 0 2024-09-21T00:56:36.318 INFO:tasks.workunit.client.1.smithi187.stdout:7/431: write d1/dc/d15/d22/f79 [3341601,123993] 0 2024-09-21T00:56:36.318 INFO:tasks.workunit.client.1.smithi187.stdout:4/499: truncate d2/d3/da/d2f/d32/d26/f44 4452776 0 2024-09-21T00:56:36.320 INFO:tasks.workunit.client.1.smithi187.stdout:9/659: write d4/d8/d41/fa6 [7853668,126479] 0 2024-09-21T00:56:36.321 INFO:tasks.workunit.client.1.smithi187.stdout:4/500: write d2/d3/d56/d84/d60/d6c/d77/f93 [133520,67402] 0 2024-09-21T00:56:36.323 INFO:tasks.workunit.client.1.smithi187.stdout:0/460: rename d0/d60/f84 to d0/d17/d18/d3a/d97/f9b 0 2024-09-21T00:56:36.323 INFO:tasks.workunit.client.1.smithi187.stdout:4/501: chown d2/d3/da/d2f/d32/d26/d66/d6e/l73 31 1 2024-09-21T00:56:36.324 INFO:tasks.workunit.client.1.smithi187.stdout:8/569: creat dc/d94/fbc x:0 0 0 2024-09-21T00:56:36.326 INFO:tasks.workunit.client.1.smithi187.stdout:3/456: link d9/f12 d9/d19/d1c/d5f/f92 0 2024-09-21T00:56:36.327 INFO:tasks.workunit.client.1.smithi187.stdout:9/660: chown d4/d10/d39/c82 67 1 2024-09-21T00:56:36.328 INFO:tasks.workunit.client.1.smithi187.stdout:9/661: write d4/d13/fca [663930,42484] 0 2024-09-21T00:56:36.331 INFO:tasks.workunit.client.1.smithi187.stdout:6/534: write d7/d2a/da2/fab [3682924,119545] 0 2024-09-21T00:56:36.332 INFO:tasks.workunit.client.1.smithi187.stdout:8/570: unlink dc/d2f/d34/l46 0 2024-09-21T00:56:36.333 INFO:tasks.workunit.client.1.smithi187.stdout:4/502: truncate d2/d3/da/d2f/d32/d24/f53 804048 0 2024-09-21T00:56:36.333 INFO:tasks.workunit.client.1.smithi187.stdout:8/571: dread dc/f62 [0,4194304] 0 2024-09-21T00:56:36.334 INFO:tasks.workunit.client.1.smithi187.stdout:5/463: truncate d0/dc/d39/d46/d67/f50 4673175 0 2024-09-21T00:56:36.335 INFO:tasks.workunit.client.1.smithi187.stdout:5/464: write d0/dc/d39/d46/d67/d14/d38/f82 [787212,113224] 0 2024-09-21T00:56:36.336 INFO:tasks.workunit.client.1.smithi187.stdout:3/457: creat d9/d19/d42/d89/f93 x:0 0 0 2024-09-21T00:56:36.337 INFO:tasks.workunit.client.1.smithi187.stdout:5/465: stat d0/dc/d39/d46/d67/d30/f3c 0 2024-09-21T00:56:36.339 INFO:tasks.workunit.client.1.smithi187.stdout:0/461: truncate d0/d17/d18/f43 2254270 0 2024-09-21T00:56:36.339 INFO:tasks.workunit.client.1.smithi187.stdout:6/535: creat d7/d2a/da2/fb6 x:0 0 0 2024-09-21T00:56:36.340 INFO:tasks.workunit.client.1.smithi187.stdout:8/572: creat dc/d94/fbd x:0 0 0 2024-09-21T00:56:36.341 INFO:tasks.workunit.client.1.smithi187.stdout:1/590: creat d4/d6/d23/d2e/d53/fbb x:0 0 0 2024-09-21T00:56:36.342 INFO:tasks.workunit.client.1.smithi187.stdout:2/550: truncate d2/f7 1481585 0 2024-09-21T00:56:36.343 INFO:tasks.workunit.client.1.smithi187.stdout:8/573: chown dc/d2f/d80/db8/dba/d29/f4c 922 1 2024-09-21T00:56:36.345 INFO:tasks.workunit.client.1.smithi187.stdout:6/536: dread d7/d2a/d29/d40/d50/d68/fa9 [0,4194304] 0 2024-09-21T00:56:36.348 INFO:tasks.workunit.client.1.smithi187.stdout:3/458: rename d9/d19/d42 to d9/d13/d87/d94 0 2024-09-21T00:56:36.349 INFO:tasks.workunit.client.1.smithi187.stdout:5/466: mknod d0/dc/d39/d46/d67/d14/d1b/d27/d3a/c9f 0 2024-09-21T00:56:36.353 INFO:tasks.workunit.client.1.smithi187.stdout:2/551: mkdir d2/dc/d2e/d51/dc5 0 2024-09-21T00:56:36.354 INFO:tasks.workunit.client.1.smithi187.stdout:1/591: mknod d4/d6/d23/d2e/d94/d66/cbc 0 2024-09-21T00:56:36.354 INFO:tasks.workunit.client.1.smithi187.stdout:1/592: chown d4/d6/d23/d2e/d94/d35/d79 0 1 2024-09-21T00:56:36.356 INFO:tasks.workunit.client.1.smithi187.stdout:4/503: write d2/d3/da/d2f/f30 [3017187,52305] 0 2024-09-21T00:56:36.359 INFO:tasks.workunit.client.1.smithi187.stdout:3/459: stat d9/d13/d20/c27 0 2024-09-21T00:56:36.359 INFO:tasks.workunit.client.1.smithi187.stdout:1/593: dread d4/d6/d23/d2e/d94/d35/d22/d65/f9d [0,4194304] 0 2024-09-21T00:56:36.360 INFO:tasks.workunit.client.1.smithi187.stdout:1/594: dread - d4/d6/d23/d2e/f4b zero size 2024-09-21T00:56:36.362 INFO:tasks.workunit.client.1.smithi187.stdout:5/467: rename d0/dc/d39/d46/d67/d14/d38/d5a/d6c/d7b/f7e to d0/dc/d39/d46/d67/d30/d6b/fa0 0 2024-09-21T00:56:36.363 INFO:tasks.workunit.client.1.smithi187.stdout:2/552: mkdir d2/da8/d1c/dc6 0 2024-09-21T00:56:36.363 INFO:tasks.workunit.client.1.smithi187.stdout:9/662: getdents d4/d10/d43 0 2024-09-21T00:56:36.364 INFO:tasks.workunit.client.1.smithi187.stdout:8/574: fdatasync dc/d2f/d80/db8/dba/d3e/d75/f8b 0 2024-09-21T00:56:36.366 INFO:tasks.workunit.client.1.smithi187.stdout:6/537: symlink d7/d2a/d29/lb7 0 2024-09-21T00:56:36.366 INFO:tasks.workunit.client.1.smithi187.stdout:2/553: fsync d2/da8/d6c/d97/db0/fa9 0 2024-09-21T00:56:36.369 INFO:tasks.workunit.client.1.smithi187.stdout:0/462: dwrite d0/d17/d1c/d23/df/d41/d3b/f54 [4194304,4194304] 0 2024-09-21T00:56:36.370 INFO:tasks.workunit.client.1.smithi187.stdout:4/504: dread d2/d3/da/d2f/f30 [0,4194304] 0 2024-09-21T00:56:36.372 INFO:tasks.workunit.client.1.smithi187.stdout:5/468: fsync d0/dc/d39/d46/d67/d14/f21 0 2024-09-21T00:56:36.374 INFO:tasks.workunit.client.1.smithi187.stdout:5/469: read - d0/dc/d39/d46/d67/d14/d1b/d27/f9a zero size 2024-09-21T00:56:36.376 INFO:tasks.workunit.client.1.smithi187.stdout:5/470: fsync d0/dc/d39/d46/d67/d30/d6b/f9b 0 2024-09-21T00:56:36.377 INFO:tasks.workunit.client.1.smithi187.stdout:5/471: write d0/dc/d39/d46/d67/d30/d68/f8a [1483908,64236] 0 2024-09-21T00:56:36.378 INFO:tasks.workunit.client.1.smithi187.stdout:6/538: write d7/f4e [121390,49899] 0 2024-09-21T00:56:36.382 INFO:tasks.workunit.client.1.smithi187.stdout:9/663: dread d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:36.383 INFO:tasks.workunit.client.1.smithi187.stdout:3/460: creat d9/d19/f95 x:0 0 0 2024-09-21T00:56:36.384 INFO:tasks.workunit.client.1.smithi187.stdout:3/461: chown d9/d13/d87/d94/d53/d75 1216 1 2024-09-21T00:56:36.385 INFO:tasks.workunit.client.1.smithi187.stdout:1/595: creat d4/d6/d23/d2e/d53/fbd x:0 0 0 2024-09-21T00:56:36.385 INFO:tasks.workunit.client.1.smithi187.stdout:3/462: stat d9/d13/d87/d94/d53/d56/f83 0 2024-09-21T00:56:36.385 INFO:tasks.workunit.client.1.smithi187.stdout:6/539: dread d7/d2a/d29/d40/d50/f73 [0,4194304] 0 2024-09-21T00:56:36.386 INFO:tasks.workunit.client.1.smithi187.stdout:6/540: readlink d7/l65 0 2024-09-21T00:56:36.387 INFO:tasks.workunit.client.1.smithi187.stdout:1/596: chown d4/d6/d23/d2e/d94/d66/cb4 17128 1 2024-09-21T00:56:36.387 INFO:tasks.workunit.client.1.smithi187.stdout:0/463: rename d0/d17/d1c/d23/df/d41/l64 to d0/d17/d18/d90/d98/l9c 0 2024-09-21T00:56:36.388 INFO:tasks.workunit.client.1.smithi187.stdout:4/505: link d2/d3/da/d2f/d32/d25/f2d d2/d3/da/d48/f9c 0 2024-09-21T00:56:36.389 INFO:tasks.workunit.client.1.smithi187.stdout:8/575: creat dc/d2f/d37/fbe x:0 0 0 2024-09-21T00:56:36.391 INFO:tasks.workunit.client.1.smithi187.stdout:5/472: link d0/f2d d0/dc/d1f/d26/d8b/fa1 0 2024-09-21T00:56:36.391 INFO:tasks.workunit.client.1.smithi187.stdout:6/541: truncate d7/d2a/d7a/fb3 838073 0 2024-09-21T00:56:36.392 INFO:tasks.workunit.client.1.smithi187.stdout:2/554: rename d2/da8/d1c/d2d/d8f/d9f/d8c/c93 to d2/da8/d1c/d2d/d8f/cc7 0 2024-09-21T00:56:36.392 INFO:tasks.workunit.client.1.smithi187.stdout:4/506: write d2/d3/d56/f87 [505731,99665] 0 2024-09-21T00:56:36.393 INFO:tasks.workunit.client.1.smithi187.stdout:0/464: rmdir d0/d17/d1c/d23/df 39 2024-09-21T00:56:36.395 INFO:tasks.workunit.client.1.smithi187.stdout:2/555: stat d2/da8/d3f/l5f 0 2024-09-21T00:56:36.395 INFO:tasks.workunit.client.1.smithi187.stdout:3/463: dwrite d9/f6b [0,4194304] 0 2024-09-21T00:56:36.395 INFO:tasks.workunit.client.1.smithi187.stdout:6/542: write d7/d2a/d29/f48 [282717,89790] 0 2024-09-21T00:56:36.396 INFO:tasks.workunit.client.1.smithi187.stdout:1/597: write d4/d6/d23/d2e/d53/d6a/f8f [891827,118025] 0 2024-09-21T00:56:36.399 INFO:tasks.workunit.client.1.smithi187.stdout:8/576: write dc/d2f/d34/d7d/f81 [4423455,129918] 0 2024-09-21T00:56:36.401 INFO:tasks.workunit.client.1.smithi187.stdout:1/598: mknod d4/d75/cbe 0 2024-09-21T00:56:36.401 INFO:tasks.workunit.client.1.smithi187.stdout:7/432: sync 2024-09-21T00:56:36.402 INFO:tasks.workunit.client.1.smithi187.stdout:1/599: dread - d4/d86/f8e zero size 2024-09-21T00:56:36.403 INFO:tasks.workunit.client.1.smithi187.stdout:9/664: dread d4/d8/f22 [0,4194304] 0 2024-09-21T00:56:36.405 INFO:tasks.workunit.client.1.smithi187.stdout:1/600: chown d4/c36 12 1 2024-09-21T00:56:36.405 INFO:tasks.workunit.client.1.smithi187.stdout:4/507: truncate d2/d3/da/d48/f6d 667174 0 2024-09-21T00:56:36.408 INFO:tasks.workunit.client.1.smithi187.stdout:3/464: rename d9/d19/d43/l5a to d9/d13/d87/d94/d89/l96 0 2024-09-21T00:56:36.408 INFO:tasks.workunit.client.1.smithi187.stdout:2/556: dwrite d2/dc/d6b/f96 [0,4194304] 0 2024-09-21T00:56:36.415 INFO:tasks.workunit.client.1.smithi187.stdout:1/601: creat d4/d6/d23/d2e/d94/d35/d22/d65/fbf x:0 0 0 2024-09-21T00:56:36.416 INFO:tasks.workunit.client.1.smithi187.stdout:3/465: dread d9/d13/f48 [0,4194304] 0 2024-09-21T00:56:36.417 INFO:tasks.workunit.client.1.smithi187.stdout:7/433: creat d1/dc/d15/d22/d3e/d7c/d97/f9b x:0 0 0 2024-09-21T00:56:36.419 INFO:tasks.workunit.client.1.smithi187.stdout:2/557: chown d2/da8/d1c/l90 2674 1 2024-09-21T00:56:36.420 INFO:tasks.workunit.client.1.smithi187.stdout:0/465: truncate d0/d17/f83 1218072 0 2024-09-21T00:56:36.420 INFO:tasks.workunit.client.1.smithi187.stdout:9/665: mkdir d4/d13/d20/dd4 0 2024-09-21T00:56:36.422 INFO:tasks.workunit.client.1.smithi187.stdout:8/577: mknod dc/d2f/d80/db8/dba/cbf 0 2024-09-21T00:56:36.422 INFO:tasks.workunit.client.1.smithi187.stdout:9/666: chown d4/d13/d14/c85 33 1 2024-09-21T00:56:36.422 INFO:tasks.workunit.client.1.smithi187.stdout:5/473: dread d0/dc/d39/d46/d67/f61 [0,4194304] 0 2024-09-21T00:56:36.424 INFO:tasks.workunit.client.1.smithi187.stdout:3/466: symlink d9/d19/d1c/d5f/l97 0 2024-09-21T00:56:36.426 INFO:tasks.workunit.client.1.smithi187.stdout:0/466: creat d0/d17/d1c/d65/f9d x:0 0 0 2024-09-21T00:56:36.427 INFO:tasks.workunit.client.1.smithi187.stdout:6/543: getdents d7/d2a/d29/d40/d6a/d88 0 2024-09-21T00:56:36.428 INFO:tasks.workunit.client.1.smithi187.stdout:5/474: write d0/f20 [1951414,23896] 0 2024-09-21T00:56:36.430 INFO:tasks.workunit.client.1.smithi187.stdout:5/475: write d0/dc/d39/d46/d67/d14/d38/d5a/f7d [646469,101964] 0 2024-09-21T00:56:36.430 INFO:tasks.workunit.client.1.smithi187.stdout:9/667: creat d4/d13/d20/d2b/d94/fd5 x:0 0 0 2024-09-21T00:56:36.431 INFO:tasks.workunit.client.1.smithi187.stdout:1/602: mkdir d4/d6/d23/d2e/dc0 0 2024-09-21T00:56:36.432 INFO:tasks.workunit.client.1.smithi187.stdout:4/508: dread d2/d3/da/d2f/d32/f8a [0,4194304] 0 2024-09-21T00:56:36.433 INFO:tasks.workunit.client.1.smithi187.stdout:7/434: creat d1/d55/d80/d87/f9c x:0 0 0 2024-09-21T00:56:36.434 INFO:tasks.workunit.client.1.smithi187.stdout:2/558: write d2/d3/df/f72 [1624352,119521] 0 2024-09-21T00:56:36.434 INFO:tasks.workunit.client.1.smithi187.stdout:3/467: mknod d9/d13/d87/d94/d89/c98 0 2024-09-21T00:56:36.436 INFO:tasks.workunit.client.1.smithi187.stdout:3/468: chown d9/d19/d1c/f8c 86 1 2024-09-21T00:56:36.436 INFO:tasks.workunit.client.1.smithi187.stdout:6/544: creat d7/d2a/d29/d40/fb8 x:0 0 0 2024-09-21T00:56:36.439 INFO:tasks.workunit.client.1.smithi187.stdout:1/603: rename d4/f8c to d4/d6/fc1 0 2024-09-21T00:56:36.440 INFO:tasks.workunit.client.1.smithi187.stdout:5/476: mknod d0/dc/d39/d46/d67/d30/d6b/ca2 0 2024-09-21T00:56:36.440 INFO:tasks.workunit.client.1.smithi187.stdout:4/509: mknod d2/d3/d56/d84/d60/c9d 0 2024-09-21T00:56:36.442 INFO:tasks.workunit.client.1.smithi187.stdout:7/435: creat d1/dc/d15/d2b/f9d x:0 0 0 2024-09-21T00:56:36.442 INFO:tasks.workunit.client.1.smithi187.stdout:2/559: creat d2/da8/d1c/d2d/d8f/d9f/d8c/fc8 x:0 0 0 2024-09-21T00:56:36.443 INFO:tasks.workunit.client.1.smithi187.stdout:0/467: symlink d0/d17/d1c/d23/df/l9e 0 2024-09-21T00:56:36.444 INFO:tasks.workunit.client.1.smithi187.stdout:3/469: dwrite d9/d13/d87/d94/d53/d56/f8e [0,4194304] 0 2024-09-21T00:56:36.444 INFO:tasks.workunit.client.1.smithi187.stdout:6/545: creat d7/d2a/d29/d40/fb9 x:0 0 0 2024-09-21T00:56:36.445 INFO:tasks.workunit.client.1.smithi187.stdout:4/510: readlink d2/d3/da/d2f/d32/d22/d4f/d89/l8c 0 2024-09-21T00:56:36.449 INFO:tasks.workunit.client.1.smithi187.stdout:9/668: rmdir d4/d13/d20/dd4 0 2024-09-21T00:56:36.453 INFO:tasks.workunit.client.1.smithi187.stdout:2/560: creat d2/da8/fc9 x:0 0 0 2024-09-21T00:56:36.456 INFO:tasks.workunit.client.1.smithi187.stdout:9/669: chown d4/d13/d14/d28/c5e 13 1 2024-09-21T00:56:36.457 INFO:tasks.workunit.client.1.smithi187.stdout:2/561: unlink d2/f78 0 2024-09-21T00:56:36.459 INFO:tasks.workunit.client.1.smithi187.stdout:0/468: dread d0/f11 [0,4194304] 0 2024-09-21T00:56:36.459 INFO:tasks.workunit.client.1.smithi187.stdout:6/546: dwrite d7/f8e [0,4194304] 0 2024-09-21T00:56:36.459 INFO:tasks.workunit.client.1.smithi187.stdout:3/470: creat d9/d13/d87/d94/d53/f99 x:0 0 0 2024-09-21T00:56:36.461 INFO:tasks.workunit.client.1.smithi187.stdout:1/604: dread d4/d6/d23/d2e/d94/f37 [0,4194304] 0 2024-09-21T00:56:36.461 INFO:tasks.workunit.client.1.smithi187.stdout:5/477: dwrite d0/dc/d39/d46/d67/f32 [0,4194304] 0 2024-09-21T00:56:36.464 INFO:tasks.workunit.client.1.smithi187.stdout:9/670: readlink d4/d10/d39/d69/lb9 0 2024-09-21T00:56:36.468 INFO:tasks.workunit.client.1.smithi187.stdout:4/511: dwrite d2/d3/d56/d84/d60/d6c/f91 [0,4194304] 0 2024-09-21T00:56:36.472 INFO:tasks.workunit.client.1.smithi187.stdout:1/605: mknod d4/d6/d23/d6f/cc2 0 2024-09-21T00:56:36.475 INFO:tasks.workunit.client.1.smithi187.stdout:3/471: dread d9/d13/d87/d94/d53/d56/f5d [0,4194304] 0 2024-09-21T00:56:36.478 INFO:tasks.workunit.client.1.smithi187.stdout:6/547: creat d7/d2a/fba x:0 0 0 2024-09-21T00:56:36.479 INFO:tasks.workunit.client.1.smithi187.stdout:1/606: readlink d4/d6/d49/la2 0 2024-09-21T00:56:36.479 INFO:tasks.workunit.client.1.smithi187.stdout:2/562: dwrite d2/dc/d2e/f82 [0,4194304] 0 2024-09-21T00:56:36.480 INFO:tasks.workunit.client.1.smithi187.stdout:4/512: mkdir d2/d3/d56/d84/d60/d9e 0 2024-09-21T00:56:36.482 INFO:tasks.workunit.client.1.smithi187.stdout:3/472: mkdir d9/d9a 0 2024-09-21T00:56:36.487 INFO:tasks.workunit.client.1.smithi187.stdout:6/548: fsync d7/d2a/d29/d40/d45/f76 0 2024-09-21T00:56:36.488 INFO:tasks.workunit.client.1.smithi187.stdout:7/436: dwrite d1/f1c [0,4194304] 0 2024-09-21T00:56:36.488 INFO:tasks.workunit.client.1.smithi187.stdout:0/469: dwrite d0/d17/d1c/d23/df/f32 [0,4194304] 0 2024-09-21T00:56:36.489 INFO:tasks.workunit.client.1.smithi187.stdout:2/563: creat d2/da8/d6c/fca x:0 0 0 2024-09-21T00:56:36.490 INFO:tasks.workunit.client.1.smithi187.stdout:5/478: dwrite d0/dc/d39/d46/d67/f73 [0,4194304] 0 2024-09-21T00:56:36.492 INFO:tasks.workunit.client.1.smithi187.stdout:7/437: read - d1/dc/d15/d22/f4f zero size 2024-09-21T00:56:36.493 INFO:tasks.workunit.client.1.smithi187.stdout:3/473: mkdir d9/d19/d9b 0 2024-09-21T00:56:36.493 INFO:tasks.workunit.client.1.smithi187.stdout:6/549: write d7/d59/f42 [1807258,80144] 0 2024-09-21T00:56:36.494 INFO:tasks.workunit.client.1.smithi187.stdout:4/513: write d2/d3/da/d2f/d32/f8a [6303020,103554] 0 2024-09-21T00:56:36.497 INFO:tasks.workunit.client.1.smithi187.stdout:0/470: chown d0/d17/d1c/d23/df/d41/c34 1 1 2024-09-21T00:56:36.499 INFO:tasks.workunit.client.1.smithi187.stdout:3/474: mkdir d9/d13/d9c 0 2024-09-21T00:56:36.500 INFO:tasks.workunit.client.1.smithi187.stdout:2/564: truncate d2/da8/d6c/d97/da1/fa4 5182174 0 2024-09-21T00:56:36.501 INFO:tasks.workunit.client.1.smithi187.stdout:0/471: fsync d0/f11 0 2024-09-21T00:56:36.502 INFO:tasks.workunit.client.1.smithi187.stdout:6/550: mknod d7/d2a/d7a/cbb 0 2024-09-21T00:56:36.505 INFO:tasks.workunit.client.1.smithi187.stdout:2/565: mknod d2/da8/ccb 0 2024-09-21T00:56:36.507 INFO:tasks.workunit.client.1.smithi187.stdout:6/551: chown d7/d2a/d29/d40/d6a/d88/f9c 5680185 1 2024-09-21T00:56:36.507 INFO:tasks.workunit.client.1.smithi187.stdout:0/472: rmdir d0/d17/d1c/d23/df 39 2024-09-21T00:56:36.508 INFO:tasks.workunit.client.1.smithi187.stdout:7/438: dwrite d1/d18/d31/d33/d3b/f3f [0,4194304] 0 2024-09-21T00:56:36.509 INFO:tasks.workunit.client.1.smithi187.stdout:5/479: rename d0/dc/d39/c76 to d0/dc/d39/d46/d67/d14/d1b/ca3 0 2024-09-21T00:56:36.511 INFO:tasks.workunit.client.1.smithi187.stdout:2/566: truncate d2/dc/d2e/d6f/f8a 418987 0 2024-09-21T00:56:36.511 INFO:tasks.workunit.client.1.smithi187.stdout:3/475: mkdir d9/d13/d87/d94/d53/d56/d7d/d81/d9d 0 2024-09-21T00:56:36.512 INFO:tasks.workunit.client.1.smithi187.stdout:6/552: mkdir d7/d2a/d29/d40/d6a/dbc 0 2024-09-21T00:56:36.512 INFO:tasks.workunit.client.1.smithi187.stdout:5/480: mknod d0/dc/ca4 0 2024-09-21T00:56:36.514 INFO:tasks.workunit.client.1.smithi187.stdout:7/439: mknod d1/dc/d15/d22/c9e 0 2024-09-21T00:56:36.515 INFO:tasks.workunit.client.1.smithi187.stdout:6/553: dread - d7/d2a/fba zero size 2024-09-21T00:56:36.516 INFO:tasks.workunit.client.1.smithi187.stdout:9/671: dread d4/d13/d14/d1d/f63 [0,4194304] 0 2024-09-21T00:56:36.516 INFO:tasks.workunit.client.1.smithi187.stdout:7/440: chown d1/d18/d31/d33 28 1 2024-09-21T00:56:36.519 INFO:tasks.workunit.client.1.smithi187.stdout:3/476: mknod d9/d19/d1c/c9e 0 2024-09-21T00:56:36.519 INFO:tasks.workunit.client.1.smithi187.stdout:0/473: truncate d0/d17/d1c/d23/df/d41/d3b/f94 30528 0 2024-09-21T00:56:36.519 INFO:tasks.workunit.client.1.smithi187.stdout:5/481: write d0/dc/d39/d46/d67/d30/f65 [758745,19179] 0 2024-09-21T00:56:36.522 INFO:tasks.workunit.client.1.smithi187.stdout:7/441: read d1/d18/d31/d33/d3b/f66 [212740,54308] 0 2024-09-21T00:56:36.524 INFO:tasks.workunit.client.1.smithi187.stdout:3/477: mknod d9/d13/d87/d94/d89/c9f 0 2024-09-21T00:56:36.525 INFO:tasks.workunit.client.1.smithi187.stdout:0/474: fsync d0/d17/d1c/d23/df/d41/d3b/f59 0 2024-09-21T00:56:36.525 INFO:tasks.workunit.client.1.smithi187.stdout:7/442: write d1/dc/f13 [4475835,46987] 0 2024-09-21T00:56:36.527 INFO:tasks.workunit.client.1.smithi187.stdout:5/482: write d0/dc/d39/d46/d67/d30/f3b [5234321,14338] 0 2024-09-21T00:56:36.528 INFO:tasks.workunit.client.1.smithi187.stdout:6/554: dwrite d7/d2a/d29/f60 [0,4194304] 0 2024-09-21T00:56:36.535 INFO:tasks.workunit.client.1.smithi187.stdout:4/514: dread d2/d3/da/d16/f3c [0,4194304] 0 2024-09-21T00:56:36.535 INFO:tasks.workunit.client.1.smithi187.stdout:6/555: creat d7/d59/fbd x:0 0 0 2024-09-21T00:56:36.536 INFO:tasks.workunit.client.1.smithi187.stdout:6/556: stat d7/d59/laf 0 2024-09-21T00:56:36.536 INFO:tasks.workunit.client.1.smithi187.stdout:4/515: dread - d2/d3/da/d16/f5c zero size 2024-09-21T00:56:36.536 INFO:tasks.workunit.client.1.smithi187.stdout:0/475: rmdir d0/d17/d1c/d23/df/d41 39 2024-09-21T00:56:36.538 INFO:tasks.workunit.client.1.smithi187.stdout:0/476: stat d0/d17/d1c/d23/df/d51 0 2024-09-21T00:56:36.538 INFO:tasks.workunit.client.1.smithi187.stdout:7/443: fdatasync d1/f9 0 2024-09-21T00:56:36.539 INFO:tasks.workunit.client.1.smithi187.stdout:0/477: readlink d0/d17/d1c/d23/df/l9e 0 2024-09-21T00:56:36.540 INFO:tasks.workunit.client.1.smithi187.stdout:3/478: mknod d9/d13/d87/d94/d53/d56/d7d/ca0 0 2024-09-21T00:56:36.541 INFO:tasks.workunit.client.1.smithi187.stdout:7/444: fsync d1/dc/d15/d22/d3e/d73/d8b/f96 0 2024-09-21T00:56:36.541 INFO:tasks.workunit.client.1.smithi187.stdout:6/557: rmdir d7/d2a/d29/d40/d45 39 2024-09-21T00:56:36.541 INFO:tasks.workunit.client.1.smithi187.stdout:9/672: dread d4/d10/f11 [0,4194304] 0 2024-09-21T00:56:36.542 INFO:tasks.workunit.client.1.smithi187.stdout:2/567: dread d2/da8/d1c/f6a [0,4194304] 0 2024-09-21T00:56:36.542 INFO:tasks.workunit.client.1.smithi187.stdout:3/479: fsync d9/d19/d1c/f8c 0 2024-09-21T00:56:36.544 INFO:tasks.workunit.client.1.smithi187.stdout:6/558: write d7/d2a/d29/d40/fae [1016307,76501] 0 2024-09-21T00:56:36.544 INFO:tasks.workunit.client.1.smithi187.stdout:0/478: mkdir d0/d60/d6b/d9f 0 2024-09-21T00:56:36.546 INFO:tasks.workunit.client.1.smithi187.stdout:4/516: dread d2/d3/da/d2f/d32/d22/d4f/f62 [0,4194304] 0 2024-09-21T00:56:36.546 INFO:tasks.workunit.client.1.smithi187.stdout:6/559: fsync d7/f84 0 2024-09-21T00:56:36.547 INFO:tasks.workunit.client.1.smithi187.stdout:5/483: rename d0/dc/d39/d46/d67/f73 to d0/fa5 0 2024-09-21T00:56:36.548 INFO:tasks.workunit.client.1.smithi187.stdout:2/568: creat d2/da8/d1c/d2d/d8f/d9f/fcc x:0 0 0 2024-09-21T00:56:36.549 INFO:tasks.workunit.client.1.smithi187.stdout:8/578: sync 2024-09-21T00:56:36.549 INFO:tasks.workunit.client.1.smithi187.stdout:9/673: mknod d4/d8/d41/cd6 0 2024-09-21T00:56:36.550 INFO:tasks.workunit.client.1.smithi187.stdout:5/484: read d0/dc/d39/d46/d67/d14/d38/f82 [84708,60133] 0 2024-09-21T00:56:36.550 INFO:tasks.workunit.client.1.smithi187.stdout:0/479: fdatasync d0/d17/d18/d3a/d97/f9b 0 2024-09-21T00:56:36.551 INFO:tasks.workunit.client.1.smithi187.stdout:9/674: fsync d4/d13/d20/d2b/d94/fae 0 2024-09-21T00:56:36.551 INFO:tasks.workunit.client.1.smithi187.stdout:4/517: rmdir d2/d3/da 39 2024-09-21T00:56:36.551 INFO:tasks.workunit.client.1.smithi187.stdout:5/485: write d0/f20 [3132297,81358] 0 2024-09-21T00:56:36.553 INFO:tasks.workunit.client.1.smithi187.stdout:6/560: chown d7/d2a/d29/d40/d45/f5a 3448 1 2024-09-21T00:56:36.553 INFO:tasks.workunit.client.1.smithi187.stdout:3/480: rename d9/d19/d1c/d5f/c70 to d9/d13/d87/d94/d53/d56/d7d/d81/d9d/ca1 0 2024-09-21T00:56:36.555 INFO:tasks.workunit.client.1.smithi187.stdout:6/561: chown d7/d2a/d29/lb7 26403 1 2024-09-21T00:56:36.556 INFO:tasks.workunit.client.1.smithi187.stdout:3/481: write d9/d13/d87/d94/d53/f99 [471628,52564] 0 2024-09-21T00:56:36.556 INFO:tasks.workunit.client.1.smithi187.stdout:8/579: write dc/d2f/d54/d69/fa0 [971408,30167] 0 2024-09-21T00:56:36.560 INFO:tasks.workunit.client.1.smithi187.stdout:2/569: mkdir d2/da8/d1c/dc6/dcd 0 2024-09-21T00:56:36.561 INFO:tasks.workunit.client.1.smithi187.stdout:3/482: write d9/d13/d87/d94/d53/f99 [280933,93764] 0 2024-09-21T00:56:36.564 INFO:tasks.workunit.client.1.smithi187.stdout:7/445: dread d1/dc/d15/d22/d3e/f71 [0,4194304] 0 2024-09-21T00:56:36.564 INFO:tasks.workunit.client.1.smithi187.stdout:8/580: creat dc/d2f/d37/fc0 x:0 0 0 2024-09-21T00:56:36.565 INFO:tasks.workunit.client.1.smithi187.stdout:7/446: chown d1/dc/d15/d2b/c3c 1317769894 1 2024-09-21T00:56:36.565 INFO:tasks.workunit.client.1.smithi187.stdout:7/447: write d1/f2 [3796835,130379] 0 2024-09-21T00:56:36.567 INFO:tasks.workunit.client.1.smithi187.stdout:5/486: unlink d0/dc/d39/d46/d67/d14/d57/l90 0 2024-09-21T00:56:36.567 INFO:tasks.workunit.client.1.smithi187.stdout:1/607: sync 2024-09-21T00:56:36.569 INFO:tasks.workunit.client.1.smithi187.stdout:9/675: dread d4/d13/fb8 [0,4194304] 0 2024-09-21T00:56:36.569 INFO:tasks.workunit.client.1.smithi187.stdout:5/487: chown d0/dc/d39/d46/d67/d14/d1b/d27/d3a 0 1 2024-09-21T00:56:36.570 INFO:tasks.workunit.client.1.smithi187.stdout:2/570: write d2/d3/d15/fb1 [775980,128053] 0 2024-09-21T00:56:36.571 INFO:tasks.workunit.client.1.smithi187.stdout:9/676: chown d4/d8/d44/cc7 8935096 1 2024-09-21T00:56:36.571 INFO:tasks.workunit.client.1.smithi187.stdout:4/518: rename d2/d3/da/d2f/l5a to d2/d3/da/d2f/d32/d26/d66/d6e/l9f 0 2024-09-21T00:56:36.576 INFO:tasks.workunit.client.1.smithi187.stdout:6/562: truncate d7/d2a/d29/f48 140909 0 2024-09-21T00:56:36.577 INFO:tasks.workunit.client.1.smithi187.stdout:9/677: dwrite d4/d8/d46/d54/f55 [0,4194304] 0 2024-09-21T00:56:36.579 INFO:tasks.workunit.client.1.smithi187.stdout:5/488: symlink d0/dc/d39/d46/d67/d14/d1b/d27/la6 0 2024-09-21T00:56:36.582 INFO:tasks.workunit.client.1.smithi187.stdout:0/480: truncate d0/d17/d1c/d23/df/d41/f42 3107360 0 2024-09-21T00:56:36.584 INFO:tasks.workunit.client.1.smithi187.stdout:1/608: dwrite d4/d6/d23/d2e/f3f [4194304,4194304] 0 2024-09-21T00:56:36.588 INFO:tasks.workunit.client.1.smithi187.stdout:6/563: symlink d7/d2a/d7a/lbe 0 2024-09-21T00:56:36.588 INFO:tasks.workunit.client.1.smithi187.stdout:9/678: dwrite d4/d13/d20/d2b/d66/f74 [0,4194304] 0 2024-09-21T00:56:36.595 INFO:tasks.workunit.client.1.smithi187.stdout:2/571: link d2/da8/d1c/d2d/d8f/d9f/fa2 d2/dc/d2e/d6f/fce 0 2024-09-21T00:56:36.596 INFO:tasks.workunit.client.1.smithi187.stdout:8/581: mkdir dc/d44/dc1 0 2024-09-21T00:56:36.597 INFO:tasks.workunit.client.1.smithi187.stdout:7/448: truncate d1/f2 1799234 0 2024-09-21T00:56:36.601 INFO:tasks.workunit.client.1.smithi187.stdout:4/519: dwrite d2/d3/da/d2f/d32/d24/f28 [0,4194304] 0 2024-09-21T00:56:36.601 INFO:tasks.workunit.client.1.smithi187.stdout:6/564: symlink d7/d2a/d29/d40/d45/lbf 0 2024-09-21T00:56:36.603 INFO:tasks.workunit.client.1.smithi187.stdout:2/572: creat d2/da8/d6c/db8/d40/fcf x:0 0 0 2024-09-21T00:56:36.604 INFO:tasks.workunit.client.1.smithi187.stdout:3/483: getdents d9/d13/d87 0 2024-09-21T00:56:36.604 INFO:tasks.workunit.client.1.smithi187.stdout:0/481: mknod d0/d17/d1c/d23/df/ca0 0 2024-09-21T00:56:36.605 INFO:tasks.workunit.client.1.smithi187.stdout:8/582: creat dc/d2f/d80/db8/dba/d3e/fc2 x:0 0 0 2024-09-21T00:56:36.607 INFO:tasks.workunit.client.1.smithi187.stdout:3/484: read d9/d7f/f85 [253524,61328] 0 2024-09-21T00:56:36.609 INFO:tasks.workunit.client.1.smithi187.stdout:2/573: write d2/dc/f65 [1202738,104939] 0 2024-09-21T00:56:36.609 INFO:tasks.workunit.client.1.smithi187.stdout:7/449: rename d1/d18/d31/d5a to d1/d18/d31/d33/d3b/d9f 0 2024-09-21T00:56:36.612 INFO:tasks.workunit.client.1.smithi187.stdout:4/520: dread d2/d3/da/d2f/d32/d22/f49 [0,4194304] 0 2024-09-21T00:56:36.613 INFO:tasks.workunit.client.1.smithi187.stdout:7/450: stat d1/dc/d15/d22/d3e/d7c 0 2024-09-21T00:56:36.613 INFO:tasks.workunit.client.1.smithi187.stdout:2/574: dread - d2/dc/d2e/f86 zero size 2024-09-21T00:56:36.614 INFO:tasks.workunit.client.1.smithi187.stdout:5/489: chown d0/dc/d39/d46/d67/l45 3801 1 2024-09-21T00:56:36.615 INFO:tasks.workunit.client.1.smithi187.stdout:8/583: rename dc/d94/fbc to dc/fc3 0 2024-09-21T00:56:36.617 INFO:tasks.workunit.client.1.smithi187.stdout:3/485: write d9/d13/d87/d94/d53/d56/d7d/f86 [1309052,13942] 0 2024-09-21T00:56:36.618 INFO:tasks.workunit.client.1.smithi187.stdout:0/482: dwrite d0/f70 [0,4194304] 0 2024-09-21T00:56:36.618 INFO:tasks.workunit.client.1.smithi187.stdout:7/451: readlink d1/l38 0 2024-09-21T00:56:36.621 INFO:tasks.workunit.client.1.smithi187.stdout:4/521: truncate d2/d3/da/d2f/d4b/f6a 654652 0 2024-09-21T00:56:36.624 INFO:tasks.workunit.client.1.smithi187.stdout:7/452: dread - d1/dc/d15/d2b/f9d zero size 2024-09-21T00:56:36.624 INFO:tasks.workunit.client.1.smithi187.stdout:1/609: dread d4/d6/f1c [0,4194304] 0 2024-09-21T00:56:36.625 INFO:tasks.workunit.client.1.smithi187.stdout:8/584: fsync dc/d2f/d80/db8/dba/f21 0 2024-09-21T00:56:36.625 INFO:tasks.workunit.client.1.smithi187.stdout:4/522: chown d2/d3/da/d48 20 1 2024-09-21T00:56:36.626 INFO:tasks.workunit.client.1.smithi187.stdout:0/483: creat d0/d17/d1c/d23/d36/fa1 x:0 0 0 2024-09-21T00:56:36.628 INFO:tasks.workunit.client.1.smithi187.stdout:1/610: chown d4/d6/d23/d2e/d94/l61 13244980 1 2024-09-21T00:56:36.629 INFO:tasks.workunit.client.1.smithi187.stdout:8/585: dread dc/f28 [0,4194304] 0 2024-09-21T00:56:36.630 INFO:tasks.workunit.client.1.smithi187.stdout:5/490: dread d0/dc/d39/d46/d67/d14/f21 [0,4194304] 0 2024-09-21T00:56:36.632 INFO:tasks.workunit.client.1.smithi187.stdout:7/453: symlink d1/d18/d31/d33/d3b/d9f/d75/la0 0 2024-09-21T00:56:36.633 INFO:tasks.workunit.client.1.smithi187.stdout:6/565: truncate d7/d59/f1d 4964059 0 2024-09-21T00:56:36.634 INFO:tasks.workunit.client.1.smithi187.stdout:9/679: dread d4/d10/f4a [0,4194304] 0 2024-09-21T00:56:36.634 INFO:tasks.workunit.client.1.smithi187.stdout:0/484: rename d0/d17/d1c/d23/df/d41/d3b/d46/l4e to d0/d17/d18/d3a/d97/la2 0 2024-09-21T00:56:36.640 INFO:tasks.workunit.client.1.smithi187.stdout:4/523: dwrite d2/d3/d74/f80 [0,4194304] 0 2024-09-21T00:56:36.644 INFO:tasks.workunit.client.1.smithi187.stdout:1/611: link d4/d6/d23/f3d d4/d6/fc3 0 2024-09-21T00:56:36.644 INFO:tasks.workunit.client.1.smithi187.stdout:7/454: unlink d1/d55/d80/d87/f9c 0 2024-09-21T00:56:36.645 INFO:tasks.workunit.client.1.smithi187.stdout:4/524: stat d2/d3/da/d48/f9c 0 2024-09-21T00:56:36.645 INFO:tasks.workunit.client.1.smithi187.stdout:0/485: dread - d0/d17/d1c/d23/f99 zero size 2024-09-21T00:56:36.651 INFO:tasks.workunit.client.1.smithi187.stdout:2/575: dwrite d2/dc/f46 [0,4194304] 0 2024-09-21T00:56:36.651 INFO:tasks.workunit.client.1.smithi187.stdout:7/455: unlink d1/d18/l1b 0 2024-09-21T00:56:36.651 INFO:tasks.workunit.client.1.smithi187.stdout:8/586: dwrite dc/f24 [4194304,4194304] 0 2024-09-21T00:56:36.654 INFO:tasks.workunit.client.1.smithi187.stdout:6/566: link d7/f4e d7/d2a/d29/d40/d50/d68/fc0 0 2024-09-21T00:56:36.655 INFO:tasks.workunit.client.1.smithi187.stdout:6/567: chown d7/l65 360056501 1 2024-09-21T00:56:36.656 INFO:tasks.workunit.client.1.smithi187.stdout:4/525: write d2/d3/da/d2f/d4b/f6a [186716,70179] 0 2024-09-21T00:56:36.658 INFO:tasks.workunit.client.1.smithi187.stdout:7/456: creat d1/dc/d15/fa1 x:0 0 0 2024-09-21T00:56:36.660 INFO:tasks.workunit.client.1.smithi187.stdout:1/612: creat d4/d6/d23/d2e/d94/d35/d22/fc4 x:0 0 0 2024-09-21T00:56:36.662 INFO:tasks.workunit.client.1.smithi187.stdout:8/587: chown dc/d44/fb4 270235350 1 2024-09-21T00:56:36.662 INFO:tasks.workunit.client.1.smithi187.stdout:4/526: rmdir d2/d3/d56/d84/d60/d6c/d77 39 2024-09-21T00:56:36.665 INFO:tasks.workunit.client.1.smithi187.stdout:6/568: dwrite d7/d2a/d29/f43 [0,4194304] 0 2024-09-21T00:56:36.665 INFO:tasks.workunit.client.1.smithi187.stdout:8/588: rmdir dc/d2f/d34/d7d 39 2024-09-21T00:56:36.668 INFO:tasks.workunit.client.1.smithi187.stdout:8/589: dread - dc/d2f/d34/f7c zero size 2024-09-21T00:56:36.670 INFO:tasks.workunit.client.1.smithi187.stdout:4/527: mknod d2/d3/da/d2f/d32/d22/d37/d63/ca0 0 2024-09-21T00:56:36.671 INFO:tasks.workunit.client.1.smithi187.stdout:7/457: link d1/dc/c10 d1/dc/d15/d22/d3e/d73/ca2 0 2024-09-21T00:56:36.673 INFO:tasks.workunit.client.1.smithi187.stdout:8/590: chown dc/d2f/d37/f66 217727984 1 2024-09-21T00:56:36.675 INFO:tasks.workunit.client.1.smithi187.stdout:4/528: write d2/d3/da/f5b [1154350,93016] 0 2024-09-21T00:56:36.678 INFO:tasks.workunit.client.1.smithi187.stdout:8/591: creat dc/d2f/d34/d4b/fc4 x:0 0 0 2024-09-21T00:56:36.678 INFO:tasks.workunit.client.1.smithi187.stdout:7/458: truncate d1/d18/d31/d41/f6a 410669 0 2024-09-21T00:56:36.678 INFO:tasks.workunit.client.1.smithi187.stdout:1/613: dwrite d4/d6/d23/d2e/d94/f31 [4194304,4194304] 0 2024-09-21T00:56:36.681 INFO:tasks.workunit.client.1.smithi187.stdout:4/529: readlink d2/d3/da/d2f/d32/d26/d66/d6e/l9f 0 2024-09-21T00:56:36.683 INFO:tasks.workunit.client.1.smithi187.stdout:8/592: fsync dc/d2f/d80/db8/dba/d29/da7/fb5 0 2024-09-21T00:56:36.683 INFO:tasks.workunit.client.1.smithi187.stdout:1/614: rmdir d4/d6/d23/d2e/d94/d35/d22/d2c/d9f 39 2024-09-21T00:56:36.685 INFO:tasks.workunit.client.1.smithi187.stdout:7/459: mknod d1/d18/d31/d41/ca3 0 2024-09-21T00:56:36.685 INFO:tasks.workunit.client.1.smithi187.stdout:4/530: write d2/d3/da/f5b [572817,53965] 0 2024-09-21T00:56:36.686 INFO:tasks.workunit.client.1.smithi187.stdout:8/593: stat dc/d44/f55 0 2024-09-21T00:56:36.687 INFO:tasks.workunit.client.1.smithi187.stdout:6/569: truncate d7/f4e 1947509 0 2024-09-21T00:56:36.689 INFO:tasks.workunit.client.1.smithi187.stdout:0/486: dread d0/d17/d18/f24 [0,4194304] 0 2024-09-21T00:56:36.691 INFO:tasks.workunit.client.1.smithi187.stdout:4/531: mkdir d2/d3/da/d2f/d32/d22/d37/da1 0 2024-09-21T00:56:36.691 INFO:tasks.workunit.client.1.smithi187.stdout:2/576: dread d2/fa [0,4194304] 0 2024-09-21T00:56:36.692 INFO:tasks.workunit.client.1.smithi187.stdout:1/615: creat d4/d6/d23/d2e/d53/fc5 x:0 0 0 2024-09-21T00:56:36.694 INFO:tasks.workunit.client.1.smithi187.stdout:2/577: dread - d2/da8/d6c/fca zero size 2024-09-21T00:56:36.695 INFO:tasks.workunit.client.1.smithi187.stdout:8/594: creat dc/d2f/d80/db8/dba/d29/da7/fc5 x:0 0 0 2024-09-21T00:56:36.698 INFO:tasks.workunit.client.1.smithi187.stdout:7/460: dwrite d1/d18/d31/f36 [0,4194304] 0 2024-09-21T00:56:36.700 INFO:tasks.workunit.client.1.smithi187.stdout:2/578: rename d2/d25/f50 to d2/da8/d6c/d97/da1/fd0 0 2024-09-21T00:56:36.703 INFO:tasks.workunit.client.1.smithi187.stdout:2/579: write d2/dc/d6b/f96 [296574,79432] 0 2024-09-21T00:56:36.705 INFO:tasks.workunit.client.1.smithi187.stdout:1/616: creat d4/d6/d23/d2e/d94/d35/d22/d2c/fc6 x:0 0 0 2024-09-21T00:56:36.706 INFO:tasks.workunit.client.1.smithi187.stdout:1/617: stat d4/d6/d23/d2e/d94/f37 0 2024-09-21T00:56:36.707 INFO:tasks.workunit.client.1.smithi187.stdout:2/580: creat d2/dc/d21/fd1 x:0 0 0 2024-09-21T00:56:36.707 INFO:tasks.workunit.client.1.smithi187.stdout:1/618: write d4/f76 [275806,77772] 0 2024-09-21T00:56:36.711 INFO:tasks.workunit.client.1.smithi187.stdout:2/581: unlink d2/da8/d1c/f32 0 2024-09-21T00:56:36.711 INFO:tasks.workunit.client.1.smithi187.stdout:0/487: write d0/d17/d1c/d23/df/d41/f8e [81957,103212] 0 2024-09-21T00:56:36.712 INFO:tasks.workunit.client.1.smithi187.stdout:0/488: readlink d0/d17/l75 0 2024-09-21T00:56:36.713 INFO:tasks.workunit.client.1.smithi187.stdout:4/532: dread d2/d3/da/f5b [0,4194304] 0 2024-09-21T00:56:36.713 INFO:tasks.workunit.client.1.smithi187.stdout:7/461: link d1/dc/d15/d22/d3e/d73/f7d d1/d18/d31/d41/d64/d93/fa4 0 2024-09-21T00:56:36.714 INFO:tasks.workunit.client.1.smithi187.stdout:1/619: rmdir d4/d6/d23/d2e/d94 39 2024-09-21T00:56:36.714 INFO:tasks.workunit.client.1.smithi187.stdout:0/489: fdatasync d0/d17/d1c/d65/f7d 0 2024-09-21T00:56:36.715 INFO:tasks.workunit.client.1.smithi187.stdout:7/462: chown d1/d55/c6f 10156 1 2024-09-21T00:56:36.715 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:36 smithi112 ceph-mon[28078]: pgmap v21: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 172 MiB/s wr, 449 op/s 2024-09-21T00:56:36.719 INFO:tasks.workunit.client.1.smithi187.stdout:0/490: creat d0/d17/d1c/d23/d36/fa3 x:0 0 0 2024-09-21T00:56:36.721 INFO:tasks.workunit.client.1.smithi187.stdout:7/463: write d1/d18/d31/d41/d64/d93/fa4 [4367403,8719] 0 2024-09-21T00:56:36.721 INFO:tasks.workunit.client.1.smithi187.stdout:4/533: dwrite d2/d3/da/fc [0,4194304] 0 2024-09-21T00:56:36.721 INFO:tasks.workunit.client.1.smithi187.stdout:1/620: symlink d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/lc7 0 2024-09-21T00:56:36.727 INFO:tasks.workunit.client.1.smithi187.stdout:6/570: dwrite d7/d2a/d29/d40/d50/d68/fc0 [0,4194304] 0 2024-09-21T00:56:36.728 INFO:tasks.workunit.client.1.smithi187.stdout:1/621: read - d4/d6/d23/d2e/d53/fbb zero size 2024-09-21T00:56:36.731 INFO:tasks.workunit.client.1.smithi187.stdout:8/595: dread dc/d2f/f41 [0,4194304] 0 2024-09-21T00:56:36.731 INFO:tasks.workunit.client.1.smithi187.stdout:4/534: mkdir d2/d3/d56/d84/d58/da2 0 2024-09-21T00:56:36.735 INFO:tasks.workunit.client.1.smithi187.stdout:4/535: write d2/d3/f21 [6609826,106282] 0 2024-09-21T00:56:36.739 INFO:tasks.workunit.client.1.smithi187.stdout:4/536: chown d2/d3/c3e 50 1 2024-09-21T00:56:36.739 INFO:tasks.workunit.client.1.smithi187.stdout:7/464: write d1/f68 [540415,95540] 0 2024-09-21T00:56:36.739 INFO:tasks.workunit.client.1.smithi187.stdout:0/491: dwrite d0/d17/d1c/d23/df/d41/d3b/f94 [0,4194304] 0 2024-09-21T00:56:36.747 INFO:tasks.workunit.client.1.smithi187.stdout:4/537: fsync d2/d3/d74/f92 0 2024-09-21T00:56:36.750 INFO:tasks.workunit.client.1.smithi187.stdout:8/596: dwrite dc/f49 [4194304,4194304] 0 2024-09-21T00:56:36.750 INFO:tasks.workunit.client.1.smithi187.stdout:1/622: dwrite d4/d6/d23/d2e/d94/f13 [0,4194304] 0 2024-09-21T00:56:36.751 INFO:tasks.workunit.client.1.smithi187.stdout:7/465: unlink d1/d18/d31/d33/d3b/f7e 0 2024-09-21T00:56:36.751 INFO:tasks.workunit.client.1.smithi187.stdout:3/486: sync 2024-09-21T00:56:36.759 INFO:tasks.workunit.client.1.smithi187.stdout:8/597: dread - dc/d2f/d37/fbe zero size 2024-09-21T00:56:36.759 INFO:tasks.workunit.client.1.smithi187.stdout:7/466: chown d1/c4b 9 1 2024-09-21T00:56:36.761 INFO:tasks.workunit.client.1.smithi187.stdout:6/571: dwrite d7/f4a [0,4194304] 0 2024-09-21T00:56:36.761 INFO:tasks.workunit.client.1.smithi187.stdout:1/623: symlink d4/lc8 0 2024-09-21T00:56:36.764 INFO:tasks.workunit.client.1.smithi187.stdout:4/538: creat d2/d3/da/d2f/d4b/d7e/fa3 x:0 0 0 2024-09-21T00:56:36.765 INFO:tasks.workunit.client.1.smithi187.stdout:0/492: dwrite d0/d17/d1c/f7a [0,4194304] 0 2024-09-21T00:56:36.768 INFO:tasks.workunit.client.1.smithi187.stdout:6/572: truncate d7/d59/fbd 535696 0 2024-09-21T00:56:36.770 INFO:tasks.workunit.client.1.smithi187.stdout:1/624: truncate d4/d6/d23/fb2 352236 0 2024-09-21T00:56:36.772 INFO:tasks.workunit.client.1.smithi187.stdout:8/598: creat dc/d2f/d80/db8/dba/d29/fc6 x:0 0 0 2024-09-21T00:56:36.772 INFO:tasks.workunit.client.1.smithi187.stdout:3/487: truncate d9/d19/d1c/d5f/f92 3347622 0 2024-09-21T00:56:36.773 INFO:tasks.workunit.client.1.smithi187.stdout:7/467: unlink d1/dc/d15/d22/c28 0 2024-09-21T00:56:36.775 INFO:tasks.workunit.client.1.smithi187.stdout:6/573: write d7/d2a/d29/f7c [272845,110019] 0 2024-09-21T00:56:36.778 INFO:tasks.workunit.client.1.smithi187.stdout:8/599: chown dc/d2f/c3f 1407808 1 2024-09-21T00:56:36.778 INFO:tasks.workunit.client.1.smithi187.stdout:7/468: chown d1/dc/d15/f57 54125 1 2024-09-21T00:56:36.778 INFO:tasks.workunit.client.1.smithi187.stdout:2/582: dread d2/dc/d2e/d4a/d7c/f2b [0,4194304] 0 2024-09-21T00:56:36.779 INFO:tasks.workunit.client.1.smithi187.stdout:0/493: dwrite d0/d17/d18/f78 [0,4194304] 0 2024-09-21T00:56:36.779 INFO:tasks.workunit.client.1.smithi187.stdout:9/680: sync 2024-09-21T00:56:36.782 INFO:tasks.workunit.client.1.smithi187.stdout:8/600: dread - dc/d2f/d34/d7d/fa3 zero size 2024-09-21T00:56:36.782 INFO:tasks.workunit.client.1.smithi187.stdout:2/583: truncate d2/da8/d3f/fb9 941624 0 2024-09-21T00:56:36.783 INFO:tasks.workunit.client.1.smithi187.stdout:0/494: dread - d0/d17/d1c/d23/d36/f91 zero size 2024-09-21T00:56:36.783 INFO:tasks.workunit.client.1.smithi187.stdout:6/574: creat d7/d2a/d29/d40/d6a/dbc/fc1 x:0 0 0 2024-09-21T00:56:36.784 INFO:tasks.workunit.client.1.smithi187.stdout:9/681: unlink d4/d13/d14/d83/c9b 0 2024-09-21T00:56:36.786 INFO:tasks.workunit.client.1.smithi187.stdout:0/495: chown d0/d17/d1c/d23 5 1 2024-09-21T00:56:36.786 INFO:tasks.workunit.client.1.smithi187.stdout:8/601: write dc/f49 [5074179,121306] 0 2024-09-21T00:56:36.786 INFO:tasks.workunit.client.1.smithi187.stdout:6/575: write d7/f84 [666660,11100] 0 2024-09-21T00:56:36.787 INFO:tasks.workunit.client.1.smithi187.stdout:9/682: fdatasync d4/d61/d6c/fbd 0 2024-09-21T00:56:36.788 INFO:tasks.workunit.client.1.smithi187.stdout:2/584: symlink d2/d3/d15/ld2 0 2024-09-21T00:56:36.788 INFO:tasks.workunit.client.1.smithi187.stdout:5/491: sync 2024-09-21T00:56:36.791 INFO:tasks.workunit.client.1.smithi187.stdout:6/576: stat d7/d59/fbd 0 2024-09-21T00:56:36.793 INFO:tasks.workunit.client.1.smithi187.stdout:2/585: chown d2/da8/d1c/c71 174013 1 2024-09-21T00:56:36.795 INFO:tasks.workunit.client.1.smithi187.stdout:9/683: mknod d4/d13/d14/d1d/d5f/cd7 0 2024-09-21T00:56:36.796 INFO:tasks.workunit.client.1.smithi187.stdout:7/469: dwrite d1/d18/d31/d33/d3b/f66 [0,4194304] 0 2024-09-21T00:56:36.797 INFO:tasks.workunit.client.1.smithi187.stdout:8/602: getdents dc/d94 0 2024-09-21T00:56:36.799 INFO:tasks.workunit.client.1.smithi187.stdout:5/492: truncate d0/dc/d39/d46/d67/d14/f3d 2452646 0 2024-09-21T00:56:36.799 INFO:tasks.workunit.client.1.smithi187.stdout:2/586: creat d2/da8/d6c/db8/d40/d75/fd3 x:0 0 0 2024-09-21T00:56:36.801 INFO:tasks.workunit.client.1.smithi187.stdout:7/470: creat d1/dc/d15/d22/d3e/d7c/fa5 x:0 0 0 2024-09-21T00:56:36.804 INFO:tasks.workunit.client.1.smithi187.stdout:8/603: truncate dc/d2f/d80/db8/dba/f3d 557312 0 2024-09-21T00:56:36.805 INFO:tasks.workunit.client.1.smithi187.stdout:2/587: symlink d2/da8/d6c/d97/da1/ld4 0 2024-09-21T00:56:36.805 INFO:tasks.workunit.client.1.smithi187.stdout:7/471: write d1/dc/d15/fa1 [468627,13828] 0 2024-09-21T00:56:36.807 INFO:tasks.workunit.client.1.smithi187.stdout:9/684: dwrite d4/f5 [4194304,4194304] 0 2024-09-21T00:56:36.807 INFO:tasks.workunit.client.1.smithi187.stdout:7/472: chown d1/d18/d31/d41/d8a 1435099699 1 2024-09-21T00:56:36.808 INFO:tasks.workunit.client.1.smithi187.stdout:5/493: creat d0/dc/d39/d46/d67/d14/d1b/d27/fa7 x:0 0 0 2024-09-21T00:56:36.810 INFO:tasks.workunit.client.1.smithi187.stdout:2/588: creat d2/dc/d2e/d4a/d7c/d52/da3/fd5 x:0 0 0 2024-09-21T00:56:36.812 INFO:tasks.workunit.client.1.smithi187.stdout:3/488: dread d9/d19/d1c/f47 [0,4194304] 0 2024-09-21T00:56:36.812 INFO:tasks.workunit.client.1.smithi187.stdout:5/494: fdatasync d0/dc/d39/d46/d67/d30/f6a 0 2024-09-21T00:56:36.812 INFO:tasks.workunit.client.1.smithi187.stdout:4/539: dread d2/d3/da/d2f/d4b/f7a [0,4194304] 0 2024-09-21T00:56:36.813 INFO:tasks.workunit.client.1.smithi187.stdout:7/473: mkdir d1/dc/d15/d22/d3e/da6 0 2024-09-21T00:56:36.814 INFO:tasks.workunit.client.1.smithi187.stdout:9/685: dread d4/d8/d44/d6e/d92/f97 [0,4194304] 0 2024-09-21T00:56:36.815 INFO:tasks.workunit.client.1.smithi187.stdout:4/540: write d2/d3/da/d2f/d32/d24/f28 [2634668,26552] 0 2024-09-21T00:56:36.820 INFO:tasks.workunit.client.1.smithi187.stdout:7/474: dwrite d1/d18/d31/d33/f46 [0,4194304] 0 2024-09-21T00:56:36.836 INFO:tasks.workunit.client.1.smithi187.stdout:5/495: dread d0/dc/d39/d46/d67/d30/f60 [0,4194304] 0 2024-09-21T00:56:36.847 INFO:tasks.workunit.client.1.smithi187.stdout:7/475: dread d1/d18/f29 [0,4194304] 0 2024-09-21T00:56:36.858 INFO:tasks.workunit.client.1.smithi187.stdout:7/476: dread d1/dc/d15/d22/f79 [0,4194304] 0 2024-09-21T00:56:36.894 INFO:tasks.workunit.client.1.smithi187.stdout:1/625: sync 2024-09-21T00:56:36.894 INFO:tasks.workunit.client.1.smithi187.stdout:1/626: chown d4/d75 404 1 2024-09-21T00:56:36.895 INFO:tasks.workunit.client.1.smithi187.stdout:1/627: chown d4/d6/d23/d2e/d94/d6c/l63 596178458 1 2024-09-21T00:56:36.899 INFO:tasks.workunit.client.1.smithi187.stdout:2/589: unlink d2/dc/d2e/d4a/l6d 0 2024-09-21T00:56:36.903 INFO:tasks.workunit.client.1.smithi187.stdout:3/489: symlink d9/d13/d87/d94/d53/d56/d7d/d81/d9d/la2 0 2024-09-21T00:56:36.904 INFO:tasks.workunit.client.1.smithi187.stdout:0/496: dread d0/d17/d18/f81 [0,4194304] 0 2024-09-21T00:56:36.904 INFO:tasks.workunit.client.1.smithi187.stdout:5/496: rmdir d0/dc/d39 39 2024-09-21T00:56:36.905 INFO:tasks.workunit.client.1.smithi187.stdout:7/477: creat d1/dc/d15/d22/d3e/d7c/fa7 x:0 0 0 2024-09-21T00:56:36.906 INFO:tasks.workunit.client.1.smithi187.stdout:1/628: mknod d4/d6/cc9 0 2024-09-21T00:56:36.906 INFO:tasks.workunit.client.1.smithi187.stdout:4/541: dread d2/d3/d56/d84/d60/d6c/d77/f93 [0,4194304] 0 2024-09-21T00:56:36.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:36 smithi187 ceph-mon[34997]: pgmap v21: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 172 MiB/s wr, 449 op/s 2024-09-21T00:56:36.911 INFO:tasks.workunit.client.1.smithi187.stdout:5/497: dwrite d0/f75 [0,4194304] 0 2024-09-21T00:56:36.911 INFO:tasks.workunit.client.1.smithi187.stdout:0/497: link d0/d17/d1c/d65/f7d d0/d17/d1c/d23/d36/fa4 0 2024-09-21T00:56:36.912 INFO:tasks.workunit.client.1.smithi187.stdout:9/686: getdents d4/d10/d24 0 2024-09-21T00:56:36.913 INFO:tasks.workunit.client.1.smithi187.stdout:7/478: symlink d1/d18/d31/d41/d64/d93/la8 0 2024-09-21T00:56:36.913 INFO:tasks.workunit.client.1.smithi187.stdout:0/498: read - d0/d17/d1c/d23/d36/fa4 zero size 2024-09-21T00:56:36.914 INFO:tasks.workunit.client.1.smithi187.stdout:9/687: fsync d4/d8/f2f 0 2024-09-21T00:56:36.915 INFO:tasks.workunit.client.1.smithi187.stdout:7/479: stat d1/d18/c40 0 2024-09-21T00:56:36.915 INFO:tasks.workunit.client.1.smithi187.stdout:1/629: truncate d4/d6/d23/d2e/d94/d6c/f93 419708 0 2024-09-21T00:56:36.917 INFO:tasks.workunit.client.1.smithi187.stdout:1/630: chown d4/d6/fc3 26013 1 2024-09-21T00:56:36.917 INFO:tasks.workunit.client.1.smithi187.stdout:9/688: truncate d4/d61/d6c/f99 272302 0 2024-09-21T00:56:36.919 INFO:tasks.workunit.client.1.smithi187.stdout:1/631: read d4/d6/f1c [1731176,56359] 0 2024-09-21T00:56:36.921 INFO:tasks.workunit.client.1.smithi187.stdout:0/499: dread d0/d17/d1c/d23/df/f15 [0,4194304] 0 2024-09-21T00:56:36.921 INFO:tasks.workunit.client.1.smithi187.stdout:5/498: read d0/dc/d39/d46/d67/d14/f3d [1539314,30874] 0 2024-09-21T00:56:36.924 INFO:tasks.workunit.client.1.smithi187.stdout:7/480: dwrite d1/d18/d31/f32 [0,4194304] 0 2024-09-21T00:56:36.928 INFO:tasks.workunit.client.1.smithi187.stdout:9/689: rename d4/d13/d20/f62 to d4/d61/d6c/fd8 0 2024-09-21T00:56:36.930 INFO:tasks.workunit.client.1.smithi187.stdout:3/490: getdents d9/d13/d87/d94/d53/d56/d7d/d81/d9d 0 2024-09-21T00:56:36.931 INFO:tasks.workunit.client.1.smithi187.stdout:5/499: stat d0/dc/d39/d46/l74 0 2024-09-21T00:56:36.931 INFO:tasks.workunit.client.1.smithi187.stdout:0/500: symlink d0/d17/d1c/d23/d36/la5 0 2024-09-21T00:56:36.932 INFO:tasks.workunit.client.1.smithi187.stdout:3/491: chown d9/d13/d87/d94/d53 6 1 2024-09-21T00:56:36.934 INFO:tasks.workunit.client.1.smithi187.stdout:3/492: write d9/d19/d1c/f5b [1577460,104016] 0 2024-09-21T00:56:36.936 INFO:tasks.workunit.client.1.smithi187.stdout:3/493: dread - d9/d19/d1c/d5f/f60 zero size 2024-09-21T00:56:36.937 INFO:tasks.workunit.client.1.smithi187.stdout:7/481: dread d1/d18/f29 [0,4194304] 0 2024-09-21T00:56:36.937 INFO:tasks.workunit.client.1.smithi187.stdout:5/500: write d0/dc/d39/d46/d67/d30/d68/f92 [211119,60236] 0 2024-09-21T00:56:36.938 INFO:tasks.workunit.client.1.smithi187.stdout:3/494: chown d9/d19/d1c/d5f/l97 32894699 1 2024-09-21T00:56:36.940 INFO:tasks.workunit.client.1.smithi187.stdout:7/482: readlink d1/d18/d31/d33/d3b/d9f/d75/la0 0 2024-09-21T00:56:36.941 INFO:tasks.workunit.client.1.smithi187.stdout:7/483: truncate d1/d18/f76 736370 0 2024-09-21T00:56:36.942 INFO:tasks.workunit.client.1.smithi187.stdout:5/501: fsync d0/dc/d39/d46/d67/d30/f60 0 2024-09-21T00:56:36.943 INFO:tasks.workunit.client.1.smithi187.stdout:4/542: truncate d2/d3/da/d2f/d32/d26/f44 705508 0 2024-09-21T00:56:36.945 INFO:tasks.workunit.client.1.smithi187.stdout:7/484: readlink d1/dc/d15/d22/d3e/d73/l8c 0 2024-09-21T00:56:36.946 INFO:tasks.workunit.client.1.smithi187.stdout:4/543: readlink d2/d3/da/l31 0 2024-09-21T00:56:36.947 INFO:tasks.workunit.client.1.smithi187.stdout:9/690: write d4/d61/d6a/f9e [152639,50891] 0 2024-09-21T00:56:36.948 INFO:tasks.workunit.client.1.smithi187.stdout:3/495: dwrite d9/d13/d20/f3c [0,4194304] 0 2024-09-21T00:56:36.951 INFO:tasks.workunit.client.1.smithi187.stdout:1/632: dread d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [0,4194304] 0 2024-09-21T00:56:36.951 INFO:tasks.workunit.client.1.smithi187.stdout:5/502: dread - d0/dc/d39/d46/d67/d14/d1b/d27/f9a zero size 2024-09-21T00:56:36.954 INFO:tasks.workunit.client.1.smithi187.stdout:3/496: write d9/d13/d20/f2e [1722763,97502] 0 2024-09-21T00:56:36.954 INFO:tasks.workunit.client.1.smithi187.stdout:4/544: symlink d2/d3/da/d2f/d32/d25/la4 0 2024-09-21T00:56:36.957 INFO:tasks.workunit.client.1.smithi187.stdout:0/501: dread d0/d17/d1c/d23/f30 [0,4194304] 0 2024-09-21T00:56:36.958 INFO:tasks.workunit.client.1.smithi187.stdout:3/497: fsync d9/d13/d87/d94/d53/f76 0 2024-09-21T00:56:36.959 INFO:tasks.workunit.client.1.smithi187.stdout:4/545: chown d2/d3/da/d2f/l8b 1354 1 2024-09-21T00:56:36.960 INFO:tasks.workunit.client.1.smithi187.stdout:1/633: mknod d4/d6/d23/d2e/d94/d35/d22/cca 0 2024-09-21T00:56:36.960 INFO:tasks.workunit.client.1.smithi187.stdout:7/485: dwrite d1/d18/d31/f32 [0,4194304] 0 2024-09-21T00:56:36.967 INFO:tasks.workunit.client.1.smithi187.stdout:9/691: link d4/d8/d46/d54/lba d4/d10/d39/d69/ld9 0 2024-09-21T00:56:36.968 INFO:tasks.workunit.client.1.smithi187.stdout:4/546: symlink d2/d3/da/d2f/d32/d22/d37/d63/la5 0 2024-09-21T00:56:36.971 INFO:tasks.workunit.client.1.smithi187.stdout:5/503: dwrite d0/dc/d39/d46/d67/d30/d6b/f9b [0,4194304] 0 2024-09-21T00:56:36.971 INFO:tasks.workunit.client.1.smithi187.stdout:9/692: stat d4/d13/d20/d2b/d94/fd5 0 2024-09-21T00:56:36.973 INFO:tasks.workunit.client.1.smithi187.stdout:3/498: getdents d9/d13/d87/d94 0 2024-09-21T00:56:36.974 INFO:tasks.workunit.client.1.smithi187.stdout:1/634: getdents d4/d6 0 2024-09-21T00:56:36.976 INFO:tasks.workunit.client.1.smithi187.stdout:0/502: dwrite d0/d5a/f89 [0,4194304] 0 2024-09-21T00:56:36.976 INFO:tasks.workunit.client.1.smithi187.stdout:9/693: mkdir d4/d8/dda 0 2024-09-21T00:56:36.977 INFO:tasks.workunit.client.1.smithi187.stdout:5/504: write d0/dc/d39/d46/d67/d14/d38/f5f [7835543,12587] 0 2024-09-21T00:56:36.978 INFO:tasks.workunit.client.1.smithi187.stdout:4/547: rmdir d2/d3/da/d2f/d32/d22/d37/da1 0 2024-09-21T00:56:36.979 INFO:tasks.workunit.client.1.smithi187.stdout:3/499: mkdir d9/d13/da3 0 2024-09-21T00:56:36.979 INFO:tasks.workunit.client.1.smithi187.stdout:9/694: chown d4/d13/d20/d2b/d66/f74 9767 1 2024-09-21T00:56:36.979 INFO:tasks.workunit.client.1.smithi187.stdout:1/635: mkdir d4/d6/d23/d2e/d94/dcb 0 2024-09-21T00:56:36.980 INFO:tasks.workunit.client.1.smithi187.stdout:8/604: sync 2024-09-21T00:56:36.980 INFO:tasks.workunit.client.1.smithi187.stdout:6/577: sync 2024-09-21T00:56:36.980 INFO:tasks.workunit.client.1.smithi187.stdout:5/505: write d0/dc/f11 [3897554,113932] 0 2024-09-21T00:56:36.982 INFO:tasks.workunit.client.1.smithi187.stdout:0/503: mknod d0/d5a/ca6 0 2024-09-21T00:56:36.983 INFO:tasks.workunit.client.1.smithi187.stdout:9/695: fdatasync d4/d61/d6a/f9e 0 2024-09-21T00:56:36.984 INFO:tasks.workunit.client.1.smithi187.stdout:3/500: write d9/d19/d1c/f41 [5103036,35038] 0 2024-09-21T00:56:36.986 INFO:tasks.workunit.client.1.smithi187.stdout:9/696: readlink d4/d10/lb2 0 2024-09-21T00:56:36.986 INFO:tasks.workunit.client.1.smithi187.stdout:4/548: truncate d2/d3/da/d48/f9c 6300113 0 2024-09-21T00:56:36.987 INFO:tasks.workunit.client.1.smithi187.stdout:8/605: mkdir dc/d2f/d80/db8/dba/dc7 0 2024-09-21T00:56:36.990 INFO:tasks.workunit.client.1.smithi187.stdout:5/506: write d0/dc/d39/d46/d67/d30/d68/f8a [168464,119604] 0 2024-09-21T00:56:36.991 INFO:tasks.workunit.client.1.smithi187.stdout:6/578: getdents d7/d2a/d29 0 2024-09-21T00:56:36.992 INFO:tasks.workunit.client.1.smithi187.stdout:9/697: write d4/d13/d14/d5d/f8b [422207,108739] 0 2024-09-21T00:56:36.993 INFO:tasks.workunit.client.1.smithi187.stdout:4/549: write d2/d3/da/d2f/d4b/d7e/fa3 [53070,20924] 0 2024-09-21T00:56:36.994 INFO:tasks.workunit.client.1.smithi187.stdout:2/590: sync 2024-09-21T00:56:36.994 INFO:tasks.workunit.client.1.smithi187.stdout:8/606: creat dc/d2f/fc8 x:0 0 0 2024-09-21T00:56:37.001 INFO:tasks.workunit.client.1.smithi187.stdout:9/698: creat d4/d13/d20/d2b/fdb x:0 0 0 2024-09-21T00:56:37.001 INFO:tasks.workunit.client.1.smithi187.stdout:1/636: dwrite d4/d6/d23/d2e/d53/fc5 [0,4194304] 0 2024-09-21T00:56:37.003 INFO:tasks.workunit.client.1.smithi187.stdout:8/607: fdatasync dc/d2f/d54/d69/f9c 0 2024-09-21T00:56:37.005 INFO:tasks.workunit.client.1.smithi187.stdout:2/591: creat d2/dc/d2e/d4a/fd6 x:0 0 0 2024-09-21T00:56:37.005 INFO:tasks.workunit.client.1.smithi187.stdout:9/699: fdatasync d4/d8/fb 0 2024-09-21T00:56:37.006 INFO:tasks.workunit.client.1.smithi187.stdout:7/486: dread d1/dc/f13 [0,4194304] 0 2024-09-21T00:56:37.007 INFO:tasks.workunit.client.1.smithi187.stdout:3/501: dwrite d9/d13/d87/d94/d53/f99 [0,4194304] 0 2024-09-21T00:56:37.007 INFO:tasks.workunit.client.1.smithi187.stdout:5/507: dread d0/dc/d39/d46/d67/d30/d68/f92 [0,4194304] 0 2024-09-21T00:56:37.012 INFO:tasks.workunit.client.1.smithi187.stdout:6/579: rename d7/d2a/d29/d40/d6a/d88/f9c to d7/d2a/d29/fc2 0 2024-09-21T00:56:37.013 INFO:tasks.workunit.client.1.smithi187.stdout:1/637: symlink d4/lcc 0 2024-09-21T00:56:37.014 INFO:tasks.workunit.client.1.smithi187.stdout:0/504: dread d0/d17/d1c/d23/df/d41/f42 [0,4194304] 0 2024-09-21T00:56:37.015 INFO:tasks.workunit.client.1.smithi187.stdout:2/592: mknod d2/da8/d6c/d97/da1/cd7 0 2024-09-21T00:56:37.016 INFO:tasks.workunit.client.1.smithi187.stdout:4/550: dwrite d2/d3/da/d2f/d32/f4e [0,4194304] 0 2024-09-21T00:56:37.016 INFO:tasks.workunit.client.1.smithi187.stdout:8/608: write dc/f3c [4504903,34326] 0 2024-09-21T00:56:37.017 INFO:tasks.workunit.client.1.smithi187.stdout:7/487: mknod d1/dc/d15/d22/d3e/d7c/ca9 0 2024-09-21T00:56:37.018 INFO:tasks.workunit.client.1.smithi187.stdout:5/508: creat d0/dc/d39/d46/d67/d14/d57/fa8 x:0 0 0 2024-09-21T00:56:37.019 INFO:tasks.workunit.client.1.smithi187.stdout:1/638: read - d4/d6/d23/d2e/f4b zero size 2024-09-21T00:56:37.024 INFO:tasks.workunit.client.1.smithi187.stdout:1/639: dread - d4/faa zero size 2024-09-21T00:56:37.025 INFO:tasks.workunit.client.1.smithi187.stdout:5/509: chown d0/dc/d39/d46/d67/d14/d38/d5a/l7a 57861116 1 2024-09-21T00:56:37.028 INFO:tasks.workunit.client.1.smithi187.stdout:4/551: unlink d2/d3/da/d2f/d32/d22/d4f/d89/l8c 0 2024-09-21T00:56:37.029 INFO:tasks.workunit.client.1.smithi187.stdout:3/502: dwrite d9/d13/d87/d94/d53/d56/f8e [0,4194304] 0 2024-09-21T00:56:37.037 INFO:tasks.workunit.client.1.smithi187.stdout:7/488: rename d1/dc/f13 to d1/d18/d31/d41/d64/faa 0 2024-09-21T00:56:37.038 INFO:tasks.workunit.client.1.smithi187.stdout:0/505: dwrite d0/f9a [0,4194304] 0 2024-09-21T00:56:37.038 INFO:tasks.workunit.client.1.smithi187.stdout:8/609: truncate dc/d2f/d80/db8/dba/d29/f73 1419022 0 2024-09-21T00:56:37.040 INFO:tasks.workunit.client.1.smithi187.stdout:5/510: dread - d0/dc/d39/d46/d67/d14/d57/fa8 zero size 2024-09-21T00:56:37.041 INFO:tasks.workunit.client.1.smithi187.stdout:9/700: dwrite d4/d13/d14/d1d/f63 [0,4194304] 0 2024-09-21T00:56:37.042 INFO:tasks.workunit.client.1.smithi187.stdout:4/552: stat d2/d3/da/d2f/d32/d22/d4f/d97 0 2024-09-21T00:56:37.042 INFO:tasks.workunit.client.1.smithi187.stdout:0/506: stat d0/d5a/f89 0 2024-09-21T00:56:37.043 INFO:tasks.workunit.client.1.smithi187.stdout:9/701: stat l1 0 2024-09-21T00:56:37.044 INFO:tasks.workunit.client.1.smithi187.stdout:2/593: dwrite d2/da8/d6c/fca [0,4194304] 0 2024-09-21T00:56:37.044 INFO:tasks.workunit.client.1.smithi187.stdout:3/503: chown d9/d19/d1c/f2a 6373226 1 2024-09-21T00:56:37.049 INFO:tasks.workunit.client.1.smithi187.stdout:9/702: read - d4/d13/d20/d2b/d66/fc1 zero size 2024-09-21T00:56:37.050 INFO:tasks.workunit.client.1.smithi187.stdout:7/489: rmdir d1/dc/d15/d22/d3e/d7c/d97 39 2024-09-21T00:56:37.052 INFO:tasks.workunit.client.1.smithi187.stdout:7/490: chown d1/d55/d80 9712 1 2024-09-21T00:56:37.052 INFO:tasks.workunit.client.1.smithi187.stdout:3/504: fdatasync d9/d13/d87/d94/d53/d56/d7d/d81/f84 0 2024-09-21T00:56:37.052 INFO:tasks.workunit.client.1.smithi187.stdout:4/553: rename d2/d3/f13 to d2/d3/da/fa6 0 2024-09-21T00:56:37.053 INFO:tasks.workunit.client.1.smithi187.stdout:2/594: mknod d2/da8/d9d/cd8 0 2024-09-21T00:56:37.055 INFO:tasks.workunit.client.1.smithi187.stdout:1/640: dwrite d4/d6/d23/fb2 [0,4194304] 0 2024-09-21T00:56:37.055 INFO:tasks.workunit.client.1.smithi187.stdout:6/580: creat d7/d2a/d29/d40/d50/d83/fc3 x:0 0 0 2024-09-21T00:56:37.056 INFO:tasks.workunit.client.1.smithi187.stdout:8/610: dread dc/d2f/d37/f42 [0,4194304] 0 2024-09-21T00:56:37.057 INFO:tasks.workunit.client.1.smithi187.stdout:0/507: creat d0/fa7 x:0 0 0 2024-09-21T00:56:37.057 INFO:tasks.workunit.client.1.smithi187.stdout:3/505: read d9/d13/d20/f3c [194306,77478] 0 2024-09-21T00:56:37.058 INFO:tasks.workunit.client.1.smithi187.stdout:4/554: chown d2/d3/da/d2f/d32/d22/d37/d63/f69 101364970 1 2024-09-21T00:56:37.059 INFO:tasks.workunit.client.1.smithi187.stdout:9/703: link d4/d10/f4a d4/d10/fdc 0 2024-09-21T00:56:37.061 INFO:tasks.workunit.client.1.smithi187.stdout:2/595: creat d2/dc/d2e/d4a/d7c/d52/dac/fd9 x:0 0 0 2024-09-21T00:56:37.061 INFO:tasks.workunit.client.1.smithi187.stdout:1/641: chown d4/d6/d23/d2e/d94/d35/d22/dac 659690670 1 2024-09-21T00:56:37.062 INFO:tasks.workunit.client.1.smithi187.stdout:3/506: symlink d9/d13/d20/la4 0 2024-09-21T00:56:37.062 INFO:tasks.workunit.client.1.smithi187.stdout:9/704: rmdir d4/d10/d39 39 2024-09-21T00:56:37.063 INFO:tasks.workunit.client.1.smithi187.stdout:3/507: chown d9/d19/d1c/f3e 144639027 1 2024-09-21T00:56:37.065 INFO:tasks.workunit.client.1.smithi187.stdout:3/508: fdatasync d9/d13/d87/d94/d53/f99 0 2024-09-21T00:56:37.066 INFO:tasks.workunit.client.1.smithi187.stdout:4/555: fsync d2/d3/da/d2f/d32/d24/f2e 0 2024-09-21T00:56:37.067 INFO:tasks.workunit.client.1.smithi187.stdout:2/596: creat d2/da8/d6c/d97/fda x:0 0 0 2024-09-21T00:56:37.069 INFO:tasks.workunit.client.1.smithi187.stdout:9/705: unlink d4/d8/d46/d54/f7c 0 2024-09-21T00:56:37.071 INFO:tasks.workunit.client.1.smithi187.stdout:4/556: dread d2/d3/da/d2f/d32/d22/f49 [0,4194304] 0 2024-09-21T00:56:37.072 INFO:tasks.workunit.client.1.smithi187.stdout:3/509: symlink d9/d13/d87/d94/d53/d56/d7d/d81/d9d/la5 0 2024-09-21T00:56:37.073 INFO:tasks.workunit.client.1.smithi187.stdout:3/510: dread - d9/d19/d1c/f66 zero size 2024-09-21T00:56:37.073 INFO:tasks.workunit.client.1.smithi187.stdout:1/642: mkdir d4/d6/d23/d2e/d94/d35/d22/dcd 0 2024-09-21T00:56:37.075 INFO:tasks.workunit.client.1.smithi187.stdout:2/597: unlink d2/d3/f8d 0 2024-09-21T00:56:37.076 INFO:tasks.workunit.client.1.smithi187.stdout:2/598: readlink d2/da8/d1c/d2d/d8f/l61 0 2024-09-21T00:56:37.077 INFO:tasks.workunit.client.1.smithi187.stdout:4/557: creat d2/d3/da/d2f/d32/d22/d37/d3a/fa7 x:0 0 0 2024-09-21T00:56:37.078 INFO:tasks.workunit.client.1.smithi187.stdout:3/511: rmdir d9/d19 39 2024-09-21T00:56:37.078 INFO:tasks.workunit.client.1.smithi187.stdout:2/599: fdatasync d2/da8/d6c/d97/da1/fad 0 2024-09-21T00:56:37.080 INFO:tasks.workunit.client.1.smithi187.stdout:4/558: chown d2/d3/da/fc 140 1 2024-09-21T00:56:37.080 INFO:tasks.workunit.client.1.smithi187.stdout:8/611: write dc/d2f/d54/d69/f9c [941578,34268] 0 2024-09-21T00:56:37.080 INFO:tasks.workunit.client.1.smithi187.stdout:0/508: getdents d0/d17/d1c/d23/df/d41/d3b/d46 0 2024-09-21T00:56:37.082 INFO:tasks.workunit.client.1.smithi187.stdout:9/706: mkdir d4/d13/d20/d2b/dbf/ddd 0 2024-09-21T00:56:37.083 INFO:tasks.workunit.client.1.smithi187.stdout:1/643: dwrite d4/d6/d23/d2e/d94/d35/d22/d65/fa3 [0,4194304] 0 2024-09-21T00:56:37.084 INFO:tasks.workunit.client.1.smithi187.stdout:2/600: symlink d2/da8/d6c/d97/ldb 0 2024-09-21T00:56:37.085 INFO:tasks.workunit.client.1.smithi187.stdout:9/707: dread - d4/d13/d20/d2b/d94/fd5 zero size 2024-09-21T00:56:37.086 INFO:tasks.workunit.client.1.smithi187.stdout:2/601: chown d2/d25/f68 7308332 1 2024-09-21T00:56:37.088 INFO:tasks.workunit.client.1.smithi187.stdout:0/509: dread d0/d17/d1c/d23/df/f15 [0,4194304] 0 2024-09-21T00:56:37.088 INFO:tasks.workunit.client.1.smithi187.stdout:1/644: mkdir d4/d6/d23/d2e/d94/d35/d79/dce 0 2024-09-21T00:56:37.090 INFO:tasks.workunit.client.1.smithi187.stdout:6/581: dread d7/d59/f1e [0,4194304] 0 2024-09-21T00:56:37.091 INFO:tasks.workunit.client.1.smithi187.stdout:6/582: stat d7/f9f 0 2024-09-21T00:56:37.092 INFO:tasks.workunit.client.1.smithi187.stdout:9/708: mkdir d4/d13/d20/d2b/d94/dde 0 2024-09-21T00:56:37.092 INFO:tasks.workunit.client.1.smithi187.stdout:1/645: write d4/d6/d23/d2e/d53/fbd [105702,117407] 0 2024-09-21T00:56:37.093 INFO:tasks.workunit.client.1.smithi187.stdout:8/612: dwrite dc/fc3 [0,4194304] 0 2024-09-21T00:56:37.093 INFO:tasks.workunit.client.1.smithi187.stdout:2/602: dread d2/d3/d15/f87 [0,4194304] 0 2024-09-21T00:56:37.095 INFO:tasks.workunit.client.1.smithi187.stdout:9/709: chown d4/d13/d14/f18 209363671 1 2024-09-21T00:56:37.095 INFO:tasks.workunit.client.1.smithi187.stdout:3/512: link d9/d13/d87/d94/d53/d56/d7d/d81/d9d/la5 d9/d7f/la6 0 2024-09-21T00:56:37.098 INFO:tasks.workunit.client.1.smithi187.stdout:0/510: creat d0/d17/d18/d90/fa8 x:0 0 0 2024-09-21T00:56:37.099 INFO:tasks.workunit.client.1.smithi187.stdout:4/559: getdents d2/d3/da/d2f 0 2024-09-21T00:56:37.099 INFO:tasks.workunit.client.1.smithi187.stdout:6/583: creat d7/d2a/d29/d40/d6a/dbc/fc4 x:0 0 0 2024-09-21T00:56:37.100 INFO:tasks.workunit.client.1.smithi187.stdout:3/513: write d9/d13/d87/d94/d53/d56/f83 [3789004,31615] 0 2024-09-21T00:56:37.101 INFO:tasks.workunit.client.1.smithi187.stdout:2/603: unlink d2/da8/d6c/db8/f85 0 2024-09-21T00:56:37.102 INFO:tasks.workunit.client.1.smithi187.stdout:4/560: dread d2/d3/da/d2f/d4b/d7e/fa3 [0,4194304] 0 2024-09-21T00:56:37.102 INFO:tasks.workunit.client.1.smithi187.stdout:9/710: mknod d4/d13/d14/d83/cdf 0 2024-09-21T00:56:37.103 INFO:tasks.workunit.client.1.smithi187.stdout:2/604: fdatasync d2/dc/d2e/d4a/d7c/d52/dac/fd9 0 2024-09-21T00:56:37.104 INFO:tasks.workunit.client.1.smithi187.stdout:4/561: dread - d2/d3/da/d2f/d32/d26/d66/d6e/f8e zero size 2024-09-21T00:56:37.105 INFO:tasks.workunit.client.1.smithi187.stdout:0/511: creat d0/d60/d6b/fa9 x:0 0 0 2024-09-21T00:56:37.106 INFO:tasks.workunit.client.1.smithi187.stdout:3/514: dread d9/d13/d87/d94/f45 [0,4194304] 0 2024-09-21T00:56:37.106 INFO:tasks.workunit.client.1.smithi187.stdout:1/646: mknod d4/d6/d23/d2e/d94/d35/d22/d2c/d9f/ccf 0 2024-09-21T00:56:37.110 INFO:tasks.workunit.client.1.smithi187.stdout:6/584: write d7/d2a/d29/d40/f4b [22848,2551] 0 2024-09-21T00:56:37.113 INFO:tasks.workunit.client.1.smithi187.stdout:0/512: rmdir d0/d17/d18/d90/d98 39 2024-09-21T00:56:37.114 INFO:tasks.workunit.client.1.smithi187.stdout:8/613: creat dc/d2f/d80/db8/dba/fc9 x:0 0 0 2024-09-21T00:56:37.115 INFO:tasks.workunit.client.1.smithi187.stdout:1/647: mknod d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/cd0 0 2024-09-21T00:56:37.116 INFO:tasks.workunit.client.1.smithi187.stdout:8/614: write dc/d2f/d80/db8/dba/d29/da7/fc5 [719417,20533] 0 2024-09-21T00:56:37.116 INFO:tasks.workunit.client.1.smithi187.stdout:6/585: creat d7/d59/fc5 x:0 0 0 2024-09-21T00:56:37.118 INFO:tasks.workunit.client.1.smithi187.stdout:6/586: dread d7/d2a/d7a/fb3 [0,4194304] 0 2024-09-21T00:56:37.120 INFO:tasks.workunit.client.1.smithi187.stdout:4/562: symlink d2/d3/la8 0 2024-09-21T00:56:37.120 INFO:tasks.workunit.client.1.smithi187.stdout:1/648: dread d4/d6/d23/d2e/d94/f13 [0,4194304] 0 2024-09-21T00:56:37.120 INFO:tasks.workunit.client.1.smithi187.stdout:0/513: symlink d0/d17/d1c/d65/laa 0 2024-09-21T00:56:37.122 INFO:tasks.workunit.client.1.smithi187.stdout:9/711: creat d4/d13/fe0 x:0 0 0 2024-09-21T00:56:37.123 INFO:tasks.workunit.client.1.smithi187.stdout:8/615: rmdir dc/d44 39 2024-09-21T00:56:37.123 INFO:tasks.workunit.client.1.smithi187.stdout:9/712: dread - d4/d13/d20/d2b/d94/fd5 zero size 2024-09-21T00:56:37.124 INFO:tasks.workunit.client.1.smithi187.stdout:2/605: creat d2/da8/d1c/d2d/fdc x:0 0 0 2024-09-21T00:56:37.125 INFO:tasks.workunit.client.1.smithi187.stdout:2/606: truncate d2/dc/d2e/fae 739174 0 2024-09-21T00:56:37.126 INFO:tasks.workunit.client.1.smithi187.stdout:6/587: write d7/d2a/f5b [377064,75854] 0 2024-09-21T00:56:37.127 INFO:tasks.workunit.client.1.smithi187.stdout:4/563: dread d2/d3/da/d48/f6d [0,4194304] 0 2024-09-21T00:56:37.129 INFO:tasks.workunit.client.1.smithi187.stdout:0/514: creat d0/d60/fab x:0 0 0 2024-09-21T00:56:37.132 INFO:tasks.workunit.client.1.smithi187.stdout:9/713: rmdir d4/d61/d6a 39 2024-09-21T00:56:37.133 INFO:tasks.workunit.client.1.smithi187.stdout:3/515: rename d9/d13/da3 to d9/d19/da7 0 2024-09-21T00:56:37.134 INFO:tasks.workunit.client.1.smithi187.stdout:2/607: mknod d2/da8/d1c/dc6/cdd 0 2024-09-21T00:56:37.135 INFO:tasks.workunit.client.1.smithi187.stdout:6/588: rmdir d7/d2a/d29/d40/d6a/d9e 39 2024-09-21T00:56:37.135 INFO:tasks.workunit.client.1.smithi187.stdout:1/649: dread d4/d6/d23/d2e/d94/d35/d22/f57 [0,4194304] 0 2024-09-21T00:56:37.135 INFO:tasks.workunit.client.1.smithi187.stdout:4/564: dwrite d2/d3/da/d2f/d32/d22/d4f/f54 [0,4194304] 0 2024-09-21T00:56:37.137 INFO:tasks.workunit.client.1.smithi187.stdout:8/616: getdents dc/d2f/d80/db8/dba/dc7 0 2024-09-21T00:56:37.138 INFO:tasks.workunit.client.1.smithi187.stdout:9/714: creat d4/d61/d6c/fe1 x:0 0 0 2024-09-21T00:56:37.139 INFO:tasks.workunit.client.1.smithi187.stdout:1/650: dread - d4/faa zero size 2024-09-21T00:56:37.139 INFO:tasks.workunit.client.1.smithi187.stdout:0/515: dwrite d0/d17/d1c/d23/d36/f5c [0,4194304] 0 2024-09-21T00:56:37.139 INFO:tasks.workunit.client.1.smithi187.stdout:3/516: dread - d9/d13/d87/d94/d53/d56/d61/f63 zero size 2024-09-21T00:56:37.140 INFO:tasks.workunit.client.1.smithi187.stdout:2/608: fdatasync d2/d3/df/f41 0 2024-09-21T00:56:37.140 INFO:tasks.workunit.client.1.smithi187.stdout:6/589: truncate d7/d2a/f9d 955670 0 2024-09-21T00:56:37.141 INFO:tasks.workunit.client.1.smithi187.stdout:4/565: fdatasync d2/d3/da/d2f/d32/d24/f2e 0 2024-09-21T00:56:37.141 INFO:tasks.workunit.client.1.smithi187.stdout:1/651: fdatasync d4/d86/f8e 0 2024-09-21T00:56:37.143 INFO:tasks.workunit.client.1.smithi187.stdout:0/516: creat d0/d17/fac x:0 0 0 2024-09-21T00:56:37.144 INFO:tasks.workunit.client.1.smithi187.stdout:3/517: readlink d9/d13/d87/d94/d53/d75/l7a 0 2024-09-21T00:56:37.145 INFO:tasks.workunit.client.1.smithi187.stdout:8/617: creat dc/d2f/d54/d69/db3/fca x:0 0 0 2024-09-21T00:56:37.148 INFO:tasks.workunit.client.1.smithi187.stdout:3/518: write d9/d13/d87/d94/d53/d56/f8e [1051502,128964] 0 2024-09-21T00:56:37.149 INFO:tasks.workunit.client.1.smithi187.stdout:2/609: fsync d2/dc/d2e/fbb 0 2024-09-21T00:56:37.150 INFO:tasks.workunit.client.1.smithi187.stdout:9/715: creat d4/d13/d20/d2b/d94/dde/fe2 x:0 0 0 2024-09-21T00:56:37.151 INFO:tasks.workunit.client.1.smithi187.stdout:4/566: dread d2/d3/d56/d84/d60/d6c/d77/f93 [0,4194304] 0 2024-09-21T00:56:37.152 INFO:tasks.workunit.client.1.smithi187.stdout:4/567: chown d2/d3/f21 28628 1 2024-09-21T00:56:37.153 INFO:tasks.workunit.client.1.smithi187.stdout:0/517: truncate d0/d17/f83 93515 0 2024-09-21T00:56:37.153 INFO:tasks.workunit.client.1.smithi187.stdout:4/568: truncate d2/d3/da/d2f/d32/d22/d37/d3a/fa7 660480 0 2024-09-21T00:56:37.154 INFO:tasks.workunit.client.1.smithi187.stdout:2/610: mknod d2/da8/d1c/dc6/cde 0 2024-09-21T00:56:37.156 INFO:tasks.workunit.client.1.smithi187.stdout:3/519: creat d9/d13/d87/d94/d53/d56/d7d/d81/d9d/fa8 x:0 0 0 2024-09-21T00:56:37.169 INFO:tasks.workunit.client.1.smithi187.stdout:5/511: sync 2024-09-21T00:56:37.169 INFO:tasks.workunit.client.1.smithi187.stdout:1/652: creat d4/d6/d23/d2e/d94/d35/d79/dce/fd1 x:0 0 0 2024-09-21T00:56:37.170 INFO:tasks.workunit.client.1.smithi187.stdout:0/518: creat d0/d17/d1c/d65/fad x:0 0 0 2024-09-21T00:56:37.170 INFO:tasks.workunit.client.1.smithi187.stdout:4/569: rename d2/d3/da/d2f/d32/d26/d66/f9b to d2/d3/da/d2f/d4b/fa9 0 2024-09-21T00:56:37.170 INFO:tasks.workunit.client.1.smithi187.stdout:0/519: fdatasync d0/f70 0 2024-09-21T00:56:37.172 INFO:tasks.workunit.client.1.smithi187.stdout:9/716: creat d4/d13/fe3 x:0 0 0 2024-09-21T00:56:37.172 INFO:tasks.workunit.client.1.smithi187.stdout:1/653: chown d4/d6/d23/d2e/d94/l3b 769198472 1 2024-09-21T00:56:37.241 INFO:tasks.workunit.client.1.smithi187.stdout:0/520: fsync d0/f70 0 2024-09-21T00:56:37.246 INFO:tasks.workunit.client.1.smithi187.stdout:9/717: rename l0 to d4/d13/d20/d2b/le4 0 2024-09-21T00:56:37.246 INFO:tasks.workunit.client.1.smithi187.stdout:6/590: dwrite d7/d2a/d29/d40/d50/f73 [0,4194304] 0 2024-09-21T00:56:37.247 INFO:tasks.workunit.client.1.smithi187.stdout:0/521: creat d0/d60/d6b/fae x:0 0 0 2024-09-21T00:56:37.248 INFO:tasks.workunit.client.1.smithi187.stdout:1/654: mkdir d4/d6/d23/d2e/d94/d35/d79/dd2 0 2024-09-21T00:56:37.249 INFO:tasks.workunit.client.1.smithi187.stdout:0/522: write d0/d17/d1c/d23/d36/fa1 [353525,85474] 0 2024-09-21T00:56:37.249 INFO:tasks.workunit.client.1.smithi187.stdout:2/611: dread d2/dc/d2e/d4a/d7c/f37 [8388608,4194304] 0 2024-09-21T00:56:37.251 INFO:tasks.workunit.client.1.smithi187.stdout:4/570: getdents d2/d3/da 0 2024-09-21T00:56:37.252 INFO:tasks.workunit.client.1.smithi187.stdout:5/512: rmdir d0/dc/d39/d46/d67/d14/d38/d5a/d6c/d7b/d8c 0 2024-09-21T00:56:37.254 INFO:tasks.workunit.client.1.smithi187.stdout:2/612: readlink d2/dc/d2e/d4a/d7c/lbf 0 2024-09-21T00:56:37.255 INFO:tasks.workunit.client.1.smithi187.stdout:9/718: creat d4/fe5 x:0 0 0 2024-09-21T00:56:37.256 INFO:tasks.workunit.client.1.smithi187.stdout:0/523: link d0/d60/d6b/fa9 d0/d17/d18/faf 0 2024-09-21T00:56:37.257 INFO:tasks.workunit.client.1.smithi187.stdout:5/513: write d0/dc/d39/d46/d67/d30/f34 [395899,63750] 0 2024-09-21T00:56:37.258 INFO:tasks.workunit.client.1.smithi187.stdout:2/613: write d2/da8/d1c/f1f [4415596,62699] 0 2024-09-21T00:56:37.261 INFO:tasks.workunit.client.1.smithi187.stdout:9/719: fsync d4/d13/d20/d2b/f7b 0 2024-09-21T00:56:37.261 INFO:tasks.workunit.client.1.smithi187.stdout:1/655: dwrite d4/d6/d23/d2e/d94/d6c/fa4 [0,4194304] 0 2024-09-21T00:56:37.262 INFO:tasks.workunit.client.1.smithi187.stdout:9/720: chown d4 19 1 2024-09-21T00:56:37.263 INFO:tasks.workunit.client.1.smithi187.stdout:5/514: write d0/dc/d39/d46/d67/d14/d1b/d27/f9a [814935,83802] 0 2024-09-21T00:56:37.266 INFO:tasks.workunit.client.1.smithi187.stdout:9/721: mkdir d4/d10/d8f/de6 0 2024-09-21T00:56:37.268 INFO:tasks.workunit.client.1.smithi187.stdout:0/524: getdents d0/d17/d1c 0 2024-09-21T00:56:37.268 INFO:tasks.workunit.client.1.smithi187.stdout:1/656: chown d4/d6/d23/d2e/d94/d35/d22/d65/db9 51 1 2024-09-21T00:56:37.268 INFO:tasks.workunit.client.1.smithi187.stdout:7/491: sync 2024-09-21T00:56:37.270 INFO:tasks.workunit.client.1.smithi187.stdout:0/525: symlink d0/d5a/lb0 0 2024-09-21T00:56:37.272 INFO:tasks.workunit.client.1.smithi187.stdout:9/722: symlink d4/d8/d41/le7 0 2024-09-21T00:56:37.273 INFO:tasks.workunit.client.1.smithi187.stdout:5/515: rename d0/dc/d39/d46/d67/d14/c70 to d0/dc/d39/d46/d67/d14/d38/ca9 0 2024-09-21T00:56:37.274 INFO:tasks.workunit.client.1.smithi187.stdout:6/591: dread d7/f4f [0,4194304] 0 2024-09-21T00:56:37.274 INFO:tasks.workunit.client.1.smithi187.stdout:7/492: write d1/dc/d15/d22/d3e/d7c/f7f [5035570,115500] 0 2024-09-21T00:56:37.275 INFO:tasks.workunit.client.1.smithi187.stdout:0/526: chown d0/d17/d1c/d23/df/d41/l88 61 1 2024-09-21T00:56:37.278 INFO:tasks.workunit.client.1.smithi187.stdout:2/614: dwrite d2/da8/d6c/d97/da1/fd0 [0,4194304] 0 2024-09-21T00:56:37.278 INFO:tasks.workunit.client.1.smithi187.stdout:1/657: rmdir d4/d6/d23/d2e/dc0 0 2024-09-21T00:56:37.282 INFO:tasks.workunit.client.1.smithi187.stdout:2/615: write d2/da8/fc9 [630452,61744] 0 2024-09-21T00:56:37.283 INFO:tasks.workunit.client.1.smithi187.stdout:4/571: dread d2/d3/da/d2f/d32/f8a [4194304,4194304] 0 2024-09-21T00:56:37.284 INFO:tasks.workunit.client.1.smithi187.stdout:0/527: mknod d0/cb1 0 2024-09-21T00:56:37.285 INFO:tasks.workunit.client.1.smithi187.stdout:7/493: symlink d1/dc/d15/d22/d3e/da6/lab 0 2024-09-21T00:56:37.287 INFO:tasks.workunit.client.1.smithi187.stdout:6/592: dwrite d7/d2a/d7a/f99 [0,4194304] 0 2024-09-21T00:56:37.287 INFO:tasks.workunit.client.1.smithi187.stdout:1/658: mkdir d4/d6/d23/d2e/d94/d35/d22/dcd/dd3 0 2024-09-21T00:56:37.288 INFO:tasks.workunit.client.1.smithi187.stdout:6/593: fsync d7/f4a 0 2024-09-21T00:56:37.289 INFO:tasks.workunit.client.1.smithi187.stdout:5/516: rename d0/dc/d39/d46 to d0/dc/daa 0 2024-09-21T00:56:37.294 INFO:tasks.workunit.client.1.smithi187.stdout:7/494: creat d1/d18/d31/d33/d3b/d9f/fac x:0 0 0 2024-09-21T00:56:37.294 INFO:tasks.workunit.client.1.smithi187.stdout:1/659: write d4/d6/d23/d2e/d94/f4e [5080195,4364] 0 2024-09-21T00:56:37.295 INFO:tasks.workunit.client.1.smithi187.stdout:8/618: sync 2024-09-21T00:56:37.295 INFO:tasks.workunit.client.1.smithi187.stdout:5/517: mknod d0/dc/daa/d67/d14/d1b/d27/d3a/cab 0 2024-09-21T00:56:37.296 INFO:tasks.workunit.client.1.smithi187.stdout:7/495: dread d1/f68 [0,4194304] 0 2024-09-21T00:56:37.297 INFO:tasks.workunit.client.1.smithi187.stdout:6/594: mknod d7/cc6 0 2024-09-21T00:56:37.298 INFO:tasks.workunit.client.1.smithi187.stdout:4/572: dread d2/d3/da/d2f/d32/d22/d4f/f62 [0,4194304] 0 2024-09-21T00:56:37.301 INFO:tasks.workunit.client.1.smithi187.stdout:9/723: rename d4/c32 to d4/d10/d39/d69/ce8 0 2024-09-21T00:56:37.303 INFO:tasks.workunit.client.1.smithi187.stdout:2/616: getdents d2/da8/d1c/d2d/d8f 0 2024-09-21T00:56:37.303 INFO:tasks.workunit.client.1.smithi187.stdout:1/660: dread d4/d6/d23/d2e/d94/d35/f6e [0,4194304] 0 2024-09-21T00:56:37.305 INFO:tasks.workunit.client.1.smithi187.stdout:6/595: dwrite d7/d2a/f5b [0,4194304] 0 2024-09-21T00:56:37.306 INFO:tasks.workunit.client.1.smithi187.stdout:0/528: getdents d0/d17/d1c/d23/d36 0 2024-09-21T00:56:37.306 INFO:tasks.workunit.client.1.smithi187.stdout:4/573: write d2/d3/da/f1f [2301898,57431] 0 2024-09-21T00:56:37.307 INFO:tasks.workunit.client.1.smithi187.stdout:4/574: stat d2/d3/d56/d84/d58 0 2024-09-21T00:56:37.308 INFO:tasks.workunit.client.1.smithi187.stdout:5/518: rename d0/f2d to d0/dc/daa/d67/d30/d6b/fac 0 2024-09-21T00:56:37.309 INFO:tasks.workunit.client.1.smithi187.stdout:7/496: mknod d1/d18/d31/d41/cad 0 2024-09-21T00:56:37.309 INFO:tasks.workunit.client.1.smithi187.stdout:5/519: rename d0/dc to d0/dc/daa/d67/d14/d38/d5a/dad 22 2024-09-21T00:56:37.311 INFO:tasks.workunit.client.1.smithi187.stdout:7/497: dread d1/dc/d15/fa1 [0,4194304] 0 2024-09-21T00:56:37.313 INFO:tasks.workunit.client.1.smithi187.stdout:0/529: creat d0/d17/d1c/d23/df/d41/d3b/fb2 x:0 0 0 2024-09-21T00:56:37.315 INFO:tasks.workunit.client.1.smithi187.stdout:4/575: unlink d2/d3/c19 0 2024-09-21T00:56:37.318 INFO:tasks.workunit.client.1.smithi187.stdout:2/617: mkdir d2/dc/d2e/d51/dc5/ddf 0 2024-09-21T00:56:37.319 INFO:tasks.workunit.client.1.smithi187.stdout:0/530: dwrite d0/d17/d1c/f4c [0,4194304] 0 2024-09-21T00:56:37.324 INFO:tasks.workunit.client.1.smithi187.stdout:4/576: symlink d2/d3/da/laa 0 2024-09-21T00:56:37.326 INFO:tasks.workunit.client.1.smithi187.stdout:2/618: rmdir d2/dc/d2e/d4a 39 2024-09-21T00:56:37.327 INFO:tasks.workunit.client.1.smithi187.stdout:8/619: truncate dc/d2f/d54/d69/f84 824639 0 2024-09-21T00:56:37.332 INFO:tasks.workunit.client.1.smithi187.stdout:8/620: write dc/d2f/d80/db8/dba/d29/faf [315590,84051] 0 2024-09-21T00:56:37.332 INFO:tasks.workunit.client.1.smithi187.stdout:4/577: dwrite d2/d3/da/f1f [4194304,4194304] 0 2024-09-21T00:56:37.332 INFO:tasks.workunit.client.1.smithi187.stdout:6/596: getdents d7 0 2024-09-21T00:56:37.332 INFO:tasks.workunit.client.1.smithi187.stdout:0/531: link d0/d17/d1c/d23/df/d41/c39 d0/d5a/cb3 0 2024-09-21T00:56:37.334 INFO:tasks.workunit.client.1.smithi187.stdout:7/498: link d1/d18/d31/d33/d3b/d62/l83 d1/dc/d15/d22/d3e/d7c/lae 0 2024-09-21T00:56:37.335 INFO:tasks.workunit.client.1.smithi187.stdout:6/597: dread - d7/d59/fc5 zero size 2024-09-21T00:56:37.337 INFO:tasks.workunit.client.1.smithi187.stdout:1/661: dwrite d4/d6/d23/d2e/d53/f7f [0,4194304] 0 2024-09-21T00:56:37.337 INFO:tasks.workunit.client.1.smithi187.stdout:2/619: dread - d2/dc/d2e/d4a/d7c/d52/fbe zero size 2024-09-21T00:56:37.337 INFO:tasks.workunit.client.1.smithi187.stdout:5/520: write d0/dc/daa/d67/f50 [4052563,63386] 0 2024-09-21T00:56:37.339 INFO:tasks.workunit.client.1.smithi187.stdout:2/620: fsync d2/da8/fc9 0 2024-09-21T00:56:37.341 INFO:tasks.workunit.client.1.smithi187.stdout:6/598: fsync d7/d2a/d29/f7c 0 2024-09-21T00:56:37.343 INFO:tasks.workunit.client.1.smithi187.stdout:2/621: dread - d2/dc/d2e/fbb zero size 2024-09-21T00:56:37.345 INFO:tasks.workunit.client.1.smithi187.stdout:7/499: dread d1/dc/d15/fa1 [0,4194304] 0 2024-09-21T00:56:37.346 INFO:tasks.workunit.client.1.smithi187.stdout:6/599: fdatasync d7/d2a/d7a/f99 0 2024-09-21T00:56:37.346 INFO:tasks.workunit.client.1.smithi187.stdout:5/521: symlink d0/dc/daa/d67/lae 0 2024-09-21T00:56:37.346 INFO:tasks.workunit.client.1.smithi187.stdout:1/662: dread d4/d6/d23/f2b [0,4194304] 0 2024-09-21T00:56:37.347 INFO:tasks.workunit.client.1.smithi187.stdout:4/578: dread d2/d3/da/d2f/d32/d26/d66/d6e/f7b [0,4194304] 0 2024-09-21T00:56:37.347 INFO:tasks.workunit.client.1.smithi187.stdout:2/622: chown d2/da8/d1c/d2d/d8f 77 1 2024-09-21T00:56:37.348 INFO:tasks.workunit.client.1.smithi187.stdout:8/621: rename dc/d2f/d80/db8/dba/d29/d9f to dc/d44/dcb 0 2024-09-21T00:56:37.351 INFO:tasks.workunit.client.1.smithi187.stdout:6/600: write d7/d2a/d29/d40/d50/f73 [524275,53849] 0 2024-09-21T00:56:37.351 INFO:tasks.workunit.client.1.smithi187.stdout:0/532: dwrite d0/d17/d1c/d23/df/d41/d3b/f54 [0,4194304] 0 2024-09-21T00:56:37.352 INFO:tasks.workunit.client.1.smithi187.stdout:7/500: dread - d1/d18/d31/d33/d3b/d9f/fac zero size 2024-09-21T00:56:37.354 INFO:tasks.workunit.client.1.smithi187.stdout:8/622: creat dc/d2f/d34/d4b/fcc x:0 0 0 2024-09-21T00:56:37.354 INFO:tasks.workunit.client.1.smithi187.stdout:2/623: creat d2/da8/d6c/fe0 x:0 0 0 2024-09-21T00:56:37.356 INFO:tasks.workunit.client.1.smithi187.stdout:5/522: truncate d0/dc/daa/d67/d30/d68/f8a 1978057 0 2024-09-21T00:56:37.356 INFO:tasks.workunit.client.1.smithi187.stdout:7/501: unlink d1/f14 0 2024-09-21T00:56:37.357 INFO:tasks.workunit.client.1.smithi187.stdout:0/533: rmdir d0/d17/d18/d3a 39 2024-09-21T00:56:37.362 INFO:tasks.workunit.client.1.smithi187.stdout:4/579: dwrite d2/d3/f42 [0,4194304] 0 2024-09-21T00:56:37.363 INFO:tasks.workunit.client.1.smithi187.stdout:7/502: unlink d1/d18/d31/d33/d3b/f3f 0 2024-09-21T00:56:37.365 INFO:tasks.workunit.client.1.smithi187.stdout:0/534: creat d0/d17/fb4 x:0 0 0 2024-09-21T00:56:37.366 INFO:tasks.workunit.client.1.smithi187.stdout:8/623: rename dc/f26 to dc/d2f/d80/db8/dba/dc7/fcd 0 2024-09-21T00:56:37.367 INFO:tasks.workunit.client.1.smithi187.stdout:4/580: chown d2/d3/d56/d84/d60/d6c/f91 950322847 1 2024-09-21T00:56:37.369 INFO:tasks.workunit.client.1.smithi187.stdout:4/581: chown d2/d3/da/d2f/d4b 2302336 1 2024-09-21T00:56:37.369 INFO:tasks.workunit.client.1.smithi187.stdout:8/624: write dc/f49 [8532450,34071] 0 2024-09-21T00:56:37.370 INFO:tasks.workunit.client.1.smithi187.stdout:2/624: dwrite d2/dc/d2e/d4a/d7c/f37 [8388608,4194304] 0 2024-09-21T00:56:37.374 INFO:tasks.workunit.client.1.smithi187.stdout:5/523: truncate d0/dc/daa/d67/d14/f21 3957773 0 2024-09-21T00:56:37.375 INFO:tasks.workunit.client.1.smithi187.stdout:1/663: write d4/d6/d64/fb3 [495816,93684] 0 2024-09-21T00:56:37.376 INFO:tasks.workunit.client.1.smithi187.stdout:8/625: fdatasync dc/d2f/d37/f42 0 2024-09-21T00:56:37.381 INFO:tasks.workunit.client.1.smithi187.stdout:6/601: dread d7/d2a/da2/fab [0,4194304] 0 2024-09-21T00:56:37.383 INFO:tasks.workunit.client.1.smithi187.stdout:4/582: truncate d2/d3/da/d2f/d32/d26/d66/d6e/f7b 29482 0 2024-09-21T00:56:37.384 INFO:tasks.workunit.client.1.smithi187.stdout:2/625: dwrite d2/dc/d6b/f96 [0,4194304] 0 2024-09-21T00:56:37.386 INFO:tasks.workunit.client.1.smithi187.stdout:6/602: dread d7/d2a/f9d [0,4194304] 0 2024-09-21T00:56:37.389 INFO:tasks.workunit.client.1.smithi187.stdout:7/503: getdents d1/dc/d15/d22 0 2024-09-21T00:56:37.391 INFO:tasks.workunit.client.1.smithi187.stdout:7/504: stat d1/dc 0 2024-09-21T00:56:37.392 INFO:tasks.workunit.client.1.smithi187.stdout:0/535: truncate d0/d17/d1c/d23/df/d41/f4a 1034799 0 2024-09-21T00:56:37.392 INFO:tasks.workunit.client.1.smithi187.stdout:5/524: dwrite d0/dc/daa/d67/d14/d38/d5a/f7d [0,4194304] 0 2024-09-21T00:56:37.393 INFO:tasks.workunit.client.1.smithi187.stdout:1/664: creat d4/d6/d23/d2e/d94/d35/d79/dd2/fd4 x:0 0 0 2024-09-21T00:56:37.393 INFO:tasks.workunit.client.1.smithi187.stdout:4/583: chown d2/d3/da/d2f/d32/d22/d37/d63/f72 178804817 1 2024-09-21T00:56:37.394 INFO:tasks.workunit.client.1.smithi187.stdout:2/626: unlink d2/da8/d1c/l53 0 2024-09-21T00:56:37.395 INFO:tasks.workunit.client.1.smithi187.stdout:3/520: sync 2024-09-21T00:56:37.398 INFO:tasks.workunit.client.1.smithi187.stdout:0/536: write d0/f70 [3059282,57897] 0 2024-09-21T00:56:37.399 INFO:tasks.workunit.client.1.smithi187.stdout:5/525: chown d0/dc/daa/d67/d14/l63 2218 1 2024-09-21T00:56:37.400 INFO:tasks.workunit.client.1.smithi187.stdout:7/505: read d1/d18/d31/f51 [111744,42572] 0 2024-09-21T00:56:37.404 INFO:tasks.workunit.client.1.smithi187.stdout:3/521: rename d9/d13/f3d to d9/d7f/fa9 0 2024-09-21T00:56:37.405 INFO:tasks.workunit.client.1.smithi187.stdout:2/627: mkdir d2/dc/d2e/de1 0 2024-09-21T00:56:37.406 INFO:tasks.workunit.client.1.smithi187.stdout:7/506: write d1/d18/d31/d33/d3b/d9f/d5d/f6c [152873,57417] 0 2024-09-21T00:56:37.406 INFO:tasks.workunit.client.1.smithi187.stdout:8/626: dwrite dc/d2f/d34/f3a [0,4194304] 0 2024-09-21T00:56:37.406 INFO:tasks.workunit.client.1.smithi187.stdout:0/537: mknod d0/d17/d1c/d23/d36/cb5 0 2024-09-21T00:56:37.408 INFO:tasks.workunit.client.1.smithi187.stdout:2/628: fsync d2/da8/d6c/d97/da1/fd0 0 2024-09-21T00:56:37.408 INFO:tasks.workunit.client.1.smithi187.stdout:1/665: getdents d4/d6/d64 0 2024-09-21T00:56:37.410 INFO:tasks.workunit.client.1.smithi187.stdout:9/724: sync 2024-09-21T00:56:37.411 INFO:tasks.workunit.client.1.smithi187.stdout:8/627: creat dc/d2f/d34/d7d/fce x:0 0 0 2024-09-21T00:56:37.412 INFO:tasks.workunit.client.1.smithi187.stdout:0/538: creat d0/d17/d1c/d65/fb6 x:0 0 0 2024-09-21T00:56:37.412 INFO:tasks.workunit.client.1.smithi187.stdout:6/603: link d7/d2a/d29/d40/d50/l75 d7/d2a/d29/d40/d6a/d88/lc7 0 2024-09-21T00:56:37.413 INFO:tasks.workunit.client.1.smithi187.stdout:5/526: creat d0/dc/faf x:0 0 0 2024-09-21T00:56:37.413 INFO:tasks.workunit.client.1.smithi187.stdout:2/629: mknod d2/dc/d2e/d51/ce2 0 2024-09-21T00:56:37.414 INFO:tasks.workunit.client.1.smithi187.stdout:1/666: mkdir d4/d6/d23/d2e/d94/dd5 0 2024-09-21T00:56:37.414 INFO:tasks.workunit.client.1.smithi187.stdout:4/584: link d2/d3/da/d2f/d32/d22/d37/f38 d2/d3/da/d16/fab 0 2024-09-21T00:56:37.416 INFO:tasks.workunit.client.1.smithi187.stdout:7/507: creat d1/dc/d15/d22/d3e/d73/d8b/d8f/faf x:0 0 0 2024-09-21T00:56:37.420 INFO:tasks.workunit.client.1.smithi187.stdout:6/604: truncate d7/d2a/d29/d40/d50/f96 619657 0 2024-09-21T00:56:37.421 INFO:tasks.workunit.client.1.smithi187.stdout:1/667: read d4/d6/d23/d2e/d94/d35/d22/f57 [3524805,81473] 0 2024-09-21T00:56:37.422 INFO:tasks.workunit.client.1.smithi187.stdout:8/628: rename dc/d44/fb4 to dc/d2f/d80/db8/dba/fcf 0 2024-09-21T00:56:37.422 INFO:tasks.workunit.client.1.smithi187.stdout:9/725: dwrite d4/d13/d14/d1d/f8d [4194304,4194304] 0 2024-09-21T00:56:37.422 INFO:tasks.workunit.client.1.smithi187.stdout:5/527: fdatasync d0/dc/daa/d67/d30/d6b/fa0 0 2024-09-21T00:56:37.424 INFO:tasks.workunit.client.1.smithi187.stdout:0/539: mknod d0/d17/d1c/d23/df/d41/d3b/d46/cb7 0 2024-09-21T00:56:37.424 INFO:tasks.workunit.client.1.smithi187.stdout:7/508: symlink d1/d18/d31/d33/d3b/d9f/lb0 0 2024-09-21T00:56:37.428 INFO:tasks.workunit.client.1.smithi187.stdout:0/540: symlink d0/d17/lb8 0 2024-09-21T00:56:37.431 INFO:tasks.workunit.client.1.smithi187.stdout:5/528: creat d0/dc/daa/d67/d14/d1b/d27/d3a/fb0 x:0 0 0 2024-09-21T00:56:37.431 INFO:tasks.workunit.client.1.smithi187.stdout:9/726: dwrite d4/d13/d14/d1d/fad [0,4194304] 0 2024-09-21T00:56:37.432 INFO:tasks.workunit.client.1.smithi187.stdout:1/668: mknod d4/d6/d23/d2e/d94/d35/d22/d65/d90/cd6 0 2024-09-21T00:56:37.433 INFO:tasks.workunit.client.1.smithi187.stdout:6/605: symlink d7/d2a/d29/d40/d6a/lc8 0 2024-09-21T00:56:37.438 INFO:tasks.workunit.client.1.smithi187.stdout:0/541: write d0/d17/d18/f24 [4335348,43874] 0 2024-09-21T00:56:37.439 INFO:tasks.workunit.client.1.smithi187.stdout:5/529: creat d0/dc/d1f/d26/fb1 x:0 0 0 2024-09-21T00:56:37.440 INFO:tasks.workunit.client.1.smithi187.stdout:6/606: rmdir d7/d2a/d29/d40/d5e 39 2024-09-21T00:56:37.443 INFO:tasks.workunit.client.1.smithi187.stdout:9/727: link d4/f5 d4/d13/d14/fe9 0 2024-09-21T00:56:37.445 INFO:tasks.workunit.client.1.smithi187.stdout:0/542: rmdir d0/d17/d18 39 2024-09-21T00:56:37.446 INFO:tasks.workunit.client.1.smithi187.stdout:2/630: dwrite d2/da8/d1c/d2d/d8f/d9f/fa2 [0,4194304] 0 2024-09-21T00:56:37.447 INFO:tasks.workunit.client.1.smithi187.stdout:4/585: dwrite d2/d3/da/d48/f6d [0,4194304] 0 2024-09-21T00:56:37.448 INFO:tasks.workunit.client.1.smithi187.stdout:5/530: rmdir d0/dc/daa/d67/d14/d57 39 2024-09-21T00:56:37.450 INFO:tasks.workunit.client.1.smithi187.stdout:6/607: dread d7/d2a/d29/f48 [0,4194304] 0 2024-09-21T00:56:37.453 INFO:tasks.workunit.client.1.smithi187.stdout:9/728: mknod d4/d13/d14/d1d/cea 0 2024-09-21T00:56:37.455 INFO:tasks.workunit.client.1.smithi187.stdout:7/509: write d1/f7 [1739591,50270] 0 2024-09-21T00:56:37.456 INFO:tasks.workunit.client.1.smithi187.stdout:1/669: getdents d4/d6/d23/d2e/d94/d35/d22/d2c/d9f 0 2024-09-21T00:56:37.459 INFO:tasks.workunit.client.1.smithi187.stdout:8/629: dread dc/d2f/d80/db8/dba/f33 [0,4194304] 0 2024-09-21T00:56:37.460 INFO:tasks.workunit.client.1.smithi187.stdout:1/670: dread - d4/d86/f8e zero size 2024-09-21T00:56:37.464 INFO:tasks.workunit.client.1.smithi187.stdout:8/630: chown dc/fd 2 1 2024-09-21T00:56:37.464 INFO:tasks.workunit.client.1.smithi187.stdout:2/631: dwrite d2/d3/d15/fb1 [0,4194304] 0 2024-09-21T00:56:37.464 INFO:tasks.workunit.client.1.smithi187.stdout:9/729: truncate d4/d13/d14/d5d/fa2 1759056 0 2024-09-21T00:56:37.466 INFO:tasks.workunit.client.1.smithi187.stdout:5/531: mkdir d0/dc/daa/d67/d14/d57/d5c/db2 0 2024-09-21T00:56:37.466 INFO:tasks.workunit.client.1.smithi187.stdout:4/586: dwrite d2/d3/da/d2f/d32/d22/f3d [4194304,4194304] 0 2024-09-21T00:56:37.471 INFO:tasks.workunit.client.1.smithi187.stdout:0/543: dread d0/d17/d1c/d23/df/d41/f4a [0,4194304] 0 2024-09-21T00:56:37.471 INFO:tasks.workunit.client.1.smithi187.stdout:8/631: unlink dc/d2f/d80/db8/dba/d29/f73 0 2024-09-21T00:56:37.485 INFO:tasks.workunit.client.1.smithi187.stdout:4/587: creat d2/d3/d56/d84/d60/d9e/fac x:0 0 0 2024-09-21T00:56:37.486 INFO:tasks.workunit.client.1.smithi187.stdout:0/544: write d0/d60/d6b/f8d [931504,52741] 0 2024-09-21T00:56:37.487 INFO:tasks.workunit.client.1.smithi187.stdout:9/730: dread d4/d13/d14/d1d/f63 [0,4194304] 0 2024-09-21T00:56:37.488 INFO:tasks.workunit.client.1.smithi187.stdout:8/632: symlink dc/d2f/d80/db8/dba/d3e/ld0 0 2024-09-21T00:56:37.488 INFO:tasks.workunit.client.1.smithi187.stdout:0/545: fsync d0/d60/d6b/fae 0 2024-09-21T00:56:37.490 INFO:tasks.workunit.client.1.smithi187.stdout:4/588: fsync d2/d3/da/d2f/d32/d24/f2e 0 2024-09-21T00:56:37.490 INFO:tasks.workunit.client.1.smithi187.stdout:5/532: dread d0/dc/daa/d67/d14/d38/f82 [0,4194304] 0 2024-09-21T00:56:37.490 INFO:tasks.workunit.client.0.smithi112.stdout:8/29: sync 2024-09-21T00:56:37.491 INFO:tasks.workunit.client.1.smithi187.stdout:8/633: stat dc/l22 0 2024-09-21T00:56:37.492 INFO:tasks.workunit.client.0.smithi112.stdout:8/30: dread - d0/fb zero size 2024-09-21T00:56:37.494 INFO:tasks.workunit.client.0.smithi112.stdout:2/84: sync 2024-09-21T00:56:37.494 INFO:tasks.workunit.client.0.smithi112.stdout:6/47: sync 2024-09-21T00:56:37.494 INFO:tasks.workunit.client.0.smithi112.stdout:0/21: sync 2024-09-21T00:56:37.494 INFO:tasks.workunit.client.0.smithi112.stdout:9/59: sync 2024-09-21T00:56:37.494 INFO:tasks.workunit.client.0.smithi112.stdout:1/8: sync 2024-09-21T00:56:37.495 INFO:tasks.workunit.client.1.smithi187.stdout:1/671: dwrite d4/d6/d23/d2e/d94/d6c/f93 [0,4194304] 0 2024-09-21T00:56:37.495 INFO:tasks.workunit.client.0.smithi112.stdout:3/149: sync 2024-09-21T00:56:37.495 INFO:tasks.workunit.client.0.smithi112.stdout:4/160: sync 2024-09-21T00:56:37.495 INFO:tasks.workunit.client.0.smithi112.stdout:7/108: sync 2024-09-21T00:56:37.495 INFO:tasks.workunit.client.0.smithi112.stdout:5/21: sync 2024-09-21T00:56:37.496 INFO:tasks.workunit.client.1.smithi187.stdout:4/589: chown d2/d3/da/d48/f6d 18203309 1 2024-09-21T00:56:37.497 INFO:tasks.workunit.client.1.smithi187.stdout:8/634: write dc/d2f/fc8 [909024,68022] 0 2024-09-21T00:56:37.498 INFO:tasks.workunit.client.1.smithi187.stdout:5/533: mknod d0/dc/cb3 0 2024-09-21T00:56:37.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/9: chown l0 61 1 2024-09-21T00:56:37.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/10: dread - no filename 2024-09-21T00:56:37.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/11: dread - no filename 2024-09-21T00:56:37.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/12: dread - no filename 2024-09-21T00:56:37.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/13: fdatasync - no filename 2024-09-21T00:56:37.498 INFO:tasks.workunit.client.0.smithi112.stdout:3/150: chown d2/l7 0 1 2024-09-21T00:56:37.499 INFO:tasks.workunit.client.1.smithi187.stdout:6/608: dread d7/d2a/d29/f60 [0,4194304] 0 2024-09-21T00:56:37.499 INFO:tasks.workunit.client.1.smithi187.stdout:0/546: creat d0/fb9 x:0 0 0 2024-09-21T00:56:37.499 INFO:tasks.workunit.client.0.smithi112.stdout:5/22: chown f6 345 1 2024-09-21T00:56:37.500 INFO:tasks.workunit.client.0.smithi112.stdout:6/48: symlink d9/l10 0 2024-09-21T00:56:37.501 INFO:tasks.workunit.client.0.smithi112.stdout:5/23: dread f4 [0,4194304] 0 2024-09-21T00:56:37.501 INFO:tasks.workunit.client.1.smithi187.stdout:0/547: read - d0/d60/d6b/fa9 zero size 2024-09-21T00:56:37.503 INFO:tasks.workunit.client.1.smithi187.stdout:9/731: dwrite d4/d8/d41/f5b [0,4194304] 0 2024-09-21T00:56:37.506 INFO:tasks.workunit.client.0.smithi112.stdout:0/22: rename f3 to f7 0 2024-09-21T00:56:37.506 INFO:tasks.workunit.client.0.smithi112.stdout:0/23: stat l4 0 2024-09-21T00:56:37.507 INFO:tasks.workunit.client.0.smithi112.stdout:0/24: stat l6 0 2024-09-21T00:56:37.509 INFO:tasks.workunit.client.0.smithi112.stdout:7/109: mknod d0/d2/c1e 0 2024-09-21T00:56:37.510 INFO:tasks.workunit.client.1.smithi187.stdout:4/590: creat d2/d3/d56/d84/d58/fad x:0 0 0 2024-09-21T00:56:37.510 INFO:tasks.workunit.client.0.smithi112.stdout:8/31: dwrite d0/fb [0,4194304] 0 2024-09-21T00:56:37.512 INFO:tasks.workunit.client.0.smithi112.stdout:1/14: symlink l2 0 2024-09-21T00:56:37.513 INFO:tasks.workunit.client.1.smithi187.stdout:5/534: dwrite d0/dc/d1f/d26/f9c [0,4194304] 0 2024-09-21T00:56:37.513 INFO:tasks.workunit.client.1.smithi187.stdout:6/609: dread d7/d2a/da2/fab [0,4194304] 0 2024-09-21T00:56:37.513 INFO:tasks.workunit.client.1.smithi187.stdout:7/510: dread d1/d18/d31/d33/d3b/f66 [0,4194304] 0 2024-09-21T00:56:37.513 INFO:tasks.workunit.client.0.smithi112.stdout:8/32: dread d0/f9 [0,4194304] 0 2024-09-21T00:56:37.514 INFO:tasks.workunit.client.0.smithi112.stdout:3/151: symlink d2/d8/dd/de/l2a 0 2024-09-21T00:56:37.514 INFO:tasks.workunit.client.1.smithi187.stdout:4/591: write d2/d3/da/d16/d5f/f75 [612347,2767] 0 2024-09-21T00:56:37.516 INFO:tasks.workunit.client.1.smithi187.stdout:0/548: creat d0/d17/d1c/d23/d36/fba x:0 0 0 2024-09-21T00:56:37.517 INFO:tasks.workunit.client.0.smithi112.stdout:6/49: mkdir d9/d11 0 2024-09-21T00:56:37.517 INFO:tasks.workunit.client.0.smithi112.stdout:4/161: dread d1/d7/f17 [0,4194304] 0 2024-09-21T00:56:37.517 INFO:tasks.workunit.client.0.smithi112.stdout:3/152: chown d2/c1a 4605243 1 2024-09-21T00:56:37.519 INFO:tasks.workunit.client.0.smithi112.stdout:5/24: creat f7 x:0 0 0 2024-09-21T00:56:37.519 INFO:tasks.workunit.client.1.smithi187.stdout:8/635: unlink dc/d2f/d80/db8/dba/d3e/d75/c89 0 2024-09-21T00:56:37.520 INFO:tasks.workunit.client.1.smithi187.stdout:8/636: write dc/d2f/d34/f3a [3248877,35897] 0 2024-09-21T00:56:37.521 INFO:tasks.workunit.client.1.smithi187.stdout:9/732: rename d4/d8/d44/d6e/d92/f97 to d4/d13/d14/feb 0 2024-09-21T00:56:37.524 INFO:tasks.workunit.client.0.smithi112.stdout:9/60: write d5/f16 [53619,22450] 0 2024-09-21T00:56:37.526 INFO:tasks.workunit.client.0.smithi112.stdout:0/25: readlink l5 0 2024-09-21T00:56:37.528 INFO:tasks.workunit.client.1.smithi187.stdout:4/592: creat d2/d3/d56/d84/d60/d6c/d77/fae x:0 0 0 2024-09-21T00:56:37.529 INFO:tasks.workunit.client.1.smithi187.stdout:0/549: unlink d0/d17/d1c/d23/df/d41/c34 0 2024-09-21T00:56:37.529 INFO:tasks.workunit.client.0.smithi112.stdout:7/110: dread d0/f10 [0,4194304] 0 2024-09-21T00:56:37.531 INFO:tasks.workunit.client.1.smithi187.stdout:3/522: sync 2024-09-21T00:56:37.532 INFO:tasks.workunit.client.1.smithi187.stdout:3/523: truncate d9/f4e 998777 0 2024-09-21T00:56:37.533 INFO:tasks.workunit.client.0.smithi112.stdout:6/50: creat d9/f12 x:0 0 0 2024-09-21T00:56:37.533 INFO:tasks.workunit.client.1.smithi187.stdout:1/672: getdents d4/d6/d23/d2e/d94/d35/d79 0 2024-09-21T00:56:37.535 INFO:tasks.workunit.client.0.smithi112.stdout:5/25: unlink f6 0 2024-09-21T00:56:37.536 INFO:tasks.workunit.client.1.smithi187.stdout:8/637: creat dc/d2f/d80/db8/dba/d29/fd1 x:0 0 0 2024-09-21T00:56:37.537 INFO:tasks.workunit.client.1.smithi187.stdout:8/638: write dc/d2f/d37/f57 [706898,109436] 0 2024-09-21T00:56:37.537 INFO:tasks.workunit.client.1.smithi187.stdout:5/535: mknod d0/cb4 0 2024-09-21T00:56:37.538 INFO:tasks.workunit.client.0.smithi112.stdout:2/85: link d0/fa d0/f18 0 2024-09-21T00:56:37.542 INFO:tasks.workunit.client.0.smithi112.stdout:0/26: dread - f7 zero size 2024-09-21T00:56:37.545 INFO:tasks.workunit.client.0.smithi112.stdout:8/33: link d0/fb d0/fd 0 2024-09-21T00:56:37.546 INFO:tasks.workunit.client.0.smithi112.stdout:8/34: chown d0/f3 270 1 2024-09-21T00:56:37.547 INFO:tasks.workunit.client.1.smithi187.stdout:1/673: dread d4/d6/d23/d2e/d94/d35/d4c/d5b/d83/f84 [0,4194304] 0 2024-09-21T00:56:37.547 INFO:tasks.workunit.client.1.smithi187.stdout:0/550: write d0/d17/d18/f78 [3410161,17686] 0 2024-09-21T00:56:37.548 INFO:tasks.workunit.client.0.smithi112.stdout:7/111: fdatasync d0/f19 0 2024-09-21T00:56:37.550 INFO:tasks.workunit.client.1.smithi187.stdout:3/524: rmdir d9/d19/d43 39 2024-09-21T00:56:37.552 INFO:tasks.workunit.client.1.smithi187.stdout:8/639: fsync dc/d2f/d80/db8/dba/fcf 0 2024-09-21T00:56:37.553 INFO:tasks.workunit.client.0.smithi112.stdout:6/51: rename d9/d11 to d9/d13 0 2024-09-21T00:56:37.554 INFO:tasks.workunit.client.1.smithi187.stdout:2/632: sync 2024-09-21T00:56:37.555 INFO:tasks.workunit.client.1.smithi187.stdout:5/536: unlink d0/dc/daa/d67/d14/l63 0 2024-09-21T00:56:37.556 INFO:tasks.workunit.client.1.smithi187.stdout:3/525: dwrite d9/d13/d87/d94/d53/d56/d7d/d81/f84 [0,4194304] 0 2024-09-21T00:56:37.556 INFO:tasks.workunit.client.0.smithi112.stdout:5/26: mkdir d8 0 2024-09-21T00:56:37.557 INFO:tasks.workunit.client.0.smithi112.stdout:9/61: write d5/fc [5102205,50953] 0 2024-09-21T00:56:37.557 INFO:tasks.workunit.client.1.smithi187.stdout:6/610: getdents d7/d2a/d29 0 2024-09-21T00:56:37.559 INFO:tasks.workunit.client.0.smithi112.stdout:4/162: rename d1/d5/d1c/d1e/l1f to d1/d7/d9/d1a/l37 0 2024-09-21T00:56:37.560 INFO:tasks.workunit.client.1.smithi187.stdout:4/593: write d2/d3/da/d48/f9c [2500656,1527] 0 2024-09-21T00:56:37.564 INFO:tasks.workunit.client.0.smithi112.stdout:5/27: dwrite f7 [0,4194304] 0 2024-09-21T00:56:37.566 INFO:tasks.workunit.client.0.smithi112.stdout:0/27: mkdir d8 0 2024-09-21T00:56:37.568 INFO:tasks.workunit.client.1.smithi187.stdout:1/674: mknod d4/d6/d23/d2e/d94/d35/d4c/cd7 0 2024-09-21T00:56:37.568 INFO:tasks.workunit.client.0.smithi112.stdout:8/35: creat d0/fe x:0 0 0 2024-09-21T00:56:37.569 INFO:tasks.workunit.client.1.smithi187.stdout:4/594: dread d2/d3/d56/f87 [0,4194304] 0 2024-09-21T00:56:37.569 INFO:tasks.workunit.client.1.smithi187.stdout:1/675: fdatasync d4/d6/d23/d2e/d94/d35/d22/d65/f9d 0 2024-09-21T00:56:37.571 INFO:tasks.workunit.client.1.smithi187.stdout:4/595: chown d2/d3/da/fa6 65803 1 2024-09-21T00:56:37.573 INFO:tasks.workunit.client.1.smithi187.stdout:1/676: chown d4/d6/d23/d2e/d94/f4e 1778454 1 2024-09-21T00:56:37.573 INFO:tasks.workunit.client.0.smithi112.stdout:3/153: rmdir d2/d8/dd/d21 0 2024-09-21T00:56:37.574 INFO:tasks.workunit.client.0.smithi112.stdout:3/154: chown d2/d8/d28/f26 3 1 2024-09-21T00:56:37.576 INFO:tasks.workunit.client.1.smithi187.stdout:5/537: mknod d0/dc/daa/d67/d30/cb5 0 2024-09-21T00:56:37.577 INFO:tasks.workunit.client.0.smithi112.stdout:6/52: dread - d9/fd zero size 2024-09-21T00:56:37.578 INFO:tasks.workunit.client.0.smithi112.stdout:9/62: read - d5/f14 zero size 2024-09-21T00:56:37.580 INFO:tasks.workunit.client.1.smithi187.stdout:6/611: unlink d7/d2a/d29/d40/d6a/lc8 0 2024-09-21T00:56:37.580 INFO:tasks.workunit.client.0.smithi112.stdout:2/86: dwrite d0/fb [0,4194304] 0 2024-09-21T00:56:37.581 INFO:tasks.workunit.client.0.smithi112.stdout:7/112: write d0/f10 [5026768,60912] 0 2024-09-21T00:56:37.582 INFO:tasks.workunit.client.1.smithi187.stdout:7/511: getdents d1/dc 0 2024-09-21T00:56:37.587 INFO:tasks.workunit.client.1.smithi187.stdout:9/733: getdents d4/d8/d46/d54 0 2024-09-21T00:56:37.592 INFO:tasks.workunit.client.0.smithi112.stdout:5/28: dwrite f5 [0,4194304] 0 2024-09-21T00:56:37.592 INFO:tasks.workunit.client.1.smithi187.stdout:4/596: fsync d2/d3/da/d2f/d4b/d7e/fa3 0 2024-09-21T00:56:37.594 INFO:tasks.workunit.client.0.smithi112.stdout:4/163: write d1/d5/d1c/d1e/f20 [775971,106474] 0 2024-09-21T00:56:37.595 INFO:tasks.workunit.client.1.smithi187.stdout:1/677: rename d4/d6/cc9 to d4/d6/d23/d2e/d94/d6c/cd8 0 2024-09-21T00:56:37.597 INFO:tasks.workunit.client.0.smithi112.stdout:3/155: mknod d2/d8/d28/c2b 0 2024-09-21T00:56:37.599 INFO:tasks.workunit.client.0.smithi112.stdout:6/53: truncate d9/fd 159225 0 2024-09-21T00:56:37.600 INFO:tasks.workunit.client.0.smithi112.stdout:6/54: read - d9/f12 zero size 2024-09-21T00:56:37.606 INFO:tasks.workunit.client.0.smithi112.stdout:0/28: mknod d8/c9 0 2024-09-21T00:56:37.606 INFO:tasks.workunit.client.1.smithi187.stdout:6/612: dwrite d7/d2a/d29/d40/d50/fb0 [0,4194304] 0 2024-09-21T00:56:37.607 INFO:tasks.workunit.client.0.smithi112.stdout:0/29: stat l4 0 2024-09-21T00:56:37.608 INFO:tasks.workunit.client.0.smithi112.stdout:8/36: dwrite d0/f3 [0,4194304] 0 2024-09-21T00:56:37.609 INFO:tasks.workunit.client.0.smithi112.stdout:4/164: chown d1/d7/f2e 3 1 2024-09-21T00:56:37.611 INFO:tasks.workunit.client.1.smithi187.stdout:4/597: mkdir d2/d3/da/d2f/d4b/daf 0 2024-09-21T00:56:37.612 INFO:tasks.workunit.client.0.smithi112.stdout:3/156: fsync d2/d8/dd/f27 0 2024-09-21T00:56:37.614 INFO:tasks.workunit.client.1.smithi187.stdout:6/613: dwrite d7/d2a/d29/d40/fae [0,4194304] 0 2024-09-21T00:56:37.614 INFO:tasks.workunit.client.1.smithi187.stdout:7/512: dread d1/d18/f8d [0,4194304] 0 2024-09-21T00:56:37.615 INFO:tasks.workunit.client.1.smithi187.stdout:1/678: mknod d4/d6/d23/d2e/d94/d35/d22/d65/cd9 0 2024-09-21T00:56:37.616 INFO:tasks.workunit.client.1.smithi187.stdout:2/633: write d2/f7 [52823,26227] 0 2024-09-21T00:56:37.619 INFO:tasks.workunit.client.0.smithi112.stdout:9/63: write d5/d6/de/f12 [301528,19591] 0 2024-09-21T00:56:37.619 INFO:tasks.workunit.client.1.smithi187.stdout:7/513: dread - d1/dc/d15/d22/d3e/d73/d8b/d8f/faf zero size 2024-09-21T00:56:37.624 INFO:tasks.workunit.client.1.smithi187.stdout:0/551: truncate d0/d17/d18/d3a/f77 8124018 0 2024-09-21T00:56:37.627 INFO:tasks.workunit.client.0.smithi112.stdout:7/113: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:37.628 INFO:tasks.workunit.client.1.smithi187.stdout:6/614: dwrite d7/d2a/d29/d40/d50/fb0 [0,4194304] 0 2024-09-21T00:56:37.628 INFO:tasks.workunit.client.1.smithi187.stdout:8/640: link dc/d2f/d80/db8/dba/d29/la9 dc/d2f/d80/db8/dba/d29/da7/ld2 0 2024-09-21T00:56:37.630 INFO:tasks.workunit.client.1.smithi187.stdout:1/679: dwrite d4/d6/d23/f45 [0,4194304] 0 2024-09-21T00:56:37.630 INFO:tasks.workunit.client.0.smithi112.stdout:0/30: creat d8/fa x:0 0 0 2024-09-21T00:56:37.630 INFO:tasks.workunit.client.0.smithi112.stdout:0/31: dread - d8/fa zero size 2024-09-21T00:56:37.631 INFO:tasks.workunit.client.1.smithi187.stdout:1/680: write d4/d6/d23/f54 [3418999,82609] 0 2024-09-21T00:56:37.631 INFO:tasks.workunit.client.0.smithi112.stdout:8/37: creat d0/ff x:0 0 0 2024-09-21T00:56:37.632 INFO:tasks.workunit.client.0.smithi112.stdout:0/32: write d8/fa [484388,125283] 0 2024-09-21T00:56:37.632 INFO:tasks.workunit.client.1.smithi187.stdout:4/598: mkdir d2/d3/da/d48/db0 0 2024-09-21T00:56:37.633 INFO:tasks.workunit.client.0.smithi112.stdout:4/165: read d1/d5/d1c/d1e/f31 [23249,25700] 0 2024-09-21T00:56:37.636 INFO:tasks.workunit.client.1.smithi187.stdout:1/681: read d4/d6/d23/d2e/d94/d35/d4c/f4d [1512373,23666] 0 2024-09-21T00:56:37.637 INFO:tasks.workunit.client.0.smithi112.stdout:8/38: dread d0/f3 [0,4194304] 0 2024-09-21T00:56:37.638 INFO:tasks.workunit.client.0.smithi112.stdout:3/157: creat d2/d8/d28/f2c x:0 0 0 2024-09-21T00:56:37.639 INFO:tasks.workunit.client.1.smithi187.stdout:7/514: unlink d1/d18/c9a 0 2024-09-21T00:56:37.640 INFO:tasks.workunit.client.1.smithi187.stdout:8/641: dwrite dc/d2f/d34/d4b/fcc [0,4194304] 0 2024-09-21T00:56:37.641 INFO:tasks.workunit.client.1.smithi187.stdout:3/526: getdents d9/d13 0 2024-09-21T00:56:37.642 INFO:tasks.workunit.client.1.smithi187.stdout:9/734: link d4/d13/d20/d2b/c6d d4/d13/d14/d1d/cec 0 2024-09-21T00:56:37.643 INFO:tasks.workunit.client.1.smithi187.stdout:9/735: stat d4/d61/f68 0 2024-09-21T00:56:37.647 INFO:tasks.workunit.client.1.smithi187.stdout:5/538: sync 2024-09-21T00:56:37.647 INFO:tasks.workunit.client.0.smithi112.stdout:9/64: rename d5/d6/f9 to d5/f17 0 2024-09-21T00:56:37.649 INFO:tasks.workunit.client.1.smithi187.stdout:5/539: chown d0/dc/daa/d67/d14/d1b/d27/d3a/l54 0 1 2024-09-21T00:56:37.649 INFO:tasks.workunit.client.0.smithi112.stdout:5/29: write f4 [800172,42861] 0 2024-09-21T00:56:37.651 INFO:tasks.workunit.client.1.smithi187.stdout:6/615: creat d7/d2a/d29/d40/d50/fc9 x:0 0 0 2024-09-21T00:56:37.654 INFO:tasks.workunit.client.0.smithi112.stdout:0/33: creat d8/fb x:0 0 0 2024-09-21T00:56:37.654 INFO:tasks.workunit.client.0.smithi112.stdout:4/166: rmdir d1/d5/d1c 39 2024-09-21T00:56:37.655 INFO:tasks.workunit.client.1.smithi187.stdout:4/599: write d2/d3/da/d16/f61 [4790166,86885] 0 2024-09-21T00:56:37.656 INFO:tasks.workunit.client.1.smithi187.stdout:2/634: mkdir d2/dc/d2e/de1/de3 0 2024-09-21T00:56:37.656 INFO:tasks.workunit.client.1.smithi187.stdout:3/527: dwrite d9/d13/d87/d94/f90 [0,4194304] 0 2024-09-21T00:56:37.657 INFO:tasks.workunit.client.0.smithi112.stdout:8/39: creat d0/f10 x:0 0 0 2024-09-21T00:56:37.658 INFO:tasks.workunit.client.1.smithi187.stdout:2/635: stat d2/da8/d1c/fbd 0 2024-09-21T00:56:37.658 INFO:tasks.workunit.client.0.smithi112.stdout:3/158: dread - d2/d8/f16 zero size 2024-09-21T00:56:37.660 INFO:tasks.workunit.client.0.smithi112.stdout:6/55: dread d9/fd [0,4194304] 0 2024-09-21T00:56:37.660 INFO:tasks.workunit.client.0.smithi112.stdout:2/87: getdents d0/df 0 2024-09-21T00:56:37.660 INFO:tasks.workunit.client.1.smithi187.stdout:7/515: creat d1/dc/d15/d2b/fb1 x:0 0 0 2024-09-21T00:56:37.661 INFO:tasks.workunit.client.1.smithi187.stdout:8/642: chown dc/c11 511850375 1 2024-09-21T00:56:37.662 INFO:tasks.workunit.client.1.smithi187.stdout:4/600: write d2/d3/da/d2f/d32/d22/d37/d3a/f8d [189382,5436] 0 2024-09-21T00:56:37.662 INFO:tasks.workunit.client.1.smithi187.stdout:9/736: mkdir d4/d8/ded 0 2024-09-21T00:56:37.663 INFO:tasks.workunit.client.1.smithi187.stdout:5/540: dwrite d0/dc/d1f/d26/f64 [0,4194304] 0 2024-09-21T00:56:37.665 INFO:tasks.workunit.client.0.smithi112.stdout:7/114: creat d0/d8/d1a/f1f x:0 0 0 2024-09-21T00:56:37.666 INFO:tasks.workunit.client.1.smithi187.stdout:4/601: chown d2/d3/d74/f92 109 1 2024-09-21T00:56:37.666 INFO:tasks.workunit.client.1.smithi187.stdout:9/737: readlink d4/d10/d39/d69/l7f 0 2024-09-21T00:56:37.666 INFO:tasks.workunit.client.1.smithi187.stdout:5/541: chown d0/dc/daa/d67/d14/d1b/d27/c51 59230 1 2024-09-21T00:56:37.666 INFO:tasks.workunit.client.1.smithi187.stdout:9/738: fdatasync d4/d13/d14/d1d/d5f/fc6 0 2024-09-21T00:56:37.667 INFO:tasks.workunit.client.0.smithi112.stdout:0/34: mkdir d8/dc 0 2024-09-21T00:56:37.668 INFO:tasks.workunit.client.0.smithi112.stdout:0/35: readlink l2 0 2024-09-21T00:56:37.670 INFO:tasks.workunit.client.0.smithi112.stdout:8/40: creat d0/f11 x:0 0 0 2024-09-21T00:56:37.671 INFO:tasks.workunit.client.0.smithi112.stdout:8/41: chown d0/f9 0 1 2024-09-21T00:56:37.671 INFO:tasks.workunit.client.0.smithi112.stdout:8/42: dread - d0/f10 zero size 2024-09-21T00:56:37.675 INFO:tasks.workunit.client.1.smithi187.stdout:2/636: rename d2/dc/d2e/f9e to d2/da8/d9d/fe4 0 2024-09-21T00:56:37.676 INFO:tasks.workunit.client.1.smithi187.stdout:3/528: dwrite d9/d19/d43/f52 [0,4194304] 0 2024-09-21T00:56:37.677 INFO:tasks.workunit.client.1.smithi187.stdout:2/637: dread - d2/dc/d21/fd1 zero size 2024-09-21T00:56:37.679 INFO:tasks.workunit.client.1.smithi187.stdout:0/552: creat d0/fbb x:0 0 0 2024-09-21T00:56:37.679 INFO:tasks.workunit.client.0.smithi112.stdout:9/65: link d5/fc d5/d6/de/d13/f18 0 2024-09-21T00:56:37.681 INFO:tasks.workunit.client.1.smithi187.stdout:7/516: creat d1/dc/fb2 x:0 0 0 2024-09-21T00:56:37.682 INFO:tasks.workunit.client.1.smithi187.stdout:8/643: symlink dc/d2f/d34/d7d/ld3 0 2024-09-21T00:56:37.684 INFO:tasks.workunit.client.0.smithi112.stdout:7/115: symlink d0/d8/l20 0 2024-09-21T00:56:37.686 INFO:tasks.workunit.client.1.smithi187.stdout:6/616: symlink d7/d2a/lca 0 2024-09-21T00:56:37.686 INFO:tasks.workunit.client.0.smithi112.stdout:0/36: truncate f7 910558 0 2024-09-21T00:56:37.688 INFO:tasks.workunit.client.1.smithi187.stdout:5/542: unlink d0/dc/daa/d67/d30/d6b/ca2 0 2024-09-21T00:56:37.689 INFO:tasks.workunit.client.0.smithi112.stdout:4/167: symlink d1/d2d/d34/l38 0 2024-09-21T00:56:37.691 INFO:tasks.workunit.client.0.smithi112.stdout:7/116: dwrite d0/f10 [4194304,4194304] 0 2024-09-21T00:56:37.692 INFO:tasks.workunit.client.0.smithi112.stdout:8/43: write d0/f3 [1975252,109472] 0 2024-09-21T00:56:37.694 INFO:tasks.workunit.client.1.smithi187.stdout:5/543: dwrite d0/dc/daa/d67/d30/f3b [0,4194304] 0 2024-09-21T00:56:37.694 INFO:tasks.workunit.client.0.smithi112.stdout:6/56: mknod d9/df/c14 0 2024-09-21T00:56:37.698 INFO:tasks.workunit.client.1.smithi187.stdout:4/602: rename d2/d3/d56/d84/d58 to d2/d3/d74/db1 0 2024-09-21T00:56:37.699 INFO:tasks.workunit.client.0.smithi112.stdout:1/15: sync 2024-09-21T00:56:37.701 INFO:tasks.workunit.client.1.smithi187.stdout:3/529: mkdir d9/d19/da7/daa 0 2024-09-21T00:56:37.701 INFO:tasks.workunit.client.0.smithi112.stdout:8/44: dwrite d0/f3 [0,4194304] 0 2024-09-21T00:56:37.701 INFO:tasks.workunit.client.1.smithi187.stdout:4/603: write d2/d3/da/d2f/d32/d22/f3d [4799874,10620] 0 2024-09-21T00:56:37.702 INFO:tasks.workunit.client.1.smithi187.stdout:3/530: fdatasync d9/f11 0 2024-09-21T00:56:37.702 INFO:tasks.workunit.client.1.smithi187.stdout:2/638: dread d2/fa [4194304,4194304] 0 2024-09-21T00:56:37.705 INFO:tasks.workunit.client.1.smithi187.stdout:3/531: dread - d9/d13/d87/d94/d53/d56/d61/f74 zero size 2024-09-21T00:56:37.709 INFO:tasks.workunit.client.0.smithi112.stdout:7/117: dread - d0/f19 zero size 2024-09-21T00:56:37.712 INFO:tasks.workunit.client.1.smithi187.stdout:2/639: dwrite d2/da8/d6c/d97/da1/fa4 [0,4194304] 0 2024-09-21T00:56:37.714 INFO:tasks.workunit.client.1.smithi187.stdout:9/739: creat d4/d13/d20/d2b/d66/db6/fee x:0 0 0 2024-09-21T00:56:37.714 INFO:tasks.workunit.client.1.smithi187.stdout:9/740: chown d4/d8/ded 2 1 2024-09-21T00:56:37.715 INFO:tasks.workunit.client.0.smithi112.stdout:5/30: dwrite f3 [0,4194304] 0 2024-09-21T00:56:37.719 INFO:tasks.workunit.client.1.smithi187.stdout:7/517: rename d1/dc/d15/d22/f4f to d1/d18/d31/d41/d64/d93/fb3 0 2024-09-21T00:56:37.721 INFO:tasks.workunit.client.1.smithi187.stdout:1/682: dwrite d4/f62 [0,4194304] 0 2024-09-21T00:56:37.723 INFO:tasks.workunit.client.0.smithi112.stdout:1/16: symlink l3 0 2024-09-21T00:56:37.728 INFO:tasks.workunit.client.1.smithi187.stdout:0/553: symlink d0/d60/d6b/d9f/lbc 0 2024-09-21T00:56:37.729 INFO:tasks.workunit.client.1.smithi187.stdout:0/554: readlink d0/d17/d1c/l6d 0 2024-09-21T00:56:37.730 INFO:tasks.workunit.client.1.smithi187.stdout:0/555: chown d0/d17/d18/f68 64896 1 2024-09-21T00:56:37.731 INFO:tasks.workunit.client.0.smithi112.stdout:0/37: read f7 [522852,124564] 0 2024-09-21T00:56:37.733 INFO:tasks.workunit.client.0.smithi112.stdout:7/118: fdatasync d0/f19 0 2024-09-21T00:56:37.735 INFO:tasks.workunit.client.0.smithi112.stdout:3/159: rename d2/d8/cf to d2/d8/c2d 0 2024-09-21T00:56:37.736 INFO:tasks.workunit.client.0.smithi112.stdout:2/88: write d0/fa [228539,13652] 0 2024-09-21T00:56:37.739 INFO:tasks.workunit.client.1.smithi187.stdout:5/544: unlink d0/dc/daa/d67/d14/d1b/d27/d3a/l69 0 2024-09-21T00:56:37.741 INFO:tasks.workunit.client.0.smithi112.stdout:4/168: write d1/d5/fd [307578,29365] 0 2024-09-21T00:56:37.743 INFO:tasks.workunit.client.1.smithi187.stdout:3/532: rename d9/d13/d87/d94/d53/f67 to d9/d13/d87/fab 0 2024-09-21T00:56:37.743 INFO:tasks.workunit.client.1.smithi187.stdout:7/518: fsync d1/d18/d31/d33/d3b/f66 0 2024-09-21T00:56:37.744 INFO:tasks.workunit.client.0.smithi112.stdout:1/17: creat f4 x:0 0 0 2024-09-21T00:56:37.745 INFO:tasks.workunit.client.1.smithi187.stdout:8/644: dwrite f7 [0,4194304] 0 2024-09-21T00:56:37.745 INFO:tasks.workunit.client.0.smithi112.stdout:6/57: write f3 [2178313,37431] 0 2024-09-21T00:56:37.746 INFO:tasks.workunit.client.1.smithi187.stdout:8/645: stat dc/f62 0 2024-09-21T00:56:37.747 INFO:tasks.workunit.client.1.smithi187.stdout:8/646: write dc/d2f/d34/f3a [4162672,41292] 0 2024-09-21T00:56:37.747 INFO:tasks.workunit.client.0.smithi112.stdout:9/66: write d5/f17 [578385,89777] 0 2024-09-21T00:56:37.748 INFO:tasks.workunit.client.0.smithi112.stdout:0/38: truncate f7 39373 0 2024-09-21T00:56:37.748 INFO:tasks.workunit.client.1.smithi187.stdout:0/556: symlink d0/d17/d1c/d23/df/d51/lbd 0 2024-09-21T00:56:37.749 INFO:tasks.workunit.client.0.smithi112.stdout:0/39: truncate d8/fa 855421 0 2024-09-21T00:56:37.752 INFO:tasks.workunit.client.1.smithi187.stdout:5/545: mknod d0/dc/daa/d67/d14/d57/cb6 0 2024-09-21T00:56:37.753 INFO:tasks.workunit.client.0.smithi112.stdout:7/119: truncate d0/d2/f1d 901666 0 2024-09-21T00:56:37.753 INFO:tasks.workunit.client.1.smithi187.stdout:5/546: read - d0/dc/faf zero size 2024-09-21T00:56:37.755 INFO:tasks.workunit.client.1.smithi187.stdout:7/519: dwrite d1/dc/d15/d22/f86 [0,4194304] 0 2024-09-21T00:56:37.756 INFO:tasks.workunit.client.1.smithi187.stdout:1/683: symlink d4/d6/d23/d2e/d94/d35/d22/dac/lda 0 2024-09-21T00:56:37.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/45: dwrite d0/f9 [0,4194304] 0 2024-09-21T00:56:37.758 INFO:tasks.workunit.client.0.smithi112.stdout:8/46: truncate d0/ff 298778 0 2024-09-21T00:56:37.758 INFO:tasks.workunit.client.0.smithi112.stdout:2/89: rename d0/fb to d0/d14/f19 0 2024-09-21T00:56:37.759 INFO:tasks.workunit.client.0.smithi112.stdout:8/47: stat d0/f9 0 2024-09-21T00:56:37.760 INFO:tasks.workunit.client.0.smithi112.stdout:5/31: mkdir d8/d9 0 2024-09-21T00:56:37.763 INFO:tasks.workunit.client.1.smithi187.stdout:6/617: getdents d7/d59 0 2024-09-21T00:56:37.764 INFO:tasks.workunit.client.0.smithi112.stdout:1/18: unlink l0 0 2024-09-21T00:56:37.766 INFO:tasks.workunit.client.0.smithi112.stdout:5/32: dread f4 [0,4194304] 0 2024-09-21T00:56:37.766 INFO:tasks.workunit.client.1.smithi187.stdout:9/741: link d4/d8/d44/cb1 d4/d13/d20/d2b/d66/db6/cef 0 2024-09-21T00:56:37.767 INFO:tasks.workunit.client.0.smithi112.stdout:6/58: creat d9/d13/f15 x:0 0 0 2024-09-21T00:56:37.770 INFO:tasks.workunit.client.0.smithi112.stdout:4/169: dwrite d1/d5/d1c/d1e/f20 [0,4194304] 0 2024-09-21T00:56:37.776 INFO:tasks.workunit.client.1.smithi187.stdout:0/557: rename d0/d17/d1c/l76 to d0/d17/d1c/d23/df/d41/lbe 0 2024-09-21T00:56:37.777 INFO:tasks.workunit.client.1.smithi187.stdout:5/547: mkdir d0/dc/daa/d67/d14/d38/d5a/d6c/db7 0 2024-09-21T00:56:37.778 INFO:tasks.workunit.client.1.smithi187.stdout:7/520: fdatasync d1/f9 0 2024-09-21T00:56:37.781 INFO:tasks.workunit.client.0.smithi112.stdout:2/90: creat d0/d14/d8/f1a x:0 0 0 2024-09-21T00:56:37.781 INFO:tasks.workunit.client.1.smithi187.stdout:8/647: symlink dc/d44/ld4 0 2024-09-21T00:56:37.782 INFO:tasks.workunit.client.0.smithi112.stdout:2/91: read - d0/d14/d8/f1a zero size 2024-09-21T00:56:37.783 INFO:tasks.workunit.client.0.smithi112.stdout:2/92: chown d0/d14/d8/c17 129 1 2024-09-21T00:56:37.783 INFO:tasks.workunit.client.0.smithi112.stdout:2/93: stat d0/d14/f9 0 2024-09-21T00:56:37.784 INFO:tasks.workunit.client.1.smithi187.stdout:9/742: write d4/d61/d6a/f9e [1998239,109635] 0 2024-09-21T00:56:37.784 INFO:tasks.workunit.client.1.smithi187.stdout:9/743: chown d4/d13/d20/d2e 236476384 1 2024-09-21T00:56:37.785 INFO:tasks.workunit.client.1.smithi187.stdout:6/618: rename d7/d2a/d29/d40/l90 to d7/d2a/d29/lcb 0 2024-09-21T00:56:37.786 INFO:tasks.workunit.client.1.smithi187.stdout:6/619: write d7/f4e [1113004,124661] 0 2024-09-21T00:56:37.788 INFO:tasks.workunit.client.0.smithi112.stdout:1/19: unlink l3 0 2024-09-21T00:56:37.788 INFO:tasks.workunit.client.1.smithi187.stdout:8/648: dread dc/d2f/d80/db8/dba/d29/f4c [0,4194304] 0 2024-09-21T00:56:37.789 INFO:tasks.workunit.client.1.smithi187.stdout:8/649: read dc/d2f/d54/d69/f9c [345023,80708] 0 2024-09-21T00:56:37.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/59: symlink d9/l16 0 2024-09-21T00:56:37.799 INFO:tasks.workunit.client.1.smithi187.stdout:4/604: sync 2024-09-21T00:56:37.801 INFO:tasks.workunit.client.0.smithi112.stdout:3/160: creat d2/d8/dd/f2e x:0 0 0 2024-09-21T00:56:37.803 INFO:tasks.workunit.client.1.smithi187.stdout:7/521: rename d1/dc/d15/d2b/f9d to d1/d18/fb4 0 2024-09-21T00:56:37.804 INFO:tasks.workunit.client.1.smithi187.stdout:9/744: dread d4/d8/f38 [0,4194304] 0 2024-09-21T00:56:37.805 INFO:tasks.workunit.client.0.smithi112.stdout:2/94: dread - d0/d14/f9 zero size 2024-09-21T00:56:37.808 INFO:tasks.workunit.client.0.smithi112.stdout:1/20: mkdir d5 0 2024-09-21T00:56:37.808 INFO:tasks.workunit.client.0.smithi112.stdout:1/21: dread - f4 zero size 2024-09-21T00:56:37.810 INFO:tasks.workunit.client.1.smithi187.stdout:8/650: fsync dc/d44/f6a 0 2024-09-21T00:56:37.811 INFO:tasks.workunit.client.0.smithi112.stdout:6/60: fdatasync d9/fd 0 2024-09-21T00:56:37.812 INFO:tasks.workunit.client.0.smithi112.stdout:6/61: write f3 [7706392,6510] 0 2024-09-21T00:56:37.813 INFO:tasks.workunit.client.1.smithi187.stdout:5/548: symlink d0/dc/daa/d67/d14/d57/d5c/db2/lb8 0 2024-09-21T00:56:37.814 INFO:tasks.workunit.client.1.smithi187.stdout:3/533: getdents d9/d19/d1c/d5f 0 2024-09-21T00:56:37.818 INFO:tasks.workunit.client.0.smithi112.stdout:0/40: truncate d8/fa 811672 0 2024-09-21T00:56:37.819 INFO:tasks.workunit.client.0.smithi112.stdout:7/120: rename d0/d2/f1d to d0/d2/f21 0 2024-09-21T00:56:37.820 INFO:tasks.workunit.client.1.smithi187.stdout:1/684: truncate d4/d6/d64/f71 74338 0 2024-09-21T00:56:37.822 INFO:tasks.workunit.client.0.smithi112.stdout:3/161: dread - d2/d8/d28/f26 zero size 2024-09-21T00:56:37.822 INFO:tasks.workunit.client.1.smithi187.stdout:7/522: fsync d1/d18/d31/d33/f95 0 2024-09-21T00:56:37.824 INFO:tasks.workunit.client.0.smithi112.stdout:2/95: creat d0/df/f1b x:0 0 0 2024-09-21T00:56:37.825 INFO:tasks.workunit.client.1.smithi187.stdout:9/745: stat d4/d8/d46/d54/lba 0 2024-09-21T00:56:37.826 INFO:tasks.workunit.client.1.smithi187.stdout:0/558: creat d0/d17/d18/d90/fbf x:0 0 0 2024-09-21T00:56:37.827 INFO:tasks.workunit.client.1.smithi187.stdout:7/523: dwrite d1/dc/d15/d22/f86 [0,4194304] 0 2024-09-21T00:56:37.827 INFO:tasks.workunit.client.0.smithi112.stdout:7/121: dwrite d0/d8/d1a/f1f [0,4194304] 0 2024-09-21T00:56:37.827 INFO:tasks.workunit.client.0.smithi112.stdout:9/67: getdents d5/d6/de/d13 0 2024-09-21T00:56:37.830 INFO:tasks.workunit.client.0.smithi112.stdout:5/33: truncate f3 2856181 0 2024-09-21T00:56:37.834 INFO:tasks.workunit.client.1.smithi187.stdout:5/549: symlink d0/dc/daa/d67/d30/lb9 0 2024-09-21T00:56:37.834 INFO:tasks.workunit.client.1.smithi187.stdout:4/605: write d2/d3/da/d2f/d4b/d7e/fa3 [99914,67736] 0 2024-09-21T00:56:37.834 INFO:tasks.workunit.client.0.smithi112.stdout:6/62: creat d9/d13/f17 x:0 0 0 2024-09-21T00:56:37.836 INFO:tasks.workunit.client.1.smithi187.stdout:3/534: creat d9/d13/d87/d94/d53/d75/fac x:0 0 0 2024-09-21T00:56:37.839 INFO:tasks.workunit.client.0.smithi112.stdout:3/162: creat d2/f2f x:0 0 0 2024-09-21T00:56:37.839 INFO:tasks.workunit.client.1.smithi187.stdout:5/550: write d0/dc/daa/d67/d30/f3b [1803705,42930] 0 2024-09-21T00:56:37.840 INFO:tasks.workunit.client.1.smithi187.stdout:7/524: dread d1/d18/d31/d41/d64/faa [0,4194304] 0 2024-09-21T00:56:37.840 INFO:tasks.workunit.client.1.smithi187.stdout:9/746: mknod d4/d13/d20/d2b/cf0 0 2024-09-21T00:56:37.844 INFO:tasks.workunit.client.1.smithi187.stdout:8/651: symlink dc/d2f/d80/db8/dba/ld5 0 2024-09-21T00:56:37.845 INFO:tasks.workunit.client.1.smithi187.stdout:6/620: mknod d7/d2a/d29/d94/ccc 0 2024-09-21T00:56:37.846 INFO:tasks.workunit.client.0.smithi112.stdout:9/68: mkdir d5/d6/d19 0 2024-09-21T00:56:37.847 INFO:tasks.workunit.client.1.smithi187.stdout:2/640: sync 2024-09-21T00:56:37.848 INFO:tasks.workunit.client.1.smithi187.stdout:2/641: dread - d2/da8/d6c/db8/d40/d75/fd3 zero size 2024-09-21T00:56:37.848 INFO:tasks.workunit.client.1.smithi187.stdout:1/685: stat d4/d6/d64/f71 0 2024-09-21T00:56:37.848 INFO:tasks.workunit.client.1.smithi187.stdout:2/642: readlink d2/d3/d15/l38 0 2024-09-21T00:56:37.848 INFO:tasks.workunit.client.1.smithi187.stdout:2/643: chown d2/d3/df 379239 1 2024-09-21T00:56:37.849 INFO:tasks.workunit.client.0.smithi112.stdout:5/34: creat d8/fa x:0 0 0 2024-09-21T00:56:37.851 INFO:tasks.workunit.client.0.smithi112.stdout:6/63: mkdir d9/d13/d18 0 2024-09-21T00:56:37.852 INFO:tasks.workunit.client.0.smithi112.stdout:5/35: dread f7 [0,4194304] 0 2024-09-21T00:56:37.855 INFO:tasks.workunit.client.1.smithi187.stdout:0/559: rename d0/d17/d1c/d23/df/d41/c39 to d0/d60/d6b/cc0 0 2024-09-21T00:56:37.856 INFO:tasks.workunit.client.1.smithi187.stdout:8/652: readlink dc/l83 0 2024-09-21T00:56:37.856 INFO:tasks.workunit.client.0.smithi112.stdout:1/22: link l2 d5/l6 0 2024-09-21T00:56:37.856 INFO:tasks.workunit.client.0.smithi112.stdout:1/23: dread - f4 zero size 2024-09-21T00:56:37.857 INFO:tasks.workunit.client.0.smithi112.stdout:1/24: truncate f4 405188 0 2024-09-21T00:56:37.865 INFO:tasks.workunit.client.0.smithi112.stdout:1/25: dwrite f4 [0,4194304] 0 2024-09-21T00:56:37.867 INFO:tasks.workunit.client.0.smithi112.stdout:6/64: mkdir d9/df/d19 0 2024-09-21T00:56:37.868 INFO:tasks.workunit.client.1.smithi187.stdout:9/747: mkdir d4/d10/d8f/de6/df1 0 2024-09-21T00:56:37.869 INFO:tasks.workunit.client.0.smithi112.stdout:0/41: rmdir d8/dc 0 2024-09-21T00:56:37.871 INFO:tasks.workunit.client.1.smithi187.stdout:3/535: rename d9/d19/d1c/f41 to d9/d19/d9b/fad 0 2024-09-21T00:56:37.878 INFO:tasks.workunit.client.0.smithi112.stdout:6/65: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:37.880 INFO:tasks.workunit.client.0.smithi112.stdout:6/66: dread - d9/d13/f17 zero size 2024-09-21T00:56:37.884 INFO:tasks.workunit.client.0.smithi112.stdout:0/42: dwrite d8/fb [0,4194304] 0 2024-09-21T00:56:37.884 INFO:tasks.workunit.client.0.smithi112.stdout:9/69: link d5/d6/fd d5/d6/de/d13/f1a 0 2024-09-21T00:56:37.886 INFO:tasks.workunit.client.1.smithi187.stdout:5/551: creat d0/dc/daa/d67/d14/d1b/fba x:0 0 0 2024-09-21T00:56:37.887 INFO:tasks.workunit.client.0.smithi112.stdout:9/70: read f3 [1045150,21977] 0 2024-09-21T00:56:37.890 INFO:tasks.workunit.client.1.smithi187.stdout:7/525: creat d1/d18/d31/d41/fb5 x:0 0 0 2024-09-21T00:56:37.894 INFO:tasks.workunit.client.0.smithi112.stdout:1/26: unlink l1 0 2024-09-21T00:56:37.896 INFO:tasks.workunit.client.0.smithi112.stdout:2/96: dwrite d0/f5 [4194304,4194304] 0 2024-09-21T00:56:37.898 INFO:tasks.workunit.client.0.smithi112.stdout:3/163: write d2/f5 [3688110,102253] 0 2024-09-21T00:56:37.901 INFO:tasks.workunit.client.0.smithi112.stdout:0/43: dwrite d8/fb [0,4194304] 0 2024-09-21T00:56:37.903 INFO:tasks.workunit.client.0.smithi112.stdout:0/44: write d8/fb [275026,92986] 0 2024-09-21T00:56:37.904 INFO:tasks.workunit.client.0.smithi112.stdout:7/122: getdents d0/d8 0 2024-09-21T00:56:37.904 INFO:tasks.workunit.client.0.smithi112.stdout:7/123: chown d0/d2 76476 1 2024-09-21T00:56:37.906 INFO:tasks.workunit.client.1.smithi187.stdout:4/606: dwrite d2/d3/da/d16/fab [0,4194304] 0 2024-09-21T00:56:37.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/124: write d0/d8/d1a/f1f [4149524,91068] 0 2024-09-21T00:56:37.909 INFO:tasks.workunit.client.1.smithi187.stdout:8/653: truncate dc/d2f/d34/d4b/f77 3323000 0 2024-09-21T00:56:37.915 INFO:tasks.workunit.client.1.smithi187.stdout:6/621: truncate d7/d2a/d29/f3f 4161163 0 2024-09-21T00:56:37.917 INFO:tasks.workunit.client.1.smithi187.stdout:5/552: truncate d0/f7 1106814 0 2024-09-21T00:56:37.917 INFO:tasks.workunit.client.1.smithi187.stdout:4/607: dwrite d2/d3/f42 [0,4194304] 0 2024-09-21T00:56:37.918 INFO:tasks.workunit.client.0.smithi112.stdout:5/36: dwrite f4 [0,4194304] 0 2024-09-21T00:56:37.918 INFO:tasks.workunit.client.0.smithi112.stdout:9/71: truncate d5/d6/f7 456761 0 2024-09-21T00:56:37.921 INFO:tasks.workunit.client.1.smithi187.stdout:7/526: unlink d1/d18/d31/d41/fb5 0 2024-09-21T00:56:37.923 INFO:tasks.workunit.client.1.smithi187.stdout:0/560: dwrite d0/d60/d6b/fa9 [0,4194304] 0 2024-09-21T00:56:37.923 INFO:tasks.workunit.client.1.smithi187.stdout:8/654: dwrite dc/f24 [0,4194304] 0 2024-09-21T00:56:37.925 INFO:tasks.workunit.client.1.smithi187.stdout:9/748: link d4/d13/fca d4/d13/d20/d2b/dbf/ddd/ff2 0 2024-09-21T00:56:37.928 INFO:tasks.workunit.client.0.smithi112.stdout:5/37: dwrite f5 [0,4194304] 0 2024-09-21T00:56:37.929 INFO:tasks.workunit.client.0.smithi112.stdout:5/38: stat f4 0 2024-09-21T00:56:37.935 INFO:tasks.workunit.client.1.smithi187.stdout:0/561: dwrite d0/d17/d1c/d23/d36/fa1 [0,4194304] 0 2024-09-21T00:56:37.936 INFO:tasks.workunit.client.0.smithi112.stdout:6/67: write d9/f12 [4870616,113687] 0 2024-09-21T00:56:37.937 INFO:tasks.workunit.client.1.smithi187.stdout:0/562: truncate d0/d17/d18/d90/fa8 349440 0 2024-09-21T00:56:37.937 INFO:tasks.workunit.client.1.smithi187.stdout:3/536: link d9/f4e d9/d7f/fae 0 2024-09-21T00:56:37.938 INFO:tasks.workunit.client.1.smithi187.stdout:3/537: readlink d9/l16 0 2024-09-21T00:56:37.940 INFO:tasks.workunit.client.0.smithi112.stdout:5/39: dwrite f4 [0,4194304] 0 2024-09-21T00:56:37.945 INFO:tasks.workunit.client.0.smithi112.stdout:0/45: creat d8/fd x:0 0 0 2024-09-21T00:56:37.946 INFO:tasks.workunit.client.0.smithi112.stdout:0/46: chown d8 88 1 2024-09-21T00:56:37.948 INFO:tasks.workunit.client.0.smithi112.stdout:0/47: write d8/fd [225316,49492] 0 2024-09-21T00:56:37.949 INFO:tasks.workunit.client.0.smithi112.stdout:0/48: stat l4 0 2024-09-21T00:56:37.951 INFO:tasks.workunit.client.0.smithi112.stdout:0/49: chown d8/c9 1146 1 2024-09-21T00:56:37.952 INFO:tasks.workunit.client.1.smithi187.stdout:5/553: mknod d0/dc/daa/d67/d14/d1b/d27/d3a/cbb 0 2024-09-21T00:56:37.952 INFO:tasks.workunit.client.0.smithi112.stdout:5/40: dwrite f4 [0,4194304] 0 2024-09-21T00:56:37.953 INFO:tasks.workunit.client.1.smithi187.stdout:7/527: mknod d1/d18/d31/d33/d3b/d9f/d75/cb6 0 2024-09-21T00:56:37.960 INFO:tasks.workunit.client.0.smithi112.stdout:1/27: unlink d5/l6 0 2024-09-21T00:56:37.962 INFO:tasks.workunit.client.1.smithi187.stdout:2/644: rename d2/da8/d6c/db8/d40/d75/fc2 to d2/da8/d1c/d2d/fe5 0 2024-09-21T00:56:37.963 INFO:tasks.workunit.client.1.smithi187.stdout:2/645: chown d2/dc/d2e/f82 72 1 2024-09-21T00:56:37.964 INFO:tasks.workunit.client.1.smithi187.stdout:0/563: mknod d0/d17/d18/d3a/cc1 0 2024-09-21T00:56:37.965 INFO:tasks.workunit.client.1.smithi187.stdout:0/564: readlink d0/l56 0 2024-09-21T00:56:37.965 INFO:tasks.workunit.client.0.smithi112.stdout:6/68: truncate d9/fc 910789 0 2024-09-21T00:56:37.966 INFO:tasks.workunit.client.0.smithi112.stdout:6/69: chown d9/f12 1032124108 1 2024-09-21T00:56:37.967 INFO:tasks.workunit.client.1.smithi187.stdout:3/538: creat d9/d13/d87/d94/d53/d56/d7d/d81/d9d/faf x:0 0 0 2024-09-21T00:56:37.967 INFO:tasks.workunit.client.0.smithi112.stdout:0/50: creat d8/fe x:0 0 0 2024-09-21T00:56:37.968 INFO:tasks.workunit.client.1.smithi187.stdout:6/622: creat d7/d2a/d29/d40/d50/d83/fcd x:0 0 0 2024-09-21T00:56:37.969 INFO:tasks.workunit.client.1.smithi187.stdout:3/539: write d9/d13/d87/d94/d53/d56/d7d/d81/f84 [3994787,107630] 0 2024-09-21T00:56:37.970 INFO:tasks.workunit.client.1.smithi187.stdout:5/554: unlink d0/dc/daa/l74 0 2024-09-21T00:56:37.971 INFO:tasks.workunit.client.0.smithi112.stdout:5/41: mknod d8/cb 0 2024-09-21T00:56:37.973 INFO:tasks.workunit.client.0.smithi112.stdout:9/72: chown d5/d6/f7 1 1 2024-09-21T00:56:37.974 INFO:tasks.workunit.client.0.smithi112.stdout:3/164: link d2/d8/c19 d2/c30 0 2024-09-21T00:56:37.976 INFO:tasks.workunit.client.0.smithi112.stdout:6/70: unlink f3 0 2024-09-21T00:56:37.976 INFO:tasks.workunit.client.0.smithi112.stdout:0/51: dwrite d8/fe [0,4194304] 0 2024-09-21T00:56:37.976 INFO:tasks.workunit.client.1.smithi187.stdout:6/623: dwrite d7/d2a/fb [0,4194304] 0 2024-09-21T00:56:37.977 INFO:tasks.workunit.client.0.smithi112.stdout:0/52: write d8/fb [1221434,93003] 0 2024-09-21T00:56:37.978 INFO:tasks.workunit.client.1.smithi187.stdout:3/540: dwrite d9/d13/d87/d94/d53/d56/d61/f74 [0,4194304] 0 2024-09-21T00:56:37.978 INFO:tasks.workunit.client.1.smithi187.stdout:1/686: sync 2024-09-21T00:56:37.978 INFO:tasks.workunit.client.1.smithi187.stdout:2/646: mkdir d2/dc/d2e/d4a/d7c/d52/da3/de6 0 2024-09-21T00:56:37.979 INFO:tasks.workunit.client.0.smithi112.stdout:0/53: truncate d8/fd 551334 0 2024-09-21T00:56:37.984 INFO:tasks.workunit.client.0.smithi112.stdout:3/165: creat d2/d8/d28/f31 x:0 0 0 2024-09-21T00:56:37.986 INFO:tasks.workunit.client.0.smithi112.stdout:7/125: rename d0/d2/f21 to d0/f22 0 2024-09-21T00:56:37.986 INFO:tasks.workunit.client.1.smithi187.stdout:1/687: fdatasync d4/d6/d49/fa8 0 2024-09-21T00:56:37.987 INFO:tasks.workunit.client.1.smithi187.stdout:5/555: chown d0/dc/daa/d67/d30/l94 23201 1 2024-09-21T00:56:37.987 INFO:tasks.workunit.client.1.smithi187.stdout:0/565: write d0/d17/d1c/d23/d36/f91 [287138,59097] 0 2024-09-21T00:56:37.989 INFO:tasks.workunit.client.1.smithi187.stdout:5/556: chown d0/dc/d1f/d26/c33 107483129 1 2024-09-21T00:56:37.991 INFO:tasks.workunit.client.1.smithi187.stdout:9/749: creat d4/ff3 x:0 0 0 2024-09-21T00:56:37.991 INFO:tasks.workunit.client.0.smithi112.stdout:5/42: mknod d8/d9/cc 0 2024-09-21T00:56:37.992 INFO:tasks.workunit.client.1.smithi187.stdout:6/624: truncate d7/d2a/f9d 92303 0 2024-09-21T00:56:37.992 INFO:tasks.workunit.client.1.smithi187.stdout:9/750: fsync d4/d61/d6c/f99 0 2024-09-21T00:56:37.993 INFO:tasks.workunit.client.0.smithi112.stdout:0/54: mknod d8/cf 0 2024-09-21T00:56:37.994 INFO:tasks.workunit.client.1.smithi187.stdout:4/608: sync 2024-09-21T00:56:37.994 INFO:tasks.workunit.client.1.smithi187.stdout:0/566: chown d0/d17/d1c/f7a 96895 1 2024-09-21T00:56:37.994 INFO:tasks.workunit.client.0.smithi112.stdout:3/166: dwrite d2/d8/d28/f2c [0,4194304] 0 2024-09-21T00:56:37.995 INFO:tasks.workunit.client.0.smithi112.stdout:9/73: mkdir d5/d6/d19/d1b 0 2024-09-21T00:56:37.996 INFO:tasks.workunit.client.1.smithi187.stdout:3/541: dwrite d9/d19/d1c/f8c [0,4194304] 0 2024-09-21T00:56:37.997 INFO:tasks.workunit.client.0.smithi112.stdout:3/167: chown d2/c1a 1 1 2024-09-21T00:56:37.999 INFO:tasks.workunit.client.1.smithi187.stdout:0/567: write d0/d17/d1c/d23/d36/fa1 [592800,102573] 0 2024-09-21T00:56:38.000 INFO:tasks.workunit.client.0.smithi112.stdout:3/168: readlink d2/l1b 0 2024-09-21T00:56:38.001 INFO:tasks.workunit.client.1.smithi187.stdout:3/542: chown d9/d13/d87/d94/d53/d75 22951587 1 2024-09-21T00:56:38.002 INFO:tasks.workunit.client.0.smithi112.stdout:2/97: dwrite d0/d14/d8/fd [0,4194304] 0 2024-09-21T00:56:38.003 INFO:tasks.workunit.client.0.smithi112.stdout:7/126: mkdir d0/d8/d1a/d23 0 2024-09-21T00:56:38.003 INFO:tasks.workunit.client.1.smithi187.stdout:7/528: dread d1/dc/d15/d2b/f61 [0,4194304] 0 2024-09-21T00:56:38.003 INFO:tasks.workunit.client.1.smithi187.stdout:5/557: creat d0/dc/daa/d67/d14/d38/d5a/fbc x:0 0 0 2024-09-21T00:56:38.004 INFO:tasks.workunit.client.0.smithi112.stdout:6/71: mkdir d9/d13/d18/d1a 0 2024-09-21T00:56:38.005 INFO:tasks.workunit.client.0.smithi112.stdout:7/127: read d0/f10 [6962999,55704] 0 2024-09-21T00:56:38.006 INFO:tasks.workunit.client.1.smithi187.stdout:6/625: dwrite d7/d2a/d29/d40/f72 [0,4194304] 0 2024-09-21T00:56:38.007 INFO:tasks.workunit.client.0.smithi112.stdout:7/128: stat d0 0 2024-09-21T00:56:38.007 INFO:tasks.workunit.client.1.smithi187.stdout:3/543: write d9/d13/d87/d94/d53/d56/d7d/d81/f84 [4405269,87330] 0 2024-09-21T00:56:38.009 INFO:tasks.workunit.client.0.smithi112.stdout:5/43: dwrite f4 [0,4194304] 0 2024-09-21T00:56:38.010 INFO:tasks.workunit.client.1.smithi187.stdout:5/558: write d0/dc/daa/d67/d14/d1b/d27/f2f [1223038,42121] 0 2024-09-21T00:56:38.014 INFO:tasks.workunit.client.1.smithi187.stdout:4/609: symlink d2/d3/da/d2f/d4b/d7e/lb2 0 2024-09-21T00:56:38.016 INFO:tasks.workunit.client.1.smithi187.stdout:5/559: read d0/dc/daa/d67/d30/f6a [530526,48530] 0 2024-09-21T00:56:38.017 INFO:tasks.workunit.client.0.smithi112.stdout:9/74: mknod d5/d6/de/c1c 0 2024-09-21T00:56:38.017 INFO:tasks.workunit.client.1.smithi187.stdout:0/568: rmdir d0/d60/d6e 39 2024-09-21T00:56:38.019 INFO:tasks.workunit.client.0.smithi112.stdout:1/28: rename l2 to d5/l7 0 2024-09-21T00:56:38.024 INFO:tasks.workunit.client.1.smithi187.stdout:2/647: rename d2/da8/d1c/dc6/cdd to d2/dc/d2e/d4a/d7c/ce7 0 2024-09-21T00:56:38.025 INFO:tasks.workunit.client.1.smithi187.stdout:3/544: rename d9/d13 to d9/d13/d20/db0 22 2024-09-21T00:56:38.025 INFO:tasks.workunit.client.1.smithi187.stdout:2/648: chown d2/d3/d15/l38 8 1 2024-09-21T00:56:38.025 INFO:tasks.workunit.client.1.smithi187.stdout:3/545: dread - d9/d13/d87/d94/d89/f93 zero size 2024-09-21T00:56:38.027 INFO:tasks.workunit.client.1.smithi187.stdout:3/546: write d9/d13/d20/f2e [478091,29539] 0 2024-09-21T00:56:38.027 INFO:tasks.workunit.client.1.smithi187.stdout:7/529: write d1/d18/d31/f51 [1189600,11218] 0 2024-09-21T00:56:38.031 INFO:tasks.workunit.client.0.smithi112.stdout:6/72: mkdir d9/d1b 0 2024-09-21T00:56:38.031 INFO:tasks.workunit.client.0.smithi112.stdout:6/73: write d9/f12 [4723532,106346] 0 2024-09-21T00:56:38.032 INFO:tasks.workunit.client.1.smithi187.stdout:8/655: truncate dc/d2f/d80/db8/dba/d29/faf 295830 0 2024-09-21T00:56:38.033 INFO:tasks.workunit.client.1.smithi187.stdout:8/656: write dc/d2f/d34/d4b/d85/fa8 [359923,67231] 0 2024-09-21T00:56:38.035 INFO:tasks.workunit.client.1.smithi187.stdout:4/610: unlink d2/d3/lb 0 2024-09-21T00:56:38.036 INFO:tasks.workunit.client.0.smithi112.stdout:5/44: symlink d8/ld 0 2024-09-21T00:56:38.036 INFO:tasks.workunit.client.0.smithi112.stdout:5/45: stat d8/cb 0 2024-09-21T00:56:38.037 INFO:tasks.workunit.client.0.smithi112.stdout:5/46: dread - d8/fa zero size 2024-09-21T00:56:38.038 INFO:tasks.workunit.client.1.smithi187.stdout:5/560: mknod d0/dc/daa/d67/d14/d38/d5a/d6c/cbd 0 2024-09-21T00:56:38.038 INFO:tasks.workunit.client.0.smithi112.stdout:5/47: fdatasync f5 0 2024-09-21T00:56:38.039 INFO:tasks.workunit.client.0.smithi112.stdout:1/29: mkdir d5/d8 0 2024-09-21T00:56:38.039 INFO:tasks.workunit.client.1.smithi187.stdout:5/561: dread - d0/dc/daa/d67/d14/d1b/fba zero size 2024-09-21T00:56:38.040 INFO:tasks.workunit.client.1.smithi187.stdout:2/649: fdatasync d2/da8/d9d/fe4 0 2024-09-21T00:56:38.041 INFO:tasks.workunit.client.0.smithi112.stdout:9/75: dread f3 [0,4194304] 0 2024-09-21T00:56:38.041 INFO:tasks.workunit.client.0.smithi112.stdout:9/76: chown d5 366102280 1 2024-09-21T00:56:38.041 INFO:tasks.workunit.client.0.smithi112.stdout:9/77: chown d5/f14 176 1 2024-09-21T00:56:38.041 INFO:tasks.workunit.client.1.smithi187.stdout:2/650: stat d2/da8/d9d/laf 0 2024-09-21T00:56:38.043 INFO:tasks.workunit.client.1.smithi187.stdout:3/547: symlink d9/d13/d87/d94/d53/d56/d7d/d81/lb1 0 2024-09-21T00:56:38.044 INFO:tasks.workunit.client.1.smithi187.stdout:2/651: truncate d2/da8/fb2 278281 0 2024-09-21T00:56:38.046 INFO:tasks.workunit.client.1.smithi187.stdout:5/562: dwrite d0/dc/d39/f9e [0,4194304] 0 2024-09-21T00:56:38.046 INFO:tasks.workunit.client.1.smithi187.stdout:4/611: dread d2/d3/da/d2f/d32/d26/d66/d6e/f7b [0,4194304] 0 2024-09-21T00:56:38.048 INFO:tasks.workunit.client.1.smithi187.stdout:1/688: sync 2024-09-21T00:56:38.048 INFO:tasks.workunit.client.1.smithi187.stdout:0/569: mkdir d0/dc2 0 2024-09-21T00:56:38.049 INFO:tasks.workunit.client.1.smithi187.stdout:6/626: rename d7/d2a/d29/d40/d6a/d88/lc7 to d7/d2a/d29/d40/d45/lce 0 2024-09-21T00:56:38.050 INFO:tasks.workunit.client.1.smithi187.stdout:9/751: link d4/d13/d14/d28/c58 d4/d61/d6c/cf4 0 2024-09-21T00:56:38.052 INFO:tasks.workunit.client.1.smithi187.stdout:4/612: mkdir d2/d3/da/d2f/d32/d22/d37/d63/db3 0 2024-09-21T00:56:38.054 INFO:tasks.workunit.client.1.smithi187.stdout:9/752: dread d4/d13/d14/d5d/fa2 [0,4194304] 0 2024-09-21T00:56:38.066 INFO:tasks.workunit.client.1.smithi187.stdout:8/657: dread dc/d2f/d80/db8/dba/f2e [4194304,4194304] 0 2024-09-21T00:56:38.072 INFO:tasks.workunit.client.0.smithi112.stdout:6/74: creat d9/df/f1c x:0 0 0 2024-09-21T00:56:38.072 INFO:tasks.workunit.client.0.smithi112.stdout:5/48: fsync f2 0 2024-09-21T00:56:38.072 INFO:tasks.workunit.client.1.smithi187.stdout:1/689: read d4/d6/d23/f54 [619187,35723] 0 2024-09-21T00:56:38.072 INFO:tasks.workunit.client.0.smithi112.stdout:5/49: chown f5 599 1 2024-09-21T00:56:38.073 INFO:tasks.workunit.client.1.smithi187.stdout:0/570: mknod d0/d17/d1c/d23/df/d41/cc3 0 2024-09-21T00:56:38.074 INFO:tasks.workunit.client.0.smithi112.stdout:9/78: truncate d5/f14 732023 0 2024-09-21T00:56:38.074 INFO:tasks.workunit.client.1.smithi187.stdout:0/571: write d0/d17/d1c/d23/df/f32 [403910,66481] 0 2024-09-21T00:56:38.074 INFO:tasks.workunit.client.0.smithi112.stdout:9/79: truncate d5/fc 5792005 0 2024-09-21T00:56:38.077 INFO:tasks.workunit.client.1.smithi187.stdout:5/563: fdatasync d0/f7 0 2024-09-21T00:56:38.078 INFO:tasks.workunit.client.1.smithi187.stdout:5/564: write d0/dc/faf [376063,5999] 0 2024-09-21T00:56:38.080 INFO:tasks.workunit.client.0.smithi112.stdout:1/30: link f4 d5/f9 0 2024-09-21T00:56:38.084 INFO:tasks.workunit.client.1.smithi187.stdout:5/565: dwrite d0/dc/daa/d67/d14/d57/fa8 [0,4194304] 0 2024-09-21T00:56:38.085 INFO:tasks.workunit.client.1.smithi187.stdout:4/613: rename d2/d3/da/d2f/d4b/d7e/lb2 to d2/d3/da/d2f/d32/d26/d66/d6e/lb4 0 2024-09-21T00:56:38.085 INFO:tasks.workunit.client.0.smithi112.stdout:1/31: dread d5/f9 [0,4194304] 0 2024-09-21T00:56:38.085 INFO:tasks.workunit.client.1.smithi187.stdout:5/566: fdatasync d0/dc/d1f/d26/f9c 0 2024-09-21T00:56:38.088 INFO:tasks.workunit.client.1.smithi187.stdout:9/753: creat d4/d13/d20/d2b/ff5 x:0 0 0 2024-09-21T00:56:38.090 INFO:tasks.workunit.client.1.smithi187.stdout:8/658: dread dc/d2f/d80/db8/dba/f2e [0,4194304] 0 2024-09-21T00:56:38.094 INFO:tasks.workunit.client.1.smithi187.stdout:0/572: mknod d0/d17/d1c/d23/df/d41/d3b/cc4 0 2024-09-21T00:56:38.095 INFO:tasks.workunit.client.1.smithi187.stdout:0/573: write d0/fb9 [304499,52504] 0 2024-09-21T00:56:38.095 INFO:tasks.workunit.client.1.smithi187.stdout:0/574: stat d0/d17/d18/l1e 0 2024-09-21T00:56:38.096 INFO:tasks.workunit.client.1.smithi187.stdout:0/575: write d0/d60/d6b/fa9 [176886,28593] 0 2024-09-21T00:56:38.112 INFO:tasks.workunit.client.1.smithi187.stdout:0/576: dread d0/d17/d18/f68 [0,4194304] 0 2024-09-21T00:56:38.113 INFO:tasks.workunit.client.1.smithi187.stdout:6/627: sync 2024-09-21T00:56:38.150 INFO:tasks.workunit.client.1.smithi187.stdout:1/690: rename d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/cd0 to d4/d6/d23/d2e/d94/d35/d79/cdb 0 2024-09-21T00:56:38.150 INFO:tasks.workunit.client.1.smithi187.stdout:4/614: mknod d2/d3/d56/d84/cb5 0 2024-09-21T00:56:38.154 INFO:tasks.workunit.client.1.smithi187.stdout:4/615: dread d2/d3/da/d2f/f83 [0,4194304] 0 2024-09-21T00:56:38.239 INFO:tasks.workunit.client.1.smithi187.stdout:8/659: symlink dc/d2f/d80/db8/dba/dc7/ld6 0 2024-09-21T00:56:38.239 INFO:tasks.workunit.client.0.smithi112.stdout:1/32: unlink d5/l7 0 2024-09-21T00:56:38.240 INFO:tasks.workunit.client.0.smithi112.stdout:3/169: write d2/d8/d28/f26 [618887,130756] 0 2024-09-21T00:56:38.240 INFO:tasks.workunit.client.1.smithi187.stdout:3/548: getdents d9/d13/d87/d94/d53 0 2024-09-21T00:56:38.241 INFO:tasks.workunit.client.0.smithi112.stdout:1/33: truncate d5/f9 4894850 0 2024-09-21T00:56:38.241 INFO:tasks.workunit.client.1.smithi187.stdout:3/549: fsync d9/d13/d20/f68 0 2024-09-21T00:56:38.243 INFO:tasks.workunit.client.0.smithi112.stdout:2/98: write d0/df/f13 [21440,2709] 0 2024-09-21T00:56:38.244 INFO:tasks.workunit.client.0.smithi112.stdout:3/170: symlink d2/l32 0 2024-09-21T00:56:38.247 INFO:tasks.workunit.client.1.smithi187.stdout:6/628: mkdir d7/d2a/d29/d40/d50/d68/dcf 0 2024-09-21T00:56:38.250 INFO:tasks.workunit.client.0.smithi112.stdout:0/55: truncate d8/fd 439897 0 2024-09-21T00:56:38.251 INFO:tasks.workunit.client.0.smithi112.stdout:0/56: fdatasync d8/fb 0 2024-09-21T00:56:38.252 INFO:tasks.workunit.client.0.smithi112.stdout:0/57: write d8/fb [3741326,103446] 0 2024-09-21T00:56:38.252 INFO:tasks.workunit.client.0.smithi112.stdout:3/171: unlink d2/f2f 0 2024-09-21T00:56:38.253 INFO:tasks.workunit.client.0.smithi112.stdout:0/58: write d8/fb [2022726,57977] 0 2024-09-21T00:56:38.253 INFO:tasks.workunit.client.0.smithi112.stdout:3/172: chown d2/d8/d28/f26 38 1 2024-09-21T00:56:38.254 INFO:tasks.workunit.client.1.smithi187.stdout:9/754: mkdir d4/d61/d6a/d90/daa/df6 0 2024-09-21T00:56:38.260 INFO:tasks.workunit.client.1.smithi187.stdout:8/660: mknod dc/d2f/d80/db8/dba/d3e/cd7 0 2024-09-21T00:56:38.262 INFO:tasks.workunit.client.1.smithi187.stdout:7/530: dwrite d1/dc/d15/d22/f5e [0,4194304] 0 2024-09-21T00:56:38.263 INFO:tasks.workunit.client.1.smithi187.stdout:7/531: dread - d1/dc/d15/d22/d3e/d73/d8b/f94 zero size 2024-09-21T00:56:38.264 INFO:tasks.workunit.client.0.smithi112.stdout:3/173: mkdir d2/d33 0 2024-09-21T00:56:38.265 INFO:tasks.workunit.client.0.smithi112.stdout:3/174: fdatasync d2/d8/dd/f2e 0 2024-09-21T00:56:38.267 INFO:tasks.workunit.client.0.smithi112.stdout:3/175: truncate d2/d8/dd/f1f 1290511 0 2024-09-21T00:56:38.272 INFO:tasks.workunit.client.0.smithi112.stdout:0/59: link d8/fa d8/f10 0 2024-09-21T00:56:38.273 INFO:tasks.workunit.client.0.smithi112.stdout:3/176: dread d2/d8/d28/f26 [0,4194304] 0 2024-09-21T00:56:38.273 INFO:tasks.workunit.client.1.smithi187.stdout:2/652: dwrite d2/da8/d1c/f54 [0,4194304] 0 2024-09-21T00:56:38.274 INFO:tasks.workunit.client.0.smithi112.stdout:3/177: truncate d2/d8/d28/f2c 4494788 0 2024-09-21T00:56:38.276 INFO:tasks.workunit.client.0.smithi112.stdout:6/75: write f7 [3263095,46320] 0 2024-09-21T00:56:38.280 INFO:tasks.workunit.client.0.smithi112.stdout:3/178: mknod d2/d8/dd/de/c34 0 2024-09-21T00:56:38.284 INFO:tasks.workunit.client.0.smithi112.stdout:0/60: unlink f7 0 2024-09-21T00:56:38.284 INFO:tasks.workunit.client.0.smithi112.stdout:0/61: chown l4 31762 1 2024-09-21T00:56:38.288 INFO:tasks.workunit.client.0.smithi112.stdout:0/62: mkdir d8/d11 0 2024-09-21T00:56:38.290 INFO:tasks.workunit.client.1.smithi187.stdout:3/550: mknod d9/d13/d87/d94/d53/d56/d7d/d81/d9d/cb2 0 2024-09-21T00:56:38.292 INFO:tasks.workunit.client.1.smithi187.stdout:1/691: creat d4/d6/d23/d2e/d94/dcb/fdc x:0 0 0 2024-09-21T00:56:38.292 INFO:tasks.workunit.client.1.smithi187.stdout:0/577: write d0/d17/d1c/d23/df/d41/f8e [474001,95570] 0 2024-09-21T00:56:38.293 INFO:tasks.workunit.client.0.smithi112.stdout:0/63: mknod d8/d11/c12 0 2024-09-21T00:56:38.294 INFO:tasks.workunit.client.1.smithi187.stdout:9/755: unlink d4/d13/d14/fc2 0 2024-09-21T00:56:38.295 INFO:tasks.workunit.client.0.smithi112.stdout:2/99: write d0/fe [30788,104811] 0 2024-09-21T00:56:38.296 INFO:tasks.workunit.client.0.smithi112.stdout:0/64: creat d8/d11/f13 x:0 0 0 2024-09-21T00:56:38.296 INFO:tasks.workunit.client.0.smithi112.stdout:2/100: chown d0/d14/f15 61201039 1 2024-09-21T00:56:38.296 INFO:tasks.workunit.client.1.smithi187.stdout:9/756: read d4/d13/d20/d2b/f7b [149111,99748] 0 2024-09-21T00:56:38.296 INFO:tasks.workunit.client.0.smithi112.stdout:0/65: stat d8/d11 0 2024-09-21T00:56:38.297 INFO:tasks.workunit.client.0.smithi112.stdout:2/101: write d0/f5 [7229343,23152] 0 2024-09-21T00:56:38.301 INFO:tasks.workunit.client.1.smithi187.stdout:5/567: rmdir d0/dc/daa/d67/d14/d38/d5a/d6c/d7b 0 2024-09-21T00:56:38.301 INFO:tasks.workunit.client.0.smithi112.stdout:1/34: truncate d5/f9 4636580 0 2024-09-21T00:56:38.302 INFO:tasks.workunit.client.1.smithi187.stdout:9/757: dwrite d4/d61/d6c/fe1 [0,4194304] 0 2024-09-21T00:56:38.302 INFO:tasks.workunit.client.1.smithi187.stdout:5/568: chown d0/dc/daa/d67/d30/l89 39095334 1 2024-09-21T00:56:38.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/102: creat d0/df/f1c x:0 0 0 2024-09-21T00:56:38.306 INFO:tasks.workunit.client.1.smithi187.stdout:8/661: mknod dc/d2f/d37/cd8 0 2024-09-21T00:56:38.306 INFO:tasks.workunit.client.1.smithi187.stdout:8/662: chown dc/f10 22692 1 2024-09-21T00:56:38.307 INFO:tasks.workunit.client.1.smithi187.stdout:8/663: chown dc/d94/fbd 14833651 1 2024-09-21T00:56:38.307 INFO:tasks.workunit.client.1.smithi187.stdout:7/532: mknod d1/dc/d15/d22/d3e/da6/cb7 0 2024-09-21T00:56:38.308 INFO:tasks.workunit.client.1.smithi187.stdout:5/569: dwrite d0/dc/daa/d67/d14/d38/d5a/f7d [0,4194304] 0 2024-09-21T00:56:38.310 INFO:tasks.workunit.client.1.smithi187.stdout:5/570: stat d0/dc/daa/d67/d30/d6b/d8e/f95 0 2024-09-21T00:56:38.313 INFO:tasks.workunit.client.0.smithi112.stdout:2/103: rmdir d0 39 2024-09-21T00:56:38.314 INFO:tasks.workunit.client.1.smithi187.stdout:2/653: stat d2/dc/d2e/ca7 0 2024-09-21T00:56:38.315 INFO:tasks.workunit.client.1.smithi187.stdout:5/571: dread d0/dc/d1f/d26/f9c [0,4194304] 0 2024-09-21T00:56:38.316 INFO:tasks.workunit.client.1.smithi187.stdout:5/572: stat d0/dc/cb3 0 2024-09-21T00:56:38.319 INFO:tasks.workunit.client.0.smithi112.stdout:2/104: dread d0/df/f13 [0,4194304] 0 2024-09-21T00:56:38.319 INFO:tasks.workunit.client.1.smithi187.stdout:3/551: rename d9/d13/d87/d94/l6d to d9/d19/d9b/lb3 0 2024-09-21T00:56:38.322 INFO:tasks.workunit.client.0.smithi112.stdout:9/80: dwrite d5/f14 [0,4194304] 0 2024-09-21T00:56:38.322 INFO:tasks.workunit.client.1.smithi187.stdout:1/692: creat d4/d6/d23/d2e/d94/dcb/fdd x:0 0 0 2024-09-21T00:56:38.324 INFO:tasks.workunit.client.1.smithi187.stdout:3/552: dwrite d9/d19/d1c/f8c [0,4194304] 0 2024-09-21T00:56:38.325 INFO:tasks.workunit.client.0.smithi112.stdout:2/105: creat d0/d14/d8/f1d x:0 0 0 2024-09-21T00:56:38.326 INFO:tasks.workunit.client.1.smithi187.stdout:0/578: truncate d0/d17/d1c/d23/df/d41/f4a 1958584 0 2024-09-21T00:56:38.327 INFO:tasks.workunit.client.1.smithi187.stdout:0/579: chown d0/l4d 2225641 1 2024-09-21T00:56:38.327 INFO:tasks.workunit.client.0.smithi112.stdout:9/81: dread d5/f16 [0,4194304] 0 2024-09-21T00:56:38.330 INFO:tasks.workunit.client.0.smithi112.stdout:3/179: write d2/d8/dd/f10 [160206,123739] 0 2024-09-21T00:56:38.330 INFO:tasks.workunit.client.0.smithi112.stdout:9/82: chown d5/d6/fd 240418 1 2024-09-21T00:56:38.331 INFO:tasks.workunit.client.1.smithi187.stdout:0/580: write d0/d17/d18/f24 [2988714,28678] 0 2024-09-21T00:56:38.331 INFO:tasks.workunit.client.1.smithi187.stdout:9/758: mknod d4/d13/d20/d2b/cf7 0 2024-09-21T00:56:38.331 INFO:tasks.workunit.client.0.smithi112.stdout:2/106: symlink d0/l1e 0 2024-09-21T00:56:38.332 INFO:tasks.workunit.client.0.smithi112.stdout:3/180: chown f1 8253872 1 2024-09-21T00:56:38.333 INFO:tasks.workunit.client.0.smithi112.stdout:6/76: dwrite d9/fd [0,4194304] 0 2024-09-21T00:56:38.335 INFO:tasks.workunit.client.0.smithi112.stdout:6/77: read - d9/d13/f17 zero size 2024-09-21T00:56:38.338 INFO:tasks.workunit.client.1.smithi187.stdout:9/759: dwrite d4/d13/d14/d28/fa5 [0,4194304] 0 2024-09-21T00:56:38.341 INFO:tasks.workunit.client.0.smithi112.stdout:9/83: creat d5/d6/d19/f1d x:0 0 0 2024-09-21T00:56:38.341 INFO:tasks.workunit.client.0.smithi112.stdout:9/84: stat d5/fb 0 2024-09-21T00:56:38.342 INFO:tasks.workunit.client.0.smithi112.stdout:9/85: chown d5/d6/de/d13/f1a 2446816 1 2024-09-21T00:56:38.343 INFO:tasks.workunit.client.0.smithi112.stdout:9/86: chown d5/fb 3497 1 2024-09-21T00:56:38.343 INFO:tasks.workunit.client.1.smithi187.stdout:3/553: dread d9/d13/d20/f2e [0,4194304] 0 2024-09-21T00:56:38.345 INFO:tasks.workunit.client.0.smithi112.stdout:2/107: rename d0/d14/f15 to d0/f1f 0 2024-09-21T00:56:38.346 INFO:tasks.workunit.client.1.smithi187.stdout:4/616: truncate d2/d3/da/d2f/d32/d24/f28 2267827 0 2024-09-21T00:56:38.348 INFO:tasks.workunit.client.1.smithi187.stdout:9/760: dwrite d4/d8/d41/f5b [0,4194304] 0 2024-09-21T00:56:38.348 INFO:tasks.workunit.client.0.smithi112.stdout:3/181: dread d2/d8/dd/de/f18 [0,4194304] 0 2024-09-21T00:56:38.349 INFO:tasks.workunit.client.1.smithi187.stdout:5/573: unlink d0/dc/d1f/d26/d8b/f91 0 2024-09-21T00:56:38.351 INFO:tasks.workunit.client.1.smithi187.stdout:5/574: write d0/dc/daa/d67/d30/d68/f8a [2599604,31498] 0 2024-09-21T00:56:38.353 INFO:tasks.workunit.client.0.smithi112.stdout:9/87: dwrite d5/f17 [0,4194304] 0 2024-09-21T00:56:38.355 INFO:tasks.workunit.client.0.smithi112.stdout:2/108: mknod d0/c20 0 2024-09-21T00:56:38.358 INFO:tasks.workunit.client.0.smithi112.stdout:1/35: dread d5/f9 [0,4194304] 0 2024-09-21T00:56:38.358 INFO:tasks.workunit.client.0.smithi112.stdout:6/78: rename d9/fb to d9/d1b/f1d 0 2024-09-21T00:56:38.360 INFO:tasks.workunit.client.0.smithi112.stdout:6/79: read d9/d1b/f1d [3448142,117985] 0 2024-09-21T00:56:38.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/182: truncate d2/f29 393787 0 2024-09-21T00:56:38.363 INFO:tasks.workunit.client.1.smithi187.stdout:0/581: creat d0/d17/d1c/d23/df/d41/d3b/d46/fc5 x:0 0 0 2024-09-21T00:56:38.363 INFO:tasks.workunit.client.0.smithi112.stdout:6/80: truncate d9/df/f1c 167410 0 2024-09-21T00:56:38.365 INFO:tasks.workunit.client.0.smithi112.stdout:9/88: unlink d5/d6/c10 0 2024-09-21T00:56:38.366 INFO:tasks.workunit.client.1.smithi187.stdout:8/664: mknod dc/d44/dc1/cd9 0 2024-09-21T00:56:38.366 INFO:tasks.workunit.client.0.smithi112.stdout:0/66: dwrite d8/fa [0,4194304] 0 2024-09-21T00:56:38.367 INFO:tasks.workunit.client.1.smithi187.stdout:8/665: write dc/d2f/d54/d69/fa0 [564654,30119] 0 2024-09-21T00:56:38.368 INFO:tasks.workunit.client.0.smithi112.stdout:9/89: chown d5/d6/fd 102271718 1 2024-09-21T00:56:38.368 INFO:tasks.workunit.client.1.smithi187.stdout:8/666: chown dc/d2f/d80 35009874 1 2024-09-21T00:56:38.374 INFO:tasks.workunit.client.1.smithi187.stdout:6/629: getdents d7/d2a/d29/d40/d50/d68 0 2024-09-21T00:56:38.376 INFO:tasks.workunit.client.0.smithi112.stdout:3/183: mkdir d2/d8/d28/d35 0 2024-09-21T00:56:38.378 INFO:tasks.workunit.client.0.smithi112.stdout:3/184: write d2/f5 [4376289,118626] 0 2024-09-21T00:56:38.380 INFO:tasks.workunit.client.0.smithi112.stdout:6/81: symlink d9/d13/d18/l1e 0 2024-09-21T00:56:38.381 INFO:tasks.workunit.client.1.smithi187.stdout:7/533: write d1/d18/f29 [4577671,57631] 0 2024-09-21T00:56:38.382 INFO:tasks.workunit.client.0.smithi112.stdout:0/67: mkdir d8/d14 0 2024-09-21T00:56:38.385 INFO:tasks.workunit.client.0.smithi112.stdout:9/90: fsync d5/d6/de/f15 0 2024-09-21T00:56:38.386 INFO:tasks.workunit.client.1.smithi187.stdout:4/617: dread d2/d3/da/d2f/d32/d24/f45 [0,4194304] 0 2024-09-21T00:56:38.388 INFO:tasks.workunit.client.1.smithi187.stdout:0/582: mknod d0/d60/d6b/d9f/cc6 0 2024-09-21T00:56:38.389 INFO:tasks.workunit.client.0.smithi112.stdout:1/36: write f4 [2592025,53103] 0 2024-09-21T00:56:38.392 INFO:tasks.workunit.client.0.smithi112.stdout:6/82: write f7 [2911494,68343] 0 2024-09-21T00:56:38.393 INFO:tasks.workunit.client.1.smithi187.stdout:4/618: dwrite d2/d3/d74/f92 [0,4194304] 0 2024-09-21T00:56:38.395 INFO:tasks.workunit.client.0.smithi112.stdout:0/68: creat d8/d11/f15 x:0 0 0 2024-09-21T00:56:38.396 INFO:tasks.workunit.client.0.smithi112.stdout:0/69: chown l6 66537208 1 2024-09-21T00:56:38.398 INFO:tasks.workunit.client.0.smithi112.stdout:1/37: dwrite f4 [0,4194304] 0 2024-09-21T00:56:38.398 INFO:tasks.workunit.client.0.smithi112.stdout:1/38: readlink - no filename 2024-09-21T00:56:38.398 INFO:tasks.workunit.client.0.smithi112.stdout:1/39: readlink - no filename 2024-09-21T00:56:38.399 INFO:tasks.workunit.client.1.smithi187.stdout:9/761: dread d4/d10/d8f/f95 [0,4194304] 0 2024-09-21T00:56:38.400 INFO:tasks.workunit.client.0.smithi112.stdout:1/40: write f4 [5150973,50219] 0 2024-09-21T00:56:38.403 INFO:tasks.workunit.client.1.smithi187.stdout:7/534: unlink d1/d18/d31/d41/d64/d93/la8 0 2024-09-21T00:56:38.403 INFO:tasks.workunit.client.0.smithi112.stdout:0/70: dread d8/f10 [0,4194304] 0 2024-09-21T00:56:38.404 INFO:tasks.workunit.client.0.smithi112.stdout:9/91: creat d5/d6/d19/f1e x:0 0 0 2024-09-21T00:56:38.406 INFO:tasks.workunit.client.0.smithi112.stdout:0/71: write d8/d11/f13 [1022125,73227] 0 2024-09-21T00:56:38.406 INFO:tasks.workunit.client.1.smithi187.stdout:5/575: mkdir d0/dc/dbe 0 2024-09-21T00:56:38.409 INFO:tasks.workunit.client.1.smithi187.stdout:0/583: creat d0/d60/d6b/fc7 x:0 0 0 2024-09-21T00:56:38.414 INFO:tasks.workunit.client.1.smithi187.stdout:8/667: rename dc/d2f/d34/d4b/f77 to dc/d2f/d37/fda 0 2024-09-21T00:56:38.416 INFO:tasks.workunit.client.0.smithi112.stdout:6/83: rename d9/d13/d18 to d9/d1f 0 2024-09-21T00:56:38.416 INFO:tasks.workunit.client.0.smithi112.stdout:9/92: dread d5/d6/de/d13/f18 [4194304,4194304] 0 2024-09-21T00:56:38.416 INFO:tasks.workunit.client.1.smithi187.stdout:1/693: sync 2024-09-21T00:56:38.418 INFO:tasks.workunit.client.0.smithi112.stdout:0/72: dread d8/d11/f13 [0,4194304] 0 2024-09-21T00:56:38.418 INFO:tasks.workunit.client.1.smithi187.stdout:4/619: dread d2/d3/da/d16/f61 [0,4194304] 0 2024-09-21T00:56:38.419 INFO:tasks.workunit.client.1.smithi187.stdout:2/654: getdents d2 0 2024-09-21T00:56:38.421 INFO:tasks.workunit.client.1.smithi187.stdout:2/655: chown d2/dc/d2e/d4a/d7c/d52 27 1 2024-09-21T00:56:38.421 INFO:tasks.workunit.client.1.smithi187.stdout:9/762: creat d4/d13/d14/d28/ff8 x:0 0 0 2024-09-21T00:56:38.422 INFO:tasks.workunit.client.0.smithi112.stdout:1/41: creat d5/fa x:0 0 0 2024-09-21T00:56:38.422 INFO:tasks.workunit.client.1.smithi187.stdout:4/620: dread - d2/d3/da/d2f/d32/d26/d66/d6e/f8e zero size 2024-09-21T00:56:38.423 INFO:tasks.workunit.client.0.smithi112.stdout:1/42: truncate d5/fa 283634 0 2024-09-21T00:56:38.424 INFO:tasks.workunit.client.1.smithi187.stdout:2/656: write d2/da8/d6c/fca [1228208,79778] 0 2024-09-21T00:56:38.424 INFO:tasks.workunit.client.0.smithi112.stdout:2/109: write d0/f1f [153091,34663] 0 2024-09-21T00:56:38.425 INFO:tasks.workunit.client.1.smithi187.stdout:1/694: dwrite d4/d6/d23/d2e/d94/d35/d4c/d5b/f8a [0,4194304] 0 2024-09-21T00:56:38.425 INFO:tasks.workunit.client.0.smithi112.stdout:1/43: truncate d5/fa 1075806 0 2024-09-21T00:56:38.425 INFO:tasks.workunit.client.0.smithi112.stdout:2/110: readlink d0/l1e 0 2024-09-21T00:56:38.426 INFO:tasks.workunit.client.1.smithi187.stdout:2/657: chown d2/dc/d2e/d4a/d7c/d52/da3/de6 45703836 1 2024-09-21T00:56:38.426 INFO:tasks.workunit.client.0.smithi112.stdout:2/111: read - d0/df/f1c zero size 2024-09-21T00:56:38.427 INFO:tasks.workunit.client.0.smithi112.stdout:2/112: read d0/fe [90498,39540] 0 2024-09-21T00:56:38.427 INFO:tasks.workunit.client.1.smithi187.stdout:0/584: write d0/d17/d1c/d23/f30 [761875,82710] 0 2024-09-21T00:56:38.428 INFO:tasks.workunit.client.1.smithi187.stdout:0/585: read - d0/d17/d1c/d23/d36/fba zero size 2024-09-21T00:56:38.428 INFO:tasks.workunit.client.1.smithi187.stdout:2/658: read d2/d3/d15/f63 [2004131,90053] 0 2024-09-21T00:56:38.429 INFO:tasks.workunit.client.1.smithi187.stdout:0/586: fsync d0/d17/d18/d90/fa8 0 2024-09-21T00:56:38.430 INFO:tasks.workunit.client.1.smithi187.stdout:2/659: readlink d2/dc/d2e/d6f/l9c 0 2024-09-21T00:56:38.431 INFO:tasks.workunit.client.1.smithi187.stdout:8/668: creat dc/d2f/d34/d4b/fdb x:0 0 0 2024-09-21T00:56:38.432 INFO:tasks.workunit.client.1.smithi187.stdout:8/669: dread - dc/d2f/d37/fbe zero size 2024-09-21T00:56:38.433 INFO:tasks.workunit.client.1.smithi187.stdout:9/763: dread d4/d13/d20/d2b/f7b [0,4194304] 0 2024-09-21T00:56:38.435 INFO:tasks.workunit.client.0.smithi112.stdout:9/93: unlink d5/d6/de/d13/f18 0 2024-09-21T00:56:38.437 INFO:tasks.workunit.client.1.smithi187.stdout:3/554: getdents d9/d13/d87/d94/d53/d56/d7d/d81/d9d 0 2024-09-21T00:56:38.438 INFO:tasks.workunit.client.1.smithi187.stdout:3/555: write d9/d13/f2c [3143823,127508] 0 2024-09-21T00:56:38.438 INFO:tasks.workunit.client.0.smithi112.stdout:0/73: symlink d8/d11/l16 0 2024-09-21T00:56:38.439 INFO:tasks.workunit.client.1.smithi187.stdout:3/556: fdatasync d9/d13/d87/d94/d53/d56/f8e 0 2024-09-21T00:56:38.441 INFO:tasks.workunit.client.1.smithi187.stdout:7/535: creat d1/d18/d31/d41/d8a/fb8 x:0 0 0 2024-09-21T00:56:38.445 INFO:tasks.workunit.client.0.smithi112.stdout:4/170: sync 2024-09-21T00:56:38.445 INFO:tasks.workunit.client.0.smithi112.stdout:5/50: sync 2024-09-21T00:56:38.445 INFO:tasks.workunit.client.0.smithi112.stdout:8/48: sync 2024-09-21T00:56:38.445 INFO:tasks.workunit.client.0.smithi112.stdout:7/129: sync 2024-09-21T00:56:38.446 INFO:tasks.workunit.client.1.smithi187.stdout:5/576: mknod d0/dc/daa/d67/d14/d38/d5a/d6c/db7/cbf 0 2024-09-21T00:56:38.447 INFO:tasks.workunit.client.0.smithi112.stdout:2/113: symlink d0/d14/l21 0 2024-09-21T00:56:38.448 INFO:tasks.workunit.client.0.smithi112.stdout:2/114: write d0/f18 [321496,43116] 0 2024-09-21T00:56:38.448 INFO:tasks.workunit.client.0.smithi112.stdout:3/185: link d2/l20 d2/d33/l36 0 2024-09-21T00:56:38.450 INFO:tasks.workunit.client.0.smithi112.stdout:5/51: dread f2 [0,4194304] 0 2024-09-21T00:56:38.451 INFO:tasks.workunit.client.0.smithi112.stdout:6/84: unlink c8 0 2024-09-21T00:56:38.451 INFO:tasks.workunit.client.0.smithi112.stdout:6/85: readlink d9/l10 0 2024-09-21T00:56:38.452 INFO:tasks.workunit.client.0.smithi112.stdout:9/94: symlink d5/d6/de/d13/l1f 0 2024-09-21T00:56:38.456 INFO:tasks.workunit.client.1.smithi187.stdout:2/660: mkdir d2/da8/d6c/db8/d40/d75/de8 0 2024-09-21T00:56:38.459 INFO:tasks.workunit.client.1.smithi187.stdout:3/557: readlink d9/d19/d9b/lb3 0 2024-09-21T00:56:38.460 INFO:tasks.workunit.client.0.smithi112.stdout:8/49: rename d0/c7 to d0/c12 0 2024-09-21T00:56:38.460 INFO:tasks.workunit.client.1.smithi187.stdout:0/587: write d0/d17/d1c/d23/df/d41/f42 [1259026,111983] 0 2024-09-21T00:56:38.461 INFO:tasks.workunit.client.1.smithi187.stdout:7/536: fdatasync d1/dc/d15/fa1 0 2024-09-21T00:56:38.462 INFO:tasks.workunit.client.0.smithi112.stdout:1/44: truncate d5/f9 987799 0 2024-09-21T00:56:38.463 INFO:tasks.workunit.client.1.smithi187.stdout:2/661: dwrite d2/da8/d6c/d97/da1/fad [0,4194304] 0 2024-09-21T00:56:38.463 INFO:tasks.workunit.client.0.smithi112.stdout:4/171: creat d1/d7/f39 x:0 0 0 2024-09-21T00:56:38.465 INFO:tasks.workunit.client.0.smithi112.stdout:7/130: rename d0/d2/l15 to d0/d8/d1a/l24 0 2024-09-21T00:56:38.467 INFO:tasks.workunit.client.1.smithi187.stdout:4/621: creat d2/d3/d74/d98/fb6 x:0 0 0 2024-09-21T00:56:38.470 INFO:tasks.workunit.client.1.smithi187.stdout:6/630: rename d7/l65 to d7/d2a/d29/d40/ld0 0 2024-09-21T00:56:38.470 INFO:tasks.workunit.client.1.smithi187.stdout:9/764: rename d4/d10/d24/da0 to d4/d10/d24/da0/df9 22 2024-09-21T00:56:38.471 INFO:tasks.workunit.client.0.smithi112.stdout:2/115: mkdir d0/d14/d22 0 2024-09-21T00:56:38.472 INFO:tasks.workunit.client.1.smithi187.stdout:8/670: write dc/d2f/f51 [3539785,46150] 0 2024-09-21T00:56:38.474 INFO:tasks.workunit.client.0.smithi112.stdout:3/186: truncate d2/d8/dd/f27 504551 0 2024-09-21T00:56:38.474 INFO:tasks.workunit.client.1.smithi187.stdout:4/622: dwrite d2/d3/da/d16/f5c [0,4194304] 0 2024-09-21T00:56:38.475 INFO:tasks.workunit.client.1.smithi187.stdout:4/623: readlink d2/d3/da/d2f/l8b 0 2024-09-21T00:56:38.475 INFO:tasks.workunit.client.0.smithi112.stdout:6/86: creat d9/f20 x:0 0 0 2024-09-21T00:56:38.476 INFO:tasks.workunit.client.0.smithi112.stdout:8/50: rmdir d0 39 2024-09-21T00:56:38.476 INFO:tasks.workunit.client.1.smithi187.stdout:3/558: symlink d9/d13/d87/d94/d53/d56/d61/lb4 0 2024-09-21T00:56:38.476 INFO:tasks.workunit.client.0.smithi112.stdout:6/87: dread - d9/d13/f15 zero size 2024-09-21T00:56:38.478 INFO:tasks.workunit.client.1.smithi187.stdout:7/537: rmdir d1/dc/d15/d22 39 2024-09-21T00:56:38.478 INFO:tasks.workunit.client.1.smithi187.stdout:7/538: chown d1/lf 5620 1 2024-09-21T00:56:38.479 INFO:tasks.workunit.client.0.smithi112.stdout:9/95: rename d5/d6/fd to d5/f20 0 2024-09-21T00:56:38.479 INFO:tasks.workunit.client.1.smithi187.stdout:7/539: write d1/d18/d31/d33/f95 [4592079,72637] 0 2024-09-21T00:56:38.480 INFO:tasks.workunit.client.0.smithi112.stdout:9/96: chown d5/d6/d19/f1d 1603888 1 2024-09-21T00:56:38.481 INFO:tasks.workunit.client.1.smithi187.stdout:7/540: fdatasync d1/d18/d31/f32 0 2024-09-21T00:56:38.482 INFO:tasks.workunit.client.0.smithi112.stdout:7/131: symlink d0/d8/l25 0 2024-09-21T00:56:38.484 INFO:tasks.workunit.client.1.smithi187.stdout:2/662: symlink d2/da8/d6c/db8/d40/le9 0 2024-09-21T00:56:38.484 INFO:tasks.workunit.client.0.smithi112.stdout:2/116: rmdir d0/d14/d8 39 2024-09-21T00:56:38.485 INFO:tasks.workunit.client.1.smithi187.stdout:2/663: write d2/da8/d1c/d2d/d8f/d9f/fa2 [555094,109937] 0 2024-09-21T00:56:38.485 INFO:tasks.workunit.client.0.smithi112.stdout:2/117: chown d0/d14/f12 222937257 1 2024-09-21T00:56:38.490 INFO:tasks.workunit.client.0.smithi112.stdout:3/187: symlink d2/d8/d28/l37 0 2024-09-21T00:56:38.491 INFO:tasks.workunit.client.1.smithi187.stdout:9/765: truncate d4/f1a 1468151 0 2024-09-21T00:56:38.493 INFO:tasks.workunit.client.1.smithi187.stdout:8/671: creat dc/d2f/d54/d69/fdc x:0 0 0 2024-09-21T00:56:38.494 INFO:tasks.workunit.client.0.smithi112.stdout:3/188: dread d2/d8/dd/de/f18 [0,4194304] 0 2024-09-21T00:56:38.496 INFO:tasks.workunit.client.1.smithi187.stdout:4/624: creat d2/d3/da/d2f/d32/d24/fb7 x:0 0 0 2024-09-21T00:56:38.497 INFO:tasks.workunit.client.0.smithi112.stdout:6/88: chown d9/fc 3 1 2024-09-21T00:56:38.499 INFO:tasks.workunit.client.0.smithi112.stdout:5/52: write f3 [2147678,109730] 0 2024-09-21T00:56:38.502 INFO:tasks.workunit.client.0.smithi112.stdout:2/118: write d0/d14/f19 [4534527,103637] 0 2024-09-21T00:56:38.503 INFO:tasks.workunit.client.0.smithi112.stdout:2/119: read - d0/d14/f9 zero size 2024-09-21T00:56:38.506 INFO:tasks.workunit.client.1.smithi187.stdout:7/541: readlink d1/dc/d15/d22/d3e/l63 0 2024-09-21T00:56:38.506 INFO:tasks.workunit.client.0.smithi112.stdout:7/132: write d0/f19 [184733,63220] 0 2024-09-21T00:56:38.507 INFO:tasks.workunit.client.1.smithi187.stdout:7/542: chown d1/d18/d31/d41 2873368 1 2024-09-21T00:56:38.507 INFO:tasks.workunit.client.0.smithi112.stdout:8/51: mkdir d0/d13 0 2024-09-21T00:56:38.507 INFO:tasks.workunit.client.0.smithi112.stdout:8/52: readlink d0/la 0 2024-09-21T00:56:38.508 INFO:tasks.workunit.client.0.smithi112.stdout:8/53: fsync d0/f11 0 2024-09-21T00:56:38.509 INFO:tasks.workunit.client.0.smithi112.stdout:7/133: dread d0/f19 [0,4194304] 0 2024-09-21T00:56:38.510 INFO:tasks.workunit.client.0.smithi112.stdout:3/189: mkdir d2/d38 0 2024-09-21T00:56:38.511 INFO:tasks.workunit.client.0.smithi112.stdout:7/134: write d0/d8/d1a/f1f [2828824,76358] 0 2024-09-21T00:56:38.511 INFO:tasks.workunit.client.0.smithi112.stdout:3/190: write d2/d8/dd/f10 [421189,47696] 0 2024-09-21T00:56:38.512 INFO:tasks.workunit.client.1.smithi187.stdout:6/631: getdents d7/d2a/d29/d40/d6a/da1 0 2024-09-21T00:56:38.513 INFO:tasks.workunit.client.0.smithi112.stdout:6/89: mkdir d9/d13/d21 0 2024-09-21T00:56:38.514 INFO:tasks.workunit.client.1.smithi187.stdout:8/672: mknod dc/d2f/d80/cdd 0 2024-09-21T00:56:38.515 INFO:tasks.workunit.client.1.smithi187.stdout:8/673: chown dc/d2f/d37/fbe 11170 1 2024-09-21T00:56:38.516 INFO:tasks.workunit.client.0.smithi112.stdout:6/90: truncate f7 9241258 0 2024-09-21T00:56:38.517 INFO:tasks.workunit.client.0.smithi112.stdout:9/97: creat d5/d6/d19/d1b/f21 x:0 0 0 2024-09-21T00:56:38.518 INFO:tasks.workunit.client.0.smithi112.stdout:5/53: unlink f4 0 2024-09-21T00:56:38.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/45: dwrite f4 [0,4194304] 0 2024-09-21T00:56:38.520 INFO:tasks.workunit.client.1.smithi187.stdout:5/577: getdents d0/dc 0 2024-09-21T00:56:38.523 INFO:tasks.workunit.client.1.smithi187.stdout:2/664: truncate d2/dc/f13 1798113 0 2024-09-21T00:56:38.524 INFO:tasks.workunit.client.0.smithi112.stdout:1/46: dread f4 [0,4194304] 0 2024-09-21T00:56:38.526 INFO:tasks.workunit.client.0.smithi112.stdout:3/191: symlink d2/l39 0 2024-09-21T00:56:38.527 INFO:tasks.workunit.client.0.smithi112.stdout:3/192: readlink d2/d33/l36 0 2024-09-21T00:56:38.527 INFO:tasks.workunit.client.1.smithi187.stdout:0/588: getdents d0/d17/d18/d3a 0 2024-09-21T00:56:38.528 INFO:tasks.workunit.client.0.smithi112.stdout:3/193: fsync d2/f5 0 2024-09-21T00:56:38.528 INFO:tasks.workunit.client.1.smithi187.stdout:4/625: dwrite d2/d3/d56/f87 [0,4194304] 0 2024-09-21T00:56:38.528 INFO:tasks.workunit.client.1.smithi187.stdout:3/559: creat d9/d13/d87/d94/d53/d56/d7d/fb5 x:0 0 0 2024-09-21T00:56:38.531 INFO:tasks.workunit.client.1.smithi187.stdout:3/560: fdatasync d9/d13/d87/d94/d53/d56/f8e 0 2024-09-21T00:56:38.531 INFO:tasks.workunit.client.1.smithi187.stdout:0/589: write d0/d17/d1c/d65/f9d [589190,90077] 0 2024-09-21T00:56:38.532 INFO:tasks.workunit.client.1.smithi187.stdout:2/665: creat d2/dc/d21/fea x:0 0 0 2024-09-21T00:56:38.532 INFO:tasks.workunit.client.1.smithi187.stdout:3/561: stat d9/d19/d1c/f5b 0 2024-09-21T00:56:38.534 INFO:tasks.workunit.client.1.smithi187.stdout:6/632: creat d7/d2a/d29/d40/d5e/fd1 x:0 0 0 2024-09-21T00:56:38.535 INFO:tasks.workunit.client.0.smithi112.stdout:5/54: unlink d8/d9/cc 0 2024-09-21T00:56:38.535 INFO:tasks.workunit.client.1.smithi187.stdout:0/590: truncate d0/d5a/f85 213804 0 2024-09-21T00:56:38.536 INFO:tasks.workunit.client.1.smithi187.stdout:8/674: mknod dc/cde 0 2024-09-21T00:56:38.536 INFO:tasks.workunit.client.0.smithi112.stdout:2/120: symlink d0/d14/d8/l23 0 2024-09-21T00:56:38.537 INFO:tasks.workunit.client.1.smithi187.stdout:5/578: mknod d0/dc/daa/d67/d14/d1b/cc0 0 2024-09-21T00:56:38.538 INFO:tasks.workunit.client.1.smithi187.stdout:8/675: fdatasync dc/d2f/d54/d69/db3/fca 0 2024-09-21T00:56:38.539 INFO:tasks.workunit.client.1.smithi187.stdout:2/666: dwrite d2/dc/f46 [0,4194304] 0 2024-09-21T00:56:38.540 INFO:tasks.workunit.client.0.smithi112.stdout:8/54: mknod d0/d13/c14 0 2024-09-21T00:56:38.541 INFO:tasks.workunit.client.0.smithi112.stdout:8/55: dread - d0/f11 zero size 2024-09-21T00:56:38.541 INFO:tasks.workunit.client.1.smithi187.stdout:3/562: symlink d9/d19/da7/lb6 0 2024-09-21T00:56:38.542 INFO:tasks.workunit.client.0.smithi112.stdout:1/47: mknod d5/cb 0 2024-09-21T00:56:38.543 INFO:tasks.workunit.client.0.smithi112.stdout:7/135: rename d0/c11 to d0/d8/c26 0 2024-09-21T00:56:38.544 INFO:tasks.workunit.client.0.smithi112.stdout:7/136: chown d0/d8 1565 1 2024-09-21T00:56:38.544 INFO:tasks.workunit.client.0.smithi112.stdout:1/48: dread d5/fa [0,4194304] 0 2024-09-21T00:56:38.545 INFO:tasks.workunit.client.1.smithi187.stdout:5/579: dread d0/dc/daa/d67/d14/d57/fa8 [0,4194304] 0 2024-09-21T00:56:38.546 INFO:tasks.workunit.client.1.smithi187.stdout:8/676: dread f8 [0,4194304] 0 2024-09-21T00:56:38.547 INFO:tasks.workunit.client.1.smithi187.stdout:5/580: write d0/dc/d1f/d26/f64 [2682127,68060] 0 2024-09-21T00:56:38.550 INFO:tasks.workunit.client.1.smithi187.stdout:3/563: dwrite d9/d13/d87/d94/d53/d56/f8e [0,4194304] 0 2024-09-21T00:56:38.552 INFO:tasks.workunit.client.0.smithi112.stdout:5/55: mkdir d8/d9/de 0 2024-09-21T00:56:38.555 INFO:tasks.workunit.client.0.smithi112.stdout:2/121: creat d0/f24 x:0 0 0 2024-09-21T00:56:38.556 INFO:tasks.workunit.client.0.smithi112.stdout:2/122: chown d0/d14/d8/fd 6145 1 2024-09-21T00:56:38.556 INFO:tasks.workunit.client.0.smithi112.stdout:5/56: dread f5 [0,4194304] 0 2024-09-21T00:56:38.557 INFO:tasks.workunit.client.1.smithi187.stdout:1/695: sync 2024-09-21T00:56:38.557 INFO:tasks.workunit.client.0.smithi112.stdout:5/57: chown f5 80 1 2024-09-21T00:56:38.557 INFO:tasks.workunit.client.0.smithi112.stdout:2/123: chown d0/d14/d8/l11 912465780 1 2024-09-21T00:56:38.559 INFO:tasks.workunit.client.1.smithi187.stdout:2/667: dwrite d2/da8/f5e [0,4194304] 0 2024-09-21T00:56:38.559 INFO:tasks.workunit.client.0.smithi112.stdout:8/56: rmdir d0 39 2024-09-21T00:56:38.561 INFO:tasks.workunit.client.1.smithi187.stdout:6/633: truncate d7/d2a/d29/f3f 1783339 0 2024-09-21T00:56:38.561 INFO:tasks.workunit.client.0.smithi112.stdout:9/98: write d5/f16 [616788,7282] 0 2024-09-21T00:56:38.567 INFO:tasks.workunit.client.1.smithi187.stdout:8/677: mknod dc/d2f/d54/d69/cdf 0 2024-09-21T00:56:38.571 INFO:tasks.workunit.client.0.smithi112.stdout:2/124: truncate d0/df/f13 1006137 0 2024-09-21T00:56:38.572 INFO:tasks.workunit.client.1.smithi187.stdout:5/581: rename d0/dc/daa/d67/d30/d68/c79 to d0/dc/cc1 0 2024-09-21T00:56:38.573 INFO:tasks.workunit.client.0.smithi112.stdout:8/57: readlink d0/l1 0 2024-09-21T00:56:38.574 INFO:tasks.workunit.client.0.smithi112.stdout:8/58: write d0/ff [226824,80019] 0 2024-09-21T00:56:38.575 INFO:tasks.workunit.client.1.smithi187.stdout:4/626: write d2/d3/da/d2f/d32/d24/f53 [1578222,104139] 0 2024-09-21T00:56:38.577 INFO:tasks.workunit.client.1.smithi187.stdout:2/668: creat d2/da8/d6c/db8/d40/feb x:0 0 0 2024-09-21T00:56:38.578 INFO:tasks.workunit.client.1.smithi187.stdout:2/669: fsync d2/da8/fc9 0 2024-09-21T00:56:38.580 INFO:tasks.workunit.client.1.smithi187.stdout:1/696: dwrite d4/d6/f1c [4194304,4194304] 0 2024-09-21T00:56:38.581 INFO:tasks.workunit.client.0.smithi112.stdout:8/59: dwrite d0/ff [0,4194304] 0 2024-09-21T00:56:38.581 INFO:tasks.workunit.client.0.smithi112.stdout:6/91: link c5 d9/df/c22 0 2024-09-21T00:56:38.582 INFO:tasks.workunit.client.0.smithi112.stdout:8/60: dread - d0/f11 zero size 2024-09-21T00:56:38.582 INFO:tasks.workunit.client.0.smithi112.stdout:6/92: readlink d9/l16 0 2024-09-21T00:56:38.583 INFO:tasks.workunit.client.1.smithi187.stdout:2/670: creat d2/da8/d6c/d97/fec x:0 0 0 2024-09-21T00:56:38.584 INFO:tasks.workunit.client.0.smithi112.stdout:5/58: mkdir d8/d9/de/df 0 2024-09-21T00:56:38.584 INFO:tasks.workunit.client.0.smithi112.stdout:2/125: symlink d0/d14/d8/l25 0 2024-09-21T00:56:38.585 INFO:tasks.workunit.client.1.smithi187.stdout:8/678: dwrite dc/d2f/d80/db8/dba/f2e [0,4194304] 0 2024-09-21T00:56:38.587 INFO:tasks.workunit.client.1.smithi187.stdout:1/697: mknod d4/d6/d23/d2e/d94/d35/d22/dcd/dd3/cde 0 2024-09-21T00:56:38.587 INFO:tasks.workunit.client.1.smithi187.stdout:8/679: truncate dc/d2f/d34/d4b/f99 646665 0 2024-09-21T00:56:38.588 INFO:tasks.workunit.client.1.smithi187.stdout:2/671: fdatasync d2/dc/d2e/d4a/f77 0 2024-09-21T00:56:38.590 INFO:tasks.workunit.client.0.smithi112.stdout:3/194: rename d2/d8/dd/c13 to d2/d8/c3a 0 2024-09-21T00:56:38.590 INFO:tasks.workunit.client.0.smithi112.stdout:8/61: fsync d0/fd 0 2024-09-21T00:56:38.590 INFO:tasks.workunit.client.1.smithi187.stdout:8/680: write dc/d2f/d80/db8/dba/d29/f2c [277930,104301] 0 2024-09-21T00:56:38.590 INFO:tasks.workunit.client.1.smithi187.stdout:2/672: write d2/da8/d1c/d2d/d8f/f20 [2810158,77147] 0 2024-09-21T00:56:38.593 INFO:tasks.workunit.client.1.smithi187.stdout:1/698: mkdir d4/d6/d23/d2e/d94/d66/ddf 0 2024-09-21T00:56:38.595 INFO:tasks.workunit.client.0.smithi112.stdout:2/126: truncate d0/fe 186240 0 2024-09-21T00:56:38.596 INFO:tasks.workunit.client.0.smithi112.stdout:8/62: mknod d0/d13/c15 0 2024-09-21T00:56:38.597 INFO:tasks.workunit.client.0.smithi112.stdout:8/63: dread - d0/f11 zero size 2024-09-21T00:56:38.597 INFO:tasks.workunit.client.0.smithi112.stdout:8/64: stat d0/la 0 2024-09-21T00:56:38.598 INFO:tasks.workunit.client.0.smithi112.stdout:8/65: write d0/f3 [1355650,119727] 0 2024-09-21T00:56:38.610 INFO:tasks.workunit.client.1.smithi187.stdout:2/673: mkdir d2/dc/d2e/ded 0 2024-09-21T00:56:38.611 INFO:tasks.workunit.client.1.smithi187.stdout:2/674: fsync d2/dc/d2e/d4a/f4d 0 2024-09-21T00:56:38.612 INFO:tasks.workunit.client.0.smithi112.stdout:2/127: unlink d0/f24 0 2024-09-21T00:56:38.614 INFO:tasks.workunit.client.1.smithi187.stdout:1/699: mkdir d4/de0 0 2024-09-21T00:56:38.615 INFO:tasks.workunit.client.1.smithi187.stdout:0/591: truncate d0/fb9 234350 0 2024-09-21T00:56:38.623 INFO:tasks.workunit.client.1.smithi187.stdout:7/543: sync 2024-09-21T00:56:38.623 INFO:tasks.workunit.client.1.smithi187.stdout:9/766: sync 2024-09-21T00:56:38.623 INFO:tasks.workunit.client.1.smithi187.stdout:9/767: dread - d4/d13/fe0 zero size 2024-09-21T00:56:38.625 INFO:tasks.workunit.client.1.smithi187.stdout:9/768: write d4/d13/d20/d2b/d66/db6/fee [797368,4343] 0 2024-09-21T00:56:38.649 INFO:tasks.workunit.client.0.smithi112.stdout:2/128: creat d0/df/f26 x:0 0 0 2024-09-21T00:56:38.650 INFO:tasks.workunit.client.1.smithi187.stdout:3/564: sync 2024-09-21T00:56:38.654 INFO:tasks.workunit.client.0.smithi112.stdout:8/66: link d0/f9 d0/d13/f16 0 2024-09-21T00:56:38.659 INFO:tasks.workunit.client.0.smithi112.stdout:2/129: mkdir d0/d14/d8/d27 0 2024-09-21T00:56:38.660 INFO:tasks.workunit.client.0.smithi112.stdout:2/130: chown d0/df/f26 157679578 1 2024-09-21T00:56:38.660 INFO:tasks.workunit.client.0.smithi112.stdout:2/131: chown d0/l1e 7078 1 2024-09-21T00:56:38.662 INFO:tasks.workunit.client.0.smithi112.stdout:2/132: write d0/fa [539334,83753] 0 2024-09-21T00:56:38.665 INFO:tasks.workunit.client.1.smithi187.stdout:7/544: creat d1/dc/d15/d22/d3e/da6/fb9 x:0 0 0 2024-09-21T00:56:38.666 INFO:tasks.workunit.client.0.smithi112.stdout:7/137: truncate d0/fa 1404835 0 2024-09-21T00:56:38.668 INFO:tasks.workunit.client.0.smithi112.stdout:9/99: dwrite f3 [4194304,4194304] 0 2024-09-21T00:56:38.669 INFO:tasks.workunit.client.1.smithi187.stdout:4/627: write d2/d3/da/d2f/f83 [1174952,3954] 0 2024-09-21T00:56:38.669 INFO:tasks.workunit.client.0.smithi112.stdout:9/100: truncate d5/f14 4478601 0 2024-09-21T00:56:38.670 INFO:tasks.workunit.client.0.smithi112.stdout:8/67: unlink d0/fe 0 2024-09-21T00:56:38.672 INFO:tasks.workunit.client.1.smithi187.stdout:4/628: truncate d2/d3/da/d2f/d32/d22/d4f/f62 1306699 0 2024-09-21T00:56:38.673 INFO:tasks.workunit.client.1.smithi187.stdout:3/565: rmdir d9/d19/d9b 39 2024-09-21T00:56:38.678 INFO:tasks.workunit.client.0.smithi112.stdout:8/68: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:38.678 INFO:tasks.workunit.client.1.smithi187.stdout:7/545: dread d1/d18/d31/f32 [0,4194304] 0 2024-09-21T00:56:38.686 INFO:tasks.workunit.client.0.smithi112.stdout:7/138: symlink d0/d8/l27 0 2024-09-21T00:56:38.687 INFO:tasks.workunit.client.1.smithi187.stdout:9/769: creat d4/d61/d6a/d90/daa/df6/ffa x:0 0 0 2024-09-21T00:56:38.691 INFO:tasks.workunit.client.0.smithi112.stdout:5/59: write f7 [4764664,103850] 0 2024-09-21T00:56:38.691 INFO:tasks.workunit.client.1.smithi187.stdout:4/629: fsync d2/d3/da/d16/f61 0 2024-09-21T00:56:38.692 INFO:tasks.workunit.client.0.smithi112.stdout:5/60: truncate d8/fa 143580 0 2024-09-21T00:56:38.695 INFO:tasks.workunit.client.0.smithi112.stdout:5/61: dread f3 [0,4194304] 0 2024-09-21T00:56:38.697 INFO:tasks.workunit.client.1.smithi187.stdout:6/634: sync 2024-09-21T00:56:38.698 INFO:tasks.workunit.client.0.smithi112.stdout:6/93: truncate d9/d1b/f1d 4986715 0 2024-09-21T00:56:38.699 INFO:tasks.workunit.client.0.smithi112.stdout:6/94: write d9/f20 [1007351,105476] 0 2024-09-21T00:56:38.700 INFO:tasks.workunit.client.0.smithi112.stdout:6/95: chown d9/df/c14 1344 1 2024-09-21T00:56:38.700 INFO:tasks.workunit.client.1.smithi187.stdout:1/700: link d4/d6/d23/d2e/d94/d35/d4c/f4d d4/d6/d23/d2e/d94/d6c/fe1 0 2024-09-21T00:56:38.701 INFO:tasks.workunit.client.0.smithi112.stdout:7/139: symlink d0/d2/l28 0 2024-09-21T00:56:38.705 INFO:tasks.workunit.client.1.smithi187.stdout:7/546: dwrite d1/d18/d31/d41/d64/d93/fb3 [0,4194304] 0 2024-09-21T00:56:38.706 INFO:tasks.workunit.client.1.smithi187.stdout:6/635: dread d7/d2a/da2/fab [0,4194304] 0 2024-09-21T00:56:38.711 INFO:tasks.workunit.client.0.smithi112.stdout:2/133: link d0/d14/d8/l23 d0/d14/d8/d27/l28 0 2024-09-21T00:56:38.712 INFO:tasks.workunit.client.0.smithi112.stdout:2/134: chown d0/d14/f12 79857 1 2024-09-21T00:56:38.713 INFO:tasks.workunit.client.0.smithi112.stdout:2/135: fdatasync d0/df/f1c 0 2024-09-21T00:56:38.719 INFO:tasks.workunit.client.0.smithi112.stdout:8/69: truncate d0/fb 1016958 0 2024-09-21T00:56:38.721 INFO:tasks.workunit.client.1.smithi187.stdout:2/675: creat d2/d25/fee x:0 0 0 2024-09-21T00:56:38.722 INFO:tasks.workunit.client.0.smithi112.stdout:6/96: mkdir d9/d1b/d23 0 2024-09-21T00:56:38.724 INFO:tasks.workunit.client.1.smithi187.stdout:1/701: rename d4/d75/l7e to d4/d6/d23/d2e/d94/d35/d79/dd2/le2 0 2024-09-21T00:56:38.729 INFO:tasks.workunit.client.1.smithi187.stdout:7/547: fdatasync d1/dc/d15/d22/d3e/d7c/d97/f9b 0 2024-09-21T00:56:38.731 INFO:tasks.workunit.client.0.smithi112.stdout:5/62: creat d8/d9/de/df/f10 x:0 0 0 2024-09-21T00:56:38.734 INFO:tasks.workunit.client.0.smithi112.stdout:8/70: symlink d0/d13/l17 0 2024-09-21T00:56:38.736 INFO:tasks.workunit.client.0.smithi112.stdout:2/136: dread d0/df/f13 [0,4194304] 0 2024-09-21T00:56:38.742 INFO:tasks.workunit.client.1.smithi187.stdout:1/702: stat d4/d6/d23/d2e/d94/c24 0 2024-09-21T00:56:38.742 INFO:tasks.workunit.client.1.smithi187.stdout:7/548: dread d1/d18/d31/f36 [0,4194304] 0 2024-09-21T00:56:38.743 INFO:tasks.workunit.client.1.smithi187.stdout:7/549: chown d1/d18/d31/d33/f95 1966 1 2024-09-21T00:56:38.743 INFO:tasks.workunit.client.1.smithi187.stdout:1/703: write d4/d6/d23/d2e/d94/d6c/f93 [2572721,120849] 0 2024-09-21T00:56:38.744 INFO:tasks.workunit.client.1.smithi187.stdout:7/550: chown d1/d18/d31/d33/d3b/d9f/d75 4046855 1 2024-09-21T00:56:38.747 INFO:tasks.workunit.client.1.smithi187.stdout:4/630: getdents d2/d3/d56 0 2024-09-21T00:56:38.749 INFO:tasks.workunit.client.0.smithi112.stdout:2/137: mknod d0/df/c29 0 2024-09-21T00:56:38.750 INFO:tasks.workunit.client.0.smithi112.stdout:8/71: dwrite d0/d13/f16 [0,4194304] 0 2024-09-21T00:56:38.750 INFO:tasks.workunit.client.1.smithi187.stdout:2/676: mknod d2/d3/cef 0 2024-09-21T00:56:38.755 INFO:tasks.workunit.client.0.smithi112.stdout:8/72: symlink d0/l18 0 2024-09-21T00:56:38.758 INFO:tasks.workunit.client.0.smithi112.stdout:2/138: dwrite d0/df/f1b [0,4194304] 0 2024-09-21T00:56:38.759 INFO:tasks.workunit.client.0.smithi112.stdout:2/139: chown d0/f18 142 1 2024-09-21T00:56:38.760 INFO:tasks.workunit.client.0.smithi112.stdout:0/74: sync 2024-09-21T00:56:38.760 INFO:tasks.workunit.client.1.smithi187.stdout:7/551: mkdir d1/dc/d15/d22/d3e/d73/d8b/d8f/dba 0 2024-09-21T00:56:38.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:38 smithi112 ceph-mon[28078]: pgmap v22: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 163 MiB/s wr, 316 op/s 2024-09-21T00:56:38.761 INFO:tasks.workunit.client.0.smithi112.stdout:2/140: read d0/d14/d8/fd [719134,21253] 0 2024-09-21T00:56:38.763 INFO:tasks.workunit.client.0.smithi112.stdout:2/141: chown d0/df 111 1 2024-09-21T00:56:38.763 INFO:tasks.workunit.client.1.smithi187.stdout:4/631: creat d2/d3/da/d2f/d32/d25/fb8 x:0 0 0 2024-09-21T00:56:38.764 INFO:tasks.workunit.client.0.smithi112.stdout:8/73: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:38.767 INFO:tasks.workunit.client.1.smithi187.stdout:1/704: dread d4/d6/d23/d2e/d94/d35/d22/f46 [4194304,4194304] 0 2024-09-21T00:56:38.768 INFO:tasks.workunit.client.1.smithi187.stdout:1/705: write d4/d6/d23/d2e/d53/fbb [715357,86168] 0 2024-09-21T00:56:38.772 INFO:tasks.workunit.client.1.smithi187.stdout:7/552: fdatasync d1/f9 0 2024-09-21T00:56:38.772 INFO:tasks.workunit.client.0.smithi112.stdout:0/75: creat d8/f17 x:0 0 0 2024-09-21T00:56:38.775 INFO:tasks.workunit.client.1.smithi187.stdout:4/632: symlink d2/d3/da/d2f/d32/d22/d37/d51/lb9 0 2024-09-21T00:56:38.776 INFO:tasks.workunit.client.0.smithi112.stdout:8/74: creat d0/d13/f19 x:0 0 0 2024-09-21T00:56:38.779 INFO:tasks.workunit.client.1.smithi187.stdout:1/706: mkdir d4/d6/d23/d2e/d94/d35/d22/d65/d90/de3 0 2024-09-21T00:56:38.780 INFO:tasks.workunit.client.0.smithi112.stdout:2/142: creat d0/d14/d8/d27/f2a x:0 0 0 2024-09-21T00:56:38.782 INFO:tasks.workunit.client.0.smithi112.stdout:0/76: creat d8/f18 x:0 0 0 2024-09-21T00:56:38.784 INFO:tasks.workunit.client.1.smithi187.stdout:1/707: dwrite d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 [4194304,4194304] 0 2024-09-21T00:56:38.786 INFO:tasks.workunit.client.1.smithi187.stdout:1/708: mkdir d4/d6/d49/de4 0 2024-09-21T00:56:38.787 INFO:tasks.workunit.client.1.smithi187.stdout:8/681: creat dc/d2f/d54/fe0 x:0 0 0 2024-09-21T00:56:38.789 INFO:tasks.workunit.client.0.smithi112.stdout:6/97: rename c6 to d9/d1f/c24 0 2024-09-21T00:56:38.789 INFO:tasks.workunit.client.1.smithi187.stdout:8/682: fsync dc/f24 0 2024-09-21T00:56:38.793 INFO:tasks.workunit.client.0.smithi112.stdout:6/98: creat d9/f25 x:0 0 0 2024-09-21T00:56:38.795 INFO:tasks.workunit.client.1.smithi187.stdout:8/683: write dc/f92 [1120694,37358] 0 2024-09-21T00:56:38.796 INFO:tasks.workunit.client.1.smithi187.stdout:8/684: truncate dc/d2f/d34/d7d/fa3 669730 0 2024-09-21T00:56:38.796 INFO:tasks.workunit.client.0.smithi112.stdout:2/143: rename d0/df/f1c to d0/f2b 0 2024-09-21T00:56:38.798 INFO:tasks.workunit.client.0.smithi112.stdout:2/144: write d0/f1f [533680,128555] 0 2024-09-21T00:56:38.798 INFO:tasks.workunit.client.0.smithi112.stdout:6/99: dread d9/fd [0,4194304] 0 2024-09-21T00:56:38.799 INFO:tasks.workunit.client.1.smithi187.stdout:8/685: dread - dc/d2f/d54/f74 zero size 2024-09-21T00:56:38.803 INFO:tasks.workunit.client.1.smithi187.stdout:8/686: symlink dc/d2f/d34/d4b/le1 0 2024-09-21T00:56:38.804 INFO:tasks.workunit.client.1.smithi187.stdout:8/687: write dc/d2f/d80/db8/dba/d3e/f53 [131591,37775] 0 2024-09-21T00:56:38.804 INFO:tasks.workunit.client.0.smithi112.stdout:6/100: mkdir d9/d13/d26 0 2024-09-21T00:56:38.804 INFO:tasks.workunit.client.1.smithi187.stdout:8/688: dread - dc/fb0 zero size 2024-09-21T00:56:38.804 INFO:tasks.workunit.client.0.smithi112.stdout:2/145: chown d0/d14/d8/l23 150860242 1 2024-09-21T00:56:38.806 INFO:tasks.workunit.client.0.smithi112.stdout:6/101: unlink d9/df/f1c 0 2024-09-21T00:56:38.810 INFO:tasks.workunit.client.0.smithi112.stdout:6/102: creat d9/df/f27 x:0 0 0 2024-09-21T00:56:38.813 INFO:tasks.workunit.client.0.smithi112.stdout:2/146: dwrite d0/d14/d8/d27/f2a [0,4194304] 0 2024-09-21T00:56:38.813 INFO:tasks.workunit.client.0.smithi112.stdout:6/103: dread d9/fc [0,4194304] 0 2024-09-21T00:56:38.818 INFO:tasks.workunit.client.0.smithi112.stdout:2/147: mknod d0/d14/d22/c2c 0 2024-09-21T00:56:38.820 INFO:tasks.workunit.client.0.smithi112.stdout:2/148: write d0/d14/f19 [5008523,121507] 0 2024-09-21T00:56:38.821 INFO:tasks.workunit.client.0.smithi112.stdout:2/149: fsync d0/d14/d8/f1a 0 2024-09-21T00:56:38.821 INFO:tasks.workunit.client.0.smithi112.stdout:2/150: fdatasync d0/df/f26 0 2024-09-21T00:56:38.823 INFO:tasks.workunit.client.0.smithi112.stdout:2/151: read d0/d14/d8/d27/f2a [1319368,92819] 0 2024-09-21T00:56:38.824 INFO:tasks.workunit.client.0.smithi112.stdout:2/152: dread - d0/d14/d8/f1d zero size 2024-09-21T00:56:38.824 INFO:tasks.workunit.client.1.smithi187.stdout:8/689: dread dc/d2f/f65 [0,4194304] 0 2024-09-21T00:56:38.828 INFO:tasks.workunit.client.0.smithi112.stdout:2/153: creat d0/d14/d8/d27/f2d x:0 0 0 2024-09-21T00:56:38.831 INFO:tasks.workunit.client.0.smithi112.stdout:2/154: write d0/d14/f12 [1404751,83348] 0 2024-09-21T00:56:38.832 INFO:tasks.workunit.client.0.smithi112.stdout:8/75: dwrite d0/f10 [4194304,4194304] 0 2024-09-21T00:56:38.833 INFO:tasks.workunit.client.0.smithi112.stdout:2/155: read - d0/d14/d8/d27/f2d zero size 2024-09-21T00:56:38.836 INFO:tasks.workunit.client.1.smithi187.stdout:3/566: write d9/f12 [3528605,49636] 0 2024-09-21T00:56:38.838 INFO:tasks.workunit.client.0.smithi112.stdout:2/156: mknod d0/d14/d8/c2e 0 2024-09-21T00:56:38.839 INFO:tasks.workunit.client.0.smithi112.stdout:8/76: dread d0/f10 [4194304,4194304] 0 2024-09-21T00:56:38.841 INFO:tasks.workunit.client.1.smithi187.stdout:5/582: write d0/dc/daa/d67/d14/f21 [2808570,111951] 0 2024-09-21T00:56:38.845 INFO:tasks.workunit.client.0.smithi112.stdout:8/77: creat d0/f1a x:0 0 0 2024-09-21T00:56:38.846 INFO:tasks.workunit.client.1.smithi187.stdout:5/583: dread d0/dc/daa/d67/d14/d1b/d27/f9a [0,4194304] 0 2024-09-21T00:56:38.848 INFO:tasks.workunit.client.1.smithi187.stdout:3/567: creat d9/fb7 x:0 0 0 2024-09-21T00:56:38.848 INFO:tasks.workunit.client.1.smithi187.stdout:9/770: dwrite d4/d8/d41/fbc [4194304,4194304] 0 2024-09-21T00:56:38.849 INFO:tasks.workunit.client.0.smithi112.stdout:2/157: dwrite d0/d14/f19 [4194304,4194304] 0 2024-09-21T00:56:38.854 INFO:tasks.workunit.client.1.smithi187.stdout:5/584: dwrite d0/dc/daa/d67/d30/f34 [0,4194304] 0 2024-09-21T00:56:38.854 INFO:tasks.workunit.client.1.smithi187.stdout:7/553: creat d1/dc/fbb x:0 0 0 2024-09-21T00:56:38.855 INFO:tasks.workunit.client.1.smithi187.stdout:7/554: write d1/d18/d31/d33/d3b/f66 [420213,20788] 0 2024-09-21T00:56:38.856 INFO:tasks.workunit.client.0.smithi112.stdout:8/78: dwrite d0/f3 [0,4194304] 0 2024-09-21T00:56:38.856 INFO:tasks.workunit.client.1.smithi187.stdout:7/555: chown d1/d18/d31/d41/d64/d93 0 1 2024-09-21T00:56:38.857 INFO:tasks.workunit.client.1.smithi187.stdout:7/556: stat d1/dc/d15/d22/d3e/l5f 0 2024-09-21T00:56:38.860 INFO:tasks.workunit.client.0.smithi112.stdout:5/63: truncate f3 1206465 0 2024-09-21T00:56:38.861 INFO:tasks.workunit.client.0.smithi112.stdout:9/101: creat d5/f22 x:0 0 0 2024-09-21T00:56:38.862 INFO:tasks.workunit.client.0.smithi112.stdout:9/102: chown d5/d6/d19/d1b 1723 1 2024-09-21T00:56:38.864 INFO:tasks.workunit.client.1.smithi187.stdout:7/557: creat d1/d18/d31/d41/d64/d93/fbc x:0 0 0 2024-09-21T00:56:38.864 INFO:tasks.workunit.client.1.smithi187.stdout:7/558: stat d1/dc/d15/d22/d3e 0 2024-09-21T00:56:38.868 INFO:tasks.workunit.client.1.smithi187.stdout:9/771: link d4/d8/d41/f5b d4/d13/d20/d2b/d94/dde/ffb 0 2024-09-21T00:56:38.869 INFO:tasks.workunit.client.0.smithi112.stdout:5/64: mkdir d8/d9/d11 0 2024-09-21T00:56:38.869 INFO:tasks.workunit.client.1.smithi187.stdout:5/585: symlink d0/dc/daa/d67/d14/lc2 0 2024-09-21T00:56:38.871 INFO:tasks.workunit.client.1.smithi187.stdout:5/586: stat d0/dc/daa/d67/d14/d57/d5c/db2 0 2024-09-21T00:56:38.871 INFO:tasks.workunit.client.1.smithi187.stdout:5/587: readlink d0/dc/daa/d67/lae 0 2024-09-21T00:56:38.872 INFO:tasks.workunit.client.0.smithi112.stdout:5/65: dread f2 [0,4194304] 0 2024-09-21T00:56:38.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/103: dwrite d5/f14 [4194304,4194304] 0 2024-09-21T00:56:38.877 INFO:tasks.workunit.client.1.smithi187.stdout:5/588: rmdir d0/dc/daa/d67/d30/d6b/d8e 39 2024-09-21T00:56:38.878 INFO:tasks.workunit.client.0.smithi112.stdout:2/158: getdents d0/d14 0 2024-09-21T00:56:38.878 INFO:tasks.workunit.client.1.smithi187.stdout:5/589: dread - d0/dc/daa/d67/d14/d1b/d27/d3a/fb0 zero size 2024-09-21T00:56:38.880 INFO:tasks.workunit.client.1.smithi187.stdout:3/568: dread d9/d13/d87/d94/d53/d56/f83 [0,4194304] 0 2024-09-21T00:56:38.881 INFO:tasks.workunit.client.0.smithi112.stdout:5/66: rename f2 to d8/d9/de/f12 0 2024-09-21T00:56:38.883 INFO:tasks.workunit.client.0.smithi112.stdout:2/159: creat d0/d14/d22/f2f x:0 0 0 2024-09-21T00:56:38.884 INFO:tasks.workunit.client.0.smithi112.stdout:2/160: chown d0/f1f 1354249985 1 2024-09-21T00:56:38.885 INFO:tasks.workunit.client.0.smithi112.stdout:2/161: chown d0/d14/d8/fd 82182 1 2024-09-21T00:56:38.885 INFO:tasks.workunit.client.0.smithi112.stdout:2/162: chown d0/d14/f9 68893807 1 2024-09-21T00:56:38.886 INFO:tasks.workunit.client.1.smithi187.stdout:9/772: getdents d4/d13/d20 0 2024-09-21T00:56:38.887 INFO:tasks.workunit.client.1.smithi187.stdout:5/590: mknod d0/dc/daa/d67/d14/d1b/cc3 0 2024-09-21T00:56:38.888 INFO:tasks.workunit.client.1.smithi187.stdout:5/591: chown d0/dc/daa/d67/d14/d38/d5a/f7d 245 1 2024-09-21T00:56:38.889 INFO:tasks.workunit.client.1.smithi187.stdout:5/592: write d0/dc/daa/d67/f32 [353572,12438] 0 2024-09-21T00:56:38.891 INFO:tasks.workunit.client.1.smithi187.stdout:9/773: mkdir d4/d8/d44/d6e/d92/dfc 0 2024-09-21T00:56:38.895 INFO:tasks.workunit.client.1.smithi187.stdout:3/569: getdents d9/d13/d87/d94/d53/d75 0 2024-09-21T00:56:38.895 INFO:tasks.workunit.client.1.smithi187.stdout:5/593: dwrite d0/dc/daa/d67/d14/d38/d5a/fbc [0,4194304] 0 2024-09-21T00:56:38.896 INFO:tasks.workunit.client.0.smithi112.stdout:2/163: dwrite d0/f2b [0,4194304] 0 2024-09-21T00:56:38.898 INFO:tasks.workunit.client.1.smithi187.stdout:5/594: write d0/dc/daa/d67/f10 [2124630,20104] 0 2024-09-21T00:56:38.901 INFO:tasks.workunit.client.1.smithi187.stdout:9/774: dwrite d4/d61/d6a/d90/fd0 [0,4194304] 0 2024-09-21T00:56:38.907 INFO:tasks.workunit.client.0.smithi112.stdout:2/164: dwrite d0/f2b [0,4194304] 0 2024-09-21T00:56:38.907 INFO:tasks.workunit.client.1.smithi187.stdout:9/775: readlink d4/d61/d6a/d90/la3 0 2024-09-21T00:56:38.908 INFO:tasks.workunit.client.1.smithi187.stdout:3/570: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:38.910 INFO:tasks.workunit.client.0.smithi112.stdout:2/165: mknod d0/df/c30 0 2024-09-21T00:56:38.911 INFO:tasks.workunit.client.0.smithi112.stdout:2/166: fsync d0/d14/d8/f1a 0 2024-09-21T00:56:38.911 INFO:tasks.workunit.client.1.smithi187.stdout:9/776: write d4/d13/d20/d2b/d94/fd5 [725302,123489] 0 2024-09-21T00:56:38.916 INFO:tasks.workunit.client.1.smithi187.stdout:3/571: creat d9/d13/d87/fb8 x:0 0 0 2024-09-21T00:56:38.916 INFO:tasks.workunit.client.0.smithi112.stdout:2/167: dread d0/d14/f19 [4194304,4194304] 0 2024-09-21T00:56:38.917 INFO:tasks.workunit.client.1.smithi187.stdout:9/777: dwrite d4/d61/d6c/fe1 [0,4194304] 0 2024-09-21T00:56:38.919 INFO:tasks.workunit.client.1.smithi187.stdout:3/572: write d9/d19/d1c/f5b [132615,39459] 0 2024-09-21T00:56:38.922 INFO:tasks.workunit.client.0.smithi112.stdout:2/168: mknod d0/d14/d8/d27/c31 0 2024-09-21T00:56:38.923 INFO:tasks.workunit.client.0.smithi112.stdout:7/140: write d0/fa [301417,36722] 0 2024-09-21T00:56:38.924 INFO:tasks.workunit.client.0.smithi112.stdout:7/141: stat d0/d8/l25 0 2024-09-21T00:56:38.926 INFO:tasks.workunit.client.0.smithi112.stdout:2/169: fdatasync d0/d14/d22/f2f 0 2024-09-21T00:56:38.926 INFO:tasks.workunit.client.0.smithi112.stdout:7/142: write d0/d8/d1a/f1f [538033,121238] 0 2024-09-21T00:56:38.926 INFO:tasks.workunit.client.1.smithi187.stdout:9/778: dwrite d4/d13/d14/d28/fa5 [0,4194304] 0 2024-09-21T00:56:38.929 INFO:tasks.workunit.client.1.smithi187.stdout:3/573: dread d9/d13/d87/d94/f45 [0,4194304] 0 2024-09-21T00:56:38.929 INFO:tasks.workunit.client.0.smithi112.stdout:7/143: symlink d0/d8/l29 0 2024-09-21T00:56:38.931 INFO:tasks.workunit.client.0.smithi112.stdout:6/104: write d9/fc [838785,95555] 0 2024-09-21T00:56:38.932 INFO:tasks.workunit.client.0.smithi112.stdout:6/105: write d9/df/f27 [562575,61775] 0 2024-09-21T00:56:38.935 INFO:tasks.workunit.client.1.smithi187.stdout:3/574: symlink d9/d13/d87/d94/d53/lb9 0 2024-09-21T00:56:38.935 INFO:tasks.workunit.client.0.smithi112.stdout:7/144: chown d0/d8/d1a/l24 1 1 2024-09-21T00:56:38.936 INFO:tasks.workunit.client.0.smithi112.stdout:7/145: chown d0/d2/l6 2 1 2024-09-21T00:56:38.938 INFO:tasks.workunit.client.1.smithi187.stdout:3/575: mknod d9/d19/da7/cba 0 2024-09-21T00:56:38.939 INFO:tasks.workunit.client.1.smithi187.stdout:3/576: write d9/d13/d87/d94/f8a [864942,39116] 0 2024-09-21T00:56:38.941 INFO:tasks.workunit.client.0.smithi112.stdout:6/106: symlink d9/df/d19/l28 0 2024-09-21T00:56:38.942 INFO:tasks.workunit.client.0.smithi112.stdout:6/107: truncate d9/df/f27 1043039 0 2024-09-21T00:56:38.942 INFO:tasks.workunit.client.1.smithi187.stdout:1/709: link d4/d6/d23/d2e/c3a d4/d6/d23/d2e/ce5 0 2024-09-21T00:56:38.942 INFO:tasks.workunit.client.1.smithi187.stdout:1/710: fdatasync d4/d6/d23/d2e/d53/fbd 0 2024-09-21T00:56:38.943 INFO:tasks.workunit.client.1.smithi187.stdout:1/711: readlink d4/d6/l32 0 2024-09-21T00:56:38.944 INFO:tasks.workunit.client.0.smithi112.stdout:6/108: creat d9/d13/f29 x:0 0 0 2024-09-21T00:56:38.944 INFO:tasks.workunit.client.1.smithi187.stdout:1/712: truncate d4/d6/d23/d2e/d94/d35/d22/d2c/f98 368457 0 2024-09-21T00:56:38.946 INFO:tasks.workunit.client.1.smithi187.stdout:6/636: rename d7/f4f to d7/d2a/d29/fd2 0 2024-09-21T00:56:38.949 INFO:tasks.workunit.client.1.smithi187.stdout:2/677: rename d2/d3/df/l7a to d2/dc/d2e/d51/lf0 0 2024-09-21T00:56:38.950 INFO:tasks.workunit.client.1.smithi187.stdout:1/713: dwrite d4/d75/fb1 [0,4194304] 0 2024-09-21T00:56:38.951 INFO:tasks.workunit.client.1.smithi187.stdout:2/678: write d2/dc/d2e/d6f/fce [3088992,54678] 0 2024-09-21T00:56:38.955 INFO:tasks.workunit.client.1.smithi187.stdout:1/714: creat d4/d6/d64/fe6 x:0 0 0 2024-09-21T00:56:38.957 INFO:tasks.workunit.client.1.smithi187.stdout:6/637: link d7/f5f d7/d2a/fd3 0 2024-09-21T00:56:38.958 INFO:tasks.workunit.client.1.smithi187.stdout:2/679: truncate d2/dc/d2e/d4a/f77 28091 0 2024-09-21T00:56:38.960 INFO:tasks.workunit.client.1.smithi187.stdout:2/680: write d2/dc/d2e/d6f/fce [3679983,124812] 0 2024-09-21T00:56:38.960 INFO:tasks.workunit.client.1.smithi187.stdout:4/633: rename d2/d3/d56/d84/d60/c6f to d2/d3/cba 0 2024-09-21T00:56:38.961 INFO:tasks.workunit.client.1.smithi187.stdout:4/634: stat d2/d3/da/d2f/d32/d25/c3f 0 2024-09-21T00:56:38.962 INFO:tasks.workunit.client.1.smithi187.stdout:1/715: unlink d4/d6/d23/d2e/d94/d35/d4c/f8b 0 2024-09-21T00:56:38.970 INFO:tasks.workunit.client.1.smithi187.stdout:0/592: rmdir d0/d17/d1c/d23/df/d51 39 2024-09-21T00:56:38.973 INFO:tasks.workunit.client.1.smithi187.stdout:6/638: symlink d7/d2a/d29/d40/d50/d68/dcf/ld4 0 2024-09-21T00:56:38.974 INFO:tasks.workunit.client.1.smithi187.stdout:6/639: dread - d7/d2a/fba zero size 2024-09-21T00:56:38.975 INFO:tasks.workunit.client.1.smithi187.stdout:7/559: dwrite d1/f68 [0,4194304] 0 2024-09-21T00:56:38.975 INFO:tasks.workunit.client.1.smithi187.stdout:6/640: chown d7/d2a/d7a/c86 40868907 1 2024-09-21T00:56:38.976 INFO:tasks.workunit.client.1.smithi187.stdout:7/560: chown d1/d18/d31/d33/f95 2852698 1 2024-09-21T00:56:38.976 INFO:tasks.workunit.client.0.smithi112.stdout:9/104: write d5/d6/de/f15 [277364,33718] 0 2024-09-21T00:56:38.977 INFO:tasks.workunit.client.1.smithi187.stdout:8/690: rename dc/d2f/d34/d4b/fc4 to dc/d2f/d80/db8/dba/fe2 0 2024-09-21T00:56:38.978 INFO:tasks.workunit.client.1.smithi187.stdout:7/561: write d1/dc/d15/d22/f5e [2630363,13933] 0 2024-09-21T00:56:38.979 INFO:tasks.workunit.client.1.smithi187.stdout:4/635: link d2/d3/da/d2f/d4b/d7e/fa3 d2/d3/fbb 0 2024-09-21T00:56:38.979 INFO:tasks.workunit.client.0.smithi112.stdout:2/170: getdents d0/d14/d22 0 2024-09-21T00:56:38.980 INFO:tasks.workunit.client.1.smithi187.stdout:7/562: chown d1/dc/d15/d22/d3e/d7c/d97 2067682 1 2024-09-21T00:56:38.981 INFO:tasks.workunit.client.0.smithi112.stdout:9/105: mknod d5/d6/de/d13/c23 0 2024-09-21T00:56:38.986 INFO:tasks.workunit.client.1.smithi187.stdout:2/681: dread d2/da8/fa0 [0,4194304] 0 2024-09-21T00:56:38.987 INFO:tasks.workunit.client.1.smithi187.stdout:6/641: symlink d7/ld5 0 2024-09-21T00:56:38.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/106: dwrite d5/f17 [0,4194304] 0 2024-09-21T00:56:38.991 INFO:tasks.workunit.client.1.smithi187.stdout:9/779: rename d4/d61/d6a/f9e to d4/d61/d6a/d90/daa/df6/ffd 0 2024-09-21T00:56:38.992 INFO:tasks.workunit.client.0.smithi112.stdout:2/171: link d0/d14/f9 d0/d14/f32 0 2024-09-21T00:56:38.993 INFO:tasks.workunit.client.1.smithi187.stdout:5/595: truncate d0/dc/daa/d67/d30/f3b 4273288 0 2024-09-21T00:56:38.995 INFO:tasks.workunit.client.1.smithi187.stdout:5/596: write d0/dc/daa/d67/d14/d1b/d27/f2f [4828667,19783] 0 2024-09-21T00:56:38.996 INFO:tasks.workunit.client.1.smithi187.stdout:7/563: creat d1/d18/fbd x:0 0 0 2024-09-21T00:56:38.996 INFO:tasks.workunit.client.0.smithi112.stdout:2/172: creat d0/df/f33 x:0 0 0 2024-09-21T00:56:38.996 INFO:tasks.workunit.client.1.smithi187.stdout:9/780: dread d4/d13/d20/d2b/d66/db6/fee [0,4194304] 0 2024-09-21T00:56:38.997 INFO:tasks.workunit.client.1.smithi187.stdout:2/682: rmdir d2/da8/d1c/d2d/d8f/d9f/d8c 39 2024-09-21T00:56:39.001 INFO:tasks.workunit.client.0.smithi112.stdout:2/173: creat d0/df/f34 x:0 0 0 2024-09-21T00:56:39.002 INFO:tasks.workunit.client.1.smithi187.stdout:5/597: dwrite d0/dc/daa/d67/f15 [4194304,4194304] 0 2024-09-21T00:56:39.003 INFO:tasks.workunit.client.1.smithi187.stdout:5/598: chown d0 23254558 1 2024-09-21T00:56:39.004 INFO:tasks.workunit.client.1.smithi187.stdout:5/599: write d0/dc/daa/d67/d30/f6a [656961,123730] 0 2024-09-21T00:56:39.005 INFO:tasks.workunit.client.1.smithi187.stdout:4/636: creat d2/d3/d74/db1/da2/fbc x:0 0 0 2024-09-21T00:56:39.005 INFO:tasks.workunit.client.0.smithi112.stdout:2/174: creat d0/d14/f35 x:0 0 0 2024-09-21T00:56:39.007 INFO:tasks.workunit.client.1.smithi187.stdout:7/564: fsync d1/d18/d31/d33/d3b/f4a 0 2024-09-21T00:56:39.009 INFO:tasks.workunit.client.1.smithi187.stdout:7/565: chown d1/dc/d15/d22/f86 0 1 2024-09-21T00:56:39.011 INFO:tasks.workunit.client.1.smithi187.stdout:9/781: creat d4/d8/d44/d6e/d92/ffe x:0 0 0 2024-09-21T00:56:39.011 INFO:tasks.workunit.client.0.smithi112.stdout:7/146: dwrite d0/f19 [0,4194304] 0 2024-09-21T00:56:39.012 INFO:tasks.workunit.client.0.smithi112.stdout:2/175: mknod d0/d14/d8/d27/c36 0 2024-09-21T00:56:39.012 INFO:tasks.workunit.client.1.smithi187.stdout:7/566: chown d1/dc/d15/d22/d3e/d73/d8b/f94 22339460 1 2024-09-21T00:56:39.014 INFO:tasks.workunit.client.0.smithi112.stdout:2/176: write d0/d14/f35 [666416,84017] 0 2024-09-21T00:56:39.014 INFO:tasks.workunit.client.1.smithi187.stdout:4/637: dwrite d2/d3/da/d16/d5f/f75 [0,4194304] 0 2024-09-21T00:56:39.018 INFO:tasks.workunit.client.0.smithi112.stdout:6/109: fsync d9/d1b/f1d 0 2024-09-21T00:56:39.021 INFO:tasks.workunit.client.0.smithi112.stdout:7/147: unlink d0/d8/l20 0 2024-09-21T00:56:39.023 INFO:tasks.workunit.client.0.smithi112.stdout:7/148: write d0/d8/d1a/f1f [3640102,17556] 0 2024-09-21T00:56:39.024 INFO:tasks.workunit.client.0.smithi112.stdout:2/177: creat d0/d14/f37 x:0 0 0 2024-09-21T00:56:39.029 INFO:tasks.workunit.client.0.smithi112.stdout:6/110: creat d9/d1b/f2a x:0 0 0 2024-09-21T00:56:39.029 INFO:tasks.workunit.client.0.smithi112.stdout:6/111: stat d9/df/d19/l28 0 2024-09-21T00:56:39.031 INFO:tasks.workunit.client.1.smithi187.stdout:1/716: write d4/d6/d23/d2e/d94/d35/d4c/f4d [4530525,15390] 0 2024-09-21T00:56:39.031 INFO:tasks.workunit.client.1.smithi187.stdout:2/683: dread d2/da8/d1c/d2d/d8f/d9f/fa2 [0,4194304] 0 2024-09-21T00:56:39.031 INFO:tasks.workunit.client.0.smithi112.stdout:2/178: creat d0/d14/d8/d27/f38 x:0 0 0 2024-09-21T00:56:39.033 INFO:tasks.workunit.client.1.smithi187.stdout:0/593: rename d0/d17/d1c/f5d to d0/d17/d18/fc8 0 2024-09-21T00:56:39.034 INFO:tasks.workunit.client.1.smithi187.stdout:0/594: fsync d0/d17/d18/f8a 0 2024-09-21T00:56:39.035 INFO:tasks.workunit.client.1.smithi187.stdout:5/600: dread d0/f55 [0,4194304] 0 2024-09-21T00:56:39.036 INFO:tasks.workunit.client.1.smithi187.stdout:5/601: fdatasync d0/dc/daa/d67/d14/d1b/f24 0 2024-09-21T00:56:39.036 INFO:tasks.workunit.client.1.smithi187.stdout:7/567: mkdir d1/d18/d31/d41/dbe 0 2024-09-21T00:56:39.037 INFO:tasks.workunit.client.1.smithi187.stdout:5/602: stat d0/dc/daa/d67/d14/d1b/l5d 0 2024-09-21T00:56:39.040 INFO:tasks.workunit.client.1.smithi187.stdout:4/638: creat d2/d3/da/d2f/d32/d22/d4f/d97/fbd x:0 0 0 2024-09-21T00:56:39.041 INFO:tasks.workunit.client.1.smithi187.stdout:4/639: write d2/d3/da/d2f/d32/d22/d4f/d97/fbd [680760,104451] 0 2024-09-21T00:56:39.045 INFO:tasks.workunit.client.1.smithi187.stdout:2/684: symlink d2/da8/d6c/db8/d40/lf1 0 2024-09-21T00:56:39.046 INFO:tasks.workunit.client.0.smithi112.stdout:6/112: mknod d9/d13/d21/c2b 0 2024-09-21T00:56:39.048 INFO:tasks.workunit.client.0.smithi112.stdout:9/107: write d5/fc [4381327,111893] 0 2024-09-21T00:56:39.048 INFO:tasks.workunit.client.1.smithi187.stdout:2/685: dread d2/da8/d1c/d2d/d8f/fb4 [0,4194304] 0 2024-09-21T00:56:39.049 INFO:tasks.workunit.client.1.smithi187.stdout:6/642: rename d7/d2a/d29/d40/d5e/c9b to d7/d2a/d29/d40/d45/cd6 0 2024-09-21T00:56:39.050 INFO:tasks.workunit.client.0.smithi112.stdout:6/113: symlink d9/df/l2c 0 2024-09-21T00:56:39.052 INFO:tasks.workunit.client.0.smithi112.stdout:9/108: dread d5/f17 [0,4194304] 0 2024-09-21T00:56:39.052 INFO:tasks.workunit.client.0.smithi112.stdout:2/179: link d0/d14/d8/d27/c36 d0/c39 0 2024-09-21T00:56:39.053 INFO:tasks.workunit.client.0.smithi112.stdout:2/180: dread - d0/d14/d8/d27/f38 zero size 2024-09-21T00:56:39.053 INFO:tasks.workunit.client.0.smithi112.stdout:2/181: chown d0/fa 127435112 1 2024-09-21T00:56:39.056 INFO:tasks.workunit.client.0.smithi112.stdout:6/114: mknod d9/d1f/c2d 0 2024-09-21T00:56:39.058 INFO:tasks.workunit.client.1.smithi187.stdout:7/568: unlink d1/d18/d31/c89 0 2024-09-21T00:56:39.058 INFO:tasks.workunit.client.0.smithi112.stdout:9/109: rmdir d5/d6/de/d13 39 2024-09-21T00:56:39.059 INFO:tasks.workunit.client.1.smithi187.stdout:8/691: sync 2024-09-21T00:56:39.059 INFO:tasks.workunit.client.1.smithi187.stdout:3/577: sync 2024-09-21T00:56:39.061 INFO:tasks.workunit.client.1.smithi187.stdout:1/717: link d4/f62 d4/d6/d49/de4/fe7 0 2024-09-21T00:56:39.061 INFO:tasks.workunit.client.0.smithi112.stdout:6/115: creat d9/df/f2e x:0 0 0 2024-09-21T00:56:39.063 INFO:tasks.workunit.client.1.smithi187.stdout:2/686: read - d2/da8/d1c/d2d/f83 zero size 2024-09-21T00:56:39.063 INFO:tasks.workunit.client.1.smithi187.stdout:2/687: dread d2/da8/fb2 [0,4194304] 0 2024-09-21T00:56:39.065 INFO:tasks.workunit.client.0.smithi112.stdout:6/116: dread d9/fd [0,4194304] 0 2024-09-21T00:56:39.069 INFO:tasks.workunit.client.0.smithi112.stdout:9/110: creat d5/d6/de/f24 x:0 0 0 2024-09-21T00:56:39.071 INFO:tasks.workunit.client.0.smithi112.stdout:6/117: mkdir d9/d13/d2f 0 2024-09-21T00:56:39.071 INFO:tasks.workunit.client.0.smithi112.stdout:6/118: stat d9/d1b/f1d 0 2024-09-21T00:56:39.072 INFO:tasks.workunit.client.1.smithi187.stdout:9/782: truncate d4/d61/d6c/fd8 2651368 0 2024-09-21T00:56:39.072 INFO:tasks.workunit.client.0.smithi112.stdout:6/119: dread - d9/df/f2e zero size 2024-09-21T00:56:39.072 INFO:tasks.workunit.client.0.smithi112.stdout:9/111: rmdir d5/d6 39 2024-09-21T00:56:39.073 INFO:tasks.workunit.client.0.smithi112.stdout:6/120: truncate d9/fd 4588083 0 2024-09-21T00:56:39.073 INFO:tasks.workunit.client.0.smithi112.stdout:6/121: stat f7 0 2024-09-21T00:56:39.074 INFO:tasks.workunit.client.0.smithi112.stdout:6/122: chown d9/df/f27 6 1 2024-09-21T00:56:39.074 INFO:tasks.workunit.client.1.smithi187.stdout:3/578: mknod d9/d13/d20/cbb 0 2024-09-21T00:56:39.075 INFO:tasks.workunit.client.0.smithi112.stdout:7/149: truncate d0/d8/d1a/f1f 2668353 0 2024-09-21T00:56:39.076 INFO:tasks.workunit.client.0.smithi112.stdout:7/150: fdatasync d0/f19 0 2024-09-21T00:56:39.080 INFO:tasks.workunit.client.0.smithi112.stdout:9/112: dwrite d5/f16 [0,4194304] 0 2024-09-21T00:56:39.083 INFO:tasks.workunit.client.1.smithi187.stdout:4/640: rename d2/d3/da/d2f/d32/d24/c2c to d2/d3/da/d2f/d32/d22/d4f/d89/cbe 0 2024-09-21T00:56:39.084 INFO:tasks.workunit.client.1.smithi187.stdout:0/595: truncate d0/d17/d1c/d23/df/d41/f42 1894228 0 2024-09-21T00:56:39.087 INFO:tasks.workunit.client.0.smithi112.stdout:7/151: rename d0/d2/cc to d0/d8/d1a/d23/c2a 0 2024-09-21T00:56:39.090 INFO:tasks.workunit.client.0.smithi112.stdout:9/113: write d5/d6/de/f15 [800056,63283] 0 2024-09-21T00:56:39.091 INFO:tasks.workunit.client.1.smithi187.stdout:9/783: unlink d4/d13/d14/d1d/d5f/caf 0 2024-09-21T00:56:39.092 INFO:tasks.workunit.client.0.smithi112.stdout:6/123: link d9/df/l2c d9/l30 0 2024-09-21T00:56:39.092 INFO:tasks.workunit.client.1.smithi187.stdout:9/784: dread - d4/d13/d20/d2b/d66/fc1 zero size 2024-09-21T00:56:39.092 INFO:tasks.workunit.client.0.smithi112.stdout:6/124: dread - d9/d13/f15 zero size 2024-09-21T00:56:39.093 INFO:tasks.workunit.client.1.smithi187.stdout:9/785: dread - d4/d13/d14/d5d/fbe zero size 2024-09-21T00:56:39.097 INFO:tasks.workunit.client.1.smithi187.stdout:5/603: truncate d0/fa5 616346 0 2024-09-21T00:56:39.100 INFO:tasks.workunit.client.1.smithi187.stdout:2/688: write d2/dc/d2e/d4a/d7c/f89 [1502645,43066] 0 2024-09-21T00:56:39.103 INFO:tasks.workunit.client.0.smithi112.stdout:6/125: mkdir d9/d13/d31 0 2024-09-21T00:56:39.103 INFO:tasks.workunit.client.0.smithi112.stdout:9/114: dread d5/d6/de/d13/f1a [0,4194304] 0 2024-09-21T00:56:39.104 INFO:tasks.workunit.client.0.smithi112.stdout:6/126: dread - d9/d1b/f2a zero size 2024-09-21T00:56:39.105 INFO:tasks.workunit.client.1.smithi187.stdout:1/718: rename d4/d6/d23/d2e/d94/d35/d22/fc4 to d4/d86/fe8 0 2024-09-21T00:56:39.106 INFO:tasks.workunit.client.1.smithi187.stdout:4/641: creat d2/d3/d74/db1/fbf x:0 0 0 2024-09-21T00:56:39.107 INFO:tasks.workunit.client.1.smithi187.stdout:1/719: truncate d4/d6/d23/d2e/d94/d35/d22/f7b 637566 0 2024-09-21T00:56:39.107 INFO:tasks.workunit.client.1.smithi187.stdout:1/720: fdatasync d4/d6/fa9 0 2024-09-21T00:56:39.108 INFO:tasks.workunit.client.1.smithi187.stdout:4/642: truncate d2/d3/d56/d84/d60/d6c/d77/fae 523302 0 2024-09-21T00:56:39.110 INFO:tasks.workunit.client.1.smithi187.stdout:4/643: write d2/d3/f21 [8388443,44966] 0 2024-09-21T00:56:39.112 INFO:tasks.workunit.client.1.smithi187.stdout:6/643: truncate d7/d2a/d29/f7c 3581957 0 2024-09-21T00:56:39.113 INFO:tasks.workunit.client.1.smithi187.stdout:8/692: write dc/d2f/d37/fda [2106183,60722] 0 2024-09-21T00:56:39.114 INFO:tasks.workunit.client.1.smithi187.stdout:6/644: truncate d7/d2a/fba 623114 0 2024-09-21T00:56:39.114 INFO:tasks.workunit.client.1.smithi187.stdout:0/596: mkdir d0/d60/d6b/dc9 0 2024-09-21T00:56:39.115 INFO:tasks.workunit.client.1.smithi187.stdout:1/721: dwrite d4/d6/d23/d2e/f3f [4194304,4194304] 0 2024-09-21T00:56:39.115 INFO:tasks.workunit.client.1.smithi187.stdout:6/645: chown d7/d2a/d7a/f8f 42290751 1 2024-09-21T00:56:39.116 INFO:tasks.workunit.client.1.smithi187.stdout:7/569: truncate d1/d18/d31/d41/d64/faa 2574642 0 2024-09-21T00:56:39.117 INFO:tasks.workunit.client.1.smithi187.stdout:6/646: write d7/d59/f4c [1328976,6303] 0 2024-09-21T00:56:39.117 INFO:tasks.workunit.client.0.smithi112.stdout:7/152: write d0/f10 [6440340,26048] 0 2024-09-21T00:56:39.118 INFO:tasks.workunit.client.1.smithi187.stdout:7/570: write d1/f7 [829183,126366] 0 2024-09-21T00:56:39.118 INFO:tasks.workunit.client.0.smithi112.stdout:7/153: read d0/f10 [3582805,1249] 0 2024-09-21T00:56:39.119 INFO:tasks.workunit.client.0.smithi112.stdout:7/154: readlink d0/d2/l28 0 2024-09-21T00:56:39.119 INFO:tasks.workunit.client.0.smithi112.stdout:7/155: chown d0/d8/c17 669 1 2024-09-21T00:56:39.122 INFO:tasks.workunit.client.0.smithi112.stdout:6/127: mknod d9/d13/d2f/c32 0 2024-09-21T00:56:39.123 INFO:tasks.workunit.client.0.smithi112.stdout:6/128: fsync d9/d13/f29 0 2024-09-21T00:56:39.124 INFO:tasks.workunit.client.0.smithi112.stdout:7/156: dread d0/d8/d1a/f1f [0,4194304] 0 2024-09-21T00:56:39.124 INFO:tasks.workunit.client.0.smithi112.stdout:6/129: fsync d9/fc 0 2024-09-21T00:56:39.124 INFO:tasks.workunit.client.1.smithi187.stdout:9/786: read d4/d8/d44/f51 [2678336,21368] 0 2024-09-21T00:56:39.125 INFO:tasks.workunit.client.1.smithi187.stdout:1/722: dwrite d4/d6/d23/d6f/f96 [0,4194304] 0 2024-09-21T00:56:39.125 INFO:tasks.workunit.client.1.smithi187.stdout:2/689: unlink d2/da8/d1c/d2d/d8f/f59 0 2024-09-21T00:56:39.127 INFO:tasks.workunit.client.1.smithi187.stdout:1/723: dread - d4/d86/f8e zero size 2024-09-21T00:56:39.127 INFO:tasks.workunit.client.1.smithi187.stdout:9/787: chown d4/d13/d14/d5d/f79 1 1 2024-09-21T00:56:39.127 INFO:tasks.workunit.client.1.smithi187.stdout:2/690: chown d2/dc/c24 4 1 2024-09-21T00:56:39.131 INFO:tasks.workunit.client.1.smithi187.stdout:1/724: truncate d4/d6/d23/d2e/d94/d35/d79/dd2/fd4 354556 0 2024-09-21T00:56:39.132 INFO:tasks.workunit.client.0.smithi112.stdout:6/130: fsync f7 0 2024-09-21T00:56:39.133 INFO:tasks.workunit.client.1.smithi187.stdout:1/725: write d4/d6/d23/d2e/d94/d35/d79/f88 [5036330,80] 0 2024-09-21T00:56:39.135 INFO:tasks.workunit.client.0.smithi112.stdout:7/157: rmdir d0/d8 39 2024-09-21T00:56:39.136 INFO:tasks.workunit.client.0.smithi112.stdout:7/158: chown d0/fa 1923095 1 2024-09-21T00:56:39.136 INFO:tasks.workunit.client.1.smithi187.stdout:9/788: dwrite d4/d8/d41/fa6 [0,4194304] 0 2024-09-21T00:56:39.138 INFO:tasks.workunit.client.1.smithi187.stdout:5/604: dread d0/dc/daa/d67/d14/f3d [0,4194304] 0 2024-09-21T00:56:39.139 INFO:tasks.workunit.client.0.smithi112.stdout:9/115: truncate d5/d6/de/f15 826417 0 2024-09-21T00:56:39.141 INFO:tasks.workunit.client.0.smithi112.stdout:6/131: mkdir d9/d1f/d1a/d33 0 2024-09-21T00:56:39.142 INFO:tasks.workunit.client.1.smithi187.stdout:4/644: rename d2/d3/da/d16/l46 to d2/d3/d74/lc0 0 2024-09-21T00:56:39.143 INFO:tasks.workunit.client.0.smithi112.stdout:6/132: write d9/d13/f15 [417654,100700] 0 2024-09-21T00:56:39.144 INFO:tasks.workunit.client.1.smithi187.stdout:8/693: unlink dc/d2f/d80/db8/dba/d3e/fae 0 2024-09-21T00:56:39.146 INFO:tasks.workunit.client.1.smithi187.stdout:8/694: fdatasync f7 0 2024-09-21T00:56:39.146 INFO:tasks.workunit.client.0.smithi112.stdout:9/116: rename d5/d6/de/d13/l1f to d5/d6/l25 0 2024-09-21T00:56:39.147 INFO:tasks.workunit.client.0.smithi112.stdout:6/133: dread d9/f12 [0,4194304] 0 2024-09-21T00:56:39.149 INFO:tasks.workunit.client.1.smithi187.stdout:9/789: dwrite d4/d8/f19 [4194304,4194304] 0 2024-09-21T00:56:39.149 INFO:tasks.workunit.client.1.smithi187.stdout:1/726: dwrite d4/d6/d23/d2e/d94/f4e [0,4194304] 0 2024-09-21T00:56:39.151 INFO:tasks.workunit.client.0.smithi112.stdout:6/134: chown d9/df/l2c 2 1 2024-09-21T00:56:39.152 INFO:tasks.workunit.client.0.smithi112.stdout:6/135: truncate d9/f25 543646 0 2024-09-21T00:56:39.154 INFO:tasks.workunit.client.1.smithi187.stdout:5/605: dwrite d0/dc/daa/d67/d14/d38/d5a/f7d [0,4194304] 0 2024-09-21T00:56:39.155 INFO:tasks.workunit.client.1.smithi187.stdout:6/647: creat d7/d2a/da2/fd7 x:0 0 0 2024-09-21T00:56:39.157 INFO:tasks.workunit.client.0.smithi112.stdout:6/136: mkdir d9/d13/d2f/d34 0 2024-09-21T00:56:39.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:38 smithi187 ceph-mon[34997]: pgmap v22: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 163 MiB/s wr, 316 op/s 2024-09-21T00:56:39.165 INFO:tasks.workunit.client.1.smithi187.stdout:0/597: mkdir d0/d17/d1c/d23/df/dca 0 2024-09-21T00:56:39.166 INFO:tasks.workunit.client.1.smithi187.stdout:8/695: mkdir dc/d2f/d80/db8/dba/d3e/de3 0 2024-09-21T00:56:39.166 INFO:tasks.workunit.client.1.smithi187.stdout:3/579: getdents d9/d7f 0 2024-09-21T00:56:39.167 INFO:tasks.workunit.client.1.smithi187.stdout:3/580: stat d9/d13/d20/c69 0 2024-09-21T00:56:39.167 INFO:tasks.workunit.client.0.smithi112.stdout:6/137: dwrite d9/fd [4194304,4194304] 0 2024-09-21T00:56:39.168 INFO:tasks.workunit.client.1.smithi187.stdout:1/727: creat d4/d6/d23/d2e/d94/d35/d22/d65/d90/fe9 x:0 0 0 2024-09-21T00:56:39.168 INFO:tasks.workunit.client.1.smithi187.stdout:9/790: symlink d4/d10/d8f/de6/lff 0 2024-09-21T00:56:39.169 INFO:tasks.workunit.client.1.smithi187.stdout:9/791: chown d4/d61/l8c 778 1 2024-09-21T00:56:39.170 INFO:tasks.workunit.client.1.smithi187.stdout:5/606: creat d0/dc/daa/d67/fc4 x:0 0 0 2024-09-21T00:56:39.172 INFO:tasks.workunit.client.0.smithi112.stdout:6/138: creat d9/d1f/f35 x:0 0 0 2024-09-21T00:56:39.174 INFO:tasks.workunit.client.0.smithi112.stdout:6/139: truncate d9/df/f2e 617466 0 2024-09-21T00:56:39.175 INFO:tasks.workunit.client.1.smithi187.stdout:6/648: creat d7/d2a/d29/d40/d45/fd8 x:0 0 0 2024-09-21T00:56:39.176 INFO:tasks.workunit.client.1.smithi187.stdout:2/691: symlink d2/dc/d2e/lf2 0 2024-09-21T00:56:39.177 INFO:tasks.workunit.client.0.smithi112.stdout:9/117: readlink d5/d6/l25 0 2024-09-21T00:56:39.179 INFO:tasks.workunit.client.0.smithi112.stdout:6/140: creat d9/d13/d2f/d34/f36 x:0 0 0 2024-09-21T00:56:39.180 INFO:tasks.workunit.client.1.smithi187.stdout:4/645: symlink d2/lc1 0 2024-09-21T00:56:39.183 INFO:tasks.workunit.client.0.smithi112.stdout:6/141: creat d9/d1b/f37 x:0 0 0 2024-09-21T00:56:39.183 INFO:tasks.workunit.client.1.smithi187.stdout:8/696: unlink dc/d2f/d80/db8/dba/ld5 0 2024-09-21T00:56:39.184 INFO:tasks.workunit.client.0.smithi112.stdout:9/118: dwrite d5/fc [4194304,4194304] 0 2024-09-21T00:56:39.185 INFO:tasks.workunit.client.0.smithi112.stdout:9/119: chown d5/d6/de/f24 6126 1 2024-09-21T00:56:39.187 INFO:tasks.workunit.client.1.smithi187.stdout:1/728: unlink d4/d6/d23/d2e/d94/d35/d22/d65/fa3 0 2024-09-21T00:56:39.188 INFO:tasks.workunit.client.0.smithi112.stdout:6/142: unlink d9/df/d19/l28 0 2024-09-21T00:56:39.190 INFO:tasks.workunit.client.0.smithi112.stdout:9/120: unlink d5/fc 0 2024-09-21T00:56:39.192 INFO:tasks.workunit.client.0.smithi112.stdout:6/143: symlink d9/l38 0 2024-09-21T00:56:39.192 INFO:tasks.workunit.client.0.smithi112.stdout:6/144: chown d9/df/l2c 547468 1 2024-09-21T00:56:39.193 INFO:tasks.workunit.client.1.smithi187.stdout:5/607: creat d0/dc/daa/d67/d14/d38/d5a/fc5 x:0 0 0 2024-09-21T00:56:39.195 INFO:tasks.workunit.client.1.smithi187.stdout:7/571: dwrite d1/d18/d31/f6d [0,4194304] 0 2024-09-21T00:56:39.197 INFO:tasks.workunit.client.1.smithi187.stdout:8/697: dwrite dc/d2f/d37/f42 [4194304,4194304] 0 2024-09-21T00:56:39.197 INFO:tasks.workunit.client.1.smithi187.stdout:3/581: dwrite d9/d19/d1c/d5f/f60 [0,4194304] 0 2024-09-21T00:56:39.199 INFO:tasks.workunit.client.1.smithi187.stdout:7/572: readlink d1/dc/d15/d22/d3e/da6/lab 0 2024-09-21T00:56:39.201 INFO:tasks.workunit.client.0.smithi112.stdout:6/145: creat d9/d13/f39 x:0 0 0 2024-09-21T00:56:39.203 INFO:tasks.workunit.client.1.smithi187.stdout:0/598: symlink d0/d17/d18/d90/d98/lcb 0 2024-09-21T00:56:39.205 INFO:tasks.workunit.client.0.smithi112.stdout:9/121: mknod d5/d6/de/c26 0 2024-09-21T00:56:39.205 INFO:tasks.workunit.client.0.smithi112.stdout:9/122: chown d5/d6/d19/d1b 7350086 1 2024-09-21T00:56:39.211 INFO:tasks.workunit.client.0.smithi112.stdout:9/123: rename d5/d6/de/c1c to d5/d6/d19/d1b/c27 0 2024-09-21T00:56:39.213 INFO:tasks.workunit.client.1.smithi187.stdout:9/792: link d4/d10/fc3 d4/d10/d43/f100 0 2024-09-21T00:56:39.214 INFO:tasks.workunit.client.1.smithi187.stdout:9/793: stat d4/d8/d41/fa6 0 2024-09-21T00:56:39.221 INFO:tasks.workunit.client.1.smithi187.stdout:2/692: symlink d2/dc/d2e/d51/dc5/ddf/lf3 0 2024-09-21T00:56:39.225 INFO:tasks.workunit.client.1.smithi187.stdout:8/698: creat dc/d2f/d34/d4b/d85/fe4 x:0 0 0 2024-09-21T00:56:39.226 INFO:tasks.workunit.client.1.smithi187.stdout:7/573: symlink d1/d18/d31/d33/d3b/lbf 0 2024-09-21T00:56:39.227 INFO:tasks.workunit.client.1.smithi187.stdout:0/599: rmdir d0/d60/d6b 39 2024-09-21T00:56:39.229 INFO:tasks.workunit.client.1.smithi187.stdout:9/794: rename d4/d61/d6a/d90/cce to d4/d8/d46/c101 0 2024-09-21T00:56:39.230 INFO:tasks.workunit.client.1.smithi187.stdout:4/646: write d2/d3/da/d2f/d32/d22/d37/d63/f69 [2676484,26389] 0 2024-09-21T00:56:39.232 INFO:tasks.workunit.client.1.smithi187.stdout:5/608: mkdir d0/dc/dc6 0 2024-09-21T00:56:39.234 INFO:tasks.workunit.client.1.smithi187.stdout:0/600: dwrite d0/d17/fac [0,4194304] 0 2024-09-21T00:56:39.236 INFO:tasks.workunit.client.1.smithi187.stdout:8/699: unlink dc/d2f/d37/fc0 0 2024-09-21T00:56:39.236 INFO:tasks.workunit.client.1.smithi187.stdout:8/700: readlink dc/d44/ld4 0 2024-09-21T00:56:39.237 INFO:tasks.workunit.client.1.smithi187.stdout:8/701: chown dc/f10 0 1 2024-09-21T00:56:39.238 INFO:tasks.workunit.client.0.smithi112.stdout:6/146: dwrite d9/d1b/f1d [0,4194304] 0 2024-09-21T00:56:39.239 INFO:tasks.workunit.client.1.smithi187.stdout:9/795: mkdir d4/d13/d20/d2b/d94/dde/d102 0 2024-09-21T00:56:39.239 INFO:tasks.workunit.client.1.smithi187.stdout:9/796: write d4/d13/d14/d5d/f79 [4488275,118410] 0 2024-09-21T00:56:39.242 INFO:tasks.workunit.client.1.smithi187.stdout:0/601: read d0/d17/d18/f78 [1602350,102575] 0 2024-09-21T00:56:39.243 INFO:tasks.workunit.client.1.smithi187.stdout:4/647: mkdir d2/d3/d74/d98/dc2 0 2024-09-21T00:56:39.243 INFO:tasks.workunit.client.1.smithi187.stdout:0/602: truncate d0/d60/fab 858150 0 2024-09-21T00:56:39.245 INFO:tasks.workunit.client.0.smithi112.stdout:9/124: write d5/f17 [5193530,11744] 0 2024-09-21T00:56:39.245 INFO:tasks.workunit.client.1.smithi187.stdout:6/649: write d7/d2a/faa [704217,49320] 0 2024-09-21T00:56:39.250 INFO:tasks.workunit.client.0.smithi112.stdout:9/125: creat d5/d6/d19/f28 x:0 0 0 2024-09-21T00:56:39.251 INFO:tasks.workunit.client.0.smithi112.stdout:9/126: readlink d5/d6/l25 0 2024-09-21T00:56:39.252 INFO:tasks.workunit.client.1.smithi187.stdout:1/729: truncate d4/d6/f5a 551274 0 2024-09-21T00:56:39.253 INFO:tasks.workunit.client.1.smithi187.stdout:2/693: dread d2/dc/d2e/d4a/d7c/f37 [8388608,4194304] 0 2024-09-21T00:56:39.254 INFO:tasks.workunit.client.1.smithi187.stdout:2/694: write d2/d3/df/f72 [205473,90058] 0 2024-09-21T00:56:39.256 INFO:tasks.workunit.client.1.smithi187.stdout:3/582: getdents d9 0 2024-09-21T00:56:39.257 INFO:tasks.workunit.client.1.smithi187.stdout:0/603: mkdir d0/d17/d18/d3a/d97/dcc 0 2024-09-21T00:56:39.259 INFO:tasks.workunit.client.0.smithi112.stdout:9/127: rename d5/d6/de/d13/c23 to d5/d6/de/c29 0 2024-09-21T00:56:39.262 INFO:tasks.workunit.client.0.smithi112.stdout:9/128: rmdir d5/d6/de 39 2024-09-21T00:56:39.269 INFO:tasks.workunit.client.0.smithi112.stdout:9/129: rename d5/d6/de/f12 to d5/d6/d19/f2a 0 2024-09-21T00:56:39.269 INFO:tasks.workunit.client.0.smithi112.stdout:9/130: dread - d5/d6/d19/f1e zero size 2024-09-21T00:56:39.270 INFO:tasks.workunit.client.1.smithi187.stdout:5/609: dwrite d0/fa5 [0,4194304] 0 2024-09-21T00:56:39.271 INFO:tasks.workunit.client.1.smithi187.stdout:7/574: link d1/dc/l72 d1/d55/lc0 0 2024-09-21T00:56:39.273 INFO:tasks.workunit.client.1.smithi187.stdout:7/575: write d1/dc/d15/d22/d3e/d7c/f7f [1089885,80032] 0 2024-09-21T00:56:39.274 INFO:tasks.workunit.client.1.smithi187.stdout:6/650: symlink d7/d2a/d29/d40/d50/d68/ld9 0 2024-09-21T00:56:39.276 INFO:tasks.workunit.client.0.smithi112.stdout:9/131: dwrite d5/f14 [4194304,4194304] 0 2024-09-21T00:56:39.276 INFO:tasks.workunit.client.1.smithi187.stdout:9/797: symlink d4/d13/d20/d2b/dbf/ddd/l103 0 2024-09-21T00:56:39.279 INFO:tasks.workunit.client.1.smithi187.stdout:3/583: rmdir d9/d7f 39 2024-09-21T00:56:39.284 INFO:tasks.workunit.client.0.smithi112.stdout:9/132: dwrite d5/d6/d19/f1d [0,4194304] 0 2024-09-21T00:56:39.286 INFO:tasks.workunit.client.0.smithi112.stdout:9/133: write d5/d6/de/f24 [695380,110149] 0 2024-09-21T00:56:39.287 INFO:tasks.workunit.client.1.smithi187.stdout:9/798: mknod d4/d8/d46/c104 0 2024-09-21T00:56:39.289 INFO:tasks.workunit.client.0.smithi112.stdout:9/134: creat d5/d6/d19/d1b/f2b x:0 0 0 2024-09-21T00:56:39.291 INFO:tasks.workunit.client.1.smithi187.stdout:5/610: mkdir d0/dc/daa/d67/d14/d1b/d27/dc7 0 2024-09-21T00:56:39.292 INFO:tasks.workunit.client.1.smithi187.stdout:8/702: getdents dc/d2f/d34/d4b/d85 0 2024-09-21T00:56:39.295 INFO:tasks.workunit.client.1.smithi187.stdout:1/730: rename d4/d6/d23/d2e/d94/d35/d79/dd2/fd4 to d4/d6/d23/d2e/d53/fea 0 2024-09-21T00:56:39.296 INFO:tasks.workunit.client.1.smithi187.stdout:9/799: mknod d4/d61/c105 0 2024-09-21T00:56:39.296 INFO:tasks.workunit.client.1.smithi187.stdout:3/584: dread - d9/d13/d87/d94/f65 zero size 2024-09-21T00:56:39.297 INFO:tasks.workunit.client.1.smithi187.stdout:3/585: fdatasync d9/d13/d87/fb8 0 2024-09-21T00:56:39.298 INFO:tasks.workunit.client.1.smithi187.stdout:2/695: rename d2/d3/d15/fb1 to d2/dc/d2e/de1/ff4 0 2024-09-21T00:56:39.300 INFO:tasks.workunit.client.1.smithi187.stdout:9/800: rmdir d4/d61/d6c 39 2024-09-21T00:56:39.301 INFO:tasks.workunit.client.1.smithi187.stdout:8/703: dread dc/d2f/d80/db8/dba/d29/f4c [0,4194304] 0 2024-09-21T00:56:39.301 INFO:tasks.workunit.client.1.smithi187.stdout:6/651: getdents d7/d2a/d29/d40/d6a/d9e 0 2024-09-21T00:56:39.302 INFO:tasks.workunit.client.1.smithi187.stdout:8/704: chown dc/f28 13 1 2024-09-21T00:56:39.303 INFO:tasks.workunit.client.1.smithi187.stdout:0/604: rename d0/d17/d1c/d65/fad to d0/d17/d18/d90/d98/fcd 0 2024-09-21T00:56:39.304 INFO:tasks.workunit.client.1.smithi187.stdout:1/731: dwrite d4/d6/d23/d2e/d53/d6a/f8f [0,4194304] 0 2024-09-21T00:56:39.305 INFO:tasks.workunit.client.1.smithi187.stdout:9/801: rmdir d4/d13/d20/d2b/d66 39 2024-09-21T00:56:39.305 INFO:tasks.workunit.client.1.smithi187.stdout:8/705: write dc/d2f/d34/d7d/f81 [956887,1565] 0 2024-09-21T00:56:39.307 INFO:tasks.workunit.client.1.smithi187.stdout:2/696: fsync d2/dc/d2e/d4a/f77 0 2024-09-21T00:56:39.307 INFO:tasks.workunit.client.1.smithi187.stdout:9/802: dread - d4/d13/d14/d28/ff8 zero size 2024-09-21T00:56:39.309 INFO:tasks.workunit.client.1.smithi187.stdout:2/697: stat d2/dc/d2e/fae 0 2024-09-21T00:56:39.310 INFO:tasks.workunit.client.1.smithi187.stdout:7/576: rename d1/dc/d15/d22/d3e to d1/d18/d31/d41/d64/d93/dc1 0 2024-09-21T00:56:39.312 INFO:tasks.workunit.client.1.smithi187.stdout:3/586: write d9/d13/d20/f3c [811403,35982] 0 2024-09-21T00:56:39.313 INFO:tasks.workunit.client.1.smithi187.stdout:8/706: symlink dc/d2f/d54/d69/db3/le5 0 2024-09-21T00:56:39.318 INFO:tasks.workunit.client.1.smithi187.stdout:7/577: creat d1/dc/d15/d22/fc2 x:0 0 0 2024-09-21T00:56:39.319 INFO:tasks.workunit.client.1.smithi187.stdout:6/652: link d7/d2a/da2/fb6 d7/d2a/d29/d40/d50/d83/fda 0 2024-09-21T00:56:39.320 INFO:tasks.workunit.client.1.smithi187.stdout:6/653: truncate d7/f84 1706580 0 2024-09-21T00:56:39.320 INFO:tasks.workunit.client.1.smithi187.stdout:3/587: symlink d9/d13/d87/d94/d53/lbc 0 2024-09-21T00:56:39.322 INFO:tasks.workunit.client.1.smithi187.stdout:5/611: rename d0/dc/cb3 to d0/dc/daa/d67/cc8 0 2024-09-21T00:56:39.324 INFO:tasks.workunit.client.1.smithi187.stdout:0/605: creat d0/d17/d1c/d23/df/fce x:0 0 0 2024-09-21T00:56:39.324 INFO:tasks.workunit.client.1.smithi187.stdout:7/578: unlink d1/d18/fbd 0 2024-09-21T00:56:39.325 INFO:tasks.workunit.client.1.smithi187.stdout:6/654: mknod d7/d2a/d29/d40/d50/cdb 0 2024-09-21T00:56:39.326 INFO:tasks.workunit.client.1.smithi187.stdout:7/579: stat d1/lf 0 2024-09-21T00:56:39.327 INFO:tasks.workunit.client.1.smithi187.stdout:8/707: link dc/d2f/d54/d69/db3/fca dc/d44/dc1/fe6 0 2024-09-21T00:56:39.328 INFO:tasks.workunit.client.1.smithi187.stdout:1/732: rename d4/d75/fb1 to d4/d6/d23/d2e/d94/d35/d79/feb 0 2024-09-21T00:56:39.329 INFO:tasks.workunit.client.1.smithi187.stdout:6/655: dread - d7/d2a/da2/fb6 zero size 2024-09-21T00:56:39.329 INFO:tasks.workunit.client.1.smithi187.stdout:7/580: readlink d1/d55/l65 0 2024-09-21T00:56:39.329 INFO:tasks.workunit.client.1.smithi187.stdout:5/612: readlink d0/dc/daa/l86 0 2024-09-21T00:56:39.329 INFO:tasks.workunit.client.1.smithi187.stdout:3/588: creat d9/d7f/fbd x:0 0 0 2024-09-21T00:56:39.331 INFO:tasks.workunit.client.1.smithi187.stdout:2/698: dwrite d2/d3/df/f3e [0,4194304] 0 2024-09-21T00:56:39.334 INFO:tasks.workunit.client.1.smithi187.stdout:9/803: dwrite d4/d13/d20/d2b/d94/dde/ffb [0,4194304] 0 2024-09-21T00:56:39.336 INFO:tasks.workunit.client.1.smithi187.stdout:8/708: creat dc/d2f/d54/d69/db3/fe7 x:0 0 0 2024-09-21T00:56:39.338 INFO:tasks.workunit.client.1.smithi187.stdout:1/733: write d4/d6/d23/d2e/d53/fbb [941033,96993] 0 2024-09-21T00:56:39.341 INFO:tasks.workunit.client.1.smithi187.stdout:6/656: mkdir d7/d2a/d29/d40/d5e/ddc 0 2024-09-21T00:56:39.342 INFO:tasks.workunit.client.1.smithi187.stdout:7/581: creat d1/d18/d31/d33/d3b/d9f/fc3 x:0 0 0 2024-09-21T00:56:39.342 INFO:tasks.workunit.client.1.smithi187.stdout:0/606: dwrite d0/d17/d1c/d23/f30 [0,4194304] 0 2024-09-21T00:56:39.343 INFO:tasks.workunit.client.1.smithi187.stdout:4/648: sync 2024-09-21T00:56:39.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/172: sync 2024-09-21T00:56:39.345 INFO:tasks.workunit.client.1.smithi187.stdout:4/649: chown d2/d3/d74 26903 1 2024-09-21T00:56:39.346 INFO:tasks.workunit.client.1.smithi187.stdout:1/734: write d4/d6/d23/d2e/d94/d35/d22/f7b [310788,99839] 0 2024-09-21T00:56:39.347 INFO:tasks.workunit.client.1.smithi187.stdout:9/804: creat d4/d10/d8f/f106 x:0 0 0 2024-09-21T00:56:39.348 INFO:tasks.workunit.client.0.smithi112.stdout:4/173: mknod d1/d7/c3a 0 2024-09-21T00:56:39.348 INFO:tasks.workunit.client.0.smithi112.stdout:4/174: chown d1/d7 38342 1 2024-09-21T00:56:39.349 INFO:tasks.workunit.client.1.smithi187.stdout:3/589: dread d9/d13/d87/d94/d53/d56/f5d [0,4194304] 0 2024-09-21T00:56:39.349 INFO:tasks.workunit.client.1.smithi187.stdout:7/582: write d1/d18/d31/d41/d64/d93/dc1/f50 [4550654,56478] 0 2024-09-21T00:56:39.351 INFO:tasks.workunit.client.1.smithi187.stdout:4/650: write d2/d3/da/d48/f9c [5425919,97363] 0 2024-09-21T00:56:39.354 INFO:tasks.workunit.client.1.smithi187.stdout:8/709: dwrite dc/d2f/d37/f42 [0,4194304] 0 2024-09-21T00:56:39.354 INFO:tasks.workunit.client.1.smithi187.stdout:0/607: mkdir d0/dcf 0 2024-09-21T00:56:39.357 INFO:tasks.workunit.client.1.smithi187.stdout:6/657: rename d7/d2a/f77 to d7/d2a/d29/d40/d5e/ddc/fdd 0 2024-09-21T00:56:39.358 INFO:tasks.workunit.client.1.smithi187.stdout:9/805: symlink d4/d13/d14/l107 0 2024-09-21T00:56:39.361 INFO:tasks.workunit.client.1.smithi187.stdout:2/699: getdents d2/dc/d2e/d4a 0 2024-09-21T00:56:39.362 INFO:tasks.workunit.client.1.smithi187.stdout:8/710: mkdir dc/d2f/d54/d69/de8 0 2024-09-21T00:56:39.365 INFO:tasks.workunit.client.1.smithi187.stdout:6/658: mknod d7/d2a/d29/d40/d5e/cde 0 2024-09-21T00:56:39.366 INFO:tasks.workunit.client.1.smithi187.stdout:4/651: read d2/d3/da/d2f/d32/d26/f44 [301326,118664] 0 2024-09-21T00:56:39.366 INFO:tasks.workunit.client.1.smithi187.stdout:5/613: dwrite d0/dc/daa/d67/d14/d38/f5b [0,4194304] 0 2024-09-21T00:56:39.368 INFO:tasks.workunit.client.1.smithi187.stdout:1/735: creat d4/d6/d23/d2e/d94/d35/d22/d2c/fec x:0 0 0 2024-09-21T00:56:39.368 INFO:tasks.workunit.client.1.smithi187.stdout:0/608: dread d0/d17/d1c/d23/df/f15 [0,4194304] 0 2024-09-21T00:56:39.369 INFO:tasks.workunit.client.1.smithi187.stdout:2/700: fdatasync d2/dc/d2e/d4a/f77 0 2024-09-21T00:56:39.370 INFO:tasks.workunit.client.1.smithi187.stdout:7/583: link d1/dc/d15/d22/c4c d1/d55/cc4 0 2024-09-21T00:56:39.370 INFO:tasks.workunit.client.1.smithi187.stdout:0/609: stat d0/dc2 0 2024-09-21T00:56:39.371 INFO:tasks.workunit.client.1.smithi187.stdout:6/659: symlink d7/d2a/d29/d40/d50/d68/dcf/ldf 0 2024-09-21T00:56:39.372 INFO:tasks.workunit.client.0.smithi112.stdout:4/175: dwrite d1/d7/f2e [0,4194304] 0 2024-09-21T00:56:39.372 INFO:tasks.workunit.client.1.smithi187.stdout:1/736: write d4/d6/d23/d2e/d53/fbd [735437,120499] 0 2024-09-21T00:56:39.373 INFO:tasks.workunit.client.1.smithi187.stdout:5/614: mkdir d0/dc/daa/d67/d14/d57/d5c/dc9 0 2024-09-21T00:56:39.374 INFO:tasks.workunit.client.1.smithi187.stdout:4/652: symlink d2/d3/lc3 0 2024-09-21T00:56:39.376 INFO:tasks.workunit.client.1.smithi187.stdout:0/610: mkdir d0/d17/d1c/d65/dd0 0 2024-09-21T00:56:39.376 INFO:tasks.workunit.client.1.smithi187.stdout:1/737: chown d4/d6/d23/d2e/d94/d35/d79/dce/fd1 43276 1 2024-09-21T00:56:39.377 INFO:tasks.workunit.client.0.smithi112.stdout:4/176: rmdir d1 39 2024-09-21T00:56:39.380 INFO:tasks.workunit.client.1.smithi187.stdout:2/701: mknod d2/da8/d6c/db8/d40/d75/cf5 0 2024-09-21T00:56:39.381 INFO:tasks.workunit.client.1.smithi187.stdout:2/702: write d2/dc/d2e/d6f/fc1 [768252,34430] 0 2024-09-21T00:56:39.382 INFO:tasks.workunit.client.1.smithi187.stdout:7/584: dread d1/d18/d31/f51 [0,4194304] 0 2024-09-21T00:56:39.383 INFO:tasks.workunit.client.1.smithi187.stdout:9/806: rename d4/d8/d44/d6e/d92 to d4/d13/d20/d2b/d108 0 2024-09-21T00:56:39.383 INFO:tasks.workunit.client.1.smithi187.stdout:6/660: rmdir d7/d2a/d29 39 2024-09-21T00:56:39.384 INFO:tasks.workunit.client.1.smithi187.stdout:7/585: fsync d1/dc/d15/f57 0 2024-09-21T00:56:39.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/177: dwrite d1/d5/fd [4194304,4194304] 0 2024-09-21T00:56:39.387 INFO:tasks.workunit.client.1.smithi187.stdout:4/653: mkdir d2/d3/da/dc4 0 2024-09-21T00:56:39.389 INFO:tasks.workunit.client.0.smithi112.stdout:4/178: symlink d1/d7/d9/l3b 0 2024-09-21T00:56:39.390 INFO:tasks.workunit.client.1.smithi187.stdout:9/807: dwrite d4/d13/fd2 [0,4194304] 0 2024-09-21T00:56:39.390 INFO:tasks.workunit.client.0.smithi112.stdout:4/179: read d1/d5/d1c/d1e/f31 [11284,121040] 0 2024-09-21T00:56:39.391 INFO:tasks.workunit.client.1.smithi187.stdout:8/711: rename dc/c16 to dc/d94/ce9 0 2024-09-21T00:56:39.392 INFO:tasks.workunit.client.1.smithi187.stdout:3/590: dread d9/d13/f1e [0,4194304] 0 2024-09-21T00:56:39.393 INFO:tasks.workunit.client.1.smithi187.stdout:7/586: unlink d1/dc/c54 0 2024-09-21T00:56:39.395 INFO:tasks.workunit.client.1.smithi187.stdout:6/661: chown d7/d2a/d29/d40/d6a/f70 18515176 1 2024-09-21T00:56:39.396 INFO:tasks.workunit.client.1.smithi187.stdout:0/611: mkdir d0/d17/d18/d90/dd1 0 2024-09-21T00:56:39.396 INFO:tasks.workunit.client.1.smithi187.stdout:8/712: chown dc/d2f/d80/db8/dba/d29/da7/ld2 92952326 1 2024-09-21T00:56:39.396 INFO:tasks.workunit.client.1.smithi187.stdout:3/591: truncate d9/d7f/fbd 58773 0 2024-09-21T00:56:39.397 INFO:tasks.workunit.client.1.smithi187.stdout:0/612: write d0/f16 [7035006,30046] 0 2024-09-21T00:56:39.397 INFO:tasks.workunit.client.1.smithi187.stdout:9/808: write d4/d13/fb8 [1650146,40179] 0 2024-09-21T00:56:39.400 INFO:tasks.workunit.client.1.smithi187.stdout:1/738: rename d4/d6/d49 to d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded 0 2024-09-21T00:56:39.401 INFO:tasks.workunit.client.0.smithi112.stdout:4/180: rename d1/d7/d9/c14 to d1/d5/c3c 0 2024-09-21T00:56:39.403 INFO:tasks.workunit.client.0.smithi112.stdout:4/181: dread d1/d5/f15 [4194304,4194304] 0 2024-09-21T00:56:39.405 INFO:tasks.workunit.client.1.smithi187.stdout:6/662: dwrite d7/d2a/d29/d40/d50/d83/fc3 [0,4194304] 0 2024-09-21T00:56:39.407 INFO:tasks.workunit.client.0.smithi112.stdout:4/182: rename d1/d5/d1c/d1e/d32 to d1/d5/d1c/d1e/d3d 0 2024-09-21T00:56:39.407 INFO:tasks.workunit.client.0.smithi112.stdout:4/183: chown d1/d7/d9/d1a/c25 1140546020 1 2024-09-21T00:56:39.409 INFO:tasks.workunit.client.1.smithi187.stdout:3/592: rmdir d9/d13/d87/d94/d53/d56 39 2024-09-21T00:56:39.413 INFO:tasks.workunit.client.1.smithi187.stdout:6/663: dwrite d7/d59/f4c [0,4194304] 0 2024-09-21T00:56:39.414 INFO:tasks.workunit.client.1.smithi187.stdout:6/664: readlink d7/d2a/d29/d40/d50/d68/ld9 0 2024-09-21T00:56:39.415 INFO:tasks.workunit.client.1.smithi187.stdout:2/703: rename d2/dc/d6b/c99 to d2/da8/d6c/db8/d40/d75/de8/cf6 0 2024-09-21T00:56:39.416 INFO:tasks.workunit.client.1.smithi187.stdout:5/615: write d0/dc/daa/d67/d30/f3b [3728554,42730] 0 2024-09-21T00:56:39.422 INFO:tasks.workunit.client.1.smithi187.stdout:4/654: truncate d2/d3/da/d16/f5c 1735431 0 2024-09-21T00:56:39.422 INFO:tasks.workunit.client.1.smithi187.stdout:2/704: dwrite d2/f7 [0,4194304] 0 2024-09-21T00:56:39.423 INFO:tasks.workunit.client.0.smithi112.stdout:4/184: getdents d1/d7 0 2024-09-21T00:56:39.426 INFO:tasks.workunit.client.1.smithi187.stdout:5/616: dwrite d0/dc/daa/d67/d30/f6a [0,4194304] 0 2024-09-21T00:56:39.426 INFO:tasks.workunit.client.1.smithi187.stdout:9/809: write d4/f3b [2559428,5394] 0 2024-09-21T00:56:39.427 INFO:tasks.workunit.client.0.smithi112.stdout:4/185: symlink d1/d5/l3e 0 2024-09-21T00:56:39.430 INFO:tasks.workunit.client.1.smithi187.stdout:9/810: readlink d4/d13/d14/d28/d72/la4 0 2024-09-21T00:56:39.430 INFO:tasks.workunit.client.1.smithi187.stdout:0/613: link d0/d17/d18/faf d0/d60/d6e/fd2 0 2024-09-21T00:56:39.431 INFO:tasks.workunit.client.0.smithi112.stdout:4/186: rename d1/d2d/d34/l38 to d1/d2d/l3f 0 2024-09-21T00:56:39.431 INFO:tasks.workunit.client.0.smithi112.stdout:4/187: fsync d1/d7/f2e 0 2024-09-21T00:56:39.432 INFO:tasks.workunit.client.1.smithi187.stdout:4/655: creat d2/d3/d56/d84/d60/fc5 x:0 0 0 2024-09-21T00:56:39.433 INFO:tasks.workunit.client.1.smithi187.stdout:2/705: creat d2/da8/d6c/d97/da1/ff7 x:0 0 0 2024-09-21T00:56:39.434 INFO:tasks.workunit.client.1.smithi187.stdout:4/656: dread d2/d3/da/d2f/d32/d22/d37/d3a/fa7 [0,4194304] 0 2024-09-21T00:56:39.434 INFO:tasks.workunit.client.1.smithi187.stdout:3/593: rmdir d9/d13/d87/d94/d53/d56/d61 39 2024-09-21T00:56:39.435 INFO:tasks.workunit.client.1.smithi187.stdout:9/811: read d4/d10/f11 [2961236,107574] 0 2024-09-21T00:56:39.437 INFO:tasks.workunit.client.0.smithi112.stdout:4/188: mknod d1/d7/d9/d1a/c40 0 2024-09-21T00:56:39.439 INFO:tasks.workunit.client.1.smithi187.stdout:7/587: getdents d1/d18/d31/d41/d64/d93/dc1/d73/d8b 0 2024-09-21T00:56:39.439 INFO:tasks.workunit.client.0.smithi112.stdout:4/189: creat d1/d5/d1c/d1e/f41 x:0 0 0 2024-09-21T00:56:39.441 INFO:tasks.workunit.client.1.smithi187.stdout:0/614: creat d0/d17/d1c/d23/df/d41/d3b/d46/fd3 x:0 0 0 2024-09-21T00:56:39.441 INFO:tasks.workunit.client.1.smithi187.stdout:7/588: truncate d1/d18/f8d 5653988 0 2024-09-21T00:56:39.443 INFO:tasks.workunit.client.1.smithi187.stdout:6/665: dwrite d7/d2a/d29/fc2 [0,4194304] 0 2024-09-21T00:56:39.444 INFO:tasks.workunit.client.0.smithi112.stdout:4/190: dread d1/d5/d1c/d1e/f20 [0,4194304] 0 2024-09-21T00:56:39.446 INFO:tasks.workunit.client.1.smithi187.stdout:8/713: rename dc/d2f/d34/d7d to dc/dea 0 2024-09-21T00:56:39.447 INFO:tasks.workunit.client.1.smithi187.stdout:4/657: mknod d2/cc6 0 2024-09-21T00:56:39.449 INFO:tasks.workunit.client.0.smithi112.stdout:4/191: mknod d1/d5/c42 0 2024-09-21T00:56:39.452 INFO:tasks.workunit.client.1.smithi187.stdout:0/615: creat d0/d5a/fd4 x:0 0 0 2024-09-21T00:56:39.454 INFO:tasks.workunit.client.1.smithi187.stdout:0/616: write d0/d17/d1c/d23/d36/f38 [1096871,88457] 0 2024-09-21T00:56:39.454 INFO:tasks.workunit.client.0.smithi112.stdout:4/192: truncate d1/d7/d9/d1a/d22/f2c 901912 0 2024-09-21T00:56:39.460 INFO:tasks.workunit.client.0.smithi112.stdout:1/49: sync 2024-09-21T00:56:39.461 INFO:tasks.workunit.client.0.smithi112.stdout:1/50: creat d5/fc x:0 0 0 2024-09-21T00:56:39.462 INFO:tasks.workunit.client.0.smithi112.stdout:4/193: link d1/d5/l3e d1/d2d/l43 0 2024-09-21T00:56:39.463 INFO:tasks.workunit.client.0.smithi112.stdout:1/51: unlink d5/f9 0 2024-09-21T00:56:39.464 INFO:tasks.workunit.client.0.smithi112.stdout:4/194: creat d1/d7/d30/f44 x:0 0 0 2024-09-21T00:56:39.469 INFO:tasks.workunit.client.1.smithi187.stdout:3/594: creat d9/d13/d87/d94/d53/d56/d61/fbe x:0 0 0 2024-09-21T00:56:39.469 INFO:tasks.workunit.client.0.smithi112.stdout:4/195: getdents d1 0 2024-09-21T00:56:39.471 INFO:tasks.workunit.client.1.smithi187.stdout:2/706: truncate d2/da8/d1c/d2d/d8f/d9f/fa2 2280611 0 2024-09-21T00:56:39.471 INFO:tasks.workunit.client.1.smithi187.stdout:4/658: chown d2/d3/d74/lc0 602 1 2024-09-21T00:56:39.471 INFO:tasks.workunit.client.0.smithi112.stdout:1/52: dwrite f4 [0,4194304] 0 2024-09-21T00:56:39.472 INFO:tasks.workunit.client.0.smithi112.stdout:1/53: stat d5 0 2024-09-21T00:56:39.472 INFO:tasks.workunit.client.0.smithi112.stdout:4/196: mknod d1/d7/c45 0 2024-09-21T00:56:39.474 INFO:tasks.workunit.client.1.smithi187.stdout:9/812: getdents d4/d61/d6a/d90 0 2024-09-21T00:56:39.477 INFO:tasks.workunit.client.0.smithi112.stdout:1/54: mkdir d5/d8/dd 0 2024-09-21T00:56:39.477 INFO:tasks.workunit.client.1.smithi187.stdout:8/714: creat dc/d2f/d54/feb x:0 0 0 2024-09-21T00:56:39.478 INFO:tasks.workunit.client.0.smithi112.stdout:4/197: chown d1/d5/l3e 7 1 2024-09-21T00:56:39.479 INFO:tasks.workunit.client.1.smithi187.stdout:2/707: mknod d2/d3/d15/cf8 0 2024-09-21T00:56:39.479 INFO:tasks.workunit.client.1.smithi187.stdout:9/813: dread - d4/d13/d14/d28/ff8 zero size 2024-09-21T00:56:39.480 INFO:tasks.workunit.client.0.smithi112.stdout:1/55: dread d5/fa [0,4194304] 0 2024-09-21T00:56:39.481 INFO:tasks.workunit.client.1.smithi187.stdout:5/617: dwrite d0/f7 [0,4194304] 0 2024-09-21T00:56:39.481 INFO:tasks.workunit.client.0.smithi112.stdout:4/198: creat d1/f46 x:0 0 0 2024-09-21T00:56:39.482 INFO:tasks.workunit.client.0.smithi112.stdout:1/56: chown d5/fa 16838 1 2024-09-21T00:56:39.482 INFO:tasks.workunit.client.1.smithi187.stdout:0/617: link d0/d17/d1c/c1f d0/d17/d18/d90/d98/cd5 0 2024-09-21T00:56:39.482 INFO:tasks.workunit.client.0.smithi112.stdout:1/57: write f4 [170451,51061] 0 2024-09-21T00:56:39.483 INFO:tasks.workunit.client.0.smithi112.stdout:4/199: readlink d1/d2d/l3f 0 2024-09-21T00:56:39.484 INFO:tasks.workunit.client.0.smithi112.stdout:1/58: write d5/fc [1040182,8650] 0 2024-09-21T00:56:39.484 INFO:tasks.workunit.client.1.smithi187.stdout:3/595: dwrite d9/d13/d87/d94/d53/f99 [0,4194304] 0 2024-09-21T00:56:39.485 INFO:tasks.workunit.client.1.smithi187.stdout:6/666: dread d7/d59/f1e [0,4194304] 0 2024-09-21T00:56:39.486 INFO:tasks.workunit.client.1.smithi187.stdout:6/667: write d7/d59/f6e [5171755,64741] 0 2024-09-21T00:56:39.491 INFO:tasks.workunit.client.0.smithi112.stdout:1/59: rename d5/fa to d5/fe 0 2024-09-21T00:56:39.491 INFO:tasks.workunit.client.0.smithi112.stdout:1/60: stat d5/fc 0 2024-09-21T00:56:39.498 INFO:tasks.workunit.client.0.smithi112.stdout:4/200: fsync d1/d7/d9/d1a/d22/f2c 0 2024-09-21T00:56:39.499 INFO:tasks.workunit.client.0.smithi112.stdout:4/201: fdatasync d1/d5/d1c/d1e/f41 0 2024-09-21T00:56:39.499 INFO:tasks.workunit.client.0.smithi112.stdout:1/61: mknod d5/d8/dd/cf 0 2024-09-21T00:56:39.501 INFO:tasks.workunit.client.0.smithi112.stdout:4/202: symlink d1/l47 0 2024-09-21T00:56:39.502 INFO:tasks.workunit.client.0.smithi112.stdout:1/62: mkdir d5/d8/d10 0 2024-09-21T00:56:39.504 INFO:tasks.workunit.client.0.smithi112.stdout:4/203: creat d1/d5/d1c/d1e/d3d/f48 x:0 0 0 2024-09-21T00:56:39.505 INFO:tasks.workunit.client.0.smithi112.stdout:4/204: dread - d1/d5/d1c/d1e/d3d/f48 zero size 2024-09-21T00:56:39.510 INFO:tasks.workunit.client.1.smithi187.stdout:1/739: sync 2024-09-21T00:56:39.510 INFO:tasks.workunit.client.1.smithi187.stdout:9/814: symlink d4/d10/d8f/de6/l109 0 2024-09-21T00:56:39.513 INFO:tasks.workunit.client.0.smithi112.stdout:4/205: dwrite d1/d5/d1c/d1e/f41 [0,4194304] 0 2024-09-21T00:56:39.513 INFO:tasks.workunit.client.1.smithi187.stdout:0/618: fdatasync d0/d17/d1c/d23/f19 0 2024-09-21T00:56:39.515 INFO:tasks.workunit.client.1.smithi187.stdout:2/708: dread d2/dc/d2e/d6f/fce [0,4194304] 0 2024-09-21T00:56:39.515 INFO:tasks.workunit.client.0.smithi112.stdout:1/63: write d5/fe [1262649,72061] 0 2024-09-21T00:56:39.516 INFO:tasks.workunit.client.1.smithi187.stdout:4/659: dread d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:39.516 INFO:tasks.workunit.client.1.smithi187.stdout:2/709: read d2/da8/d1c/d2d/d8f/fb4 [98172,7102] 0 2024-09-21T00:56:39.518 INFO:tasks.workunit.client.1.smithi187.stdout:1/740: symlink d4/d6/d23/d2e/d94/d35/d79/dce/lee 0 2024-09-21T00:56:39.518 INFO:tasks.workunit.client.1.smithi187.stdout:4/660: write d2/d3/da/d2f/d32/f8a [4016147,85220] 0 2024-09-21T00:56:39.520 INFO:tasks.workunit.client.1.smithi187.stdout:0/619: rmdir d0 39 2024-09-21T00:56:39.520 INFO:tasks.workunit.client.0.smithi112.stdout:4/206: symlink d1/d2d/d34/l49 0 2024-09-21T00:56:39.521 INFO:tasks.workunit.client.1.smithi187.stdout:9/815: mkdir d4/d13/d20/d2b/d108/dfc/d10a 0 2024-09-21T00:56:39.522 INFO:tasks.workunit.client.0.smithi112.stdout:4/207: write d1/d7/d30/f44 [729386,30472] 0 2024-09-21T00:56:39.522 INFO:tasks.workunit.client.1.smithi187.stdout:3/596: mknod d9/d19/da7/daa/cbf 0 2024-09-21T00:56:39.522 INFO:tasks.workunit.client.1.smithi187.stdout:4/661: chown d2/d3/da/d2f/d32/d22/d4f/f62 558237 1 2024-09-21T00:56:39.523 INFO:tasks.workunit.client.0.smithi112.stdout:1/64: dread f4 [0,4194304] 0 2024-09-21T00:56:39.526 INFO:tasks.workunit.client.1.smithi187.stdout:4/662: write d2/d3/da/d2f/d4b/f6a [1049795,47356] 0 2024-09-21T00:56:39.526 INFO:tasks.workunit.client.0.smithi112.stdout:4/208: dread d1/d5/fd [4194304,4194304] 0 2024-09-21T00:56:39.527 INFO:tasks.workunit.client.1.smithi187.stdout:1/741: dwrite d4/d6/d64/fb3 [0,4194304] 0 2024-09-21T00:56:39.528 INFO:tasks.workunit.client.1.smithi187.stdout:9/816: rename d4/ff3 to d4/d10/d8f/de6/f10b 0 2024-09-21T00:56:39.530 INFO:tasks.workunit.client.1.smithi187.stdout:2/710: link d2/da8/d6c/db8/d40/feb d2/dc/d2e/d4a/d7c/d52/da3/de6/ff9 0 2024-09-21T00:56:39.531 INFO:tasks.workunit.client.0.smithi112.stdout:4/209: mkdir d1/d5/d1c/d1e/d4a 0 2024-09-21T00:56:39.532 INFO:tasks.workunit.client.0.smithi112.stdout:1/65: getdents d5/d8 0 2024-09-21T00:56:39.533 INFO:tasks.workunit.client.1.smithi187.stdout:6/668: link d7/d2a/d7a/l92 d7/d2a/d29/d40/le0 0 2024-09-21T00:56:39.534 INFO:tasks.workunit.client.1.smithi187.stdout:6/669: write d7/d2a/d29/d40/d50/f81 [1830942,18044] 0 2024-09-21T00:56:39.534 INFO:tasks.workunit.client.0.smithi112.stdout:4/210: rename d1/d5/c42 to d1/d5/d1c/d1e/c4b 0 2024-09-21T00:56:39.535 INFO:tasks.workunit.client.1.smithi187.stdout:6/670: fdatasync d7/d2a/d29/d40/f4d 0 2024-09-21T00:56:39.535 INFO:tasks.workunit.client.0.smithi112.stdout:4/211: chown d1/d5/d1c/d1e/d4a 19926097 1 2024-09-21T00:56:39.535 INFO:tasks.workunit.client.0.smithi112.stdout:1/66: creat d5/d8/f11 x:0 0 0 2024-09-21T00:56:39.536 INFO:tasks.workunit.client.1.smithi187.stdout:6/671: dread - d7/d2a/d29/d40/d6a/dbc/fc1 zero size 2024-09-21T00:56:39.536 INFO:tasks.workunit.client.0.smithi112.stdout:4/212: write d1/d5/d1c/d1e/d3d/f48 [477746,49059] 0 2024-09-21T00:56:39.538 INFO:tasks.workunit.client.0.smithi112.stdout:1/67: creat d5/d8/f12 x:0 0 0 2024-09-21T00:56:39.541 INFO:tasks.workunit.client.1.smithi187.stdout:6/672: dwrite d7/d2a/fb [0,4194304] 0 2024-09-21T00:56:39.542 INFO:tasks.workunit.client.1.smithi187.stdout:6/673: chown d7/d2a/d29/d40/d5e/ddc 1842618 1 2024-09-21T00:56:39.545 INFO:tasks.workunit.client.1.smithi187.stdout:3/597: rename d9/d13/d87/d94/d53/d56/d7d/d81/lb1 to d9/d13/d87/d94/d53/d56/d7d/lc0 0 2024-09-21T00:56:39.546 INFO:tasks.workunit.client.0.smithi112.stdout:1/68: dwrite d5/d8/f11 [0,4194304] 0 2024-09-21T00:56:39.546 INFO:tasks.workunit.client.1.smithi187.stdout:2/711: dwrite d2/dc/d2e/d4a/d7c/f45 [0,4194304] 0 2024-09-21T00:56:39.546 INFO:tasks.workunit.client.1.smithi187.stdout:9/817: creat d4/d61/f10c x:0 0 0 2024-09-21T00:56:39.547 INFO:tasks.workunit.client.1.smithi187.stdout:9/818: readlink d4/d8/d46/d54/lba 0 2024-09-21T00:56:39.549 INFO:tasks.workunit.client.1.smithi187.stdout:0/620: getdents d0/d17/d18 0 2024-09-21T00:56:39.549 INFO:tasks.workunit.client.1.smithi187.stdout:6/674: truncate d7/f52 705885 0 2024-09-21T00:56:39.550 INFO:tasks.workunit.client.1.smithi187.stdout:3/598: mkdir d9/d13/d87/d94/d89/dc1 0 2024-09-21T00:56:39.551 INFO:tasks.workunit.client.1.smithi187.stdout:2/712: symlink d2/da8/d6c/db8/d40/d75/de8/lfa 0 2024-09-21T00:56:39.552 INFO:tasks.workunit.client.1.smithi187.stdout:9/819: mknod d4/d13/d14/c10d 0 2024-09-21T00:56:39.553 INFO:tasks.workunit.client.1.smithi187.stdout:0/621: creat d0/d17/d1c/d23/d36/fd6 x:0 0 0 2024-09-21T00:56:39.553 INFO:tasks.workunit.client.0.smithi112.stdout:1/69: dwrite d5/d8/f11 [0,4194304] 0 2024-09-21T00:56:39.554 INFO:tasks.workunit.client.1.smithi187.stdout:3/599: creat d9/d19/da7/fc2 x:0 0 0 2024-09-21T00:56:39.554 INFO:tasks.workunit.client.1.smithi187.stdout:9/820: rmdir d4/d10/d24 39 2024-09-21T00:56:39.555 INFO:tasks.workunit.client.0.smithi112.stdout:1/70: chown d5/d8/f11 0 1 2024-09-21T00:56:39.555 INFO:tasks.workunit.client.0.smithi112.stdout:1/71: chown d5/d8/f11 0 1 2024-09-21T00:56:39.555 INFO:tasks.workunit.client.0.smithi112.stdout:1/72: chown d5/d8/d10 4 1 2024-09-21T00:56:39.555 INFO:tasks.workunit.client.0.smithi112.stdout:1/73: fdatasync d5/d8/f12 0 2024-09-21T00:56:39.556 INFO:tasks.workunit.client.1.smithi187.stdout:9/821: chown d4/d13/d14/d1d/fad 16932 1 2024-09-21T00:56:39.556 INFO:tasks.workunit.client.1.smithi187.stdout:0/622: creat d0/d17/d18/d3a/d97/fd7 x:0 0 0 2024-09-21T00:56:39.556 INFO:tasks.workunit.client.1.smithi187.stdout:3/600: fdatasync d9/d19/d1c/d5f/f78 0 2024-09-21T00:56:39.557 INFO:tasks.workunit.client.0.smithi112.stdout:1/74: mkdir d5/d8/d13 0 2024-09-21T00:56:39.559 INFO:tasks.workunit.client.1.smithi187.stdout:2/713: rename d2/dc/d2e/d4a/d7c/f89 to d2/dc/d2e/d4a/d7c/d52/da3/ffb 0 2024-09-21T00:56:39.559 INFO:tasks.workunit.client.0.smithi112.stdout:1/75: mkdir d5/d8/d14 0 2024-09-21T00:56:39.563 INFO:tasks.workunit.client.1.smithi187.stdout:9/822: dread d4/d13/fca [0,4194304] 0 2024-09-21T00:56:39.565 INFO:tasks.workunit.client.1.smithi187.stdout:9/823: readlink d4/d13/d20/d2b/le4 0 2024-09-21T00:56:39.566 INFO:tasks.workunit.client.1.smithi187.stdout:9/824: chown d4/d13/d20 329082 1 2024-09-21T00:56:39.566 INFO:tasks.workunit.client.1.smithi187.stdout:9/825: readlink d4/d13/d20/d2b/l87 0 2024-09-21T00:56:39.571 INFO:tasks.workunit.client.1.smithi187.stdout:9/826: dwrite d4/d13/d14/d1d/f8d [4194304,4194304] 0 2024-09-21T00:56:39.573 INFO:tasks.workunit.client.1.smithi187.stdout:9/827: write d4/d13/d14/d5d/f8b [732448,99355] 0 2024-09-21T00:56:39.573 INFO:tasks.workunit.client.1.smithi187.stdout:9/828: chown d4/d8/d41/cd6 6 1 2024-09-21T00:56:39.575 INFO:tasks.workunit.client.1.smithi187.stdout:9/829: write d4/d61/d6c/f56 [6746470,9202] 0 2024-09-21T00:56:39.576 INFO:tasks.workunit.client.1.smithi187.stdout:2/714: dread d2/dc/d2e/f82 [0,4194304] 0 2024-09-21T00:56:39.578 INFO:tasks.workunit.client.1.smithi187.stdout:2/715: truncate d2/dc/d2e/d6f/f8a 936448 0 2024-09-21T00:56:39.579 INFO:tasks.workunit.client.1.smithi187.stdout:9/830: dread d4/d13/d14/d28/fa5 [0,4194304] 0 2024-09-21T00:56:39.579 INFO:tasks.workunit.client.1.smithi187.stdout:2/716: truncate d2/dc/d2e/fae 1395356 0 2024-09-21T00:56:39.582 INFO:tasks.workunit.client.1.smithi187.stdout:9/831: dread d4/d13/d14/d5d/f79 [4194304,4194304] 0 2024-09-21T00:56:39.582 INFO:tasks.workunit.client.1.smithi187.stdout:2/717: rename d2/dc/d2e/lf2 to d2/dc/d2e/d4a/d7c/d52/da3/de6/lfc 0 2024-09-21T00:56:39.583 INFO:tasks.workunit.client.1.smithi187.stdout:9/832: write d4/d8/d46/fd3 [715602,2784] 0 2024-09-21T00:56:39.583 INFO:tasks.workunit.client.1.smithi187.stdout:9/833: dread - d4/d13/d20/d2b/d108/ffe zero size 2024-09-21T00:56:39.584 INFO:tasks.workunit.client.1.smithi187.stdout:2/718: write d2/dc/d2e/d6f/fce [2594806,31676] 0 2024-09-21T00:56:39.586 INFO:tasks.workunit.client.1.smithi187.stdout:2/719: symlink d2/da8/d1c/dc6/lfd 0 2024-09-21T00:56:39.587 INFO:tasks.workunit.client.1.smithi187.stdout:9/834: unlink d4/d13/d20/d2b/d66/db6/cef 0 2024-09-21T00:56:39.589 INFO:tasks.workunit.client.1.smithi187.stdout:9/835: mknod d4/d13/d20/d2b/d66/db6/c10e 0 2024-09-21T00:56:39.591 INFO:tasks.workunit.client.1.smithi187.stdout:9/836: truncate d4/d13/d14/d5d/f8b 855061 0 2024-09-21T00:56:39.594 INFO:tasks.workunit.client.1.smithi187.stdout:2/720: dwrite d2/dc/d2e/f82 [0,4194304] 0 2024-09-21T00:56:39.594 INFO:tasks.workunit.client.1.smithi187.stdout:9/837: mkdir d4/d8/d46/d54/d10f 0 2024-09-21T00:56:39.595 INFO:tasks.workunit.client.1.smithi187.stdout:2/721: chown d2 3608 1 2024-09-21T00:56:39.597 INFO:tasks.workunit.client.1.smithi187.stdout:2/722: dread d2/dc/d2e/d6f/f8a [0,4194304] 0 2024-09-21T00:56:39.598 INFO:tasks.workunit.client.1.smithi187.stdout:9/838: mknod d4/d8/c110 0 2024-09-21T00:56:39.599 INFO:tasks.workunit.client.1.smithi187.stdout:9/839: fdatasync d4/d13/fe0 0 2024-09-21T00:56:39.604 INFO:tasks.workunit.client.1.smithi187.stdout:9/840: dread d4/d8/d41/f5b [0,4194304] 0 2024-09-21T00:56:39.606 INFO:tasks.workunit.client.1.smithi187.stdout:7/589: sync 2024-09-21T00:56:39.607 INFO:tasks.workunit.client.1.smithi187.stdout:7/590: chown d1/d18/d31/d41/d64/d93/dc1/d73/d8b 110 1 2024-09-21T00:56:39.607 INFO:tasks.workunit.client.0.smithi112.stdout:1/76: dread d5/fe [0,4194304] 0 2024-09-21T00:56:39.608 INFO:tasks.workunit.client.1.smithi187.stdout:9/841: unlink d4/d61/f89 0 2024-09-21T00:56:39.611 INFO:tasks.workunit.client.0.smithi112.stdout:1/77: rename d5/cb to d5/d8/dd/c15 0 2024-09-21T00:56:39.611 INFO:tasks.workunit.client.0.smithi112.stdout:1/78: chown d5/d8 133336553 1 2024-09-21T00:56:39.612 INFO:tasks.workunit.client.1.smithi187.stdout:9/842: fdatasync d4/d13/d20/d2b/d94/dde/ffb 0 2024-09-21T00:56:39.612 INFO:tasks.workunit.client.0.smithi112.stdout:1/79: dread - d5/d8/f12 zero size 2024-09-21T00:56:39.612 INFO:tasks.workunit.client.1.smithi187.stdout:9/843: chown d4/d13/d14/l36 565935 1 2024-09-21T00:56:39.613 INFO:tasks.workunit.client.1.smithi187.stdout:9/844: truncate d4/fcf 886294 0 2024-09-21T00:56:39.613 INFO:tasks.workunit.client.0.smithi112.stdout:1/80: write d5/fc [1287039,11072] 0 2024-09-21T00:56:39.614 INFO:tasks.workunit.client.1.smithi187.stdout:7/591: link d1/dc/c49 d1/d55/cc5 0 2024-09-21T00:56:39.615 INFO:tasks.workunit.client.1.smithi187.stdout:7/592: chown d1/d18/d31/d41/d8a 766082523 1 2024-09-21T00:56:39.616 INFO:tasks.workunit.client.1.smithi187.stdout:9/845: creat d4/d10/d39/d69/f111 x:0 0 0 2024-09-21T00:56:39.618 INFO:tasks.workunit.client.1.smithi187.stdout:7/593: mknod d1/d18/d31/d33/d3b/d9f/cc6 0 2024-09-21T00:56:39.621 INFO:tasks.workunit.client.1.smithi187.stdout:7/594: truncate d1/d18/d31/d33/d3b/d9f/d5d/f6c 5473265 0 2024-09-21T00:56:39.621 INFO:tasks.workunit.client.1.smithi187.stdout:7/595: fdatasync d1/d55/d80/f84 0 2024-09-21T00:56:39.622 INFO:tasks.workunit.client.1.smithi187.stdout:7/596: chown d1/d18/d31/d33/d3b/d62 13136 1 2024-09-21T00:56:39.623 INFO:tasks.workunit.client.1.smithi187.stdout:9/846: link d4/d10/fdc d4/d8/ded/f112 0 2024-09-21T00:56:39.624 INFO:tasks.workunit.client.1.smithi187.stdout:9/847: chown d4/d13/d20/d2b/d66/f74 885024242 1 2024-09-21T00:56:39.625 INFO:tasks.workunit.client.1.smithi187.stdout:7/597: creat d1/d18/d31/d41/d64/d93/dc1/d7c/d97/fc7 x:0 0 0 2024-09-21T00:56:39.625 INFO:tasks.workunit.client.1.smithi187.stdout:4/663: write d2/d3/da/d2f/d32/d26/f44 [1329404,12434] 0 2024-09-21T00:56:39.628 INFO:tasks.workunit.client.1.smithi187.stdout:4/664: write d2/d3/da/fa6 [2131038,78505] 0 2024-09-21T00:56:39.633 INFO:tasks.workunit.client.0.smithi112.stdout:4/213: dwrite d1/d7/f28 [0,4194304] 0 2024-09-21T00:56:39.633 INFO:tasks.workunit.client.1.smithi187.stdout:4/665: mkdir d2/d3/da/d2f/d32/d22/d37/dc7 0 2024-09-21T00:56:39.635 INFO:tasks.workunit.client.0.smithi112.stdout:4/214: write d1/d5/d1c/d1e/d3d/f48 [700275,21480] 0 2024-09-21T00:56:39.638 INFO:tasks.workunit.client.1.smithi187.stdout:4/666: unlink d2/d3/d56/d84/d60/fc5 0 2024-09-21T00:56:39.638 INFO:tasks.workunit.client.1.smithi187.stdout:4/667: chown d2/d3/d74/db1/da2 1 1 2024-09-21T00:56:39.642 INFO:tasks.workunit.client.0.smithi112.stdout:4/215: creat d1/d7/d9/d1a/d22/f4c x:0 0 0 2024-09-21T00:56:39.644 INFO:tasks.workunit.client.0.smithi112.stdout:4/216: mknod d1/d7/d30/c4d 0 2024-09-21T00:56:39.645 INFO:tasks.workunit.client.0.smithi112.stdout:4/217: chown d1/d5/l1b 23 1 2024-09-21T00:56:39.648 INFO:tasks.workunit.client.0.smithi112.stdout:4/218: rename d1/d7/d9/d1a/d22/f2c to d1/d2d/d34/f4e 0 2024-09-21T00:56:39.649 INFO:tasks.workunit.client.1.smithi187.stdout:4/668: dread d2/d3/da/d2f/d4b/f7a [0,4194304] 0 2024-09-21T00:56:39.649 INFO:tasks.workunit.client.1.smithi187.stdout:4/669: chown d2/d3/da/fc 21 1 2024-09-21T00:56:39.651 INFO:tasks.workunit.client.1.smithi187.stdout:4/670: write d2/d3/da/d2f/d32/d22/d37/d3a/f85 [855406,34717] 0 2024-09-21T00:56:39.651 INFO:tasks.workunit.client.1.smithi187.stdout:4/671: chown d2/d3/da/d2f/d4b/d7e/c59 208112 1 2024-09-21T00:56:39.653 INFO:tasks.workunit.client.0.smithi112.stdout:4/219: dread d1/d5/d1c/d1e/d3d/f48 [0,4194304] 0 2024-09-21T00:56:39.653 INFO:tasks.workunit.client.1.smithi187.stdout:3/601: truncate d9/d13/d87/d94/d53/d56/f8e 506166 0 2024-09-21T00:56:39.656 INFO:tasks.workunit.client.1.smithi187.stdout:3/602: write d9/d13/d87/d94/d53/d56/d7d/d81/f84 [3830284,95426] 0 2024-09-21T00:56:39.658 INFO:tasks.workunit.client.1.smithi187.stdout:0/623: dwrite d0/d17/d1c/d23/df/d41/d3b/f54 [8388608,4194304] 0 2024-09-21T00:56:39.658 INFO:tasks.workunit.client.1.smithi187.stdout:8/715: sync 2024-09-21T00:56:39.658 INFO:tasks.workunit.client.1.smithi187.stdout:3/603: readlink d9/l10 0 2024-09-21T00:56:39.660 INFO:tasks.workunit.client.1.smithi187.stdout:2/723: rename d2/da8/d1c to d2/d3/d15/dfe 0 2024-09-21T00:56:39.660 INFO:tasks.workunit.client.1.smithi187.stdout:0/624: chown d0/d5a/ca6 1775687 1 2024-09-21T00:56:39.660 INFO:tasks.workunit.client.1.smithi187.stdout:0/625: dread - d0/fa7 zero size 2024-09-21T00:56:39.663 INFO:tasks.workunit.client.1.smithi187.stdout:3/604: creat d9/d13/d87/d94/d89/fc3 x:0 0 0 2024-09-21T00:56:39.664 INFO:tasks.workunit.client.1.smithi187.stdout:3/605: chown d9/d13/f54 54961609 1 2024-09-21T00:56:39.665 INFO:tasks.workunit.client.1.smithi187.stdout:2/724: symlink d2/d3/lff 0 2024-09-21T00:56:39.666 INFO:tasks.workunit.client.1.smithi187.stdout:2/725: fsync d2/da8/d6c/d97/da1/ff7 0 2024-09-21T00:56:39.666 INFO:tasks.workunit.client.1.smithi187.stdout:8/716: link f7 dc/d2f/d54/fec 0 2024-09-21T00:56:39.668 INFO:tasks.workunit.client.1.smithi187.stdout:3/606: read d9/d13/d87/d94/d53/f76 [4094927,76369] 0 2024-09-21T00:56:39.670 INFO:tasks.workunit.client.1.smithi187.stdout:2/726: getdents d2/d3/d15/dfe/dc6/dcd 0 2024-09-21T00:56:39.671 INFO:tasks.workunit.client.1.smithi187.stdout:3/607: truncate d9/d7f/f85 1268020 0 2024-09-21T00:56:39.673 INFO:tasks.workunit.client.1.smithi187.stdout:2/727: read d2/dc/d2e/d4a/d7c/f2b [2377949,63075] 0 2024-09-21T00:56:39.674 INFO:tasks.workunit.client.1.smithi187.stdout:3/608: rename d9/d13/d20/c2b to d9/d13/d87/d94/d89/dc1/cc4 0 2024-09-21T00:56:39.675 INFO:tasks.workunit.client.1.smithi187.stdout:8/717: dread dc/d2f/d80/db8/dba/f3d [0,4194304] 0 2024-09-21T00:56:39.675 INFO:tasks.workunit.client.1.smithi187.stdout:8/718: chown dc/d2f/d34/d4b/d85/fa8 1196 1 2024-09-21T00:56:39.676 INFO:tasks.workunit.client.0.smithi112.stdout:1/81: truncate d5/fe 518446 0 2024-09-21T00:56:39.676 INFO:tasks.workunit.client.1.smithi187.stdout:8/719: chown dc/d2f/d54/d69/db3/fb6 29640309 1 2024-09-21T00:56:39.677 INFO:tasks.workunit.client.0.smithi112.stdout:1/82: truncate d5/fc 1938391 0 2024-09-21T00:56:39.677 INFO:tasks.workunit.client.1.smithi187.stdout:2/728: rename d2/dc/d2e/fbb to d2/d3/d15/dfe/d2d/d8f/f100 0 2024-09-21T00:56:39.679 INFO:tasks.workunit.client.1.smithi187.stdout:3/609: symlink d9/lc5 0 2024-09-21T00:56:39.682 INFO:tasks.workunit.client.1.smithi187.stdout:9/848: write d4/d10/d8f/f95 [2060554,75286] 0 2024-09-21T00:56:39.684 INFO:tasks.workunit.client.1.smithi187.stdout:7/598: truncate d1/d18/d31/d33/f95 1012977 0 2024-09-21T00:56:39.685 INFO:tasks.workunit.client.1.smithi187.stdout:8/720: symlink dc/d2f/d80/db8/dba/d29/da7/led 0 2024-09-21T00:56:39.686 INFO:tasks.workunit.client.0.smithi112.stdout:1/83: creat d5/d8/d10/f16 x:0 0 0 2024-09-21T00:56:39.688 INFO:tasks.workunit.client.1.smithi187.stdout:3/610: creat d9/d13/d87/d94/d89/fc6 x:0 0 0 2024-09-21T00:56:39.692 INFO:tasks.workunit.client.1.smithi187.stdout:9/849: creat d4/d61/d6c/f113 x:0 0 0 2024-09-21T00:56:39.695 INFO:tasks.workunit.client.0.smithi112.stdout:1/84: chown d5/fe 16767367 1 2024-09-21T00:56:39.698 INFO:tasks.workunit.client.1.smithi187.stdout:8/721: dwrite dc/d44/f71 [0,4194304] 0 2024-09-21T00:56:39.699 INFO:tasks.workunit.client.1.smithi187.stdout:8/722: read - dc/d2f/d80/db8/dba/f2a zero size 2024-09-21T00:56:39.701 INFO:tasks.workunit.client.1.smithi187.stdout:7/599: truncate d1/d18/d31/d41/d64/faa 2321044 0 2024-09-21T00:56:39.702 INFO:tasks.workunit.client.1.smithi187.stdout:7/600: fdatasync d1/d18/d31/d41/d64/d93/dc1/f50 0 2024-09-21T00:56:39.704 INFO:tasks.workunit.client.1.smithi187.stdout:9/850: mknod d4/d10/d8f/de6/df1/c114 0 2024-09-21T00:56:39.705 INFO:tasks.workunit.client.1.smithi187.stdout:8/723: rmdir dc/d44 39 2024-09-21T00:56:39.705 INFO:tasks.workunit.client.1.smithi187.stdout:9/851: fsync d4/d8/f2f 0 2024-09-21T00:56:39.707 INFO:tasks.workunit.client.1.smithi187.stdout:7/601: fdatasync d1/d18/d31/f36 0 2024-09-21T00:56:39.708 INFO:tasks.workunit.client.1.smithi187.stdout:4/672: dwrite d2/d3/da/d2f/d4b/d7e/fa3 [0,4194304] 0 2024-09-21T00:56:39.709 INFO:tasks.workunit.client.1.smithi187.stdout:8/724: chown dc/l4e 507005384 1 2024-09-21T00:56:39.712 INFO:tasks.workunit.client.1.smithi187.stdout:3/611: getdents d9/d19/d43 0 2024-09-21T00:56:39.713 INFO:tasks.workunit.client.1.smithi187.stdout:7/602: mkdir d1/d18/d31/d41/d64/d93/dc1/d73/dc8 0 2024-09-21T00:56:39.714 INFO:tasks.workunit.client.1.smithi187.stdout:9/852: mknod d4/d13/d20/d2e/d9a/c115 0 2024-09-21T00:56:39.716 INFO:tasks.workunit.client.1.smithi187.stdout:4/673: rename d2/d3/da/d2f/d32/d22/d4f to d2/d3/da/d2f/d4b/d7e/dc8 0 2024-09-21T00:56:39.718 INFO:tasks.workunit.client.1.smithi187.stdout:8/725: fdatasync dc/d2f/d80/db8/dba/d29/f4c 0 2024-09-21T00:56:39.721 INFO:tasks.workunit.client.1.smithi187.stdout:4/674: mkdir d2/d3/da/d16/dc9 0 2024-09-21T00:56:39.724 INFO:tasks.workunit.client.1.smithi187.stdout:3/612: unlink d9/d13/d20/c23 0 2024-09-21T00:56:39.726 INFO:tasks.workunit.client.1.smithi187.stdout:7/603: mkdir d1/dc/d15/dc9 0 2024-09-21T00:56:39.726 INFO:tasks.workunit.client.1.smithi187.stdout:4/675: dwrite d2/d3/da/d2f/d32/d22/d37/d3a/f8d [0,4194304] 0 2024-09-21T00:56:39.728 INFO:tasks.workunit.client.1.smithi187.stdout:7/604: write d1/d18/d31/d41/d64/d93/dc1/da6/fb9 [537035,21157] 0 2024-09-21T00:56:39.730 INFO:tasks.workunit.client.1.smithi187.stdout:4/676: fdatasync d2/d3/da/d2f/d32/d22/d37/d3a/fa7 0 2024-09-21T00:56:39.733 INFO:tasks.workunit.client.1.smithi187.stdout:8/726: link dc/f28 dc/d2f/d80/db8/dba/d29/da7/fee 0 2024-09-21T00:56:39.737 INFO:tasks.workunit.client.1.smithi187.stdout:4/677: mknod d2/d3/da/d2f/d4b/d7e/dc8/d89/cca 0 2024-09-21T00:56:39.742 INFO:tasks.workunit.client.0.smithi112.stdout:1/85: rename d5/fe to d5/d8/d10/f17 0 2024-09-21T00:56:39.743 INFO:tasks.workunit.client.1.smithi187.stdout:4/678: creat d2/d3/da/d2f/d4b/fcb x:0 0 0 2024-09-21T00:56:39.744 INFO:tasks.workunit.client.1.smithi187.stdout:4/679: write d2/d3/d56/f90 [767713,65947] 0 2024-09-21T00:56:39.744 INFO:tasks.workunit.client.1.smithi187.stdout:8/727: creat dc/d2f/d54/d69/de8/fef x:0 0 0 2024-09-21T00:56:39.747 INFO:tasks.workunit.client.1.smithi187.stdout:4/680: mknod d2/d3/d74/db1/ccc 0 2024-09-21T00:56:39.747 INFO:tasks.workunit.client.1.smithi187.stdout:4/681: write d2/d3/da/f4d [1049379,20965] 0 2024-09-21T00:56:39.748 INFO:tasks.workunit.client.1.smithi187.stdout:8/728: symlink dc/d2f/d80/db8/dba/d29/lf0 0 2024-09-21T00:56:39.749 INFO:tasks.workunit.client.0.smithi112.stdout:1/86: dwrite d5/d8/f11 [0,4194304] 0 2024-09-21T00:56:39.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.752+0000 7fafb7fff640 1 --2- 172.21.15.112:0/3317628987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb81001d0 0x7fafb81005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:39.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.752+0000 7fafbe600640 1 -- 172.21.15.112:0/3317628987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafb8100b10 msgr2=0x7fafb8100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:39.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.752+0000 7fafbe600640 1 --2- 172.21.15.112:0/3317628987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafb8100b10 0x7fafb8100f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fafac0097e0 tx=0x7fafac02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:39.754 INFO:tasks.workunit.client.1.smithi187.stdout:4/682: rename d2/d3/da/d2f/d32/d22/d37/d63 to d2/d3/da/d2f/d32/d24/dcd 0 2024-09-21T00:56:39.754 INFO:tasks.workunit.client.1.smithi187.stdout:1/742: sync 2024-09-21T00:56:39.754 INFO:tasks.workunit.client.1.smithi187.stdout:6/675: sync 2024-09-21T00:56:39.754 INFO:tasks.workunit.client.1.smithi187.stdout:5/618: sync 2024-09-21T00:56:39.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.753+0000 7fafbe600640 1 -- 172.21.15.112:0/3317628987 shutdown_connections 2024-09-21T00:56:39.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.753+0000 7fafbe600640 1 --2- 172.21.15.112:0/3317628987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafb8100b10 0x7fafb8100f70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.753+0000 7fafbe600640 1 --2- 172.21.15.112:0/3317628987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb81001d0 0x7fafb81005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.753+0000 7fafbe600640 1 -- 172.21.15.112:0/3317628987 >> 172.21.15.112:0/3317628987 conn(0x7fafb80fbfc0 msgr2=0x7fafb80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.753+0000 7fafbe600640 1 -- 172.21.15.112:0/3317628987 shutdown_connections 2024-09-21T00:56:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.753+0000 7fafbe600640 1 -- 172.21.15.112:0/3317628987 wait complete. 2024-09-21T00:56:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.754+0000 7fafbe600640 1 Processor -- start 2024-09-21T00:56:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.755+0000 7fafbe600640 1 -- start start 2024-09-21T00:56:39.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.755+0000 7fafbe600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafb81001d0 0x7fafb81a2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:39.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.756+0000 7fafbe600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb8100b10 0x7fafb81a2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:39.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.756+0000 7fafbe600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fafb806c340 con 0x7fafb8100b10 2024-09-21T00:56:39.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.756+0000 7fafbe600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fafb806c1c0 con 0x7fafb81001d0 2024-09-21T00:56:39.757 INFO:tasks.workunit.client.1.smithi187.stdout:8/729: dwrite dc/d2f/d34/d4b/d85/fe4 [0,4194304] 0 2024-09-21T00:56:39.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.756+0000 7fafb77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb8100b10 0x7fafb81a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:39.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.756+0000 7fafb77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb8100b10 0x7fafb81a2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33582/0 (socket says 172.21.15.112:33582) 2024-09-21T00:56:39.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.756+0000 7fafb77fe640 1 -- 172.21.15.112:0/3359140661 learned_addr learned my addr 172.21.15.112:0/3359140661 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:39.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.757+0000 7fafb77fe640 1 -- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafb81001d0 msgr2=0x7fafb81a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:39.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.757+0000 7fafb77fe640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafb81001d0 0x7fafb81a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:39.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.757+0000 7fafb77fe640 1 -- 172.21.15.112:0/3359140661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb81a2dc0 con 0x7fafb8100b10 2024-09-21T00:56:39.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.758+0000 7fafb77fe640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb8100b10 0x7fafb81a2740 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fafac004270 tx=0x7fafac0042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:39.759 INFO:tasks.workunit.client.1.smithi187.stdout:4/683: chown d2/d3/d56/d84/c70 2884380 1 2024-09-21T00:56:39.759 INFO:tasks.workunit.client.1.smithi187.stdout:5/619: readlink d0/dc/daa/d67/l45 0 2024-09-21T00:56:39.759 INFO:tasks.workunit.client.0.smithi112.stdout:1/87: mknod d5/d8/dd/c18 0 2024-09-21T00:56:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.758+0000 7fafb57fa640 1 -- 172.21.15.112:0/3359140661 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafac040070 con 0x7fafb8100b10 2024-09-21T00:56:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.758+0000 7fafb57fa640 1 -- 172.21.15.112:0/3359140661 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafac0044c0 con 0x7fafb8100b10 2024-09-21T00:56:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.758+0000 7fafb57fa640 1 -- 172.21.15.112:0/3359140661 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafac045460 con 0x7fafb8100b10 2024-09-21T00:56:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.758+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb81a7220 con 0x7fafb8100b10 2024-09-21T00:56:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.759+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb8102600 con 0x7fafb8100b10 2024-09-21T00:56:39.761 INFO:tasks.workunit.client.1.smithi187.stdout:4/684: fdatasync d2/d3/da/d16/fab 0 2024-09-21T00:56:39.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.762+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb8102910 con 0x7fafb8100b10 2024-09-21T00:56:39.764 INFO:tasks.workunit.client.1.smithi187.stdout:6/676: read d7/d2a/d29/d40/d45/f69 [3504535,113906] 0 2024-09-21T00:56:39.764 INFO:tasks.workunit.client.1.smithi187.stdout:4/685: fsync d2/d3/d56/f87 0 2024-09-21T00:56:39.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.764+0000 7fafb57fa640 1 -- 172.21.15.112:0/3359140661 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fafac039040 con 0x7fafb8100b10 2024-09-21T00:56:39.766 INFO:tasks.workunit.client.1.smithi187.stdout:9/853: dread d4/d13/d20/d2b/f7b [0,4194304] 0 2024-09-21T00:56:39.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.765+0000 7fafb57fa640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fafa0074ad0 0x7fafa0076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:39.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.765+0000 7fafb57fa640 1 -- 172.21.15.112:0/3359140661 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fafac0b77b0 con 0x7fafb8100b10 2024-09-21T00:56:39.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.765+0000 7fafb7fff640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fafa0074ad0 0x7fafa0076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:39.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.766+0000 7fafb7fff640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fafa0074ad0 0x7fafa0076f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009a60 tx=0x7fafb0009280 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:39.769 INFO:tasks.workunit.client.0.smithi112.stdout:1/88: unlink f4 0 2024-09-21T00:56:39.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:39.774+0000 7fafb57fa640 1 -- 172.21.15.112:0/3359140661 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fafac082cc0 con 0x7fafb8100b10 2024-09-21T00:56:39.775 INFO:tasks.workunit.client.1.smithi187.stdout:1/743: link d4/d6/fa9 d4/d6/d23/d2e/d94/d35/d79/dce/fef 0 2024-09-21T00:56:39.776 INFO:tasks.workunit.client.0.smithi112.stdout:1/89: mknod d5/d8/dd/c19 0 2024-09-21T00:56:39.776 INFO:tasks.workunit.client.1.smithi187.stdout:1/744: write d4/d6/d23/d2e/d94/dcb/fdc [680786,58998] 0 2024-09-21T00:56:39.779 INFO:tasks.workunit.client.1.smithi187.stdout:8/730: mknod dc/d2f/d54/d69/db3/cf1 0 2024-09-21T00:56:39.782 INFO:tasks.workunit.client.0.smithi112.stdout:1/90: creat d5/d8/d10/f1a x:0 0 0 2024-09-21T00:56:39.784 INFO:tasks.workunit.client.1.smithi187.stdout:8/731: dwrite dc/d2f/d37/fbe [0,4194304] 0 2024-09-21T00:56:39.785 INFO:tasks.workunit.client.1.smithi187.stdout:4/686: unlink d2/d3/d74/db1/l78 0 2024-09-21T00:56:39.787 INFO:tasks.workunit.client.1.smithi187.stdout:6/677: rmdir d7/d2a/d29/d40/d5e/ddc 39 2024-09-21T00:56:39.791 INFO:tasks.workunit.client.1.smithi187.stdout:5/620: rename d0/dc/d1f/d26/f53 to d0/dc/daa/d67/d14/d38/d5a/d6c/fca 0 2024-09-21T00:56:39.792 INFO:tasks.workunit.client.0.smithi112.stdout:1/91: mknod d5/d8/d13/c1b 0 2024-09-21T00:56:39.793 INFO:tasks.workunit.client.1.smithi187.stdout:9/854: dwrite d4/d13/d14/f1e [0,4194304] 0 2024-09-21T00:56:39.796 INFO:tasks.workunit.client.1.smithi187.stdout:4/687: write d2/d3/da/d2f/d32/d25/f2d [1652800,83262] 0 2024-09-21T00:56:39.797 INFO:tasks.workunit.client.0.smithi112.stdout:1/92: creat d5/f1c x:0 0 0 2024-09-21T00:56:39.798 INFO:tasks.workunit.client.1.smithi187.stdout:6/678: fsync d7/d2a/d29/d40/fb1 0 2024-09-21T00:56:39.802 INFO:tasks.workunit.client.1.smithi187.stdout:7/605: dwrite d1/dc/d15/d22/f79 [0,4194304] 0 2024-09-21T00:56:39.803 INFO:tasks.workunit.client.0.smithi112.stdout:1/93: creat d5/d8/d10/f1d x:0 0 0 2024-09-21T00:56:39.803 INFO:tasks.workunit.client.1.smithi187.stdout:7/606: chown d1/dc/d15 8052 1 2024-09-21T00:56:39.804 INFO:tasks.workunit.client.1.smithi187.stdout:1/745: mknod d4/d6/d23/d2e/d94/d66/ddf/cf0 0 2024-09-21T00:56:39.807 INFO:tasks.workunit.client.1.smithi187.stdout:9/855: creat d4/d13/d14/d28/f116 x:0 0 0 2024-09-21T00:56:39.809 INFO:tasks.workunit.client.1.smithi187.stdout:1/746: read d4/d6/fc3 [7527837,92903] 0 2024-09-21T00:56:39.810 INFO:tasks.workunit.client.1.smithi187.stdout:8/732: mkdir dc/df2 0 2024-09-21T00:56:39.814 INFO:tasks.workunit.client.1.smithi187.stdout:6/679: mknod d7/d2a/d29/d40/d50/d68/ce1 0 2024-09-21T00:56:39.814 INFO:tasks.workunit.client.1.smithi187.stdout:6/680: dread - d7/d2a/fd3 zero size 2024-09-21T00:56:39.815 INFO:tasks.workunit.client.0.smithi112.stdout:1/94: link d5/d8/d13/c1b d5/d8/d13/c1e 0 2024-09-21T00:56:39.819 INFO:tasks.workunit.client.1.smithi187.stdout:1/747: symlink d4/d86/lf1 0 2024-09-21T00:56:39.823 INFO:tasks.workunit.client.0.smithi112.stdout:1/95: dwrite d5/d8/d10/f1a [0,4194304] 0 2024-09-21T00:56:39.826 INFO:tasks.workunit.client.0.smithi112.stdout:1/96: read d5/fc [1016273,125857] 0 2024-09-21T00:56:39.831 INFO:tasks.workunit.client.1.smithi187.stdout:7/607: dread d1/d18/d31/d33/d3b/f66 [0,4194304] 0 2024-09-21T00:56:39.833 INFO:tasks.workunit.client.0.smithi112.stdout:1/97: rename d5/d8/d10/f1a to d5/d8/f1f 0 2024-09-21T00:56:39.834 INFO:tasks.workunit.client.1.smithi187.stdout:6/681: write d7/d2a/d29/d40/d5e/ddc/fdd [364071,19287] 0 2024-09-21T00:56:39.835 INFO:tasks.workunit.client.1.smithi187.stdout:6/682: chown d7/d2a/d7a/fb3 7157626 1 2024-09-21T00:56:39.835 INFO:tasks.workunit.client.1.smithi187.stdout:8/733: link dc/d2f/d34/d4b/lab dc/d2f/d80/db8/dba/d3e/de3/lf3 0 2024-09-21T00:56:39.838 INFO:tasks.workunit.client.1.smithi187.stdout:8/734: dread dc/d2f/d80/db8/dba/d29/f4c [0,4194304] 0 2024-09-21T00:56:39.840 INFO:tasks.workunit.client.1.smithi187.stdout:5/621: dwrite d0/dc/daa/d67/d30/f60 [0,4194304] 0 2024-09-21T00:56:39.841 INFO:tasks.workunit.client.0.smithi112.stdout:1/98: dwrite d5/d8/f12 [0,4194304] 0 2024-09-21T00:56:39.841 INFO:tasks.workunit.client.1.smithi187.stdout:5/622: write d0/dc/daa/d67/d14/d38/f5b [4681268,118875] 0 2024-09-21T00:56:39.849 INFO:tasks.workunit.client.0.smithi112.stdout:1/99: rename d5/f1c to d5/d8/d10/f20 0 2024-09-21T00:56:39.850 INFO:tasks.workunit.client.1.smithi187.stdout:4/688: dwrite d2/d3/f36 [0,4194304] 0 2024-09-21T00:56:39.851 INFO:tasks.workunit.client.1.smithi187.stdout:1/748: link d4/c19 d4/d6/cf2 0 2024-09-21T00:56:39.851 INFO:tasks.workunit.client.0.smithi112.stdout:1/100: write d5/d8/d10/f16 [363974,95365] 0 2024-09-21T00:56:39.852 INFO:tasks.workunit.client.0.smithi112.stdout:1/101: dread - d5/d8/d10/f1d zero size 2024-09-21T00:56:39.853 INFO:tasks.workunit.client.1.smithi187.stdout:7/608: mkdir d1/d18/d31/d41/d64/d93/dc1/d73/d8b/d8f/dba/dca 0 2024-09-21T00:56:39.854 INFO:tasks.workunit.client.1.smithi187.stdout:1/749: write d4/d6/d23/d2e/d94/d35/f82 [1431449,3394] 0 2024-09-21T00:56:39.857 INFO:tasks.workunit.client.1.smithi187.stdout:8/735: mknod dc/d2f/d54/cf4 0 2024-09-21T00:56:39.859 INFO:tasks.workunit.client.1.smithi187.stdout:4/689: unlink d2/d3/f42 0 2024-09-21T00:56:39.860 INFO:tasks.workunit.client.1.smithi187.stdout:6/683: dread d7/d2a/d29/d40/f20 [0,4194304] 0 2024-09-21T00:56:39.862 INFO:tasks.workunit.client.1.smithi187.stdout:5/623: link d0/dc/daa/d67/d14/d1b/f24 d0/dc/daa/d67/d14/d38/d5a/d6c/db7/fcb 0 2024-09-21T00:56:39.862 INFO:tasks.workunit.client.1.smithi187.stdout:7/609: dwrite d1/d18/d31/d41/d64/d93/dc1/d7c/d97/f9b [0,4194304] 0 2024-09-21T00:56:39.864 INFO:tasks.workunit.client.1.smithi187.stdout:6/684: write d7/d2a/d29/d40/f4b [388266,101715] 0 2024-09-21T00:56:39.865 INFO:tasks.workunit.client.1.smithi187.stdout:1/750: symlink d4/d6/d23/d2e/d94/d35/d79/lf3 0 2024-09-21T00:56:39.867 INFO:tasks.workunit.client.1.smithi187.stdout:8/736: fdatasync dc/d2f/d54/d69/db3/fca 0 2024-09-21T00:56:39.868 INFO:tasks.workunit.client.1.smithi187.stdout:1/751: read d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [1212030,40453] 0 2024-09-21T00:56:39.870 INFO:tasks.workunit.client.1.smithi187.stdout:8/737: stat dc/d2f/d80/db8/dba/d3e/f53 0 2024-09-21T00:56:39.870 INFO:tasks.workunit.client.1.smithi187.stdout:3/613: sync 2024-09-21T00:56:39.870 INFO:tasks.workunit.client.1.smithi187.stdout:9/856: sync 2024-09-21T00:56:39.870 INFO:tasks.workunit.client.1.smithi187.stdout:4/690: symlink d2/d3/d56/d84/d60/d9e/lce 0 2024-09-21T00:56:39.870 INFO:tasks.workunit.client.1.smithi187.stdout:0/626: sync 2024-09-21T00:56:39.870 INFO:tasks.workunit.client.1.smithi187.stdout:2/729: sync 2024-09-21T00:56:39.871 INFO:tasks.workunit.client.1.smithi187.stdout:1/752: readlink d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/la2 0 2024-09-21T00:56:39.871 INFO:tasks.workunit.client.1.smithi187.stdout:5/624: mkdir d0/dc/daa/d67/dcc 0 2024-09-21T00:56:39.872 INFO:tasks.workunit.client.1.smithi187.stdout:4/691: chown d2/d3/d56/d84/c8f 3 1 2024-09-21T00:56:39.873 INFO:tasks.workunit.client.1.smithi187.stdout:7/610: rename d1/dc/l7b to d1/dc/d15/d2b/lcb 0 2024-09-21T00:56:39.873 INFO:tasks.workunit.client.1.smithi187.stdout:3/614: dread d9/d13/d87/d94/d53/d56/f5d [0,4194304] 0 2024-09-21T00:56:39.874 INFO:tasks.workunit.client.1.smithi187.stdout:5/625: fsync d0/dc/daa/d67/d30/f3c 0 2024-09-21T00:56:39.876 INFO:tasks.workunit.client.1.smithi187.stdout:0/627: unlink d0/d17/d1c/l93 0 2024-09-21T00:56:39.877 INFO:tasks.workunit.client.1.smithi187.stdout:0/628: write d0/d17/d18/d90/fbf [298281,98039] 0 2024-09-21T00:56:39.877 INFO:tasks.workunit.client.1.smithi187.stdout:8/738: creat dc/d2f/d54/d69/de8/ff5 x:0 0 0 2024-09-21T00:56:39.878 INFO:tasks.workunit.client.1.smithi187.stdout:2/730: mknod d2/da8/d3f/c101 0 2024-09-21T00:56:39.883 INFO:tasks.workunit.client.1.smithi187.stdout:7/611: creat d1/d55/fcc x:0 0 0 2024-09-21T00:56:39.884 INFO:tasks.workunit.client.1.smithi187.stdout:3/615: stat d9/f11 0 2024-09-21T00:56:39.884 INFO:tasks.workunit.client.1.smithi187.stdout:4/692: stat d2/d3/da/d2f/d32/d26/d66/d6e/lb4 0 2024-09-21T00:56:39.884 INFO:tasks.workunit.client.1.smithi187.stdout:9/857: mkdir d4/d8/d41/d117 0 2024-09-21T00:56:39.886 INFO:tasks.workunit.client.1.smithi187.stdout:0/629: mkdir d0/d17/d1c/d23/df/d41/d3b/d46/dd8 0 2024-09-21T00:56:39.887 INFO:tasks.workunit.client.1.smithi187.stdout:6/685: link d7/d2a/d7a/f7e d7/d2a/d29/d94/fe2 0 2024-09-21T00:56:39.889 INFO:tasks.workunit.client.1.smithi187.stdout:3/616: dread d9/d13/d87/d94/d53/f99 [0,4194304] 0 2024-09-21T00:56:39.889 INFO:tasks.workunit.client.1.smithi187.stdout:5/626: unlink d0/dc/daa/d67/d14/d38/d5a/f7d 0 2024-09-21T00:56:39.889 INFO:tasks.workunit.client.1.smithi187.stdout:6/686: write d7/d2a/d29/d40/d50/fc9 [400820,128189] 0 2024-09-21T00:56:39.890 INFO:tasks.workunit.client.1.smithi187.stdout:3/617: write d9/d19/d1c/f5b [1916570,68717] 0 2024-09-21T00:56:39.893 INFO:tasks.workunit.client.1.smithi187.stdout:4/693: mkdir d2/d3/da/d2f/d32/d22/d37/dcf 0 2024-09-21T00:56:39.895 INFO:tasks.workunit.client.1.smithi187.stdout:2/731: dread d2/d25/f43 [0,4194304] 0 2024-09-21T00:56:39.945 INFO:tasks.workunit.client.0.smithi112.stdout:3/195: sync 2024-09-21T00:56:39.947 INFO:tasks.workunit.client.0.smithi112.stdout:3/196: mknod d2/d8/d28/c3b 0 2024-09-21T00:56:39.949 INFO:tasks.workunit.client.0.smithi112.stdout:3/197: creat d2/d8/d28/f3c x:0 0 0 2024-09-21T00:56:39.958 INFO:tasks.workunit.client.0.smithi112.stdout:3/198: write d2/d8/dd/de/f1d [590377,61328] 0 2024-09-21T00:56:39.964 INFO:tasks.workunit.client.0.smithi112.stdout:3/199: dwrite d2/d8/dd/de/f1d [0,4194304] 0 2024-09-21T00:56:39.966 INFO:tasks.workunit.client.0.smithi112.stdout:3/200: chown d2/d8/cc 13 1 2024-09-21T00:56:39.971 INFO:tasks.workunit.client.0.smithi112.stdout:3/201: write d2/d8/f11 [2298496,84763] 0 2024-09-21T00:56:39.972 INFO:tasks.workunit.client.0.smithi112.stdout:3/202: stat d2/d8/dd/de/f1d 0 2024-09-21T00:56:39.974 INFO:tasks.workunit.client.0.smithi112.stdout:3/203: fdatasync d2/d8/f22 0 2024-09-21T00:56:39.976 INFO:tasks.workunit.client.0.smithi112.stdout:3/204: symlink d2/d8/d28/l3d 0 2024-09-21T00:56:39.976 INFO:tasks.workunit.client.0.smithi112.stdout:3/205: dread - d2/d8/f22 zero size 2024-09-21T00:56:39.979 INFO:tasks.workunit.client.0.smithi112.stdout:3/206: fdatasync d2/f29 0 2024-09-21T00:56:39.980 INFO:tasks.workunit.client.1.smithi187.stdout:7/612: rename d1/dc/d15/d22/c2c to d1/dc/d15/ccd 0 2024-09-21T00:56:39.981 INFO:tasks.workunit.client.1.smithi187.stdout:2/732: dread - d2/da8/d6c/d97/fec zero size 2024-09-21T00:56:39.982 INFO:tasks.workunit.client.1.smithi187.stdout:4/694: dread d2/d3/f36 [0,4194304] 0 2024-09-21T00:56:39.983 INFO:tasks.workunit.client.1.smithi187.stdout:1/753: dwrite d4/d6/d23/d2e/d94/d35/d4c/f5f [0,4194304] 0 2024-09-21T00:56:39.983 INFO:tasks.workunit.client.1.smithi187.stdout:2/733: fsync d2/da8/d6c/d97/db0/fa9 0 2024-09-21T00:56:39.984 INFO:tasks.workunit.client.1.smithi187.stdout:4/695: stat d2/d3/da/d2f/d32/d22/d37/dc7 0 2024-09-21T00:56:39.985 INFO:tasks.workunit.client.1.smithi187.stdout:0/630: truncate d0/d60/d6b/f8d 346560 0 2024-09-21T00:56:39.987 INFO:tasks.workunit.client.1.smithi187.stdout:9/858: rename d4/d13/d20/d2b/f7b to d4/d10/d43/f118 0 2024-09-21T00:56:39.987 INFO:tasks.workunit.client.1.smithi187.stdout:4/696: dread - d2/d3/d74/d98/fb6 zero size 2024-09-21T00:56:39.988 INFO:tasks.workunit.client.0.smithi112.stdout:3/207: getdents d2 0 2024-09-21T00:56:39.989 INFO:tasks.workunit.client.1.smithi187.stdout:4/697: write d2/d3/d74/db1/fad [592980,7221] 0 2024-09-21T00:56:39.990 INFO:tasks.workunit.client.1.smithi187.stdout:9/859: dread - d4/d13/d20/d2b/d94/dde/fe2 zero size 2024-09-21T00:56:39.991 INFO:tasks.workunit.client.1.smithi187.stdout:7/613: mkdir d1/dce 0 2024-09-21T00:56:39.991 INFO:tasks.workunit.client.0.smithi112.stdout:3/208: mkdir d2/d3e 0 2024-09-21T00:56:39.992 INFO:tasks.workunit.client.0.smithi112.stdout:3/209: dread - d2/d8/dd/f2e zero size 2024-09-21T00:56:39.992 INFO:tasks.workunit.client.1.smithi187.stdout:1/754: dwrite d4/d6/d23/d2e/f3f [0,4194304] 0 2024-09-21T00:56:39.994 INFO:tasks.workunit.client.1.smithi187.stdout:5/627: rename d0/dc/daa/d67/f10 to d0/dc/daa/d67/d14/d38/fcd 0 2024-09-21T00:56:39.994 INFO:tasks.workunit.client.1.smithi187.stdout:2/734: getdents d2/da8/d6c/db8/d94 0 2024-09-21T00:56:39.995 INFO:tasks.workunit.client.1.smithi187.stdout:0/631: symlink d0/dcf/ld9 0 2024-09-21T00:56:39.995 INFO:tasks.workunit.client.0.smithi112.stdout:3/210: mkdir d2/d38/d3f 0 2024-09-21T00:56:39.997 INFO:tasks.workunit.client.1.smithi187.stdout:9/860: symlink d4/d61/d6c/l119 0 2024-09-21T00:56:39.998 INFO:tasks.workunit.client.1.smithi187.stdout:2/735: write d2/da8/d6c/d97/fb7 [560810,21898] 0 2024-09-21T00:56:40.004 INFO:tasks.workunit.client.1.smithi187.stdout:7/614: dread d1/dc/d15/d22/f79 [0,4194304] 0 2024-09-21T00:56:40.007 INFO:tasks.workunit.client.1.smithi187.stdout:9/861: truncate d4/d61/d6c/fd8 3477882 0 2024-09-21T00:56:40.009 INFO:tasks.workunit.client.1.smithi187.stdout:2/736: creat d2/dc/d2e/d4a/d7c/d52/dba/f102 x:0 0 0 2024-09-21T00:56:40.009 INFO:tasks.workunit.client.1.smithi187.stdout:5/628: dwrite d0/dc/daa/d67/f15 [8388608,4194304] 0 2024-09-21T00:56:40.010 INFO:tasks.workunit.client.1.smithi187.stdout:0/632: rename d0/d17/d18/d3a/c48 to d0/d17/d1c/d23/df/d41/d3b/cda 0 2024-09-21T00:56:40.011 INFO:tasks.workunit.client.1.smithi187.stdout:7/615: creat d1/d18/d31/d41/d64/d93/dc1/d7c/d97/fcf x:0 0 0 2024-09-21T00:56:40.012 INFO:tasks.workunit.client.1.smithi187.stdout:7/616: dread - d1/d18/d31/d41/d8a/fb8 zero size 2024-09-21T00:56:40.012 INFO:tasks.workunit.client.1.smithi187.stdout:9/862: creat d4/d13/d14/d1d/f11a x:0 0 0 2024-09-21T00:56:40.014 INFO:tasks.workunit.client.1.smithi187.stdout:5/629: fsync d0/dc/daa/d67/d14/d57/fa8 0 2024-09-21T00:56:40.015 INFO:tasks.workunit.client.1.smithi187.stdout:4/698: dread d2/d3/da/d2f/d32/d22/d37/d51/f81 [0,4194304] 0 2024-09-21T00:56:40.016 INFO:tasks.workunit.client.0.smithi112.stdout:3/211: truncate d2/d8/dd/f1f 1079558 0 2024-09-21T00:56:40.017 INFO:tasks.workunit.client.0.smithi112.stdout:3/212: chown d2/d8/d28/d35 391325 1 2024-09-21T00:56:40.018 INFO:tasks.workunit.client.1.smithi187.stdout:2/737: creat d2/d3/d15/dfe/d2d/d8f/d9f/d8c/f103 x:0 0 0 2024-09-21T00:56:40.018 INFO:tasks.workunit.client.1.smithi187.stdout:2/738: readlink d2/d3/l2f 0 2024-09-21T00:56:40.019 INFO:tasks.workunit.client.1.smithi187.stdout:2/739: stat d2/d3/df 0 2024-09-21T00:56:40.020 INFO:tasks.workunit.client.1.smithi187.stdout:1/755: dread d4/d6/d23/d2e/d53/fc5 [0,4194304] 0 2024-09-21T00:56:40.021 INFO:tasks.workunit.client.0.smithi112.stdout:3/213: mknod d2/c40 0 2024-09-21T00:56:40.021 INFO:tasks.workunit.client.0.smithi112.stdout:3/214: chown d2/l7 7304 1 2024-09-21T00:56:40.022 INFO:tasks.workunit.client.1.smithi187.stdout:1/756: read d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [447732,24544] 0 2024-09-21T00:56:40.024 INFO:tasks.workunit.client.1.smithi187.stdout:7/617: rename d1/d18/d31/d41/d64/d93/dc1/d7c to d1/dce/dd0 0 2024-09-21T00:56:40.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/215: creat d2/d8/d28/f41 x:0 0 0 2024-09-21T00:56:40.026 INFO:tasks.workunit.client.1.smithi187.stdout:9/863: symlink d4/d13/l11b 0 2024-09-21T00:56:40.027 INFO:tasks.workunit.client.1.smithi187.stdout:4/699: creat d2/d3/d74/db1/da2/fd0 x:0 0 0 2024-09-21T00:56:40.027 INFO:tasks.workunit.client.0.smithi112.stdout:3/216: symlink d2/d38/l42 0 2024-09-21T00:56:40.028 INFO:tasks.workunit.client.1.smithi187.stdout:2/740: mkdir d2/da8/d6c/db8/d40/d104 0 2024-09-21T00:56:40.028 INFO:tasks.workunit.client.0.smithi112.stdout:3/217: write d2/d8/d28/f41 [608657,91000] 0 2024-09-21T00:56:40.029 INFO:tasks.workunit.client.1.smithi187.stdout:4/700: write d2/d3/da/d2f/d32/d22/d37/f38 [2878707,88771] 0 2024-09-21T00:56:40.029 INFO:tasks.workunit.client.1.smithi187.stdout:0/633: getdents d0/d5a 0 2024-09-21T00:56:40.029 INFO:tasks.workunit.client.1.smithi187.stdout:5/630: symlink d0/dc/daa/d67/d14/lce 0 2024-09-21T00:56:40.032 INFO:tasks.workunit.client.1.smithi187.stdout:1/757: unlink d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/de4/fe7 0 2024-09-21T00:56:40.032 INFO:tasks.workunit.client.0.smithi112.stdout:3/218: creat d2/d38/d3f/f43 x:0 0 0 2024-09-21T00:56:40.033 INFO:tasks.workunit.client.1.smithi187.stdout:9/864: dwrite d4/d13/d14/d1d/f8d [0,4194304] 0 2024-09-21T00:56:40.034 INFO:tasks.workunit.client.1.smithi187.stdout:7/618: mkdir d1/d18/d31/d41/dd1 0 2024-09-21T00:56:40.035 INFO:tasks.workunit.client.1.smithi187.stdout:1/758: write d4/d6/d23/f45 [4799014,36274] 0 2024-09-21T00:56:40.039 INFO:tasks.workunit.client.1.smithi187.stdout:7/619: dread - d1/dc/fb2 zero size 2024-09-21T00:56:40.043 INFO:tasks.workunit.client.0.smithi112.stdout:3/219: dread d2/d8/dd/f1f [0,4194304] 0 2024-09-21T00:56:40.043 INFO:tasks.workunit.client.1.smithi187.stdout:2/741: dwrite d2/dc/d21/fd1 [0,4194304] 0 2024-09-21T00:56:40.046 INFO:tasks.workunit.client.1.smithi187.stdout:5/631: dread d0/dc/daa/d67/d14/d38/f5b [0,4194304] 0 2024-09-21T00:56:40.047 INFO:tasks.workunit.client.1.smithi187.stdout:7/620: creat d1/d18/d31/d33/d3b/d9f/fd2 x:0 0 0 2024-09-21T00:56:40.049 INFO:tasks.workunit.client.1.smithi187.stdout:7/621: stat d1/d18/c40 0 2024-09-21T00:56:40.049 INFO:tasks.workunit.client.1.smithi187.stdout:1/759: rename d4/d6/d23/d2e/d94/d35/d22/f57 to d4/d6/d23/d2e/d94/ff4 0 2024-09-21T00:56:40.051 INFO:tasks.workunit.client.0.smithi112.stdout:3/220: creat d2/d38/f44 x:0 0 0 2024-09-21T00:56:40.052 INFO:tasks.workunit.client.1.smithi187.stdout:8/739: sync 2024-09-21T00:56:40.055 INFO:tasks.workunit.client.1.smithi187.stdout:4/701: dread d2/d3/da/d48/f6d [0,4194304] 0 2024-09-21T00:56:40.055 INFO:tasks.workunit.client.1.smithi187.stdout:5/632: dwrite d0/dc/daa/d67/f15 [4194304,4194304] 0 2024-09-21T00:56:40.062 INFO:tasks.workunit.client.1.smithi187.stdout:8/740: mkdir dc/d94/df6 0 2024-09-21T00:56:40.064 INFO:tasks.workunit.client.1.smithi187.stdout:5/633: dwrite d0/dc/daa/d67/d14/d38/d5a/fc5 [0,4194304] 0 2024-09-21T00:56:40.065 INFO:tasks.workunit.client.1.smithi187.stdout:1/760: rename d4/d6/d23/d2e/d53/fbd to d4/d6/d23/d2e/d94/d35/d22/d65/d90/ff5 0 2024-09-21T00:56:40.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.067+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fafb8109940 con 0x7fafa0074ad0 2024-09-21T00:56:40.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.069+0000 7fafb57fa640 1 -- 172.21.15.112:0/3359140661 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fafb8109940 con 0x7fafa0074ad0 2024-09-21T00:56:40.070 INFO:tasks.workunit.client.1.smithi187.stdout:7/622: dread d1/d18/d31/d41/f6a [0,4194304] 0 2024-09-21T00:56:40.071 INFO:tasks.workunit.client.1.smithi187.stdout:0/634: truncate d0/d17/d1c/f7a 3832932 0 2024-09-21T00:56:40.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.071+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fafa0074ad0 msgr2=0x7fafa0076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.071+0000 7fafbe600640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fafa0074ad0 0x7fafa0076f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009a60 tx=0x7fafb0009280 comp rx=0 tx=0).stop 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.071+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb8100b10 msgr2=0x7fafb81a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.071+0000 7fafbe600640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb8100b10 0x7fafb81a2740 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fafac004270 tx=0x7fafac0042a0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.072+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 shutdown_connections 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.072+0000 7fafbe600640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fafa0074ad0 0x7fafa0076f90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.072+0000 7fafbe600640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb8100b10 0x7fafb81a2740 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.072+0000 7fafbe600640 1 --2- 172.21.15.112:0/3359140661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafb81001d0 0x7fafb81a2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.072+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 >> 172.21.15.112:0/3359140661 conn(0x7fafb80fbfc0 msgr2=0x7fafb80fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.072+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 shutdown_connections 2024-09-21T00:56:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.072+0000 7fafbe600640 1 -- 172.21.15.112:0/3359140661 wait complete. 2024-09-21T00:56:40.074 INFO:tasks.workunit.client.1.smithi187.stdout:5/634: symlink d0/dc/daa/d67/d14/d38/lcf 0 2024-09-21T00:56:40.074 INFO:tasks.workunit.client.1.smithi187.stdout:1/761: dwrite d4/d6/d23/d2e/d53/f7f [0,4194304] 0 2024-09-21T00:56:40.074 INFO:tasks.workunit.client.1.smithi187.stdout:1/762: chown d4/d6/d23/d2e/d94/dae 9 1 2024-09-21T00:56:40.074 INFO:tasks.workunit.client.1.smithi187.stdout:4/702: creat d2/d3/da/d2f/d32/d24/dcd/db3/fd1 x:0 0 0 2024-09-21T00:56:40.077 INFO:tasks.workunit.client.1.smithi187.stdout:7/623: mknod d1/d18/d31/d33/cd3 0 2024-09-21T00:56:40.081 INFO:tasks.workunit.client.1.smithi187.stdout:7/624: write d1/dc/d15/d22/f5e [2135736,35819] 0 2024-09-21T00:56:40.083 INFO:tasks.workunit.client.1.smithi187.stdout:4/703: symlink d2/d3/d56/d84/ld2 0 2024-09-21T00:56:40.085 INFO:tasks.workunit.client.0.smithi112.stdout:3/221: dwrite d2/d8/dd/de/f18 [0,4194304] 0 2024-09-21T00:56:40.085 INFO:tasks.workunit.client.1.smithi187.stdout:8/741: creat dc/d44/ff7 x:0 0 0 2024-09-21T00:56:40.085 INFO:tasks.workunit.client.1.smithi187.stdout:9/865: dwrite d4/d13/d14/d5d/fa2 [0,4194304] 0 2024-09-21T00:56:40.086 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:56:40.087 INFO:tasks.workunit.client.1.smithi187.stdout:5/635: creat d0/dc/daa/d67/d30/d6b/fd0 x:0 0 0 2024-09-21T00:56:40.089 INFO:tasks.workunit.client.1.smithi187.stdout:7/625: mkdir d1/dce/dd4 0 2024-09-21T00:56:40.090 INFO:tasks.workunit.client.1.smithi187.stdout:2/742: dwrite d2/d25/f68 [0,4194304] 0 2024-09-21T00:56:40.092 INFO:tasks.workunit.client.1.smithi187.stdout:0/635: dwrite d0/d17/d18/fc8 [0,4194304] 0 2024-09-21T00:56:40.095 INFO:tasks.workunit.client.0.smithi112.stdout:3/222: mknod d2/d33/c45 0 2024-09-21T00:56:40.100 INFO:tasks.workunit.client.1.smithi187.stdout:8/742: creat dc/d2f/d54/d69/de8/ff8 x:0 0 0 2024-09-21T00:56:40.100 INFO:tasks.workunit.client.1.smithi187.stdout:2/743: mknod d2/dc/d21/c105 0 2024-09-21T00:56:40.100 INFO:tasks.workunit.client.1.smithi187.stdout:1/763: write d4/d6/fa9 [4396182,83111] 0 2024-09-21T00:56:40.102 INFO:tasks.workunit.client.1.smithi187.stdout:1/764: chown d4/d6/d23/d2e/d94/d35/d22/d65/f6d 276830618 1 2024-09-21T00:56:40.103 INFO:tasks.workunit.client.1.smithi187.stdout:3/618: sync 2024-09-21T00:56:40.103 INFO:tasks.workunit.client.1.smithi187.stdout:6/687: sync 2024-09-21T00:56:40.104 INFO:tasks.workunit.client.1.smithi187.stdout:1/765: chown d4/d6/d23/d2e/d94/d6c/l63 8230 1 2024-09-21T00:56:40.105 INFO:tasks.workunit.client.0.smithi112.stdout:3/223: dwrite d2/d8/d28/f41 [0,4194304] 0 2024-09-21T00:56:40.105 INFO:tasks.workunit.client.1.smithi187.stdout:5/636: creat d0/dc/d1f/d26/d8b/fd1 x:0 0 0 2024-09-21T00:56:40.107 INFO:tasks.workunit.client.0.smithi112.stdout:3/224: truncate d2/d8/dd/de/f1d 5048719 0 2024-09-21T00:56:40.107 INFO:tasks.workunit.client.1.smithi187.stdout:5/637: stat d0/dc/daa/d67/d30/f3b 0 2024-09-21T00:56:40.109 INFO:tasks.workunit.client.1.smithi187.stdout:5/638: readlink d0/dc/daa/d67/d14/d1b/d27/d3a/l54 0 2024-09-21T00:56:40.110 INFO:tasks.workunit.client.1.smithi187.stdout:6/688: dwrite d7/d2a/d29/d40/d5e/ddc/fdd [0,4194304] 0 2024-09-21T00:56:40.112 INFO:tasks.workunit.client.1.smithi187.stdout:6/689: dread - d7/d2a/d29/d40/fb9 zero size 2024-09-21T00:56:40.113 INFO:tasks.workunit.client.1.smithi187.stdout:6/690: chown d7/f5f 26 1 2024-09-21T00:56:40.114 INFO:tasks.workunit.client.1.smithi187.stdout:2/744: rename d2/dc/d2e/d4a/d7c/d52/fbe to d2/dc/f106 0 2024-09-21T00:56:40.115 INFO:tasks.workunit.client.0.smithi112.stdout:3/225: creat d2/d8/d28/d35/f46 x:0 0 0 2024-09-21T00:56:40.115 INFO:tasks.workunit.client.1.smithi187.stdout:7/626: getdents d1/d18/d31/d41/dbe 0 2024-09-21T00:56:40.116 INFO:tasks.workunit.client.0.smithi112.stdout:3/226: chown d2/d8/f22 514818 1 2024-09-21T00:56:40.116 INFO:tasks.workunit.client.1.smithi187.stdout:8/743: truncate dc/d2f/d80/db8/dba/d3e/d75/f8b 1559195 0 2024-09-21T00:56:40.117 INFO:tasks.workunit.client.1.smithi187.stdout:0/636: fsync d0/d17/f83 0 2024-09-21T00:56:40.118 INFO:tasks.workunit.client.1.smithi187.stdout:7/627: chown d1/d55/fcc 396292526 1 2024-09-21T00:56:40.119 INFO:tasks.workunit.client.0.smithi112.stdout:3/227: rmdir d2/d38 39 2024-09-21T00:56:40.119 INFO:tasks.workunit.client.1.smithi187.stdout:4/704: link d2/d3/da/d2f/d4b/d7e/dc8/d89/cca d2/d3/d74/d98/dc2/cd3 0 2024-09-21T00:56:40.119 INFO:tasks.workunit.client.0.smithi112.stdout:3/228: chown d2/d8/l24 90822 1 2024-09-21T00:56:40.120 INFO:tasks.workunit.client.1.smithi187.stdout:5/639: rmdir d0/dc/daa/d67/d30/d68 39 2024-09-21T00:56:40.120 INFO:tasks.workunit.client.0.smithi112.stdout:3/229: chown d2/c1a 2892 1 2024-09-21T00:56:40.122 INFO:tasks.workunit.client.1.smithi187.stdout:6/691: creat d7/d59/fe3 x:0 0 0 2024-09-21T00:56:40.122 INFO:tasks.workunit.client.0.smithi112.stdout:3/230: rmdir d2/d8 39 2024-09-21T00:56:40.123 INFO:tasks.workunit.client.1.smithi187.stdout:3/619: dread d9/d7f/fa9 [0,4194304] 0 2024-09-21T00:56:40.124 INFO:tasks.workunit.client.1.smithi187.stdout:2/745: mkdir d2/d3/d15/dfe/d2d/d8f/d9f/d8c/d107 0 2024-09-21T00:56:40.124 INFO:tasks.workunit.client.1.smithi187.stdout:8/744: creat dc/dea/ff9 x:0 0 0 2024-09-21T00:56:40.125 INFO:tasks.workunit.client.0.smithi112.stdout:3/231: creat d2/d3e/f47 x:0 0 0 2024-09-21T00:56:40.126 INFO:tasks.workunit.client.1.smithi187.stdout:3/620: truncate d9/d13/d87/d94/d53/d75/fac 479295 0 2024-09-21T00:56:40.126 INFO:tasks.workunit.client.1.smithi187.stdout:0/637: mknod d0/dcf/cdb 0 2024-09-21T00:56:40.127 INFO:tasks.workunit.client.1.smithi187.stdout:4/705: creat d2/d3/da/d2f/d32/d22/d37/fd4 x:0 0 0 2024-09-21T00:56:40.128 INFO:tasks.workunit.client.1.smithi187.stdout:4/706: dread - d2/d3/d74/db1/fbf zero size 2024-09-21T00:56:40.128 INFO:tasks.workunit.client.1.smithi187.stdout:7/628: mkdir d1/d18/d31/d41/d8a/dd5 0 2024-09-21T00:56:40.130 INFO:tasks.workunit.client.1.smithi187.stdout:0/638: read d0/d17/d1c/d23/df/d41/d3b/f54 [738024,109780] 0 2024-09-21T00:56:40.130 INFO:tasks.workunit.client.1.smithi187.stdout:2/746: mknod d2/dc/d2e/d4a/c108 0 2024-09-21T00:56:40.130 INFO:tasks.workunit.client.1.smithi187.stdout:2/747: chown d2/da8/d3f/l5f 876 1 2024-09-21T00:56:40.131 INFO:tasks.workunit.client.0.smithi112.stdout:3/232: unlink d2/d8/c19 0 2024-09-21T00:56:40.131 INFO:tasks.workunit.client.1.smithi187.stdout:8/745: rmdir dc/d2f/d80/db8/dba/d3e/d75 39 2024-09-21T00:56:40.134 INFO:tasks.workunit.client.0.smithi112.stdout:3/233: mknod d2/c48 0 2024-09-21T00:56:40.135 INFO:tasks.workunit.client.1.smithi187.stdout:6/692: mkdir d7/d2a/d29/de4 0 2024-09-21T00:56:40.136 INFO:tasks.workunit.client.1.smithi187.stdout:7/629: symlink d1/d55/d80/d87/ld6 0 2024-09-21T00:56:40.139 INFO:tasks.workunit.client.1.smithi187.stdout:0/639: unlink d0/d17/d18/f2c 0 2024-09-21T00:56:40.140 INFO:tasks.workunit.client.1.smithi187.stdout:9/866: write d4/d10/fdc [4729139,5411] 0 2024-09-21T00:56:40.140 INFO:tasks.workunit.client.0.smithi112.stdout:3/234: creat d2/d38/d3f/f49 x:0 0 0 2024-09-21T00:56:40.141 INFO:tasks.workunit.client.1.smithi187.stdout:2/748: symlink d2/d25/l109 0 2024-09-21T00:56:40.143 INFO:tasks.workunit.client.0.smithi112.stdout:3/235: mkdir d2/d8/dd/de/d4a 0 2024-09-21T00:56:40.144 INFO:tasks.workunit.client.1.smithi187.stdout:2/749: write d2/dc/d2e/d4a/d7c/d52/da3/fd5 [666799,115086] 0 2024-09-21T00:56:40.144 INFO:tasks.workunit.client.0.smithi112.stdout:3/236: dread - d2/d8/dd/f2e zero size 2024-09-21T00:56:40.147 INFO:tasks.workunit.client.1.smithi187.stdout:5/640: creat d0/dc/daa/d67/d30/fd2 x:0 0 0 2024-09-21T00:56:40.147 INFO:tasks.workunit.client.1.smithi187.stdout:2/750: dread d2/da8/d6c/d97/fb7 [0,4194304] 0 2024-09-21T00:56:40.147 INFO:tasks.workunit.client.1.smithi187.stdout:6/693: mkdir d7/d2a/d29/d40/d50/d83/de5 0 2024-09-21T00:56:40.148 INFO:tasks.workunit.client.1.smithi187.stdout:5/641: fdatasync d0/dc/daa/d67/d14/d38/d5a/fbc 0 2024-09-21T00:56:40.149 INFO:tasks.workunit.client.1.smithi187.stdout:5/642: chown d0/dc/daa/d67/d14/d38/f5b 203821147 1 2024-09-21T00:56:40.149 INFO:tasks.workunit.client.0.smithi112.stdout:3/237: creat d2/d38/f4b x:0 0 0 2024-09-21T00:56:40.150 INFO:tasks.workunit.client.0.smithi112.stdout:3/238: chown d2/d33/c45 408680662 1 2024-09-21T00:56:40.150 INFO:tasks.workunit.client.1.smithi187.stdout:7/630: write d1/d18/fb4 [429225,57146] 0 2024-09-21T00:56:40.151 INFO:tasks.workunit.client.0.smithi112.stdout:3/239: write d2/d3e/f47 [69493,70160] 0 2024-09-21T00:56:40.151 INFO:tasks.workunit.client.1.smithi187.stdout:0/640: symlink d0/d17/d1c/ldc 0 2024-09-21T00:56:40.151 INFO:tasks.workunit.client.0.smithi112.stdout:0/77: sync 2024-09-21T00:56:40.152 INFO:tasks.workunit.client.1.smithi187.stdout:7/631: readlink d1/d18/d31/d33/d3b/d9f/d5d/l60 0 2024-09-21T00:56:40.152 INFO:tasks.workunit.client.1.smithi187.stdout:0/641: dread - d0/d17/d1c/d65/fb6 zero size 2024-09-21T00:56:40.152 INFO:tasks.workunit.client.1.smithi187.stdout:8/746: mknod dc/cfa 0 2024-09-21T00:56:40.153 INFO:tasks.workunit.client.1.smithi187.stdout:4/707: dread d2/d3/da/d2f/d4b/d7e/dc8/f54 [0,4194304] 0 2024-09-21T00:56:40.154 INFO:tasks.workunit.client.1.smithi187.stdout:0/642: write d0/d60/d6e/f74 [1064811,117127] 0 2024-09-21T00:56:40.155 INFO:tasks.workunit.client.1.smithi187.stdout:9/867: rename d4/d8/d44 to d4/d10/d43/d11c 0 2024-09-21T00:56:40.156 INFO:tasks.workunit.client.1.smithi187.stdout:9/868: fsync d4/d13/d14/d1d/d5f/fc6 0 2024-09-21T00:56:40.157 INFO:tasks.workunit.client.0.smithi112.stdout:0/78: creat d8/f19 x:0 0 0 2024-09-21T00:56:40.160 INFO:tasks.workunit.client.0.smithi112.stdout:3/240: dwrite d2/d8/dd/f2e [0,4194304] 0 2024-09-21T00:56:40.164 INFO:tasks.workunit.client.0.smithi112.stdout:0/79: creat d8/d11/f1a x:0 0 0 2024-09-21T00:56:40.166 INFO:tasks.workunit.client.1.smithi187.stdout:4/708: dread d2/d3/da/d2f/d32/d24/f2e [0,4194304] 0 2024-09-21T00:56:40.166 INFO:tasks.workunit.client.0.smithi112.stdout:0/80: read d8/fb [2379588,57489] 0 2024-09-21T00:56:40.167 INFO:tasks.workunit.client.0.smithi112.stdout:0/81: readlink l6 0 2024-09-21T00:56:40.167 INFO:tasks.workunit.client.1.smithi187.stdout:2/751: mkdir d2/dc/d2e/d51/dc5/ddf/d10a 0 2024-09-21T00:56:40.167 INFO:tasks.workunit.client.1.smithi187.stdout:0/643: dread d0/d17/d1c/d23/d36/f5c [0,4194304] 0 2024-09-21T00:56:40.169 INFO:tasks.workunit.client.1.smithi187.stdout:0/644: chown d0/d17/d1c/d23/df/d41/d3b/fb2 5718 1 2024-09-21T00:56:40.169 INFO:tasks.workunit.client.0.smithi112.stdout:3/241: dwrite d2/d38/f44 [0,4194304] 0 2024-09-21T00:56:40.177 INFO:tasks.workunit.client.1.smithi187.stdout:8/747: mkdir dc/d94/dfb 0 2024-09-21T00:56:40.188 INFO:tasks.workunit.client.1.smithi187.stdout:9/869: mkdir d4/d61/d6a/d90/d11d 0 2024-09-21T00:56:40.189 INFO:tasks.workunit.client.1.smithi187.stdout:9/870: read - d4/d13/d20/d2e/fbb zero size 2024-09-21T00:56:40.189 INFO:tasks.workunit.client.1.smithi187.stdout:3/621: truncate d9/f37 845958 0 2024-09-21T00:56:40.191 INFO:tasks.workunit.client.0.smithi112.stdout:3/242: mkdir d2/d8/dd/de/d4a/d4c 0 2024-09-21T00:56:40.192 INFO:tasks.workunit.client.1.smithi187.stdout:4/709: creat d2/d3/da/d2f/d4b/d7e/dc8/fd5 x:0 0 0 2024-09-21T00:56:40.193 INFO:tasks.workunit.client.0.smithi112.stdout:0/82: rmdir d8/d14 0 2024-09-21T00:56:40.195 INFO:tasks.workunit.client.1.smithi187.stdout:2/752: rename d2/da8/d3f/c101 to d2/dc/d2e/de1/de3/c10b 0 2024-09-21T00:56:40.196 INFO:tasks.workunit.client.1.smithi187.stdout:2/753: write d2/d25/f68 [2739391,118347] 0 2024-09-21T00:56:40.197 INFO:tasks.workunit.client.1.smithi187.stdout:2/754: chown d2/d3/d15/dfe/fbd 184 1 2024-09-21T00:56:40.199 INFO:tasks.workunit.client.0.smithi112.stdout:0/83: mkdir d8/d1b 0 2024-09-21T00:56:40.199 INFO:tasks.workunit.client.0.smithi112.stdout:0/84: dread - d8/f19 zero size 2024-09-21T00:56:40.201 INFO:tasks.workunit.client.1.smithi187.stdout:5/643: mknod d0/dc/daa/d67/d14/d57/d5c/dc9/cd3 0 2024-09-21T00:56:40.204 INFO:tasks.workunit.client.0.smithi112.stdout:0/85: creat d8/d11/f1c x:0 0 0 2024-09-21T00:56:40.205 INFO:tasks.workunit.client.1.smithi187.stdout:3/622: dread d9/d19/d1c/f2a [0,4194304] 0 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.205+0000 7f30ae153640 1 -- 172.21.15.112:0/3939532198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 msgr2=0x7f30a8101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.205+0000 7f30ae153640 1 --2- 172.21.15.112:0/3939532198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 0x7f30a8101ec0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f309c009880 tx=0x7f309c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.206+0000 7f30ae153640 1 -- 172.21.15.112:0/3939532198 shutdown_connections 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.206+0000 7f30ae153640 1 --2- 172.21.15.112:0/3939532198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 0x7f30a8101ec0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.206+0000 7f30ae153640 1 --2- 172.21.15.112:0/3939532198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 0x7f30a8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.206+0000 7f30ae153640 1 -- 172.21.15.112:0/3939532198 >> 172.21.15.112:0/3939532198 conn(0x7f30a80fbff0 msgr2=0x7f30a80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.206+0000 7f30ae153640 1 -- 172.21.15.112:0/3939532198 shutdown_connections 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.206+0000 7f30ae153640 1 -- 172.21.15.112:0/3939532198 wait complete. 2024-09-21T00:56:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.207+0000 7f30ae153640 1 Processor -- start 2024-09-21T00:56:40.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.207+0000 7f30ae153640 1 -- start start 2024-09-21T00:56:40.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30ae153640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 0x7f30a8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:40.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30ae153640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 0x7f30a8199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:40.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30ae153640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8109700 con 0x7f30a8101a40 2024-09-21T00:56:40.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30ae153640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8109580 con 0x7f30a8100840 2024-09-21T00:56:40.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 0x7f30a8199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:40.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 0x7f30a8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:40.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 0x7f30a8199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:41606/0 (socket says 172.21.15.112:41606) 2024-09-21T00:56:40.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 0x7f30a8199cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33602/0 (socket says 172.21.15.112:33602) 2024-09-21T00:56:40.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a77fe640 1 -- 172.21.15.112:0/3355685747 learned_addr learned my addr 172.21.15.112:0/3355685747 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a77fe640 1 -- 172.21.15.112:0/3355685747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 msgr2=0x7f30a8199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a77fe640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 0x7f30a8199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.208+0000 7f30a77fe640 1 -- 172.21.15.112:0/3355685747 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a819a330 con 0x7f30a8100840 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.209+0000 7f30a77fe640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 0x7f30a8199770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f309800b3d0 tx=0x7f309800b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.209+0000 7f30a4ff9640 1 -- 172.21.15.112:0/3355685747 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3098015020 con 0x7f30a8100840 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.209+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a819ed70 con 0x7f30a8100840 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.209+0000 7f30a4ff9640 1 -- 172.21.15.112:0/3355685747 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3098011af0 con 0x7f30a8100840 2024-09-21T00:56:40.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.209+0000 7f30a4ff9640 1 -- 172.21.15.112:0/3355685747 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3098010da0 con 0x7f30a8100840 2024-09-21T00:56:40.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.209+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a819f290 con 0x7f30a8100840 2024-09-21T00:56:40.211 INFO:tasks.workunit.client.0.smithi112.stdout:8/79: sync 2024-09-21T00:56:40.211 INFO:tasks.workunit.client.0.smithi112.stdout:5/67: sync 2024-09-21T00:56:40.211 INFO:tasks.workunit.client.0.smithi112.stdout:0/86: symlink d8/l1d 0 2024-09-21T00:56:40.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.210+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8100c40 con 0x7f30a8100840 2024-09-21T00:56:40.211 INFO:tasks.workunit.client.0.smithi112.stdout:0/87: write d8/fe [3306481,46115] 0 2024-09-21T00:56:40.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.211+0000 7f30a4ff9640 1 -- 172.21.15.112:0/3355685747 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f3098018020 con 0x7f30a8100840 2024-09-21T00:56:40.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.212+0000 7f30a4ff9640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3090074a80 0x7f3090076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:40.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.212+0000 7f30a4ff9640 1 -- 172.21.15.112:0/3355685747 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7f3098095d40 con 0x7f30a8100840 2024-09-21T00:56:40.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.212+0000 7f30a6ffd640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3090074a80 0x7f3090076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:40.213 INFO:tasks.workunit.client.0.smithi112.stdout:3/243: mknod d2/d8/d28/d35/c4d 0 2024-09-21T00:56:40.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.213+0000 7f30a6ffd640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3090074a80 0x7f3090076f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f309c000c00 tx=0x7f309c0058d0 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:40.214 INFO:tasks.workunit.client.1.smithi187.stdout:9/871: symlink d4/d13/d20/d2b/d108/l11e 0 2024-09-21T00:56:40.216 INFO:tasks.workunit.client.1.smithi187.stdout:4/710: creat d2/d3/da/d2f/d32/d26/d66/d6e/fd6 x:0 0 0 2024-09-21T00:56:40.217 INFO:tasks.workunit.client.0.smithi112.stdout:8/80: mkdir d0/d13/d1b 0 2024-09-21T00:56:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.217+0000 7f30a4ff9640 1 -- 172.21.15.112:0/3355685747 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f309801f020 con 0x7f30a8100840 2024-09-21T00:56:40.218 INFO:tasks.workunit.client.0.smithi112.stdout:8/81: read d0/f10 [4769039,91516] 0 2024-09-21T00:56:40.219 INFO:tasks.workunit.client.0.smithi112.stdout:8/82: dread - d0/d13/f19 zero size 2024-09-21T00:56:40.220 INFO:tasks.workunit.client.0.smithi112.stdout:3/244: mknod d2/d8/d28/d35/c4e 0 2024-09-21T00:56:40.221 INFO:tasks.workunit.client.0.smithi112.stdout:3/245: readlink d2/d8/dd/de/l14 0 2024-09-21T00:56:40.222 INFO:tasks.workunit.client.0.smithi112.stdout:0/88: fdatasync d8/fd 0 2024-09-21T00:56:40.223 INFO:tasks.workunit.client.0.smithi112.stdout:0/89: fsync d8/d11/f1c 0 2024-09-21T00:56:40.224 INFO:tasks.workunit.client.0.smithi112.stdout:0/90: dread - d8/d11/f1a zero size 2024-09-21T00:56:40.225 INFO:tasks.workunit.client.1.smithi187.stdout:2/755: unlink d2/da8/fb2 0 2024-09-21T00:56:40.225 INFO:tasks.workunit.client.0.smithi112.stdout:0/91: dread - d8/d11/f1c zero size 2024-09-21T00:56:40.225 INFO:tasks.workunit.client.0.smithi112.stdout:8/83: dread d0/d13/f16 [0,4194304] 0 2024-09-21T00:56:40.226 INFO:tasks.workunit.client.1.smithi187.stdout:2/756: write d2/d3/d15/dfe/d2d/d8f/d9f/d8c/f103 [379741,34596] 0 2024-09-21T00:56:40.226 INFO:tasks.workunit.client.0.smithi112.stdout:8/84: stat d0/l5 0 2024-09-21T00:56:40.227 INFO:tasks.workunit.client.1.smithi187.stdout:2/757: chown d2/d3/d15/dfe/d2d/d8f/d9f/c7f 2 1 2024-09-21T00:56:40.227 INFO:tasks.workunit.client.1.smithi187.stdout:2/758: fdatasync d2/dc/f65 0 2024-09-21T00:56:40.228 INFO:tasks.workunit.client.1.smithi187.stdout:6/694: creat d7/d2a/d29/d40/d5e/fe6 x:0 0 0 2024-09-21T00:56:40.231 INFO:tasks.workunit.client.1.smithi187.stdout:5/644: mknod d0/dc/daa/d67/d14/d38/d5a/d6c/cd4 0 2024-09-21T00:56:40.232 INFO:tasks.workunit.client.1.smithi187.stdout:7/632: rmdir d1/d18/d31/d41/d64/d93/dc1/d73/d8b/d8f/dba/dca 0 2024-09-21T00:56:40.233 INFO:tasks.workunit.client.0.smithi112.stdout:0/92: dread d8/d11/f13 [0,4194304] 0 2024-09-21T00:56:40.233 INFO:tasks.workunit.client.0.smithi112.stdout:8/85: write d0/f10 [5600356,41523] 0 2024-09-21T00:56:40.234 INFO:tasks.workunit.client.1.smithi187.stdout:4/711: mknod d2/d3/da/d16/d5f/cd7 0 2024-09-21T00:56:40.234 INFO:tasks.workunit.client.0.smithi112.stdout:0/93: dread - d8/f17 zero size 2024-09-21T00:56:40.235 INFO:tasks.workunit.client.0.smithi112.stdout:8/86: write d0/f3 [265064,63689] 0 2024-09-21T00:56:40.236 INFO:tasks.workunit.client.1.smithi187.stdout:0/645: mkdir d0/d17/d18/d90/d98/ddd 0 2024-09-21T00:56:40.238 INFO:tasks.workunit.client.1.smithi187.stdout:6/695: creat d7/d2a/d29/d40/d6a/dbc/fe7 x:0 0 0 2024-09-21T00:56:40.240 INFO:tasks.workunit.client.1.smithi187.stdout:2/759: mknod d2/d3/d15/dfe/d2d/d8f/c10c 0 2024-09-21T00:56:40.241 INFO:tasks.workunit.client.1.smithi187.stdout:8/748: creat dc/d44/ffc x:0 0 0 2024-09-21T00:56:40.241 INFO:tasks.workunit.client.1.smithi187.stdout:0/646: dwrite d0/d17/d1c/d23/df/fce [0,4194304] 0 2024-09-21T00:56:40.242 INFO:tasks.workunit.client.1.smithi187.stdout:8/749: stat dc/d2f/d54/cf4 0 2024-09-21T00:56:40.244 INFO:tasks.workunit.client.1.smithi187.stdout:0/647: truncate d0/d17/d1c/d23/df/d41/f8e 1467086 0 2024-09-21T00:56:40.244 INFO:tasks.workunit.client.1.smithi187.stdout:3/623: rename d9/d13/d87/d94/d89/dc1/cc4 to d9/d19/d43/cc7 0 2024-09-21T00:56:40.245 INFO:tasks.workunit.client.1.smithi187.stdout:1/766: sync 2024-09-21T00:56:40.247 INFO:tasks.workunit.client.0.smithi112.stdout:8/87: mknod d0/d13/d1b/c1c 0 2024-09-21T00:56:40.247 INFO:tasks.workunit.client.0.smithi112.stdout:8/88: stat d0 0 2024-09-21T00:56:40.248 INFO:tasks.workunit.client.1.smithi187.stdout:8/750: dwrite dc/d2f/fc8 [0,4194304] 0 2024-09-21T00:56:40.248 INFO:tasks.workunit.client.1.smithi187.stdout:7/633: mkdir d1/d55/dd7 0 2024-09-21T00:56:40.249 INFO:tasks.workunit.client.1.smithi187.stdout:8/751: chown dc/d2f/d80/db8/dba/d3e/la2 315 1 2024-09-21T00:56:40.250 INFO:tasks.workunit.client.1.smithi187.stdout:7/634: write d1/d18/d31/d41/d64/d93/fa4 [3824842,38168] 0 2024-09-21T00:56:40.251 INFO:tasks.workunit.client.0.smithi112.stdout:3/246: link d2/l32 d2/d33/l4f 0 2024-09-21T00:56:40.253 INFO:tasks.workunit.client.0.smithi112.stdout:8/89: creat d0/f1d x:0 0 0 2024-09-21T00:56:40.254 INFO:tasks.workunit.client.0.smithi112.stdout:8/90: read - d0/d13/f19 zero size 2024-09-21T00:56:40.256 INFO:tasks.workunit.client.0.smithi112.stdout:3/247: mknod d2/d8/dd/de/c50 0 2024-09-21T00:56:40.257 INFO:tasks.workunit.client.1.smithi187.stdout:6/696: mknod d7/d2a/d7a/ce8 0 2024-09-21T00:56:40.260 INFO:tasks.workunit.client.0.smithi112.stdout:3/248: dread - d2/d38/d3f/f43 zero size 2024-09-21T00:56:40.260 INFO:tasks.workunit.client.1.smithi187.stdout:4/712: rename d2/l9 to d2/d3/d56/d84/d60/d9e/ld8 0 2024-09-21T00:56:40.261 INFO:tasks.workunit.client.1.smithi187.stdout:0/648: mknod d0/d17/d1c/cde 0 2024-09-21T00:56:40.262 INFO:tasks.workunit.client.1.smithi187.stdout:0/649: dread - d0/d17/d1c/d23/df/d41/d3b/d46/fd3 zero size 2024-09-21T00:56:40.264 INFO:tasks.workunit.client.0.smithi112.stdout:0/94: dwrite d8/d11/f13 [0,4194304] 0 2024-09-21T00:56:40.265 INFO:tasks.workunit.client.0.smithi112.stdout:3/249: creat d2/d8/d28/d35/f51 x:0 0 0 2024-09-21T00:56:40.265 INFO:tasks.workunit.client.0.smithi112.stdout:0/95: chown d8/d1b 719258841 1 2024-09-21T00:56:40.266 INFO:tasks.workunit.client.0.smithi112.stdout:3/250: write d2/d8/d28/f41 [4099191,79342] 0 2024-09-21T00:56:40.267 INFO:tasks.workunit.client.0.smithi112.stdout:3/251: read - d2/d8/d28/f3c zero size 2024-09-21T00:56:40.267 INFO:tasks.workunit.client.1.smithi187.stdout:1/767: dwrite d4/f14 [8388608,4194304] 0 2024-09-21T00:56:40.275 INFO:tasks.workunit.client.1.smithi187.stdout:1/768: dwrite d4/d6/d23/d2e/d94/d35/d79/feb [0,4194304] 0 2024-09-21T00:56:40.277 INFO:tasks.workunit.client.0.smithi112.stdout:3/252: mknod d2/d38/d3f/c52 0 2024-09-21T00:56:40.284 INFO:tasks.workunit.client.1.smithi187.stdout:5/645: truncate d0/dc/daa/d67/f61 2558941 0 2024-09-21T00:56:40.288 INFO:tasks.workunit.client.0.smithi112.stdout:0/96: getdents d8/d11 0 2024-09-21T00:56:40.289 INFO:tasks.workunit.client.0.smithi112.stdout:3/253: dwrite d2/d8/d28/f26 [0,4194304] 0 2024-09-21T00:56:40.293 INFO:tasks.workunit.client.0.smithi112.stdout:0/97: creat d8/d11/f1e x:0 0 0 2024-09-21T00:56:40.296 INFO:tasks.workunit.client.0.smithi112.stdout:3/254: fdatasync d2/f29 0 2024-09-21T00:56:40.296 INFO:tasks.workunit.client.1.smithi187.stdout:1/769: dread d4/f76 [0,4194304] 0 2024-09-21T00:56:40.305 INFO:tasks.workunit.client.0.smithi112.stdout:0/98: getdents d8 0 2024-09-21T00:56:40.308 INFO:tasks.workunit.client.0.smithi112.stdout:0/99: symlink d8/d1b/l1f 0 2024-09-21T00:56:40.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/100: dread - d8/d11/f1c zero size 2024-09-21T00:56:40.310 INFO:tasks.workunit.client.0.smithi112.stdout:0/101: chown d8/fe 315787 1 2024-09-21T00:56:40.312 INFO:tasks.workunit.client.0.smithi112.stdout:0/102: creat d8/f20 x:0 0 0 2024-09-21T00:56:40.314 INFO:tasks.workunit.client.1.smithi187.stdout:6/697: symlink d7/d59/le9 0 2024-09-21T00:56:40.318 INFO:tasks.workunit.client.0.smithi112.stdout:0/103: dwrite d8/d11/f1c [0,4194304] 0 2024-09-21T00:56:40.320 INFO:tasks.workunit.client.0.smithi112.stdout:0/104: truncate d8/d11/f1e 510350 0 2024-09-21T00:56:40.320 INFO:tasks.workunit.client.1.smithi187.stdout:2/760: creat d2/d3/d15/dfe/d2d/f10d x:0 0 0 2024-09-21T00:56:40.322 INFO:tasks.workunit.client.1.smithi187.stdout:6/698: chown d7/d2a/d29/lcb 3379 1 2024-09-21T00:56:40.324 INFO:tasks.workunit.client.0.smithi112.stdout:0/105: rename l4 to d8/d11/l21 0 2024-09-21T00:56:40.324 INFO:tasks.workunit.client.1.smithi187.stdout:6/699: read d7/d2a/d29/d40/d50/f73 [970101,64826] 0 2024-09-21T00:56:40.325 INFO:tasks.workunit.client.0.smithi112.stdout:0/106: chown d8/f10 5 1 2024-09-21T00:56:40.326 INFO:tasks.workunit.client.1.smithi187.stdout:6/700: write d7/d2a/fb [973798,19704] 0 2024-09-21T00:56:40.326 INFO:tasks.workunit.client.1.smithi187.stdout:0/650: truncate d0/d17/d18/f8a 1281555 0 2024-09-21T00:56:40.326 INFO:tasks.workunit.client.0.smithi112.stdout:0/107: rmdir d8/d11 39 2024-09-21T00:56:40.327 INFO:tasks.workunit.client.1.smithi187.stdout:6/701: chown d7/d2a/d29/d40/d45 1 1 2024-09-21T00:56:40.329 INFO:tasks.workunit.client.1.smithi187.stdout:5/646: mknod d0/dc/cd5 0 2024-09-21T00:56:40.331 INFO:tasks.workunit.client.1.smithi187.stdout:9/872: link d4/c91 d4/d10/d24/c11f 0 2024-09-21T00:56:40.334 INFO:tasks.workunit.client.0.smithi112.stdout:0/108: creat d8/d11/f22 x:0 0 0 2024-09-21T00:56:40.334 INFO:tasks.workunit.client.0.smithi112.stdout:0/109: dread - d8/f19 zero size 2024-09-21T00:56:40.335 INFO:tasks.workunit.client.1.smithi187.stdout:2/761: symlink d2/dc/d2e/d6f/l10e 0 2024-09-21T00:56:40.336 INFO:tasks.workunit.client.1.smithi187.stdout:4/713: link d2/d3/d56/c86 d2/d3/da/d2f/d32/d22/d37/dcf/cd9 0 2024-09-21T00:56:40.336 INFO:tasks.workunit.client.0.smithi112.stdout:0/110: creat d8/d11/f23 x:0 0 0 2024-09-21T00:56:40.338 INFO:tasks.workunit.client.1.smithi187.stdout:0/651: unlink d0/d17/d1c/d23/df/ca0 0 2024-09-21T00:56:40.339 INFO:tasks.workunit.client.1.smithi187.stdout:0/652: truncate d0/f70 5077969 0 2024-09-21T00:56:40.339 INFO:tasks.workunit.client.1.smithi187.stdout:5/647: mknod d0/dc/daa/d67/cd6 0 2024-09-21T00:56:40.340 INFO:tasks.workunit.client.0.smithi112.stdout:0/111: dread d8/fd [0,4194304] 0 2024-09-21T00:56:40.340 INFO:tasks.workunit.client.1.smithi187.stdout:9/873: symlink d4/d13/d20/d2b/d66/db6/l120 0 2024-09-21T00:56:40.340 INFO:tasks.workunit.client.1.smithi187.stdout:5/648: write d0/dc/daa/d67/d14/d1b/fba [700820,74352] 0 2024-09-21T00:56:40.341 INFO:tasks.workunit.client.1.smithi187.stdout:7/635: getdents d1/d55/d80/d87 0 2024-09-21T00:56:40.342 INFO:tasks.workunit.client.1.smithi187.stdout:8/752: rename dc/c1b to dc/d2f/d34/cfd 0 2024-09-21T00:56:40.343 INFO:tasks.workunit.client.0.smithi112.stdout:0/112: symlink d8/d11/l24 0 2024-09-21T00:56:40.343 INFO:tasks.workunit.client.1.smithi187.stdout:7/636: truncate d1/dce/dd0/fa7 209400 0 2024-09-21T00:56:40.343 INFO:tasks.workunit.client.1.smithi187.stdout:8/753: dread - dc/d2f/d80/db8/dba/fc9 zero size 2024-09-21T00:56:40.344 INFO:tasks.workunit.client.1.smithi187.stdout:8/754: dread - dc/d2f/d54/f74 zero size 2024-09-21T00:56:40.344 INFO:tasks.workunit.client.1.smithi187.stdout:2/762: fdatasync d2/da8/d6c/db8/d40/f6e 0 2024-09-21T00:56:40.348 INFO:tasks.workunit.client.0.smithi112.stdout:0/113: dwrite d8/d11/f13 [4194304,4194304] 0 2024-09-21T00:56:40.371 INFO:tasks.workunit.client.1.smithi187.stdout:3/624: sync 2024-09-21T00:56:40.382 INFO:tasks.workunit.client.1.smithi187.stdout:3/625: dread d9/d13/d87/d94/d53/d56/d7d/d81/f84 [0,4194304] 0 2024-09-21T00:56:40.383 INFO:tasks.workunit.client.1.smithi187.stdout:3/626: read d9/d19/d1c/f47 [1803678,73577] 0 2024-09-21T00:56:40.387 INFO:tasks.workunit.client.1.smithi187.stdout:3/627: dwrite d9/d13/d87/d94/f90 [0,4194304] 0 2024-09-21T00:56:40.465 INFO:tasks.workunit.client.1.smithi187.stdout:4/714: symlink d2/d3/da/d2f/d4b/d7e/dc8/d89/lda 0 2024-09-21T00:56:40.467 INFO:tasks.workunit.client.1.smithi187.stdout:0/653: rmdir d0/d17/d1c/d65 39 2024-09-21T00:56:40.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.482+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f30a806a330 con 0x7f3090074a80 2024-09-21T00:56:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.483+0000 7f30a4ff9640 1 -- 172.21.15.112:0/3355685747 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f30a806a330 con 0x7f3090074a80 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3090074a80 msgr2=0x7f3090076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3090074a80 0x7f3090076f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f309c000c00 tx=0x7f309c0058d0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 msgr2=0x7f30a8199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 0x7f30a8199770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f309800b3d0 tx=0x7f309800b890 comp rx=0 tx=0).stop 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 shutdown_connections 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3090074a80 0x7f3090076f40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a8101a40 0x7f30a8199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 --2- 172.21.15.112:0/3355685747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30a8100840 0x7f30a8199770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 >> 172.21.15.112:0/3355685747 conn(0x7f30a80fbff0 msgr2=0x7f30a8069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 shutdown_connections 2024-09-21T00:56:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.485+0000 7f30ae153640 1 -- 172.21.15.112:0/3355685747 wait complete. 2024-09-21T00:56:40.492 INFO:tasks.workunit.client.0.smithi112.stdout:4/220: sync 2024-09-21T00:56:40.492 INFO:tasks.workunit.client.0.smithi112.stdout:6/147: sync 2024-09-21T00:56:40.492 INFO:tasks.workunit.client.0.smithi112.stdout:7/159: sync 2024-09-21T00:56:40.492 INFO:tasks.workunit.client.0.smithi112.stdout:2/182: sync 2024-09-21T00:56:40.492 INFO:tasks.workunit.client.0.smithi112.stdout:9/135: sync 2024-09-21T00:56:40.492 INFO:tasks.workunit.client.0.smithi112.stdout:1/102: sync 2024-09-21T00:56:40.494 INFO:tasks.workunit.client.0.smithi112.stdout:4/221: dread - d1/f46 zero size 2024-09-21T00:56:40.494 INFO:tasks.workunit.client.1.smithi187.stdout:1/770: rename d4/d86/lf1 to d4/d6/d23/d2e/d94/d35/d22/d2c/d9f/lf6 0 2024-09-21T00:56:40.495 INFO:tasks.workunit.client.0.smithi112.stdout:6/148: truncate d9/d13/f39 358511 0 2024-09-21T00:56:40.495 INFO:tasks.workunit.client.1.smithi187.stdout:1/771: chown d4/d6/d23/d2e/d94/dcb/fdd 487303 1 2024-09-21T00:56:40.502 INFO:tasks.workunit.client.1.smithi187.stdout:6/702: dwrite d7/d2a/f8a [0,4194304] 0 2024-09-21T00:56:40.503 INFO:tasks.workunit.client.0.smithi112.stdout:1/103: symlink d5/d8/d13/l21 0 2024-09-21T00:56:40.504 INFO:tasks.workunit.client.0.smithi112.stdout:1/104: dread - d5/d8/d10/f1d zero size 2024-09-21T00:56:40.504 INFO:tasks.workunit.client.1.smithi187.stdout:3/628: write d9/d13/f2c [5274764,21191] 0 2024-09-21T00:56:40.505 INFO:tasks.workunit.client.0.smithi112.stdout:1/105: read d5/d8/f12 [2446735,94832] 0 2024-09-21T00:56:40.505 INFO:tasks.workunit.client.0.smithi112.stdout:4/222: mknod d1/d7/d30/c4f 0 2024-09-21T00:56:40.508 INFO:tasks.workunit.client.0.smithi112.stdout:6/149: symlink d9/d13/d21/l3a 0 2024-09-21T00:56:40.508 INFO:tasks.workunit.client.0.smithi112.stdout:4/223: chown d1/d7/d9/d1a/l33 0 1 2024-09-21T00:56:40.509 INFO:tasks.workunit.client.0.smithi112.stdout:6/150: truncate d9/f25 1479041 0 2024-09-21T00:56:40.511 INFO:tasks.workunit.client.0.smithi112.stdout:6/151: write d9/df/f2e [571507,76402] 0 2024-09-21T00:56:40.512 INFO:tasks.workunit.client.0.smithi112.stdout:7/160: unlink d0/d8/c17 0 2024-09-21T00:56:40.514 INFO:tasks.workunit.client.1.smithi187.stdout:0/654: dwrite d0/d17/d1c/d23/df/d51/f2f [0,4194304] 0 2024-09-21T00:56:40.515 INFO:tasks.workunit.client.0.smithi112.stdout:2/183: write d0/df/f13 [76954,80897] 0 2024-09-21T00:56:40.516 INFO:tasks.workunit.client.0.smithi112.stdout:7/161: write d0/fa [591126,77447] 0 2024-09-21T00:56:40.518 INFO:tasks.workunit.client.1.smithi187.stdout:9/874: rename d4/d13/d20/d2b to d4/d8/d46/d54/d10f/d121 0 2024-09-21T00:56:40.519 INFO:tasks.workunit.client.0.smithi112.stdout:0/114: dwrite d8/fa [4194304,4194304] 0 2024-09-21T00:56:40.520 INFO:tasks.workunit.client.0.smithi112.stdout:0/115: stat d8/d11/l16 0 2024-09-21T00:56:40.520 INFO:tasks.workunit.client.0.smithi112.stdout:7/162: write d0/f19 [2067689,126678] 0 2024-09-21T00:56:40.523 INFO:tasks.workunit.client.0.smithi112.stdout:7/163: chown d0/d2 26701 1 2024-09-21T00:56:40.524 INFO:tasks.workunit.client.0.smithi112.stdout:7/164: read d0/d8/d1a/f1f [1656436,12470] 0 2024-09-21T00:56:40.524 INFO:tasks.workunit.client.0.smithi112.stdout:9/136: unlink d5/d6/de/f15 0 2024-09-21T00:56:40.529 INFO:tasks.workunit.client.1.smithi187.stdout:8/755: link dc/d2f/d34/d4b/d85/fe4 dc/d2f/d54/d69/ffe 0 2024-09-21T00:56:40.529 INFO:tasks.workunit.client.0.smithi112.stdout:6/152: dwrite d9/fd [4194304,4194304] 0 2024-09-21T00:56:40.534 INFO:tasks.workunit.client.0.smithi112.stdout:7/165: dread d0/d8/d1a/f1f [0,4194304] 0 2024-09-21T00:56:40.535 INFO:tasks.workunit.client.0.smithi112.stdout:0/116: dwrite d8/d11/f22 [0,4194304] 0 2024-09-21T00:56:40.536 INFO:tasks.workunit.client.0.smithi112.stdout:4/224: creat d1/d2d/f50 x:0 0 0 2024-09-21T00:56:40.538 INFO:tasks.workunit.client.0.smithi112.stdout:0/117: stat d8 0 2024-09-21T00:56:40.540 INFO:tasks.workunit.client.0.smithi112.stdout:4/225: dread - d1/f46 zero size 2024-09-21T00:56:40.540 INFO:tasks.workunit.client.1.smithi187.stdout:3/629: unlink d9/d13/f2c 0 2024-09-21T00:56:40.541 INFO:tasks.workunit.client.0.smithi112.stdout:0/118: dread d8/d11/f1e [0,4194304] 0 2024-09-21T00:56:40.549 INFO:tasks.workunit.client.1.smithi187.stdout:7/637: truncate d1/dc/d15/d2b/f61 272906 0 2024-09-21T00:56:40.549 INFO:tasks.workunit.client.0.smithi112.stdout:2/184: dread d0/d14/d8/fd [0,4194304] 0 2024-09-21T00:56:40.551 INFO:tasks.workunit.client.1.smithi187.stdout:5/649: creat d0/dc/daa/d67/d30/d6b/fd7 x:0 0 0 2024-09-21T00:56:40.554 INFO:tasks.workunit.client.0.smithi112.stdout:1/106: symlink d5/d8/d14/l22 0 2024-09-21T00:56:40.557 INFO:tasks.workunit.client.1.smithi187.stdout:2/763: rename d2/d3/df/f3e to d2/da8/d6c/db8/d40/d75/de8/f10f 0 2024-09-21T00:56:40.567 INFO:tasks.workunit.client.1.smithi187.stdout:3/630: unlink d9/d13/d87/d94/d89/fc3 0 2024-09-21T00:56:40.569 INFO:tasks.workunit.client.0.smithi112.stdout:4/226: mknod d1/d5/d1c/d1e/d3d/c51 0 2024-09-21T00:56:40.571 INFO:tasks.workunit.client.0.smithi112.stdout:2/185: creat d0/d14/d8/d27/f3a x:0 0 0 2024-09-21T00:56:40.573 INFO:tasks.workunit.client.0.smithi112.stdout:7/166: write d0/f10 [1434846,58737] 0 2024-09-21T00:56:40.574 INFO:tasks.workunit.client.0.smithi112.stdout:1/107: mknod d5/c23 0 2024-09-21T00:56:40.575 INFO:tasks.workunit.client.1.smithi187.stdout:0/655: mknod d0/d60/cdf 0 2024-09-21T00:56:40.575 INFO:tasks.workunit.client.1.smithi187.stdout:0/656: readlink d0/d17/l75 0 2024-09-21T00:56:40.578 INFO:tasks.workunit.client.0.smithi112.stdout:7/167: dread d0/f10 [0,4194304] 0 2024-09-21T00:56:40.578 INFO:tasks.workunit.client.1.smithi187.stdout:8/756: dwrite dc/d44/dc1/fe6 [0,4194304] 0 2024-09-21T00:56:40.580 INFO:tasks.workunit.client.1.smithi187.stdout:1/772: rename d4/d6/d23/d2e/d94/dd5 to d4/d6/d23/d2e/d94/d35/d4c/df7 0 2024-09-21T00:56:40.581 INFO:tasks.workunit.client.1.smithi187.stdout:1/773: stat d4/d6/d23/d2e/d94/dcb 0 2024-09-21T00:56:40.582 INFO:tasks.workunit.client.0.smithi112.stdout:0/119: symlink d8/l25 0 2024-09-21T00:56:40.583 INFO:tasks.workunit.client.0.smithi112.stdout:4/227: mknod d1/d7/d9/c52 0 2024-09-21T00:56:40.584 INFO:tasks.workunit.client.0.smithi112.stdout:7/168: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:40.584 INFO:tasks.workunit.client.0.smithi112.stdout:2/186: symlink d0/d14/d8/l3b 0 2024-09-21T00:56:40.585 INFO:tasks.workunit.client.0.smithi112.stdout:9/137: creat d5/d6/de/f2c x:0 0 0 2024-09-21T00:56:40.588 INFO:tasks.workunit.client.1.smithi187.stdout:8/757: dwrite dc/d2f/d34/d4b/fcc [4194304,4194304] 0 2024-09-21T00:56:40.589 INFO:tasks.workunit.client.0.smithi112.stdout:9/138: dread - d5/d6/d19/f28 zero size 2024-09-21T00:56:40.589 INFO:tasks.workunit.client.0.smithi112.stdout:6/153: link d9/d13/d21/c2b d9/d13/d2f/c3b 0 2024-09-21T00:56:40.590 INFO:tasks.workunit.client.1.smithi187.stdout:4/715: getdents d2/d3/da/d2f/d32 0 2024-09-21T00:56:40.591 INFO:tasks.workunit.client.0.smithi112.stdout:0/120: dread d8/fb [0,4194304] 0 2024-09-21T00:56:40.594 INFO:tasks.workunit.client.0.smithi112.stdout:4/228: write d1/d5/d1c/d1e/f20 [3519097,125283] 0 2024-09-21T00:56:40.594 INFO:tasks.workunit.client.1.smithi187.stdout:2/764: dwrite d2/d3/d15/dfe/d2d/d8f/f100 [0,4194304] 0 2024-09-21T00:56:40.597 INFO:tasks.workunit.client.1.smithi187.stdout:4/716: write d2/d3/da/d2f/d4b/fcb [491018,68608] 0 2024-09-21T00:56:40.597 INFO:tasks.workunit.client.0.smithi112.stdout:7/169: dread d0/f10 [4194304,4194304] 0 2024-09-21T00:56:40.598 INFO:tasks.workunit.client.0.smithi112.stdout:1/108: unlink d5/d8/dd/c15 0 2024-09-21T00:56:40.598 INFO:tasks.workunit.client.1.smithi187.stdout:1/774: dwrite d4/d6/d23/f45 [0,4194304] 0 2024-09-21T00:56:40.600 INFO:tasks.workunit.client.1.smithi187.stdout:0/657: truncate d0/d17/d1c/d65/fb6 782315 0 2024-09-21T00:56:40.600 INFO:tasks.workunit.client.0.smithi112.stdout:7/170: chown d0/d8/l25 0 1 2024-09-21T00:56:40.601 INFO:tasks.workunit.client.0.smithi112.stdout:0/121: dwrite d8/d11/f1c [0,4194304] 0 2024-09-21T00:56:40.603 INFO:tasks.workunit.client.1.smithi187.stdout:4/717: dread d2/d3/da/d2f/d32/d22/d37/d51/f81 [0,4194304] 0 2024-09-21T00:56:40.604 INFO:tasks.workunit.client.1.smithi187.stdout:4/718: readlink d2/d3/da/d2f/d32/d26/l52 0 2024-09-21T00:56:40.605 INFO:tasks.workunit.client.1.smithi187.stdout:4/719: fdatasync d2/d3/da/d2f/d32/d26/f44 0 2024-09-21T00:56:40.606 INFO:tasks.workunit.client.1.smithi187.stdout:9/875: rmdir d4/d10/d24/da0 0 2024-09-21T00:56:40.607 INFO:tasks.workunit.client.1.smithi187.stdout:9/876: truncate d4/d13/fe0 483653 0 2024-09-21T00:56:40.609 INFO:tasks.workunit.client.1.smithi187.stdout:9/877: fdatasync d4/d8/d46/d54/f55 0 2024-09-21T00:56:40.612 INFO:tasks.workunit.client.0.smithi112.stdout:2/187: link d0/d14/f35 d0/f3c 0 2024-09-21T00:56:40.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/139: dwrite f3 [0,4194304] 0 2024-09-21T00:56:40.614 INFO:tasks.workunit.client.1.smithi187.stdout:6/703: getdents d7/d2a 0 2024-09-21T00:56:40.615 INFO:tasks.workunit.client.1.smithi187.stdout:4/720: dwrite d2/d3/da/d2f/d32/d22/d37/f38 [0,4194304] 0 2024-09-21T00:56:40.617 INFO:tasks.workunit.client.0.smithi112.stdout:4/229: symlink d1/d7/l53 0 2024-09-21T00:56:40.621 INFO:tasks.workunit.client.0.smithi112.stdout:1/109: chown d5/d8/d13/c1b 11 1 2024-09-21T00:56:40.622 INFO:tasks.workunit.client.0.smithi112.stdout:1/110: stat d5/d8/dd/c19 0 2024-09-21T00:56:40.623 INFO:tasks.workunit.client.1.smithi187.stdout:3/631: symlink d9/lc8 0 2024-09-21T00:56:40.624 INFO:tasks.workunit.client.0.smithi112.stdout:7/171: rmdir d0/d8 39 2024-09-21T00:56:40.626 INFO:tasks.workunit.client.1.smithi187.stdout:5/650: mknod d0/dc/daa/d98/cd8 0 2024-09-21T00:56:40.629 INFO:tasks.workunit.client.1.smithi187.stdout:7/638: dwrite d1/d18/d31/d41/d64/faa [0,4194304] 0 2024-09-21T00:56:40.629 INFO:tasks.workunit.client.0.smithi112.stdout:9/140: dread d5/f14 [0,4194304] 0 2024-09-21T00:56:40.630 INFO:tasks.workunit.client.0.smithi112.stdout:2/188: dwrite d0/d14/d8/d27/f2d [0,4194304] 0 2024-09-21T00:56:40.630 INFO:tasks.workunit.client.0.smithi112.stdout:6/154: link d9/d1b/f1d d9/d1f/d1a/d33/f3c 0 2024-09-21T00:56:40.632 INFO:tasks.workunit.client.0.smithi112.stdout:9/141: write d5/f16 [603336,79843] 0 2024-09-21T00:56:40.633 INFO:tasks.workunit.client.0.smithi112.stdout:6/155: write d9/fd [1491190,37338] 0 2024-09-21T00:56:40.633 INFO:tasks.workunit.client.0.smithi112.stdout:1/111: rmdir d5 39 2024-09-21T00:56:40.634 INFO:tasks.workunit.client.1.smithi187.stdout:1/775: creat d4/d6/d23/d2e/d94/d35/d22/dcd/ff8 x:0 0 0 2024-09-21T00:56:40.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.633+0000 7fdd1ef99640 1 -- 172.21.15.112:0/152006429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18100d60 msgr2=0x7fdd18101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.633+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/152006429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18100d60 0x7fdd18101160 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009880 tx=0x7fdd0002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.634+0000 7fdd1ef99640 1 -- 172.21.15.112:0/152006429 shutdown_connections 2024-09-21T00:56:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.634+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/152006429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd18101a80 0x7fdd18101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.634+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/152006429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18100d60 0x7fdd18101160 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.634+0000 7fdd1ef99640 1 -- 172.21.15.112:0/152006429 >> 172.21.15.112:0/152006429 conn(0x7fdd180fb750 msgr2=0x7fdd180fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:40.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.634+0000 7fdd1ef99640 1 -- 172.21.15.112:0/152006429 shutdown_connections 2024-09-21T00:56:40.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.634+0000 7fdd1ef99640 1 -- 172.21.15.112:0/152006429 wait complete. 2024-09-21T00:56:40.636 INFO:tasks.workunit.client.0.smithi112.stdout:6/156: write d9/d13/f17 [652399,107877] 0 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.635+0000 7fdd1ef99640 1 Processor -- start 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd1ef99640 1 -- start start 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd1ef99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd18100d60 0x7fdd1819da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd1ef99640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18101a80 0x7fdd1819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd1ef99640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd18108560 con 0x7fdd18101a80 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd1ef99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdd181083e0 con 0x7fdd18100d60 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18101a80 0x7fdd1819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18101a80 0x7fdd1819dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33624/0 (socket says 172.21.15.112:33624) 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd17fff640 1 -- 172.21.15.112:0/2109333252 learned_addr learned my addr 172.21.15.112:0/2109333252 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.636+0000 7fdd1cd35640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd18100d60 0x7fdd1819da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd17fff640 1 -- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd18100d60 msgr2=0x7fdd1819da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd17fff640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd18100d60 0x7fdd1819da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd17fff640 1 -- 172.21.15.112:0/2109333252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1819e5c0 con 0x7fdd18101a80 2024-09-21T00:56:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd17fff640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18101a80 0x7fdd1819dfd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800ca30 tx=0x7fdd0800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd15ffb640 1 -- 172.21.15.112:0/2109333252 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd08007b30 con 0x7fdd18101a80 2024-09-21T00:56:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd181a3030 con 0x7fdd18101a80 2024-09-21T00:56:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd15ffb640 1 -- 172.21.15.112:0/2109333252 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd08007cd0 con 0x7fdd18101a80 2024-09-21T00:56:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd15ffb640 1 -- 172.21.15.112:0/2109333252 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd08007b30 con 0x7fdd18101a80 2024-09-21T00:56:40.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.637+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd181a3590 con 0x7fdd18101a80 2024-09-21T00:56:40.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.639+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf80052c0 con 0x7fdd18101a80 2024-09-21T00:56:40.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.641+0000 7fdd15ffb640 1 -- 172.21.15.112:0/2109333252 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fdd080035f0 con 0x7fdd18101a80 2024-09-21T00:56:40.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.642+0000 7fdd15ffb640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fdd04074d00 0x7fdd040771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:40.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.642+0000 7fdd15ffb640 1 -- 172.21.15.112:0/2109333252 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fdd08095ed0 con 0x7fdd18101a80 2024-09-21T00:56:40.643 INFO:tasks.workunit.client.1.smithi187.stdout:5/651: chown d0/dc/daa/d67/d14/l16 602009 1 2024-09-21T00:56:40.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.646+0000 7fdd1cd35640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fdd04074d00 0x7fdd040771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:40.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.648+0000 7fdd1cd35640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fdd04074d00 0x7fdd040771c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd00006010 tx=0x7fdd00004260 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:40.649 INFO:tasks.workunit.client.1.smithi187.stdout:5/652: dwrite d0/dc/daa/d67/d14/d38/d5a/f8d [0,4194304] 0 2024-09-21T00:56:40.649 INFO:tasks.workunit.client.1.smithi187.stdout:2/765: mkdir d2/dc/d2e/d51/dc5/ddf/d10a/d110 0 2024-09-21T00:56:40.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:40.649+0000 7fdd15ffb640 1 -- 172.21.15.112:0/2109333252 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fdd08014030 con 0x7fdd18101a80 2024-09-21T00:56:40.650 INFO:tasks.workunit.client.1.smithi187.stdout:2/766: read - d2/d3/d15/dfe/fbd zero size 2024-09-21T00:56:40.656 INFO:tasks.workunit.client.1.smithi187.stdout:8/758: dwrite dc/f15 [0,4194304] 0 2024-09-21T00:56:40.660 INFO:tasks.workunit.client.0.smithi112.stdout:1/112: mknod d5/d8/d13/c24 0 2024-09-21T00:56:40.661 INFO:tasks.workunit.client.0.smithi112.stdout:0/122: truncate d8/fa 5128489 0 2024-09-21T00:56:40.664 INFO:tasks.workunit.client.0.smithi112.stdout:9/142: unlink d5/d6/de/c29 0 2024-09-21T00:56:40.665 INFO:tasks.workunit.client.1.smithi187.stdout:5/653: mkdir d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9 0 2024-09-21T00:56:40.667 INFO:tasks.workunit.client.0.smithi112.stdout:6/157: creat d9/d13/d26/f3d x:0 0 0 2024-09-21T00:56:40.667 INFO:tasks.workunit.client.1.smithi187.stdout:6/704: write d7/d2a/d7a/f8f [654872,122135] 0 2024-09-21T00:56:40.667 INFO:tasks.workunit.client.1.smithi187.stdout:7/639: creat d1/d18/d31/d41/d8a/dd5/fd8 x:0 0 0 2024-09-21T00:56:40.668 INFO:tasks.workunit.client.0.smithi112.stdout:4/230: rename d1/d7/d30/c4f to d1/d5/c54 0 2024-09-21T00:56:40.669 INFO:tasks.workunit.client.1.smithi187.stdout:7/640: write d1/d18/f29 [3699538,105684] 0 2024-09-21T00:56:40.670 INFO:tasks.workunit.client.0.smithi112.stdout:4/231: truncate d1/d7/f39 516787 0 2024-09-21T00:56:40.671 INFO:tasks.workunit.client.1.smithi187.stdout:2/767: rename d2/dc/d2e/d6f/fc1 to d2/d25/f111 0 2024-09-21T00:56:40.671 INFO:tasks.workunit.client.1.smithi187.stdout:7/641: write d1/f37 [217043,23077] 0 2024-09-21T00:56:40.671 INFO:tasks.workunit.client.0.smithi112.stdout:1/113: creat d5/d8/d14/f25 x:0 0 0 2024-09-21T00:56:40.673 INFO:tasks.workunit.client.1.smithi187.stdout:2/768: read - d2/d3/d15/dfe/d2d/fdc zero size 2024-09-21T00:56:40.673 INFO:tasks.workunit.client.0.smithi112.stdout:0/123: creat d8/d11/f26 x:0 0 0 2024-09-21T00:56:40.675 INFO:tasks.workunit.client.1.smithi187.stdout:3/632: dwrite d9/d13/d20/f2e [0,4194304] 0 2024-09-21T00:56:40.675 INFO:tasks.workunit.client.1.smithi187.stdout:1/776: creat d4/d6/d23/d2e/d94/dae/ff9 x:0 0 0 2024-09-21T00:56:40.678 INFO:tasks.workunit.client.1.smithi187.stdout:8/759: unlink dc/d94/fbd 0 2024-09-21T00:56:40.681 INFO:tasks.workunit.client.0.smithi112.stdout:1/114: mknod d5/d8/c26 0 2024-09-21T00:56:40.683 INFO:tasks.workunit.client.1.smithi187.stdout:6/705: chown d7/d2a/d29/d40/d50/l75 33 1 2024-09-21T00:56:40.685 INFO:tasks.workunit.client.0.smithi112.stdout:9/143: mknod d5/c2d 0 2024-09-21T00:56:40.686 INFO:tasks.workunit.client.1.smithi187.stdout:3/633: rmdir d9/d19/d1c/d5f 39 2024-09-21T00:56:40.687 INFO:tasks.workunit.client.1.smithi187.stdout:3/634: dread d9/d7f/fbd [0,4194304] 0 2024-09-21T00:56:40.688 INFO:tasks.workunit.client.0.smithi112.stdout:1/115: mknod d5/d8/d14/c27 0 2024-09-21T00:56:40.689 INFO:tasks.workunit.client.1.smithi187.stdout:2/769: creat d2/dc/d2e/d4a/d7c/d52/da3/f112 x:0 0 0 2024-09-21T00:56:40.689 INFO:tasks.workunit.client.1.smithi187.stdout:2/770: write d2/da8/d9d/fe4 [1015509,114599] 0 2024-09-21T00:56:40.692 INFO:tasks.workunit.client.0.smithi112.stdout:9/144: rmdir d5/d6 39 2024-09-21T00:56:40.692 INFO:tasks.workunit.client.0.smithi112.stdout:1/116: dread d5/d8/f11 [0,4194304] 0 2024-09-21T00:56:40.695 INFO:tasks.workunit.client.1.smithi187.stdout:1/777: creat d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/ffa x:0 0 0 2024-09-21T00:56:40.696 INFO:tasks.workunit.client.0.smithi112.stdout:1/117: mknod d5/d8/dd/c28 0 2024-09-21T00:56:40.697 INFO:tasks.workunit.client.1.smithi187.stdout:6/706: rename d7/d2a/d7a/f7e to d7/d2a/d29/d94/fea 0 2024-09-21T00:56:40.698 INFO:tasks.workunit.client.1.smithi187.stdout:6/707: readlink d7/d2a/d29/d40/d45/lce 0 2024-09-21T00:56:40.698 INFO:tasks.workunit.client.1.smithi187.stdout:6/708: readlink d7/ld5 0 2024-09-21T00:56:40.699 INFO:tasks.workunit.client.1.smithi187.stdout:6/709: chown d7/d2a/d29/d40/l35 109 1 2024-09-21T00:56:40.700 INFO:tasks.workunit.client.1.smithi187.stdout:6/710: chown d7/d2a/d29/d40/fb1 1 1 2024-09-21T00:56:40.703 INFO:tasks.workunit.client.1.smithi187.stdout:2/771: creat d2/da8/d6c/d97/db0/f113 x:0 0 0 2024-09-21T00:56:40.704 INFO:tasks.workunit.client.1.smithi187.stdout:2/772: write d2/d25/f68 [4272810,120900] 0 2024-09-21T00:56:40.705 INFO:tasks.workunit.client.1.smithi187.stdout:2/773: stat d2/da8/d6c/db8/d40/le9 0 2024-09-21T00:56:40.705 INFO:tasks.workunit.client.1.smithi187.stdout:5/654: creat d0/dc/daa/d67/d14/fda x:0 0 0 2024-09-21T00:56:40.708 INFO:tasks.workunit.client.0.smithi112.stdout:9/145: creat d5/d6/de/f2e x:0 0 0 2024-09-21T00:56:40.709 INFO:tasks.workunit.client.1.smithi187.stdout:7/642: dread d1/d18/d31/f36 [0,4194304] 0 2024-09-21T00:56:40.710 INFO:tasks.workunit.client.1.smithi187.stdout:3/635: mkdir d9/d13/d87/d94/d53/d56/dc9 0 2024-09-21T00:56:40.711 INFO:tasks.workunit.client.1.smithi187.stdout:6/711: readlink d7/d2a/d29/l95 0 2024-09-21T00:56:40.712 INFO:tasks.workunit.client.1.smithi187.stdout:6/712: write d7/d2a/d29/d40/d50/d83/fcd [475905,82259] 0 2024-09-21T00:56:40.712 INFO:tasks.workunit.client.1.smithi187.stdout:6/713: readlink d7/l61 0 2024-09-21T00:56:40.712 INFO:tasks.workunit.client.1.smithi187.stdout:4/721: sync 2024-09-21T00:56:40.713 INFO:tasks.workunit.client.1.smithi187.stdout:9/878: sync 2024-09-21T00:56:40.713 INFO:tasks.workunit.client.1.smithi187.stdout:0/658: sync 2024-09-21T00:56:40.714 INFO:tasks.workunit.client.1.smithi187.stdout:2/774: rename d2/dc/d21/l35 to d2/d3/d15/dfe/d2d/d8f/d9f/d8c/d107/l114 0 2024-09-21T00:56:40.715 INFO:tasks.workunit.client.1.smithi187.stdout:1/778: mknod d4/d6/d23/d2e/d94/d35/d22/cfb 0 2024-09-21T00:56:40.715 INFO:tasks.workunit.client.1.smithi187.stdout:7/643: creat d1/dce/fd9 x:0 0 0 2024-09-21T00:56:40.716 INFO:tasks.workunit.client.1.smithi187.stdout:8/760: link dc/d2f/c52 dc/d94/df6/cff 0 2024-09-21T00:56:40.716 INFO:tasks.workunit.client.1.smithi187.stdout:4/722: chown d2/d3/da/d2f/d32/d22/d37/d51/c55 3947 1 2024-09-21T00:56:40.717 INFO:tasks.workunit.client.1.smithi187.stdout:9/879: mkdir d4/d8/d46/d54/d10f/d121/d94/d122 0 2024-09-21T00:56:40.718 INFO:tasks.workunit.client.1.smithi187.stdout:8/761: write dc/d2f/d80/db8/dba/f21 [1433443,27496] 0 2024-09-21T00:56:40.720 INFO:tasks.workunit.client.1.smithi187.stdout:9/880: write d4/d10/f4a [1231362,121073] 0 2024-09-21T00:56:40.720 INFO:tasks.workunit.client.1.smithi187.stdout:5/655: rename d0/dc/daa/d67/d30/f3b to d0/dc/d1f/d26/d8b/fdb 0 2024-09-21T00:56:40.720 INFO:tasks.workunit.client.1.smithi187.stdout:8/762: chown dc/dea/f81 5276 1 2024-09-21T00:56:40.722 INFO:tasks.workunit.client.1.smithi187.stdout:3/636: mkdir d9/d19/dca 0 2024-09-21T00:56:40.722 INFO:tasks.workunit.client.1.smithi187.stdout:0/659: mknod d0/d17/d1c/d23/d36/ce0 0 2024-09-21T00:56:40.722 INFO:tasks.workunit.client.1.smithi187.stdout:1/779: dread d4/d6/d23/d2e/d94/f13 [0,4194304] 0 2024-09-21T00:56:40.723 INFO:tasks.workunit.client.1.smithi187.stdout:2/775: symlink d2/d3/d15/dfe/d2d/d8f/d9f/d8c/d107/l115 0 2024-09-21T00:56:40.726 INFO:tasks.workunit.client.1.smithi187.stdout:0/660: write d0/d17/d1c/d23/d36/fa1 [2242218,106141] 0 2024-09-21T00:56:40.726 INFO:tasks.workunit.client.1.smithi187.stdout:2/776: write d2/d3/d15/dfe/d2d/fdc [303553,102760] 0 2024-09-21T00:56:40.728 INFO:tasks.workunit.client.1.smithi187.stdout:6/714: link d7/d2a/d29/d40/f4d d7/d59/feb 0 2024-09-21T00:56:40.729 INFO:tasks.workunit.client.1.smithi187.stdout:3/637: write d9/d13/d87/d94/d53/d56/d7d/d81/d9d/faf [1048331,22332] 0 2024-09-21T00:56:40.730 INFO:tasks.workunit.client.1.smithi187.stdout:2/777: write d2/d3/d15/f63 [3147954,120717] 0 2024-09-21T00:56:40.733 INFO:tasks.workunit.client.0.smithi112.stdout:6/158: dwrite d9/f12 [4194304,4194304] 0 2024-09-21T00:56:40.733 INFO:tasks.workunit.client.1.smithi187.stdout:4/723: dread d2/d3/da/d16/f1d [0,4194304] 0 2024-09-21T00:56:40.734 INFO:tasks.workunit.client.0.smithi112.stdout:6/159: write d9/fc [750197,116336] 0 2024-09-21T00:56:40.735 INFO:tasks.workunit.client.0.smithi112.stdout:4/232: dwrite d1/d7/f17 [0,4194304] 0 2024-09-21T00:56:40.736 INFO:tasks.workunit.client.1.smithi187.stdout:0/661: creat d0/d17/d1c/d23/df/d41/fe1 x:0 0 0 2024-09-21T00:56:40.737 INFO:tasks.workunit.client.0.smithi112.stdout:4/233: dread d1/d5/f15 [4194304,4194304] 0 2024-09-21T00:56:40.738 INFO:tasks.workunit.client.1.smithi187.stdout:0/662: stat d0/d17/d1c/d23/df/fce 0 2024-09-21T00:56:40.743 INFO:tasks.workunit.client.1.smithi187.stdout:8/763: creat dc/d2f/d34/f100 x:0 0 0 2024-09-21T00:56:40.744 INFO:tasks.workunit.client.1.smithi187.stdout:9/881: dread d4/d61/f68 [0,4194304] 0 2024-09-21T00:56:40.744 INFO:tasks.workunit.client.1.smithi187.stdout:2/778: dread d2/dc/d2e/d4a/d7c/d52/da3/ffb [0,4194304] 0 2024-09-21T00:56:40.744 INFO:tasks.workunit.client.1.smithi187.stdout:3/638: dwrite d9/d13/d87/d94/d53/d56/d7d/d81/d9d/faf [0,4194304] 0 2024-09-21T00:56:40.747 INFO:tasks.workunit.client.1.smithi187.stdout:4/724: mknod d2/d3/d74/db1/cdb 0 2024-09-21T00:56:40.748 INFO:tasks.workunit.client.0.smithi112.stdout:0/124: write d8/f10 [2868416,34413] 0 2024-09-21T00:56:40.750 INFO:tasks.workunit.client.0.smithi112.stdout:4/234: dwrite d1/d7/f28 [4194304,4194304] 0 2024-09-21T00:56:40.751 INFO:tasks.workunit.client.0.smithi112.stdout:4/235: chown d1/d7/d9/d1a/d22/f4c 36203201 1 2024-09-21T00:56:40.752 INFO:tasks.workunit.client.1.smithi187.stdout:0/663: unlink d0/d17/d1c/d23/df/f15 0 2024-09-21T00:56:40.752 INFO:tasks.workunit.client.0.smithi112.stdout:4/236: dread - d1/d2d/f50 zero size 2024-09-21T00:56:40.753 INFO:tasks.workunit.client.1.smithi187.stdout:5/656: dread d0/dc/d1f/d26/d8b/fa1 [0,4194304] 0 2024-09-21T00:56:40.753 INFO:tasks.workunit.client.0.smithi112.stdout:0/125: truncate d8/fb 675012 0 2024-09-21T00:56:40.754 INFO:tasks.workunit.client.0.smithi112.stdout:1/118: write d5/d8/d10/f17 [479302,19063] 0 2024-09-21T00:56:40.756 INFO:tasks.workunit.client.1.smithi187.stdout:2/779: dread d2/d3/d15/f87 [0,4194304] 0 2024-09-21T00:56:40.758 INFO:tasks.workunit.client.1.smithi187.stdout:2/780: write d2/da8/d6c/d97/da1/fa4 [13242,21552] 0 2024-09-21T00:56:40.759 INFO:tasks.workunit.client.1.smithi187.stdout:3/639: rename d9/d13 to d9/d7f/dcb 0 2024-09-21T00:56:40.760 INFO:tasks.workunit.client.1.smithi187.stdout:6/715: link d7/d2a/d29/d40/cb4 d7/d2a/d29/d94/cec 0 2024-09-21T00:56:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:40 smithi112 ceph-mon[28078]: pgmap v23: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 163 MiB/s wr, 316 op/s 2024-09-21T00:56:40.760 INFO:tasks.workunit.client.1.smithi187.stdout:2/781: dread d2/d3/d15/f87 [0,4194304] 0 2024-09-21T00:56:40.762 INFO:tasks.workunit.client.0.smithi112.stdout:1/119: creat d5/d8/d10/f29 x:0 0 0 2024-09-21T00:56:40.763 INFO:tasks.workunit.client.0.smithi112.stdout:0/126: dwrite d8/f18 [0,4194304] 0 2024-09-21T00:56:40.764 INFO:tasks.workunit.client.1.smithi187.stdout:4/725: rename d2/d3/da/d2f/d32/d22/d37/fd4 to d2/d3/da/d2f/d32/d22/d37/fdc 0 2024-09-21T00:56:40.765 INFO:tasks.workunit.client.0.smithi112.stdout:1/120: dread d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:40.769 INFO:tasks.workunit.client.1.smithi187.stdout:4/726: dwrite d2/d3/fbb [0,4194304] 0 2024-09-21T00:56:40.770 INFO:tasks.workunit.client.1.smithi187.stdout:4/727: chown d2/d3/d56/d84/c5d 340166 1 2024-09-21T00:56:40.774 INFO:tasks.workunit.client.0.smithi112.stdout:1/121: dwrite d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:40.775 INFO:tasks.workunit.client.1.smithi187.stdout:5/657: truncate d0/dc/faf 921631 0 2024-09-21T00:56:40.776 INFO:tasks.workunit.client.0.smithi112.stdout:0/127: symlink d8/d1b/l27 0 2024-09-21T00:56:40.778 INFO:tasks.workunit.client.0.smithi112.stdout:0/128: write d8/d11/f1a [574111,85987] 0 2024-09-21T00:56:40.778 INFO:tasks.workunit.client.1.smithi187.stdout:8/764: mkdir dc/d94/dfb/d101 0 2024-09-21T00:56:40.783 INFO:tasks.workunit.client.0.smithi112.stdout:0/129: mkdir d8/d11/d28 0 2024-09-21T00:56:40.784 INFO:tasks.workunit.client.1.smithi187.stdout:8/765: dread dc/d2f/d54/d69/db3/fca [0,4194304] 0 2024-09-21T00:56:40.785 INFO:tasks.workunit.client.0.smithi112.stdout:0/130: write d8/f18 [1202775,115381] 0 2024-09-21T00:56:40.786 INFO:tasks.workunit.client.1.smithi187.stdout:6/716: rmdir d7/d2a 39 2024-09-21T00:56:40.787 INFO:tasks.workunit.client.1.smithi187.stdout:8/766: write dc/d2f/d80/db8/dba/d29/da7/fc5 [950351,10153] 0 2024-09-21T00:56:40.787 INFO:tasks.workunit.client.1.smithi187.stdout:0/664: dwrite d0/d17/d18/d3a/f5e [0,4194304] 0 2024-09-21T00:56:40.789 INFO:tasks.workunit.client.1.smithi187.stdout:0/665: dread - d0/d60/d6b/fc7 zero size 2024-09-21T00:56:40.790 INFO:tasks.workunit.client.1.smithi187.stdout:2/782: mknod d2/da8/d6c/db8/d40/c116 0 2024-09-21T00:56:40.791 INFO:tasks.workunit.client.0.smithi112.stdout:0/131: symlink d8/d1b/l29 0 2024-09-21T00:56:40.794 INFO:tasks.workunit.client.1.smithi187.stdout:9/882: creat d4/d13/f123 x:0 0 0 2024-09-21T00:56:40.796 INFO:tasks.workunit.client.0.smithi112.stdout:1/122: getdents d5/d8/dd 0 2024-09-21T00:56:40.796 INFO:tasks.workunit.client.0.smithi112.stdout:6/160: dwrite f7 [0,4194304] 0 2024-09-21T00:56:40.799 INFO:tasks.workunit.client.0.smithi112.stdout:1/123: truncate d5/d8/d10/f1d 912817 0 2024-09-21T00:56:40.799 INFO:tasks.workunit.client.1.smithi187.stdout:9/883: dwrite d4/d8/fb [4194304,4194304] 0 2024-09-21T00:56:40.800 INFO:tasks.workunit.client.0.smithi112.stdout:1/124: chown d5/d8/d10/f29 5540793 1 2024-09-21T00:56:40.801 INFO:tasks.workunit.client.0.smithi112.stdout:1/125: read d5/d8/f1f [2593909,800] 0 2024-09-21T00:56:40.801 INFO:tasks.workunit.client.1.smithi187.stdout:4/728: truncate d2/d3/da/d2f/d32/d26/d66/d6e/f7b 194456 0 2024-09-21T00:56:40.802 INFO:tasks.workunit.client.0.smithi112.stdout:0/132: creat d8/d1b/f2a x:0 0 0 2024-09-21T00:56:40.803 INFO:tasks.workunit.client.1.smithi187.stdout:4/729: write d2/d3/d56/f87 [5170443,93832] 0 2024-09-21T00:56:40.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/237: write d1/d5/f15 [981923,76618] 0 2024-09-21T00:56:40.812 INFO:tasks.workunit.client.0.smithi112.stdout:6/161: mkdir d9/d1f/d3e 0 2024-09-21T00:56:40.812 INFO:tasks.workunit.client.0.smithi112.stdout:6/162: readlink d9/d13/d21/l3a 0 2024-09-21T00:56:40.813 INFO:tasks.workunit.client.0.smithi112.stdout:6/163: write d9/fd [4744502,74434] 0 2024-09-21T00:56:40.814 INFO:tasks.workunit.client.0.smithi112.stdout:6/164: stat d9/df 0 2024-09-21T00:56:40.819 INFO:tasks.workunit.client.1.smithi187.stdout:3/640: mkdir d9/dcc 0 2024-09-21T00:56:40.820 INFO:tasks.workunit.client.0.smithi112.stdout:4/238: dread d1/d2d/d34/f4e [0,4194304] 0 2024-09-21T00:56:40.825 INFO:tasks.workunit.client.0.smithi112.stdout:4/239: read d1/d7/d30/f44 [213509,15946] 0 2024-09-21T00:56:40.826 INFO:tasks.workunit.client.1.smithi187.stdout:9/884: dread d4/d8/d46/d54/d10f/d121/d94/dde/ffb [0,4194304] 0 2024-09-21T00:56:40.828 INFO:tasks.workunit.client.1.smithi187.stdout:0/666: symlink d0/d17/d1c/d23/d36/le2 0 2024-09-21T00:56:40.830 INFO:tasks.workunit.client.1.smithi187.stdout:2/783: symlink d2/d25/l117 0 2024-09-21T00:56:40.830 INFO:tasks.workunit.client.1.smithi187.stdout:5/658: write d0/dc/daa/d67/d30/d6b/fac [471270,120871] 0 2024-09-21T00:56:40.831 INFO:tasks.workunit.client.1.smithi187.stdout:2/784: read - d2/da8/d6c/db8/d40/d75/fd3 zero size 2024-09-21T00:56:40.833 INFO:tasks.workunit.client.0.smithi112.stdout:1/126: write d5/d8/f11 [2519031,58518] 0 2024-09-21T00:56:40.834 INFO:tasks.workunit.client.0.smithi112.stdout:1/127: chown d5/d8/d14/l22 194 1 2024-09-21T00:56:40.834 INFO:tasks.workunit.client.1.smithi187.stdout:4/730: creat d2/d3/da/d16/fdd x:0 0 0 2024-09-21T00:56:40.834 INFO:tasks.workunit.client.0.smithi112.stdout:1/128: fsync d5/d8/d14/f25 0 2024-09-21T00:56:40.835 INFO:tasks.workunit.client.0.smithi112.stdout:6/165: link d9/d13/d2f/d34/f36 d9/f3f 0 2024-09-21T00:56:40.843 INFO:tasks.workunit.client.0.smithi112.stdout:6/166: dwrite d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:40.844 INFO:tasks.workunit.client.0.smithi112.stdout:0/133: truncate d8/d11/f1c 1123633 0 2024-09-21T00:56:40.844 INFO:tasks.workunit.client.0.smithi112.stdout:6/167: dread - d9/d13/d26/f3d zero size 2024-09-21T00:56:40.845 INFO:tasks.workunit.client.0.smithi112.stdout:3/255: sync 2024-09-21T00:56:40.845 INFO:tasks.workunit.client.0.smithi112.stdout:5/68: sync 2024-09-21T00:56:40.845 INFO:tasks.workunit.client.0.smithi112.stdout:8/91: sync 2024-09-21T00:56:40.846 INFO:tasks.workunit.client.0.smithi112.stdout:1/129: symlink d5/l2a 0 2024-09-21T00:56:40.846 INFO:tasks.workunit.client.0.smithi112.stdout:5/69: fsync f5 0 2024-09-21T00:56:40.847 INFO:tasks.workunit.client.0.smithi112.stdout:3/256: dread - d2/d38/d3f/f43 zero size 2024-09-21T00:56:40.848 INFO:tasks.workunit.client.1.smithi187.stdout:6/717: rename d7/d59/f42 to d7/d2a/d29/d40/d50/fed 0 2024-09-21T00:56:40.850 INFO:tasks.workunit.client.0.smithi112.stdout:6/168: dread f7 [0,4194304] 0 2024-09-21T00:56:40.850 INFO:tasks.workunit.client.0.smithi112.stdout:6/169: chown d9/d13/d31 14786952 1 2024-09-21T00:56:40.851 INFO:tasks.workunit.client.1.smithi187.stdout:8/767: mknod dc/d2f/d80/db8/dba/c102 0 2024-09-21T00:56:40.855 INFO:tasks.workunit.client.1.smithi187.stdout:1/780: sync 2024-09-21T00:56:40.855 INFO:tasks.workunit.client.1.smithi187.stdout:7/644: sync 2024-09-21T00:56:40.856 INFO:tasks.workunit.client.0.smithi112.stdout:0/134: symlink d8/d1b/l2b 0 2024-09-21T00:56:40.856 INFO:tasks.workunit.client.1.smithi187.stdout:1/781: chown d4/d6/d23/d2e/d94/d35/d22/f46 10 1 2024-09-21T00:56:40.858 INFO:tasks.workunit.client.0.smithi112.stdout:1/130: rmdir d5/d8/d10 39 2024-09-21T00:56:40.859 INFO:tasks.workunit.client.0.smithi112.stdout:3/257: fdatasync d2/f5 0 2024-09-21T00:56:40.860 INFO:tasks.workunit.client.0.smithi112.stdout:6/170: fdatasync d9/d13/f15 0 2024-09-21T00:56:40.860 INFO:tasks.workunit.client.1.smithi187.stdout:4/731: write d2/d3/da/d2f/d4b/d7e/dc8/f62 [374212,41857] 0 2024-09-21T00:56:40.861 INFO:tasks.workunit.client.0.smithi112.stdout:8/92: creat d0/d13/d1b/f1e x:0 0 0 2024-09-21T00:56:40.862 INFO:tasks.workunit.client.1.smithi187.stdout:3/641: symlink d9/d19/d1c/d5f/lcd 0 2024-09-21T00:56:40.862 INFO:tasks.workunit.client.0.smithi112.stdout:8/93: dread - d0/d13/f19 zero size 2024-09-21T00:56:40.862 INFO:tasks.workunit.client.0.smithi112.stdout:8/94: stat d0/c6 0 2024-09-21T00:56:40.863 INFO:tasks.workunit.client.1.smithi187.stdout:0/667: dwrite d0/d17/d18/fc8 [0,4194304] 0 2024-09-21T00:56:40.863 INFO:tasks.workunit.client.1.smithi187.stdout:3/642: chown d9/d7f/dcb/f48 881987846 1 2024-09-21T00:56:40.863 INFO:tasks.workunit.client.0.smithi112.stdout:8/95: truncate d0/d13/f19 603822 0 2024-09-21T00:56:40.865 INFO:tasks.workunit.client.1.smithi187.stdout:6/718: creat d7/d2a/da2/fee x:0 0 0 2024-09-21T00:56:40.869 INFO:tasks.workunit.client.1.smithi187.stdout:9/885: mknod d4/d61/d6a/d90/d11d/c124 0 2024-09-21T00:56:40.870 INFO:tasks.workunit.client.1.smithi187.stdout:9/886: dread - d4/d8/d46/d54/d10f/d121/ff5 zero size 2024-09-21T00:56:40.874 INFO:tasks.workunit.client.1.smithi187.stdout:7/645: mkdir d1/d18/d31/d33/d3b/d9f/d75/dda 0 2024-09-21T00:56:40.874 INFO:tasks.workunit.client.0.smithi112.stdout:1/131: read d5/fc [1431974,118873] 0 2024-09-21T00:56:40.876 INFO:tasks.workunit.client.0.smithi112.stdout:3/258: mkdir d2/d38/d3f/d53 0 2024-09-21T00:56:40.876 INFO:tasks.workunit.client.1.smithi187.stdout:9/887: dwrite d4/d61/d6c/f99 [0,4194304] 0 2024-09-21T00:56:40.878 INFO:tasks.workunit.client.1.smithi187.stdout:9/888: dread - d4/d8/d46/d54/d10f/d121/d66/fc1 zero size 2024-09-21T00:56:40.879 INFO:tasks.workunit.client.0.smithi112.stdout:6/171: dread d9/d1b/f1d [4194304,4194304] 0 2024-09-21T00:56:40.880 INFO:tasks.workunit.client.0.smithi112.stdout:4/240: getdents d1/d5 0 2024-09-21T00:56:40.882 INFO:tasks.workunit.client.1.smithi187.stdout:2/785: link d2/d3/d15/dfe/d2d/d8f/fb4 d2/dc/f118 0 2024-09-21T00:56:40.882 INFO:tasks.workunit.client.0.smithi112.stdout:8/96: mknod d0/d13/d1b/c1f 0 2024-09-21T00:56:40.884 INFO:tasks.workunit.client.1.smithi187.stdout:1/782: rename d4/d6/d23/d2e/d94/d35/d79/la1 to d4/d6/d23/d2e/d94/d35/d22/d65/d90/de3/lfc 0 2024-09-21T00:56:40.886 INFO:tasks.workunit.client.1.smithi187.stdout:4/732: mknod d2/d3/da/d2f/d4b/d7e/cde 0 2024-09-21T00:56:40.886 INFO:tasks.workunit.client.1.smithi187.stdout:4/733: chown d2/d3/da/d2f/f83 549 1 2024-09-21T00:56:40.889 INFO:tasks.workunit.client.1.smithi187.stdout:3/643: mkdir d9/d19/da7/daa/dce 0 2024-09-21T00:56:40.890 INFO:tasks.workunit.client.1.smithi187.stdout:5/659: truncate d0/dc/d1f/d26/f64 2078425 0 2024-09-21T00:56:40.891 INFO:tasks.workunit.client.1.smithi187.stdout:6/719: symlink d7/d59/lef 0 2024-09-21T00:56:40.891 INFO:tasks.workunit.client.1.smithi187.stdout:4/734: dwrite d2/d3/f33 [0,4194304] 0 2024-09-21T00:56:40.892 INFO:tasks.workunit.client.1.smithi187.stdout:6/720: chown d7/d2a/da2/fee 27 1 2024-09-21T00:56:40.893 INFO:tasks.workunit.client.1.smithi187.stdout:6/721: readlink d7/d2a/lca 0 2024-09-21T00:56:40.893 INFO:tasks.workunit.client.1.smithi187.stdout:4/735: dread - d2/d3/da/d2f/d32/d26/d66/d6e/f8e zero size 2024-09-21T00:56:40.896 INFO:tasks.workunit.client.1.smithi187.stdout:4/736: read d2/d3/f33 [4425645,80046] 0 2024-09-21T00:56:40.904 INFO:tasks.workunit.client.1.smithi187.stdout:7/646: rename d1/d18/d31/d41/d8a/fb8 to d1/d18/d31/d41/d64/d93/dc1/d73/d8b/d8f/fdb 0 2024-09-21T00:56:40.905 INFO:tasks.workunit.client.1.smithi187.stdout:7/647: stat d1/dc/d15/d22/fc2 0 2024-09-21T00:56:40.906 INFO:tasks.workunit.client.1.smithi187.stdout:1/783: creat d4/d6/d23/d2e/d94/dcb/ffd x:0 0 0 2024-09-21T00:56:40.908 INFO:tasks.workunit.client.1.smithi187.stdout:1/784: fdatasync d4/d6/d23/d2e/d94/d35/d22/d65/fbf 0 2024-09-21T00:56:40.909 INFO:tasks.workunit.client.1.smithi187.stdout:1/785: chown d4/d6/d23/d2e/d94/d35/d22/d2c/f30 410 1 2024-09-21T00:56:40.910 INFO:tasks.workunit.client.1.smithi187.stdout:8/768: link dc/d2f/d80/db8/dba/l5b dc/d2f/d54/d69/db3/l103 0 2024-09-21T00:56:40.910 INFO:tasks.workunit.client.1.smithi187.stdout:1/786: fsync d4/d6/d23/d2e/d94/d35/d22/f46 0 2024-09-21T00:56:40.912 INFO:tasks.workunit.client.1.smithi187.stdout:1/787: read - d4/d6/d23/d2e/d94/d35/d22/d2c/fc6 zero size 2024-09-21T00:56:40.913 INFO:tasks.workunit.client.1.smithi187.stdout:4/737: creat d2/d3/da/d2f/d32/d24/fdf x:0 0 0 2024-09-21T00:56:40.914 INFO:tasks.workunit.client.1.smithi187.stdout:5/660: dwrite d0/dc/d39/f9e [0,4194304] 0 2024-09-21T00:56:40.916 INFO:tasks.workunit.client.1.smithi187.stdout:9/889: creat d4/d8/d46/d54/d10f/d121/d94/dde/d102/f125 x:0 0 0 2024-09-21T00:56:40.917 INFO:tasks.workunit.client.1.smithi187.stdout:2/786: rename d2/da8/d6c/d97/da1/ld4 to d2/d3/d15/dfe/l119 0 2024-09-21T00:56:40.917 INFO:tasks.workunit.client.1.smithi187.stdout:9/890: chown d4/d13/d14/d5d/f8b 9546686 1 2024-09-21T00:56:40.917 INFO:tasks.workunit.client.1.smithi187.stdout:6/722: write d7/d2a/d29/d40/f4d [3976790,93427] 0 2024-09-21T00:56:40.918 INFO:tasks.workunit.client.1.smithi187.stdout:3/644: creat d9/d19/d9b/fcf x:0 0 0 2024-09-21T00:56:40.924 INFO:tasks.workunit.client.1.smithi187.stdout:3/645: dread d9/d7f/dcb/f48 [0,4194304] 0 2024-09-21T00:56:40.929 INFO:tasks.workunit.client.1.smithi187.stdout:3/646: dwrite d9/d7f/dcb/d20/f68 [0,4194304] 0 2024-09-21T00:56:40.931 INFO:tasks.workunit.client.1.smithi187.stdout:2/787: dwrite d2/d3/d15/f87 [0,4194304] 0 2024-09-21T00:56:40.932 INFO:tasks.workunit.client.1.smithi187.stdout:7/648: creat d1/dce/dd0/fdc x:0 0 0 2024-09-21T00:56:40.933 INFO:tasks.workunit.client.1.smithi187.stdout:8/769: write dc/d2f/d80/db8/dba/d29/f31 [4650533,1907] 0 2024-09-21T00:56:40.935 INFO:tasks.workunit.client.1.smithi187.stdout:8/770: chown dc/d44/ff7 10 1 2024-09-21T00:56:40.936 INFO:tasks.workunit.client.0.smithi112.stdout:6/172: symlink d9/d1f/d1a/l40 0 2024-09-21T00:56:40.936 INFO:tasks.workunit.client.0.smithi112.stdout:3/259: creat d2/d8/d28/f54 x:0 0 0 2024-09-21T00:56:40.937 INFO:tasks.workunit.client.1.smithi187.stdout:3/647: fdatasync d9/f12 0 2024-09-21T00:56:40.937 INFO:tasks.workunit.client.0.smithi112.stdout:4/241: creat d1/d2d/f55 x:0 0 0 2024-09-21T00:56:40.939 INFO:tasks.workunit.client.1.smithi187.stdout:0/668: rename d0/d17/d1c/d23/df/d41/d3b/f59 to d0/d17/d1c/d23/df/fe3 0 2024-09-21T00:56:40.939 INFO:tasks.workunit.client.0.smithi112.stdout:0/135: write d8/fb [1553064,85260] 0 2024-09-21T00:56:40.939 INFO:tasks.workunit.client.0.smithi112.stdout:5/70: dwrite f3 [0,4194304] 0 2024-09-21T00:56:40.940 INFO:tasks.workunit.client.0.smithi112.stdout:4/242: stat d1/c4 0 2024-09-21T00:56:40.940 INFO:tasks.workunit.client.1.smithi187.stdout:5/661: rename d0/dc/daa/d67/d14 to d0/dc/daa/d67/d14/d1b/d27/d3a/ddc 22 2024-09-21T00:56:40.940 INFO:tasks.workunit.client.1.smithi187.stdout:8/771: write dc/dea/ff9 [803781,53051] 0 2024-09-21T00:56:40.941 INFO:tasks.workunit.client.0.smithi112.stdout:4/243: chown d1/d5 47474 1 2024-09-21T00:56:40.941 INFO:tasks.workunit.client.0.smithi112.stdout:0/136: fsync d8/d1b/f2a 0 2024-09-21T00:56:40.943 INFO:tasks.workunit.client.1.smithi187.stdout:6/723: dwrite d7/ff [0,4194304] 0 2024-09-21T00:56:40.943 INFO:tasks.workunit.client.0.smithi112.stdout:5/71: dread d8/fa [0,4194304] 0 2024-09-21T00:56:40.945 INFO:tasks.workunit.client.0.smithi112.stdout:8/97: write d0/d13/f16 [3503569,102059] 0 2024-09-21T00:56:40.947 INFO:tasks.workunit.client.1.smithi187.stdout:1/788: dwrite d4/f62 [4194304,4194304] 0 2024-09-21T00:56:40.947 INFO:tasks.workunit.client.0.smithi112.stdout:4/244: stat d1/d7/d9/d1a/l2b 0 2024-09-21T00:56:40.947 INFO:tasks.workunit.client.0.smithi112.stdout:5/72: fsync d8/d9/de/df/f10 0 2024-09-21T00:56:40.948 INFO:tasks.workunit.client.0.smithi112.stdout:8/98: write d0/d13/d1b/f1e [1046482,19113] 0 2024-09-21T00:56:40.949 INFO:tasks.workunit.client.0.smithi112.stdout:8/99: stat d0/f1a 0 2024-09-21T00:56:40.950 INFO:tasks.workunit.client.1.smithi187.stdout:6/724: truncate d7/d2a/d29/d40/d45/f76 649448 0 2024-09-21T00:56:40.951 INFO:tasks.workunit.client.1.smithi187.stdout:7/649: mknod d1/d18/d31/d33/d3b/d9f/cdd 0 2024-09-21T00:56:40.953 INFO:tasks.workunit.client.1.smithi187.stdout:3/648: write d9/d19/d9b/fad [4259059,27432] 0 2024-09-21T00:56:40.953 INFO:tasks.workunit.client.1.smithi187.stdout:5/662: mknod d0/dc/daa/d67/d14/d57/d5c/db2/cdd 0 2024-09-21T00:56:40.954 INFO:tasks.workunit.client.1.smithi187.stdout:5/663: chown d0/c84 28026299 1 2024-09-21T00:56:40.955 INFO:tasks.workunit.client.1.smithi187.stdout:9/891: getdents d4/d61/d6a/d90/daa/df6 0 2024-09-21T00:56:40.955 INFO:tasks.workunit.client.0.smithi112.stdout:0/137: mkdir d8/d1b/d2c 0 2024-09-21T00:56:40.956 INFO:tasks.workunit.client.1.smithi187.stdout:0/669: dread d0/d17/d1c/d23/d36/f91 [0,4194304] 0 2024-09-21T00:56:40.956 INFO:tasks.workunit.client.0.smithi112.stdout:8/100: dwrite d0/ff [0,4194304] 0 2024-09-21T00:56:40.957 INFO:tasks.workunit.client.1.smithi187.stdout:1/789: creat d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/ffe x:0 0 0 2024-09-21T00:56:40.958 INFO:tasks.workunit.client.0.smithi112.stdout:8/101: dread - d0/f1d zero size 2024-09-21T00:56:40.962 INFO:tasks.workunit.client.0.smithi112.stdout:5/73: rename d8/d9/d11 to d8/d9/d13 0 2024-09-21T00:56:40.967 INFO:tasks.workunit.client.0.smithi112.stdout:4/245: creat d1/d7/d9/d1a/d22/f56 x:0 0 0 2024-09-21T00:56:40.971 INFO:tasks.workunit.client.1.smithi187.stdout:6/725: symlink d7/d2a/d29/d40/d50/d68/dcf/lf0 0 2024-09-21T00:56:40.973 INFO:tasks.workunit.client.0.smithi112.stdout:6/173: mkdir d9/d13/d31/d41 0 2024-09-21T00:56:40.974 INFO:tasks.workunit.client.1.smithi187.stdout:3/649: mkdir d9/d7f/dcb/dd0 0 2024-09-21T00:56:40.975 INFO:tasks.workunit.client.0.smithi112.stdout:3/260: dwrite d2/d8/dd/de/f1d [4194304,4194304] 0 2024-09-21T00:56:40.976 INFO:tasks.workunit.client.0.smithi112.stdout:0/138: rename d8/f10 to d8/d11/f2d 0 2024-09-21T00:56:40.977 INFO:tasks.workunit.client.0.smithi112.stdout:0/139: write d8/f20 [961067,67551] 0 2024-09-21T00:56:40.978 INFO:tasks.workunit.client.1.smithi187.stdout:5/664: chown d0/dc/daa/d67/cc8 663 1 2024-09-21T00:56:40.978 INFO:tasks.workunit.client.0.smithi112.stdout:8/102: chown d0/fd 7 1 2024-09-21T00:56:40.979 INFO:tasks.workunit.client.0.smithi112.stdout:8/103: fdatasync d0/f9 0 2024-09-21T00:56:40.980 INFO:tasks.workunit.client.0.smithi112.stdout:8/104: rename d0 to d0/d13/d20 22 2024-09-21T00:56:40.980 INFO:tasks.workunit.client.1.smithi187.stdout:9/892: mkdir d4/d61/d6a/d90/d126 0 2024-09-21T00:56:40.983 INFO:tasks.workunit.client.1.smithi187.stdout:1/790: symlink d4/d6/d23/d2e/d94/dae/lff 0 2024-09-21T00:56:40.984 INFO:tasks.workunit.client.0.smithi112.stdout:4/246: symlink d1/d7/l57 0 2024-09-21T00:56:40.985 INFO:tasks.workunit.client.1.smithi187.stdout:2/788: link d2/dc/d2e/d4a/d7c/d52/da3/de6/lfc d2/d3/d15/l11a 0 2024-09-21T00:56:40.987 INFO:tasks.workunit.client.0.smithi112.stdout:3/261: rmdir d2 39 2024-09-21T00:56:40.991 INFO:tasks.workunit.client.1.smithi187.stdout:6/726: dread d7/d59/feb [0,4194304] 0 2024-09-21T00:56:40.992 INFO:tasks.workunit.client.1.smithi187.stdout:7/650: link d1/dce/dd0/d97/fcf d1/d18/d31/d41/d64/d93/dc1/d73/fde 0 2024-09-21T00:56:40.994 INFO:tasks.workunit.client.0.smithi112.stdout:8/105: rename d0/f3 to d0/f21 0 2024-09-21T00:56:40.996 INFO:tasks.workunit.client.1.smithi187.stdout:9/893: mkdir d4/d8/d46/d54/d10f/d121/d94/d127 0 2024-09-21T00:56:41.000 INFO:tasks.workunit.client.0.smithi112.stdout:5/74: truncate f5 2002873 0 2024-09-21T00:56:41.001 INFO:tasks.workunit.client.0.smithi112.stdout:8/106: dwrite d0/f1a [0,4194304] 0 2024-09-21T00:56:41.004 INFO:tasks.workunit.client.1.smithi187.stdout:4/738: sync 2024-09-21T00:56:41.004 INFO:tasks.workunit.client.0.smithi112.stdout:4/247: creat d1/d2d/d34/f58 x:0 0 0 2024-09-21T00:56:41.005 INFO:tasks.workunit.client.0.smithi112.stdout:4/248: chown d1/d5 4845104 1 2024-09-21T00:56:41.005 INFO:tasks.workunit.client.1.smithi187.stdout:4/739: stat d2/d3/da/d2f/d32/d24/dcd/ca0 0 2024-09-21T00:56:41.006 INFO:tasks.workunit.client.0.smithi112.stdout:4/249: write d1/d2d/f55 [905040,95220] 0 2024-09-21T00:56:41.008 INFO:tasks.workunit.client.1.smithi187.stdout:8/772: getdents dc 0 2024-09-21T00:56:41.009 INFO:tasks.workunit.client.0.smithi112.stdout:6/174: link d9/d1f/f35 d9/d13/d2f/f42 0 2024-09-21T00:56:41.009 INFO:tasks.workunit.client.1.smithi187.stdout:2/789: fsync d2/dc/f106 0 2024-09-21T00:56:41.012 INFO:tasks.workunit.client.0.smithi112.stdout:0/140: mkdir d8/d1b/d2c/d2e 0 2024-09-21T00:56:41.012 INFO:tasks.workunit.client.1.smithi187.stdout:3/650: write d9/d7f/dcb/f54 [2377097,94563] 0 2024-09-21T00:56:41.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.012+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdcf8000bf0 con 0x7fdd04074d00 2024-09-21T00:56:41.014 INFO:tasks.workunit.client.1.smithi187.stdout:5/665: truncate d0/dc/daa/d67/f61 720218 0 2024-09-21T00:56:41.014 INFO:tasks.workunit.client.1.smithi187.stdout:0/670: dwrite d0/d17/d1c/d23/df/d41/d3b/f54 [0,4194304] 0 2024-09-21T00:56:41.016 INFO:tasks.workunit.client.1.smithi187.stdout:3/651: write d9/d7f/dcb/d87/fb8 [488750,19281] 0 2024-09-21T00:56:41.019 INFO:tasks.workunit.client.0.smithi112.stdout:5/75: fsync d8/fa 0 2024-09-21T00:56:41.019 INFO:tasks.workunit.client.1.smithi187.stdout:0/671: write d0/d17/d1c/d23/df/d41/d3b/d46/fd3 [769990,86291] 0 2024-09-21T00:56:41.021 INFO:tasks.workunit.client.1.smithi187.stdout:0/672: write d0/f9a [1567280,40162] 0 2024-09-21T00:56:41.024 INFO:tasks.workunit.client.0.smithi112.stdout:4/250: rename d1/d5/c54 to d1/d7/c59 0 2024-09-21T00:56:41.025 INFO:tasks.workunit.client.1.smithi187.stdout:4/740: mknod d2/d3/da/d2f/d32/d24/ce0 0 2024-09-21T00:56:41.026 INFO:tasks.workunit.client.1.smithi187.stdout:8/773: rename dc/d2f/d80/db8/dba/c102 to dc/d2f/d80/db8/dba/d29/c104 0 2024-09-21T00:56:41.027 INFO:tasks.workunit.client.1.smithi187.stdout:5/666: dwrite d0/dc/daa/d67/d14/fda [0,4194304] 0 2024-09-21T00:56:41.027 INFO:tasks.workunit.client.1.smithi187.stdout:3/652: dwrite d9/d19/d9b/fad [4194304,4194304] 0 2024-09-21T00:56:41.027 INFO:tasks.workunit.client.0.smithi112.stdout:6/175: symlink d9/d1f/l43 0 2024-09-21T00:56:41.028 INFO:tasks.workunit.client.0.smithi112.stdout:3/262: stat d2/ca 0 2024-09-21T00:56:41.029 INFO:tasks.workunit.client.0.smithi112.stdout:4/251: truncate d1/d7/d9/d1a/d22/f4c 914386 0 2024-09-21T00:56:41.030 INFO:tasks.workunit.client.1.smithi187.stdout:2/790: write d2/d3/d15/dfe/d2d/fe5 [1394821,109753] 0 2024-09-21T00:56:41.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.030+0000 7fdd15ffb640 1 -- 172.21.15.112:0/2109333252 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdcf8000bf0 con 0x7fdd04074d00 2024-09-21T00:56:41.030 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (6m) 20s ago 8m 25.4M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 starting - - - - 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (7m) 34s ago 7m 5263k - 19.1.1-373-g4e45e6b4 164465d2334a fcd1455bbc96 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (8m) 20s ago 8m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (7m) 34s ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 20s ago 7m 79.4M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (2m) 20s ago 2m 153M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (2m) 20s ago 2m 13.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (2m) 34s ago 2m 16.3M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (2m) 34s ago 2m 14.1M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:9283,8765,8443 running (9m) 20s ago 9m 297M - 19.1.1-373-g4e45e6b4 164465d2334a c587f79e18b3 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (59s) 34s ago 7m 564M - 19.3.0-5120-g18432218 ddce307e1f32 9ab97a4dd8af 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (9m) 20s ago 9m 53.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:56:41.031 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (7m) 34s ago 7m 39.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 20s ago 8m 15.6M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (7m) 34s ago 7m 16.5M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (5m) 20s ago 5m 72.7M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (5m) 20s ago 5m 101M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (5m) 20s ago 5m 73.6M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (4m) 34s ago 4m 80.7M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (4m) 34s ago 4m 72.1M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (3m) 34s ago 3m 86.5M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:56:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (6m) 20s ago 7m 59.0M - 2.43.0 a07b618ecd1d 67f455a0b500 2024-09-21T00:56:41.033 INFO:tasks.workunit.client.0.smithi112.stdout:4/252: stat d1/d7/d9/d1a 0 2024-09-21T00:56:41.033 INFO:tasks.workunit.client.1.smithi187.stdout:7/651: symlink d1/d55/dd7/ldf 0 2024-09-21T00:56:41.033 INFO:tasks.workunit.client.1.smithi187.stdout:2/791: readlink d2/d3/d15/l38 0 2024-09-21T00:56:41.034 INFO:tasks.workunit.client.1.smithi187.stdout:9/894: mkdir d4/d8/d46/d54/d10f/d121/d94/d122/d128 0 2024-09-21T00:56:41.034 INFO:tasks.workunit.client.1.smithi187.stdout:5/667: write d0/dc/daa/d67/d14/d38/d5a/f8d [3116025,129629] 0 2024-09-21T00:56:41.035 INFO:tasks.workunit.client.0.smithi112.stdout:8/107: dwrite d0/f21 [4194304,4194304] 0 2024-09-21T00:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.034+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fdd04074d00 msgr2=0x7fdd040771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.034+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fdd04074d00 0x7fdd040771c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd00006010 tx=0x7fdd00004260 comp rx=0 tx=0).stop 2024-09-21T00:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.034+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18101a80 msgr2=0x7fdd1819dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.034+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18101a80 0x7fdd1819dfd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800ca30 tx=0x7fdd0800cef0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.036 INFO:tasks.workunit.client.0.smithi112.stdout:8/108: chown d0/fb 58179 1 2024-09-21T00:56:41.037 INFO:tasks.workunit.client.1.smithi187.stdout:1/791: dread d4/d6/d23/f54 [0,4194304] 0 2024-09-21T00:56:41.038 INFO:tasks.workunit.client.1.smithi187.stdout:2/792: chown d2/d3/d15/dfe/d2d/d8f/f100 0 1 2024-09-21T00:56:41.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.038+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 shutdown_connections 2024-09-21T00:56:41.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.038+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fdd04074d00 0x7fdd040771c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.038+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd18101a80 0x7fdd1819dfd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.038+0000 7fdd1ef99640 1 --2- 172.21.15.112:0/2109333252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd18100d60 0x7fdd1819da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.038+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 >> 172.21.15.112:0/2109333252 conn(0x7fdd180fb750 msgr2=0x7fdd180fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.039 INFO:tasks.workunit.client.0.smithi112.stdout:6/176: rmdir d9/d13/d31 39 2024-09-21T00:56:41.040 INFO:tasks.workunit.client.1.smithi187.stdout:5/668: write d0/dc/daa/d67/d14/d38/f4f [7410129,97087] 0 2024-09-21T00:56:41.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.038+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 shutdown_connections 2024-09-21T00:56:41.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.039+0000 7fdd1ef99640 1 -- 172.21.15.112:0/2109333252 wait complete. 2024-09-21T00:56:41.041 INFO:tasks.workunit.client.1.smithi187.stdout:1/792: chown d4/d6/d23/d2e/d94/d35/d4c/d5b/l81 1531 1 2024-09-21T00:56:41.041 INFO:tasks.workunit.client.0.smithi112.stdout:8/109: dread d0/d13/f16 [0,4194304] 0 2024-09-21T00:56:41.042 INFO:tasks.workunit.client.1.smithi187.stdout:2/793: write d2/da8/fc9 [390590,40159] 0 2024-09-21T00:56:41.043 INFO:tasks.workunit.client.1.smithi187.stdout:6/727: dread d7/d2a/d29/d40/d50/d83/f87 [0,4194304] 0 2024-09-21T00:56:41.043 INFO:tasks.workunit.client.1.smithi187.stdout:4/741: dwrite d2/d3/da/d2f/d32/d22/d37/d3a/f8d [0,4194304] 0 2024-09-21T00:56:41.046 INFO:tasks.workunit.client.0.smithi112.stdout:0/141: creat d8/d11/d28/f2f x:0 0 0 2024-09-21T00:56:41.046 INFO:tasks.workunit.client.0.smithi112.stdout:0/142: truncate d8/f18 4338242 0 2024-09-21T00:56:41.046 INFO:tasks.workunit.client.1.smithi187.stdout:4/742: stat d2/d3/d56/d84/d60/d6c/f91 0 2024-09-21T00:56:41.050 INFO:tasks.workunit.client.1.smithi187.stdout:8/774: readlink dc/d44/l7e 0 2024-09-21T00:56:41.053 INFO:tasks.workunit.client.1.smithi187.stdout:3/653: dread d9/d7f/f85 [0,4194304] 0 2024-09-21T00:56:41.056 INFO:tasks.workunit.client.0.smithi112.stdout:4/253: creat d1/d7/d9/f5a x:0 0 0 2024-09-21T00:56:41.062 INFO:tasks.workunit.client.1.smithi187.stdout:7/652: symlink d1/d18/d31/d33/d3b/d9f/le0 0 2024-09-21T00:56:41.067 INFO:tasks.workunit.client.0.smithi112.stdout:4/254: dwrite d1/d2d/f55 [0,4194304] 0 2024-09-21T00:56:41.067 INFO:tasks.workunit.client.0.smithi112.stdout:5/76: dread f7 [0,4194304] 0 2024-09-21T00:56:41.069 INFO:tasks.workunit.client.0.smithi112.stdout:3/263: mknod d2/d38/d3f/d53/c55 0 2024-09-21T00:56:41.072 INFO:tasks.workunit.client.1.smithi187.stdout:0/673: write d0/d17/d1c/d65/f7d [692662,112007] 0 2024-09-21T00:56:41.073 INFO:tasks.workunit.client.1.smithi187.stdout:1/793: dread d4/f76 [0,4194304] 0 2024-09-21T00:56:41.074 INFO:tasks.workunit.client.0.smithi112.stdout:0/143: dwrite d8/fa [0,4194304] 0 2024-09-21T00:56:41.075 INFO:tasks.workunit.client.1.smithi187.stdout:5/669: creat d0/dc/daa/d67/d14/d38/d5a/fde x:0 0 0 2024-09-21T00:56:41.077 INFO:tasks.workunit.client.0.smithi112.stdout:6/177: rename d9/d1f/l43 to d9/d13/d31/d41/l44 0 2024-09-21T00:56:41.078 INFO:tasks.workunit.client.0.smithi112.stdout:9/146: sync 2024-09-21T00:56:41.078 INFO:tasks.workunit.client.0.smithi112.stdout:2/189: sync 2024-09-21T00:56:41.078 INFO:tasks.workunit.client.0.smithi112.stdout:7/172: sync 2024-09-21T00:56:41.079 INFO:tasks.workunit.client.1.smithi187.stdout:4/743: mknod d2/d3/da/d2f/d32/d26/d66/ce1 0 2024-09-21T00:56:41.081 INFO:tasks.workunit.client.1.smithi187.stdout:0/674: dread d0/d17/d1c/d23/d36/f5c [0,4194304] 0 2024-09-21T00:56:41.083 INFO:tasks.workunit.client.1.smithi187.stdout:8/775: mkdir dc/d2f/d80/db8/dba/d29/d105 0 2024-09-21T00:56:41.083 INFO:tasks.workunit.client.0.smithi112.stdout:3/264: truncate d2/d8/f16 1019303 0 2024-09-21T00:56:41.085 INFO:tasks.workunit.client.1.smithi187.stdout:5/670: dwrite d0/dc/d1f/d26/d8b/fa1 [0,4194304] 0 2024-09-21T00:56:41.086 INFO:tasks.workunit.client.0.smithi112.stdout:0/144: read d8/d11/f1c [536625,78129] 0 2024-09-21T00:56:41.087 INFO:tasks.workunit.client.0.smithi112.stdout:0/145: readlink d8/d1b/l27 0 2024-09-21T00:56:41.088 INFO:tasks.workunit.client.1.smithi187.stdout:1/794: dwrite d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 [4194304,4194304] 0 2024-09-21T00:56:41.089 INFO:tasks.workunit.client.1.smithi187.stdout:8/776: write dc/d2f/d80/db8/dba/d29/da7/fc5 [1785904,410] 0 2024-09-21T00:56:41.090 INFO:tasks.workunit.client.0.smithi112.stdout:8/110: dwrite d0/fb [0,4194304] 0 2024-09-21T00:56:41.090 INFO:tasks.workunit.client.0.smithi112.stdout:0/146: write d8/fe [1845341,46055] 0 2024-09-21T00:56:41.092 INFO:tasks.workunit.client.1.smithi187.stdout:4/744: dwrite d2/d3/da/d2f/d32/d25/fb8 [0,4194304] 0 2024-09-21T00:56:41.095 INFO:tasks.workunit.client.0.smithi112.stdout:0/147: readlink l5 0 2024-09-21T00:56:41.095 INFO:tasks.workunit.client.0.smithi112.stdout:0/148: chown d8/d11/f22 31530 1 2024-09-21T00:56:41.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/178: mkdir d9/d1b/d45 0 2024-09-21T00:56:41.099 INFO:tasks.workunit.client.0.smithi112.stdout:9/147: creat d5/d6/de/d13/f2f x:0 0 0 2024-09-21T00:56:41.100 INFO:tasks.workunit.client.0.smithi112.stdout:7/173: mknod d0/d2/c2b 0 2024-09-21T00:56:41.103 INFO:tasks.workunit.client.1.smithi187.stdout:2/794: link d2/dc/d2e/d4a/d7c/d52/da3/f112 d2/da8/d6c/d97/da1/f11b 0 2024-09-21T00:56:41.105 INFO:tasks.workunit.client.1.smithi187.stdout:6/728: sync 2024-09-21T00:56:41.106 INFO:tasks.workunit.client.0.smithi112.stdout:8/111: dwrite d0/f10 [4194304,4194304] 0 2024-09-21T00:56:41.106 INFO:tasks.workunit.client.1.smithi187.stdout:7/653: fsync d1/d18/d31/d33/f95 0 2024-09-21T00:56:41.107 INFO:tasks.workunit.client.1.smithi187.stdout:7/654: truncate d1/d55/fcc 199949 0 2024-09-21T00:56:41.108 INFO:tasks.workunit.client.0.smithi112.stdout:5/77: truncate f5 3046252 0 2024-09-21T00:56:41.112 INFO:tasks.workunit.client.0.smithi112.stdout:7/174: write d0/f19 [3103612,13992] 0 2024-09-21T00:56:41.112 INFO:tasks.workunit.client.0.smithi112.stdout:3/265: creat d2/d33/f56 x:0 0 0 2024-09-21T00:56:41.112 INFO:tasks.workunit.client.0.smithi112.stdout:5/78: write f3 [1384995,126861] 0 2024-09-21T00:56:41.115 INFO:tasks.workunit.client.0.smithi112.stdout:0/149: rmdir d8/d11/d28 39 2024-09-21T00:56:41.118 INFO:tasks.workunit.client.1.smithi187.stdout:8/777: unlink dc/d2f/f51 0 2024-09-21T00:56:41.118 INFO:tasks.workunit.client.0.smithi112.stdout:6/179: mkdir d9/d1b/d46 0 2024-09-21T00:56:41.119 INFO:tasks.workunit.client.1.smithi187.stdout:4/745: mkdir d2/d3/d74/de2 0 2024-09-21T00:56:41.121 INFO:tasks.workunit.client.0.smithi112.stdout:0/150: dread d8/fa [0,4194304] 0 2024-09-21T00:56:41.121 INFO:tasks.workunit.client.0.smithi112.stdout:8/112: mkdir d0/d13/d1b/d22 0 2024-09-21T00:56:41.124 INFO:tasks.workunit.client.0.smithi112.stdout:4/255: write d1/d5/d1c/d1e/d3d/f48 [351954,124493] 0 2024-09-21T00:56:41.126 INFO:tasks.workunit.client.1.smithi187.stdout:4/746: dwrite d2/d3/da/d2f/d4b/f6a [0,4194304] 0 2024-09-21T00:56:41.129 INFO:tasks.workunit.client.1.smithi187.stdout:5/671: creat d0/dc/daa/d67/dcc/fdf x:0 0 0 2024-09-21T00:56:41.130 INFO:tasks.workunit.client.1.smithi187.stdout:8/778: fdatasync dc/d2f/d80/db8/dba/d29/da7/fb5 0 2024-09-21T00:56:41.131 INFO:tasks.workunit.client.1.smithi187.stdout:5/672: dread - d0/dc/daa/d67/fc4 zero size 2024-09-21T00:56:41.131 INFO:tasks.workunit.client.1.smithi187.stdout:4/747: truncate d2/d3/da/d16/f3c 4952526 0 2024-09-21T00:56:41.132 INFO:tasks.workunit.client.0.smithi112.stdout:0/151: creat d8/d1b/d2c/f30 x:0 0 0 2024-09-21T00:56:41.133 INFO:tasks.workunit.client.0.smithi112.stdout:0/152: read - d8/d1b/d2c/f30 zero size 2024-09-21T00:56:41.133 INFO:tasks.workunit.client.1.smithi187.stdout:3/654: rmdir d9/d9a 0 2024-09-21T00:56:41.134 INFO:tasks.workunit.client.0.smithi112.stdout:3/266: mknod d2/c57 0 2024-09-21T00:56:41.134 INFO:tasks.workunit.client.0.smithi112.stdout:1/132: sync 2024-09-21T00:56:41.135 INFO:tasks.workunit.client.1.smithi187.stdout:7/655: dwrite d1/d18/d31/d33/d3b/f66 [0,4194304] 0 2024-09-21T00:56:41.135 INFO:tasks.workunit.client.0.smithi112.stdout:3/267: dread - d2/d8/d28/f3c zero size 2024-09-21T00:56:41.135 INFO:tasks.workunit.client.0.smithi112.stdout:1/133: stat d5/d8/d13/c24 0 2024-09-21T00:56:41.136 INFO:tasks.workunit.client.1.smithi187.stdout:6/729: mknod d7/d2a/d29/d40/d5e/cf1 0 2024-09-21T00:56:41.136 INFO:tasks.workunit.client.0.smithi112.stdout:7/175: symlink d0/l2c 0 2024-09-21T00:56:41.136 INFO:tasks.workunit.client.0.smithi112.stdout:5/79: dread d8/d9/de/f12 [0,4194304] 0 2024-09-21T00:56:41.137 INFO:tasks.workunit.client.1.smithi187.stdout:3/655: chown d9/d7f/dcb/d20/c6c 236936 1 2024-09-21T00:56:41.137 INFO:tasks.workunit.client.1.smithi187.stdout:7/656: stat d1/d18/d31/d41 0 2024-09-21T00:56:41.138 INFO:tasks.workunit.client.1.smithi187.stdout:1/795: creat d4/f100 x:0 0 0 2024-09-21T00:56:41.139 INFO:tasks.workunit.client.0.smithi112.stdout:4/256: creat d1/d5/d1c/f5b x:0 0 0 2024-09-21T00:56:41.140 INFO:tasks.workunit.client.1.smithi187.stdout:3/656: write d9/d19/d1c/d5f/f60 [2634078,103042] 0 2024-09-21T00:56:41.141 INFO:tasks.workunit.client.1.smithi187.stdout:4/748: dread d2/d3/da/d48/f9c [0,4194304] 0 2024-09-21T00:56:41.141 INFO:tasks.workunit.client.1.smithi187.stdout:4/749: stat d2/d3/da/fc 0 2024-09-21T00:56:41.142 INFO:tasks.workunit.client.1.smithi187.stdout:3/657: dread - d9/d7f/dcb/d87/d94/d89/f93 zero size 2024-09-21T00:56:41.143 INFO:tasks.workunit.client.1.smithi187.stdout:4/750: stat d2/d3/da/d2f 0 2024-09-21T00:56:41.145 INFO:tasks.workunit.client.1.smithi187.stdout:6/730: dread d7/f84 [0,4194304] 0 2024-09-21T00:56:41.146 INFO:tasks.workunit.client.0.smithi112.stdout:2/190: getdents d0 0 2024-09-21T00:56:41.147 INFO:tasks.workunit.client.1.smithi187.stdout:4/751: write d2/d3/da/d2f/d32/d24/dcd/f69 [1280172,34607] 0 2024-09-21T00:56:41.148 INFO:tasks.workunit.client.1.smithi187.stdout:1/796: dwrite d4/d6/d23/d2e/d94/d35/d4c/f5f [0,4194304] 0 2024-09-21T00:56:41.148 INFO:tasks.workunit.client.0.smithi112.stdout:2/191: truncate d0/d14/d8/d27/f38 61776 0 2024-09-21T00:56:41.150 INFO:tasks.workunit.client.1.smithi187.stdout:1/797: dread - d4/d6/d23/d2e/d94/d35/d22/d2c/fc6 zero size 2024-09-21T00:56:41.150 INFO:tasks.workunit.client.0.smithi112.stdout:4/257: dwrite d1/d2d/f55 [0,4194304] 0 2024-09-21T00:56:41.151 INFO:tasks.workunit.client.0.smithi112.stdout:2/192: read d0/fe [165526,12624] 0 2024-09-21T00:56:41.151 INFO:tasks.workunit.client.0.smithi112.stdout:8/113: creat d0/d13/d1b/d22/f23 x:0 0 0 2024-09-21T00:56:41.153 INFO:tasks.workunit.client.1.smithi187.stdout:0/675: dread d0/d17/d1c/d23/df/f32 [0,4194304] 0 2024-09-21T00:56:41.153 INFO:tasks.workunit.client.0.smithi112.stdout:9/148: link d5/d6/de/f2e d5/d6/f30 0 2024-09-21T00:56:41.153 INFO:tasks.workunit.client.0.smithi112.stdout:8/114: write d0/ff [2465240,48197] 0 2024-09-21T00:56:41.154 INFO:tasks.workunit.client.0.smithi112.stdout:4/258: chown d1/d5/d1c 6919418 1 2024-09-21T00:56:41.155 INFO:tasks.workunit.client.0.smithi112.stdout:9/149: chown d5/c2d 145852 1 2024-09-21T00:56:41.155 INFO:tasks.workunit.client.1.smithi187.stdout:9/895: truncate d4/d13/d14/d5d/f8b 374241 0 2024-09-21T00:56:41.156 INFO:tasks.workunit.client.1.smithi187.stdout:9/896: chown d4/d13/d14/d1d 1194939741 1 2024-09-21T00:56:41.158 INFO:tasks.workunit.client.0.smithi112.stdout:0/153: write d8/d11/d28/f2f [144478,46627] 0 2024-09-21T00:56:41.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:40 smithi187 ceph-mon[34997]: pgmap v23: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 35 MiB/s rd, 163 MiB/s wr, 316 op/s 2024-09-21T00:56:41.159 INFO:tasks.workunit.client.1.smithi187.stdout:2/795: getdents d2/dc/d2e/d51 0 2024-09-21T00:56:41.164 INFO:tasks.workunit.client.0.smithi112.stdout:9/150: dwrite d5/d6/d19/f2a [4194304,4194304] 0 2024-09-21T00:56:41.166 INFO:tasks.workunit.client.0.smithi112.stdout:9/151: read - d5/d6/f30 zero size 2024-09-21T00:56:41.170 INFO:tasks.workunit.client.0.smithi112.stdout:5/80: mknod d8/d9/de/df/c14 0 2024-09-21T00:56:41.171 INFO:tasks.workunit.client.0.smithi112.stdout:1/134: dwrite d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:41.173 INFO:tasks.workunit.client.1.smithi187.stdout:5/673: dread d0/dc/daa/d67/f32 [0,4194304] 0 2024-09-21T00:56:41.175 INFO:tasks.workunit.client.1.smithi187.stdout:6/731: creat d7/d2a/d29/d40/d6a/d9e/ff2 x:0 0 0 2024-09-21T00:56:41.178 INFO:tasks.workunit.client.0.smithi112.stdout:5/81: dwrite d8/d9/de/df/f10 [0,4194304] 0 2024-09-21T00:56:41.179 INFO:tasks.workunit.client.0.smithi112.stdout:5/82: chown d8/cb 0 1 2024-09-21T00:56:41.180 INFO:tasks.workunit.client.0.smithi112.stdout:5/83: chown d8/d9/de 187739362 1 2024-09-21T00:56:41.181 INFO:tasks.workunit.client.1.smithi187.stdout:7/657: mknod d1/d18/d31/d41/d64/d93/dc1/d73/dc8/ce1 0 2024-09-21T00:56:41.185 INFO:tasks.workunit.client.1.smithi187.stdout:1/798: rename d4/d6/d23/d2e/d94/d66/cb4 to d4/d6/d23/d2e/d94/d35/d22/d65/c101 0 2024-09-21T00:56:41.185 INFO:tasks.workunit.client.0.smithi112.stdout:6/180: write d9/d13/d2f/d34/f36 [231316,108141] 0 2024-09-21T00:56:41.187 INFO:tasks.workunit.client.0.smithi112.stdout:2/193: rename d0/d14/d8/l25 to d0/d14/l3d 0 2024-09-21T00:56:41.188 INFO:tasks.workunit.client.1.smithi187.stdout:8/779: read dc/d44/f71 [447972,12562] 0 2024-09-21T00:56:41.189 INFO:tasks.workunit.client.1.smithi187.stdout:4/752: dwrite d2/d3/da/d2f/d4b/f7a [0,4194304] 0 2024-09-21T00:56:41.190 INFO:tasks.workunit.client.1.smithi187.stdout:0/676: creat d0/d17/d18/d90/d98/fe4 x:0 0 0 2024-09-21T00:56:41.190 INFO:tasks.workunit.client.0.smithi112.stdout:2/194: dread d0/d14/d8/d27/f38 [0,4194304] 0 2024-09-21T00:56:41.191 INFO:tasks.workunit.client.1.smithi187.stdout:1/799: write d4/d6/d23/d2e/f7a [955132,88095] 0 2024-09-21T00:56:41.194 INFO:tasks.workunit.client.1.smithi187.stdout:7/658: dwrite d1/f37 [0,4194304] 0 2024-09-21T00:56:41.195 INFO:tasks.workunit.client.1.smithi187.stdout:2/796: symlink d2/da8/d6c/d97/l11c 0 2024-09-21T00:56:41.199 INFO:tasks.workunit.client.1.smithi187.stdout:3/658: unlink d9/d7f/dcb/d87/d94/d53/d56/f8e 0 2024-09-21T00:56:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 -- 172.21.15.112:0/2157463307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 msgr2=0x7f8180101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 --2- 172.21.15.112:0/2157463307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 0x7f8180101f10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8170009880 tx=0x7f817002a4d0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 -- 172.21.15.112:0/2157463307 shutdown_connections 2024-09-21T00:56:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 --2- 172.21.15.112:0/2157463307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 0x7f8180101f10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 --2- 172.21.15.112:0/2157463307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8180100890 0x7f8180100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 -- 172.21.15.112:0/2157463307 >> 172.21.15.112:0/2157463307 conn(0x7f81800fc040 msgr2=0x7f81800fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 -- 172.21.15.112:0/2157463307 shutdown_connections 2024-09-21T00:56:41.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.201+0000 7f81875c4640 1 -- 172.21.15.112:0/2157463307 wait complete. 2024-09-21T00:56:41.203 INFO:tasks.workunit.client.1.smithi187.stdout:5/674: rename d0/dc/d1f/d26/c33 to d0/dc/daa/d67/d14/d1b/d27/dc7/ce0 0 2024-09-21T00:56:41.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.203+0000 7f81875c4640 1 Processor -- start 2024-09-21T00:56:41.205 INFO:tasks.workunit.client.1.smithi187.stdout:8/780: dwrite dc/d2f/f41 [0,4194304] 0 2024-09-21T00:56:41.205 INFO:tasks.workunit.client.1.smithi187.stdout:0/677: dwrite d0/d17/d18/d3a/f77 [8388608,4194304] 0 2024-09-21T00:56:41.206 INFO:tasks.workunit.client.1.smithi187.stdout:8/781: chown dc/d2f/d34/d4b/fdb 3735406 1 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.203+0000 7f81875c4640 1 -- start start 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.204+0000 7f81875c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8180100890 0x7f8180196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.204+0000 7f81875c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 0x7f8180196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.204+0000 7f81875c4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8180109750 con 0x7f8180101a90 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.205+0000 7f8185360640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8180100890 0x7f8180196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.205+0000 7f8185360640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8180100890 0x7f8180196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:41642/0 (socket says 172.21.15.112:41642) 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.205+0000 7f8185360640 1 -- 172.21.15.112:0/4076006307 learned_addr learned my addr 172.21.15.112:0/4076006307 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.205+0000 7f8184b5f640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 0x7f8180196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.205+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f81801095d0 con 0x7f8180100890 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.206+0000 7f8184b5f640 1 -- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8180100890 msgr2=0x7f8180196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.206+0000 7f8184b5f640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8180100890 0x7f8180196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.206+0000 7f8184b5f640 1 -- 172.21.15.112:0/4076006307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8180197000 con 0x7f8180101a90 2024-09-21T00:56:41.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.206+0000 7f8184b5f640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 0x7f8180196980 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8170009230 tx=0x7f81700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.207+0000 7f81767fc640 1 -- 172.21.15.112:0/4076006307 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8170035070 con 0x7f8180101a90 2024-09-21T00:56:41.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.207+0000 7f81767fc640 1 -- 172.21.15.112:0/4076006307 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81700044d0 con 0x7f8180101a90 2024-09-21T00:56:41.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.207+0000 7f81767fc640 1 -- 172.21.15.112:0/4076006307 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8170003ba0 con 0x7f8180101a90 2024-09-21T00:56:41.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.207+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818006a350 con 0x7f8180101a90 2024-09-21T00:56:41.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.207+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818006a960 con 0x7f8180101a90 2024-09-21T00:56:41.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.210+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8180100c90 con 0x7f8180101a90 2024-09-21T00:56:41.211 INFO:tasks.workunit.client.1.smithi187.stdout:4/753: rmdir d2/d3/da/d2f/d32/d22 39 2024-09-21T00:56:41.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.212+0000 7f81767fc640 1 -- 172.21.15.112:0/4076006307 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f817003a670 con 0x7f8180101a90 2024-09-21T00:56:41.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.213+0000 7f81767fc640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f816c074a80 0x7f816c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.213+0000 7f81767fc640 1 -- 172.21.15.112:0/4076006307 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7f8170040070 con 0x7f8180101a90 2024-09-21T00:56:41.214 INFO:tasks.workunit.client.1.smithi187.stdout:1/800: creat d4/d6/d23/d2e/d94/d35/d22/d65/f102 x:0 0 0 2024-09-21T00:56:41.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.213+0000 7f8185360640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f816c074a80 0x7f816c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.215+0000 7f8185360640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f816c074a80 0x7f816c076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f817c006fd0 tx=0x7f817c008040 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.215 INFO:tasks.workunit.client.0.smithi112.stdout:7/176: mknod d0/d8/d1a/d23/c2d 0 2024-09-21T00:56:41.216 INFO:tasks.workunit.client.1.smithi187.stdout:2/797: symlink d2/d3/d15/dfe/l11d 0 2024-09-21T00:56:41.217 INFO:tasks.workunit.client.0.smithi112.stdout:1/135: symlink d5/l2b 0 2024-09-21T00:56:41.218 INFO:tasks.workunit.client.0.smithi112.stdout:1/136: fsync d5/d8/d10/f1d 0 2024-09-21T00:56:41.219 INFO:tasks.workunit.client.1.smithi187.stdout:3/659: mkdir d9/d7f/dcb/d87/d94/dd1 0 2024-09-21T00:56:41.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.221+0000 7f81767fc640 1 -- 172.21.15.112:0/4076006307 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8170085fc0 con 0x7f8180101a90 2024-09-21T00:56:41.221 INFO:tasks.workunit.client.0.smithi112.stdout:6/181: chown d9/d1f/c24 1 1 2024-09-21T00:56:41.222 INFO:tasks.workunit.client.0.smithi112.stdout:6/182: fdatasync d9/d13/d2f/d34/f36 0 2024-09-21T00:56:41.225 INFO:tasks.workunit.client.0.smithi112.stdout:5/84: rename d8/d9/de/df/c14 to d8/d9/d13/c15 0 2024-09-21T00:56:41.227 INFO:tasks.workunit.client.0.smithi112.stdout:6/183: dread d9/d1f/d1a/d33/f3c [0,4194304] 0 2024-09-21T00:56:41.227 INFO:tasks.workunit.client.1.smithi187.stdout:6/732: rename d7/d2a/d29/d40/d50/d68/fa9 to d7/d2a/d29/d40/d6a/da1/ff3 0 2024-09-21T00:56:41.228 INFO:tasks.workunit.client.1.smithi187.stdout:6/733: dread - d7/d2a/d29/d40/d5e/fb5 zero size 2024-09-21T00:56:41.229 INFO:tasks.workunit.client.1.smithi187.stdout:0/678: fsync d0/d17/d1c/d23/df/f32 0 2024-09-21T00:56:41.231 INFO:tasks.workunit.client.0.smithi112.stdout:2/195: creat d0/d14/f3e x:0 0 0 2024-09-21T00:56:41.232 INFO:tasks.workunit.client.1.smithi187.stdout:9/897: creat d4/d13/f129 x:0 0 0 2024-09-21T00:56:41.232 INFO:tasks.workunit.client.0.smithi112.stdout:4/259: dwrite d1/d5/d1c/d1e/f31 [0,4194304] 0 2024-09-21T00:56:41.233 INFO:tasks.workunit.client.0.smithi112.stdout:2/196: stat d0/d14/f19 0 2024-09-21T00:56:41.234 INFO:tasks.workunit.client.0.smithi112.stdout:2/197: chown d0/df/c29 366098 1 2024-09-21T00:56:41.239 INFO:tasks.workunit.client.1.smithi187.stdout:4/754: creat d2/d3/da/d2f/d32/d24/fe3 x:0 0 0 2024-09-21T00:56:41.240 INFO:tasks.workunit.client.0.smithi112.stdout:4/260: dwrite d1/d7/d9/f5a [0,4194304] 0 2024-09-21T00:56:41.240 INFO:tasks.workunit.client.0.smithi112.stdout:8/115: truncate d0/d13/f16 3676190 0 2024-09-21T00:56:41.241 INFO:tasks.workunit.client.0.smithi112.stdout:8/116: readlink d0/d13/l17 0 2024-09-21T00:56:41.241 INFO:tasks.workunit.client.0.smithi112.stdout:4/261: write d1/d5/d1c/d1e/d3d/f48 [593782,62259] 0 2024-09-21T00:56:41.244 INFO:tasks.workunit.client.1.smithi187.stdout:2/798: write d2/d25/f43 [530517,46136] 0 2024-09-21T00:56:41.246 INFO:tasks.workunit.client.0.smithi112.stdout:3/268: creat d2/f58 x:0 0 0 2024-09-21T00:56:41.246 INFO:tasks.workunit.client.1.smithi187.stdout:2/799: chown d2/dc/d2e/d4a/d7c/f45 7732412 1 2024-09-21T00:56:41.247 INFO:tasks.workunit.client.1.smithi187.stdout:1/801: dwrite d4/d6/d23/d2e/d94/d35/f6e [0,4194304] 0 2024-09-21T00:56:41.251 INFO:tasks.workunit.client.1.smithi187.stdout:6/734: dread d7/d2a/f5b [0,4194304] 0 2024-09-21T00:56:41.251 INFO:tasks.workunit.client.1.smithi187.stdout:7/659: rename d1/dce/dd0/d97/fcf to d1/dce/dd4/fe2 0 2024-09-21T00:56:41.252 INFO:tasks.workunit.client.0.smithi112.stdout:3/269: dwrite d2/d38/f44 [0,4194304] 0 2024-09-21T00:56:41.253 INFO:tasks.workunit.client.1.smithi187.stdout:6/735: write d7/d2a/f5b [1560243,122695] 0 2024-09-21T00:56:41.253 INFO:tasks.workunit.client.1.smithi187.stdout:6/736: readlink d7/l61 0 2024-09-21T00:56:41.254 INFO:tasks.workunit.client.0.smithi112.stdout:7/177: mkdir d0/d2/d2e 0 2024-09-21T00:56:41.262 INFO:tasks.workunit.client.0.smithi112.stdout:5/85: creat d8/d9/d13/f16 x:0 0 0 2024-09-21T00:56:41.263 INFO:tasks.workunit.client.1.smithi187.stdout:0/679: creat d0/d17/d1c/d65/fe5 x:0 0 0 2024-09-21T00:56:41.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/86: chown d8/d9/de/df/f10 1820351763 1 2024-09-21T00:56:41.266 INFO:tasks.workunit.client.0.smithi112.stdout:6/184: rename d9/d13/d2f to d9/d1f/d47 0 2024-09-21T00:56:41.268 INFO:tasks.workunit.client.1.smithi187.stdout:2/800: unlink d2/d3/d15/dfe/d2d/d8f/c10c 0 2024-09-21T00:56:41.270 INFO:tasks.workunit.client.1.smithi187.stdout:1/802: creat d4/d75/f103 x:0 0 0 2024-09-21T00:56:41.271 INFO:tasks.workunit.client.1.smithi187.stdout:1/803: write d4/d6/d23/d2e/d94/d35/d4c/f4d [7349941,20086] 0 2024-09-21T00:56:41.273 INFO:tasks.workunit.client.1.smithi187.stdout:3/660: rename d9/d7f/dcb/d87/d94/d89/fc6 to d9/d19/da7/daa/dce/fd2 0 2024-09-21T00:56:41.275 INFO:tasks.workunit.client.0.smithi112.stdout:0/154: creat d8/f31 x:0 0 0 2024-09-21T00:56:41.276 INFO:tasks.workunit.client.0.smithi112.stdout:0/155: fsync d8/d11/f26 0 2024-09-21T00:56:41.276 INFO:tasks.workunit.client.1.smithi187.stdout:1/804: dwrite d4/d6/d23/fb2 [0,4194304] 0 2024-09-21T00:56:41.277 INFO:tasks.workunit.client.0.smithi112.stdout:0/156: chown d8/d11/f1a 4544092 1 2024-09-21T00:56:41.277 INFO:tasks.workunit.client.1.smithi187.stdout:6/737: unlink d7/d2a/d29/d40/d50/fc9 0 2024-09-21T00:56:41.277 INFO:tasks.workunit.client.0.smithi112.stdout:0/157: dread - d8/d11/f15 zero size 2024-09-21T00:56:41.278 INFO:tasks.workunit.client.1.smithi187.stdout:1/805: fsync d4/d6/d23/d2e/d94/d35/d22/f7b 0 2024-09-21T00:56:41.282 INFO:tasks.workunit.client.1.smithi187.stdout:1/806: dread d4/d6/d23/d2e/d94/f13 [0,4194304] 0 2024-09-21T00:56:41.285 INFO:tasks.workunit.client.0.smithi112.stdout:9/152: link d5/f16 d5/d6/de/f31 0 2024-09-21T00:56:41.292 INFO:tasks.workunit.client.0.smithi112.stdout:5/87: mknod d8/d9/de/df/c17 0 2024-09-21T00:56:41.294 INFO:tasks.workunit.client.1.smithi187.stdout:1/807: dread d4/d6/f1c [4194304,4194304] 0 2024-09-21T00:56:41.297 INFO:tasks.workunit.client.0.smithi112.stdout:0/158: creat d8/d1b/f32 x:0 0 0 2024-09-21T00:56:41.298 INFO:tasks.workunit.client.0.smithi112.stdout:4/262: mknod d1/d5/d1c/d1e/d4a/c5c 0 2024-09-21T00:56:41.298 INFO:tasks.workunit.client.1.smithi187.stdout:1/808: dwrite d4/f100 [0,4194304] 0 2024-09-21T00:56:41.299 INFO:tasks.workunit.client.0.smithi112.stdout:9/153: creat d5/d6/d19/d1b/f32 x:0 0 0 2024-09-21T00:56:41.300 INFO:tasks.workunit.client.0.smithi112.stdout:9/154: fsync d5/d6/d19/f28 0 2024-09-21T00:56:41.301 INFO:tasks.workunit.client.0.smithi112.stdout:9/155: truncate f3 8988308 0 2024-09-21T00:56:41.302 INFO:tasks.workunit.client.0.smithi112.stdout:1/137: link d5/d8/dd/c18 d5/d8/dd/c2c 0 2024-09-21T00:56:41.303 INFO:tasks.workunit.client.0.smithi112.stdout:1/138: write d5/d8/d10/f16 [232072,62378] 0 2024-09-21T00:56:41.306 INFO:tasks.workunit.client.0.smithi112.stdout:1/139: write d5/d8/d10/f1d [1602356,47566] 0 2024-09-21T00:56:41.307 INFO:tasks.workunit.client.0.smithi112.stdout:6/185: creat d9/d1b/d23/f48 x:0 0 0 2024-09-21T00:56:41.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/159: symlink d8/d1b/d2c/l33 0 2024-09-21T00:56:41.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/160: dread - d8/d11/f26 zero size 2024-09-21T00:56:41.316 INFO:tasks.workunit.client.0.smithi112.stdout:9/156: unlink d5/c2d 0 2024-09-21T00:56:41.317 INFO:tasks.workunit.client.0.smithi112.stdout:9/157: write d5/d6/d19/f2a [2308554,17280] 0 2024-09-21T00:56:41.320 INFO:tasks.workunit.client.0.smithi112.stdout:6/186: rmdir d9/d13/d31/d41 39 2024-09-21T00:56:41.322 INFO:tasks.workunit.client.0.smithi112.stdout:8/117: getdents d0/d13/d1b/d22 0 2024-09-21T00:56:41.323 INFO:tasks.workunit.client.0.smithi112.stdout:8/118: chown d0/d13/c15 1082871 1 2024-09-21T00:56:41.326 INFO:tasks.workunit.client.0.smithi112.stdout:8/119: write d0/d13/f19 [1139,75537] 0 2024-09-21T00:56:41.327 INFO:tasks.workunit.client.0.smithi112.stdout:4/263: rename d1/d2d/l43 to d1/l5d 0 2024-09-21T00:56:41.328 INFO:tasks.workunit.client.0.smithi112.stdout:8/120: write d0/d13/d1b/d22/f23 [645268,60657] 0 2024-09-21T00:56:41.329 INFO:tasks.workunit.client.0.smithi112.stdout:7/178: link d0/lb d0/d8/d1a/l2f 0 2024-09-21T00:56:41.335 INFO:tasks.workunit.client.0.smithi112.stdout:6/187: creat d9/df/d19/f49 x:0 0 0 2024-09-21T00:56:41.337 INFO:tasks.workunit.client.0.smithi112.stdout:5/88: dwrite d8/fa [0,4194304] 0 2024-09-21T00:56:41.345 INFO:tasks.workunit.client.0.smithi112.stdout:5/89: rmdir d8/d9 39 2024-09-21T00:56:41.348 INFO:tasks.workunit.client.0.smithi112.stdout:7/179: symlink d0/d2/d2e/l30 0 2024-09-21T00:56:41.351 INFO:tasks.workunit.client.0.smithi112.stdout:0/161: dwrite d8/fa [0,4194304] 0 2024-09-21T00:56:41.352 INFO:tasks.workunit.client.0.smithi112.stdout:0/162: dread - d8/d1b/f2a zero size 2024-09-21T00:56:41.353 INFO:tasks.workunit.client.0.smithi112.stdout:6/188: chown d9/d13/d31/d41/l44 93057 1 2024-09-21T00:56:41.354 INFO:tasks.workunit.client.0.smithi112.stdout:6/189: readlink d9/l30 0 2024-09-21T00:56:41.357 INFO:tasks.workunit.client.1.smithi187.stdout:5/675: sync 2024-09-21T00:56:41.358 INFO:tasks.workunit.client.0.smithi112.stdout:7/180: creat d0/d2/f31 x:0 0 0 2024-09-21T00:56:41.359 INFO:tasks.workunit.client.0.smithi112.stdout:9/158: getdents d5/d6/d19/d1b 0 2024-09-21T00:56:41.360 INFO:tasks.workunit.client.0.smithi112.stdout:9/159: fdatasync d5/d6/d19/d1b/f21 0 2024-09-21T00:56:41.361 INFO:tasks.workunit.client.0.smithi112.stdout:0/163: creat d8/d1b/d2c/f34 x:0 0 0 2024-09-21T00:56:41.362 INFO:tasks.workunit.client.0.smithi112.stdout:0/164: chown d8/d1b 3 1 2024-09-21T00:56:41.363 INFO:tasks.workunit.client.0.smithi112.stdout:6/190: unlink d9/f25 0 2024-09-21T00:56:41.364 INFO:tasks.workunit.client.1.smithi187.stdout:8/782: link dc/d2f/d54/c64 dc/d2f/d54/d69/de8/c106 0 2024-09-21T00:56:41.365 INFO:tasks.workunit.client.0.smithi112.stdout:5/90: creat d8/d9/de/f18 x:0 0 0 2024-09-21T00:56:41.366 INFO:tasks.workunit.client.1.smithi187.stdout:0/680: mkdir d0/d60/d6b/d9f/de6 0 2024-09-21T00:56:41.366 INFO:tasks.workunit.client.0.smithi112.stdout:7/181: rmdir d0/d2 39 2024-09-21T00:56:41.367 INFO:tasks.workunit.client.0.smithi112.stdout:9/160: creat d5/d6/d19/f33 x:0 0 0 2024-09-21T00:56:41.368 INFO:tasks.workunit.client.0.smithi112.stdout:0/165: fsync d8/d11/f1e 0 2024-09-21T00:56:41.370 INFO:tasks.workunit.client.1.smithi187.stdout:2/801: dwrite d2/dc/d2e/d4a/d7c/f37 [0,4194304] 0 2024-09-21T00:56:41.372 INFO:tasks.workunit.client.0.smithi112.stdout:5/91: symlink d8/d9/de/l19 0 2024-09-21T00:56:41.373 INFO:tasks.workunit.client.0.smithi112.stdout:7/182: chown d0/d2/f31 3 1 2024-09-21T00:56:41.374 INFO:tasks.workunit.client.1.smithi187.stdout:3/661: read d9/f37 [101235,17117] 0 2024-09-21T00:56:41.375 INFO:tasks.workunit.client.1.smithi187.stdout:4/755: rename d2/d3/da/l31 to d2/d3/d56/d84/le4 0 2024-09-21T00:56:41.379 INFO:tasks.workunit.client.1.smithi187.stdout:6/738: fsync d7/d2a/d29/f43 0 2024-09-21T00:56:41.380 INFO:tasks.workunit.client.0.smithi112.stdout:7/183: rmdir d0/d8/d1a/d23 39 2024-09-21T00:56:41.384 INFO:tasks.workunit.client.0.smithi112.stdout:6/191: link d9/d1f/d1a/l40 d9/d1b/d23/l4a 0 2024-09-21T00:56:41.388 INFO:tasks.workunit.client.1.smithi187.stdout:1/809: rmdir d4/d75 39 2024-09-21T00:56:41.389 INFO:tasks.workunit.client.1.smithi187.stdout:1/810: stat d4/d6/d23/d2e/d94/d35 0 2024-09-21T00:56:41.390 INFO:tasks.workunit.client.0.smithi112.stdout:0/166: link d8/d1b/f32 d8/f35 0 2024-09-21T00:56:41.391 INFO:tasks.workunit.client.0.smithi112.stdout:7/184: dread d0/fa [0,4194304] 0 2024-09-21T00:56:41.392 INFO:tasks.workunit.client.0.smithi112.stdout:6/192: mkdir d9/df/d4b 0 2024-09-21T00:56:41.394 INFO:tasks.workunit.client.0.smithi112.stdout:0/167: dread d8/d11/f13 [4194304,4194304] 0 2024-09-21T00:56:41.395 INFO:tasks.workunit.client.1.smithi187.stdout:0/681: mknod d0/d60/d6b/d9f/ce7 0 2024-09-21T00:56:41.397 INFO:tasks.workunit.client.1.smithi187.stdout:0/682: read d0/d17/d1c/d65/f9d [413464,102670] 0 2024-09-21T00:56:41.398 INFO:tasks.workunit.client.1.smithi187.stdout:8/783: dwrite dc/fb0 [0,4194304] 0 2024-09-21T00:56:41.399 INFO:tasks.workunit.client.1.smithi187.stdout:0/683: write d0/d17/d18/d90/fbf [573777,87891] 0 2024-09-21T00:56:41.401 INFO:tasks.workunit.client.1.smithi187.stdout:7/660: creat d1/dc/d15/fe3 x:0 0 0 2024-09-21T00:56:41.402 INFO:tasks.workunit.client.1.smithi187.stdout:4/756: dread - d2/d3/da/d2f/d32/d22/d37/fdc zero size 2024-09-21T00:56:41.403 INFO:tasks.workunit.client.1.smithi187.stdout:4/757: read - d2/d3/d56/d84/d60/d9e/fac zero size 2024-09-21T00:56:41.405 INFO:tasks.workunit.client.1.smithi187.stdout:6/739: creat d7/d2a/d29/d40/d6a/d9e/ff4 x:0 0 0 2024-09-21T00:56:41.407 INFO:tasks.workunit.client.1.smithi187.stdout:1/811: creat d4/d6/d23/d2e/d94/d35/d79/f104 x:0 0 0 2024-09-21T00:56:41.412 INFO:tasks.workunit.client.1.smithi187.stdout:7/661: creat d1/d18/d31/d41/d64/d93/fe4 x:0 0 0 2024-09-21T00:56:41.413 INFO:tasks.workunit.client.1.smithi187.stdout:4/758: stat d2/d3/d74/d98/dc2/cd3 0 2024-09-21T00:56:41.414 INFO:tasks.workunit.client.1.smithi187.stdout:6/740: creat d7/d2a/d29/d40/d50/d68/ff5 x:0 0 0 2024-09-21T00:56:41.414 INFO:tasks.workunit.client.1.smithi187.stdout:5/676: symlink d0/dc/dbe/le1 0 2024-09-21T00:56:41.415 INFO:tasks.workunit.client.1.smithi187.stdout:1/812: creat d4/d6/d23/d2e/d94/d6c/f105 x:0 0 0 2024-09-21T00:56:41.416 INFO:tasks.workunit.client.1.smithi187.stdout:2/802: dwrite d2/da8/d6c/db8/d40/feb [0,4194304] 0 2024-09-21T00:56:41.421 INFO:tasks.workunit.client.1.smithi187.stdout:7/662: unlink d1/d18/l2a 0 2024-09-21T00:56:41.422 INFO:tasks.workunit.client.1.smithi187.stdout:4/759: symlink d2/d3/d56/d84/d60/le5 0 2024-09-21T00:56:41.424 INFO:tasks.workunit.client.1.smithi187.stdout:3/662: link d9/d7f/fbd d9/d7f/dcb/d87/d94/d53/d56/fd3 0 2024-09-21T00:56:41.425 INFO:tasks.workunit.client.1.smithi187.stdout:1/813: dwrite d4/d86/f8e [0,4194304] 0 2024-09-21T00:56:41.429 INFO:tasks.workunit.client.1.smithi187.stdout:2/803: dwrite d2/da8/d6c/db8/f74 [0,4194304] 0 2024-09-21T00:56:41.430 INFO:tasks.workunit.client.1.smithi187.stdout:4/760: truncate d2/d3/d56/d84/d60/d6c/d77/fae 1114457 0 2024-09-21T00:56:41.435 INFO:tasks.workunit.client.1.smithi187.stdout:8/784: getdents dc/d2f/d80/db8/dba/d29/da7 0 2024-09-21T00:56:41.437 INFO:tasks.workunit.client.1.smithi187.stdout:2/804: mkdir d2/dc/d2e/d51/dc5/ddf/d10a/d11e 0 2024-09-21T00:56:41.438 INFO:tasks.workunit.client.1.smithi187.stdout:2/805: readlink d2/d3/d15/dfe/dc6/lfd 0 2024-09-21T00:56:41.443 INFO:tasks.workunit.client.1.smithi187.stdout:5/677: truncate d0/f75 576935 0 2024-09-21T00:56:41.444 INFO:tasks.workunit.client.1.smithi187.stdout:6/741: getdents d7/d59 0 2024-09-21T00:56:41.467 INFO:tasks.workunit.client.0.smithi112.stdout:6/193: truncate d9/d1f/d47/f42 78018 0 2024-09-21T00:56:41.469 INFO:tasks.workunit.client.0.smithi112.stdout:0/168: write d8/d11/f2d [1573771,101243] 0 2024-09-21T00:56:41.470 INFO:tasks.workunit.client.1.smithi187.stdout:9/898: sync 2024-09-21T00:56:41.471 INFO:tasks.workunit.client.0.smithi112.stdout:0/169: creat d8/d1b/f36 x:0 0 0 2024-09-21T00:56:41.483 INFO:tasks.workunit.client.1.smithi187.stdout:7/663: link d1/d18/d31/d33/d3b/c52 d1/d55/dd7/ce5 0 2024-09-21T00:56:41.483 INFO:tasks.workunit.client.1.smithi187.stdout:6/742: fsync d7/d2a/d29/d40/d50/d68/fc0 0 2024-09-21T00:56:41.484 INFO:tasks.workunit.client.1.smithi187.stdout:2/806: rename d2/dc/d2e/d4a/d7c/cb5 to d2/c11f 0 2024-09-21T00:56:41.485 INFO:tasks.workunit.client.1.smithi187.stdout:3/663: dread d9/d7f/dcb/d87/d94/d53/f76 [0,4194304] 0 2024-09-21T00:56:41.485 INFO:tasks.workunit.client.1.smithi187.stdout:7/664: write d1/d18/d31/d41/d64/d93/fb3 [5121836,73996] 0 2024-09-21T00:56:41.487 INFO:tasks.workunit.client.1.smithi187.stdout:3/664: write d9/d7f/dcb/d87/d94/d53/d56/d61/f63 [4790,118595] 0 2024-09-21T00:56:41.516 INFO:tasks.workunit.client.0.smithi112.stdout:0/170: rename d8/fe to d8/d11/f37 0 2024-09-21T00:56:41.517 INFO:tasks.workunit.client.0.smithi112.stdout:7/185: truncate d0/fa 419262 0 2024-09-21T00:56:41.517 INFO:tasks.workunit.client.1.smithi187.stdout:1/814: link d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/lad d4/d6/d23/d2e/d94/dcb/l106 0 2024-09-21T00:56:41.520 INFO:tasks.workunit.client.0.smithi112.stdout:0/171: symlink d8/d11/d28/l38 0 2024-09-21T00:56:41.520 INFO:tasks.workunit.client.0.smithi112.stdout:0/172: chown d8/d11/f37 9 1 2024-09-21T00:56:41.521 INFO:tasks.workunit.client.0.smithi112.stdout:7/186: mkdir d0/d2/d32 0 2024-09-21T00:56:41.524 INFO:tasks.workunit.client.0.smithi112.stdout:7/187: unlink d0/d2/c1e 0 2024-09-21T00:56:41.525 INFO:tasks.workunit.client.0.smithi112.stdout:0/173: creat d8/d1b/d2c/d2e/f39 x:0 0 0 2024-09-21T00:56:41.526 INFO:tasks.workunit.client.0.smithi112.stdout:0/174: dread - d8/d11/f15 zero size 2024-09-21T00:56:41.526 INFO:tasks.workunit.client.1.smithi187.stdout:6/743: symlink d7/d2a/d29/d40/d6a/dbc/lf6 0 2024-09-21T00:56:41.527 INFO:tasks.workunit.client.1.smithi187.stdout:6/744: chown d7/d2a/d29/d40/d45/lce 215 1 2024-09-21T00:56:41.530 INFO:tasks.workunit.client.1.smithi187.stdout:7/665: creat d1/d18/d31/d33/d3b/d62/fe6 x:0 0 0 2024-09-21T00:56:41.530 INFO:tasks.workunit.client.0.smithi112.stdout:0/175: mknod d8/d1b/d2c/d2e/c3a 0 2024-09-21T00:56:41.532 INFO:tasks.workunit.client.1.smithi187.stdout:0/684: sync 2024-09-21T00:56:41.532 INFO:tasks.workunit.client.0.smithi112.stdout:0/176: write d8/d1b/f36 [653439,103516] 0 2024-09-21T00:56:41.532 INFO:tasks.workunit.client.1.smithi187.stdout:6/745: dwrite d7/d2a/fba [0,4194304] 0 2024-09-21T00:56:41.533 INFO:tasks.workunit.client.1.smithi187.stdout:6/746: write d7/d2a/fb [388995,97773] 0 2024-09-21T00:56:41.534 INFO:tasks.workunit.client.0.smithi112.stdout:0/177: truncate d8/d1b/d2c/f34 466475 0 2024-09-21T00:56:41.534 INFO:tasks.workunit.client.1.smithi187.stdout:4/761: getdents d2/d3/d56/d84/d60/d6c 0 2024-09-21T00:56:41.534 INFO:tasks.workunit.client.0.smithi112.stdout:0/178: fdatasync d8/f31 0 2024-09-21T00:56:41.535 INFO:tasks.workunit.client.0.smithi112.stdout:0/179: stat d8/d11/f1a 0 2024-09-21T00:56:41.535 INFO:tasks.workunit.client.0.smithi112.stdout:0/180: chown d8/d11/f23 15194 1 2024-09-21T00:56:41.543 INFO:tasks.workunit.client.0.smithi112.stdout:0/181: dwrite d8/f17 [0,4194304] 0 2024-09-21T00:56:41.545 INFO:tasks.workunit.client.0.smithi112.stdout:0/182: readlink d8/d1b/l2b 0 2024-09-21T00:56:41.545 INFO:tasks.workunit.client.1.smithi187.stdout:3/665: creat d9/d7f/dcb/dd0/fd4 x:0 0 0 2024-09-21T00:56:41.549 INFO:tasks.workunit.client.1.smithi187.stdout:6/747: mkdir d7/d2a/d29/d40/d45/df7 0 2024-09-21T00:56:41.550 INFO:tasks.workunit.client.0.smithi112.stdout:0/183: rmdir d8/d11 39 2024-09-21T00:56:41.552 INFO:tasks.workunit.client.1.smithi187.stdout:0/685: truncate d0/d17/d1c/d23/df/d41/d3b/f6c 901719 0 2024-09-21T00:56:41.553 INFO:tasks.workunit.client.1.smithi187.stdout:5/678: getdents d0/dc/daa/d67/d14/d1b 0 2024-09-21T00:56:41.555 INFO:tasks.workunit.client.0.smithi112.stdout:0/184: rename d8/d1b/d2c/l33 to d8/d1b/d2c/d2e/l3b 0 2024-09-21T00:56:41.556 INFO:tasks.workunit.client.0.smithi112.stdout:0/185: write d8/d1b/d2c/f30 [889351,18290] 0 2024-09-21T00:56:41.558 INFO:tasks.workunit.client.1.smithi187.stdout:2/807: mknod d2/dc/d6b/c120 0 2024-09-21T00:56:41.559 INFO:tasks.workunit.client.1.smithi187.stdout:9/899: link d4/d13/d14/d1d/d5f/cd7 d4/d61/d6a/d90/c12a 0 2024-09-21T00:56:41.559 INFO:tasks.workunit.client.1.smithi187.stdout:7/666: dread d1/f9 [4194304,4194304] 0 2024-09-21T00:56:41.562 INFO:tasks.workunit.client.1.smithi187.stdout:1/815: rename d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/la2 to d4/d6/d23/d2e/d94/d35/d22/l107 0 2024-09-21T00:56:41.563 INFO:tasks.workunit.client.0.smithi112.stdout:0/186: creat d8/f3c x:0 0 0 2024-09-21T00:56:41.564 INFO:tasks.workunit.client.1.smithi187.stdout:8/785: sync 2024-09-21T00:56:41.566 INFO:tasks.workunit.client.0.smithi112.stdout:7/188: truncate d0/fa 1448798 0 2024-09-21T00:56:41.567 INFO:tasks.workunit.client.1.smithi187.stdout:4/762: link d2/d3/da/d16/fab d2/d3/d56/d84/d60/d9e/fe6 0 2024-09-21T00:56:41.567 INFO:tasks.workunit.client.0.smithi112.stdout:0/187: symlink d8/d1b/l3d 0 2024-09-21T00:56:41.568 INFO:tasks.workunit.client.0.smithi112.stdout:0/188: chown d8/d1b/d2c 382475 1 2024-09-21T00:56:41.569 INFO:tasks.workunit.client.0.smithi112.stdout:7/189: write d0/d8/d1a/f1f [417389,55713] 0 2024-09-21T00:56:41.569 INFO:tasks.workunit.client.1.smithi187.stdout:3/666: mknod d9/dcc/cd5 0 2024-09-21T00:56:41.573 INFO:tasks.workunit.client.1.smithi187.stdout:2/808: dwrite d2/d3/d15/dfe/d2d/fe5 [0,4194304] 0 2024-09-21T00:56:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.595+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f818006ab30 con 0x7f8180101a90 2024-09-21T00:56:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.596+0000 7f81767fc640 1 -- 172.21.15.112:0/4076006307 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f817008ae70 con 0x7f8180101a90 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:41.597 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:56:41.598 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:56:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f816c074a80 msgr2=0x7f816c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f816c074a80 0x7f816c076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f817c006fd0 tx=0x7f817c008040 comp rx=0 tx=0).stop 2024-09-21T00:56:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 msgr2=0x7f8180196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 0x7f8180196980 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8170009230 tx=0x7f81700048f0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 shutdown_connections 2024-09-21T00:56:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f816c074a80 0x7f816c076f40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8180101a90 0x7f8180196980 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 --2- 172.21.15.112:0/4076006307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8180100890 0x7f8180196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 >> 172.21.15.112:0/4076006307 conn(0x7f81800fc040 msgr2=0x7f81800fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 shutdown_connections 2024-09-21T00:56:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.598+0000 7f81875c4640 1 -- 172.21.15.112:0/4076006307 wait complete. 2024-09-21T00:56:41.672 INFO:tasks.workunit.client.0.smithi112.stdout:0/189: dread - d8/d11/f26 zero size 2024-09-21T00:56:41.674 INFO:tasks.workunit.client.0.smithi112.stdout:7/190: rename d0/l2c to d0/d2/d32/l33 0 2024-09-21T00:56:41.677 INFO:tasks.workunit.client.0.smithi112.stdout:0/190: unlink d8/d1b/l2b 0 2024-09-21T00:56:41.678 INFO:tasks.workunit.client.0.smithi112.stdout:0/191: fdatasync d8/d1b/d2c/f30 0 2024-09-21T00:56:41.678 INFO:tasks.workunit.client.0.smithi112.stdout:7/191: fsync d0/f10 0 2024-09-21T00:56:41.679 INFO:tasks.workunit.client.0.smithi112.stdout:7/192: read d0/f10 [6546963,91571] 0 2024-09-21T00:56:41.680 INFO:tasks.workunit.client.1.smithi187.stdout:1/816: dread d4/d6/d23/d2e/d94/d35/d4c/f85 [0,4194304] 0 2024-09-21T00:56:41.681 INFO:tasks.workunit.client.1.smithi187.stdout:4/763: write d2/d3/da/f5b [3053447,35199] 0 2024-09-21T00:56:41.683 INFO:tasks.workunit.client.0.smithi112.stdout:7/193: symlink d0/d2/d2e/l34 0 2024-09-21T00:56:41.683 INFO:tasks.workunit.client.1.smithi187.stdout:1/817: read d4/d6/d23/d2e/d94/d35/d22/d65/f9d [1802343,52811] 0 2024-09-21T00:56:41.687 INFO:tasks.workunit.client.1.smithi187.stdout:2/809: symlink d2/d3/d15/dfe/d2d/d8f/d9f/d8c/l121 0 2024-09-21T00:56:41.694 INFO:tasks.workunit.client.1.smithi187.stdout:0/686: rename d0/d17/d1c/f7a to d0/d17/d1c/d65/fe8 0 2024-09-21T00:56:41.695 INFO:tasks.workunit.client.1.smithi187.stdout:0/687: chown d0/d17/d18 0 1 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 -- 172.21.15.112:0/1129684285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 msgr2=0x7fbb900750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 --2- 172.21.15.112:0/1129684285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb900750b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009c20 tx=0x7fbb8002a970 comp rx=0 tx=0).stop 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 -- 172.21.15.112:0/1129684285 shutdown_connections 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 --2- 172.21.15.112:0/1129684285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb900750b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 --2- 172.21.15.112:0/1129684285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb90076220 0x7fbb90074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 -- 172.21.15.112:0/1129684285 >> 172.21.15.112:0/1129684285 conn(0x7fbb900fd110 msgr2=0x7fbb900ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 -- 172.21.15.112:0/1129684285 shutdown_connections 2024-09-21T00:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.695+0000 7fbb96192640 1 -- 172.21.15.112:0/1129684285 wait complete. 2024-09-21T00:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.696+0000 7fbb96192640 1 Processor -- start 2024-09-21T00:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.696+0000 7fbb96192640 1 -- start start 2024-09-21T00:56:41.697 INFO:tasks.workunit.client.1.smithi187.stdout:8/786: unlink dc/d2f/f8f 0 2024-09-21T00:56:41.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb96192640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb9019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb96192640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb90076220 0x7fbb9019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb96192640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90110dc0 con 0x7fbb90074c50 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb96192640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90110c40 con 0x7fbb90076220 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb8f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb9019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb8f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb9019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33662/0 (socket says 172.21.15.112:33662) 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb8f7fe640 1 -- 172.21.15.112:0/790411715 learned_addr learned my addr 172.21.15.112:0/790411715 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb8effd640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb90076220 0x7fbb9019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb8f7fe640 1 -- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb90076220 msgr2=0x7fbb9019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb8f7fe640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb90076220 0x7fbb9019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.697+0000 7fbb8f7fe640 1 -- 172.21.15.112:0/790411715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9019e670 con 0x7fbb90074c50 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.698+0000 7fbb8f7fe640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb9019dab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800e920 tx=0x7fbb8800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.698+0000 7fbb8cff9640 1 -- 172.21.15.112:0/790411715 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb8800cb80 con 0x7fbb90074c50 2024-09-21T00:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.698+0000 7fbb8cff9640 1 -- 172.21.15.112:0/790411715 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb8800cd20 con 0x7fbb90074c50 2024-09-21T00:56:41.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.698+0000 7fbb8cff9640 1 -- 172.21.15.112:0/790411715 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb880049d0 con 0x7fbb90074c50 2024-09-21T00:56:41.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.698+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb901a30b0 con 0x7fbb90074c50 2024-09-21T00:56:41.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.698+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb901a3690 con 0x7fbb90074c50 2024-09-21T00:56:41.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.699+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb900750b0 con 0x7fbb90074c50 2024-09-21T00:56:41.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.700+0000 7fbb8cff9640 1 -- 172.21.15.112:0/790411715 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fbb88004020 con 0x7fbb90074c50 2024-09-21T00:56:41.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.701+0000 7fbb8cff9640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb7c074a20 0x7fbb7c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.701+0000 7fbb8cff9640 1 -- 172.21.15.112:0/790411715 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fbb88096500 con 0x7fbb90074c50 2024-09-21T00:56:41.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.702+0000 7fbb8effd640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb7c074a20 0x7fbb7c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.703 INFO:tasks.workunit.client.1.smithi187.stdout:3/667: mkdir d9/d19/dca/dd6 0 2024-09-21T00:56:41.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.702+0000 7fbb8effd640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb7c074a20 0x7fbb7c076ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbb8002fa30 tx=0x7fbb8003c040 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.704 INFO:tasks.workunit.client.1.smithi187.stdout:3/668: dread - d9/d19/d1c/f66 zero size 2024-09-21T00:56:41.704 INFO:tasks.workunit.client.1.smithi187.stdout:6/748: getdents d7/d2a/d29/d40/d50/d68/dcf 0 2024-09-21T00:56:41.706 INFO:tasks.workunit.client.1.smithi187.stdout:3/669: dread d9/d7f/dcb/d87/d94/d53/d56/f5d [0,4194304] 0 2024-09-21T00:56:41.707 INFO:tasks.workunit.client.1.smithi187.stdout:3/670: dread - d9/d19/d1c/f66 zero size 2024-09-21T00:56:41.708 INFO:tasks.workunit.client.1.smithi187.stdout:9/900: getdents d4/d10/d8f/de6 0 2024-09-21T00:56:41.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:41.707+0000 7fbb8cff9640 1 -- 172.21.15.112:0/790411715 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fbb88061a30 con 0x7fbb90074c50 2024-09-21T00:56:41.708 INFO:tasks.workunit.client.1.smithi187.stdout:0/688: dread d0/d17/d1c/d23/df/f53 [4194304,4194304] 0 2024-09-21T00:56:41.709 INFO:tasks.workunit.client.1.smithi187.stdout:5/679: truncate d0/dc/daa/d67/d14/d38/f5b 3535987 0 2024-09-21T00:56:41.710 INFO:tasks.workunit.client.1.smithi187.stdout:3/671: mkdir d9/d7f/dcb/d87/d94/dd7 0 2024-09-21T00:56:41.711 INFO:tasks.workunit.client.1.smithi187.stdout:6/749: mkdir d7/d2a/d29/d40/df8 0 2024-09-21T00:56:41.713 INFO:tasks.workunit.client.1.smithi187.stdout:1/818: getdents d4/d6/d23/d2e/d94 0 2024-09-21T00:56:41.713 INFO:tasks.workunit.client.1.smithi187.stdout:5/680: write d0/dc/daa/d67/d14/d1b/d27/d3a/fb0 [725901,96981] 0 2024-09-21T00:56:41.714 INFO:tasks.workunit.client.1.smithi187.stdout:9/901: creat d4/d8/dda/f12b x:0 0 0 2024-09-21T00:56:41.714 INFO:tasks.workunit.client.1.smithi187.stdout:3/672: symlink d9/d19/dca/ld8 0 2024-09-21T00:56:41.715 INFO:tasks.workunit.client.1.smithi187.stdout:1/819: chown d4/f76 12 1 2024-09-21T00:56:41.715 INFO:tasks.workunit.client.1.smithi187.stdout:6/750: unlink d7/f22 0 2024-09-21T00:56:41.717 INFO:tasks.workunit.client.1.smithi187.stdout:8/787: dwrite dc/d44/fb2 [0,4194304] 0 2024-09-21T00:56:41.718 INFO:tasks.workunit.client.0.smithi112.stdout:7/194: write d0/fa [1086660,87320] 0 2024-09-21T00:56:41.722 INFO:tasks.workunit.client.0.smithi112.stdout:7/195: rename d0/f19 to d0/d8/f35 0 2024-09-21T00:56:41.724 INFO:tasks.workunit.client.1.smithi187.stdout:7/667: dwrite d1/dc/d15/d2b/f61 [0,4194304] 0 2024-09-21T00:56:41.725 INFO:tasks.workunit.client.1.smithi187.stdout:5/681: write d0/dc/daa/d67/d14/f21 [131979,65695] 0 2024-09-21T00:56:41.727 INFO:tasks.workunit.client.1.smithi187.stdout:7/668: fdatasync d1/dce/dd0/fa5 0 2024-09-21T00:56:41.727 INFO:tasks.workunit.client.1.smithi187.stdout:0/689: link d0/d17/d1c/d23/df/f69 d0/d17/d18/d90/dd1/fe9 0 2024-09-21T00:56:41.727 INFO:tasks.workunit.client.0.smithi112.stdout:7/196: mkdir d0/d2/d36 0 2024-09-21T00:56:41.728 INFO:tasks.workunit.client.1.smithi187.stdout:1/820: rmdir d4/d86 39 2024-09-21T00:56:41.729 INFO:tasks.workunit.client.1.smithi187.stdout:4/764: dwrite d2/d3/d56/d84/d60/d6c/d77/f93 [0,4194304] 0 2024-09-21T00:56:41.731 INFO:tasks.workunit.client.1.smithi187.stdout:3/673: symlink d9/d7f/dcb/d20/ld9 0 2024-09-21T00:56:41.733 INFO:tasks.workunit.client.1.smithi187.stdout:3/674: stat d9/d7f/dcb/d87 0 2024-09-21T00:56:41.740 INFO:tasks.workunit.client.1.smithi187.stdout:5/682: creat d0/dc/d39/fe2 x:0 0 0 2024-09-21T00:56:41.742 INFO:tasks.workunit.client.1.smithi187.stdout:7/669: symlink d1/dce/dd4/le7 0 2024-09-21T00:56:41.743 INFO:tasks.workunit.client.1.smithi187.stdout:8/788: mkdir dc/d94/df6/d107 0 2024-09-21T00:56:41.744 INFO:tasks.workunit.client.1.smithi187.stdout:1/821: symlink d4/d6/d23/d2e/d94/d35/d79/dce/l108 0 2024-09-21T00:56:41.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/197: write d0/f22 [255341,98537] 0 2024-09-21T00:56:41.745 INFO:tasks.workunit.client.1.smithi187.stdout:7/670: read d1/d18/d31/f6d [24951,73764] 0 2024-09-21T00:56:41.745 INFO:tasks.workunit.client.0.smithi112.stdout:7/198: chown d0/d2/d2e 23176 1 2024-09-21T00:56:41.746 INFO:tasks.workunit.client.1.smithi187.stdout:6/751: write d7/f52 [1657448,37404] 0 2024-09-21T00:56:41.747 INFO:tasks.workunit.client.1.smithi187.stdout:0/690: symlink d0/d17/d1c/d23/lea 0 2024-09-21T00:56:41.748 INFO:tasks.workunit.client.1.smithi187.stdout:5/683: creat d0/dc/daa/d67/d14/d38/d5a/d6c/db7/fe3 x:0 0 0 2024-09-21T00:56:41.749 INFO:tasks.workunit.client.1.smithi187.stdout:8/789: chown dc/d2f/d80/db8/dba/d29/faf 22 1 2024-09-21T00:56:41.752 INFO:tasks.workunit.client.0.smithi112.stdout:7/199: link d0/d8/l1b d0/d2/l37 0 2024-09-21T00:56:41.754 INFO:tasks.workunit.client.1.smithi187.stdout:6/752: creat d7/d2a/d29/d94/ff9 x:0 0 0 2024-09-21T00:56:41.755 INFO:tasks.workunit.client.0.smithi112.stdout:7/200: mkdir d0/d2/d38 0 2024-09-21T00:56:41.760 INFO:tasks.workunit.client.1.smithi187.stdout:8/790: mknod dc/d44/dc1/c108 0 2024-09-21T00:56:41.761 INFO:tasks.workunit.client.1.smithi187.stdout:0/691: dwrite d0/d17/d18/d90/d98/fcd [0,4194304] 0 2024-09-21T00:56:41.762 INFO:tasks.workunit.client.1.smithi187.stdout:3/675: truncate d9/d7f/dcb/d87/d94/d53/d56/f83 2469660 0 2024-09-21T00:56:41.763 INFO:tasks.workunit.client.1.smithi187.stdout:7/671: symlink d1/d18/d31/d41/d64/d93/dc1/le8 0 2024-09-21T00:56:41.763 INFO:tasks.workunit.client.1.smithi187.stdout:3/676: fdatasync d9/d7f/dcb/d87/d94/d53/f76 0 2024-09-21T00:56:41.764 INFO:tasks.workunit.client.1.smithi187.stdout:6/753: mkdir d7/d2a/d29/d40/d50/d68/dfa 0 2024-09-21T00:56:41.766 INFO:tasks.workunit.client.1.smithi187.stdout:6/754: write d7/d59/fc5 [761319,100861] 0 2024-09-21T00:56:41.767 INFO:tasks.workunit.client.1.smithi187.stdout:9/902: getdents d4/d13/d20/d2e/d9a 0 2024-09-21T00:56:41.770 INFO:tasks.workunit.client.1.smithi187.stdout:3/677: creat d9/d19/dca/fda x:0 0 0 2024-09-21T00:56:41.772 INFO:tasks.workunit.client.1.smithi187.stdout:1/822: rename d4/d6/d23/d2e/d94/d35/d79/dce/lee to d4/d6/d23/d2e/d53/d6a/l109 0 2024-09-21T00:56:41.774 INFO:tasks.workunit.client.1.smithi187.stdout:6/755: dwrite d7/d2a/d29/f43 [0,4194304] 0 2024-09-21T00:56:41.775 INFO:tasks.workunit.client.0.smithi112.stdout:7/201: getdents d0/d2 0 2024-09-21T00:56:41.777 INFO:tasks.workunit.client.1.smithi187.stdout:7/672: symlink d1/d18/d31/d41/le9 0 2024-09-21T00:56:41.780 INFO:tasks.workunit.client.1.smithi187.stdout:3/678: rename d9/d7f/dcb/d20/c77 to d9/d19/da7/daa/cdb 0 2024-09-21T00:56:41.781 INFO:tasks.workunit.client.0.smithi112.stdout:7/202: rename d0/d8 to d0/d2/d36/d39 0 2024-09-21T00:56:41.785 INFO:tasks.workunit.client.1.smithi187.stdout:7/673: mkdir d1/d18/d31/d41/d64/d93/dc1/d73/d8b/dea 0 2024-09-21T00:56:41.786 INFO:tasks.workunit.client.1.smithi187.stdout:9/903: dread d4/d13/d14/d1d/fad [0,4194304] 0 2024-09-21T00:56:41.787 INFO:tasks.workunit.client.1.smithi187.stdout:3/679: fdatasync d9/f6b 0 2024-09-21T00:56:41.789 INFO:tasks.workunit.client.1.smithi187.stdout:7/674: symlink d1/d18/d31/d33/d3b/d9f/d75/leb 0 2024-09-21T00:56:41.792 INFO:tasks.workunit.client.1.smithi187.stdout:6/756: write d7/d2a/d29/d40/d50/d83/fda [225735,68099] 0 2024-09-21T00:56:41.793 INFO:tasks.workunit.client.0.smithi112.stdout:7/203: link d0/d2/d36/d39/l1b d0/d2/d38/l3a 0 2024-09-21T00:56:41.793 INFO:tasks.workunit.client.1.smithi187.stdout:0/692: dread d0/d17/d18/d90/dd1/fe9 [0,4194304] 0 2024-09-21T00:56:41.794 INFO:tasks.workunit.client.1.smithi187.stdout:0/693: chown d0/d17/l31 7848 1 2024-09-21T00:56:41.796 INFO:tasks.workunit.client.1.smithi187.stdout:3/680: truncate d9/d7f/fbd 901253 0 2024-09-21T00:56:41.797 INFO:tasks.workunit.client.1.smithi187.stdout:7/675: rename d1/dce/dd0/ca9 to d1/dc/d15/cec 0 2024-09-21T00:56:41.797 INFO:tasks.workunit.client.0.smithi112.stdout:7/204: creat d0/f3b x:0 0 0 2024-09-21T00:56:41.798 INFO:tasks.workunit.client.1.smithi187.stdout:3/681: mknod d9/d19/d1c/d5f/cdc 0 2024-09-21T00:56:41.798 INFO:tasks.workunit.client.0.smithi112.stdout:7/205: stat d0/d2/d36/d39/d1a 0 2024-09-21T00:56:41.799 INFO:tasks.workunit.client.1.smithi187.stdout:7/676: mknod d1/dc/ced 0 2024-09-21T00:56:41.799 INFO:tasks.workunit.client.0.smithi112.stdout:7/206: mkdir d0/d2/d2e/d3c 0 2024-09-21T00:56:41.800 INFO:tasks.workunit.client.1.smithi187.stdout:7/677: creat d1/d55/dd7/fee x:0 0 0 2024-09-21T00:56:41.802 INFO:tasks.workunit.client.1.smithi187.stdout:7/678: truncate d1/dc/d15/d2b/fb1 394287 0 2024-09-21T00:56:41.802 INFO:tasks.workunit.client.0.smithi112.stdout:7/207: mknod d0/d2/d36/d39/d1a/c3d 0 2024-09-21T00:56:41.802 INFO:tasks.workunit.client.1.smithi187.stdout:3/682: link d9/d7f/dcb/d87/d94/d53/lbc d9/d7f/dcb/dd0/ldd 0 2024-09-21T00:56:41.804 INFO:tasks.workunit.client.1.smithi187.stdout:7/679: rmdir d1/d18/d31/d41/d64/d93/dc1/d73 39 2024-09-21T00:56:41.805 INFO:tasks.workunit.client.1.smithi187.stdout:3/683: mknod d9/d19/da7/daa/dce/cde 0 2024-09-21T00:56:41.806 INFO:tasks.workunit.client.1.smithi187.stdout:1/823: dread d4/d6/d23/d2e/d94/ff4 [0,4194304] 0 2024-09-21T00:56:41.807 INFO:tasks.workunit.client.0.smithi112.stdout:7/208: link d0/d2/d36/d39/d1a/l24 d0/d2/d36/d39/d1a/d23/l3e 0 2024-09-21T00:56:41.807 INFO:tasks.workunit.client.0.smithi112.stdout:7/209: fsync d0/d2/f31 0 2024-09-21T00:56:41.809 INFO:tasks.workunit.client.1.smithi187.stdout:7/680: mkdir d1/d18/d31/d41/d64/d93/dc1/d73/d8b/def 0 2024-09-21T00:56:41.810 INFO:tasks.workunit.client.1.smithi187.stdout:3/684: getdents d9 0 2024-09-21T00:56:41.811 INFO:tasks.workunit.client.0.smithi112.stdout:7/210: dread d0/f22 [0,4194304] 0 2024-09-21T00:56:41.812 INFO:tasks.workunit.client.0.smithi112.stdout:7/211: rmdir d0/d2/d2e 39 2024-09-21T00:56:41.812 INFO:tasks.workunit.client.1.smithi187.stdout:6/757: dread d7/d2a/d7a/f99 [0,4194304] 0 2024-09-21T00:56:41.813 INFO:tasks.workunit.client.1.smithi187.stdout:3/685: chown d9/d7f/dcb/d87/d94/l58 130 1 2024-09-21T00:56:41.815 INFO:tasks.workunit.client.1.smithi187.stdout:1/824: dwrite d4/d6/d23/d2e/d94/d35/d22/d2c/fec [0,4194304] 0 2024-09-21T00:56:41.816 INFO:tasks.workunit.client.0.smithi112.stdout:7/212: dread d0/d2/d36/d39/d1a/f1f [0,4194304] 0 2024-09-21T00:56:41.818 INFO:tasks.workunit.client.1.smithi187.stdout:1/825: fdatasync d4/d6/d23/d2e/d94/d35/d79/dce/fef 0 2024-09-21T00:56:41.818 INFO:tasks.workunit.client.1.smithi187.stdout:3/686: mknod d9/d7f/dcb/d87/d94/d89/cdf 0 2024-09-21T00:56:41.818 INFO:tasks.workunit.client.1.smithi187.stdout:7/681: dwrite d1/d18/d31/d41/d64/faa [0,4194304] 0 2024-09-21T00:56:41.819 INFO:tasks.workunit.client.1.smithi187.stdout:3/687: write d9/f12 [2906686,40618] 0 2024-09-21T00:56:41.820 INFO:tasks.workunit.client.1.smithi187.stdout:6/758: truncate d7/f4e 2936833 0 2024-09-21T00:56:41.823 INFO:tasks.workunit.client.1.smithi187.stdout:2/810: sync 2024-09-21T00:56:41.826 INFO:tasks.workunit.client.1.smithi187.stdout:3/688: dread d9/d7f/dcb/d87/d94/d53/d56/f5d [0,4194304] 0 2024-09-21T00:56:41.827 INFO:tasks.workunit.client.1.smithi187.stdout:6/759: creat d7/d2a/ffb x:0 0 0 2024-09-21T00:56:41.829 INFO:tasks.workunit.client.1.smithi187.stdout:2/811: mkdir d2/dc/d2e/d4a/d122 0 2024-09-21T00:56:41.831 INFO:tasks.workunit.client.1.smithi187.stdout:1/826: link d4/d6/d23/d2e/d94/dcb/fdc d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/f10a 0 2024-09-21T00:56:41.831 INFO:tasks.workunit.client.1.smithi187.stdout:1/827: fsync d4/faa 0 2024-09-21T00:56:41.834 INFO:tasks.workunit.client.1.smithi187.stdout:3/689: rename d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/ca1 to d9/d19/d9b/ce0 0 2024-09-21T00:56:41.835 INFO:tasks.workunit.client.1.smithi187.stdout:3/690: chown d9/d7f/dcb/d20/ld9 33099 1 2024-09-21T00:56:41.839 INFO:tasks.workunit.client.1.smithi187.stdout:2/812: fdatasync d2/da8/d6c/db8/d40/d75/de8/f10f 0 2024-09-21T00:56:41.842 INFO:tasks.workunit.client.1.smithi187.stdout:2/813: fdatasync d2/f8 0 2024-09-21T00:56:41.843 INFO:tasks.workunit.client.1.smithi187.stdout:3/691: dwrite d9/d19/d43/f52 [0,4194304] 0 2024-09-21T00:56:41.845 INFO:tasks.workunit.client.1.smithi187.stdout:1/828: dwrite d4/d6/d23/d2e/d53/fc5 [0,4194304] 0 2024-09-21T00:56:41.847 INFO:tasks.workunit.client.1.smithi187.stdout:3/692: chown d9/d7f/dcb/dd0/fd4 49645 1 2024-09-21T00:56:41.847 INFO:tasks.workunit.client.1.smithi187.stdout:2/814: dread d2/dc/d2e/d6f/f8a [0,4194304] 0 2024-09-21T00:56:41.848 INFO:tasks.workunit.client.1.smithi187.stdout:7/682: dread d1/d18/d31/d41/d64/d93/fa4 [0,4194304] 0 2024-09-21T00:56:41.848 INFO:tasks.workunit.client.1.smithi187.stdout:6/760: mkdir d7/d2a/d29/d40/d45/df7/dfc 0 2024-09-21T00:56:41.848 INFO:tasks.workunit.client.1.smithi187.stdout:3/693: write d9/d19/f95 [540903,50319] 0 2024-09-21T00:56:41.851 INFO:tasks.workunit.client.1.smithi187.stdout:6/761: fdatasync d7/d2a/d7a/f8f 0 2024-09-21T00:56:41.852 INFO:tasks.workunit.client.1.smithi187.stdout:2/815: creat d2/dc/d2e/d4a/d7c/d52/dac/f123 x:0 0 0 2024-09-21T00:56:41.853 INFO:tasks.workunit.client.1.smithi187.stdout:2/816: dread - d2/d3/d15/dfe/d2d/f83 zero size 2024-09-21T00:56:41.855 INFO:tasks.workunit.client.1.smithi187.stdout:7/683: write d1/d18/d31/d41/d64/d93/fa4 [2645515,97013] 0 2024-09-21T00:56:41.856 INFO:tasks.workunit.client.1.smithi187.stdout:1/829: rename d4/d6/d23/d2e/d94/d35/d22/d65/d90/de3 to d4/d6/d23/d2e/d94/d10b 0 2024-09-21T00:56:41.857 INFO:tasks.workunit.client.1.smithi187.stdout:6/762: mkdir d7/d2a/d29/d40/d50/d83/dfd 0 2024-09-21T00:56:41.858 INFO:tasks.workunit.client.1.smithi187.stdout:2/817: mkdir d2/dc/d2e/d4a/d7c/d52/da3/de6/d124 0 2024-09-21T00:56:41.863 INFO:tasks.workunit.client.1.smithi187.stdout:1/830: creat d4/d6/d23/d2e/f10c x:0 0 0 2024-09-21T00:56:41.866 INFO:tasks.workunit.client.1.smithi187.stdout:1/831: getdents d4/d6/d23/d2e/d94/d35/d22/dcd 0 2024-09-21T00:56:41.870 INFO:tasks.workunit.client.1.smithi187.stdout:6/763: read d7/d2a/d29/d40/d50/f73 [514274,23668] 0 2024-09-21T00:56:41.870 INFO:tasks.workunit.client.1.smithi187.stdout:1/832: dread d4/d6/d23/d2e/d94/d35/d22/d2c/fec [0,4194304] 0 2024-09-21T00:56:41.872 INFO:tasks.workunit.client.1.smithi187.stdout:6/764: truncate d7/f5f 736084 0 2024-09-21T00:56:41.872 INFO:tasks.workunit.client.1.smithi187.stdout:1/833: fsync d4/d6/f29 0 2024-09-21T00:56:41.874 INFO:tasks.workunit.client.1.smithi187.stdout:1/834: fsync d4/d6/d23/d2e/d94/d35/d22/f7b 0 2024-09-21T00:56:41.874 INFO:tasks.workunit.client.1.smithi187.stdout:6/765: truncate d7/d2a/d29/d40/d50/f96 847585 0 2024-09-21T00:56:41.874 INFO:tasks.workunit.client.1.smithi187.stdout:3/694: dread d9/d7f/dcb/d87/d94/d53/f99 [0,4194304] 0 2024-09-21T00:56:41.875 INFO:tasks.workunit.client.1.smithi187.stdout:1/835: write d4/d6/d23/d2e/d94/d35/d79/dce/fef [610719,130135] 0 2024-09-21T00:56:41.877 INFO:tasks.workunit.client.1.smithi187.stdout:3/695: symlink d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/le1 0 2024-09-21T00:56:41.877 INFO:tasks.workunit.client.1.smithi187.stdout:6/766: truncate d7/d2a/d29/d40/d50/f73 3771602 0 2024-09-21T00:56:41.879 INFO:tasks.workunit.client.1.smithi187.stdout:1/836: mknod d4/d6/d23/d2e/d94/d35/d22/dcd/dd3/c10d 0 2024-09-21T00:56:41.879 INFO:tasks.workunit.client.0.smithi112.stdout:2/198: sync 2024-09-21T00:56:41.879 INFO:tasks.workunit.client.1.smithi187.stdout:3/696: write d9/d19/da7/daa/dce/fd2 [665092,114530] 0 2024-09-21T00:56:41.880 INFO:tasks.workunit.client.1.smithi187.stdout:1/837: write d4/d6/d23/fb2 [4226833,124709] 0 2024-09-21T00:56:41.881 INFO:tasks.workunit.client.1.smithi187.stdout:3/697: write d9/fb7 [894213,27261] 0 2024-09-21T00:56:41.881 INFO:tasks.workunit.client.1.smithi187.stdout:6/767: symlink d7/d2a/d29/lfe 0 2024-09-21T00:56:41.883 INFO:tasks.workunit.client.0.smithi112.stdout:2/199: creat d0/d14/d8/d27/f3f x:0 0 0 2024-09-21T00:56:41.883 INFO:tasks.workunit.client.1.smithi187.stdout:1/838: mkdir d4/d6/d23/d2e/d94/d10e 0 2024-09-21T00:56:41.884 INFO:tasks.workunit.client.1.smithi187.stdout:6/768: truncate d7/d2a/d29/d40/d5e/fe6 893908 0 2024-09-21T00:56:41.884 INFO:tasks.workunit.client.1.smithi187.stdout:3/698: mkdir d9/d7f/dcb/d87/d94/d53/d75/de2 0 2024-09-21T00:56:41.885 INFO:tasks.workunit.client.1.smithi187.stdout:3/699: chown d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/la2 0 1 2024-09-21T00:56:41.886 INFO:tasks.workunit.client.1.smithi187.stdout:3/700: fsync d9/f12 0 2024-09-21T00:56:41.886 INFO:tasks.workunit.client.0.smithi112.stdout:2/200: creat d0/d14/f40 x:0 0 0 2024-09-21T00:56:41.891 INFO:tasks.workunit.client.1.smithi187.stdout:1/839: symlink d4/de0/l10f 0 2024-09-21T00:56:41.892 INFO:tasks.workunit.client.0.smithi112.stdout:2/201: dwrite d0/f18 [0,4194304] 0 2024-09-21T00:56:41.898 INFO:tasks.workunit.client.1.smithi187.stdout:2/818: write d2/d25/f44 [1946802,53075] 0 2024-09-21T00:56:41.898 INFO:tasks.workunit.client.1.smithi187.stdout:7/684: dwrite d1/dc/d15/d22/f24 [0,4194304] 0 2024-09-21T00:56:41.900 INFO:tasks.workunit.client.0.smithi112.stdout:2/202: dwrite d0/f1f [0,4194304] 0 2024-09-21T00:56:41.904 INFO:tasks.workunit.client.1.smithi187.stdout:2/819: creat d2/dc/f125 x:0 0 0 2024-09-21T00:56:41.906 INFO:tasks.workunit.client.1.smithi187.stdout:2/820: write d2/d3/d15/dfe/d2d/d8f/d9f/d8c/f103 [1097738,26673] 0 2024-09-21T00:56:41.906 INFO:tasks.workunit.client.0.smithi112.stdout:2/203: symlink d0/df/l41 0 2024-09-21T00:56:41.909 INFO:tasks.workunit.client.0.smithi112.stdout:2/204: mknod d0/d14/d8/d27/c42 0 2024-09-21T00:56:41.911 INFO:tasks.workunit.client.1.smithi187.stdout:2/821: symlink d2/dc/d2e/de1/de3/l126 0 2024-09-21T00:56:41.912 INFO:tasks.workunit.client.1.smithi187.stdout:2/822: chown d2/d25/l109 6 1 2024-09-21T00:56:41.914 INFO:tasks.workunit.client.0.smithi112.stdout:2/205: dread d0/fa [0,4194304] 0 2024-09-21T00:56:41.917 INFO:tasks.workunit.client.1.smithi187.stdout:4/765: sync 2024-09-21T00:56:41.917 INFO:tasks.workunit.client.1.smithi187.stdout:6/769: write d7/d2a/d29/d94/fe2 [1770528,69059] 0 2024-09-21T00:56:41.918 INFO:tasks.workunit.client.1.smithi187.stdout:6/770: dread - d7/d2a/d29/d94/ff9 zero size 2024-09-21T00:56:41.921 INFO:tasks.workunit.client.1.smithi187.stdout:4/766: mkdir d2/d3/da/d2f/d32/d24/de7 0 2024-09-21T00:56:41.924 INFO:tasks.workunit.client.1.smithi187.stdout:4/767: creat d2/d3/da/d2f/d4b/d7e/fe8 x:0 0 0 2024-09-21T00:56:41.924 INFO:tasks.workunit.client.1.smithi187.stdout:6/771: fdatasync d7/d2a/d29/d40/d6a/da1/ff3 0 2024-09-21T00:56:41.925 INFO:tasks.workunit.client.1.smithi187.stdout:2/823: getdents d2/dc/d2e/d4a/d7c/d52/da3/de6 0 2024-09-21T00:56:41.926 INFO:tasks.workunit.client.1.smithi187.stdout:2/824: readlink d2/d25/l117 0 2024-09-21T00:56:41.926 INFO:tasks.workunit.client.1.smithi187.stdout:4/768: fsync d2/d3/da/d2f/d32/d26/d66/d6e/fd6 0 2024-09-21T00:56:41.927 INFO:tasks.workunit.client.1.smithi187.stdout:1/840: dwrite d4/d6/d23/d2e/d53/d6a/f8f [4194304,4194304] 0 2024-09-21T00:56:41.928 INFO:tasks.workunit.client.1.smithi187.stdout:6/772: mknod d7/d2a/da2/cff 0 2024-09-21T00:56:41.929 INFO:tasks.workunit.client.1.smithi187.stdout:6/773: dread - d7/d2a/da2/fee zero size 2024-09-21T00:56:41.930 INFO:tasks.workunit.client.1.smithi187.stdout:6/774: dread - d7/d2a/d29/d40/d6a/dbc/fc4 zero size 2024-09-21T00:56:41.934 INFO:tasks.workunit.client.1.smithi187.stdout:4/769: rename d2/d3/da/d2f/d32/d25/c96 to d2/d3/da/d48/ce9 0 2024-09-21T00:56:41.938 INFO:tasks.workunit.client.1.smithi187.stdout:1/841: symlink d4/l110 0 2024-09-21T00:56:41.939 INFO:tasks.workunit.client.1.smithi187.stdout:1/842: write d4/d6/d23/d6f/f96 [3930556,110731] 0 2024-09-21T00:56:41.944 INFO:tasks.workunit.client.1.smithi187.stdout:1/843: mknod d4/d6/d23/d6f/c111 0 2024-09-21T00:56:41.944 INFO:tasks.workunit.client.1.smithi187.stdout:6/775: dwrite d7/f44 [0,4194304] 0 2024-09-21T00:56:41.946 INFO:tasks.workunit.client.1.smithi187.stdout:2/825: rmdir d2/d3/d15/dfe/dc6/dcd 0 2024-09-21T00:56:41.948 INFO:tasks.workunit.client.0.smithi112.stdout:2/206: dwrite d0/d14/f35 [0,4194304] 0 2024-09-21T00:56:41.949 INFO:tasks.workunit.client.1.smithi187.stdout:4/770: truncate d2/d3/da/d2f/d32/d26/d66/d6e/f7b 190573 0 2024-09-21T00:56:41.949 INFO:tasks.workunit.client.1.smithi187.stdout:4/771: chown d2/d3/da/d48/db0 3237054 1 2024-09-21T00:56:41.950 INFO:tasks.workunit.client.1.smithi187.stdout:1/844: mkdir d4/d6/d23/d2e/d94/d35/d22/dcd/d112 0 2024-09-21T00:56:41.955 INFO:tasks.workunit.client.0.smithi112.stdout:2/207: truncate d0/d14/d8/fd 3971369 0 2024-09-21T00:56:41.958 INFO:tasks.workunit.client.1.smithi187.stdout:1/845: dread d4/d6/d23/f2b [0,4194304] 0 2024-09-21T00:56:41.960 INFO:tasks.workunit.client.1.smithi187.stdout:1/846: write d4/d6/d23/d2e/d94/d35/d4c/f5f [3926741,18970] 0 2024-09-21T00:56:41.963 INFO:tasks.workunit.client.0.smithi112.stdout:2/208: getdents d0/d14 0 2024-09-21T00:56:41.966 INFO:tasks.workunit.client.1.smithi187.stdout:1/847: rename d4/d6/d23/d2e/d94/ff4 to d4/d6/d23/d2e/d94/d35/d4c/f113 0 2024-09-21T00:56:41.976 INFO:tasks.workunit.client.1.smithi187.stdout:6/776: truncate d7/d2a/d29/d40/d50/fed 1622486 0 2024-09-21T00:56:41.976 INFO:tasks.workunit.client.1.smithi187.stdout:4/772: truncate d2/d3/d74/db1/fad 253813 0 2024-09-21T00:56:41.979 INFO:tasks.workunit.client.1.smithi187.stdout:6/777: creat d7/d2a/f100 x:0 0 0 2024-09-21T00:56:41.981 INFO:tasks.workunit.client.0.smithi112.stdout:2/209: truncate d0/d14/f35 1729543 0 2024-09-21T00:56:41.983 INFO:tasks.workunit.client.1.smithi187.stdout:4/773: dwrite d2/d3/da/d2f/d32/d22/d37/d3a/f8d [0,4194304] 0 2024-09-21T00:56:41.983 INFO:tasks.workunit.client.1.smithi187.stdout:1/848: dwrite d4/d6/d23/f54 [0,4194304] 0 2024-09-21T00:56:41.984 INFO:tasks.workunit.client.1.smithi187.stdout:4/774: dread - d2/d3/da/d2f/d32/d26/d66/d6e/fd6 zero size 2024-09-21T00:56:41.985 INFO:tasks.workunit.client.1.smithi187.stdout:6/778: creat d7/d2a/d29/d40/d50/d83/dfd/f101 x:0 0 0 2024-09-21T00:56:41.986 INFO:tasks.workunit.client.1.smithi187.stdout:4/775: write d2/d3/da/d2f/d32/d24/f67 [569696,31108] 0 2024-09-21T00:56:41.999 INFO:tasks.workunit.client.0.smithi112.stdout:2/210: dread d0/d14/f19 [0,4194304] 0 2024-09-21T00:56:42.001 INFO:tasks.workunit.client.0.smithi112.stdout:2/211: link d0/d14/d8/d27/c31 d0/df/c43 0 2024-09-21T00:56:42.003 INFO:tasks.workunit.client.0.smithi112.stdout:2/212: unlink d0/d14/f3e 0 2024-09-21T00:56:42.006 INFO:tasks.workunit.client.0.smithi112.stdout:2/213: creat d0/d14/d8/f44 x:0 0 0 2024-09-21T00:56:42.008 INFO:tasks.workunit.client.0.smithi112.stdout:2/214: write d0/d14/d8/d27/f2d [2856683,40725] 0 2024-09-21T00:56:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:41 smithi112 ceph-mon[28078]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:41 smithi112 ceph-mon[28078]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:41 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4076006307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:56:42.012 INFO:tasks.workunit.client.0.smithi112.stdout:2/215: mkdir d0/d45 0 2024-09-21T00:56:42.014 INFO:tasks.workunit.client.0.smithi112.stdout:2/216: truncate d0/fe 405649 0 2024-09-21T00:56:42.018 INFO:tasks.workunit.client.0.smithi112.stdout:2/217: mkdir d0/df/d46 0 2024-09-21T00:56:42.036 INFO:tasks.workunit.client.1.smithi187.stdout:5/684: sync 2024-09-21T00:56:42.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.040+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbb90062630 con 0x7fbb7c074a20 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.041+0000 7fbb8cff9640 1 -- 172.21.15.112:0/790411715 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fbb90062630 con 0x7fbb7c074a20 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "", 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:56:42.042 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:56:42.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb7c074a20 msgr2=0x7fbb7c076ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:42.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb7c074a20 0x7fbb7c076ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbb8002fa30 tx=0x7fbb8003c040 comp rx=0 tx=0).stop 2024-09-21T00:56:42.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 msgr2=0x7fbb9019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:42.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb9019dab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800e920 tx=0x7fbb8800ede0 comp rx=0 tx=0).stop 2024-09-21T00:56:42.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 shutdown_connections 2024-09-21T00:56:42.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fbb7c074a20 0x7fbb7c076ee0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:42.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb90076220 0x7fbb9019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:42.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 --2- 172.21.15.112:0/790411715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb90074c50 0x7fbb9019dab0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:42.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.043+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 >> 172.21.15.112:0/790411715 conn(0x7fbb900fd110 msgr2=0x7fbb90103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:42.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.044+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 shutdown_connections 2024-09-21T00:56:42.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:56:42.044+0000 7fbb96192640 1 -- 172.21.15.112:0/790411715 wait complete. 2024-09-21T00:56:42.046 INFO:tasks.workunit.client.1.smithi187.stdout:6/779: creat d7/d2a/d29/d40/d5e/ddc/f102 x:0 0 0 2024-09-21T00:56:42.050 INFO:tasks.workunit.client.1.smithi187.stdout:5/685: dwrite d0/dc/d39/f9e [0,4194304] 0 2024-09-21T00:56:42.069 INFO:tasks.workunit.client.0.smithi112.stdout:3/270: sync 2024-09-21T00:56:42.069 INFO:tasks.workunit.client.1.smithi187.stdout:5/686: dread d0/dc/d1f/d26/d8b/fdb [0,4194304] 0 2024-09-21T00:56:42.070 INFO:tasks.workunit.client.1.smithi187.stdout:5/687: write d0/dc/daa/d67/d14/d38/d5a/d6c/fca [3695906,71361] 0 2024-09-21T00:56:42.076 INFO:tasks.workunit.client.1.smithi187.stdout:5/688: dwrite d0/dc/d1f/d26/d8b/fa1 [4194304,4194304] 0 2024-09-21T00:56:42.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/271: creat d2/d8/d28/d35/f59 x:0 0 0 2024-09-21T00:56:42.130 INFO:tasks.workunit.client.1.smithi187.stdout:6/780: fdatasync d7/d2a/f5b 0 2024-09-21T00:56:42.132 INFO:tasks.workunit.client.0.smithi112.stdout:3/272: symlink d2/d38/l5a 0 2024-09-21T00:56:42.139 INFO:tasks.workunit.client.0.smithi112.stdout:2/218: dwrite d0/df/f16 [0,4194304] 0 2024-09-21T00:56:42.140 INFO:tasks.workunit.client.0.smithi112.stdout:2/219: chown d0/d14/f12 1218 1 2024-09-21T00:56:42.141 INFO:tasks.workunit.client.0.smithi112.stdout:2/220: read d0/df/f13 [958526,31018] 0 2024-09-21T00:56:42.141 INFO:tasks.workunit.client.1.smithi187.stdout:4/776: getdents d2/d3/da/d2f/d32/d25 0 2024-09-21T00:56:42.141 INFO:tasks.workunit.client.0.smithi112.stdout:2/221: stat d0/df/f34 0 2024-09-21T00:56:42.143 INFO:tasks.workunit.client.1.smithi187.stdout:5/689: getdents d0/dc/daa/d67/d14/d1b/d27/dc7 0 2024-09-21T00:56:42.146 INFO:tasks.workunit.client.1.smithi187.stdout:1/849: truncate d4/d6/d23/d2e/d94/d35/d79/dce/fef 2103896 0 2024-09-21T00:56:42.147 INFO:tasks.workunit.client.1.smithi187.stdout:0/694: sync 2024-09-21T00:56:42.147 INFO:tasks.workunit.client.1.smithi187.stdout:9/904: sync 2024-09-21T00:56:42.147 INFO:tasks.workunit.client.1.smithi187.stdout:8/791: sync 2024-09-21T00:56:42.148 INFO:tasks.workunit.client.1.smithi187.stdout:1/850: read d4/d6/d23/d2e/d53/fc5 [3111232,18638] 0 2024-09-21T00:56:42.148 INFO:tasks.workunit.client.1.smithi187.stdout:5/690: creat d0/dc/daa/d67/d14/d38/d5a/d6c/fe4 x:0 0 0 2024-09-21T00:56:42.152 INFO:tasks.workunit.client.1.smithi187.stdout:8/792: creat dc/d2f/d80/db8/dba/dc7/f109 x:0 0 0 2024-09-21T00:56:42.156 INFO:tasks.workunit.client.1.smithi187.stdout:5/691: truncate d0/dc/daa/d67/d30/d6b/fa0 2279159 0 2024-09-21T00:56:42.157 INFO:tasks.workunit.client.1.smithi187.stdout:8/793: truncate dc/d2f/d80/db8/dba/d29/f4c 1155711 0 2024-09-21T00:56:42.157 INFO:tasks.workunit.client.1.smithi187.stdout:0/695: link d0/d17/d18/c40 d0/d17/d1c/d23/df/d51/ceb 0 2024-09-21T00:56:42.158 INFO:tasks.workunit.client.0.smithi112.stdout:2/222: dread d0/f5 [4194304,4194304] 0 2024-09-21T00:56:42.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:41 smithi187 ceph-mon[34997]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:42.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:41 smithi187 ceph-mon[34997]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:42.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:41 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4076006307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:56:42.159 INFO:tasks.workunit.client.1.smithi187.stdout:5/692: mkdir d0/dc/daa/d67/dcc/de5 0 2024-09-21T00:56:42.161 INFO:tasks.workunit.client.1.smithi187.stdout:8/794: creat dc/d2f/d80/db8/dba/dc7/f10a x:0 0 0 2024-09-21T00:56:42.161 INFO:tasks.workunit.client.1.smithi187.stdout:8/795: dread - dc/d2f/d54/d69/de8/ff5 zero size 2024-09-21T00:56:42.162 INFO:tasks.workunit.client.0.smithi112.stdout:2/223: mkdir d0/d14/d47 0 2024-09-21T00:56:42.162 INFO:tasks.workunit.client.1.smithi187.stdout:8/796: chown dc/d2f/d80/db8/dba/f3d 1265 1 2024-09-21T00:56:42.163 INFO:tasks.workunit.client.1.smithi187.stdout:4/777: dread d2/d3/da/d2f/d32/d24/f28 [0,4194304] 0 2024-09-21T00:56:42.165 INFO:tasks.workunit.client.1.smithi187.stdout:5/693: mknod d0/dc/daa/d67/d14/d57/ce6 0 2024-09-21T00:56:42.169 INFO:tasks.workunit.client.1.smithi187.stdout:0/696: dwrite d0/d17/d18/f68 [4194304,4194304] 0 2024-09-21T00:56:42.169 INFO:tasks.workunit.client.0.smithi112.stdout:2/224: dwrite d0/d14/d8/d27/f3f [0,4194304] 0 2024-09-21T00:56:42.170 INFO:tasks.workunit.client.1.smithi187.stdout:9/905: write d4/d13/d14/d1d/f3c [3104885,68113] 0 2024-09-21T00:56:42.171 INFO:tasks.workunit.client.1.smithi187.stdout:5/694: symlink d0/dc/daa/d67/d14/d1b/d27/le7 0 2024-09-21T00:56:42.172 INFO:tasks.workunit.client.1.smithi187.stdout:9/906: readlink d4/d13/d14/d28/d72/l93 0 2024-09-21T00:56:42.173 INFO:tasks.workunit.client.1.smithi187.stdout:5/695: chown d0/dc/daa/d67/d14/d38/f4f 1355338 1 2024-09-21T00:56:42.174 INFO:tasks.workunit.client.1.smithi187.stdout:1/851: write d4/d6/d23/d2e/d94/d35/d4c/fa7 [539675,64461] 0 2024-09-21T00:56:42.175 INFO:tasks.workunit.client.1.smithi187.stdout:0/697: write d0/d17/d1c/d23/df/fe3 [1854373,98149] 0 2024-09-21T00:56:42.176 INFO:tasks.workunit.client.1.smithi187.stdout:0/698: chown d0/d17/f8c 93679 1 2024-09-21T00:56:42.180 INFO:tasks.workunit.client.1.smithi187.stdout:4/778: dread d2/d3/da/d16/f61 [4194304,4194304] 0 2024-09-21T00:56:42.184 INFO:tasks.workunit.client.1.smithi187.stdout:5/696: creat d0/dc/d1f/fe8 x:0 0 0 2024-09-21T00:56:42.188 INFO:tasks.workunit.client.1.smithi187.stdout:9/907: mknod d4/d8/d46/d54/d10f/d121/d94/d127/c12c 0 2024-09-21T00:56:42.188 INFO:tasks.workunit.client.1.smithi187.stdout:9/908: chown d4/d61/d6a/d90/ca8 14949611 1 2024-09-21T00:56:42.190 INFO:tasks.workunit.client.1.smithi187.stdout:0/699: creat d0/d17/d1c/d23/df/d51/fec x:0 0 0 2024-09-21T00:56:42.191 INFO:tasks.workunit.client.1.smithi187.stdout:8/797: write dc/f28 [1153828,94720] 0 2024-09-21T00:56:42.194 INFO:tasks.workunit.client.1.smithi187.stdout:4/779: truncate d2/d3/d56/d84/d60/d9e/fe6 2667660 0 2024-09-21T00:56:42.196 INFO:tasks.workunit.client.1.smithi187.stdout:4/780: chown d2/d3/da/d16/fdd 701163 1 2024-09-21T00:56:42.198 INFO:tasks.workunit.client.1.smithi187.stdout:8/798: dwrite dc/d44/fb2 [0,4194304] 0 2024-09-21T00:56:42.201 INFO:tasks.workunit.client.1.smithi187.stdout:9/909: dread d4/d13/d14/d1d/f3c [0,4194304] 0 2024-09-21T00:56:42.202 INFO:tasks.workunit.client.1.smithi187.stdout:8/799: mkdir dc/d2f/d34/d4b/d85/d10b 0 2024-09-21T00:56:42.204 INFO:tasks.workunit.client.1.smithi187.stdout:4/781: dread d2/d3/da/f4d [0,4194304] 0 2024-09-21T00:56:42.205 INFO:tasks.workunit.client.1.smithi187.stdout:9/910: mknod d4/d8/d46/d54/d10f/d121/dbf/ddd/c12d 0 2024-09-21T00:56:42.205 INFO:tasks.workunit.client.1.smithi187.stdout:5/697: truncate d0/dc/daa/d67/f32 2079669 0 2024-09-21T00:56:42.207 INFO:tasks.workunit.client.1.smithi187.stdout:8/800: mkdir dc/df2/d10c 0 2024-09-21T00:56:42.208 INFO:tasks.workunit.client.1.smithi187.stdout:5/698: symlink d0/dc/d1f/le9 0 2024-09-21T00:56:42.208 INFO:tasks.workunit.client.1.smithi187.stdout:4/782: getdents d2/d3/da/d2f/d32/d24/de7 0 2024-09-21T00:56:42.209 INFO:tasks.workunit.client.1.smithi187.stdout:9/911: truncate d4/d10/d43/d11c/f51 2258279 0 2024-09-21T00:56:42.212 INFO:tasks.workunit.client.1.smithi187.stdout:8/801: creat dc/d2f/f10d x:0 0 0 2024-09-21T00:56:42.212 INFO:tasks.workunit.client.1.smithi187.stdout:0/700: dwrite d0/d17/d18/f8a [0,4194304] 0 2024-09-21T00:56:42.215 INFO:tasks.workunit.client.1.smithi187.stdout:0/701: readlink d0/d17/d18/l1e 0 2024-09-21T00:56:42.217 INFO:tasks.workunit.client.1.smithi187.stdout:8/802: creat dc/d2f/d54/d69/db3/f10e x:0 0 0 2024-09-21T00:56:42.219 INFO:tasks.workunit.client.1.smithi187.stdout:0/702: write d0/d17/d1c/d65/fe5 [270059,15598] 0 2024-09-21T00:56:42.219 INFO:tasks.workunit.client.1.smithi187.stdout:8/803: chown dc/fd 194 1 2024-09-21T00:56:42.222 INFO:tasks.workunit.client.1.smithi187.stdout:9/912: link d4/d13/d20/d2e/c52 d4/d8/d46/d54/d10f/d121/d108/dfc/d10a/c12e 0 2024-09-21T00:56:42.223 INFO:tasks.workunit.client.1.smithi187.stdout:4/783: dwrite d2/d3/da/d2f/d4b/fa9 [0,4194304] 0 2024-09-21T00:56:42.226 INFO:tasks.workunit.client.1.smithi187.stdout:0/703: mkdir d0/d17/d1c/ded 0 2024-09-21T00:56:42.227 INFO:tasks.workunit.client.1.smithi187.stdout:9/913: mknod d4/d13/d14/d28/d72/c12f 0 2024-09-21T00:56:42.230 INFO:tasks.workunit.client.1.smithi187.stdout:8/804: rename dc/d2f/c8e to dc/d44/dc1/c10f 0 2024-09-21T00:56:42.232 INFO:tasks.workunit.client.1.smithi187.stdout:4/784: rename d2/d3/da/d2f/d4b/d7e/dc8/d89/lda to d2/d3/da/d2f/d32/d24/dcd/lea 0 2024-09-21T00:56:42.233 INFO:tasks.workunit.client.1.smithi187.stdout:9/914: mknod d4/d61/d6a/d90/d126/c130 0 2024-09-21T00:56:42.234 INFO:tasks.workunit.client.1.smithi187.stdout:8/805: readlink dc/d2f/d80/db8/dba/d3e/de3/lf3 0 2024-09-21T00:56:42.234 INFO:tasks.workunit.client.1.smithi187.stdout:0/704: dread d0/d60/d6b/f8d [0,4194304] 0 2024-09-21T00:56:42.235 INFO:tasks.workunit.client.1.smithi187.stdout:9/915: fsync d4/d61/d6c/fbd 0 2024-09-21T00:56:42.236 INFO:tasks.workunit.client.0.smithi112.stdout:1/140: sync 2024-09-21T00:56:42.237 INFO:tasks.workunit.client.0.smithi112.stdout:4/264: sync 2024-09-21T00:56:42.237 INFO:tasks.workunit.client.0.smithi112.stdout:1/141: fsync d5/d8/d10/f17 0 2024-09-21T00:56:42.238 INFO:tasks.workunit.client.1.smithi187.stdout:8/806: rename dc/d44/f6c to dc/f110 0 2024-09-21T00:56:42.239 INFO:tasks.workunit.client.1.smithi187.stdout:5/699: dread d0/dc/daa/d67/f50 [0,4194304] 0 2024-09-21T00:56:42.239 INFO:tasks.workunit.client.0.smithi112.stdout:4/265: symlink d1/d7/d9/d1a/d22/l5e 0 2024-09-21T00:56:42.240 INFO:tasks.workunit.client.0.smithi112.stdout:1/142: symlink d5/d8/d10/l2d 0 2024-09-21T00:56:42.241 INFO:tasks.workunit.client.1.smithi187.stdout:0/705: dread d0/d17/f83 [0,4194304] 0 2024-09-21T00:56:42.242 INFO:tasks.workunit.client.0.smithi112.stdout:4/266: mkdir d1/d5/d1c/d1e/d4a/d5f 0 2024-09-21T00:56:42.242 INFO:tasks.workunit.client.1.smithi187.stdout:4/785: dwrite d2/d3/d74/db1/da2/fd0 [0,4194304] 0 2024-09-21T00:56:42.244 INFO:tasks.workunit.client.0.smithi112.stdout:4/267: mknod d1/d7/d9/d1a/c60 0 2024-09-21T00:56:42.244 INFO:tasks.workunit.client.0.smithi112.stdout:1/143: dread d5/d8/d10/f16 [0,4194304] 0 2024-09-21T00:56:42.246 INFO:tasks.workunit.client.1.smithi187.stdout:5/700: read d0/dc/daa/d67/d14/d38/d5a/f8d [305399,89502] 0 2024-09-21T00:56:42.247 INFO:tasks.workunit.client.1.smithi187.stdout:0/706: dread d0/d17/f83 [0,4194304] 0 2024-09-21T00:56:42.248 INFO:tasks.workunit.client.0.smithi112.stdout:4/268: dread d1/d2d/f55 [0,4194304] 0 2024-09-21T00:56:42.248 INFO:tasks.workunit.client.1.smithi187.stdout:9/916: dwrite d4/d13/d14/d28/ff8 [0,4194304] 0 2024-09-21T00:56:42.249 INFO:tasks.workunit.client.0.smithi112.stdout:1/144: mkdir d5/d8/d10/d2e 0 2024-09-21T00:56:42.249 INFO:tasks.workunit.client.0.smithi112.stdout:4/269: write d1/d7/f2e [4385173,89113] 0 2024-09-21T00:56:42.250 INFO:tasks.workunit.client.0.smithi112.stdout:4/270: stat d1/d2d/f55 0 2024-09-21T00:56:42.251 INFO:tasks.workunit.client.1.smithi187.stdout:0/707: readlink d0/d17/l1b 0 2024-09-21T00:56:42.252 INFO:tasks.workunit.client.1.smithi187.stdout:2/826: sync 2024-09-21T00:56:42.252 INFO:tasks.workunit.client.1.smithi187.stdout:7/685: sync 2024-09-21T00:56:42.252 INFO:tasks.workunit.client.1.smithi187.stdout:3/701: sync 2024-09-21T00:56:42.253 INFO:tasks.workunit.client.0.smithi112.stdout:1/145: unlink d5/l2a 0 2024-09-21T00:56:42.253 INFO:tasks.workunit.client.1.smithi187.stdout:8/807: dwrite dc/d2f/d34/d4b/f99 [0,4194304] 0 2024-09-21T00:56:42.254 INFO:tasks.workunit.client.1.smithi187.stdout:7/686: fsync d1/dce/fd9 0 2024-09-21T00:56:42.255 INFO:tasks.workunit.client.0.smithi112.stdout:4/271: write d1/d5/f15 [904740,65028] 0 2024-09-21T00:56:42.257 INFO:tasks.workunit.client.0.smithi112.stdout:4/272: write d1/d5/d1c/d1e/f41 [4161347,112648] 0 2024-09-21T00:56:42.259 INFO:tasks.workunit.client.1.smithi187.stdout:5/701: dwrite d0/dc/daa/d67/d14/f21 [0,4194304] 0 2024-09-21T00:56:42.260 INFO:tasks.workunit.client.0.smithi112.stdout:4/273: dread d1/d2d/d34/f4e [0,4194304] 0 2024-09-21T00:56:42.260 INFO:tasks.workunit.client.1.smithi187.stdout:0/708: dwrite d0/f16 [4194304,4194304] 0 2024-09-21T00:56:42.263 INFO:tasks.workunit.client.1.smithi187.stdout:0/709: truncate d0/d17/d18/d90/fa8 923538 0 2024-09-21T00:56:42.266 INFO:tasks.workunit.client.0.smithi112.stdout:1/146: truncate d5/d8/d10/f17 3864316 0 2024-09-21T00:56:42.270 INFO:tasks.workunit.client.0.smithi112.stdout:1/147: rmdir d5/d8/d10 39 2024-09-21T00:56:42.271 INFO:tasks.workunit.client.1.smithi187.stdout:4/786: mknod d2/d3/da/d2f/d32/d22/d37/dc7/ceb 0 2024-09-21T00:56:42.273 INFO:tasks.workunit.client.1.smithi187.stdout:2/827: unlink d2/da8/d6c/d97/db0/fa9 0 2024-09-21T00:56:42.275 INFO:tasks.workunit.client.1.smithi187.stdout:7/687: creat d1/d18/d31/d41/d64/d93/ff0 x:0 0 0 2024-09-21T00:56:42.275 INFO:tasks.workunit.client.1.smithi187.stdout:6/781: sync 2024-09-21T00:56:42.275 INFO:tasks.workunit.client.1.smithi187.stdout:1/852: sync 2024-09-21T00:56:42.278 INFO:tasks.workunit.client.0.smithi112.stdout:1/148: write d5/d8/d10/f20 [994502,79671] 0 2024-09-21T00:56:42.278 INFO:tasks.workunit.client.1.smithi187.stdout:0/710: dread d0/d17/d18/d90/dd1/fe9 [0,4194304] 0 2024-09-21T00:56:42.278 INFO:tasks.workunit.client.1.smithi187.stdout:7/688: chown d1/d18/d31/d41/d64/d93/dc1/f59 3604749 1 2024-09-21T00:56:42.280 INFO:tasks.workunit.client.1.smithi187.stdout:0/711: write d0/fbb [107580,86361] 0 2024-09-21T00:56:42.280 INFO:tasks.workunit.client.0.smithi112.stdout:1/149: rename d5/d8/dd/c19 to d5/d8/d13/c2f 0 2024-09-21T00:56:42.281 INFO:tasks.workunit.client.1.smithi187.stdout:4/787: dwrite d2/d3/da/d2f/d32/d22/f49 [8388608,4194304] 0 2024-09-21T00:56:42.284 INFO:tasks.workunit.client.0.smithi112.stdout:1/150: symlink d5/d8/d14/l30 0 2024-09-21T00:56:42.287 INFO:tasks.workunit.client.0.smithi112.stdout:1/151: write d5/d8/d10/f16 [452052,80677] 0 2024-09-21T00:56:42.291 INFO:tasks.workunit.client.0.smithi112.stdout:1/152: rename d5/d8/f11 to d5/d8/d10/d2e/f31 0 2024-09-21T00:56:42.305 INFO:tasks.workunit.client.0.smithi112.stdout:4/274: truncate d1/d7/f28 539071 0 2024-09-21T00:56:42.311 INFO:tasks.workunit.client.0.smithi112.stdout:4/275: dwrite d1/d5/d1c/d1e/f41 [4194304,4194304] 0 2024-09-21T00:56:42.311 INFO:tasks.workunit.client.0.smithi112.stdout:4/276: fdatasync d1/d7/f2e 0 2024-09-21T00:56:42.312 INFO:tasks.workunit.client.0.smithi112.stdout:4/277: stat d1/d2d/d34/l49 0 2024-09-21T00:56:42.318 INFO:tasks.workunit.client.0.smithi112.stdout:4/278: creat d1/d7/d9/f61 x:0 0 0 2024-09-21T00:56:42.319 INFO:tasks.workunit.client.0.smithi112.stdout:4/279: dread - d1/d7/d9/f61 zero size 2024-09-21T00:56:42.325 INFO:tasks.workunit.client.0.smithi112.stdout:4/280: dwrite d1/d7/d9/f61 [0,4194304] 0 2024-09-21T00:56:42.327 INFO:tasks.workunit.client.0.smithi112.stdout:1/153: write d5/d8/f12 [2987875,15464] 0 2024-09-21T00:56:42.328 INFO:tasks.workunit.client.1.smithi187.stdout:3/702: mknod d9/d7f/dcb/d9c/ce3 0 2024-09-21T00:56:42.328 INFO:tasks.workunit.client.0.smithi112.stdout:1/154: dread - d5/d8/d14/f25 zero size 2024-09-21T00:56:42.330 INFO:tasks.workunit.client.0.smithi112.stdout:4/281: mknod d1/d5/d1c/c62 0 2024-09-21T00:56:42.331 INFO:tasks.workunit.client.0.smithi112.stdout:4/282: dread - d1/d7/d9/d1a/d22/f56 zero size 2024-09-21T00:56:42.331 INFO:tasks.workunit.client.0.smithi112.stdout:1/155: mkdir d5/d8/d14/d32 0 2024-09-21T00:56:42.334 INFO:tasks.workunit.client.0.smithi112.stdout:4/283: symlink d1/d5/d1c/l63 0 2024-09-21T00:56:42.335 INFO:tasks.workunit.client.0.smithi112.stdout:4/284: write d1/d5/d1c/d1e/f31 [3232897,75058] 0 2024-09-21T00:56:42.337 INFO:tasks.workunit.client.1.smithi187.stdout:9/917: creat d4/d10/d39/f131 x:0 0 0 2024-09-21T00:56:42.340 INFO:tasks.workunit.client.0.smithi112.stdout:1/156: dread d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:42.340 INFO:tasks.workunit.client.1.smithi187.stdout:5/702: mkdir d0/dc/daa/d67/dcc/de5/dea 0 2024-09-21T00:56:42.341 INFO:tasks.workunit.client.0.smithi112.stdout:1/157: chown d5/fc 452204 1 2024-09-21T00:56:42.341 INFO:tasks.workunit.client.1.smithi187.stdout:5/703: chown d0/dc/daa/d67/lae 919445 1 2024-09-21T00:56:42.344 INFO:tasks.workunit.client.0.smithi112.stdout:1/158: creat d5/f33 x:0 0 0 2024-09-21T00:56:42.345 INFO:tasks.workunit.client.0.smithi112.stdout:1/159: dread - d5/f33 zero size 2024-09-21T00:56:42.345 INFO:tasks.workunit.client.1.smithi187.stdout:7/689: write d1/d18/d31/f51 [88579,91249] 0 2024-09-21T00:56:42.346 INFO:tasks.workunit.client.0.smithi112.stdout:4/285: creat d1/d5/f64 x:0 0 0 2024-09-21T00:56:42.347 INFO:tasks.workunit.client.1.smithi187.stdout:7/690: write d1/d18/d31/d33/d3b/d9f/fd2 [731100,20365] 0 2024-09-21T00:56:42.348 INFO:tasks.workunit.client.1.smithi187.stdout:0/712: write d0/d17/d18/f24 [100533,98993] 0 2024-09-21T00:56:42.348 INFO:tasks.workunit.client.0.smithi112.stdout:1/160: mkdir d5/d34 0 2024-09-21T00:56:42.349 INFO:tasks.workunit.client.1.smithi187.stdout:4/788: creat d2/d3/d74/db1/da2/fec x:0 0 0 2024-09-21T00:56:42.350 INFO:tasks.workunit.client.0.smithi112.stdout:1/161: read d5/d8/f1f [3022387,53456] 0 2024-09-21T00:56:42.353 INFO:tasks.workunit.client.1.smithi187.stdout:9/918: truncate d4/d8/d46/d54/d10f/d121/d66/f7d 402439 0 2024-09-21T00:56:42.353 INFO:tasks.workunit.client.0.smithi112.stdout:4/286: dwrite d1/d5/d1c/d1e/f20 [4194304,4194304] 0 2024-09-21T00:56:42.354 INFO:tasks.workunit.client.1.smithi187.stdout:1/853: fsync d4/d86/fe8 0 2024-09-21T00:56:42.354 INFO:tasks.workunit.client.0.smithi112.stdout:4/287: chown d1/d7/f2e 258386833 1 2024-09-21T00:56:42.355 INFO:tasks.workunit.client.0.smithi112.stdout:8/121: sync 2024-09-21T00:56:42.358 INFO:tasks.workunit.client.1.smithi187.stdout:1/854: dread d4/d6/d23/d2e/d53/f7f [0,4194304] 0 2024-09-21T00:56:42.359 INFO:tasks.workunit.client.1.smithi187.stdout:4/789: dread d2/d3/da/d48/f9c [0,4194304] 0 2024-09-21T00:56:42.361 INFO:tasks.workunit.client.1.smithi187.stdout:7/691: rename d1/d18 to d1/dce/dd0/d97/df1 0 2024-09-21T00:56:42.361 INFO:tasks.workunit.client.1.smithi187.stdout:4/790: readlink d2/d3/lc3 0 2024-09-21T00:56:42.362 INFO:tasks.workunit.client.0.smithi112.stdout:4/288: creat d1/d5/d1c/f65 x:0 0 0 2024-09-21T00:56:42.363 INFO:tasks.workunit.client.1.smithi187.stdout:7/692: write d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/f88 [4859855,106835] 0 2024-09-21T00:56:42.363 INFO:tasks.workunit.client.0.smithi112.stdout:4/289: read - d1/d7/d9/d1a/d22/f56 zero size 2024-09-21T00:56:42.365 INFO:tasks.workunit.client.1.smithi187.stdout:7/693: fsync d1/dce/dd0/d97/df1/d31/d41/d8a/dd5/fd8 0 2024-09-21T00:56:42.365 INFO:tasks.workunit.client.1.smithi187.stdout:9/919: creat d4/d8/d46/d54/d10f/d121/dbf/ddd/f132 x:0 0 0 2024-09-21T00:56:42.367 INFO:tasks.workunit.client.0.smithi112.stdout:8/122: rename d0/f9 to d0/d13/d1b/d22/f24 0 2024-09-21T00:56:42.368 INFO:tasks.workunit.client.0.smithi112.stdout:4/290: dread d1/d5/d1c/d1e/f41 [4194304,4194304] 0 2024-09-21T00:56:42.368 INFO:tasks.workunit.client.1.smithi187.stdout:5/704: mknod d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9/ceb 0 2024-09-21T00:56:42.368 INFO:tasks.workunit.client.1.smithi187.stdout:8/808: write dc/d44/f5a [181421,90518] 0 2024-09-21T00:56:42.369 INFO:tasks.workunit.client.1.smithi187.stdout:8/809: stat dc/d2f/d34/c58 0 2024-09-21T00:56:42.369 INFO:tasks.workunit.client.1.smithi187.stdout:5/705: write d0/dc/daa/d67/d30/d6b/fac [8401305,61624] 0 2024-09-21T00:56:42.371 INFO:tasks.workunit.client.0.smithi112.stdout:8/123: creat d0/d13/d1b/d22/f25 x:0 0 0 2024-09-21T00:56:42.373 INFO:tasks.workunit.client.1.smithi187.stdout:4/791: unlink d2/d3/da/d2f/d4b/d7e/dc8/f54 0 2024-09-21T00:56:42.373 INFO:tasks.workunit.client.0.smithi112.stdout:4/291: write d1/d2d/f55 [4414782,93085] 0 2024-09-21T00:56:42.375 INFO:tasks.workunit.client.1.smithi187.stdout:4/792: write d2/d3/da/d2f/d32/d22/f3d [3524657,78992] 0 2024-09-21T00:56:42.376 INFO:tasks.workunit.client.1.smithi187.stdout:1/855: dwrite d4/f27 [0,4194304] 0 2024-09-21T00:56:42.377 INFO:tasks.workunit.client.1.smithi187.stdout:0/713: symlink d0/d17/lee 0 2024-09-21T00:56:42.377 INFO:tasks.workunit.client.1.smithi187.stdout:4/793: chown d2/d3/lc3 26 1 2024-09-21T00:56:42.377 INFO:tasks.workunit.client.0.smithi112.stdout:8/124: creat d0/f26 x:0 0 0 2024-09-21T00:56:42.378 INFO:tasks.workunit.client.0.smithi112.stdout:8/125: fsync d0/fd 0 2024-09-21T00:56:42.379 INFO:tasks.workunit.client.0.smithi112.stdout:8/126: read d0/fd [2335070,62384] 0 2024-09-21T00:56:42.379 INFO:tasks.workunit.client.0.smithi112.stdout:8/127: stat d0/f1a 0 2024-09-21T00:56:42.380 INFO:tasks.workunit.client.1.smithi187.stdout:4/794: chown d2/d3/d56/d84/cb5 5181354 1 2024-09-21T00:56:42.381 INFO:tasks.workunit.client.1.smithi187.stdout:2/828: dwrite d2/da8/d6c/d97/fb7 [0,4194304] 0 2024-09-21T00:56:42.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/292: mknod d1/d5/d1c/d1e/d4a/d5f/c66 0 2024-09-21T00:56:42.389 INFO:tasks.workunit.client.1.smithi187.stdout:8/810: creat dc/d2f/d80/db8/dba/dc7/f111 x:0 0 0 2024-09-21T00:56:42.389 INFO:tasks.workunit.client.0.smithi112.stdout:1/162: truncate d5/d8/d10/f16 350292 0 2024-09-21T00:56:42.390 INFO:tasks.workunit.client.1.smithi187.stdout:3/703: dwrite d9/d19/d1c/f3e [4194304,4194304] 0 2024-09-21T00:56:42.392 INFO:tasks.workunit.client.1.smithi187.stdout:5/706: unlink d0/dc/daa/d67/d14/d38/d5a/d6c/cbd 0 2024-09-21T00:56:42.393 INFO:tasks.workunit.client.1.smithi187.stdout:0/714: dread d0/d17/d1c/d23/d36/fa4 [0,4194304] 0 2024-09-21T00:56:42.394 INFO:tasks.workunit.client.1.smithi187.stdout:5/707: readlink d0/dc/daa/d67/d14/lc2 0 2024-09-21T00:56:42.400 INFO:tasks.workunit.client.1.smithi187.stdout:6/782: getdents d7/d2a/d7a 0 2024-09-21T00:56:42.403 INFO:tasks.workunit.client.1.smithi187.stdout:1/856: mkdir d4/d6/d23/d2e/d94/d66/ddf/d114 0 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:1/163: creat d5/d8/f35 x:0 0 0 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:3/273: sync 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:0/192: sync 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:7/213: sync 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:6/194: sync 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:5/92: sync 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:9/161: sync 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.0.smithi112.stdout:2/225: sync 2024-09-21T00:56:42.406 INFO:tasks.workunit.client.1.smithi187.stdout:2/829: mknod d2/d3/d15/c127 0 2024-09-21T00:56:42.407 INFO:tasks.workunit.client.1.smithi187.stdout:2/830: fdatasync d2/d3/d15/dfe/d2d/d8f/f20 0 2024-09-21T00:56:42.407 INFO:tasks.workunit.client.1.smithi187.stdout:1/857: read d4/d6/d23/d2e/d94/d35/d4c/f4d [6454704,62267] 0 2024-09-21T00:56:42.408 INFO:tasks.workunit.client.1.smithi187.stdout:2/831: fdatasync d2/dc/d21/fd1 0 2024-09-21T00:56:42.409 INFO:tasks.workunit.client.0.smithi112.stdout:9/162: chown d5/d6/f7 37 1 2024-09-21T00:56:42.410 INFO:tasks.workunit.client.1.smithi187.stdout:1/858: write d4/f89 [1391177,89793] 0 2024-09-21T00:56:42.411 INFO:tasks.workunit.client.0.smithi112.stdout:6/195: dread d9/d13/f39 [0,4194304] 0 2024-09-21T00:56:42.412 INFO:tasks.workunit.client.0.smithi112.stdout:9/163: chown d5/d6/d19/f1d 458 1 2024-09-21T00:56:42.412 INFO:tasks.workunit.client.1.smithi187.stdout:3/704: stat d9/d7f/dcb/c3a 0 2024-09-21T00:56:42.413 INFO:tasks.workunit.client.1.smithi187.stdout:1/859: chown d4/d6/d23/d2e/d53/fea 21 1 2024-09-21T00:56:42.413 INFO:tasks.workunit.client.0.smithi112.stdout:2/226: creat d0/f48 x:0 0 0 2024-09-21T00:56:42.414 INFO:tasks.workunit.client.0.smithi112.stdout:9/164: chown d5/d6/l25 34050684 1 2024-09-21T00:56:42.414 INFO:tasks.workunit.client.0.smithi112.stdout:6/196: truncate d9/df/d19/f49 731003 0 2024-09-21T00:56:42.414 INFO:tasks.workunit.client.1.smithi187.stdout:7/694: dwrite d1/dce/dd0/d97/df1/d31/f36 [0,4194304] 0 2024-09-21T00:56:42.414 INFO:tasks.workunit.client.1.smithi187.stdout:0/715: creat d0/d5a/fef x:0 0 0 2024-09-21T00:56:42.416 INFO:tasks.workunit.client.1.smithi187.stdout:7/695: readlink d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d5d/l60 0 2024-09-21T00:56:42.417 INFO:tasks.workunit.client.1.smithi187.stdout:5/708: symlink d0/dc/d1f/d26/lec 0 2024-09-21T00:56:42.419 INFO:tasks.workunit.client.0.smithi112.stdout:3/274: dwrite d2/d38/d3f/f49 [0,4194304] 0 2024-09-21T00:56:42.420 INFO:tasks.workunit.client.0.smithi112.stdout:0/193: mknod d8/d1b/d2c/d2e/c3e 0 2024-09-21T00:56:42.423 INFO:tasks.workunit.client.0.smithi112.stdout:8/128: truncate d0/ff 3483182 0 2024-09-21T00:56:42.424 INFO:tasks.workunit.client.1.smithi187.stdout:6/783: dread d7/d2a/d29/d40/d50/d83/fc3 [0,4194304] 0 2024-09-21T00:56:42.425 INFO:tasks.workunit.client.0.smithi112.stdout:0/194: write d8/fb [1945628,39167] 0 2024-09-21T00:56:42.425 INFO:tasks.workunit.client.1.smithi187.stdout:7/696: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/fbc [0,4194304] 0 2024-09-21T00:56:42.425 INFO:tasks.workunit.client.0.smithi112.stdout:3/275: write d2/d8/d28/f2c [858713,385] 0 2024-09-21T00:56:42.428 INFO:tasks.workunit.client.1.smithi187.stdout:7/697: dread - d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fac zero size 2024-09-21T00:56:42.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/227: dwrite d0/f48 [0,4194304] 0 2024-09-21T00:56:42.430 INFO:tasks.workunit.client.1.smithi187.stdout:9/920: write d4/d8/f22 [985468,85358] 0 2024-09-21T00:56:42.431 INFO:tasks.workunit.client.0.smithi112.stdout:1/164: creat d5/d34/f36 x:0 0 0 2024-09-21T00:56:42.432 INFO:tasks.workunit.client.0.smithi112.stdout:7/214: dread d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:42.432 INFO:tasks.workunit.client.0.smithi112.stdout:1/165: stat d5/d8/dd/cf 0 2024-09-21T00:56:42.434 INFO:tasks.workunit.client.0.smithi112.stdout:1/166: stat d5/d8/dd/cf 0 2024-09-21T00:56:42.434 INFO:tasks.workunit.client.0.smithi112.stdout:7/215: write d0/fa [1602398,71569] 0 2024-09-21T00:56:42.436 INFO:tasks.workunit.client.1.smithi187.stdout:4/795: write d2/d3/d56/d84/d60/d6c/f91 [2273471,2837] 0 2024-09-21T00:56:42.437 INFO:tasks.workunit.client.1.smithi187.stdout:4/796: readlink d2/d3/da/d2f/d32/d24/l7d 0 2024-09-21T00:56:42.439 INFO:tasks.workunit.client.1.smithi187.stdout:4/797: write d2/d3/d56/d84/d60/d6c/f91 [3055768,116778] 0 2024-09-21T00:56:42.444 INFO:tasks.workunit.client.1.smithi187.stdout:8/811: unlink dc/d2f/l4a 0 2024-09-21T00:56:42.445 INFO:tasks.workunit.client.0.smithi112.stdout:5/93: creat d8/f1a x:0 0 0 2024-09-21T00:56:42.446 INFO:tasks.workunit.client.0.smithi112.stdout:5/94: fsync d8/d9/de/f18 0 2024-09-21T00:56:42.447 INFO:tasks.workunit.client.1.smithi187.stdout:2/832: rename d2/dc/f118 to d2/dc/d2e/d4a/d7c/d52/da3/de6/f128 0 2024-09-21T00:56:42.447 INFO:tasks.workunit.client.1.smithi187.stdout:5/709: rename d0/dc to d0/dc/daa/d67/d14/d57/d5c/dc9/ded 22 2024-09-21T00:56:42.447 INFO:tasks.workunit.client.1.smithi187.stdout:2/833: fsync d2/dc/f46 0 2024-09-21T00:56:42.450 INFO:tasks.workunit.client.1.smithi187.stdout:1/860: mkdir d4/d6/d23/d2e/d94/d35/d22/d65/db9/d115 0 2024-09-21T00:56:42.450 INFO:tasks.workunit.client.0.smithi112.stdout:3/276: rmdir d2/d8/d28 39 2024-09-21T00:56:42.452 INFO:tasks.workunit.client.1.smithi187.stdout:1/861: write d4/d6/d23/f54 [4412999,87511] 0 2024-09-21T00:56:42.454 INFO:tasks.workunit.client.1.smithi187.stdout:6/784: symlink d7/d2a/d29/d40/d45/l103 0 2024-09-21T00:56:42.455 INFO:tasks.workunit.client.1.smithi187.stdout:5/710: dwrite d0/dc/daa/d67/d14/d38/d5a/fbc [4194304,4194304] 0 2024-09-21T00:56:42.456 INFO:tasks.workunit.client.1.smithi187.stdout:5/711: write d0/fa5 [2818034,43769] 0 2024-09-21T00:56:42.460 INFO:tasks.workunit.client.0.smithi112.stdout:1/167: mknod d5/d8/dd/c37 0 2024-09-21T00:56:42.464 INFO:tasks.workunit.client.0.smithi112.stdout:2/228: dwrite d0/d14/f12 [0,4194304] 0 2024-09-21T00:56:42.464 INFO:tasks.workunit.client.0.smithi112.stdout:6/197: write d9/d1f/f35 [70495,1805] 0 2024-09-21T00:56:42.464 INFO:tasks.workunit.client.0.smithi112.stdout:4/293: dwrite d1/d7/f28 [0,4194304] 0 2024-09-21T00:56:42.470 INFO:tasks.workunit.client.0.smithi112.stdout:1/168: chown d5/d8/dd/c37 2 1 2024-09-21T00:56:42.470 INFO:tasks.workunit.client.1.smithi187.stdout:8/812: mknod dc/d2f/d34/d4b/d85/c112 0 2024-09-21T00:56:42.470 INFO:tasks.workunit.client.0.smithi112.stdout:1/169: dread - d5/d8/d10/f29 zero size 2024-09-21T00:56:42.479 INFO:tasks.workunit.client.0.smithi112.stdout:1/170: dwrite d5/d8/d10/f1d [0,4194304] 0 2024-09-21T00:56:42.481 INFO:tasks.workunit.client.1.smithi187.stdout:7/698: write d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/f96 [810837,82793] 0 2024-09-21T00:56:42.483 INFO:tasks.workunit.client.1.smithi187.stdout:1/862: rename d4/d6/d23/c40 to d4/d6/d23/d2e/d94/d66/c116 0 2024-09-21T00:56:42.484 INFO:tasks.workunit.client.1.smithi187.stdout:7/699: truncate d1/dce/fd9 886706 0 2024-09-21T00:56:42.485 INFO:tasks.workunit.client.0.smithi112.stdout:9/165: creat d5/d6/f34 x:0 0 0 2024-09-21T00:56:42.487 INFO:tasks.workunit.client.0.smithi112.stdout:9/166: write d5/d6/d19/f28 [543210,74102] 0 2024-09-21T00:56:42.488 INFO:tasks.workunit.client.1.smithi187.stdout:4/798: dread d2/d3/d74/f80 [0,4194304] 0 2024-09-21T00:56:42.489 INFO:tasks.workunit.client.0.smithi112.stdout:4/294: symlink d1/d2d/l67 0 2024-09-21T00:56:42.489 INFO:tasks.workunit.client.0.smithi112.stdout:9/167: dread - d5/d6/d19/f33 zero size 2024-09-21T00:56:42.489 INFO:tasks.workunit.client.1.smithi187.stdout:5/712: fsync d0/dc/daa/d67/d14/d38/fcd 0 2024-09-21T00:56:42.490 INFO:tasks.workunit.client.1.smithi187.stdout:2/834: dwrite d2/d25/f111 [0,4194304] 0 2024-09-21T00:56:42.491 INFO:tasks.workunit.client.1.smithi187.stdout:1/863: write d4/d6/d23/d2e/d94/d35/d79/f104 [418554,72070] 0 2024-09-21T00:56:42.492 INFO:tasks.workunit.client.0.smithi112.stdout:4/295: write d1/d7/f17 [1352817,123801] 0 2024-09-21T00:56:42.494 INFO:tasks.workunit.client.1.smithi187.stdout:9/921: truncate d4/d8/d46/d54/d10f/d121/d94/dde/ffb 3553880 0 2024-09-21T00:56:42.496 INFO:tasks.workunit.client.1.smithi187.stdout:8/813: dread - dc/d2f/fb1 zero size 2024-09-21T00:56:42.498 INFO:tasks.workunit.client.0.smithi112.stdout:2/229: dwrite d0/f3c [0,4194304] 0 2024-09-21T00:56:42.499 INFO:tasks.workunit.client.0.smithi112.stdout:5/95: write d8/d9/de/f12 [253717,55090] 0 2024-09-21T00:56:42.500 INFO:tasks.workunit.client.0.smithi112.stdout:8/129: write d0/d13/d1b/d22/f24 [1858592,108327] 0 2024-09-21T00:56:42.500 INFO:tasks.workunit.client.0.smithi112.stdout:2/230: chown d0/d14/d22/f2f 31787541 1 2024-09-21T00:56:42.500 INFO:tasks.workunit.client.0.smithi112.stdout:5/96: stat d8/d9/d13/f16 0 2024-09-21T00:56:42.502 INFO:tasks.workunit.client.0.smithi112.stdout:0/195: truncate d8/fa 2987281 0 2024-09-21T00:56:42.502 INFO:tasks.workunit.client.0.smithi112.stdout:2/231: fdatasync d0/d14/d8/f1a 0 2024-09-21T00:56:42.503 INFO:tasks.workunit.client.0.smithi112.stdout:8/130: write d0/d13/f16 [564378,14325] 0 2024-09-21T00:56:42.504 INFO:tasks.workunit.client.1.smithi187.stdout:3/705: dwrite d9/d7f/dcb/d87/d94/d53/d56/fd3 [0,4194304] 0 2024-09-21T00:56:42.504 INFO:tasks.workunit.client.0.smithi112.stdout:5/97: truncate d8/f1a 1036946 0 2024-09-21T00:56:42.504 INFO:tasks.workunit.client.0.smithi112.stdout:8/131: stat d0/f26 0 2024-09-21T00:56:42.505 INFO:tasks.workunit.client.0.smithi112.stdout:8/132: write d0/d13/f19 [1367555,102964] 0 2024-09-21T00:56:42.507 INFO:tasks.workunit.client.1.smithi187.stdout:7/700: rmdir d1/dce/dd0/d97/df1/d31/d33 39 2024-09-21T00:56:42.508 INFO:tasks.workunit.client.0.smithi112.stdout:6/198: unlink d9/d1f/d47/c3b 0 2024-09-21T00:56:42.515 INFO:tasks.workunit.client.0.smithi112.stdout:8/133: dwrite d0/d13/d1b/d22/f24 [0,4194304] 0 2024-09-21T00:56:42.516 INFO:tasks.workunit.client.0.smithi112.stdout:2/232: write d0/d14/d8/d27/f2a [3990217,52592] 0 2024-09-21T00:56:42.517 INFO:tasks.workunit.client.1.smithi187.stdout:0/716: getdents d0/d60/d6b 0 2024-09-21T00:56:42.518 INFO:tasks.workunit.client.1.smithi187.stdout:9/922: read d4/d10/f23 [4200008,63763] 0 2024-09-21T00:56:42.518 INFO:tasks.workunit.client.1.smithi187.stdout:9/923: readlink d4/d8/d46/d54/d10f/d121/dbf/ddd/l103 0 2024-09-21T00:56:42.519 INFO:tasks.workunit.client.0.smithi112.stdout:9/168: symlink d5/d6/de/l35 0 2024-09-21T00:56:42.520 INFO:tasks.workunit.client.0.smithi112.stdout:9/169: stat d5/d6/de/d13/f1a 0 2024-09-21T00:56:42.521 INFO:tasks.workunit.client.0.smithi112.stdout:9/170: readlink d5/d6/l25 0 2024-09-21T00:56:42.521 INFO:tasks.workunit.client.0.smithi112.stdout:6/199: mkdir d9/d13/d21/d4c 0 2024-09-21T00:56:42.521 INFO:tasks.workunit.client.0.smithi112.stdout:9/171: readlink d5/d6/l25 0 2024-09-21T00:56:42.522 INFO:tasks.workunit.client.0.smithi112.stdout:7/216: truncate d0/fa 596337 0 2024-09-21T00:56:42.527 INFO:tasks.workunit.client.1.smithi187.stdout:5/713: dread d0/dc/daa/d67/d14/d57/fa8 [0,4194304] 0 2024-09-21T00:56:42.527 INFO:tasks.workunit.client.0.smithi112.stdout:0/196: mknod d8/d11/c3f 0 2024-09-21T00:56:42.528 INFO:tasks.workunit.client.0.smithi112.stdout:0/197: chown d8/d1b/d2c 10 1 2024-09-21T00:56:42.528 INFO:tasks.workunit.client.1.smithi187.stdout:1/864: creat d4/d6/d23/d2e/d94/d35/d22/d65/db9/d115/f117 x:0 0 0 2024-09-21T00:56:42.528 INFO:tasks.workunit.client.1.smithi187.stdout:6/785: write d7/d2a/d29/f3c [1303024,66778] 0 2024-09-21T00:56:42.530 INFO:tasks.workunit.client.0.smithi112.stdout:0/198: fdatasync d8/f31 0 2024-09-21T00:56:42.530 INFO:tasks.workunit.client.0.smithi112.stdout:2/233: mknod d0/d14/c49 0 2024-09-21T00:56:42.533 INFO:tasks.workunit.client.0.smithi112.stdout:7/217: dread d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:42.534 INFO:tasks.workunit.client.0.smithi112.stdout:3/277: truncate d2/d8/dd/de/f18 853467 0 2024-09-21T00:56:42.534 INFO:tasks.workunit.client.0.smithi112.stdout:9/172: rmdir d5/d6 39 2024-09-21T00:56:42.535 INFO:tasks.workunit.client.0.smithi112.stdout:4/296: dwrite d1/d5/fd [4194304,4194304] 0 2024-09-21T00:56:42.536 INFO:tasks.workunit.client.1.smithi187.stdout:2/835: truncate d2/dc/d2e/d4a/f4d 1802872 0 2024-09-21T00:56:42.536 INFO:tasks.workunit.client.0.smithi112.stdout:7/218: write d0/f3b [1018599,123856] 0 2024-09-21T00:56:42.538 INFO:tasks.workunit.client.1.smithi187.stdout:8/814: mkdir dc/d2f/d80/db8/dba/d113 0 2024-09-21T00:56:42.542 INFO:tasks.workunit.client.1.smithi187.stdout:9/924: symlink d4/d13/d14/d1d/d5f/l133 0 2024-09-21T00:56:42.543 INFO:tasks.workunit.client.0.smithi112.stdout:0/199: mknod d8/d11/d28/c40 0 2024-09-21T00:56:42.543 INFO:tasks.workunit.client.0.smithi112.stdout:9/173: dwrite d5/f22 [0,4194304] 0 2024-09-21T00:56:42.543 INFO:tasks.workunit.client.0.smithi112.stdout:0/200: stat d8/d11/f13 0 2024-09-21T00:56:42.545 INFO:tasks.workunit.client.0.smithi112.stdout:3/278: dread - d2/d8/d28/f54 zero size 2024-09-21T00:56:42.546 INFO:tasks.workunit.client.1.smithi187.stdout:4/799: dwrite d2/d3/da/d16/f61 [0,4194304] 0 2024-09-21T00:56:42.548 INFO:tasks.workunit.client.1.smithi187.stdout:8/815: dwrite dc/d2f/d54/fe0 [0,4194304] 0 2024-09-21T00:56:42.550 INFO:tasks.workunit.client.1.smithi187.stdout:7/701: mknod d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/dea/cf2 0 2024-09-21T00:56:42.554 INFO:tasks.workunit.client.1.smithi187.stdout:7/702: dread - d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/f94 zero size 2024-09-21T00:56:42.554 INFO:tasks.workunit.client.0.smithi112.stdout:4/297: rename d1/d5/f64 to d1/d2d/f68 0 2024-09-21T00:56:42.556 INFO:tasks.workunit.client.0.smithi112.stdout:4/298: chown d1/d2d 1626 1 2024-09-21T00:56:42.561 INFO:tasks.workunit.client.1.smithi187.stdout:7/703: dwrite d1/dce/dd0/fdc [0,4194304] 0 2024-09-21T00:56:42.561 INFO:tasks.workunit.client.0.smithi112.stdout:2/234: creat d0/d45/f4a x:0 0 0 2024-09-21T00:56:42.561 INFO:tasks.workunit.client.0.smithi112.stdout:2/235: rename d0 to d0/d4b 22 2024-09-21T00:56:42.562 INFO:tasks.workunit.client.1.smithi187.stdout:1/865: creat d4/d6/d23/d2e/d94/d66/ddf/f118 x:0 0 0 2024-09-21T00:56:42.565 INFO:tasks.workunit.client.1.smithi187.stdout:1/866: dread - d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/ffa zero size 2024-09-21T00:56:42.565 INFO:tasks.workunit.client.0.smithi112.stdout:0/201: symlink d8/d1b/l41 0 2024-09-21T00:56:42.566 INFO:tasks.workunit.client.1.smithi187.stdout:1/867: truncate d4/d6/d23/d2e/f10c 625760 0 2024-09-21T00:56:42.566 INFO:tasks.workunit.client.1.smithi187.stdout:2/836: readlink d2/d3/d15/dfe/d2d/d8f/d9f/d8c/d107/l114 0 2024-09-21T00:56:42.567 INFO:tasks.workunit.client.1.smithi187.stdout:2/837: chown d2/da8/d6c/db8/d40/f6e 50 1 2024-09-21T00:56:42.568 INFO:tasks.workunit.client.0.smithi112.stdout:3/279: unlink d2/d8/dd/de/c50 0 2024-09-21T00:56:42.569 INFO:tasks.workunit.client.1.smithi187.stdout:3/706: truncate d9/d7f/dcb/d20/f2e 3604013 0 2024-09-21T00:56:42.570 INFO:tasks.workunit.client.1.smithi187.stdout:0/717: unlink d0/d17/d1c/d23/df/d41/c95 0 2024-09-21T00:56:42.571 INFO:tasks.workunit.client.0.smithi112.stdout:6/200: truncate d9/fd 1490378 0 2024-09-21T00:56:42.572 INFO:tasks.workunit.client.1.smithi187.stdout:9/925: fdatasync d4/d13/d14/fe9 0 2024-09-21T00:56:42.575 INFO:tasks.workunit.client.0.smithi112.stdout:4/299: mknod d1/d7/d9/c69 0 2024-09-21T00:56:42.576 INFO:tasks.workunit.client.0.smithi112.stdout:4/300: chown d1/d7/d30 2 1 2024-09-21T00:56:42.576 INFO:tasks.workunit.client.1.smithi187.stdout:4/800: symlink d2/d3/d56/led 0 2024-09-21T00:56:42.577 INFO:tasks.workunit.client.0.smithi112.stdout:2/236: symlink d0/l4c 0 2024-09-21T00:56:42.577 INFO:tasks.workunit.client.1.smithi187.stdout:8/816: mknod dc/d2f/d54/d69/db3/c114 0 2024-09-21T00:56:42.578 INFO:tasks.workunit.client.1.smithi187.stdout:8/817: dread - dc/d2f/d80/db8/dba/d29/f91 zero size 2024-09-21T00:56:42.578 INFO:tasks.workunit.client.0.smithi112.stdout:9/174: rename d5/d6/d19/f1e to d5/d6/de/d13/f36 0 2024-09-21T00:56:42.580 INFO:tasks.workunit.client.1.smithi187.stdout:5/714: getdents d0/dc/daa/d67/d14/d1b/d27/dc7 0 2024-09-21T00:56:42.580 INFO:tasks.workunit.client.0.smithi112.stdout:9/175: dread - d5/d6/de/f2e zero size 2024-09-21T00:56:42.582 INFO:tasks.workunit.client.0.smithi112.stdout:3/280: unlink d2/f29 0 2024-09-21T00:56:42.586 INFO:tasks.workunit.client.0.smithi112.stdout:6/201: unlink d9/d13/f29 0 2024-09-21T00:56:42.588 INFO:tasks.workunit.client.0.smithi112.stdout:0/202: dwrite d8/d11/f37 [4194304,4194304] 0 2024-09-21T00:56:42.588 INFO:tasks.workunit.client.0.smithi112.stdout:4/301: mknod d1/d5/d1c/d1e/c6a 0 2024-09-21T00:56:42.589 INFO:tasks.workunit.client.1.smithi187.stdout:6/786: write d7/d59/f58 [404244,58297] 0 2024-09-21T00:56:42.591 INFO:tasks.workunit.client.1.smithi187.stdout:6/787: stat d7/d2a/d29/d40/d6a 0 2024-09-21T00:56:42.593 INFO:tasks.workunit.client.1.smithi187.stdout:7/704: creat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/ff3 x:0 0 0 2024-09-21T00:56:42.594 INFO:tasks.workunit.client.1.smithi187.stdout:1/868: mkdir d4/d6/d23/d2e/d94/d119 0 2024-09-21T00:56:42.595 INFO:tasks.workunit.client.1.smithi187.stdout:9/926: dread d4/d13/d14/d5d/f79 [0,4194304] 0 2024-09-21T00:56:42.596 INFO:tasks.workunit.client.1.smithi187.stdout:1/869: truncate d4/d86/fe8 885138 0 2024-09-21T00:56:42.597 INFO:tasks.workunit.client.1.smithi187.stdout:2/838: symlink d2/d3/df/l129 0 2024-09-21T00:56:42.599 INFO:tasks.workunit.client.0.smithi112.stdout:3/281: unlink d2/d8/d28/d35/c4e 0 2024-09-21T00:56:42.602 INFO:tasks.workunit.client.1.smithi187.stdout:1/870: read d4/d6/d23/d2e/d94/f37 [2138581,59472] 0 2024-09-21T00:56:42.603 INFO:tasks.workunit.client.1.smithi187.stdout:0/718: creat d0/d17/d18/d90/d98/ff0 x:0 0 0 2024-09-21T00:56:42.817 INFO:tasks.workunit.client.0.smithi112.stdout:4/302: symlink d1/d5/d1c/d1e/d3d/l6b 0 2024-09-21T00:56:42.825 INFO:tasks.workunit.client.1.smithi187.stdout:9/927: creat d4/d8/d46/d54/d10f/d121/d94/d127/f134 x:0 0 0 2024-09-21T00:56:42.826 INFO:tasks.workunit.client.0.smithi112.stdout:4/303: mkdir d1/d5/d1c/d6c 0 2024-09-21T00:56:42.829 INFO:tasks.workunit.client.0.smithi112.stdout:9/176: creat d5/d6/f37 x:0 0 0 2024-09-21T00:56:42.830 INFO:tasks.workunit.client.1.smithi187.stdout:3/707: mkdir d9/d19/dca/dd6/de4 0 2024-09-21T00:56:42.831 INFO:tasks.workunit.client.1.smithi187.stdout:1/871: symlink d4/d6/d23/d2e/d94/l11a 0 2024-09-21T00:56:42.834 INFO:tasks.workunit.client.0.smithi112.stdout:4/304: unlink d1/d2d/f68 0 2024-09-21T00:56:42.835 INFO:tasks.workunit.client.1.smithi187.stdout:0/719: mknod d0/d17/d1c/d23/df/d41/d3b/cf1 0 2024-09-21T00:56:42.835 INFO:tasks.workunit.client.0.smithi112.stdout:9/177: fdatasync d5/d6/de/d13/f36 0 2024-09-21T00:56:42.835 INFO:tasks.workunit.client.0.smithi112.stdout:4/305: dread - d1/d2d/d34/f58 zero size 2024-09-21T00:56:42.837 INFO:tasks.workunit.client.0.smithi112.stdout:9/178: dread - d5/d6/f37 zero size 2024-09-21T00:56:42.837 INFO:tasks.workunit.client.1.smithi187.stdout:4/801: rename d2/d3/da/d16/f5c to d2/d3/d74/d98/dc2/fee 0 2024-09-21T00:56:42.838 INFO:tasks.workunit.client.1.smithi187.stdout:4/802: chown d2/d3/da/d2f/d32/d24/fdf 0 1 2024-09-21T00:56:42.839 INFO:tasks.workunit.client.0.smithi112.stdout:0/203: dwrite d8/d11/f1c [0,4194304] 0 2024-09-21T00:56:42.839 INFO:tasks.workunit.client.0.smithi112.stdout:9/179: truncate d5/d6/de/d13/f2f 961093 0 2024-09-21T00:56:42.840 INFO:tasks.workunit.client.0.smithi112.stdout:0/204: chown d8/d11/f15 35217294 1 2024-09-21T00:56:42.840 INFO:tasks.workunit.client.0.smithi112.stdout:3/282: creat d2/d8/f5b x:0 0 0 2024-09-21T00:56:42.843 INFO:tasks.workunit.client.0.smithi112.stdout:6/202: link d9/d1f/d1a/l40 d9/df/d4b/l4d 0 2024-09-21T00:56:42.843 INFO:tasks.workunit.client.0.smithi112.stdout:3/283: chown d2/d38/d3f/d53/c55 613433772 1 2024-09-21T00:56:42.844 INFO:tasks.workunit.client.1.smithi187.stdout:6/788: creat d7/d2a/d29/d40/d50/d68/dfa/f104 x:0 0 0 2024-09-21T00:56:42.847 INFO:tasks.workunit.client.0.smithi112.stdout:9/180: dread d5/f22 [0,4194304] 0 2024-09-21T00:56:42.847 INFO:tasks.workunit.client.1.smithi187.stdout:6/789: truncate d7/d2a/d29/d40/d50/d83/dfd/f101 232692 0 2024-09-21T00:56:42.848 INFO:tasks.workunit.client.1.smithi187.stdout:6/790: chown d7/d2a/d29/d40/d6a/d88 3 1 2024-09-21T00:56:42.848 INFO:tasks.workunit.client.0.smithi112.stdout:4/306: unlink d1/d2d/d34/f4e 0 2024-09-21T00:56:42.851 INFO:tasks.workunit.client.0.smithi112.stdout:3/284: readlink d2/l1e 0 2024-09-21T00:56:42.851 INFO:tasks.workunit.client.1.smithi187.stdout:9/928: mknod d4/d8/d46/d54/d10f/d121/dbf/c135 0 2024-09-21T00:56:42.851 INFO:tasks.workunit.client.0.smithi112.stdout:0/205: dwrite d8/d11/f15 [0,4194304] 0 2024-09-21T00:56:42.852 INFO:tasks.workunit.client.0.smithi112.stdout:9/181: read d5/f17 [2484396,69485] 0 2024-09-21T00:56:42.856 INFO:tasks.workunit.client.0.smithi112.stdout:4/307: truncate d1/d2d/d34/f58 768507 0 2024-09-21T00:56:42.857 INFO:tasks.workunit.client.0.smithi112.stdout:6/203: dwrite d9/d1b/d23/f48 [0,4194304] 0 2024-09-21T00:56:42.862 INFO:tasks.workunit.client.0.smithi112.stdout:0/206: dread d8/d11/f1a [0,4194304] 0 2024-09-21T00:56:42.863 INFO:tasks.workunit.client.0.smithi112.stdout:4/308: dread d1/d7/f28 [0,4194304] 0 2024-09-21T00:56:42.863 INFO:tasks.workunit.client.1.smithi187.stdout:3/708: creat d9/d7f/dcb/d87/d94/fe5 x:0 0 0 2024-09-21T00:56:42.865 INFO:tasks.workunit.client.1.smithi187.stdout:3/709: read d9/d7f/dcb/d87/fb8 [125953,94845] 0 2024-09-21T00:56:42.865 INFO:tasks.workunit.client.0.smithi112.stdout:4/309: dread d1/d2d/d34/f58 [0,4194304] 0 2024-09-21T00:56:42.868 INFO:tasks.workunit.client.0.smithi112.stdout:3/285: mkdir d2/d8/dd/de/d5c 0 2024-09-21T00:56:42.871 INFO:tasks.workunit.client.1.smithi187.stdout:1/872: rename d4/d6/d23/fb2 to d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/de4/f11b 0 2024-09-21T00:56:42.873 INFO:tasks.workunit.client.0.smithi112.stdout:9/182: write d5/d6/de/f2e [697239,31210] 0 2024-09-21T00:56:42.874 INFO:tasks.workunit.client.1.smithi187.stdout:4/803: mkdir d2/d3/d74/d98/dc2/def 0 2024-09-21T00:56:42.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/183: readlink d5/d6/l25 0 2024-09-21T00:56:42.875 INFO:tasks.workunit.client.1.smithi187.stdout:5/715: dwrite d0/dc/d1f/d26/f64 [0,4194304] 0 2024-09-21T00:56:42.876 INFO:tasks.workunit.client.0.smithi112.stdout:3/286: dwrite d2/d8/d28/d35/f51 [0,4194304] 0 2024-09-21T00:56:42.877 INFO:tasks.workunit.client.1.smithi187.stdout:7/705: truncate d1/f37 2904091 0 2024-09-21T00:56:42.877 INFO:tasks.workunit.client.1.smithi187.stdout:8/818: link dc/d2f/d34/l9e dc/d2f/d80/db8/l115 0 2024-09-21T00:56:42.878 INFO:tasks.workunit.client.0.smithi112.stdout:6/204: creat d9/df/f4e x:0 0 0 2024-09-21T00:56:42.880 INFO:tasks.workunit.client.1.smithi187.stdout:8/819: dread - dc/d2f/d80/db8/dba/fc9 zero size 2024-09-21T00:56:42.881 INFO:tasks.workunit.client.1.smithi187.stdout:7/706: truncate d1/dc/fbb 532893 0 2024-09-21T00:56:42.881 INFO:tasks.workunit.client.1.smithi187.stdout:6/791: creat d7/d2a/d7a/f105 x:0 0 0 2024-09-21T00:56:42.883 INFO:tasks.workunit.client.1.smithi187.stdout:6/792: chown d7/d2a/d29/fd2 0 1 2024-09-21T00:56:42.884 INFO:tasks.workunit.client.1.smithi187.stdout:9/929: creat d4/d13/d14/d28/d72/f136 x:0 0 0 2024-09-21T00:56:42.885 INFO:tasks.workunit.client.1.smithi187.stdout:2/839: rmdir d2/dc/d2e/d4a/d7c/d52/da3/de6/d124 0 2024-09-21T00:56:42.887 INFO:tasks.workunit.client.0.smithi112.stdout:4/310: chown d1/d5/l18 1 1 2024-09-21T00:56:42.888 INFO:tasks.workunit.client.1.smithi187.stdout:8/820: dwrite dc/f15 [0,4194304] 0 2024-09-21T00:56:42.890 INFO:tasks.workunit.client.1.smithi187.stdout:8/821: readlink dc/d2f/d34/d4b/lab 0 2024-09-21T00:56:42.892 INFO:tasks.workunit.client.1.smithi187.stdout:8/822: fsync dc/d2f/d80/db8/dba/dc7/f111 0 2024-09-21T00:56:42.893 INFO:tasks.workunit.client.1.smithi187.stdout:9/930: dwrite d4/d10/d39/f131 [0,4194304] 0 2024-09-21T00:56:42.894 INFO:tasks.workunit.client.0.smithi112.stdout:3/287: mknod d2/d33/c5d 0 2024-09-21T00:56:42.894 INFO:tasks.workunit.client.1.smithi187.stdout:9/931: dread - d4/d13/d14/d28/f116 zero size 2024-09-21T00:56:42.896 INFO:tasks.workunit.client.0.smithi112.stdout:6/205: symlink d9/d1b/l4f 0 2024-09-21T00:56:42.899 INFO:tasks.workunit.client.1.smithi187.stdout:4/804: symlink d2/d3/da/d2f/d4b/d7e/dc8/lf0 0 2024-09-21T00:56:42.903 INFO:tasks.workunit.client.0.smithi112.stdout:4/311: creat d1/d5/d1c/d6c/f6d x:0 0 0 2024-09-21T00:56:42.905 INFO:tasks.workunit.client.1.smithi187.stdout:9/932: dwrite d4/d8/d41/fa6 [4194304,4194304] 0 2024-09-21T00:56:42.905 INFO:tasks.workunit.client.0.smithi112.stdout:9/184: rename d5/d6/de/c11 to d5/d6/c38 0 2024-09-21T00:56:42.907 INFO:tasks.workunit.client.1.smithi187.stdout:0/720: creat d0/d17/d1c/d23/df/ff2 x:0 0 0 2024-09-21T00:56:42.909 INFO:tasks.workunit.client.1.smithi187.stdout:9/933: dread - d4/d13/d14/d28/d72/f136 zero size 2024-09-21T00:56:42.912 INFO:tasks.workunit.client.0.smithi112.stdout:6/206: truncate d9/f3f 127513 0 2024-09-21T00:56:42.913 INFO:tasks.workunit.client.1.smithi187.stdout:4/805: dwrite d2/d3/da/d2f/d32/d24/f2e [0,4194304] 0 2024-09-21T00:56:42.913 INFO:tasks.workunit.client.1.smithi187.stdout:6/793: dwrite d7/d2a/d29/d40/f20 [0,4194304] 0 2024-09-21T00:56:42.914 INFO:tasks.workunit.client.0.smithi112.stdout:9/185: dwrite d5/d6/de/f2c [0,4194304] 0 2024-09-21T00:56:42.916 INFO:tasks.workunit.client.0.smithi112.stdout:4/312: mkdir d1/d7/d9/d1a/d22/d6e 0 2024-09-21T00:56:42.916 INFO:tasks.workunit.client.0.smithi112.stdout:0/207: write d8/d1b/f32 [310661,68704] 0 2024-09-21T00:56:42.917 INFO:tasks.workunit.client.0.smithi112.stdout:9/186: write d5/d6/de/d13/f2f [1599252,125250] 0 2024-09-21T00:56:42.919 INFO:tasks.workunit.client.0.smithi112.stdout:9/187: write d5/fb [7680217,112831] 0 2024-09-21T00:56:42.921 INFO:tasks.workunit.client.0.smithi112.stdout:3/288: creat d2/f5e x:0 0 0 2024-09-21T00:56:42.928 INFO:tasks.workunit.client.1.smithi187.stdout:7/707: creat d1/dce/dd0/d97/df1/d31/d41/dbe/ff4 x:0 0 0 2024-09-21T00:56:42.928 INFO:tasks.workunit.client.0.smithi112.stdout:4/313: dwrite d1/d7/d9/f61 [4194304,4194304] 0 2024-09-21T00:56:42.936 INFO:tasks.workunit.client.0.smithi112.stdout:6/207: dwrite d9/d1f/d1a/d33/f3c [0,4194304] 0 2024-09-21T00:56:42.939 INFO:tasks.workunit.client.1.smithi187.stdout:3/710: link f2 d9/d7f/dcb/d87/d94/d53/d56/d61/fe6 0 2024-09-21T00:56:42.941 INFO:tasks.workunit.client.0.smithi112.stdout:4/314: dwrite d1/d5/d1c/d1e/f31 [0,4194304] 0 2024-09-21T00:56:42.942 INFO:tasks.workunit.client.1.smithi187.stdout:5/716: dwrite d0/dc/daa/d67/d14/d1b/d27/f4a [0,4194304] 0 2024-09-21T00:56:42.945 INFO:tasks.workunit.client.0.smithi112.stdout:6/208: dread d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:42.947 INFO:tasks.workunit.client.0.smithi112.stdout:3/289: unlink d2/d8/d28/l3d 0 2024-09-21T00:56:42.951 INFO:tasks.workunit.client.0.smithi112.stdout:3/290: chown d2/d8/d28/l37 28652763 1 2024-09-21T00:56:42.954 INFO:tasks.workunit.client.0.smithi112.stdout:4/315: dwrite d1/d5/d1c/d1e/f31 [0,4194304] 0 2024-09-21T00:56:42.955 INFO:tasks.workunit.client.0.smithi112.stdout:9/188: symlink d5/l39 0 2024-09-21T00:56:42.957 INFO:tasks.workunit.client.0.smithi112.stdout:4/316: write d1/d7/f17 [3362083,82017] 0 2024-09-21T00:56:42.958 INFO:tasks.workunit.client.0.smithi112.stdout:9/189: chown d5/d6/de/f2c 4174094 1 2024-09-21T00:56:42.959 INFO:tasks.workunit.client.1.smithi187.stdout:1/873: write d4/d6/d23/d6f/f96 [51490,97297] 0 2024-09-21T00:56:42.960 INFO:tasks.workunit.client.0.smithi112.stdout:6/209: dwrite d9/d1f/f35 [0,4194304] 0 2024-09-21T00:56:42.960 INFO:tasks.workunit.client.1.smithi187.stdout:7/708: chown d1/dce/dd0/lae 22861 1 2024-09-21T00:56:42.961 INFO:tasks.workunit.client.1.smithi187.stdout:2/840: link d2/da8/d6c/db8/d40/c116 d2/d3/d15/dfe/dc6/c12a 0 2024-09-21T00:56:42.966 INFO:tasks.workunit.client.1.smithi187.stdout:3/711: creat d9/d7f/dcb/d9c/fe7 x:0 0 0 2024-09-21T00:56:42.968 INFO:tasks.workunit.client.0.smithi112.stdout:0/208: write d8/d11/f1a [656747,113324] 0 2024-09-21T00:56:42.969 INFO:tasks.workunit.client.1.smithi187.stdout:1/874: dwrite d4/d6/d23/d2e/d53/d6a/f8f [0,4194304] 0 2024-09-21T00:56:42.969 INFO:tasks.workunit.client.0.smithi112.stdout:0/209: fdatasync d8/d1b/f2a 0 2024-09-21T00:56:42.970 INFO:tasks.workunit.client.0.smithi112.stdout:0/210: dread - d8/d11/f23 zero size 2024-09-21T00:56:42.971 INFO:tasks.workunit.client.0.smithi112.stdout:0/211: write d8/d1b/f2a [804626,118472] 0 2024-09-21T00:56:42.973 INFO:tasks.workunit.client.0.smithi112.stdout:4/317: rename d1/d7/d9/d1a/d22/f56 to d1/d7/d9/d1a/d22/f6f 0 2024-09-21T00:56:42.973 INFO:tasks.workunit.client.1.smithi187.stdout:9/934: dread d4/d8/d46/d54/d10f/d121/d66/f74 [0,4194304] 0 2024-09-21T00:56:42.973 INFO:tasks.workunit.client.0.smithi112.stdout:4/318: fsync d1/d5/f15 0 2024-09-21T00:56:42.975 INFO:tasks.workunit.client.1.smithi187.stdout:8/823: rename dc/d94/fac to dc/d2f/d54/f116 0 2024-09-21T00:56:42.979 INFO:tasks.workunit.client.0.smithi112.stdout:4/319: dread d1/d2d/f55 [0,4194304] 0 2024-09-21T00:56:42.979 INFO:tasks.workunit.client.1.smithi187.stdout:6/794: dwrite d7/d2a/d29/d40/d45/f5a [4194304,4194304] 0 2024-09-21T00:56:42.980 INFO:tasks.workunit.client.0.smithi112.stdout:4/320: readlink d1/d7/d9/d1a/l2b 0 2024-09-21T00:56:42.982 INFO:tasks.workunit.client.1.smithi187.stdout:0/721: creat d0/d17/d1c/ff3 x:0 0 0 2024-09-21T00:56:42.982 INFO:tasks.workunit.client.1.smithi187.stdout:4/806: dwrite d2/d3/da/d2f/d32/d22/d37/d3a/fa7 [0,4194304] 0 2024-09-21T00:56:42.983 INFO:tasks.workunit.client.1.smithi187.stdout:5/717: link d0/dc/daa/d67/d30/f6a d0/dc/dbe/fee 0 2024-09-21T00:56:42.985 INFO:tasks.workunit.client.1.smithi187.stdout:5/718: dread - d0/dc/daa/d67/d14/d38/d5a/d6c/db7/fe3 zero size 2024-09-21T00:56:42.988 INFO:tasks.workunit.client.1.smithi187.stdout:1/875: fdatasync d4/d6/fc3 0 2024-09-21T00:56:42.992 INFO:tasks.workunit.client.1.smithi187.stdout:8/824: fsync dc/f47 0 2024-09-21T00:56:42.994 INFO:tasks.workunit.client.0.smithi112.stdout:3/291: link d2/l39 d2/d8/dd/de/l5f 0 2024-09-21T00:56:42.995 INFO:tasks.workunit.client.1.smithi187.stdout:1/876: dwrite d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/ffe [0,4194304] 0 2024-09-21T00:56:42.997 INFO:tasks.workunit.client.0.smithi112.stdout:6/210: getdents d9/d1f/d1a/d33 0 2024-09-21T00:56:42.997 INFO:tasks.workunit.client.0.smithi112.stdout:9/190: dread d5/d6/d19/f2a [0,4194304] 0 2024-09-21T00:56:42.997 INFO:tasks.workunit.client.1.smithi187.stdout:1/877: chown d4/d6/d23/d2e/d94/f13 487 1 2024-09-21T00:56:42.999 INFO:tasks.workunit.client.0.smithi112.stdout:9/191: chown d5/d6/de/d13/f1a 24038132 1 2024-09-21T00:56:42.999 INFO:tasks.workunit.client.1.smithi187.stdout:0/722: stat d0/d17/d1c/d23/df/d41/d3b/f6c 0 2024-09-21T00:56:43.000 INFO:tasks.workunit.client.0.smithi112.stdout:0/212: getdents d8/d1b/d2c/d2e 0 2024-09-21T00:56:43.000 INFO:tasks.workunit.client.1.smithi187.stdout:3/712: mknod d9/d19/dca/dd6/de4/ce8 0 2024-09-21T00:56:43.001 INFO:tasks.workunit.client.1.smithi187.stdout:3/713: readlink d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/le1 0 2024-09-21T00:56:43.002 INFO:tasks.workunit.client.1.smithi187.stdout:3/714: chown d9/d7f/dcb/d87/d94/d89 748613207 1 2024-09-21T00:56:43.003 INFO:tasks.workunit.client.0.smithi112.stdout:0/213: read d8/d11/d28/f2f [111648,35271] 0 2024-09-21T00:56:43.004 INFO:tasks.workunit.client.1.smithi187.stdout:5/719: creat d0/dc/daa/d67/d14/d57/d5c/dc9/fef x:0 0 0 2024-09-21T00:56:43.006 INFO:tasks.workunit.client.0.smithi112.stdout:9/192: unlink d5/d6/f34 0 2024-09-21T00:56:43.006 INFO:tasks.workunit.client.0.smithi112.stdout:6/211: dwrite d9/d1b/f1d [0,4194304] 0 2024-09-21T00:56:43.008 INFO:tasks.workunit.client.1.smithi187.stdout:9/935: mknod d4/d10/d43/d11c/d6e/c137 0 2024-09-21T00:56:43.008 INFO:tasks.workunit.client.0.smithi112.stdout:6/212: write d9/d1f/d47/f42 [2494698,104589] 0 2024-09-21T00:56:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:42 smithi112 ceph-mon[28078]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:42 smithi112 ceph-mon[28078]: pgmap v24: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 70 MiB/s rd, 267 MiB/s wr, 520 op/s 2024-09-21T00:56:43.012 INFO:tasks.workunit.client.1.smithi187.stdout:7/709: getdents d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/dda 0 2024-09-21T00:56:43.013 INFO:tasks.workunit.client.0.smithi112.stdout:0/214: dread d8/d1b/f32 [0,4194304] 0 2024-09-21T00:56:43.014 INFO:tasks.workunit.client.0.smithi112.stdout:9/193: symlink d5/d6/de/d13/l3a 0 2024-09-21T00:56:43.016 INFO:tasks.workunit.client.1.smithi187.stdout:1/878: mkdir d4/d6/d23/d2e/d94/d6c/d11c 0 2024-09-21T00:56:43.017 INFO:tasks.workunit.client.0.smithi112.stdout:3/292: getdents d2/d38/d3f 0 2024-09-21T00:56:43.018 INFO:tasks.workunit.client.0.smithi112.stdout:3/293: read - d2/d33/f56 zero size 2024-09-21T00:56:43.019 INFO:tasks.workunit.client.0.smithi112.stdout:6/213: dwrite d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:43.021 INFO:tasks.workunit.client.0.smithi112.stdout:0/215: creat d8/d1b/f42 x:0 0 0 2024-09-21T00:56:43.023 INFO:tasks.workunit.client.0.smithi112.stdout:9/194: rmdir d5/d6/de/d13 39 2024-09-21T00:56:43.028 INFO:tasks.workunit.client.1.smithi187.stdout:9/936: creat d4/d8/d46/d54/d10f/d121/dbf/ddd/f138 x:0 0 0 2024-09-21T00:56:43.029 INFO:tasks.workunit.client.0.smithi112.stdout:6/214: mknod d9/d1f/c50 0 2024-09-21T00:56:43.031 INFO:tasks.workunit.client.1.smithi187.stdout:2/841: write d2/da8/d6c/d97/da1/f11b [372880,57544] 0 2024-09-21T00:56:43.032 INFO:tasks.workunit.client.0.smithi112.stdout:3/294: dwrite d2/d3e/f47 [0,4194304] 0 2024-09-21T00:56:43.033 INFO:tasks.workunit.client.0.smithi112.stdout:0/216: rename d8/d11/f1c to d8/d11/d28/f43 0 2024-09-21T00:56:43.034 INFO:tasks.workunit.client.0.smithi112.stdout:3/295: readlink d2/d8/dd/de/l2a 0 2024-09-21T00:56:43.036 INFO:tasks.workunit.client.1.smithi187.stdout:7/710: creat d1/dce/dd0/d97/df1/d31/d41/d8a/dd5/ff5 x:0 0 0 2024-09-21T00:56:43.039 INFO:tasks.workunit.client.1.smithi187.stdout:6/795: creat d7/d2a/d29/d40/d6a/f106 x:0 0 0 2024-09-21T00:56:43.039 INFO:tasks.workunit.client.0.smithi112.stdout:1/171: sync 2024-09-21T00:56:43.041 INFO:tasks.workunit.client.1.smithi187.stdout:1/879: read - d4/d75/f103 zero size 2024-09-21T00:56:43.042 INFO:tasks.workunit.client.1.smithi187.stdout:0/723: mknod d0/d17/d18/cf4 0 2024-09-21T00:56:43.043 INFO:tasks.workunit.client.1.smithi187.stdout:7/711: dwrite d1/dce/dd0/d97/df1/d31/d33/d3b/f4a [0,4194304] 0 2024-09-21T00:56:43.045 INFO:tasks.workunit.client.0.smithi112.stdout:3/296: chown d2/d8/dd/de/f18 1797 1 2024-09-21T00:56:43.048 INFO:tasks.workunit.client.0.smithi112.stdout:0/217: rename d8/d1b/f2a to d8/d1b/f44 0 2024-09-21T00:56:43.049 INFO:tasks.workunit.client.1.smithi187.stdout:9/937: chown d4/d8/d46/d54/c67 8637552 1 2024-09-21T00:56:43.050 INFO:tasks.workunit.client.0.smithi112.stdout:9/195: mkdir d5/d3b 0 2024-09-21T00:56:43.051 INFO:tasks.workunit.client.1.smithi187.stdout:8/825: link dc/l50 dc/d94/df6/d107/l117 0 2024-09-21T00:56:43.052 INFO:tasks.workunit.client.0.smithi112.stdout:1/172: mknod d5/d8/d10/d2e/c38 0 2024-09-21T00:56:43.053 INFO:tasks.workunit.client.0.smithi112.stdout:1/173: fdatasync d5/d8/d10/f20 0 2024-09-21T00:56:43.054 INFO:tasks.workunit.client.1.smithi187.stdout:4/807: dwrite d2/d3/da/d2f/d32/d24/dcd/f72 [0,4194304] 0 2024-09-21T00:56:43.056 INFO:tasks.workunit.client.1.smithi187.stdout:2/842: mknod d2/d3/d15/c12b 0 2024-09-21T00:56:43.058 INFO:tasks.workunit.client.1.smithi187.stdout:5/720: dread d0/dc/daa/d67/d30/d6b/f9b [0,4194304] 0 2024-09-21T00:56:43.061 INFO:tasks.workunit.client.0.smithi112.stdout:0/218: rename d8/c9 to d8/d1b/d2c/d2e/c45 0 2024-09-21T00:56:43.063 INFO:tasks.workunit.client.0.smithi112.stdout:9/196: fsync f3 0 2024-09-21T00:56:43.066 INFO:tasks.workunit.client.0.smithi112.stdout:1/174: mknod d5/d8/d14/c39 0 2024-09-21T00:56:43.067 INFO:tasks.workunit.client.0.smithi112.stdout:1/175: fsync d5/d8/f35 0 2024-09-21T00:56:43.068 INFO:tasks.workunit.client.1.smithi187.stdout:9/938: creat d4/d10/d24/f139 x:0 0 0 2024-09-21T00:56:43.069 INFO:tasks.workunit.client.0.smithi112.stdout:9/197: dwrite d5/fb [4194304,4194304] 0 2024-09-21T00:56:43.071 INFO:tasks.workunit.client.0.smithi112.stdout:0/219: write d8/d1b/f32 [768703,22022] 0 2024-09-21T00:56:43.073 INFO:tasks.workunit.client.0.smithi112.stdout:1/176: rmdir d5/d8/dd 39 2024-09-21T00:56:43.075 INFO:tasks.workunit.client.1.smithi187.stdout:4/808: mknod d2/d3/da/d2f/d4b/d7e/dc8/d89/cf1 0 2024-09-21T00:56:43.076 INFO:tasks.workunit.client.1.smithi187.stdout:6/796: symlink d7/d2a/l107 0 2024-09-21T00:56:43.077 INFO:tasks.workunit.client.1.smithi187.stdout:3/715: truncate d9/d7f/dcb/d87/d94/f90 1705554 0 2024-09-21T00:56:43.078 INFO:tasks.workunit.client.1.smithi187.stdout:6/797: truncate d7/d2a/f5b 4514419 0 2024-09-21T00:56:43.079 INFO:tasks.workunit.client.0.smithi112.stdout:1/177: mkdir d5/d3a 0 2024-09-21T00:56:43.080 INFO:tasks.workunit.client.0.smithi112.stdout:1/178: fsync d5/d8/d10/f20 0 2024-09-21T00:56:43.081 INFO:tasks.workunit.client.0.smithi112.stdout:9/198: rename d5/d6/de/d13/f36 to d5/d6/d19/d1b/f3c 0 2024-09-21T00:56:43.083 INFO:tasks.workunit.client.0.smithi112.stdout:6/215: write d9/fd [1704036,37595] 0 2024-09-21T00:56:43.083 INFO:tasks.workunit.client.1.smithi187.stdout:6/798: dwrite d7/d2a/d29/d40/d5e/fb5 [0,4194304] 0 2024-09-21T00:56:43.084 INFO:tasks.workunit.client.1.smithi187.stdout:0/724: mknod d0/d17/d1c/d23/df/d41/cf5 0 2024-09-21T00:56:43.088 INFO:tasks.workunit.client.1.smithi187.stdout:7/712: unlink d1/dce/dd0/d97/df1/c19 0 2024-09-21T00:56:43.090 INFO:tasks.workunit.client.0.smithi112.stdout:1/179: creat d5/d8/d14/f3b x:0 0 0 2024-09-21T00:56:43.093 INFO:tasks.workunit.client.1.smithi187.stdout:8/826: mknod dc/d94/df6/d107/c118 0 2024-09-21T00:56:43.094 INFO:tasks.workunit.client.0.smithi112.stdout:0/220: creat d8/f46 x:0 0 0 2024-09-21T00:56:43.094 INFO:tasks.workunit.client.0.smithi112.stdout:0/221: chown d8/f18 35 1 2024-09-21T00:56:43.095 INFO:tasks.workunit.client.1.smithi187.stdout:4/809: creat d2/d3/da/d2f/d32/d24/dcd/db3/ff2 x:0 0 0 2024-09-21T00:56:43.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/216: mknod d9/d1f/d1a/c51 0 2024-09-21T00:56:43.096 INFO:tasks.workunit.client.0.smithi112.stdout:6/217: write d9/d1b/f37 [182397,65019] 0 2024-09-21T00:56:43.098 INFO:tasks.workunit.client.1.smithi187.stdout:3/716: unlink d9/d19/d1c/l26 0 2024-09-21T00:56:43.099 INFO:tasks.workunit.client.0.smithi112.stdout:0/222: write d8/d11/d28/f43 [2302574,65322] 0 2024-09-21T00:56:43.099 INFO:tasks.workunit.client.1.smithi187.stdout:5/721: symlink d0/lf0 0 2024-09-21T00:56:43.100 INFO:tasks.workunit.client.0.smithi112.stdout:1/180: creat d5/d3a/f3c x:0 0 0 2024-09-21T00:56:43.103 INFO:tasks.workunit.client.0.smithi112.stdout:6/218: rmdir d9/d1f/d1a 39 2024-09-21T00:56:43.106 INFO:tasks.workunit.client.1.smithi187.stdout:1/880: rename d4/d6/d23/d2e/d94/c1a to d4/d6/d23/d2e/d94/d35/d22/d2c/c11d 0 2024-09-21T00:56:43.107 INFO:tasks.workunit.client.1.smithi187.stdout:1/881: chown d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/lc7 0 1 2024-09-21T00:56:43.107 INFO:tasks.workunit.client.0.smithi112.stdout:9/199: creat d5/d6/de/f3d x:0 0 0 2024-09-21T00:56:43.108 INFO:tasks.workunit.client.1.smithi187.stdout:1/882: fsync d4/d6/d23/d2e/d94/dcb/ffd 0 2024-09-21T00:56:43.108 INFO:tasks.workunit.client.1.smithi187.stdout:6/799: creat d7/d2a/d29/d40/d6a/d88/f108 x:0 0 0 2024-09-21T00:56:43.110 INFO:tasks.workunit.client.0.smithi112.stdout:0/223: mknod d8/d1b/d2c/c47 0 2024-09-21T00:56:43.111 INFO:tasks.workunit.client.0.smithi112.stdout:0/224: fsync d8/d1b/f42 0 2024-09-21T00:56:43.115 INFO:tasks.workunit.client.1.smithi187.stdout:2/843: truncate d2/d3/df/f41 3176271 0 2024-09-21T00:56:43.115 INFO:tasks.workunit.client.0.smithi112.stdout:6/219: dread d9/d1f/d47/d34/f36 [0,4194304] 0 2024-09-21T00:56:43.116 INFO:tasks.workunit.client.1.smithi187.stdout:9/939: mkdir d4/d10/d43/d11c/d6e/d13a 0 2024-09-21T00:56:43.116 INFO:tasks.workunit.client.1.smithi187.stdout:2/844: chown d2/da8/d6c/db8/d94/c76 0 1 2024-09-21T00:56:43.119 INFO:tasks.workunit.client.1.smithi187.stdout:5/722: fdatasync d0/dc/daa/d67/f50 0 2024-09-21T00:56:43.120 INFO:tasks.workunit.client.1.smithi187.stdout:3/717: rename d9/d7f/dcb/d87/d94/f8f to d9/d7f/dcb/fe9 0 2024-09-21T00:56:43.122 INFO:tasks.workunit.client.1.smithi187.stdout:6/800: creat d7/d59/f109 x:0 0 0 2024-09-21T00:56:43.123 INFO:tasks.workunit.client.1.smithi187.stdout:0/725: symlink d0/dc2/lf6 0 2024-09-21T00:56:43.124 INFO:tasks.workunit.client.1.smithi187.stdout:7/713: dread d1/dce/dd0/d97/df1/d31/d33/f46 [0,4194304] 0 2024-09-21T00:56:43.124 INFO:tasks.workunit.client.0.smithi112.stdout:6/220: unlink d9/d1f/c2d 0 2024-09-21T00:56:43.125 INFO:tasks.workunit.client.1.smithi187.stdout:7/714: chown d1/dc/d15/d2b/fb1 121756 1 2024-09-21T00:56:43.125 INFO:tasks.workunit.client.0.smithi112.stdout:6/221: readlink d9/d1b/l4f 0 2024-09-21T00:56:43.127 INFO:tasks.workunit.client.0.smithi112.stdout:0/225: symlink d8/l48 0 2024-09-21T00:56:43.129 INFO:tasks.workunit.client.0.smithi112.stdout:0/226: read d8/fb [1688416,1961] 0 2024-09-21T00:56:43.129 INFO:tasks.workunit.client.1.smithi187.stdout:9/940: creat d4/d8/d46/d54/d10f/f13b x:0 0 0 2024-09-21T00:56:43.129 INFO:tasks.workunit.client.0.smithi112.stdout:6/222: dread d9/d1b/f1d [0,4194304] 0 2024-09-21T00:56:43.131 INFO:tasks.workunit.client.0.smithi112.stdout:1/181: creat d5/d8/f3d x:0 0 0 2024-09-21T00:56:43.134 INFO:tasks.workunit.client.0.smithi112.stdout:0/227: dread d8/f20 [0,4194304] 0 2024-09-21T00:56:43.136 INFO:tasks.workunit.client.0.smithi112.stdout:9/200: truncate d5/d6/de/f24 536894 0 2024-09-21T00:56:43.137 INFO:tasks.workunit.client.1.smithi187.stdout:2/845: dwrite d2/dc/d2e/d4a/d7c/d52/da3/ffb [0,4194304] 0 2024-09-21T00:56:43.137 INFO:tasks.workunit.client.0.smithi112.stdout:9/201: write d5/d6/de/f2c [392323,44929] 0 2024-09-21T00:56:43.138 INFO:tasks.workunit.client.1.smithi187.stdout:4/810: symlink d2/d3/d74/d98/dc2/def/lf3 0 2024-09-21T00:56:43.139 INFO:tasks.workunit.client.1.smithi187.stdout:2/846: stat d2/d3/d15/c127 0 2024-09-21T00:56:43.140 INFO:tasks.workunit.client.0.smithi112.stdout:6/223: rename d9/f3f to d9/d13/d26/f52 0 2024-09-21T00:56:43.141 INFO:tasks.workunit.client.1.smithi187.stdout:1/883: dwrite d4/d6/d23/d2e/d53/d6a/faf [0,4194304] 0 2024-09-21T00:56:43.145 INFO:tasks.workunit.client.0.smithi112.stdout:0/228: symlink d8/d1b/l49 0 2024-09-21T00:56:43.146 INFO:tasks.workunit.client.0.smithi112.stdout:0/229: read d8/d11/d28/f43 [3677170,61416] 0 2024-09-21T00:56:43.148 INFO:tasks.workunit.client.0.smithi112.stdout:0/230: write d8/d1b/f32 [1356400,120585] 0 2024-09-21T00:56:43.148 INFO:tasks.workunit.client.1.smithi187.stdout:3/718: unlink d9/d19/d1c/f47 0 2024-09-21T00:56:43.148 INFO:tasks.workunit.client.1.smithi187.stdout:2/847: dwrite d2/d25/f111 [0,4194304] 0 2024-09-21T00:56:43.150 INFO:tasks.workunit.client.1.smithi187.stdout:8/827: truncate dc/d2f/fc8 1772783 0 2024-09-21T00:56:43.152 INFO:tasks.workunit.client.1.smithi187.stdout:2/848: write d2/dc/d21/fea [664955,93044] 0 2024-09-21T00:56:43.154 INFO:tasks.workunit.client.1.smithi187.stdout:7/715: symlink d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/lf6 0 2024-09-21T00:56:43.155 INFO:tasks.workunit.client.1.smithi187.stdout:7/716: chown d1/dce/dd0/d97/df1/f35 83 1 2024-09-21T00:56:43.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:42 smithi187 ceph-mon[34997]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:43.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:42 smithi187 ceph-mon[34997]: pgmap v24: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 70 MiB/s rd, 267 MiB/s wr, 520 op/s 2024-09-21T00:56:43.163 INFO:tasks.workunit.client.0.smithi112.stdout:0/231: truncate d8/d11/f2d 2949326 0 2024-09-21T00:56:43.164 INFO:tasks.workunit.client.1.smithi187.stdout:1/884: rename d4/d6/d23/d2e/d94/d35/d79/f104 to d4/d6/d23/d2e/d94/d119/f11e 0 2024-09-21T00:56:43.165 INFO:tasks.workunit.client.0.smithi112.stdout:6/224: rename d9/d1b/d23/l4a to d9/d1f/d1a/d33/l53 0 2024-09-21T00:56:43.167 INFO:tasks.workunit.client.0.smithi112.stdout:0/232: creat d8/d1b/d2c/d2e/f4a x:0 0 0 2024-09-21T00:56:43.168 INFO:tasks.workunit.client.1.smithi187.stdout:6/801: mknod d7/d2a/d29/d40/d50/d83/de5/c10a 0 2024-09-21T00:56:43.170 INFO:tasks.workunit.client.1.smithi187.stdout:0/726: mkdir d0/d17/d18/d3a/d97/dcc/df7 0 2024-09-21T00:56:43.171 INFO:tasks.workunit.client.0.smithi112.stdout:0/233: rename d8/f46 to d8/d1b/f4b 0 2024-09-21T00:56:43.174 INFO:tasks.workunit.client.0.smithi112.stdout:6/225: creat d9/d1f/d3e/f54 x:0 0 0 2024-09-21T00:56:43.174 INFO:tasks.workunit.client.0.smithi112.stdout:6/226: fdatasync d9/df/f4e 0 2024-09-21T00:56:43.175 INFO:tasks.workunit.client.1.smithi187.stdout:3/719: dread d9/d19/d1c/f8c [0,4194304] 0 2024-09-21T00:56:43.178 INFO:tasks.workunit.client.1.smithi187.stdout:2/849: dread d2/da8/f5e [0,4194304] 0 2024-09-21T00:56:43.179 INFO:tasks.workunit.client.1.smithi187.stdout:2/850: read - d2/d3/d15/dfe/d2d/f83 zero size 2024-09-21T00:56:43.180 INFO:tasks.workunit.client.0.smithi112.stdout:9/202: dread d5/f17 [0,4194304] 0 2024-09-21T00:56:43.181 INFO:tasks.workunit.client.0.smithi112.stdout:6/227: creat d9/df/d4b/f55 x:0 0 0 2024-09-21T00:56:43.182 INFO:tasks.workunit.client.0.smithi112.stdout:9/203: dread - d5/d6/d19/d1b/f32 zero size 2024-09-21T00:56:43.184 INFO:tasks.workunit.client.1.smithi187.stdout:8/828: rename dc/d44/f55 to dc/d2f/d80/db8/dba/dc7/f119 0 2024-09-21T00:56:43.184 INFO:tasks.workunit.client.1.smithi187.stdout:8/829: truncate dc/f28 1583890 0 2024-09-21T00:56:43.187 INFO:tasks.workunit.client.1.smithi187.stdout:6/802: mknod d7/d2a/d29/d40/d5e/ddc/c10b 0 2024-09-21T00:56:43.188 INFO:tasks.workunit.client.0.smithi112.stdout:9/204: creat d5/d3b/f3e x:0 0 0 2024-09-21T00:56:43.192 INFO:tasks.workunit.client.1.smithi187.stdout:5/723: dwrite d0/dc/daa/d67/d30/d6b/fa0 [0,4194304] 0 2024-09-21T00:56:43.193 INFO:tasks.workunit.client.1.smithi187.stdout:3/720: mknod d9/d7f/dcb/d87/d94/d53/d56/d61/cea 0 2024-09-21T00:56:43.194 INFO:tasks.workunit.client.1.smithi187.stdout:5/724: read d0/dc/daa/d67/d14/d38/f82 [358910,69802] 0 2024-09-21T00:56:43.195 INFO:tasks.workunit.client.0.smithi112.stdout:6/228: rename d9/d1f/d1a to d9/df/d56 0 2024-09-21T00:56:43.196 INFO:tasks.workunit.client.1.smithi187.stdout:2/851: mknod d2/d3/d15/dfe/d2d/d8f/c12c 0 2024-09-21T00:56:43.198 INFO:tasks.workunit.client.1.smithi187.stdout:6/803: mknod d7/d2a/d29/d40/d45/df7/c10c 0 2024-09-21T00:56:43.200 INFO:tasks.workunit.client.1.smithi187.stdout:0/727: mkdir d0/d17/d18/df8 0 2024-09-21T00:56:43.201 INFO:tasks.workunit.client.1.smithi187.stdout:5/725: dwrite d0/dc/daa/d67/d14/d1b/d27/d3a/fb0 [0,4194304] 0 2024-09-21T00:56:43.203 INFO:tasks.workunit.client.1.smithi187.stdout:9/941: getdents d4/d13/d14 0 2024-09-21T00:56:43.205 INFO:tasks.workunit.client.1.smithi187.stdout:7/717: creat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/ff7 x:0 0 0 2024-09-21T00:56:43.206 INFO:tasks.workunit.client.1.smithi187.stdout:3/721: mknod d9/ceb 0 2024-09-21T00:56:43.209 INFO:tasks.workunit.client.1.smithi187.stdout:1/885: creat d4/d6/d23/d2e/d94/d35/d22/d2c/f11f x:0 0 0 2024-09-21T00:56:43.209 INFO:tasks.workunit.client.1.smithi187.stdout:5/726: dwrite d0/dc/daa/d67/d14/d38/d5a/fbc [0,4194304] 0 2024-09-21T00:56:43.212 INFO:tasks.workunit.client.1.smithi187.stdout:6/804: mknod d7/d2a/d29/d40/d6a/dbc/c10d 0 2024-09-21T00:56:43.212 INFO:tasks.workunit.client.1.smithi187.stdout:7/718: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/f94 775396 0 2024-09-21T00:56:43.218 INFO:tasks.workunit.client.1.smithi187.stdout:9/942: rename d4/d10/d39/d69 to d4/d8/d46/d54/d10f/d121/d94/d122/d13c 0 2024-09-21T00:56:43.220 INFO:tasks.workunit.client.1.smithi187.stdout:2/852: unlink d2/d3/d15/dfe/d2d/c49 0 2024-09-21T00:56:43.227 INFO:tasks.workunit.client.0.smithi112.stdout:6/229: dwrite d9/df/d4b/f55 [0,4194304] 0 2024-09-21T00:56:43.227 INFO:tasks.workunit.client.0.smithi112.stdout:9/205: write d5/d6/de/f31 [940097,71164] 0 2024-09-21T00:56:43.228 INFO:tasks.workunit.client.1.smithi187.stdout:9/943: rmdir d4/d13/d14/d1d/d5f 39 2024-09-21T00:56:43.228 INFO:tasks.workunit.client.0.smithi112.stdout:9/206: fsync d5/d6/d19/f33 0 2024-09-21T00:56:43.229 INFO:tasks.workunit.client.0.smithi112.stdout:9/207: readlink d5/d6/l25 0 2024-09-21T00:56:43.230 INFO:tasks.workunit.client.1.smithi187.stdout:5/727: dread d0/fa5 [0,4194304] 0 2024-09-21T00:56:43.231 INFO:tasks.workunit.client.0.smithi112.stdout:5/98: sync 2024-09-21T00:56:43.232 INFO:tasks.workunit.client.1.smithi187.stdout:0/728: write d0/d17/d1c/d23/df/d41/d3b/f6c [52510,127743] 0 2024-09-21T00:56:43.234 INFO:tasks.workunit.client.1.smithi187.stdout:6/805: dread d7/ff [0,4194304] 0 2024-09-21T00:56:43.235 INFO:tasks.workunit.client.0.smithi112.stdout:6/230: rename d9/df/c14 to d9/df/d56/d33/c57 0 2024-09-21T00:56:43.238 INFO:tasks.workunit.client.1.smithi187.stdout:8/830: getdents dc/d2f/d80/db8/dba/dc7 0 2024-09-21T00:56:43.239 INFO:tasks.workunit.client.0.smithi112.stdout:9/208: dwrite d5/d6/de/f2e [0,4194304] 0 2024-09-21T00:56:43.239 INFO:tasks.workunit.client.1.smithi187.stdout:8/831: fsync dc/d2f/d80/db8/dba/d29/da7/fee 0 2024-09-21T00:56:43.240 INFO:tasks.workunit.client.1.smithi187.stdout:1/886: write d4/d6/d23/d2e/d94/d35/d22/d65/f9d [5118772,75343] 0 2024-09-21T00:56:43.241 INFO:tasks.workunit.client.0.smithi112.stdout:5/99: dwrite d8/fa [0,4194304] 0 2024-09-21T00:56:43.241 INFO:tasks.workunit.client.1.smithi187.stdout:7/719: write d1/f1a [956084,85268] 0 2024-09-21T00:56:43.242 INFO:tasks.workunit.client.0.smithi112.stdout:5/100: write d8/f1a [495558,127862] 0 2024-09-21T00:56:43.245 INFO:tasks.workunit.client.0.smithi112.stdout:6/231: mknod d9/d1b/d46/c58 0 2024-09-21T00:56:43.247 INFO:tasks.workunit.client.1.smithi187.stdout:5/728: symlink d0/dc/daa/d67/d14/d57/lf1 0 2024-09-21T00:56:43.248 INFO:tasks.workunit.client.0.smithi112.stdout:5/101: mknod d8/d9/de/c1b 0 2024-09-21T00:56:43.250 INFO:tasks.workunit.client.1.smithi187.stdout:0/729: symlink d0/d17/d1c/d23/df/d41/d3b/lf9 0 2024-09-21T00:56:43.251 INFO:tasks.workunit.client.0.smithi112.stdout:5/102: write d8/fa [2284970,24988] 0 2024-09-21T00:56:43.252 INFO:tasks.workunit.client.1.smithi187.stdout:0/730: fdatasync d0/d17/d1c/d23/df/d41/d3b/d46/fc5 0 2024-09-21T00:56:43.254 INFO:tasks.workunit.client.0.smithi112.stdout:6/232: dwrite d9/f20 [0,4194304] 0 2024-09-21T00:56:43.255 INFO:tasks.workunit.client.0.smithi112.stdout:9/209: write d5/d6/de/d13/f1a [705516,16108] 0 2024-09-21T00:56:43.256 INFO:tasks.workunit.client.0.smithi112.stdout:5/103: mkdir d8/d9/d13/d1c 0 2024-09-21T00:56:43.257 INFO:tasks.workunit.client.0.smithi112.stdout:5/104: write d8/d9/de/f12 [1430241,44280] 0 2024-09-21T00:56:43.258 INFO:tasks.workunit.client.1.smithi187.stdout:2/853: truncate d2/da8/d6c/d97/da1/fad 72802 0 2024-09-21T00:56:43.259 INFO:tasks.workunit.client.1.smithi187.stdout:2/854: readlink d2/d3/d15/dfe/d2d/d8f/d9f/d8c/d107/l114 0 2024-09-21T00:56:43.260 INFO:tasks.workunit.client.1.smithi187.stdout:2/855: write d2/d3/df/f72 [1154715,16413] 0 2024-09-21T00:56:43.260 INFO:tasks.workunit.client.0.smithi112.stdout:6/233: creat d9/df/f59 x:0 0 0 2024-09-21T00:56:43.261 INFO:tasks.workunit.client.0.smithi112.stdout:6/234: fdatasync d9/d1f/d3e/f54 0 2024-09-21T00:56:43.261 INFO:tasks.workunit.client.1.smithi187.stdout:3/722: creat d9/d19/dca/fec x:0 0 0 2024-09-21T00:56:43.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/105: mknod d8/d9/de/df/c1d 0 2024-09-21T00:56:43.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/106: chown d8/d9/d13 1194633063 1 2024-09-21T00:56:43.265 INFO:tasks.workunit.client.1.smithi187.stdout:5/729: mknod d0/dc/daa/d98/cf2 0 2024-09-21T00:56:43.265 INFO:tasks.workunit.client.0.smithi112.stdout:9/210: mkdir d5/d6/d3f 0 2024-09-21T00:56:43.266 INFO:tasks.workunit.client.1.smithi187.stdout:5/730: readlink d0/dc/daa/d67/d14/l16 0 2024-09-21T00:56:43.267 INFO:tasks.workunit.client.1.smithi187.stdout:5/731: write d0/dc/daa/d67/f50 [500493,51124] 0 2024-09-21T00:56:43.268 INFO:tasks.workunit.client.1.smithi187.stdout:5/732: write d0/dc/daa/d67/d30/f60 [2926825,25044] 0 2024-09-21T00:56:43.270 INFO:tasks.workunit.client.0.smithi112.stdout:9/211: rename d5/d6/de/d13/f2f to d5/d6/d19/d1b/f40 0 2024-09-21T00:56:43.274 INFO:tasks.workunit.client.0.smithi112.stdout:5/107: dwrite f7 [0,4194304] 0 2024-09-21T00:56:43.275 INFO:tasks.workunit.client.1.smithi187.stdout:7/720: unlink d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/c92 0 2024-09-21T00:56:43.276 INFO:tasks.workunit.client.1.smithi187.stdout:8/832: dread dc/d2f/d54/d69/f84 [0,4194304] 0 2024-09-21T00:56:43.277 INFO:tasks.workunit.client.0.smithi112.stdout:9/212: dread d5/d6/f30 [0,4194304] 0 2024-09-21T00:56:43.277 INFO:tasks.workunit.client.0.smithi112.stdout:9/213: readlink d5/d6/l25 0 2024-09-21T00:56:43.284 INFO:tasks.workunit.client.1.smithi187.stdout:7/721: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/ff0 [0,4194304] 0 2024-09-21T00:56:43.385 INFO:tasks.workunit.client.1.smithi187.stdout:9/944: link d4/d8/d46/d54/d10f/d121/d66/db6/fee d4/d8/d46/d54/d10f/d121/d66/db6/f13d 0 2024-09-21T00:56:43.395 INFO:tasks.workunit.client.1.smithi187.stdout:1/887: truncate d4/d6/d23/d2e/d53/fea 173815 0 2024-09-21T00:56:43.397 INFO:tasks.workunit.client.1.smithi187.stdout:1/888: write d4/d6/d23/d2e/d94/d35/d4c/fa7 [2542787,36929] 0 2024-09-21T00:56:43.399 INFO:tasks.workunit.client.1.smithi187.stdout:4/811: sync 2024-09-21T00:56:43.400 INFO:tasks.workunit.client.0.smithi112.stdout:6/235: dwrite d9/d1b/f1d [0,4194304] 0 2024-09-21T00:56:43.408 INFO:tasks.workunit.client.0.smithi112.stdout:5/108: truncate d8/d9/de/df/f10 1874236 0 2024-09-21T00:56:43.409 INFO:tasks.workunit.client.0.smithi112.stdout:9/214: dread d5/f14 [4194304,4194304] 0 2024-09-21T00:56:43.409 INFO:tasks.workunit.client.0.smithi112.stdout:5/109: read d8/fa [852691,118568] 0 2024-09-21T00:56:43.409 INFO:tasks.workunit.client.1.smithi187.stdout:0/731: dwrite d0/d17/d18/f81 [4194304,4194304] 0 2024-09-21T00:56:43.413 INFO:tasks.workunit.client.0.smithi112.stdout:9/215: symlink d5/d6/de/d13/l41 0 2024-09-21T00:56:43.415 INFO:tasks.workunit.client.0.smithi112.stdout:9/216: read d5/d6/d19/f28 [25497,124987] 0 2024-09-21T00:56:43.416 INFO:tasks.workunit.client.0.smithi112.stdout:5/110: truncate f5 3921959 0 2024-09-21T00:56:43.417 INFO:tasks.workunit.client.0.smithi112.stdout:5/111: write f3 [3534309,58842] 0 2024-09-21T00:56:43.420 INFO:tasks.workunit.client.0.smithi112.stdout:9/217: dread d5/d6/de/f2e [0,4194304] 0 2024-09-21T00:56:43.424 INFO:tasks.workunit.client.0.smithi112.stdout:9/218: mknod d5/d6/d19/c42 0 2024-09-21T00:56:43.425 INFO:tasks.workunit.client.0.smithi112.stdout:9/219: write d5/d6/f37 [433717,21096] 0 2024-09-21T00:56:43.429 INFO:tasks.workunit.client.0.smithi112.stdout:9/220: symlink d5/d6/d19/d1b/l43 0 2024-09-21T00:56:43.431 INFO:tasks.workunit.client.0.smithi112.stdout:6/236: dread d9/fd [0,4194304] 0 2024-09-21T00:56:43.431 INFO:tasks.workunit.client.0.smithi112.stdout:9/221: chown d5/d6/de/c26 4 1 2024-09-21T00:56:43.432 INFO:tasks.workunit.client.0.smithi112.stdout:6/237: chown d9/d1b/f2a 4321 1 2024-09-21T00:56:43.432 INFO:tasks.workunit.client.1.smithi187.stdout:7/722: symlink d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/lf8 0 2024-09-21T00:56:43.433 INFO:tasks.workunit.client.1.smithi187.stdout:2/856: link d2/da8/d6c/fca d2/da8/d6c/db8/d40/d75/f12d 0 2024-09-21T00:56:43.436 INFO:tasks.workunit.client.1.smithi187.stdout:9/945: symlink d4/d61/d6a/l13e 0 2024-09-21T00:56:43.437 INFO:tasks.workunit.client.0.smithi112.stdout:6/238: mknod d9/d1f/d3e/c5a 0 2024-09-21T00:56:43.438 INFO:tasks.workunit.client.1.smithi187.stdout:6/806: getdents d7/d2a/d29/d40/d5e/ddc 0 2024-09-21T00:56:43.439 INFO:tasks.workunit.client.1.smithi187.stdout:2/857: dwrite d2/d25/fee [0,4194304] 0 2024-09-21T00:56:43.439 INFO:tasks.workunit.client.1.smithi187.stdout:6/807: fdatasync d7/d2a/d29/d40/d50/d83/dfd/f101 0 2024-09-21T00:56:43.440 INFO:tasks.workunit.client.1.smithi187.stdout:6/808: chown d7/d59/f1e 124607 1 2024-09-21T00:56:43.442 INFO:tasks.workunit.client.0.smithi112.stdout:6/239: dread d9/d13/f17 [0,4194304] 0 2024-09-21T00:56:43.445 INFO:tasks.workunit.client.1.smithi187.stdout:4/812: mknod d2/d3/da/d2f/d32/d24/cf4 0 2024-09-21T00:56:43.447 INFO:tasks.workunit.client.1.smithi187.stdout:4/813: write d2/d3/da/d2f/d4b/f6a [2742756,69251] 0 2024-09-21T00:56:43.449 INFO:tasks.workunit.client.1.smithi187.stdout:4/814: chown d2/d3/da/d16/fdd 292 1 2024-09-21T00:56:43.449 INFO:tasks.workunit.client.1.smithi187.stdout:1/889: dwrite d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [0,4194304] 0 2024-09-21T00:56:43.449 INFO:tasks.workunit.client.0.smithi112.stdout:9/222: link d5/cf d5/c44 0 2024-09-21T00:56:43.450 INFO:tasks.workunit.client.1.smithi187.stdout:1/890: readlink d4/l9b 0 2024-09-21T00:56:43.450 INFO:tasks.workunit.client.0.smithi112.stdout:9/223: dread - d5/d6/d19/f33 zero size 2024-09-21T00:56:43.451 INFO:tasks.workunit.client.0.smithi112.stdout:6/240: symlink d9/d13/d31/l5b 0 2024-09-21T00:56:43.452 INFO:tasks.workunit.client.1.smithi187.stdout:8/833: mknod dc/d2f/d80/db8/dba/c11a 0 2024-09-21T00:56:43.453 INFO:tasks.workunit.client.0.smithi112.stdout:9/224: write d5/d6/d19/d1b/f40 [1039082,95214] 0 2024-09-21T00:56:43.453 INFO:tasks.workunit.client.1.smithi187.stdout:3/723: dread d9/d7f/dcb/f1e [0,4194304] 0 2024-09-21T00:56:43.455 INFO:tasks.workunit.client.1.smithi187.stdout:5/733: sync 2024-09-21T00:56:43.455 INFO:tasks.workunit.client.1.smithi187.stdout:3/724: fsync d9/d7f/dcb/d20/f3c 0 2024-09-21T00:56:43.455 INFO:tasks.workunit.client.1.smithi187.stdout:7/723: symlink d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/lf9 0 2024-09-21T00:56:43.457 INFO:tasks.workunit.client.0.smithi112.stdout:6/241: rename f7 to d9/df/d56/f5c 0 2024-09-21T00:56:43.458 INFO:tasks.workunit.client.0.smithi112.stdout:6/242: truncate d9/df/f4e 177481 0 2024-09-21T00:56:43.462 INFO:tasks.workunit.client.0.smithi112.stdout:9/225: rename f3 to d5/d6/de/d13/f45 0 2024-09-21T00:56:43.465 INFO:tasks.workunit.client.1.smithi187.stdout:6/809: symlink d7/d2a/d29/d94/l10e 0 2024-09-21T00:56:43.467 INFO:tasks.workunit.client.1.smithi187.stdout:0/732: mknod d0/d60/d6b/dc9/cfa 0 2024-09-21T00:56:43.469 INFO:tasks.workunit.client.0.smithi112.stdout:6/243: link d9/d1b/d23/f48 d9/df/d19/f5d 0 2024-09-21T00:56:43.471 INFO:tasks.workunit.client.0.smithi112.stdout:9/226: creat d5/d6/d3f/f46 x:0 0 0 2024-09-21T00:56:43.474 INFO:tasks.workunit.client.1.smithi187.stdout:0/733: dwrite d0/d17/d1c/d23/df/fce [4194304,4194304] 0 2024-09-21T00:56:43.480 INFO:tasks.workunit.client.1.smithi187.stdout:3/725: mkdir d9/d7f/dcb/d87/d94/d53/d56/d61/ded 0 2024-09-21T00:56:43.481 INFO:tasks.workunit.client.1.smithi187.stdout:5/734: dwrite d0/fa5 [4194304,4194304] 0 2024-09-21T00:56:43.482 INFO:tasks.workunit.client.0.smithi112.stdout:9/227: dwrite d5/d6/de/d13/f45 [4194304,4194304] 0 2024-09-21T00:56:43.482 INFO:tasks.workunit.client.1.smithi187.stdout:9/946: dread d4/d61/d6c/fab [4194304,4194304] 0 2024-09-21T00:56:43.483 INFO:tasks.workunit.client.0.smithi112.stdout:6/244: rename d9/d1f/d3e/c5a to d9/d1f/c5e 0 2024-09-21T00:56:43.485 INFO:tasks.workunit.client.0.smithi112.stdout:6/245: dread - d9/d1b/f2a zero size 2024-09-21T00:56:43.491 INFO:tasks.workunit.client.0.smithi112.stdout:6/246: creat d9/df/d4b/f5f x:0 0 0 2024-09-21T00:56:43.491 INFO:tasks.workunit.client.0.smithi112.stdout:5/112: write f5 [2973169,17274] 0 2024-09-21T00:56:43.492 INFO:tasks.workunit.client.0.smithi112.stdout:6/247: fdatasync d9/df/f59 0 2024-09-21T00:56:43.495 INFO:tasks.workunit.client.1.smithi187.stdout:0/734: write d0/d17/d1c/d23/df/d41/fe1 [749687,72306] 0 2024-09-21T00:56:43.500 INFO:tasks.workunit.client.0.smithi112.stdout:5/113: dwrite d8/d9/de/f18 [0,4194304] 0 2024-09-21T00:56:43.500 INFO:tasks.workunit.client.0.smithi112.stdout:6/248: mkdir d9/d13/d60 0 2024-09-21T00:56:43.501 INFO:tasks.workunit.client.1.smithi187.stdout:0/735: dwrite d0/d17/d18/d90/fbf [0,4194304] 0 2024-09-21T00:56:43.501 INFO:tasks.workunit.client.0.smithi112.stdout:6/249: chown d9/d1f/d47 0 1 2024-09-21T00:56:43.502 INFO:tasks.workunit.client.1.smithi187.stdout:5/735: stat d0/dc/f11 0 2024-09-21T00:56:43.502 INFO:tasks.workunit.client.1.smithi187.stdout:0/736: stat d0/d17/d1c/d23/d36/fd6 0 2024-09-21T00:56:43.506 INFO:tasks.workunit.client.0.smithi112.stdout:5/114: rmdir d8/d9/d13 39 2024-09-21T00:56:43.512 INFO:tasks.workunit.client.0.smithi112.stdout:5/115: write d8/d9/d13/f16 [10398,103138] 0 2024-09-21T00:56:43.514 INFO:tasks.workunit.client.0.smithi112.stdout:6/250: mknod d9/d13/d31/c61 0 2024-09-21T00:56:43.515 INFO:tasks.workunit.client.1.smithi187.stdout:8/834: write dc/d2f/d80/db8/dba/d29/da7/fb5 [634204,98644] 0 2024-09-21T00:56:43.518 INFO:tasks.workunit.client.1.smithi187.stdout:8/835: write dc/f92 [2120952,87993] 0 2024-09-21T00:56:43.518 INFO:tasks.workunit.client.1.smithi187.stdout:1/891: dwrite d4/d6/f48 [0,4194304] 0 2024-09-21T00:56:43.519 INFO:tasks.workunit.client.1.smithi187.stdout:5/736: truncate d0/dc/d39/f4b 4282899 0 2024-09-21T00:56:43.519 INFO:tasks.workunit.client.0.smithi112.stdout:5/116: symlink d8/l1e 0 2024-09-21T00:56:43.521 INFO:tasks.workunit.client.0.smithi112.stdout:6/251: mkdir d9/d1b/d45/d62 0 2024-09-21T00:56:43.523 INFO:tasks.workunit.client.1.smithi187.stdout:7/724: dwrite d1/dce/dd0/f7f [0,4194304] 0 2024-09-21T00:56:43.527 INFO:tasks.workunit.client.1.smithi187.stdout:6/810: rename d7/l3e to d7/d2a/d29/l10f 0 2024-09-21T00:56:43.528 INFO:tasks.workunit.client.1.smithi187.stdout:6/811: stat d7/d2a/d29/d40/d6a/d9e 0 2024-09-21T00:56:43.529 INFO:tasks.workunit.client.0.smithi112.stdout:9/228: dwrite d5/d6/d19/f28 [0,4194304] 0 2024-09-21T00:56:43.530 INFO:tasks.workunit.client.1.smithi187.stdout:3/726: write d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/fa8 [285625,52803] 0 2024-09-21T00:56:43.530 INFO:tasks.workunit.client.1.smithi187.stdout:2/858: write d2/da8/d6c/d97/da1/fad [181027,46916] 0 2024-09-21T00:56:43.530 INFO:tasks.workunit.client.0.smithi112.stdout:9/229: fdatasync d5/d6/de/f31 0 2024-09-21T00:56:43.533 INFO:tasks.workunit.client.0.smithi112.stdout:6/252: creat d9/d1f/d47/d34/f63 x:0 0 0 2024-09-21T00:56:43.533 INFO:tasks.workunit.client.0.smithi112.stdout:6/253: stat d9/d1f/d47/c32 0 2024-09-21T00:56:43.534 INFO:tasks.workunit.client.0.smithi112.stdout:6/254: fdatasync d9/df/f2e 0 2024-09-21T00:56:43.541 INFO:tasks.workunit.client.1.smithi187.stdout:9/947: rmdir d4/d10/d43/d11c/d6e/d13a 0 2024-09-21T00:56:43.543 INFO:tasks.workunit.client.0.smithi112.stdout:9/230: rename d5/d6/f7 to d5/d6/de/d13/f47 0 2024-09-21T00:56:43.543 INFO:tasks.workunit.client.0.smithi112.stdout:5/117: dread f3 [0,4194304] 0 2024-09-21T00:56:43.544 INFO:tasks.workunit.client.1.smithi187.stdout:8/836: rename dc/l6b to dc/d2f/d80/db8/dba/d113/l11b 0 2024-09-21T00:56:43.544 INFO:tasks.workunit.client.0.smithi112.stdout:9/231: readlink d5/d6/d19/d1b/l43 0 2024-09-21T00:56:43.544 INFO:tasks.workunit.client.1.smithi187.stdout:8/837: chown dc/d2f/d54/d69/f84 52163099 1 2024-09-21T00:56:43.545 INFO:tasks.workunit.client.0.smithi112.stdout:8/134: sync 2024-09-21T00:56:43.545 INFO:tasks.workunit.client.1.smithi187.stdout:8/838: chown dc/d2f/d80/db8 9 1 2024-09-21T00:56:43.545 INFO:tasks.workunit.client.1.smithi187.stdout:6/812: chown d7/d2a/d29/f60 7 1 2024-09-21T00:56:43.547 INFO:tasks.workunit.client.0.smithi112.stdout:6/255: dread d9/d13/f39 [0,4194304] 0 2024-09-21T00:56:43.548 INFO:tasks.workunit.client.0.smithi112.stdout:6/256: write d9/df/f4e [1025250,90001] 0 2024-09-21T00:56:43.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/257: chown d9/df/f27 29234 1 2024-09-21T00:56:43.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/258: stat d9/d1f/c24 0 2024-09-21T00:56:43.551 INFO:tasks.workunit.client.1.smithi187.stdout:4/815: sync 2024-09-21T00:56:43.553 INFO:tasks.workunit.client.1.smithi187.stdout:0/737: write d0/fb9 [1282817,129331] 0 2024-09-21T00:56:43.554 INFO:tasks.workunit.client.1.smithi187.stdout:5/737: write d0/f20 [5049122,101274] 0 2024-09-21T00:56:43.554 INFO:tasks.workunit.client.0.smithi112.stdout:5/118: dwrite f3 [4194304,4194304] 0 2024-09-21T00:56:43.555 INFO:tasks.workunit.client.0.smithi112.stdout:9/232: symlink d5/d6/l48 0 2024-09-21T00:56:43.556 INFO:tasks.workunit.client.1.smithi187.stdout:1/892: write d4/d6/d23/f2b [712548,69927] 0 2024-09-21T00:56:43.556 INFO:tasks.workunit.client.1.smithi187.stdout:5/738: write d0/dc/daa/d67/d30/fd2 [76586,35332] 0 2024-09-21T00:56:43.557 INFO:tasks.workunit.client.0.smithi112.stdout:6/259: creat d9/df/d19/f64 x:0 0 0 2024-09-21T00:56:43.558 INFO:tasks.workunit.client.1.smithi187.stdout:1/893: stat d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/lad 0 2024-09-21T00:56:43.559 INFO:tasks.workunit.client.0.smithi112.stdout:6/260: fdatasync d9/d13/f15 0 2024-09-21T00:56:43.559 INFO:tasks.workunit.client.0.smithi112.stdout:8/135: link d0/f1d d0/d13/f27 0 2024-09-21T00:56:43.560 INFO:tasks.workunit.client.0.smithi112.stdout:6/261: dread - d9/df/d4b/f5f zero size 2024-09-21T00:56:43.561 INFO:tasks.workunit.client.0.smithi112.stdout:8/136: chown d0/l18 1207535 1 2024-09-21T00:56:43.562 INFO:tasks.workunit.client.1.smithi187.stdout:1/894: read d4/d6/d23/d2e/d94/d35/d79/feb [1481956,26752] 0 2024-09-21T00:56:43.562 INFO:tasks.workunit.client.0.smithi112.stdout:2/237: sync 2024-09-21T00:56:43.562 INFO:tasks.workunit.client.0.smithi112.stdout:1/182: sync 2024-09-21T00:56:43.562 INFO:tasks.workunit.client.0.smithi112.stdout:4/321: sync 2024-09-21T00:56:43.562 INFO:tasks.workunit.client.0.smithi112.stdout:7/219: sync 2024-09-21T00:56:43.562 INFO:tasks.workunit.client.0.smithi112.stdout:0/234: sync 2024-09-21T00:56:43.563 INFO:tasks.workunit.client.0.smithi112.stdout:3/297: sync 2024-09-21T00:56:43.563 INFO:tasks.workunit.client.0.smithi112.stdout:5/119: mknod d8/d9/de/df/c1f 0 2024-09-21T00:56:43.564 INFO:tasks.workunit.client.0.smithi112.stdout:1/183: chown d5/d8/d14 30576010 1 2024-09-21T00:56:43.565 INFO:tasks.workunit.client.0.smithi112.stdout:7/220: stat d0/d2/c2b 0 2024-09-21T00:56:43.566 INFO:tasks.workunit.client.1.smithi187.stdout:3/727: dread d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/f84 [0,4194304] 0 2024-09-21T00:56:43.568 INFO:tasks.workunit.client.0.smithi112.stdout:9/233: dwrite d5/fb [4194304,4194304] 0 2024-09-21T00:56:43.568 INFO:tasks.workunit.client.1.smithi187.stdout:4/816: rmdir d2/d3/da/d2f/d4b/d7e/dc8/d89 39 2024-09-21T00:56:43.569 INFO:tasks.workunit.client.0.smithi112.stdout:0/235: write d8/d1b/f42 [131551,125559] 0 2024-09-21T00:56:43.570 INFO:tasks.workunit.client.1.smithi187.stdout:0/738: creat d0/d60/d6b/ffb x:0 0 0 2024-09-21T00:56:43.571 INFO:tasks.workunit.client.0.smithi112.stdout:3/298: write d2/d8/d28/f3c [455782,40609] 0 2024-09-21T00:56:43.572 INFO:tasks.workunit.client.1.smithi187.stdout:5/739: mkdir d0/dc/daa/d67/dcc/de5/df3 0 2024-09-21T00:56:43.573 INFO:tasks.workunit.client.1.smithi187.stdout:5/740: chown d0/dc/daa 0 1 2024-09-21T00:56:43.575 INFO:tasks.workunit.client.0.smithi112.stdout:1/184: unlink d5/d8/d10/d2e/f31 0 2024-09-21T00:56:43.576 INFO:tasks.workunit.client.0.smithi112.stdout:8/137: dwrite d0/d13/d1b/d22/f24 [0,4194304] 0 2024-09-21T00:56:43.579 INFO:tasks.workunit.client.0.smithi112.stdout:4/322: symlink d1/d7/d9/d1a/l70 0 2024-09-21T00:56:43.579 INFO:tasks.workunit.client.0.smithi112.stdout:2/238: read d0/d14/d8/d27/f2d [96635,107072] 0 2024-09-21T00:56:43.580 INFO:tasks.workunit.client.1.smithi187.stdout:6/813: creat d7/d2a/da2/f110 x:0 0 0 2024-09-21T00:56:43.581 INFO:tasks.workunit.client.0.smithi112.stdout:5/120: mknod d8/c20 0 2024-09-21T00:56:43.583 INFO:tasks.workunit.client.1.smithi187.stdout:3/728: creat d9/d19/d1c/d5f/fee x:0 0 0 2024-09-21T00:56:43.584 INFO:tasks.workunit.client.1.smithi187.stdout:2/859: link d2/d3/d15/dfe/dc6/lfd d2/d3/d15/dfe/d2d/d8f/d9f/d8c/l12e 0 2024-09-21T00:56:43.584 INFO:tasks.workunit.client.0.smithi112.stdout:3/299: dwrite d2/d8/d28/f3c [0,4194304] 0 2024-09-21T00:56:43.585 INFO:tasks.workunit.client.1.smithi187.stdout:2/860: chown d2/dc/d2e/d51/dc5/ddf/lf3 5258 1 2024-09-21T00:56:43.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/239: dread d0/fa [0,4194304] 0 2024-09-21T00:56:43.587 INFO:tasks.workunit.client.0.smithi112.stdout:7/221: symlink d0/d2/d36/d39/d1a/d23/l3f 0 2024-09-21T00:56:43.590 INFO:tasks.workunit.client.0.smithi112.stdout:0/236: mkdir d8/d1b/d2c/d2e/d4c 0 2024-09-21T00:56:43.592 INFO:tasks.workunit.client.1.smithi187.stdout:9/948: rename d4/d61/d6a/l13e to d4/d13/d14/d1d/l13f 0 2024-09-21T00:56:43.593 INFO:tasks.workunit.client.1.smithi187.stdout:7/725: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/f7d 2053506 0 2024-09-21T00:56:43.597 INFO:tasks.workunit.client.0.smithi112.stdout:1/185: mkdir d5/d8/d13/d3e 0 2024-09-21T00:56:43.598 INFO:tasks.workunit.client.0.smithi112.stdout:0/237: dread d8/fd [0,4194304] 0 2024-09-21T00:56:43.601 INFO:tasks.workunit.client.0.smithi112.stdout:6/262: dwrite d9/f20 [4194304,4194304] 0 2024-09-21T00:56:43.601 INFO:tasks.workunit.client.0.smithi112.stdout:4/323: creat d1/d5/d1c/d1e/d4a/d5f/f71 x:0 0 0 2024-09-21T00:56:43.601 INFO:tasks.workunit.client.1.smithi187.stdout:3/729: creat d9/d19/d43/fef x:0 0 0 2024-09-21T00:56:43.602 INFO:tasks.workunit.client.1.smithi187.stdout:3/730: write d9/d19/d1c/f5b [1056281,109613] 0 2024-09-21T00:56:43.602 INFO:tasks.workunit.client.1.smithi187.stdout:4/817: dread d2/d3/da/d2f/d4b/d7e/fa3 [0,4194304] 0 2024-09-21T00:56:43.604 INFO:tasks.workunit.client.1.smithi187.stdout:2/861: creat d2/dc/d2e/d4a/d7c/d52/da3/f12f x:0 0 0 2024-09-21T00:56:43.606 INFO:tasks.workunit.client.1.smithi187.stdout:4/818: dread d2/d3/d74/f80 [0,4194304] 0 2024-09-21T00:56:43.607 INFO:tasks.workunit.client.0.smithi112.stdout:3/300: creat d2/d38/d3f/f60 x:0 0 0 2024-09-21T00:56:43.607 INFO:tasks.workunit.client.0.smithi112.stdout:5/121: dread f5 [0,4194304] 0 2024-09-21T00:56:43.608 INFO:tasks.workunit.client.1.smithi187.stdout:4/819: chown d2/d3/da/d2f/d4b/d7e/dc8/d97/fbd 50950 1 2024-09-21T00:56:43.609 INFO:tasks.workunit.client.0.smithi112.stdout:2/240: symlink d0/d14/d8/d27/l4d 0 2024-09-21T00:56:43.611 INFO:tasks.workunit.client.0.smithi112.stdout:2/241: fsync d0/d14/d8/f44 0 2024-09-21T00:56:43.612 INFO:tasks.workunit.client.1.smithi187.stdout:4/820: read d2/d3/d56/d84/d60/d6c/d77/f93 [2714906,26872] 0 2024-09-21T00:56:43.612 INFO:tasks.workunit.client.1.smithi187.stdout:8/839: rename dc/d2f/d80/db8/dba/d29/fc6 to dc/d2f/d80/db8/dba/d3e/d75/f11c 0 2024-09-21T00:56:43.613 INFO:tasks.workunit.client.0.smithi112.stdout:2/242: chown d0/df/f34 3912710 1 2024-09-21T00:56:43.614 INFO:tasks.workunit.client.0.smithi112.stdout:5/122: dwrite d8/f1a [0,4194304] 0 2024-09-21T00:56:43.615 INFO:tasks.workunit.client.1.smithi187.stdout:9/949: mknod d4/d61/d6c/c140 0 2024-09-21T00:56:43.615 INFO:tasks.workunit.client.0.smithi112.stdout:5/123: chown d8/l1e 19 1 2024-09-21T00:56:43.617 INFO:tasks.workunit.client.1.smithi187.stdout:5/741: getdents d0/dc/daa/d67/dcc/de5/dea 0 2024-09-21T00:56:43.617 INFO:tasks.workunit.client.1.smithi187.stdout:4/821: dread d2/d3/d74/f80 [0,4194304] 0 2024-09-21T00:56:43.617 INFO:tasks.workunit.client.0.smithi112.stdout:0/238: stat d8/d11/f2d 0 2024-09-21T00:56:43.619 INFO:tasks.workunit.client.0.smithi112.stdout:9/234: creat d5/f49 x:0 0 0 2024-09-21T00:56:43.621 INFO:tasks.workunit.client.1.smithi187.stdout:0/739: dwrite d0/d17/d1c/f4c [0,4194304] 0 2024-09-21T00:56:43.622 INFO:tasks.workunit.client.0.smithi112.stdout:5/124: dread d8/d9/de/f18 [0,4194304] 0 2024-09-21T00:56:43.636 INFO:tasks.workunit.client.0.smithi112.stdout:3/301: dread d2/d8/d28/f26 [0,4194304] 0 2024-09-21T00:56:43.637 INFO:tasks.workunit.client.0.smithi112.stdout:3/302: truncate d2/d8/f5b 772672 0 2024-09-21T00:56:43.642 INFO:tasks.workunit.client.1.smithi187.stdout:7/726: dread d1/dc/d15/d22/f86 [0,4194304] 0 2024-09-21T00:56:43.663 INFO:tasks.workunit.client.0.smithi112.stdout:3/303: dread d2/f5 [0,4194304] 0 2024-09-21T00:56:43.664 INFO:tasks.workunit.client.1.smithi187.stdout:3/731: mkdir d9/d19/dca/dd6/df0 0 2024-09-21T00:56:43.665 INFO:tasks.workunit.client.0.smithi112.stdout:1/186: truncate d5/d8/d10/f17 3240976 0 2024-09-21T00:56:43.671 INFO:tasks.workunit.client.0.smithi112.stdout:4/324: readlink d1/d5/l1b 0 2024-09-21T00:56:43.671 INFO:tasks.workunit.client.0.smithi112.stdout:4/325: stat d1/d7/f17 0 2024-09-21T00:56:43.675 INFO:tasks.workunit.client.1.smithi187.stdout:1/895: rename d4/d6/d23/d2e/d94/d35/d4c/d5b/f67 to d4/d6/d23/d2e/d94/d6c/d11c/f120 0 2024-09-21T00:56:43.676 INFO:tasks.workunit.client.1.smithi187.stdout:1/896: read d4/d6/d23/d2e/d94/d35/d4c/f5f [2545420,35765] 0 2024-09-21T00:56:43.685 INFO:tasks.workunit.client.1.smithi187.stdout:9/950: unlink d4/d8/d46/d54/d10f/d121/le4 0 2024-09-21T00:56:43.693 INFO:tasks.workunit.client.0.smithi112.stdout:0/239: fdatasync d8/d11/f1e 0 2024-09-21T00:56:43.694 INFO:tasks.workunit.client.0.smithi112.stdout:0/240: write d8/d11/f26 [58308,29565] 0 2024-09-21T00:56:43.695 INFO:tasks.workunit.client.1.smithi187.stdout:4/822: mkdir d2/d3/da/d16/d5f/df5 0 2024-09-21T00:56:43.697 INFO:tasks.workunit.client.1.smithi187.stdout:4/823: write d2/d3/da/d2f/d32/d24/f67 [56337,42592] 0 2024-09-21T00:56:43.704 INFO:tasks.workunit.client.1.smithi187.stdout:3/732: mknod d9/d7f/dcb/d20/cf1 0 2024-09-21T00:56:43.704 INFO:tasks.workunit.client.1.smithi187.stdout:3/733: write d9/d19/d43/fef [582204,45160] 0 2024-09-21T00:56:43.706 INFO:tasks.workunit.client.0.smithi112.stdout:1/187: rename d5/c23 to d5/d8/d10/c3f 0 2024-09-21T00:56:43.708 INFO:tasks.workunit.client.1.smithi187.stdout:2/862: mknod d2/dc/d2e/d51/dc5/ddf/d10a/d11e/c130 0 2024-09-21T00:56:43.709 INFO:tasks.workunit.client.1.smithi187.stdout:2/863: write d2/dc/d21/fea [1523438,94213] 0 2024-09-21T00:56:43.710 INFO:tasks.workunit.client.0.smithi112.stdout:4/326: read d1/d2d/f55 [2890964,120708] 0 2024-09-21T00:56:43.725 INFO:tasks.workunit.client.1.smithi187.stdout:8/840: mknod dc/d2f/d80/db8/dba/d3e/c11d 0 2024-09-21T00:56:43.733 INFO:tasks.workunit.client.1.smithi187.stdout:2/864: dread d2/da8/d6c/db8/f74 [8388608,4194304] 0 2024-09-21T00:56:43.736 INFO:tasks.workunit.client.0.smithi112.stdout:5/125: symlink d8/d9/d13/d1c/l21 0 2024-09-21T00:56:43.737 INFO:tasks.workunit.client.0.smithi112.stdout:3/304: mknod d2/d8/c61 0 2024-09-21T00:56:43.738 INFO:tasks.workunit.client.0.smithi112.stdout:3/305: dread - d2/f58 zero size 2024-09-21T00:56:43.741 INFO:tasks.workunit.client.0.smithi112.stdout:1/188: creat d5/d3a/f40 x:0 0 0 2024-09-21T00:56:43.744 INFO:tasks.workunit.client.0.smithi112.stdout:4/327: creat d1/d7/d9/d1a/d22/f72 x:0 0 0 2024-09-21T00:56:43.744 INFO:tasks.workunit.client.0.smithi112.stdout:4/328: chown d1/d2d/l3f 5339804 1 2024-09-21T00:56:43.746 INFO:tasks.workunit.client.0.smithi112.stdout:4/329: write d1/d5/d1c/f65 [84597,13200] 0 2024-09-21T00:56:43.747 INFO:tasks.workunit.client.0.smithi112.stdout:4/330: chown d1/d7/d9/d1a/l70 340418 1 2024-09-21T00:56:43.747 INFO:tasks.workunit.client.0.smithi112.stdout:6/263: link d9/d1b/f2a d9/d1f/f65 0 2024-09-21T00:56:43.751 INFO:tasks.workunit.client.0.smithi112.stdout:7/222: rmdir d0/d2/d2e/d3c 0 2024-09-21T00:56:43.754 INFO:tasks.workunit.client.1.smithi187.stdout:8/841: mkdir dc/d44/dc1/d11e 0 2024-09-21T00:56:43.758 INFO:tasks.workunit.client.0.smithi112.stdout:5/126: creat d8/d9/d13/d1c/f22 x:0 0 0 2024-09-21T00:56:43.758 INFO:tasks.workunit.client.0.smithi112.stdout:5/127: stat d8/d9/de/df 0 2024-09-21T00:56:43.761 INFO:tasks.workunit.client.0.smithi112.stdout:3/306: rmdir d2/d8 39 2024-09-21T00:56:43.762 INFO:tasks.workunit.client.1.smithi187.stdout:2/865: mknod d2/dc/d2e/d4a/d7c/d52/dba/c131 0 2024-09-21T00:56:43.765 INFO:tasks.workunit.client.1.smithi187.stdout:0/740: creat d0/d17/d1c/d23/ffc x:0 0 0 2024-09-21T00:56:43.766 INFO:tasks.workunit.client.1.smithi187.stdout:4/824: creat d2/d3/da/dc4/ff6 x:0 0 0 2024-09-21T00:56:43.772 INFO:tasks.workunit.client.0.smithi112.stdout:5/128: creat d8/d9/de/df/f23 x:0 0 0 2024-09-21T00:56:43.773 INFO:tasks.workunit.client.1.smithi187.stdout:2/866: dread d2/da8/d3f/fb9 [0,4194304] 0 2024-09-21T00:56:43.775 INFO:tasks.workunit.client.1.smithi187.stdout:6/814: creat d7/d2a/d29/d40/d6a/f111 x:0 0 0 2024-09-21T00:56:43.775 INFO:tasks.workunit.client.1.smithi187.stdout:0/741: dread - d0/d17/d1c/d23/d36/fa3 zero size 2024-09-21T00:56:43.775 INFO:tasks.workunit.client.1.smithi187.stdout:2/867: truncate d2/d3/d15/dfe/d2d/f83 458123 0 2024-09-21T00:56:43.776 INFO:tasks.workunit.client.0.smithi112.stdout:7/223: dwrite d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:43.778 INFO:tasks.workunit.client.1.smithi187.stdout:4/825: dread d2/d3/da/d2f/d4b/f7a [0,4194304] 0 2024-09-21T00:56:43.780 INFO:tasks.workunit.client.1.smithi187.stdout:4/826: chown d2/d3/d56/l95 5 1 2024-09-21T00:56:43.782 INFO:tasks.workunit.client.1.smithi187.stdout:2/868: dwrite d2/da8/d6c/db8/d40/feb [0,4194304] 0 2024-09-21T00:56:43.783 INFO:tasks.workunit.client.0.smithi112.stdout:3/307: dread d2/d8/f16 [0,4194304] 0 2024-09-21T00:56:43.784 INFO:tasks.workunit.client.0.smithi112.stdout:3/308: fsync d2/d8/d28/f41 0 2024-09-21T00:56:43.789 INFO:tasks.workunit.client.1.smithi187.stdout:4/827: dwrite d2/d3/da/d2f/d32/d24/f2e [0,4194304] 0 2024-09-21T00:56:43.793 INFO:tasks.workunit.client.1.smithi187.stdout:1/897: creat d4/d6/d23/d2e/d94/d35/d79/f121 x:0 0 0 2024-09-21T00:56:43.796 INFO:tasks.workunit.client.0.smithi112.stdout:3/309: mknod d2/d8/dd/de/d5c/c62 0 2024-09-21T00:56:43.797 INFO:tasks.workunit.client.0.smithi112.stdout:9/235: creat d5/d6/de/f4a x:0 0 0 2024-09-21T00:56:43.798 INFO:tasks.workunit.client.0.smithi112.stdout:9/236: chown d5/d6/d19/f1d 14499 1 2024-09-21T00:56:43.801 INFO:tasks.workunit.client.0.smithi112.stdout:9/237: fdatasync d5/f14 0 2024-09-21T00:56:43.802 INFO:tasks.workunit.client.1.smithi187.stdout:1/898: dread d4/d6/d23/d2e/d94/d35/d4c/f85 [0,4194304] 0 2024-09-21T00:56:43.803 INFO:tasks.workunit.client.1.smithi187.stdout:2/869: creat d2/da8/d6c/db8/f132 x:0 0 0 2024-09-21T00:56:43.811 INFO:tasks.workunit.client.1.smithi187.stdout:4/828: getdents d2/d3/d74/d98/dc2 0 2024-09-21T00:56:43.813 INFO:tasks.workunit.client.0.smithi112.stdout:9/238: creat d5/f4b x:0 0 0 2024-09-21T00:56:43.814 INFO:tasks.workunit.client.0.smithi112.stdout:9/239: dread - d5/d6/de/f3d zero size 2024-09-21T00:56:43.816 INFO:tasks.workunit.client.1.smithi187.stdout:2/870: unlink d2/dc/d2e/d4a/d7c/ce7 0 2024-09-21T00:56:43.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/240: write d5/d6/de/f2e [1144483,56090] 0 2024-09-21T00:56:43.821 INFO:tasks.workunit.client.1.smithi187.stdout:2/871: creat d2/dc/d2e/d51/dc5/ddf/f133 x:0 0 0 2024-09-21T00:56:43.821 INFO:tasks.workunit.client.1.smithi187.stdout:2/872: fsync d2/da8/fa0 0 2024-09-21T00:56:43.823 INFO:tasks.workunit.client.0.smithi112.stdout:3/310: dread d2/d38/f44 [0,4194304] 0 2024-09-21T00:56:43.823 INFO:tasks.workunit.client.1.smithi187.stdout:2/873: truncate d2/da8/d6c/db8/d40/d75/fd3 572101 0 2024-09-21T00:56:43.823 INFO:tasks.workunit.client.0.smithi112.stdout:9/241: creat d5/d6/d3f/f4c x:0 0 0 2024-09-21T00:56:43.824 INFO:tasks.workunit.client.1.smithi187.stdout:1/899: fsync d4/d6/d23/d2e/d94/d35/d22/d65/f9d 0 2024-09-21T00:56:43.824 INFO:tasks.workunit.client.0.smithi112.stdout:3/311: read d2/d38/f44 [2180119,63176] 0 2024-09-21T00:56:43.824 INFO:tasks.workunit.client.0.smithi112.stdout:9/242: chown d5/d6/d19/d1b/c27 3 1 2024-09-21T00:56:43.825 INFO:tasks.workunit.client.0.smithi112.stdout:9/243: dread - d5/d3b/f3e zero size 2024-09-21T00:56:43.829 INFO:tasks.workunit.client.1.smithi187.stdout:4/829: link d2/d3/da/d2f/d32/d26/d66/d6e/lb4 d2/d3/da/d2f/d32/d22/lf7 0 2024-09-21T00:56:43.830 INFO:tasks.workunit.client.1.smithi187.stdout:4/830: write d2/d3/da/d2f/d4b/fa9 [4724907,59455] 0 2024-09-21T00:56:43.835 INFO:tasks.workunit.client.0.smithi112.stdout:9/244: link d5/d6/d19/f2a d5/d6/d19/d1b/f4d 0 2024-09-21T00:56:43.837 INFO:tasks.workunit.client.0.smithi112.stdout:9/245: mknod d5/d6/de/d13/c4e 0 2024-09-21T00:56:43.837 INFO:tasks.workunit.client.0.smithi112.stdout:9/246: fsync d5/f49 0 2024-09-21T00:56:43.840 INFO:tasks.workunit.client.0.smithi112.stdout:9/247: fdatasync d5/d6/de/d13/f45 0 2024-09-21T00:56:43.841 INFO:tasks.workunit.client.0.smithi112.stdout:9/248: read - d5/d6/d19/d1b/f2b zero size 2024-09-21T00:56:43.842 INFO:tasks.workunit.client.0.smithi112.stdout:9/249: chown d5/cf 22256 1 2024-09-21T00:56:43.843 INFO:tasks.workunit.client.1.smithi187.stdout:7/727: write d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f71 [3708829,63750] 0 2024-09-21T00:56:43.846 INFO:tasks.workunit.client.1.smithi187.stdout:7/728: creat d1/d55/dd7/ffa x:0 0 0 2024-09-21T00:56:43.848 INFO:tasks.workunit.client.1.smithi187.stdout:7/729: creat d1/dce/dd0/d97/df1/d31/d33/d3b/d62/ffb x:0 0 0 2024-09-21T00:56:43.848 INFO:tasks.workunit.client.0.smithi112.stdout:9/250: link d5/d6/de/c26 d5/d3b/c4f 0 2024-09-21T00:56:43.849 INFO:tasks.workunit.client.1.smithi187.stdout:7/730: fsync d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fc3 0 2024-09-21T00:56:43.851 INFO:tasks.workunit.client.1.smithi187.stdout:7/731: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/da6/fb9 1403377 0 2024-09-21T00:56:43.852 INFO:tasks.workunit.client.0.smithi112.stdout:9/251: getdents d5/d6 0 2024-09-21T00:56:43.855 INFO:tasks.workunit.client.1.smithi187.stdout:4/831: creat d2/d3/ff8 x:0 0 0 2024-09-21T00:56:43.857 INFO:tasks.workunit.client.1.smithi187.stdout:5/742: write d0/dc/daa/f6e [1158617,76440] 0 2024-09-21T00:56:43.861 INFO:tasks.workunit.client.0.smithi112.stdout:0/241: dwrite d8/d11/f2d [0,4194304] 0 2024-09-21T00:56:43.862 INFO:tasks.workunit.client.1.smithi187.stdout:9/951: dwrite d4/d13/d14/fcd [0,4194304] 0 2024-09-21T00:56:43.863 INFO:tasks.workunit.client.1.smithi187.stdout:8/842: mkdir dc/d11f 0 2024-09-21T00:56:43.864 INFO:tasks.workunit.client.1.smithi187.stdout:4/832: dwrite d2/d3/da/d2f/d32/d26/d66/d6e/f8e [0,4194304] 0 2024-09-21T00:56:43.870 INFO:tasks.workunit.client.0.smithi112.stdout:0/242: dwrite d8/d1b/f42 [0,4194304] 0 2024-09-21T00:56:43.872 INFO:tasks.workunit.client.1.smithi187.stdout:5/743: dread d0/dc/daa/d67/d30/d68/f8a [0,4194304] 0 2024-09-21T00:56:43.879 INFO:tasks.workunit.client.1.smithi187.stdout:4/833: mkdir d2/d3/da/d2f/d32/d24/dcd/db3/df9 0 2024-09-21T00:56:43.880 INFO:tasks.workunit.client.1.smithi187.stdout:4/834: write d2/d3/ff8 [113299,103906] 0 2024-09-21T00:56:43.881 INFO:tasks.workunit.client.0.smithi112.stdout:0/243: readlink d8/d11/l21 0 2024-09-21T00:56:43.883 INFO:tasks.workunit.client.1.smithi187.stdout:5/744: unlink d0/dc/daa/d67/d30/f65 0 2024-09-21T00:56:43.885 INFO:tasks.workunit.client.1.smithi187.stdout:9/952: dread d4/d8/d46/fd3 [0,4194304] 0 2024-09-21T00:56:43.885 INFO:tasks.workunit.client.0.smithi112.stdout:0/244: rename d8/d1b/l49 to d8/d1b/d2c/d2e/l4d 0 2024-09-21T00:56:43.886 INFO:tasks.workunit.client.1.smithi187.stdout:4/835: fsync d2/d3/da/d2f/d4b/f7a 0 2024-09-21T00:56:43.886 INFO:tasks.workunit.client.1.smithi187.stdout:9/953: truncate d4/d8/d46/d54/d10f/d121/d94/fd5 866013 0 2024-09-21T00:56:43.887 INFO:tasks.workunit.client.1.smithi187.stdout:3/734: mkdir d9/df2 0 2024-09-21T00:56:43.887 INFO:tasks.workunit.client.1.smithi187.stdout:4/836: chown d2/d3/f36 14 1 2024-09-21T00:56:43.888 INFO:tasks.workunit.client.1.smithi187.stdout:8/843: creat dc/d2f/d80/db8/dba/d3e/f120 x:0 0 0 2024-09-21T00:56:43.888 INFO:tasks.workunit.client.1.smithi187.stdout:5/745: rmdir d0/dc/daa/d67/d14/d38/d5a 39 2024-09-21T00:56:43.893 INFO:tasks.workunit.client.1.smithi187.stdout:8/844: creat dc/d2f/d54/d69/db3/f121 x:0 0 0 2024-09-21T00:56:43.893 INFO:tasks.workunit.client.1.smithi187.stdout:5/746: mkdir d0/dc/d1f/df4 0 2024-09-21T00:56:43.896 INFO:tasks.workunit.client.1.smithi187.stdout:9/954: symlink d4/d8/d46/d54/d10f/d121/d108/dfc/d10a/l141 0 2024-09-21T00:56:43.898 INFO:tasks.workunit.client.1.smithi187.stdout:3/735: symlink d9/d19/d1c/lf3 0 2024-09-21T00:56:43.899 INFO:tasks.workunit.client.1.smithi187.stdout:5/747: dwrite d0/dc/d1f/d26/d8b/fd1 [0,4194304] 0 2024-09-21T00:56:43.900 INFO:tasks.workunit.client.1.smithi187.stdout:5/748: chown d0/dc/daa/d67/d14/d1b/d27/c59 1730818 1 2024-09-21T00:56:43.902 INFO:tasks.workunit.client.1.smithi187.stdout:5/749: read d0/f20 [4637053,29259] 0 2024-09-21T00:56:43.903 INFO:tasks.workunit.client.1.smithi187.stdout:4/837: getdents d2/d3/da 0 2024-09-21T00:56:43.908 INFO:tasks.workunit.client.1.smithi187.stdout:4/838: dwrite d2/d3/da/d16/d5f/f75 [0,4194304] 0 2024-09-21T00:56:43.908 INFO:tasks.workunit.client.0.smithi112.stdout:4/331: write d1/d2d/d34/f58 [1207451,109514] 0 2024-09-21T00:56:43.912 INFO:tasks.workunit.client.1.smithi187.stdout:3/736: mknod d9/d7f/dcb/d20/cf4 0 2024-09-21T00:56:43.913 INFO:tasks.workunit.client.0.smithi112.stdout:4/332: mknod d1/d5/d1c/c73 0 2024-09-21T00:56:43.918 INFO:tasks.workunit.client.1.smithi187.stdout:3/737: mkdir d9/d7f/df5 0 2024-09-21T00:56:43.921 INFO:tasks.workunit.client.1.smithi187.stdout:8/845: mkdir dc/d2f/d80/db8/d122 0 2024-09-21T00:56:43.921 INFO:tasks.workunit.client.1.smithi187.stdout:8/846: fsync dc/d44/f5a 0 2024-09-21T00:56:43.922 INFO:tasks.workunit.client.1.smithi187.stdout:3/738: symlink d9/d7f/dcb/d9c/lf6 0 2024-09-21T00:56:43.923 INFO:tasks.workunit.client.1.smithi187.stdout:4/839: link d2/d3/da/d2f/d32/d22/d37/d51/c55 d2/d3/da/d2f/d4b/daf/cfa 0 2024-09-21T00:56:43.925 INFO:tasks.workunit.client.1.smithi187.stdout:6/815: write d7/d2a/d29/f48 [973169,127055] 0 2024-09-21T00:56:43.925 INFO:tasks.workunit.client.0.smithi112.stdout:4/333: getdents d1/d5/d1c/d6c 0 2024-09-21T00:56:43.926 INFO:tasks.workunit.client.1.smithi187.stdout:0/742: dwrite d0/d17/d1c/d23/df/f7f [0,4194304] 0 2024-09-21T00:56:43.926 INFO:tasks.workunit.client.1.smithi187.stdout:6/816: chown d7/d2a/d29/d40/d50/c9a 37105167 1 2024-09-21T00:56:43.927 INFO:tasks.workunit.client.1.smithi187.stdout:8/847: creat dc/d2f/d80/db8/f123 x:0 0 0 2024-09-21T00:56:43.928 INFO:tasks.workunit.client.0.smithi112.stdout:4/334: dread d1/d7/f39 [0,4194304] 0 2024-09-21T00:56:43.930 INFO:tasks.workunit.client.0.smithi112.stdout:7/224: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:43.931 INFO:tasks.workunit.client.0.smithi112.stdout:4/335: write d1/d7/d9/f61 [3212532,112825] 0 2024-09-21T00:56:43.934 INFO:tasks.workunit.client.1.smithi187.stdout:2/874: rename d2/da8/d6c/db8/d40/d75/cf5 to d2/dc/d2e/d51/c134 0 2024-09-21T00:56:43.941 INFO:tasks.workunit.client.0.smithi112.stdout:7/225: dwrite d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:43.942 INFO:tasks.workunit.client.0.smithi112.stdout:1/189: rmdir d5 39 2024-09-21T00:56:43.945 INFO:tasks.workunit.client.1.smithi187.stdout:8/848: creat dc/d2f/d54/d69/de8/f124 x:0 0 0 2024-09-21T00:56:43.946 INFO:tasks.workunit.client.0.smithi112.stdout:5/129: creat d8/f24 x:0 0 0 2024-09-21T00:56:43.947 INFO:tasks.workunit.client.0.smithi112.stdout:5/130: fsync d8/d9/de/f12 0 2024-09-21T00:56:43.947 INFO:tasks.workunit.client.0.smithi112.stdout:5/131: chown d8/d9 2839330 1 2024-09-21T00:56:43.948 INFO:tasks.workunit.client.1.smithi187.stdout:2/875: dread d2/d3/d15/dfe/d2d/d8f/d9f/fa2 [0,4194304] 0 2024-09-21T00:56:43.948 INFO:tasks.workunit.client.1.smithi187.stdout:4/840: unlink d2/d3/da/d16/d5f/l6b 0 2024-09-21T00:56:43.949 INFO:tasks.workunit.client.1.smithi187.stdout:2/876: chown d2/da8/d6c/d97/da1/fa4 374 1 2024-09-21T00:56:43.950 INFO:tasks.workunit.client.1.smithi187.stdout:1/900: rename d4/d6/d23/d2e/d94/d35/d4c/fa7 to d4/d6/d23/d2e/d94/d6c/d11c/f122 0 2024-09-21T00:56:43.953 INFO:tasks.workunit.client.0.smithi112.stdout:1/190: dread - d5/d8/d14/f3b zero size 2024-09-21T00:56:43.953 INFO:tasks.workunit.client.0.smithi112.stdout:1/191: dread - d5/f33 zero size 2024-09-21T00:56:43.955 INFO:tasks.workunit.client.1.smithi187.stdout:0/743: creat d0/d17/d18/d90/d98/ddd/ffd x:0 0 0 2024-09-21T00:56:43.957 INFO:tasks.workunit.client.0.smithi112.stdout:7/226: symlink d0/d2/l40 0 2024-09-21T00:56:43.959 INFO:tasks.workunit.client.0.smithi112.stdout:4/336: creat d1/d5/f74 x:0 0 0 2024-09-21T00:56:43.961 INFO:tasks.workunit.client.1.smithi187.stdout:4/841: readlink d2/d3/da/d2f/d32/d24/dcd/lea 0 2024-09-21T00:56:43.962 INFO:tasks.workunit.client.0.smithi112.stdout:3/312: write d2/d8/d28/f31 [270184,75366] 0 2024-09-21T00:56:43.963 INFO:tasks.workunit.client.0.smithi112.stdout:3/313: truncate d2/d8/d28/f41 4602207 0 2024-09-21T00:56:43.964 INFO:tasks.workunit.client.1.smithi187.stdout:2/877: creat d2/dc/d2e/d4a/d7c/d52/da3/de6/f135 x:0 0 0 2024-09-21T00:56:43.965 INFO:tasks.workunit.client.0.smithi112.stdout:7/227: symlink d0/d2/d36/d39/d1a/d23/l41 0 2024-09-21T00:56:43.967 INFO:tasks.workunit.client.1.smithi187.stdout:1/901: creat d4/d6/d23/d2e/d94/d35/d4c/df7/f123 x:0 0 0 2024-09-21T00:56:43.967 INFO:tasks.workunit.client.0.smithi112.stdout:1/192: mknod d5/d8/d13/d3e/c41 0 2024-09-21T00:56:43.967 INFO:tasks.workunit.client.0.smithi112.stdout:9/252: fsync d5/d6/d19/f2a 0 2024-09-21T00:56:43.968 INFO:tasks.workunit.client.1.smithi187.stdout:1/902: write d4/d6/d23/d2e/d94/d35/d22/d2c/f30 [3941398,128157] 0 2024-09-21T00:56:43.968 INFO:tasks.workunit.client.0.smithi112.stdout:1/193: write d5/d8/f3d [50903,15703] 0 2024-09-21T00:56:43.970 INFO:tasks.workunit.client.0.smithi112.stdout:5/132: link f3 d8/d9/f25 0 2024-09-21T00:56:43.976 INFO:tasks.workunit.client.1.smithi187.stdout:2/878: mknod d2/dc/d2e/d4a/d7c/d52/da3/c136 0 2024-09-21T00:56:43.976 INFO:tasks.workunit.client.1.smithi187.stdout:0/744: dread d0/d17/d18/d90/dd1/fe9 [0,4194304] 0 2024-09-21T00:56:43.979 INFO:tasks.workunit.client.1.smithi187.stdout:1/903: creat d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/f124 x:0 0 0 2024-09-21T00:56:43.980 INFO:tasks.workunit.client.1.smithi187.stdout:6/817: getdents d7/d2a/da2 0 2024-09-21T00:56:43.981 INFO:tasks.workunit.client.1.smithi187.stdout:8/849: creat dc/d44/f125 x:0 0 0 2024-09-21T00:56:43.981 INFO:tasks.workunit.client.1.smithi187.stdout:7/732: dwrite d1/f9 [4194304,4194304] 0 2024-09-21T00:56:43.983 INFO:tasks.workunit.client.1.smithi187.stdout:6/818: chown d7/d2a/d29/d40/d50/d68/dcf 8 1 2024-09-21T00:56:43.984 INFO:tasks.workunit.client.1.smithi187.stdout:2/879: creat d2/da8/d3f/f137 x:0 0 0 2024-09-21T00:56:43.986 INFO:tasks.workunit.client.1.smithi187.stdout:4/842: creat d2/d3/da/d2f/d32/d22/ffb x:0 0 0 2024-09-21T00:56:43.987 INFO:tasks.workunit.client.1.smithi187.stdout:1/904: creat d4/d6/d23/d2e/d94/d35/d4c/df7/f125 x:0 0 0 2024-09-21T00:56:43.990 INFO:tasks.workunit.client.1.smithi187.stdout:6/819: creat d7/d2a/d29/d40/d50/d83/f112 x:0 0 0 2024-09-21T00:56:43.994 INFO:tasks.workunit.client.1.smithi187.stdout:7/733: write d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/fdb [116238,30260] 0 2024-09-21T00:56:43.996 INFO:tasks.workunit.client.1.smithi187.stdout:6/820: chown d7/d2a/d29/d40/l51 54 1 2024-09-21T00:56:43.997 INFO:tasks.workunit.client.1.smithi187.stdout:4/843: dwrite d2/d3/da/d2f/d32/d26/f44 [0,4194304] 0 2024-09-21T00:56:43.999 INFO:tasks.workunit.client.1.smithi187.stdout:8/850: dwrite dc/d2f/d80/db8/dba/d29/f91 [0,4194304] 0 2024-09-21T00:56:44.000 INFO:tasks.workunit.client.1.smithi187.stdout:7/734: chown d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d5d 322973645 1 2024-09-21T00:56:44.001 INFO:tasks.workunit.client.1.smithi187.stdout:1/905: dwrite d4/d6/d23/d2e/d94/d35/d22/f46 [4194304,4194304] 0 2024-09-21T00:56:44.003 INFO:tasks.workunit.client.1.smithi187.stdout:4/844: creat d2/d3/da/d2f/ffc x:0 0 0 2024-09-21T00:56:44.004 INFO:tasks.workunit.client.1.smithi187.stdout:9/955: write d4/d13/fe3 [272724,111694] 0 2024-09-21T00:56:44.008 INFO:tasks.workunit.client.1.smithi187.stdout:5/750: write d0/dc/d1f/d26/d8b/fd1 [4557149,11343] 0 2024-09-21T00:56:44.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:43 smithi112 ceph-mon[28078]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:44.010 INFO:tasks.workunit.client.1.smithi187.stdout:9/956: write d4/d10/f4a [5084853,16836] 0 2024-09-21T00:56:44.012 INFO:tasks.workunit.client.1.smithi187.stdout:8/851: symlink dc/d11f/l126 0 2024-09-21T00:56:44.016 INFO:tasks.workunit.client.1.smithi187.stdout:1/906: dwrite d4/d6/d23/d2e/f10c [0,4194304] 0 2024-09-21T00:56:44.018 INFO:tasks.workunit.client.1.smithi187.stdout:9/957: write d4/d8/d46/d54/d10f/d121/d94/fd5 [1252179,85844] 0 2024-09-21T00:56:44.026 INFO:tasks.workunit.client.1.smithi187.stdout:8/852: getdents dc/d2f 0 2024-09-21T00:56:44.026 INFO:tasks.workunit.client.1.smithi187.stdout:1/907: mknod d4/d6/d23/d2e/d53/c126 0 2024-09-21T00:56:44.028 INFO:tasks.workunit.client.1.smithi187.stdout:3/739: dwrite f2 [0,4194304] 0 2024-09-21T00:56:44.030 INFO:tasks.workunit.client.1.smithi187.stdout:5/751: dwrite d0/dc/daa/d67/d14/d38/fcd [0,4194304] 0 2024-09-21T00:56:44.030 INFO:tasks.workunit.client.1.smithi187.stdout:8/853: read - dc/d2f/d80/db8/dba/dc7/f111 zero size 2024-09-21T00:56:44.031 INFO:tasks.workunit.client.1.smithi187.stdout:9/958: rename d4/d13/d14/d83/ca7 to d4/d8/d46/d54/d10f/d121/d94/dde/d102/c142 0 2024-09-21T00:56:44.035 INFO:tasks.workunit.client.1.smithi187.stdout:3/740: fsync d9/f37 0 2024-09-21T00:56:44.038 INFO:tasks.workunit.client.1.smithi187.stdout:9/959: symlink d4/d13/d14/d28/db4/l143 0 2024-09-21T00:56:44.040 INFO:tasks.workunit.client.1.smithi187.stdout:9/960: chown d4/d10/d8f/de6/f10b 1685107 1 2024-09-21T00:56:44.041 INFO:tasks.workunit.client.1.smithi187.stdout:5/752: mknod d0/dc/daa/d67/dcc/de5/dea/cf5 0 2024-09-21T00:56:44.043 INFO:tasks.workunit.client.1.smithi187.stdout:8/854: rename dc/d2f/c35 to dc/d94/dfb/c127 0 2024-09-21T00:56:44.043 INFO:tasks.workunit.client.1.smithi187.stdout:6/821: dread d7/d2a/fa7 [0,4194304] 0 2024-09-21T00:56:44.044 INFO:tasks.workunit.client.1.smithi187.stdout:6/822: dread - d7/d2a/ffb zero size 2024-09-21T00:56:44.045 INFO:tasks.workunit.client.1.smithi187.stdout:0/745: write d0/d17/d1c/d65/fe8 [608930,45348] 0 2024-09-21T00:56:44.046 INFO:tasks.workunit.client.1.smithi187.stdout:0/746: readlink d0/l4d 0 2024-09-21T00:56:44.050 INFO:tasks.workunit.client.1.smithi187.stdout:5/753: fdatasync d0/dc/daa/d67/d14/d38/d5a/d6c/db7/fe3 0 2024-09-21T00:56:44.052 INFO:tasks.workunit.client.1.smithi187.stdout:4/845: dread d2/d3/da/d2f/d32/d22/d37/d3a/f8d [0,4194304] 0 2024-09-21T00:56:44.052 INFO:tasks.workunit.client.1.smithi187.stdout:3/741: creat d9/d19/ff7 x:0 0 0 2024-09-21T00:56:44.054 INFO:tasks.workunit.client.0.smithi112.stdout:3/314: truncate d2/d8/f16 926124 0 2024-09-21T00:56:44.055 INFO:tasks.workunit.client.1.smithi187.stdout:7/735: write d1/dc/d15/fa1 [181093,69986] 0 2024-09-21T00:56:44.055 INFO:tasks.workunit.client.0.smithi112.stdout:6/264: symlink d9/l66 0 2024-09-21T00:56:44.055 INFO:tasks.workunit.client.1.smithi187.stdout:2/880: dwrite d2/da8/d6c/d97/da1/fd0 [0,4194304] 0 2024-09-21T00:56:44.056 INFO:tasks.workunit.client.0.smithi112.stdout:9/253: creat d5/d6/de/d13/f50 x:0 0 0 2024-09-21T00:56:44.057 INFO:tasks.workunit.client.0.smithi112.stdout:0/245: truncate d8/f18 3757697 0 2024-09-21T00:56:44.057 INFO:tasks.workunit.client.1.smithi187.stdout:3/742: unlink d9/d7f/fae 0 2024-09-21T00:56:44.059 INFO:tasks.workunit.client.1.smithi187.stdout:0/747: rename d0/f16 to d0/d60/ffe 0 2024-09-21T00:56:44.061 INFO:tasks.workunit.client.0.smithi112.stdout:5/133: rename d8/d9/d13/f16 to d8/d9/de/f26 0 2024-09-21T00:56:44.062 INFO:tasks.workunit.client.1.smithi187.stdout:6/823: getdents d7/d2a/d29/d40/d6a/d9e 0 2024-09-21T00:56:44.062 INFO:tasks.workunit.client.0.smithi112.stdout:1/194: dwrite d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:44.063 INFO:tasks.workunit.client.1.smithi187.stdout:6/824: fsync d7/d2a/d29/d40/d45/f5a 0 2024-09-21T00:56:44.065 INFO:tasks.workunit.client.1.smithi187.stdout:5/754: mknod d0/dc/daa/d67/d14/d38/d5a/d6c/db7/cf6 0 2024-09-21T00:56:44.065 INFO:tasks.workunit.client.0.smithi112.stdout:9/254: dread d5/f14 [4194304,4194304] 0 2024-09-21T00:56:44.069 INFO:tasks.workunit.client.1.smithi187.stdout:4/846: creat d2/d3/d56/d84/d60/d6c/d77/ffd x:0 0 0 2024-09-21T00:56:44.072 INFO:tasks.workunit.client.1.smithi187.stdout:2/881: unlink d2/dc/d2e/d51/dc5/ddf/d10a/d11e/c130 0 2024-09-21T00:56:44.075 INFO:tasks.workunit.client.0.smithi112.stdout:0/246: creat d8/d11/d28/f4e x:0 0 0 2024-09-21T00:56:44.077 INFO:tasks.workunit.client.1.smithi187.stdout:8/855: dread dc/f24 [0,4194304] 0 2024-09-21T00:56:44.078 INFO:tasks.workunit.client.1.smithi187.stdout:7/736: symlink d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/lfc 0 2024-09-21T00:56:44.078 INFO:tasks.workunit.client.1.smithi187.stdout:1/908: dwrite d4/d6/d23/d2e/d53/fea [0,4194304] 0 2024-09-21T00:56:44.079 INFO:tasks.workunit.client.1.smithi187.stdout:9/961: write d4/d13/fca [526653,68561] 0 2024-09-21T00:56:44.080 INFO:tasks.workunit.client.1.smithi187.stdout:1/909: fdatasync d4/d86/f8e 0 2024-09-21T00:56:44.081 INFO:tasks.workunit.client.0.smithi112.stdout:7/228: creat d0/f42 x:0 0 0 2024-09-21T00:56:44.082 INFO:tasks.workunit.client.1.smithi187.stdout:1/910: fdatasync d4/d6/d23/d2e/d53/f7f 0 2024-09-21T00:56:44.083 INFO:tasks.workunit.client.0.smithi112.stdout:0/247: dwrite d8/d11/d28/f4e [0,4194304] 0 2024-09-21T00:56:44.083 INFO:tasks.workunit.client.1.smithi187.stdout:1/911: chown d4/d6/d23/d2e/d94/d35/d79/lf3 156 1 2024-09-21T00:56:44.084 INFO:tasks.workunit.client.0.smithi112.stdout:0/248: chown l5 3 1 2024-09-21T00:56:44.087 INFO:tasks.workunit.client.0.smithi112.stdout:9/255: mkdir d5/d6/d19/d51 0 2024-09-21T00:56:44.089 INFO:tasks.workunit.client.0.smithi112.stdout:3/315: dread d2/d8/dd/f2e [0,4194304] 0 2024-09-21T00:56:44.091 INFO:tasks.workunit.client.0.smithi112.stdout:3/316: read d2/d8/f5b [183338,23722] 0 2024-09-21T00:56:44.094 INFO:tasks.workunit.client.1.smithi187.stdout:2/882: symlink d2/dc/d2e/d4a/l138 0 2024-09-21T00:56:44.099 INFO:tasks.workunit.client.1.smithi187.stdout:8/856: creat dc/d44/dc1/f128 x:0 0 0 2024-09-21T00:56:44.103 INFO:tasks.workunit.client.0.smithi112.stdout:0/249: creat d8/d1b/f4f x:0 0 0 2024-09-21T00:56:44.106 INFO:tasks.workunit.client.1.smithi187.stdout:5/755: creat d0/dc/d1f/df4/ff7 x:0 0 0 2024-09-21T00:56:44.107 INFO:tasks.workunit.client.1.smithi187.stdout:3/743: dread d9/f6b [0,4194304] 0 2024-09-21T00:56:44.109 INFO:tasks.workunit.client.0.smithi112.stdout:3/317: mknod d2/d38/d3f/d53/c63 0 2024-09-21T00:56:44.109 INFO:tasks.workunit.client.1.smithi187.stdout:6/825: dread d7/f8e [0,4194304] 0 2024-09-21T00:56:44.109 INFO:tasks.workunit.client.1.smithi187.stdout:2/883: dread - d2/da8/d6c/db8/d40/fcf zero size 2024-09-21T00:56:44.111 INFO:tasks.workunit.client.0.smithi112.stdout:3/318: rename d2/d8/dd/de/d4a to d2/d8/dd/de/d4a/d64 22 2024-09-21T00:56:44.111 INFO:tasks.workunit.client.0.smithi112.stdout:5/134: creat d8/d9/f27 x:0 0 0 2024-09-21T00:56:44.113 INFO:tasks.workunit.client.1.smithi187.stdout:4/847: dread d2/d3/da/d2f/d32/d22/f3d [8388608,4194304] 0 2024-09-21T00:56:44.114 INFO:tasks.workunit.client.0.smithi112.stdout:1/195: rmdir d5/d8/d14/d32 0 2024-09-21T00:56:44.114 INFO:tasks.workunit.client.1.smithi187.stdout:1/912: dread d4/d86/f8e [0,4194304] 0 2024-09-21T00:56:44.115 INFO:tasks.workunit.client.0.smithi112.stdout:1/196: truncate d5/d3a/f40 587139 0 2024-09-21T00:56:44.115 INFO:tasks.workunit.client.1.smithi187.stdout:0/748: rename d0/d17/d1c/d23/d36/fba to d0/d17/d1c/fff 0 2024-09-21T00:56:44.116 INFO:tasks.workunit.client.0.smithi112.stdout:7/229: creat d0/d2/d38/f43 x:0 0 0 2024-09-21T00:56:44.117 INFO:tasks.workunit.client.1.smithi187.stdout:9/962: symlink d4/d8/d46/d54/d10f/d121/d94/d122/d128/l144 0 2024-09-21T00:56:44.119 INFO:tasks.workunit.client.1.smithi187.stdout:3/744: mkdir d9/d7f/dcb/d9c/df8 0 2024-09-21T00:56:44.120 INFO:tasks.workunit.client.1.smithi187.stdout:3/745: stat d9/d19/d43/c6a 0 2024-09-21T00:56:44.120 INFO:tasks.workunit.client.0.smithi112.stdout:3/319: symlink d2/d8/dd/de/d5c/l65 0 2024-09-21T00:56:44.120 INFO:tasks.workunit.client.0.smithi112.stdout:9/256: dread d5/d6/de/f31 [0,4194304] 0 2024-09-21T00:56:44.122 INFO:tasks.workunit.client.0.smithi112.stdout:9/257: truncate d5/f4b 975977 0 2024-09-21T00:56:44.122 INFO:tasks.workunit.client.1.smithi187.stdout:6/826: unlink d7/d2a/d29/d40/d45/fa5 0 2024-09-21T00:56:44.125 INFO:tasks.workunit.client.0.smithi112.stdout:3/320: fsync d2/d8/d28/f26 0 2024-09-21T00:56:44.127 INFO:tasks.workunit.client.1.smithi187.stdout:7/737: rename d1/dce/dd0/d97/df1/d31/d41/d64/faa to d1/dce/dd4/ffd 0 2024-09-21T00:56:44.127 INFO:tasks.workunit.client.0.smithi112.stdout:3/321: read d2/d38/d3f/f49 [3063399,9844] 0 2024-09-21T00:56:44.132 INFO:tasks.workunit.client.1.smithi187.stdout:6/827: dread d7/d2a/d29/fc2 [0,4194304] 0 2024-09-21T00:56:44.133 INFO:tasks.workunit.client.1.smithi187.stdout:6/828: readlink d7/d2a/l107 0 2024-09-21T00:56:44.134 INFO:tasks.workunit.client.0.smithi112.stdout:0/250: link d8/d11/f1e d8/d1b/d2c/d2e/d4c/f50 0 2024-09-21T00:56:44.140 INFO:tasks.workunit.client.0.smithi112.stdout:5/135: creat d8/d9/f28 x:0 0 0 2024-09-21T00:56:44.141 INFO:tasks.workunit.client.1.smithi187.stdout:8/857: dread - dc/d2f/d34/f7c zero size 2024-09-21T00:56:44.142 INFO:tasks.workunit.client.0.smithi112.stdout:3/322: creat d2/d3e/f66 x:0 0 0 2024-09-21T00:56:44.143 INFO:tasks.workunit.client.0.smithi112.stdout:3/323: truncate d2/d38/d3f/f60 753584 0 2024-09-21T00:56:44.146 INFO:tasks.workunit.client.1.smithi187.stdout:9/963: write d4/d10/d43/f76 [2565635,76157] 0 2024-09-21T00:56:44.147 INFO:tasks.workunit.client.1.smithi187.stdout:1/913: creat d4/d6/d23/d2e/d94/d35/d22/dcd/d112/f127 x:0 0 0 2024-09-21T00:56:44.148 INFO:tasks.workunit.client.0.smithi112.stdout:7/230: creat d0/d2/d36/d39/d1a/f44 x:0 0 0 2024-09-21T00:56:44.149 INFO:tasks.workunit.client.1.smithi187.stdout:9/964: write d4/d61/f10c [898399,108731] 0 2024-09-21T00:56:44.149 INFO:tasks.workunit.client.1.smithi187.stdout:7/738: symlink d1/dc/lfe 0 2024-09-21T00:56:44.149 INFO:tasks.workunit.client.0.smithi112.stdout:0/251: mknod d8/d1b/d2c/c51 0 2024-09-21T00:56:44.151 INFO:tasks.workunit.client.0.smithi112.stdout:5/136: rename d8/cb to d8/d9/d13/d1c/c29 0 2024-09-21T00:56:44.151 INFO:tasks.workunit.client.0.smithi112.stdout:5/137: read - d8/f24 zero size 2024-09-21T00:56:44.152 INFO:tasks.workunit.client.1.smithi187.stdout:0/749: dwrite d0/d17/d1c/d65/f9d [0,4194304] 0 2024-09-21T00:56:44.153 INFO:tasks.workunit.client.0.smithi112.stdout:3/324: symlink d2/d3e/l67 0 2024-09-21T00:56:44.154 INFO:tasks.workunit.client.0.smithi112.stdout:1/197: link d5/d8/d10/f16 d5/d34/f42 0 2024-09-21T00:56:44.155 INFO:tasks.workunit.client.1.smithi187.stdout:3/746: creat d9/d7f/dcb/d87/d94/d53/d56/d61/ded/ff9 x:0 0 0 2024-09-21T00:56:44.155 INFO:tasks.workunit.client.0.smithi112.stdout:3/325: write d2/d33/f56 [611415,77824] 0 2024-09-21T00:56:44.156 INFO:tasks.workunit.client.1.smithi187.stdout:5/756: dwrite d0/dc/daa/d67/d14/d38/f5b [0,4194304] 0 2024-09-21T00:56:44.157 INFO:tasks.workunit.client.0.smithi112.stdout:7/231: creat d0/d2/d36/f45 x:0 0 0 2024-09-21T00:56:44.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:43 smithi187 ceph-mon[34997]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:44.161 INFO:tasks.workunit.client.1.smithi187.stdout:1/914: dwrite d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/ffe [0,4194304] 0 2024-09-21T00:56:44.162 INFO:tasks.workunit.client.0.smithi112.stdout:9/258: getdents d5 0 2024-09-21T00:56:44.163 INFO:tasks.workunit.client.0.smithi112.stdout:9/259: chown d5/d6/d19/d1b/f40 2 1 2024-09-21T00:56:44.164 INFO:tasks.workunit.client.1.smithi187.stdout:4/848: link d2/d3/d56/d84/d60/d6c/d77/fae d2/d3/da/d2f/d4b/d7e/dc8/d89/ffe 0 2024-09-21T00:56:44.165 INFO:tasks.workunit.client.0.smithi112.stdout:5/138: truncate d8/fa 3882784 0 2024-09-21T00:56:44.166 INFO:tasks.workunit.client.0.smithi112.stdout:5/139: chown d8/d9/d13/d1c 4081 1 2024-09-21T00:56:44.168 INFO:tasks.workunit.client.0.smithi112.stdout:1/198: creat d5/f43 x:0 0 0 2024-09-21T00:56:44.168 INFO:tasks.workunit.client.0.smithi112.stdout:9/260: read d5/f14 [2516870,109446] 0 2024-09-21T00:56:44.169 INFO:tasks.workunit.client.0.smithi112.stdout:1/199: truncate d5/f33 406358 0 2024-09-21T00:56:44.170 INFO:tasks.workunit.client.1.smithi187.stdout:1/915: dwrite d4/d6/d23/f2b [0,4194304] 0 2024-09-21T00:56:44.170 INFO:tasks.workunit.client.0.smithi112.stdout:3/326: rename d2/c57 to d2/d3e/c68 0 2024-09-21T00:56:44.173 INFO:tasks.workunit.client.1.smithi187.stdout:9/965: creat d4/d8/d46/d54/d10f/d121/dbf/ddd/f145 x:0 0 0 2024-09-21T00:56:44.174 INFO:tasks.workunit.client.1.smithi187.stdout:6/829: dwrite d7/d2a/d29/d94/f98 [0,4194304] 0 2024-09-21T00:56:44.174 INFO:tasks.workunit.client.0.smithi112.stdout:0/252: mknod d8/d11/c52 0 2024-09-21T00:56:44.175 INFO:tasks.workunit.client.0.smithi112.stdout:0/253: chown d8/d11/c3f 1870821961 1 2024-09-21T00:56:44.177 INFO:tasks.workunit.client.0.smithi112.stdout:7/232: dwrite d0/d2/d36/d39/d1a/f1f [0,4194304] 0 2024-09-21T00:56:44.181 INFO:tasks.workunit.client.1.smithi187.stdout:7/739: mkdir d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/dea/dff 0 2024-09-21T00:56:44.181 INFO:tasks.workunit.client.0.smithi112.stdout:1/200: creat d5/d8/d10/d2e/f44 x:0 0 0 2024-09-21T00:56:44.182 INFO:tasks.workunit.client.0.smithi112.stdout:3/327: symlink d2/d8/dd/de/d4a/l69 0 2024-09-21T00:56:44.183 INFO:tasks.workunit.client.1.smithi187.stdout:1/916: dwrite d4/d6/d23/d2e/d53/fea [0,4194304] 0 2024-09-21T00:56:44.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/328: chown d2/d8/dd/f10 2457636 1 2024-09-21T00:56:44.188 INFO:tasks.workunit.client.1.smithi187.stdout:2/884: getdents d2/d3/d15/dfe/d2d/d8f/d9f/d8c 0 2024-09-21T00:56:44.189 INFO:tasks.workunit.client.0.smithi112.stdout:0/254: dwrite d8/d1b/d2c/f30 [0,4194304] 0 2024-09-21T00:56:44.190 INFO:tasks.workunit.client.1.smithi187.stdout:8/858: rename dc/d2f/d80/db8/dba/l40 to dc/d2f/d34/d4b/l129 0 2024-09-21T00:56:44.193 INFO:tasks.workunit.client.0.smithi112.stdout:7/233: dwrite d0/f42 [0,4194304] 0 2024-09-21T00:56:44.195 INFO:tasks.workunit.client.0.smithi112.stdout:9/261: getdents d5/d6/d19/d51 0 2024-09-21T00:56:44.197 INFO:tasks.workunit.client.0.smithi112.stdout:9/262: fsync d5/d6/d19/f1d 0 2024-09-21T00:56:44.200 INFO:tasks.workunit.client.0.smithi112.stdout:9/263: fdatasync d5/f20 0 2024-09-21T00:56:44.201 INFO:tasks.workunit.client.0.smithi112.stdout:0/255: write d8/f3c [720992,7083] 0 2024-09-21T00:56:44.203 INFO:tasks.workunit.client.0.smithi112.stdout:9/264: write d5/f49 [42942,2964] 0 2024-09-21T00:56:44.203 INFO:tasks.workunit.client.1.smithi187.stdout:0/750: mkdir d0/d17/d1c/d23/df/dca/d100 0 2024-09-21T00:56:44.204 INFO:tasks.workunit.client.0.smithi112.stdout:0/256: dread - d8/d1b/f4f zero size 2024-09-21T00:56:44.207 INFO:tasks.workunit.client.0.smithi112.stdout:3/329: dwrite d2/d8/d28/d35/f51 [0,4194304] 0 2024-09-21T00:56:44.207 INFO:tasks.workunit.client.1.smithi187.stdout:6/830: mkdir d7/d2a/d29/d40/d6a/d9e/d113 0 2024-09-21T00:56:44.209 INFO:tasks.workunit.client.0.smithi112.stdout:7/234: dread d0/f42 [0,4194304] 0 2024-09-21T00:56:44.210 INFO:tasks.workunit.client.1.smithi187.stdout:1/917: creat d4/d6/d23/d2e/d94/d35/d22/d65/f128 x:0 0 0 2024-09-21T00:56:44.212 INFO:tasks.workunit.client.0.smithi112.stdout:1/201: mknod d5/d8/c45 0 2024-09-21T00:56:44.213 INFO:tasks.workunit.client.1.smithi187.stdout:9/966: dread d4/d8/d41/fa6 [4194304,4194304] 0 2024-09-21T00:56:44.216 INFO:tasks.workunit.client.0.smithi112.stdout:0/257: rename d8/d1b/l3d to d8/d11/d28/l53 0 2024-09-21T00:56:44.216 INFO:tasks.workunit.client.0.smithi112.stdout:0/258: chown d8/d1b/f4f 7 1 2024-09-21T00:56:44.217 INFO:tasks.workunit.client.1.smithi187.stdout:8/859: mkdir dc/d2f/d80/db8/dba/d29/d12a 0 2024-09-21T00:56:44.219 INFO:tasks.workunit.client.1.smithi187.stdout:6/831: rmdir d7 39 2024-09-21T00:56:44.220 INFO:tasks.workunit.client.0.smithi112.stdout:1/202: dwrite d5/f33 [0,4194304] 0 2024-09-21T00:56:44.225 INFO:tasks.workunit.client.0.smithi112.stdout:0/259: mkdir d8/d11/d28/d54 0 2024-09-21T00:56:44.225 INFO:tasks.workunit.client.0.smithi112.stdout:8/138: sync 2024-09-21T00:56:44.225 INFO:tasks.workunit.client.0.smithi112.stdout:0/260: read - d8/f31 zero size 2024-09-21T00:56:44.225 INFO:tasks.workunit.client.0.smithi112.stdout:1/203: mkdir d5/d8/d13/d3e/d46 0 2024-09-21T00:56:44.227 INFO:tasks.workunit.client.1.smithi187.stdout:3/747: dread d9/d7f/dcb/fe9 [0,4194304] 0 2024-09-21T00:56:44.228 INFO:tasks.workunit.client.0.smithi112.stdout:8/139: mknod d0/c28 0 2024-09-21T00:56:44.228 INFO:tasks.workunit.client.1.smithi187.stdout:3/748: chown d9 2471388 1 2024-09-21T00:56:44.230 INFO:tasks.workunit.client.0.smithi112.stdout:9/265: dread d5/d6/d19/d1b/f40 [0,4194304] 0 2024-09-21T00:56:44.232 INFO:tasks.workunit.client.1.smithi187.stdout:4/849: rename d2/d3/da/d2f/d32/d24/dcd/la5 to d2/lff 0 2024-09-21T00:56:44.233 INFO:tasks.workunit.client.0.smithi112.stdout:7/235: getdents d0/d2/d32 0 2024-09-21T00:56:44.234 INFO:tasks.workunit.client.1.smithi187.stdout:7/740: getdents d1/dce/dd0/d97/df1/d31 0 2024-09-21T00:56:44.234 INFO:tasks.workunit.client.0.smithi112.stdout:8/140: dwrite d0/fb [0,4194304] 0 2024-09-21T00:56:44.234 INFO:tasks.workunit.client.0.smithi112.stdout:0/261: truncate d8/d1b/d2c/d2e/d4c/f50 337103 0 2024-09-21T00:56:44.235 INFO:tasks.workunit.client.0.smithi112.stdout:9/266: dread d5/d6/d19/d1b/f40 [0,4194304] 0 2024-09-21T00:56:44.236 INFO:tasks.workunit.client.1.smithi187.stdout:1/918: creat d4/d6/d23/d2e/d94/d35/f129 x:0 0 0 2024-09-21T00:56:44.237 INFO:tasks.workunit.client.1.smithi187.stdout:1/919: chown d4/d86 32732 1 2024-09-21T00:56:44.237 INFO:tasks.workunit.client.1.smithi187.stdout:6/832: dwrite d7/d2a/d7a/f105 [0,4194304] 0 2024-09-21T00:56:44.239 INFO:tasks.workunit.client.1.smithi187.stdout:3/749: creat d9/d7f/dcb/d87/d94/d53/d56/d61/ffa x:0 0 0 2024-09-21T00:56:44.240 INFO:tasks.workunit.client.0.smithi112.stdout:7/236: write d0/f22 [1754087,109422] 0 2024-09-21T00:56:44.241 INFO:tasks.workunit.client.1.smithi187.stdout:0/751: rename d0/d17/d1c/d23/d36/fa4 to d0/d60/d6e/f101 0 2024-09-21T00:56:44.246 INFO:tasks.workunit.client.0.smithi112.stdout:1/204: link d5/d8/c26 d5/d8/d10/c47 0 2024-09-21T00:56:44.248 INFO:tasks.workunit.client.0.smithi112.stdout:8/141: link d0/f1a d0/d13/f29 0 2024-09-21T00:56:44.250 INFO:tasks.workunit.client.1.smithi187.stdout:1/920: mkdir d4/d6/d23/d2e/d94/d66/ddf/d12a 0 2024-09-21T00:56:44.250 INFO:tasks.workunit.client.0.smithi112.stdout:1/205: truncate d5/d8/d10/d2e/f44 882005 0 2024-09-21T00:56:44.251 INFO:tasks.workunit.client.1.smithi187.stdout:0/752: dwrite d0/d17/d1c/d23/df/f7f [0,4194304] 0 2024-09-21T00:56:44.251 INFO:tasks.workunit.client.0.smithi112.stdout:0/262: link d8/d1b/f4f d8/d11/d28/d54/f55 0 2024-09-21T00:56:44.252 INFO:tasks.workunit.client.1.smithi187.stdout:0/753: chown d0/d17/d18/d90/fbf 3953 1 2024-09-21T00:56:44.253 INFO:tasks.workunit.client.1.smithi187.stdout:0/754: chown d0/d17/d18/f24 0 1 2024-09-21T00:56:44.253 INFO:tasks.workunit.client.1.smithi187.stdout:3/750: rmdir d9/d19 39 2024-09-21T00:56:44.253 INFO:tasks.workunit.client.0.smithi112.stdout:9/267: dwrite d5/d6/d19/d1b/f40 [0,4194304] 0 2024-09-21T00:56:44.254 INFO:tasks.workunit.client.0.smithi112.stdout:0/263: dread - d8/f19 zero size 2024-09-21T00:56:44.254 INFO:tasks.workunit.client.0.smithi112.stdout:0/264: chown d8/cf 6693 1 2024-09-21T00:56:44.255 INFO:tasks.workunit.client.0.smithi112.stdout:8/142: mkdir d0/d13/d2a 0 2024-09-21T00:56:44.258 INFO:tasks.workunit.client.1.smithi187.stdout:9/967: dread d4/d13/d14/d1d/f63 [0,4194304] 0 2024-09-21T00:56:44.259 INFO:tasks.workunit.client.1.smithi187.stdout:8/860: dread dc/f49 [0,4194304] 0 2024-09-21T00:56:44.259 INFO:tasks.workunit.client.1.smithi187.stdout:9/968: readlink d4/d8/lf 0 2024-09-21T00:56:44.262 INFO:tasks.workunit.client.0.smithi112.stdout:0/265: rename d8/cf to d8/d1b/d2c/d2e/d4c/c56 0 2024-09-21T00:56:44.264 INFO:tasks.workunit.client.0.smithi112.stdout:0/266: fdatasync d8/d11/f15 0 2024-09-21T00:56:44.264 INFO:tasks.workunit.client.1.smithi187.stdout:7/741: mkdir d1/dce/dd0/d97/df1/d31/d41/d8a/d100 0 2024-09-21T00:56:44.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/140: dwrite d8/d9/de/df/f10 [0,4194304] 0 2024-09-21T00:56:44.265 INFO:tasks.workunit.client.0.smithi112.stdout:8/143: symlink d0/l2b 0 2024-09-21T00:56:44.268 INFO:tasks.workunit.client.1.smithi187.stdout:1/921: mkdir d4/d6/d23/d2e/d94/dae/d12b 0 2024-09-21T00:56:44.273 INFO:tasks.workunit.client.1.smithi187.stdout:4/850: dread d2/d3/da/d2f/d32/d24/dcd/f72 [0,4194304] 0 2024-09-21T00:56:44.274 INFO:tasks.workunit.client.0.smithi112.stdout:5/141: dwrite d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:56:44.274 INFO:tasks.workunit.client.1.smithi187.stdout:8/861: unlink dc/d11f/l126 0 2024-09-21T00:56:44.275 INFO:tasks.workunit.client.0.smithi112.stdout:5/142: chown d8/d9/de/f12 196196 1 2024-09-21T00:56:44.282 INFO:tasks.workunit.client.0.smithi112.stdout:5/143: dwrite d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:56:44.283 INFO:tasks.workunit.client.0.smithi112.stdout:8/144: mknod d0/d13/c2c 0 2024-09-21T00:56:44.285 INFO:tasks.workunit.client.1.smithi187.stdout:6/833: dread d7/f4e [0,4194304] 0 2024-09-21T00:56:44.285 INFO:tasks.workunit.client.0.smithi112.stdout:8/145: write d0/d13/d1b/f1e [285418,12986] 0 2024-09-21T00:56:44.286 INFO:tasks.workunit.client.1.smithi187.stdout:9/969: creat d4/d8/d46/d54/d10f/d121/dbf/f146 x:0 0 0 2024-09-21T00:56:44.286 INFO:tasks.workunit.client.1.smithi187.stdout:7/742: rmdir d1/dc/d15 39 2024-09-21T00:56:44.286 INFO:tasks.workunit.client.1.smithi187.stdout:0/755: mknod d0/c102 0 2024-09-21T00:56:44.286 INFO:tasks.workunit.client.1.smithi187.stdout:5/757: write d0/dc/daa/d67/d14/d1b/f24 [3478759,77216] 0 2024-09-21T00:56:44.286 INFO:tasks.workunit.client.0.smithi112.stdout:9/268: creat d5/d6/de/f52 x:0 0 0 2024-09-21T00:56:44.287 INFO:tasks.workunit.client.0.smithi112.stdout:9/269: read d5/d6/de/f2e [3677338,130590] 0 2024-09-21T00:56:44.288 INFO:tasks.workunit.client.1.smithi187.stdout:2/885: write d2/dc/d2e/d4a/fc0 [933519,99140] 0 2024-09-21T00:56:44.288 INFO:tasks.workunit.client.0.smithi112.stdout:3/330: write d2/d8/dd/de/f18 [1469882,44261] 0 2024-09-21T00:56:44.289 INFO:tasks.workunit.client.1.smithi187.stdout:3/751: mknod d9/d7f/dcb/d9c/df8/cfb 0 2024-09-21T00:56:44.289 INFO:tasks.workunit.client.1.smithi187.stdout:1/922: dread - d4/d6/d23/d2e/f4b zero size 2024-09-21T00:56:44.289 INFO:tasks.workunit.client.0.smithi112.stdout:9/270: write d5/f4b [1917762,63044] 0 2024-09-21T00:56:44.291 INFO:tasks.workunit.client.0.smithi112.stdout:3/331: truncate d2/d8/dd/f2e 4744923 0 2024-09-21T00:56:44.292 INFO:tasks.workunit.client.0.smithi112.stdout:0/267: creat d8/d11/d28/d54/f57 x:0 0 0 2024-09-21T00:56:44.295 INFO:tasks.workunit.client.0.smithi112.stdout:5/144: rename d8/d9/de to d8/d9/d13/d2a 0 2024-09-21T00:56:44.296 INFO:tasks.workunit.client.1.smithi187.stdout:5/758: dwrite d0/dc/daa/d67/d14/d38/d5a/fde [0,4194304] 0 2024-09-21T00:56:44.301 INFO:tasks.workunit.client.0.smithi112.stdout:8/146: mkdir d0/d13/d1b/d2d 0 2024-09-21T00:56:44.308 INFO:tasks.workunit.client.0.smithi112.stdout:8/147: dwrite d0/d13/d1b/d22/f24 [0,4194304] 0 2024-09-21T00:56:44.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/271: unlink d5/d6/de/f4a 0 2024-09-21T00:56:44.312 INFO:tasks.workunit.client.0.smithi112.stdout:0/268: rmdir d8/d11 39 2024-09-21T00:56:44.313 INFO:tasks.workunit.client.0.smithi112.stdout:5/145: rmdir d8/d9/d13 39 2024-09-21T00:56:44.320 INFO:tasks.workunit.client.0.smithi112.stdout:8/148: mkdir d0/d13/d1b/d22/d2e 0 2024-09-21T00:56:44.323 INFO:tasks.workunit.client.0.smithi112.stdout:3/332: mkdir d2/d6a 0 2024-09-21T00:56:44.325 INFO:tasks.workunit.client.0.smithi112.stdout:0/269: stat d8/d11/d28/d54 0 2024-09-21T00:56:44.330 INFO:tasks.workunit.client.0.smithi112.stdout:9/272: mknod d5/d6/d19/d51/c53 0 2024-09-21T00:56:44.332 INFO:tasks.workunit.client.0.smithi112.stdout:3/333: mkdir d2/d8/dd/de/d6b 0 2024-09-21T00:56:44.332 INFO:tasks.workunit.client.0.smithi112.stdout:3/334: dread - d2/d38/f4b zero size 2024-09-21T00:56:44.335 INFO:tasks.workunit.client.0.smithi112.stdout:5/146: unlink d8/d9/d13/d2a/df/c1d 0 2024-09-21T00:56:44.336 INFO:tasks.workunit.client.0.smithi112.stdout:5/147: dread - d8/f24 zero size 2024-09-21T00:56:44.338 INFO:tasks.workunit.client.0.smithi112.stdout:8/149: link d0/d13/d1b/d22/f23 d0/d13/d1b/d22/d2e/f2f 0 2024-09-21T00:56:44.340 INFO:tasks.workunit.client.0.smithi112.stdout:9/273: mkdir d5/d6/de/d13/d54 0 2024-09-21T00:56:44.341 INFO:tasks.workunit.client.0.smithi112.stdout:9/274: dread - d5/d6/d19/d1b/f21 zero size 2024-09-21T00:56:44.348 INFO:tasks.workunit.client.0.smithi112.stdout:9/275: read d5/d6/d19/f2a [7276636,47516] 0 2024-09-21T00:56:44.353 INFO:tasks.workunit.client.0.smithi112.stdout:9/276: dwrite d5/d6/de/f2c [0,4194304] 0 2024-09-21T00:56:44.353 INFO:tasks.workunit.client.0.smithi112.stdout:3/335: creat d2/d8/dd/de/d4a/d4c/f6c x:0 0 0 2024-09-21T00:56:44.354 INFO:tasks.workunit.client.0.smithi112.stdout:3/336: fdatasync d2/d33/f56 0 2024-09-21T00:56:44.356 INFO:tasks.workunit.client.0.smithi112.stdout:5/148: symlink d8/l2b 0 2024-09-21T00:56:44.357 INFO:tasks.workunit.client.0.smithi112.stdout:9/277: dread d5/d6/d19/f28 [0,4194304] 0 2024-09-21T00:56:44.367 INFO:tasks.workunit.client.0.smithi112.stdout:0/270: dwrite d8/d1b/d2c/d2e/d4c/f50 [0,4194304] 0 2024-09-21T00:56:44.369 INFO:tasks.workunit.client.0.smithi112.stdout:0/271: truncate d8/d1b/d2c/d2e/f39 32603 0 2024-09-21T00:56:44.370 INFO:tasks.workunit.client.0.smithi112.stdout:8/150: link d0/f1a d0/d13/d1b/f30 0 2024-09-21T00:56:44.371 INFO:tasks.workunit.client.0.smithi112.stdout:8/151: chown d0/d13/d1b/f1e 1 1 2024-09-21T00:56:44.377 INFO:tasks.workunit.client.1.smithi187.stdout:4/851: creat d2/d3/d74/d98/f100 x:0 0 0 2024-09-21T00:56:44.378 INFO:tasks.workunit.client.1.smithi187.stdout:8/862: unlink dc/d2f/d34/l9e 0 2024-09-21T00:56:44.380 INFO:tasks.workunit.client.1.smithi187.stdout:8/863: read dc/d2f/d80/db8/dba/d29/faf [294487,33267] 0 2024-09-21T00:56:44.381 INFO:tasks.workunit.client.1.smithi187.stdout:7/743: stat d1/dc/d15/d22/l25 0 2024-09-21T00:56:44.382 INFO:tasks.workunit.client.1.smithi187.stdout:6/834: unlink d7/d2a/d29/d40/f72 0 2024-09-21T00:56:44.383 INFO:tasks.workunit.client.0.smithi112.stdout:0/272: rename d8/d1b/d2c/d2e/c3e to d8/d11/d28/d54/c58 0 2024-09-21T00:56:44.384 INFO:tasks.workunit.client.1.smithi187.stdout:9/970: mknod d4/d61/d6a/d90/d11d/c147 0 2024-09-21T00:56:44.385 INFO:tasks.workunit.client.1.smithi187.stdout:9/971: write d4/d61/f68 [2532524,105986] 0 2024-09-21T00:56:44.385 INFO:tasks.workunit.client.0.smithi112.stdout:9/278: mkdir d5/d6/de/d13/d54/d55 0 2024-09-21T00:56:44.386 INFO:tasks.workunit.client.0.smithi112.stdout:9/279: chown d5/d6/de/d13/f50 22 1 2024-09-21T00:56:44.386 INFO:tasks.workunit.client.1.smithi187.stdout:9/972: chown d4/d13/d14/d1d/f11a 893 1 2024-09-21T00:56:44.387 INFO:tasks.workunit.client.1.smithi187.stdout:9/973: write d4/fcf [280332,38201] 0 2024-09-21T00:56:44.388 INFO:tasks.workunit.client.1.smithi187.stdout:9/974: write d4/f3b [1002803,84572] 0 2024-09-21T00:56:44.390 INFO:tasks.workunit.client.1.smithi187.stdout:2/886: mkdir d2/d3/df/d139 0 2024-09-21T00:56:44.390 INFO:tasks.workunit.client.1.smithi187.stdout:2/887: chown d2/d3/df/c18 97 1 2024-09-21T00:56:44.391 INFO:tasks.workunit.client.0.smithi112.stdout:9/280: fdatasync d5/d6/d19/d1b/f3c 0 2024-09-21T00:56:44.392 INFO:tasks.workunit.client.1.smithi187.stdout:1/923: creat d4/d6/d23/d2e/d94/d35/d4c/d5b/d83/f12c x:0 0 0 2024-09-21T00:56:44.393 INFO:tasks.workunit.client.0.smithi112.stdout:8/152: link d0/fb d0/d13/d1b/d22/f31 0 2024-09-21T00:56:44.395 INFO:tasks.workunit.client.0.smithi112.stdout:0/273: mkdir d8/d11/d59 0 2024-09-21T00:56:44.395 INFO:tasks.workunit.client.1.smithi187.stdout:2/888: dwrite d2/dc/d2e/d4a/d7c/f37 [4194304,4194304] 0 2024-09-21T00:56:44.395 INFO:tasks.workunit.client.0.smithi112.stdout:0/274: write d8/f35 [62812,32753] 0 2024-09-21T00:56:44.397 INFO:tasks.workunit.client.0.smithi112.stdout:0/275: write d8/f3c [1193896,93383] 0 2024-09-21T00:56:44.397 INFO:tasks.workunit.client.1.smithi187.stdout:5/759: mknod d0/dc/daa/d67/d14/d38/d5a/cf8 0 2024-09-21T00:56:44.397 INFO:tasks.workunit.client.0.smithi112.stdout:9/281: mkdir d5/d6/de/d13/d56 0 2024-09-21T00:56:44.398 INFO:tasks.workunit.client.1.smithi187.stdout:5/760: chown d0/dc/faf 64990778 1 2024-09-21T00:56:44.398 INFO:tasks.workunit.client.1.smithi187.stdout:4/852: readlink d2/d3/d56/d84/d60/d9e/ld8 0 2024-09-21T00:56:44.398 INFO:tasks.workunit.client.1.smithi187.stdout:5/761: chown d0/fa5 1110698 1 2024-09-21T00:56:44.400 INFO:tasks.workunit.client.0.smithi112.stdout:8/153: creat d0/d13/d1b/f32 x:0 0 0 2024-09-21T00:56:44.400 INFO:tasks.workunit.client.0.smithi112.stdout:8/154: readlink d0/l2 0 2024-09-21T00:56:44.402 INFO:tasks.workunit.client.1.smithi187.stdout:8/864: truncate dc/d44/f6a 988540 0 2024-09-21T00:56:44.405 INFO:tasks.workunit.client.0.smithi112.stdout:3/337: dwrite f1 [0,4194304] 0 2024-09-21T00:56:44.408 INFO:tasks.workunit.client.0.smithi112.stdout:9/282: mkdir d5/d6/d19/d1b/d57 0 2024-09-21T00:56:44.409 INFO:tasks.workunit.client.1.smithi187.stdout:7/744: creat d1/d55/d80/f101 x:0 0 0 2024-09-21T00:56:44.410 INFO:tasks.workunit.client.1.smithi187.stdout:6/835: mkdir d7/d2a/d29/d40/d50/d83/d114 0 2024-09-21T00:56:44.413 INFO:tasks.workunit.client.0.smithi112.stdout:8/155: mknod d0/c33 0 2024-09-21T00:56:44.413 INFO:tasks.workunit.client.0.smithi112.stdout:5/149: truncate d8/d9/d13/d2a/df/f10 2225024 0 2024-09-21T00:56:44.416 INFO:tasks.workunit.client.1.smithi187.stdout:7/745: dwrite d1/dce/dd0/fa7 [0,4194304] 0 2024-09-21T00:56:44.416 INFO:tasks.workunit.client.0.smithi112.stdout:2/243: sync 2024-09-21T00:56:44.422 INFO:tasks.workunit.client.1.smithi187.stdout:3/752: creat d9/d19/da7/ffc x:0 0 0 2024-09-21T00:56:44.423 INFO:tasks.workunit.client.1.smithi187.stdout:9/975: symlink d4/d8/d46/d54/d10f/d121/d66/l148 0 2024-09-21T00:56:44.424 INFO:tasks.workunit.client.1.smithi187.stdout:1/924: mknod d4/d6/d23/d2e/d94/d119/c12d 0 2024-09-21T00:56:44.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/244: creat d0/d14/f4e x:0 0 0 2024-09-21T00:56:44.432 INFO:tasks.workunit.client.0.smithi112.stdout:3/338: mkdir d2/d8/d6d 0 2024-09-21T00:56:44.432 INFO:tasks.workunit.client.0.smithi112.stdout:0/276: write d8/d1b/f4f [555262,56778] 0 2024-09-21T00:56:44.433 INFO:tasks.workunit.client.1.smithi187.stdout:5/762: creat d0/dc/daa/d67/d14/d1b/d27/d3a/ff9 x:0 0 0 2024-09-21T00:56:44.436 INFO:tasks.workunit.client.1.smithi187.stdout:8/865: chown dc/d2f/d37/l59 3 1 2024-09-21T00:56:44.439 INFO:tasks.workunit.client.1.smithi187.stdout:6/836: symlink d7/d2a/da2/l115 0 2024-09-21T00:56:44.439 INFO:tasks.workunit.client.1.smithi187.stdout:6/837: chown d7/d2a/d29/d40/d50/d68 140 1 2024-09-21T00:56:44.440 INFO:tasks.workunit.client.0.smithi112.stdout:5/150: read d8/d9/d13/d2a/df/f10 [1821871,126663] 0 2024-09-21T00:56:44.442 INFO:tasks.workunit.client.0.smithi112.stdout:8/156: dread d0/d13/d1b/f30 [0,4194304] 0 2024-09-21T00:56:44.444 INFO:tasks.workunit.client.1.smithi187.stdout:0/756: dwrite d0/d17/d1c/d23/df/d41/f4a [0,4194304] 0 2024-09-21T00:56:44.444 INFO:tasks.workunit.client.0.smithi112.stdout:9/283: creat d5/d6/de/f58 x:0 0 0 2024-09-21T00:56:44.447 INFO:tasks.workunit.client.0.smithi112.stdout:9/284: write d5/d6/de/d13/f1a [4908467,100027] 0 2024-09-21T00:56:44.448 INFO:tasks.workunit.client.0.smithi112.stdout:2/245: dwrite d0/f18 [0,4194304] 0 2024-09-21T00:56:44.452 INFO:tasks.workunit.client.0.smithi112.stdout:5/151: mkdir d8/d9/d13/d2a/d2c 0 2024-09-21T00:56:44.454 INFO:tasks.workunit.client.0.smithi112.stdout:9/285: dread d5/d6/de/d13/f45 [0,4194304] 0 2024-09-21T00:56:44.455 INFO:tasks.workunit.client.1.smithi187.stdout:9/976: mkdir d4/d61/d6a/d90/daa/df6/d149 0 2024-09-21T00:56:44.455 INFO:tasks.workunit.client.0.smithi112.stdout:9/286: stat d5/d6/de/f52 0 2024-09-21T00:56:44.458 INFO:tasks.workunit.client.1.smithi187.stdout:1/925: rename d4/d6/d23/d2e/d94/d6c/d11c/f120 to d4/d6/d23/d2e/d94/d66/f12e 0 2024-09-21T00:56:44.459 INFO:tasks.workunit.client.0.smithi112.stdout:0/277: creat d8/d11/d59/f5a x:0 0 0 2024-09-21T00:56:44.460 INFO:tasks.workunit.client.0.smithi112.stdout:2/246: mkdir d0/d14/d8/d4f 0 2024-09-21T00:56:44.461 INFO:tasks.workunit.client.0.smithi112.stdout:2/247: readlink d0/d14/d8/l3b 0 2024-09-21T00:56:44.462 INFO:tasks.workunit.client.1.smithi187.stdout:4/853: fsync d2/d3/d56/d84/d60/d9e/fe6 0 2024-09-21T00:56:44.465 INFO:tasks.workunit.client.1.smithi187.stdout:5/763: creat d0/dc/d1f/ffa x:0 0 0 2024-09-21T00:56:44.466 INFO:tasks.workunit.client.1.smithi187.stdout:5/764: write d0/dc/d1f/ffa [293727,63638] 0 2024-09-21T00:56:44.468 INFO:tasks.workunit.client.0.smithi112.stdout:3/339: link d2/l1e d2/d8/l6e 0 2024-09-21T00:56:44.469 INFO:tasks.workunit.client.1.smithi187.stdout:0/757: creat d0/d17/d18/d3a/d97/dcc/f103 x:0 0 0 2024-09-21T00:56:44.469 INFO:tasks.workunit.client.0.smithi112.stdout:9/287: mkdir d5/d6/de/d59 0 2024-09-21T00:56:44.470 INFO:tasks.workunit.client.1.smithi187.stdout:0/758: chown d0/d17/d18/d3a/d97/dcc/f103 0 1 2024-09-21T00:56:44.473 INFO:tasks.workunit.client.1.smithi187.stdout:3/753: getdents d9/df2 0 2024-09-21T00:56:44.473 INFO:tasks.workunit.client.1.smithi187.stdout:3/754: stat d9/d7f/dcb/d9c 0 2024-09-21T00:56:44.474 INFO:tasks.workunit.client.1.smithi187.stdout:3/755: dread - d9/d19/ff7 zero size 2024-09-21T00:56:44.476 INFO:tasks.workunit.client.1.smithi187.stdout:1/926: symlink d4/d75/l12f 0 2024-09-21T00:56:44.478 INFO:tasks.workunit.client.1.smithi187.stdout:2/889: rmdir d2/dc/d2e/d51/dc5/ddf/d10a/d11e 0 2024-09-21T00:56:44.480 INFO:tasks.workunit.client.1.smithi187.stdout:2/890: read - d2/da8/d6c/db8/d40/fcf zero size 2024-09-21T00:56:44.480 INFO:tasks.workunit.client.1.smithi187.stdout:8/866: symlink dc/d2f/d54/d69/l12b 0 2024-09-21T00:56:44.482 INFO:tasks.workunit.client.1.smithi187.stdout:3/756: dread d9/d19/d1c/f5b [0,4194304] 0 2024-09-21T00:56:44.483 INFO:tasks.workunit.client.1.smithi187.stdout:7/746: truncate d1/dce/dd0/d97/df1/d31/d33/f95 872234 0 2024-09-21T00:56:44.484 INFO:tasks.workunit.client.1.smithi187.stdout:2/891: dread - d2/dc/d2e/d51/dc5/ddf/f133 zero size 2024-09-21T00:56:44.485 INFO:tasks.workunit.client.1.smithi187.stdout:9/977: mkdir d4/d8/d46/d54/d10f/d121/d14a 0 2024-09-21T00:56:44.487 INFO:tasks.workunit.client.1.smithi187.stdout:6/838: dwrite d7/d2a/d29/d40/d5e/f93 [4194304,4194304] 0 2024-09-21T00:56:44.488 INFO:tasks.workunit.client.1.smithi187.stdout:9/978: write d4/d61/f10c [654722,72234] 0 2024-09-21T00:56:44.488 INFO:tasks.workunit.client.1.smithi187.stdout:0/759: dread d0/d60/d6b/fa9 [0,4194304] 0 2024-09-21T00:56:44.489 INFO:tasks.workunit.client.1.smithi187.stdout:4/854: rename d2/d3/d56/c86 to d2/d3/da/dc4/c101 0 2024-09-21T00:56:44.489 INFO:tasks.workunit.client.1.smithi187.stdout:9/979: chown d4/d8/ded 764 1 2024-09-21T00:56:44.499 INFO:tasks.workunit.client.1.smithi187.stdout:7/747: symlink d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/dea/l102 0 2024-09-21T00:56:44.502 INFO:tasks.workunit.client.1.smithi187.stdout:5/765: link d0/dc/d1f/d26/c36 d0/dc/daa/d67/d14/d57/d5c/cfb 0 2024-09-21T00:56:44.502 INFO:tasks.workunit.client.1.smithi187.stdout:0/760: write d0/d60/d6b/fa9 [4431878,82155] 0 2024-09-21T00:56:44.503 INFO:tasks.workunit.client.1.smithi187.stdout:3/757: symlink d9/d7f/dcb/d87/d94/d53/d75/de2/lfd 0 2024-09-21T00:56:44.505 INFO:tasks.workunit.client.1.smithi187.stdout:1/927: dwrite d4/f76 [0,4194304] 0 2024-09-21T00:56:44.505 INFO:tasks.workunit.client.1.smithi187.stdout:4/855: getdents d2/d3/da/d48/db0 0 2024-09-21T00:56:44.506 INFO:tasks.workunit.client.1.smithi187.stdout:9/980: symlink d4/d10/l14b 0 2024-09-21T00:56:44.506 INFO:tasks.workunit.client.1.smithi187.stdout:0/761: write d0/d5a/fef [995541,31394] 0 2024-09-21T00:56:44.508 INFO:tasks.workunit.client.1.smithi187.stdout:4/856: stat d2/lc1 0 2024-09-21T00:56:44.510 INFO:tasks.workunit.client.1.smithi187.stdout:3/758: write d9/d19/dca/fda [802866,107165] 0 2024-09-21T00:56:44.510 INFO:tasks.workunit.client.1.smithi187.stdout:5/766: symlink d0/dc/daa/d67/d14/d38/d5a/d6c/lfc 0 2024-09-21T00:56:44.511 INFO:tasks.workunit.client.1.smithi187.stdout:4/857: readlink d2/l99 0 2024-09-21T00:56:44.512 INFO:tasks.workunit.client.1.smithi187.stdout:6/839: link d7/d59/fbd d7/d2a/f116 0 2024-09-21T00:56:44.519 INFO:tasks.workunit.client.1.smithi187.stdout:9/981: write d4/d8/d46/d54/d10f/d121/d108/ffe [581312,30020] 0 2024-09-21T00:56:44.519 INFO:tasks.workunit.client.1.smithi187.stdout:0/762: fdatasync d0/d17/d1c/d23/df/f53 0 2024-09-21T00:56:44.520 INFO:tasks.workunit.client.1.smithi187.stdout:8/867: dwrite dc/d2f/d34/d4b/d85/fa8 [0,4194304] 0 2024-09-21T00:56:44.525 INFO:tasks.workunit.client.1.smithi187.stdout:7/748: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/fb3 [4194304,4194304] 0 2024-09-21T00:56:44.526 INFO:tasks.workunit.client.1.smithi187.stdout:9/982: read - d4/d10/fc3 zero size 2024-09-21T00:56:44.528 INFO:tasks.workunit.client.1.smithi187.stdout:3/759: creat d9/d19/ffe x:0 0 0 2024-09-21T00:56:44.528 INFO:tasks.workunit.client.1.smithi187.stdout:2/892: dwrite d2/dc/d2e/d4a/f77 [0,4194304] 0 2024-09-21T00:56:44.530 INFO:tasks.workunit.client.1.smithi187.stdout:4/858: mkdir d2/d3/da/d2f/d32/d24/dcd/d102 0 2024-09-21T00:56:44.531 INFO:tasks.workunit.client.1.smithi187.stdout:2/893: readlink d2/d3/lff 0 2024-09-21T00:56:44.532 INFO:tasks.workunit.client.1.smithi187.stdout:1/928: dwrite d4/d6/d23/f45 [0,4194304] 0 2024-09-21T00:56:44.533 INFO:tasks.workunit.client.1.smithi187.stdout:5/767: creat d0/dc/ffd x:0 0 0 2024-09-21T00:56:44.534 INFO:tasks.workunit.client.0.smithi112.stdout:9/288: write d5/d3b/f3e [38573,79960] 0 2024-09-21T00:56:44.534 INFO:tasks.workunit.client.0.smithi112.stdout:2/248: link d0/d14/d22/f2f d0/d14/f50 0 2024-09-21T00:56:44.537 INFO:tasks.workunit.client.0.smithi112.stdout:3/340: chown d2/c40 3 1 2024-09-21T00:56:44.537 INFO:tasks.workunit.client.1.smithi187.stdout:3/760: write d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/faf [329608,98983] 0 2024-09-21T00:56:44.539 INFO:tasks.workunit.client.0.smithi112.stdout:2/249: write d0/d14/d8/d27/f3a [466186,818] 0 2024-09-21T00:56:44.539 INFO:tasks.workunit.client.0.smithi112.stdout:0/278: truncate d8/d11/f13 4468074 0 2024-09-21T00:56:44.545 INFO:tasks.workunit.client.0.smithi112.stdout:8/157: dwrite d0/d13/f29 [0,4194304] 0 2024-09-21T00:56:44.549 INFO:tasks.workunit.client.1.smithi187.stdout:4/859: unlink d2/d3/d74/db1/cdb 0 2024-09-21T00:56:44.550 INFO:tasks.workunit.client.0.smithi112.stdout:3/341: dwrite d2/d38/d3f/f60 [0,4194304] 0 2024-09-21T00:56:44.553 INFO:tasks.workunit.client.0.smithi112.stdout:9/289: creat d5/d6/f5a x:0 0 0 2024-09-21T00:56:44.553 INFO:tasks.workunit.client.0.smithi112.stdout:9/290: fdatasync d5/f4b 0 2024-09-21T00:56:44.555 INFO:tasks.workunit.client.0.smithi112.stdout:0/279: dread d8/d1b/f36 [0,4194304] 0 2024-09-21T00:56:44.557 INFO:tasks.workunit.client.0.smithi112.stdout:9/291: write d5/d6/de/f3d [948960,60707] 0 2024-09-21T00:56:44.558 INFO:tasks.workunit.client.0.smithi112.stdout:9/292: chown d5/d6/de/f2e 105017 1 2024-09-21T00:56:44.559 INFO:tasks.workunit.client.0.smithi112.stdout:0/280: dread d8/d1b/d2c/f34 [0,4194304] 0 2024-09-21T00:56:44.560 INFO:tasks.workunit.client.1.smithi187.stdout:3/761: rename d9/d7f/dcb/c3a to d9/d19/dca/dd6/cff 0 2024-09-21T00:56:44.562 INFO:tasks.workunit.client.1.smithi187.stdout:6/840: dread d7/d2a/d29/f49 [4194304,4194304] 0 2024-09-21T00:56:44.566 INFO:tasks.workunit.client.1.smithi187.stdout:1/929: unlink d4/d6/f5a 0 2024-09-21T00:56:44.567 INFO:tasks.workunit.client.0.smithi112.stdout:3/342: unlink d2/d8/d28/f31 0 2024-09-21T00:56:44.570 INFO:tasks.workunit.client.1.smithi187.stdout:9/983: write d4/d8/d41/f5b [1245699,14310] 0 2024-09-21T00:56:44.571 INFO:tasks.workunit.client.1.smithi187.stdout:5/768: mknod d0/dc/dc6/cfe 0 2024-09-21T00:56:44.572 INFO:tasks.workunit.client.0.smithi112.stdout:2/250: dread d0/d14/d8/d27/f2a [0,4194304] 0 2024-09-21T00:56:44.576 INFO:tasks.workunit.client.1.smithi187.stdout:8/868: write dc/d2f/d80/db8/dba/d29/f48 [1056242,114763] 0 2024-09-21T00:56:44.580 INFO:tasks.workunit.client.1.smithi187.stdout:6/841: creat d7/d2a/d29/d40/d50/d68/f117 x:0 0 0 2024-09-21T00:56:44.581 INFO:tasks.workunit.client.1.smithi187.stdout:7/749: truncate d1/dc/d15/f57 1332109 0 2024-09-21T00:56:44.582 INFO:tasks.workunit.client.1.smithi187.stdout:0/763: getdents d0/d17/d18/d3a/d97/dcc 0 2024-09-21T00:56:44.582 INFO:tasks.workunit.client.1.smithi187.stdout:7/750: stat d1/d55/d80 0 2024-09-21T00:56:44.582 INFO:tasks.workunit.client.0.smithi112.stdout:3/343: mknod d2/d8/dd/de/d4a/c6f 0 2024-09-21T00:56:44.583 INFO:tasks.workunit.client.1.smithi187.stdout:7/751: dread - d1/dce/dd0/d97/fc7 zero size 2024-09-21T00:56:44.583 INFO:tasks.workunit.client.1.smithi187.stdout:1/930: creat d4/d86/f130 x:0 0 0 2024-09-21T00:56:44.584 INFO:tasks.workunit.client.0.smithi112.stdout:9/293: mknod d5/d6/de/c5b 0 2024-09-21T00:56:44.585 INFO:tasks.workunit.client.1.smithi187.stdout:9/984: mknod d4/d61/d6a/c14c 0 2024-09-21T00:56:44.585 INFO:tasks.workunit.client.1.smithi187.stdout:1/931: readlink d4/d6/d23/d2e/d94/d35/d22/d65/l91 0 2024-09-21T00:56:44.586 INFO:tasks.workunit.client.1.smithi187.stdout:6/842: dread d7/d2a/d29/d40/d50/d83/fcd [0,4194304] 0 2024-09-21T00:56:44.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/251: mkdir d0/d51 0 2024-09-21T00:56:44.586 INFO:tasks.workunit.client.1.smithi187.stdout:9/985: write d4/d61/d6c/f56 [2528949,70584] 0 2024-09-21T00:56:44.590 INFO:tasks.workunit.client.1.smithi187.stdout:2/894: rmdir d2/dc/d2e/d51/dc5/ddf/d10a/d110 0 2024-09-21T00:56:44.591 INFO:tasks.workunit.client.1.smithi187.stdout:2/895: chown d2/da8/d6c/db8/d40/le9 2556231 1 2024-09-21T00:56:44.591 INFO:tasks.workunit.client.1.smithi187.stdout:8/869: unlink dc/d2f/d54/feb 0 2024-09-21T00:56:44.592 INFO:tasks.workunit.client.0.smithi112.stdout:3/344: stat d2/d8/f16 0 2024-09-21T00:56:44.592 INFO:tasks.workunit.client.1.smithi187.stdout:2/896: stat d2/d3/d15/c23 0 2024-09-21T00:56:44.593 INFO:tasks.workunit.client.1.smithi187.stdout:3/762: truncate d9/d7f/dcb/d87/d94/f90 462647 0 2024-09-21T00:56:44.594 INFO:tasks.workunit.client.0.smithi112.stdout:2/252: rename d0/f1f to d0/d51/f52 0 2024-09-21T00:56:44.595 INFO:tasks.workunit.client.0.smithi112.stdout:8/158: write d0/ff [2914042,64661] 0 2024-09-21T00:56:44.595 INFO:tasks.workunit.client.1.smithi187.stdout:4/860: dwrite d2/d3/da/d2f/f83 [0,4194304] 0 2024-09-21T00:56:44.595 INFO:tasks.workunit.client.0.smithi112.stdout:0/281: link d8/d1b/d2c/c51 d8/d11/d59/c5b 0 2024-09-21T00:56:44.596 INFO:tasks.workunit.client.1.smithi187.stdout:0/764: mknod d0/d60/d6b/dc9/c104 0 2024-09-21T00:56:44.599 INFO:tasks.workunit.client.1.smithi187.stdout:0/765: write d0/d17/d1c/d23/df/d41/fe1 [1865747,39569] 0 2024-09-21T00:56:44.619 INFO:tasks.workunit.client.1.smithi187.stdout:4/861: dread d2/d3/da/d2f/d32/d22/d37/d51/f81 [0,4194304] 0 2024-09-21T00:56:44.653 INFO:tasks.workunit.client.0.smithi112.stdout:3/345: truncate d2/d8/f16 1435735 0 2024-09-21T00:56:44.659 INFO:tasks.workunit.client.0.smithi112.stdout:2/253: creat d0/f53 x:0 0 0 2024-09-21T00:56:44.659 INFO:tasks.workunit.client.1.smithi187.stdout:5/769: write d0/dc/d1f/d26/f9c [4988961,96583] 0 2024-09-21T00:56:44.660 INFO:tasks.workunit.client.1.smithi187.stdout:5/770: dread - d0/dc/daa/d67/d30/d6b/fd7 zero size 2024-09-21T00:56:44.662 INFO:tasks.workunit.client.0.smithi112.stdout:3/346: symlink d2/d8/dd/de/d5c/l70 0 2024-09-21T00:56:44.666 INFO:tasks.workunit.client.0.smithi112.stdout:8/159: mkdir d0/d13/d1b/d22/d2e/d34 0 2024-09-21T00:56:44.671 INFO:tasks.workunit.client.0.smithi112.stdout:8/160: dread d0/d13/d1b/f30 [0,4194304] 0 2024-09-21T00:56:44.673 INFO:tasks.workunit.client.1.smithi187.stdout:3/763: unlink d9/d7f/dcb/c4b 0 2024-09-21T00:56:44.676 INFO:tasks.workunit.client.1.smithi187.stdout:9/986: write d4/d8/d46/d54/d10f/d121/d94/d122/d13c/fb7 [478987,59819] 0 2024-09-21T00:56:44.676 INFO:tasks.workunit.client.1.smithi187.stdout:9/987: chown d4/d8/d46/d54/d10f/d121 35704998 1 2024-09-21T00:56:44.679 INFO:tasks.workunit.client.0.smithi112.stdout:8/161: creat d0/d13/d1b/f35 x:0 0 0 2024-09-21T00:56:44.680 INFO:tasks.workunit.client.1.smithi187.stdout:0/766: creat d0/d17/d18/d90/d98/f105 x:0 0 0 2024-09-21T00:56:44.681 INFO:tasks.workunit.client.1.smithi187.stdout:4/862: creat d2/d3/da/d16/f103 x:0 0 0 2024-09-21T00:56:44.682 INFO:tasks.workunit.client.0.smithi112.stdout:8/162: unlink d0/d13/f19 0 2024-09-21T00:56:44.684 INFO:tasks.workunit.client.1.smithi187.stdout:1/932: symlink d4/d6/d23/d2e/d94/d35/d4c/d5b/l131 0 2024-09-21T00:56:44.685 INFO:tasks.workunit.client.0.smithi112.stdout:3/347: dwrite d2/d8/d28/f26 [0,4194304] 0 2024-09-21T00:56:44.685 INFO:tasks.workunit.client.0.smithi112.stdout:2/254: dread d0/df/f1b [0,4194304] 0 2024-09-21T00:56:44.685 INFO:tasks.workunit.client.1.smithi187.stdout:1/933: chown d4/d6/d23/d2e/d94/d35/d22/l50 38 1 2024-09-21T00:56:44.686 INFO:tasks.workunit.client.0.smithi112.stdout:8/163: rmdir d0/d13/d1b/d22 39 2024-09-21T00:56:44.687 INFO:tasks.workunit.client.1.smithi187.stdout:1/934: dread d4/d86/fe8 [0,4194304] 0 2024-09-21T00:56:44.688 INFO:tasks.workunit.client.1.smithi187.stdout:5/771: creat d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9/fff x:0 0 0 2024-09-21T00:56:44.688 INFO:tasks.workunit.client.0.smithi112.stdout:3/348: creat d2/d3e/f71 x:0 0 0 2024-09-21T00:56:44.689 INFO:tasks.workunit.client.1.smithi187.stdout:8/870: getdents dc/d44/dc1/d11e 0 2024-09-21T00:56:44.690 INFO:tasks.workunit.client.0.smithi112.stdout:2/255: creat d0/d51/f54 x:0 0 0 2024-09-21T00:56:44.692 INFO:tasks.workunit.client.1.smithi187.stdout:3/764: mkdir d9/d7f/dcb/d87/d94/d53/d56/d61/ded/d100 0 2024-09-21T00:56:44.694 INFO:tasks.workunit.client.0.smithi112.stdout:3/349: dwrite d2/d8/f11 [0,4194304] 0 2024-09-21T00:56:44.699 INFO:tasks.workunit.client.1.smithi187.stdout:9/988: mknod d4/d8/d46/d54/d10f/d121/d108/dfc/d10a/c14d 0 2024-09-21T00:56:44.702 INFO:tasks.workunit.client.1.smithi187.stdout:0/767: rename d0/d60/d6b/d9f/ce7 to d0/d17/d18/d3a/d97/c106 0 2024-09-21T00:56:44.702 INFO:tasks.workunit.client.1.smithi187.stdout:0/768: readlink d0/d17/l1b 0 2024-09-21T00:56:44.704 INFO:tasks.workunit.client.1.smithi187.stdout:6/843: truncate d7/d2a/d29/d40/d5e/fb5 3804238 0 2024-09-21T00:56:44.705 INFO:tasks.workunit.client.1.smithi187.stdout:6/844: stat d7/d2a/d29/d40/d50/d83/fda 0 2024-09-21T00:56:44.705 INFO:tasks.workunit.client.1.smithi187.stdout:4/863: read d2/f65 [188504,121598] 0 2024-09-21T00:56:44.706 INFO:tasks.workunit.client.0.smithi112.stdout:3/350: rename d2/d8/dd/de/f1d to d2/d8/dd/de/d6b/f72 0 2024-09-21T00:56:44.706 INFO:tasks.workunit.client.1.smithi187.stdout:4/864: readlink d2/d3/da/d2f/d32/d26/d66/d6e/l9f 0 2024-09-21T00:56:44.710 INFO:tasks.workunit.client.0.smithi112.stdout:8/164: rmdir d0/d13/d1b/d2d 0 2024-09-21T00:56:44.714 INFO:tasks.workunit.client.1.smithi187.stdout:5/772: creat d0/dc/daa/d67/d14/d38/d5a/f100 x:0 0 0 2024-09-21T00:56:44.715 INFO:tasks.workunit.client.1.smithi187.stdout:2/897: link d2/da8/d6c/d97/da1/cd7 d2/d3/d15/c13a 0 2024-09-21T00:56:44.718 INFO:tasks.workunit.client.0.smithi112.stdout:8/165: dwrite d0/f26 [0,4194304] 0 2024-09-21T00:56:44.718 INFO:tasks.workunit.client.0.smithi112.stdout:3/351: symlink d2/d8/d6d/l73 0 2024-09-21T00:56:44.719 INFO:tasks.workunit.client.0.smithi112.stdout:2/256: dwrite d0/df/f1b [0,4194304] 0 2024-09-21T00:56:44.719 INFO:tasks.workunit.client.0.smithi112.stdout:3/352: fdatasync d2/d8/d28/f54 0 2024-09-21T00:56:44.720 INFO:tasks.workunit.client.1.smithi187.stdout:0/769: fdatasync d0/d17/d1c/d23/df/d41/d3b/f94 0 2024-09-21T00:56:44.721 INFO:tasks.workunit.client.0.smithi112.stdout:3/353: fdatasync d2/d3e/f66 0 2024-09-21T00:56:44.722 INFO:tasks.workunit.client.1.smithi187.stdout:0/770: chown d0/d17/d1c/d23/df/d41/d3b/c72 2046171 1 2024-09-21T00:56:44.723 INFO:tasks.workunit.client.1.smithi187.stdout:0/771: write d0/d17/d1c/d23/ffc [954168,68131] 0 2024-09-21T00:56:44.725 INFO:tasks.workunit.client.1.smithi187.stdout:0/772: write d0/d60/d6b/fa9 [3768674,69852] 0 2024-09-21T00:56:44.726 INFO:tasks.workunit.client.1.smithi187.stdout:6/845: creat d7/d2a/d29/d40/d6a/d9e/f118 x:0 0 0 2024-09-21T00:56:44.729 INFO:tasks.workunit.client.1.smithi187.stdout:4/865: creat d2/d3/da/d48/f104 x:0 0 0 2024-09-21T00:56:44.730 INFO:tasks.workunit.client.0.smithi112.stdout:2/257: write d0/d14/d8/d27/f2a [4493087,91017] 0 2024-09-21T00:56:44.732 INFO:tasks.workunit.client.1.smithi187.stdout:1/935: dread d4/d6/d23/d2e/d94/d35/d22/d65/f6d [0,4194304] 0 2024-09-21T00:56:44.733 INFO:tasks.workunit.client.0.smithi112.stdout:3/354: creat d2/d8/d28/f74 x:0 0 0 2024-09-21T00:56:44.734 INFO:tasks.workunit.client.0.smithi112.stdout:3/355: truncate d2/d8/dd/de/d6b/f72 9047081 0 2024-09-21T00:56:44.737 INFO:tasks.workunit.client.1.smithi187.stdout:5/773: rmdir d0/dc/daa/d67/d14/d57/d5c/dc9 39 2024-09-21T00:56:44.739 INFO:tasks.workunit.client.1.smithi187.stdout:2/898: unlink d2/da8/d6c/d97/da1/fa4 0 2024-09-21T00:56:44.740 INFO:tasks.workunit.client.1.smithi187.stdout:2/899: dread - d2/d3/d15/dfe/fbd zero size 2024-09-21T00:56:44.742 INFO:tasks.workunit.client.1.smithi187.stdout:8/871: rename dc/d2f/d80/db8/f123 to dc/df2/f12c 0 2024-09-21T00:56:44.743 INFO:tasks.workunit.client.0.smithi112.stdout:8/166: write d0/f1d [475175,108704] 0 2024-09-21T00:56:44.744 INFO:tasks.workunit.client.1.smithi187.stdout:2/900: dread d2/dc/d2e/d4a/d7c/d52/da3/f112 [0,4194304] 0 2024-09-21T00:56:44.744 INFO:tasks.workunit.client.0.smithi112.stdout:2/258: link d0/df/f16 d0/d51/f55 0 2024-09-21T00:56:44.744 INFO:tasks.workunit.client.0.smithi112.stdout:2/259: stat d0/f5 0 2024-09-21T00:56:44.745 INFO:tasks.workunit.client.1.smithi187.stdout:2/901: chown d2/da8/f5e 106216 1 2024-09-21T00:56:44.747 INFO:tasks.workunit.client.1.smithi187.stdout:0/773: write d0/d17/d1c/d23/df/d41/d3b/f94 [2776505,36368] 0 2024-09-21T00:56:44.748 INFO:tasks.workunit.client.0.smithi112.stdout:2/260: creat d0/d51/f56 x:0 0 0 2024-09-21T00:56:44.749 INFO:tasks.workunit.client.0.smithi112.stdout:3/356: write d2/d8/dd/de/f1c [3756309,106814] 0 2024-09-21T00:56:44.749 INFO:tasks.workunit.client.1.smithi187.stdout:7/752: dread d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/f88 [0,4194304] 0 2024-09-21T00:56:44.750 INFO:tasks.workunit.client.1.smithi187.stdout:7/753: write d1/dc/fbb [1160997,55224] 0 2024-09-21T00:56:44.750 INFO:tasks.workunit.client.1.smithi187.stdout:6/846: unlink d7/d2a/l107 0 2024-09-21T00:56:44.753 INFO:tasks.workunit.client.1.smithi187.stdout:1/936: creat d4/d6/d23/d2e/d94/d35/d4c/f132 x:0 0 0 2024-09-21T00:56:44.754 INFO:tasks.workunit.client.0.smithi112.stdout:2/261: creat d0/d51/f57 x:0 0 0 2024-09-21T00:56:44.756 INFO:tasks.workunit.client.0.smithi112.stdout:3/357: mknod d2/d3e/c75 0 2024-09-21T00:56:44.763 INFO:tasks.workunit.client.0.smithi112.stdout:2/262: mkdir d0/df/d46/d58 0 2024-09-21T00:56:44.764 INFO:tasks.workunit.client.0.smithi112.stdout:3/358: creat d2/d6a/f76 x:0 0 0 2024-09-21T00:56:44.765 INFO:tasks.workunit.client.0.smithi112.stdout:2/263: dread - d0/df/f26 zero size 2024-09-21T00:56:44.765 INFO:tasks.workunit.client.0.smithi112.stdout:3/359: fdatasync d2/d38/d3f/f43 0 2024-09-21T00:56:44.766 INFO:tasks.workunit.client.1.smithi187.stdout:2/902: symlink d2/dc/d2e/d4a/d7c/d52/da3/l13b 0 2024-09-21T00:56:44.768 INFO:tasks.workunit.client.0.smithi112.stdout:8/167: truncate d0/ff 293035 0 2024-09-21T00:56:44.770 INFO:tasks.workunit.client.0.smithi112.stdout:3/360: mknod d2/d33/c77 0 2024-09-21T00:56:44.771 INFO:tasks.workunit.client.0.smithi112.stdout:2/264: dwrite d0/d14/f12 [0,4194304] 0 2024-09-21T00:56:44.772 INFO:tasks.workunit.client.0.smithi112.stdout:2/265: chown d0/c6 1808 1 2024-09-21T00:56:44.772 INFO:tasks.workunit.client.1.smithi187.stdout:9/989: getdents d4/d8/d46/d54/d10f/d121/d66 0 2024-09-21T00:56:44.774 INFO:tasks.workunit.client.0.smithi112.stdout:3/361: mkdir d2/d33/d78 0 2024-09-21T00:56:44.775 INFO:tasks.workunit.client.0.smithi112.stdout:8/168: dread d0/d13/d1b/d22/f31 [0,4194304] 0 2024-09-21T00:56:44.779 INFO:tasks.workunit.client.0.smithi112.stdout:2/266: rmdir d0/d45 39 2024-09-21T00:56:44.780 INFO:tasks.workunit.client.0.smithi112.stdout:3/362: symlink d2/d3e/l79 0 2024-09-21T00:56:44.782 INFO:tasks.workunit.client.1.smithi187.stdout:8/872: mknod dc/d2f/d54/c12d 0 2024-09-21T00:56:44.783 INFO:tasks.workunit.client.1.smithi187.stdout:8/873: truncate dc/d2f/d80/db8/dba/dc7/f109 929606 0 2024-09-21T00:56:44.784 INFO:tasks.workunit.client.0.smithi112.stdout:8/169: dwrite d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:56:44.785 INFO:tasks.workunit.client.1.smithi187.stdout:7/754: mkdir d1/d103 0 2024-09-21T00:56:44.786 INFO:tasks.workunit.client.0.smithi112.stdout:2/267: write d0/f5 [5974398,101886] 0 2024-09-21T00:56:44.790 INFO:tasks.workunit.client.1.smithi187.stdout:9/990: creat d4/d10/d8f/f14e x:0 0 0 2024-09-21T00:56:44.791 INFO:tasks.workunit.client.1.smithi187.stdout:7/755: dwrite d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fd2 [0,4194304] 0 2024-09-21T00:56:44.791 INFO:tasks.workunit.client.0.smithi112.stdout:8/170: symlink d0/l36 0 2024-09-21T00:56:44.797 INFO:tasks.workunit.client.1.smithi187.stdout:0/774: creat d0/d17/d18/f107 x:0 0 0 2024-09-21T00:56:44.797 INFO:tasks.workunit.client.1.smithi187.stdout:6/847: write d7/d2a/d29/d40/d50/d83/fcd [1284293,55477] 0 2024-09-21T00:56:44.798 INFO:tasks.workunit.client.1.smithi187.stdout:6/848: truncate d7/f52 2105644 0 2024-09-21T00:56:44.799 INFO:tasks.workunit.client.0.smithi112.stdout:2/268: dwrite d0/d51/f52 [4194304,4194304] 0 2024-09-21T00:56:44.801 INFO:tasks.workunit.client.1.smithi187.stdout:3/765: rename d9/d7f/dcb/d87/d94/d53/lbc to d9/d7f/dcb/d87/d94/d53/d56/l101 0 2024-09-21T00:56:44.802 INFO:tasks.workunit.client.1.smithi187.stdout:1/937: dwrite d4/d6/d23/d2e/d94/d35/d22/d65/f6d [0,4194304] 0 2024-09-21T00:56:44.806 INFO:tasks.workunit.client.1.smithi187.stdout:8/874: unlink dc/f110 0 2024-09-21T00:56:44.807 INFO:tasks.workunit.client.1.smithi187.stdout:7/756: mkdir d1/dc/d104 0 2024-09-21T00:56:44.809 INFO:tasks.workunit.client.0.smithi112.stdout:8/171: link d0/c12 d0/d13/d2a/c37 0 2024-09-21T00:56:44.809 INFO:tasks.workunit.client.1.smithi187.stdout:7/757: chown d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/la0 0 1 2024-09-21T00:56:44.810 INFO:tasks.workunit.client.0.smithi112.stdout:3/363: dread d2/d8/d28/f2c [0,4194304] 0 2024-09-21T00:56:44.811 INFO:tasks.workunit.client.1.smithi187.stdout:4/866: rename d2/d3/da/d2f/d4b/f7a to d2/d3/da/d2f/d32/d24/dcd/db3/f105 0 2024-09-21T00:56:44.811 INFO:tasks.workunit.client.0.smithi112.stdout:3/364: dread - d2/f5e zero size 2024-09-21T00:56:44.811 INFO:tasks.workunit.client.1.smithi187.stdout:4/867: readlink d2/d3/da/laa 0 2024-09-21T00:56:44.812 INFO:tasks.workunit.client.0.smithi112.stdout:3/365: fdatasync d2/d8/dd/de/f1c 0 2024-09-21T00:56:44.814 INFO:tasks.workunit.client.1.smithi187.stdout:8/875: symlink dc/d2f/d80/db8/dba/dc7/l12e 0 2024-09-21T00:56:44.816 INFO:tasks.workunit.client.0.smithi112.stdout:8/172: symlink d0/d13/d1b/d22/d2e/d34/l38 0 2024-09-21T00:56:44.817 INFO:tasks.workunit.client.1.smithi187.stdout:7/758: truncate d1/dc/d15/d22/f86 2094210 0 2024-09-21T00:56:44.817 INFO:tasks.workunit.client.1.smithi187.stdout:0/775: dread d0/d17/d1c/d23/df/d41/d3b/d46/f4f [0,4194304] 0 2024-09-21T00:56:44.819 INFO:tasks.workunit.client.0.smithi112.stdout:8/173: write d0/d13/d1b/d22/f25 [819420,3299] 0 2024-09-21T00:56:44.819 INFO:tasks.workunit.client.0.smithi112.stdout:3/366: mknod d2/d38/d3f/d53/c7a 0 2024-09-21T00:56:44.819 INFO:tasks.workunit.client.0.smithi112.stdout:8/174: stat d0/fb 0 2024-09-21T00:56:44.819 INFO:tasks.workunit.client.1.smithi187.stdout:5/774: rename d0/f55 to d0/dc/d1f/df4/f101 0 2024-09-21T00:56:44.820 INFO:tasks.workunit.client.1.smithi187.stdout:4/868: mknod d2/d3/d56/d84/d60/d6c/d77/c106 0 2024-09-21T00:56:44.821 INFO:tasks.workunit.client.1.smithi187.stdout:8/876: dread dc/d2f/d80/db8/dba/d29/f48 [0,4194304] 0 2024-09-21T00:56:44.821 INFO:tasks.workunit.client.0.smithi112.stdout:3/367: mkdir d2/d3e/d7b 0 2024-09-21T00:56:44.821 INFO:tasks.workunit.client.1.smithi187.stdout:8/877: fdatasync dc/d44/dc1/f128 0 2024-09-21T00:56:44.822 INFO:tasks.workunit.client.0.smithi112.stdout:3/368: read - d2/d8/d28/d35/f59 zero size 2024-09-21T00:56:44.823 INFO:tasks.workunit.client.1.smithi187.stdout:3/766: link d9/d7f/dcb/d87/d94/d53/d56/d61/f63 d9/d7f/dcb/d87/d94/d53/d56/d61/ded/d100/f102 0 2024-09-21T00:56:44.824 INFO:tasks.workunit.client.0.smithi112.stdout:8/175: creat d0/d13/d2a/f39 x:0 0 0 2024-09-21T00:56:44.825 INFO:tasks.workunit.client.0.smithi112.stdout:3/369: mkdir d2/d8/dd/de/d4a/d4c/d7c 0 2024-09-21T00:56:44.825 INFO:tasks.workunit.client.1.smithi187.stdout:7/759: fsync d1/dc/d15/d22/f79 0 2024-09-21T00:56:44.826 INFO:tasks.workunit.client.1.smithi187.stdout:4/869: dwrite d2/d3/da/d2f/d32/d24/fe3 [0,4194304] 0 2024-09-21T00:56:44.827 INFO:tasks.workunit.client.1.smithi187.stdout:4/870: fdatasync d2/d3/da/d2f/d32/d24/f2e 0 2024-09-21T00:56:44.827 INFO:tasks.workunit.client.1.smithi187.stdout:6/849: rename d7/f52 to d7/d2a/d29/d40/d45/df7/f119 0 2024-09-21T00:56:44.828 INFO:tasks.workunit.client.0.smithi112.stdout:3/370: fsync d2/d8/dd/f10 0 2024-09-21T00:56:44.829 INFO:tasks.workunit.client.1.smithi187.stdout:5/775: mknod d0/dc/d1f/c102 0 2024-09-21T00:56:44.834 INFO:tasks.workunit.client.1.smithi187.stdout:3/767: creat d9/d19/da7/daa/f103 x:0 0 0 2024-09-21T00:56:44.835 INFO:tasks.workunit.client.0.smithi112.stdout:3/371: symlink d2/d8/dd/l7d 0 2024-09-21T00:56:44.836 INFO:tasks.workunit.client.0.smithi112.stdout:3/372: truncate d2/d8/d28/f41 4923580 0 2024-09-21T00:56:44.839 INFO:tasks.workunit.client.1.smithi187.stdout:7/760: read d1/dce/dd0/f7f [602723,84328] 0 2024-09-21T00:56:44.841 INFO:tasks.workunit.client.1.smithi187.stdout:3/768: rename d9/d19/d43/fef to d9/dcc/f104 0 2024-09-21T00:56:44.842 INFO:tasks.workunit.client.0.smithi112.stdout:2/269: dread d0/d14/f19 [4194304,4194304] 0 2024-09-21T00:56:44.844 INFO:tasks.workunit.client.1.smithi187.stdout:0/776: dread d0/f11 [0,4194304] 0 2024-09-21T00:56:44.845 INFO:tasks.workunit.client.0.smithi112.stdout:2/270: rename d0/df/f33 to d0/d14/d8/d27/f59 0 2024-09-21T00:56:44.845 INFO:tasks.workunit.client.1.smithi187.stdout:4/871: dread d2/d3/da/d48/f9c [0,4194304] 0 2024-09-21T00:56:44.846 INFO:tasks.workunit.client.0.smithi112.stdout:2/271: read - d0/df/f26 zero size 2024-09-21T00:56:44.846 INFO:tasks.workunit.client.1.smithi187.stdout:8/878: dread dc/f10 [0,4194304] 0 2024-09-21T00:56:44.848 INFO:tasks.workunit.client.0.smithi112.stdout:2/272: mknod d0/df/c5a 0 2024-09-21T00:56:44.848 INFO:tasks.workunit.client.1.smithi187.stdout:7/761: getdents d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73 0 2024-09-21T00:56:44.850 INFO:tasks.workunit.client.1.smithi187.stdout:0/777: mkdir d0/d17/d1c/d23/d108 0 2024-09-21T00:56:44.852 INFO:tasks.workunit.client.1.smithi187.stdout:4/872: mknod d2/d3/da/d2f/d32/d22/d37/c107 0 2024-09-21T00:56:44.852 INFO:tasks.workunit.client.1.smithi187.stdout:9/991: dread d4/d61/d6c/fab [0,4194304] 0 2024-09-21T00:56:44.852 INFO:tasks.workunit.client.1.smithi187.stdout:3/769: dwrite d9/d19/da7/ffc [0,4194304] 0 2024-09-21T00:56:44.853 INFO:tasks.workunit.client.1.smithi187.stdout:8/879: symlink dc/d2f/d80/db8/dba/d29/d12a/l12f 0 2024-09-21T00:56:44.855 INFO:tasks.workunit.client.1.smithi187.stdout:0/778: rmdir d0/d17/d1c/d23/df/d41/d3b 39 2024-09-21T00:56:44.855 INFO:tasks.workunit.client.0.smithi112.stdout:2/273: dwrite d0/d51/f56 [0,4194304] 0 2024-09-21T00:56:44.856 INFO:tasks.workunit.client.1.smithi187.stdout:7/762: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/ff3 20813 0 2024-09-21T00:56:44.857 INFO:tasks.workunit.client.1.smithi187.stdout:4/873: creat d2/d3/da/d2f/d32/d22/d37/f108 x:0 0 0 2024-09-21T00:56:44.858 INFO:tasks.workunit.client.1.smithi187.stdout:9/992: mknod d4/d8/d46/d54/d10f/d121/d108/dfc/d10a/c14f 0 2024-09-21T00:56:44.862 INFO:tasks.workunit.client.1.smithi187.stdout:3/770: unlink d9/d7f/dcb/d20/c27 0 2024-09-21T00:56:44.862 INFO:tasks.workunit.client.1.smithi187.stdout:4/874: dwrite d2/d3/da/d2f/d32/d26/f44 [0,4194304] 0 2024-09-21T00:56:44.863 INFO:tasks.workunit.client.0.smithi112.stdout:2/274: symlink d0/df/d46/d58/l5b 0 2024-09-21T00:56:44.864 INFO:tasks.workunit.client.1.smithi187.stdout:4/875: write d2/d3/da/d2f/d32/d22/ffb [766510,37514] 0 2024-09-21T00:56:44.866 INFO:tasks.workunit.client.1.smithi187.stdout:4/876: readlink d2/d3/da/d2f/d32/d22/d37/l41 0 2024-09-21T00:56:44.867 INFO:tasks.workunit.client.1.smithi187.stdout:3/771: mkdir d9/dcc/d105 0 2024-09-21T00:56:44.867 INFO:tasks.workunit.client.0.smithi112.stdout:3/373: dread d2/d8/d28/f41 [0,4194304] 0 2024-09-21T00:56:44.868 INFO:tasks.workunit.client.1.smithi187.stdout:3/772: write d9/d19/ffe [985137,116400] 0 2024-09-21T00:56:44.868 INFO:tasks.workunit.client.0.smithi112.stdout:2/275: mknod d0/d14/d22/c5c 0 2024-09-21T00:56:44.870 INFO:tasks.workunit.client.0.smithi112.stdout:3/374: rmdir d2/d38 39 2024-09-21T00:56:44.871 INFO:tasks.workunit.client.0.smithi112.stdout:3/375: dread - d2/d8/d28/f74 zero size 2024-09-21T00:56:44.872 INFO:tasks.workunit.client.1.smithi187.stdout:7/763: creat d1/dce/dd0/d97/df1/d31/d41/d8a/d100/f105 x:0 0 0 2024-09-21T00:56:44.874 INFO:tasks.workunit.client.1.smithi187.stdout:7/764: write d1/dce/dd0/fa5 [291780,71673] 0 2024-09-21T00:56:44.874 INFO:tasks.workunit.client.1.smithi187.stdout:4/877: mkdir d2/d3/d56/d109 0 2024-09-21T00:56:44.877 INFO:tasks.workunit.client.0.smithi112.stdout:3/376: symlink d2/d8/dd/de/d5c/l7e 0 2024-09-21T00:56:44.878 INFO:tasks.workunit.client.1.smithi187.stdout:3/773: rename d9/d7f/dcb/d87/d94/d53/d75/de2/lfd to d9/d7f/dcb/d87/d94/d89/l106 0 2024-09-21T00:56:44.881 INFO:tasks.workunit.client.0.smithi112.stdout:3/377: creat d2/d33/d78/f7f x:0 0 0 2024-09-21T00:56:44.881 INFO:tasks.workunit.client.0.smithi112.stdout:3/378: chown d2/d8/d28/c3b 183 1 2024-09-21T00:56:44.884 INFO:tasks.workunit.client.1.smithi187.stdout:3/774: creat d9/d19/dca/dd6/df0/f107 x:0 0 0 2024-09-21T00:56:44.885 INFO:tasks.workunit.client.0.smithi112.stdout:3/379: creat d2/d38/d3f/d53/f80 x:0 0 0 2024-09-21T00:56:44.887 INFO:tasks.workunit.client.1.smithi187.stdout:3/775: symlink d9/d7f/dcb/d87/d94/d53/d56/d61/l108 0 2024-09-21T00:56:44.889 INFO:tasks.workunit.client.1.smithi187.stdout:3/776: write d9/d19/dca/fec [706866,31328] 0 2024-09-21T00:56:44.890 INFO:tasks.workunit.client.0.smithi112.stdout:3/380: symlink d2/l81 0 2024-09-21T00:56:44.891 INFO:tasks.workunit.client.0.smithi112.stdout:3/381: mknod d2/d38/d3f/c82 0 2024-09-21T00:56:44.891 INFO:tasks.workunit.client.1.smithi187.stdout:8/880: dread dc/d2f/d34/d4b/f99 [0,4194304] 0 2024-09-21T00:56:44.894 INFO:tasks.workunit.client.0.smithi112.stdout:3/382: creat d2/d38/d3f/f83 x:0 0 0 2024-09-21T00:56:44.896 INFO:tasks.workunit.client.1.smithi187.stdout:8/881: creat dc/d2f/d54/d69/db3/f130 x:0 0 0 2024-09-21T00:56:44.897 INFO:tasks.workunit.client.0.smithi112.stdout:3/383: rename d2/d33/c77 to d2/d8/d6d/c84 0 2024-09-21T00:56:44.898 INFO:tasks.workunit.client.1.smithi187.stdout:1/938: dwrite d4/d6/d23/d2e/d94/d35/d4c/d5b/d83/f84 [0,4194304] 0 2024-09-21T00:56:44.903 INFO:tasks.workunit.client.1.smithi187.stdout:1/939: fsync d4/d6/d23/d2e/d53/fea 0 2024-09-21T00:56:44.904 INFO:tasks.workunit.client.0.smithi112.stdout:3/384: dwrite f1 [4194304,4194304] 0 2024-09-21T00:56:44.904 INFO:tasks.workunit.client.1.smithi187.stdout:0/779: dread d0/d17/d1c/d23/df/d41/d3b/f54 [4194304,4194304] 0 2024-09-21T00:56:44.906 INFO:tasks.workunit.client.0.smithi112.stdout:8/176: write d0/f11 [433336,111674] 0 2024-09-21T00:56:44.909 INFO:tasks.workunit.client.1.smithi187.stdout:8/882: dwrite dc/d44/ff7 [0,4194304] 0 2024-09-21T00:56:44.910 INFO:tasks.workunit.client.1.smithi187.stdout:1/940: symlink d4/de0/l133 0 2024-09-21T00:56:44.911 INFO:tasks.workunit.client.1.smithi187.stdout:7/765: dread d1/dc/d15/d22/f79 [0,4194304] 0 2024-09-21T00:56:44.911 INFO:tasks.workunit.client.0.smithi112.stdout:3/385: dread d2/d8/d28/f26 [0,4194304] 0 2024-09-21T00:56:44.911 INFO:tasks.workunit.client.1.smithi187.stdout:0/780: creat d0/d17/d1c/d65/f109 x:0 0 0 2024-09-21T00:56:44.913 INFO:tasks.workunit.client.1.smithi187.stdout:0/781: chown d0/d60/d6b/d9f/cc6 2513 1 2024-09-21T00:56:44.914 INFO:tasks.workunit.client.0.smithi112.stdout:8/177: dread d0/d13/d1b/d22/f31 [0,4194304] 0 2024-09-21T00:56:44.915 INFO:tasks.workunit.client.0.smithi112.stdout:4/337: sync 2024-09-21T00:56:44.916 INFO:tasks.workunit.client.1.smithi187.stdout:0/782: write d0/d17/d18/f68 [5520740,114239] 0 2024-09-21T00:56:44.916 INFO:tasks.workunit.client.0.smithi112.stdout:3/386: chown d2/d8/c2d 173 1 2024-09-21T00:56:44.917 INFO:tasks.workunit.client.1.smithi187.stdout:8/883: dwrite dc/f28 [0,4194304] 0 2024-09-21T00:56:44.920 INFO:tasks.workunit.client.1.smithi187.stdout:1/941: symlink d4/d6/d23/d2e/d94/d66/ddf/d12a/l134 0 2024-09-21T00:56:44.920 INFO:tasks.workunit.client.1.smithi187.stdout:6/850: write d7/d2a/d29/d40/fae [495509,102513] 0 2024-09-21T00:56:44.920 INFO:tasks.workunit.client.0.smithi112.stdout:8/178: unlink d0/d13/d1b/d22/d2e/f2f 0 2024-09-21T00:56:44.922 INFO:tasks.workunit.client.1.smithi187.stdout:1/942: readlink d4/d6/d23/d2e/d94/l61 0 2024-09-21T00:56:44.924 INFO:tasks.workunit.client.0.smithi112.stdout:4/338: dwrite d1/d5/d1c/f5b [0,4194304] 0 2024-09-21T00:56:44.924 INFO:tasks.workunit.client.0.smithi112.stdout:3/387: mknod d2/d8/d6d/c85 0 2024-09-21T00:56:44.932 INFO:tasks.workunit.client.1.smithi187.stdout:0/783: unlink d0/d60/cdf 0 2024-09-21T00:56:44.933 INFO:tasks.workunit.client.0.smithi112.stdout:8/179: symlink d0/l3a 0 2024-09-21T00:56:44.934 INFO:tasks.workunit.client.0.smithi112.stdout:8/180: truncate d0/d13/d1b/f32 161672 0 2024-09-21T00:56:44.935 INFO:tasks.workunit.client.1.smithi187.stdout:8/884: creat dc/d94/dfb/f131 x:0 0 0 2024-09-21T00:56:44.936 INFO:tasks.workunit.client.0.smithi112.stdout:4/339: mkdir d1/d75 0 2024-09-21T00:56:44.937 INFO:tasks.workunit.client.1.smithi187.stdout:7/766: mkdir d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d106 0 2024-09-21T00:56:44.939 INFO:tasks.workunit.client.1.smithi187.stdout:6/851: fsync d7/d2a/d29/d40/d45/f69 0 2024-09-21T00:56:44.940 INFO:tasks.workunit.client.0.smithi112.stdout:8/181: dwrite d0/f1d [0,4194304] 0 2024-09-21T00:56:44.943 INFO:tasks.workunit.client.1.smithi187.stdout:1/943: creat d4/d6/d23/d2e/d94/d35/d4c/f135 x:0 0 0 2024-09-21T00:56:44.946 INFO:tasks.workunit.client.0.smithi112.stdout:4/340: rmdir d1/d2d 39 2024-09-21T00:56:44.948 INFO:tasks.workunit.client.1.smithi187.stdout:9/993: truncate d4/d8/d46/fd3 392487 0 2024-09-21T00:56:44.950 INFO:tasks.workunit.client.1.smithi187.stdout:1/944: dwrite d4/d6/d64/fb3 [4194304,4194304] 0 2024-09-21T00:56:44.950 INFO:tasks.workunit.client.1.smithi187.stdout:7/767: rename d1/dce/dd0/d97/df1/d31/d33/d3b/d62/l83 to d1/dc/d15/d2b/l107 0 2024-09-21T00:56:44.950 INFO:tasks.workunit.client.1.smithi187.stdout:9/994: readlink d4/d8/d46/d54/d10f/d121/d94/d122/d128/l144 0 2024-09-21T00:56:44.951 INFO:tasks.workunit.client.1.smithi187.stdout:7/768: chown d1/d55/d80 131122 1 2024-09-21T00:56:44.953 INFO:tasks.workunit.client.0.smithi112.stdout:4/341: dwrite d1/d5/d1c/f65 [0,4194304] 0 2024-09-21T00:56:44.962 INFO:tasks.workunit.client.1.smithi187.stdout:8/885: mkdir dc/d44/d132 0 2024-09-21T00:56:44.963 INFO:tasks.workunit.client.1.smithi187.stdout:3/777: write d9/d7f/dcb/d87/d94/d53/f99 [2591372,109450] 0 2024-09-21T00:56:44.966 INFO:tasks.workunit.client.1.smithi187.stdout:7/769: mkdir d1/d55/d80/d108 0 2024-09-21T00:56:44.968 INFO:tasks.workunit.client.0.smithi112.stdout:3/388: rename d2/d38/d3f/d53/f80 to d2/f86 0 2024-09-21T00:56:44.969 INFO:tasks.workunit.client.1.smithi187.stdout:9/995: dread - d4/d61/d6a/d90/daa/df6/ffa zero size 2024-09-21T00:56:44.972 INFO:tasks.workunit.client.0.smithi112.stdout:4/342: truncate d1/d7/f2e 4062632 0 2024-09-21T00:56:44.975 INFO:tasks.workunit.client.0.smithi112.stdout:8/182: getdents d0/d13/d1b/d22/d2e/d34 0 2024-09-21T00:56:44.978 INFO:tasks.workunit.client.0.smithi112.stdout:4/343: mkdir d1/d5/d1c/d1e/d76 0 2024-09-21T00:56:44.978 INFO:tasks.workunit.client.1.smithi187.stdout:9/996: readlink d4/d13/l17 0 2024-09-21T00:56:44.981 INFO:tasks.workunit.client.1.smithi187.stdout:0/784: getdents d0/d60/d6b/d9f 0 2024-09-21T00:56:44.981 INFO:tasks.workunit.client.0.smithi112.stdout:3/389: link d2/ca d2/d8/dd/de/c87 0 2024-09-21T00:56:44.982 INFO:tasks.workunit.client.1.smithi187.stdout:8/886: rename dc/d2f/c3f to dc/d2f/d54/d69/c133 0 2024-09-21T00:56:44.984 INFO:tasks.workunit.client.0.smithi112.stdout:4/344: dwrite d1/f46 [0,4194304] 0 2024-09-21T00:56:44.984 INFO:tasks.workunit.client.1.smithi187.stdout:1/945: link d4/d6/l32 d4/d6/d23/d2e/d94/d35/d22/d65/db9/l136 0 2024-09-21T00:56:44.985 INFO:tasks.workunit.client.0.smithi112.stdout:3/390: mknod d2/d38/c88 0 2024-09-21T00:56:44.986 INFO:tasks.workunit.client.1.smithi187.stdout:0/785: fdatasync d0/d60/d6e/f74 0 2024-09-21T00:56:44.986 INFO:tasks.workunit.client.0.smithi112.stdout:4/345: mknod d1/d7/d9/d1a/c77 0 2024-09-21T00:56:44.988 INFO:tasks.workunit.client.1.smithi187.stdout:3/778: dread d9/d7f/dcb/d20/f68 [0,4194304] 0 2024-09-21T00:56:44.988 INFO:tasks.workunit.client.1.smithi187.stdout:7/770: dread d1/dce/dd0/d97/df1/f6b [0,4194304] 0 2024-09-21T00:56:44.988 INFO:tasks.workunit.client.0.smithi112.stdout:4/346: dread - d1/d7/d9/d1a/d22/f6f zero size 2024-09-21T00:56:44.989 INFO:tasks.workunit.client.1.smithi187.stdout:3/779: dread - d9/d7f/dcb/d87/d94/f65 zero size 2024-09-21T00:56:44.990 INFO:tasks.workunit.client.1.smithi187.stdout:8/887: rename dc/cde to dc/d2f/d34/d4b/d85/c134 0 2024-09-21T00:56:44.991 INFO:tasks.workunit.client.1.smithi187.stdout:7/771: unlink d1/dce/dd0/d97/df1/d31/d33/f46 0 2024-09-21T00:56:44.992 INFO:tasks.workunit.client.0.smithi112.stdout:4/347: creat d1/d7/d9/d1a/f78 x:0 0 0 2024-09-21T00:56:44.994 INFO:tasks.workunit.client.0.smithi112.stdout:3/391: dwrite d2/d8/dd/de/d4a/d4c/f6c [0,4194304] 0 2024-09-21T00:56:44.994 INFO:tasks.workunit.client.1.smithi187.stdout:3/780: fsync d9/d7f/dcb/d20/f68 0 2024-09-21T00:56:44.995 INFO:tasks.workunit.client.1.smithi187.stdout:3/781: fdatasync d9/d19/dca/fec 0 2024-09-21T00:56:44.995 INFO:tasks.workunit.client.1.smithi187.stdout:8/888: rmdir dc/d94/df6 39 2024-09-21T00:56:44.996 INFO:tasks.workunit.client.0.smithi112.stdout:4/348: mknod d1/d5/d1c/d6c/c79 0 2024-09-21T00:56:44.997 INFO:tasks.workunit.client.1.smithi187.stdout:3/782: read d9/d7f/dcb/d87/d94/d53/d56/d61/f63 [47501,92999] 0 2024-09-21T00:56:44.999 INFO:tasks.workunit.client.1.smithi187.stdout:3/783: write d9/d7f/dcb/d87/d94/d53/f76 [4853797,73787] 0 2024-09-21T00:56:45.000 INFO:tasks.workunit.client.0.smithi112.stdout:3/392: dwrite d2/d8/f11 [0,4194304] 0 2024-09-21T00:56:45.001 INFO:tasks.workunit.client.1.smithi187.stdout:0/786: link d0/l56 d0/d17/d1c/l10a 0 2024-09-21T00:56:45.002 INFO:tasks.workunit.client.1.smithi187.stdout:8/889: mkdir dc/d2f/d80/db8/dba/d135 0 2024-09-21T00:56:45.002 INFO:tasks.workunit.client.0.smithi112.stdout:3/393: readlink d2/d8/l6e 0 2024-09-21T00:56:45.003 INFO:tasks.workunit.client.0.smithi112.stdout:3/394: readlink d2/d8/l24 0 2024-09-21T00:56:45.004 INFO:tasks.workunit.client.0.smithi112.stdout:3/395: chown d2/d8/dd/de/d4a/d4c 4000368 1 2024-09-21T00:56:45.004 INFO:tasks.workunit.client.1.smithi187.stdout:0/787: symlink d0/d17/d1c/d23/d108/l10b 0 2024-09-21T00:56:45.005 INFO:tasks.workunit.client.1.smithi187.stdout:8/890: creat dc/d2f/d54/f136 x:0 0 0 2024-09-21T00:56:45.006 INFO:tasks.workunit.client.1.smithi187.stdout:3/784: dwrite d9/d19/ffe [0,4194304] 0 2024-09-21T00:56:45.007 INFO:tasks.workunit.client.0.smithi112.stdout:3/396: rename d2/d38/d3f/f83 to d2/d8/dd/f89 0 2024-09-21T00:56:45.008 INFO:tasks.workunit.client.1.smithi187.stdout:0/788: creat d0/d17/d1c/d23/df/d41/d3b/d46/f10c x:0 0 0 2024-09-21T00:56:45.009 INFO:tasks.workunit.client.1.smithi187.stdout:8/891: mkdir dc/d2f/d34/d137 0 2024-09-21T00:56:45.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:44 smithi112 ceph-mon[28078]: pgmap v25: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 65 MiB/s rd, 210 MiB/s wr, 395 op/s 2024-09-21T00:56:45.011 INFO:tasks.workunit.client.0.smithi112.stdout:3/397: dread d2/d33/f56 [0,4194304] 0 2024-09-21T00:56:45.013 INFO:tasks.workunit.client.1.smithi187.stdout:8/892: symlink dc/d2f/d37/l138 0 2024-09-21T00:56:45.014 INFO:tasks.workunit.client.1.smithi187.stdout:0/789: mknod d0/d60/d6b/d9f/de6/c10d 0 2024-09-21T00:56:45.015 INFO:tasks.workunit.client.0.smithi112.stdout:3/398: mkdir d2/d8/dd/de/d5c/d8a 0 2024-09-21T00:56:45.016 INFO:tasks.workunit.client.1.smithi187.stdout:0/790: write d0/d60/ffe [2087759,16705] 0 2024-09-21T00:56:45.019 INFO:tasks.workunit.client.0.smithi112.stdout:3/399: mknod d2/d38/d3f/d53/c8b 0 2024-09-21T00:56:45.020 INFO:tasks.workunit.client.0.smithi112.stdout:3/400: read d2/d8/dd/f2e [416037,81022] 0 2024-09-21T00:56:45.020 INFO:tasks.workunit.client.1.smithi187.stdout:8/893: creat dc/d2f/d80/db8/dba/d113/f139 x:0 0 0 2024-09-21T00:56:45.021 INFO:tasks.workunit.client.1.smithi187.stdout:0/791: dwrite d0/d60/ffe [4194304,4194304] 0 2024-09-21T00:56:45.021 INFO:tasks.workunit.client.0.smithi112.stdout:3/401: dread - d2/d3e/f71 zero size 2024-09-21T00:56:45.024 INFO:tasks.workunit.client.1.smithi187.stdout:8/894: mknod dc/df2/c13a 0 2024-09-21T00:56:45.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/402: rename d2/d6a to d2/d33/d8c 0 2024-09-21T00:56:45.026 INFO:tasks.workunit.client.1.smithi187.stdout:8/895: write dc/d44/dc1/f128 [846549,24215] 0 2024-09-21T00:56:45.030 INFO:tasks.workunit.client.0.smithi112.stdout:3/403: symlink d2/d8/dd/de/d6b/l8d 0 2024-09-21T00:56:45.034 INFO:tasks.workunit.client.0.smithi112.stdout:3/404: creat d2/d8/dd/de/f8e x:0 0 0 2024-09-21T00:56:45.035 INFO:tasks.workunit.client.1.smithi187.stdout:8/896: symlink dc/d94/df6/l13b 0 2024-09-21T00:56:45.035 INFO:tasks.workunit.client.1.smithi187.stdout:0/792: link d0/d17/d1c/d23/d36/fa3 d0/d17/d18/d90/f10e 0 2024-09-21T00:56:45.036 INFO:tasks.workunit.client.1.smithi187.stdout:0/793: fsync d0/f9a 0 2024-09-21T00:56:45.037 INFO:tasks.workunit.client.0.smithi112.stdout:3/405: creat d2/d8/dd/de/d6b/f8f x:0 0 0 2024-09-21T00:56:45.040 INFO:tasks.workunit.client.0.smithi112.stdout:3/406: creat d2/d8/d28/f90 x:0 0 0 2024-09-21T00:56:45.042 INFO:tasks.workunit.client.0.smithi112.stdout:3/407: dread d2/d8/dd/f27 [0,4194304] 0 2024-09-21T00:56:45.043 INFO:tasks.workunit.client.0.smithi112.stdout:3/408: readlink d2/d38/l5a 0 2024-09-21T00:56:45.043 INFO:tasks.workunit.client.0.smithi112.stdout:3/409: stat d2/d8/dd/f89 0 2024-09-21T00:56:45.065 INFO:tasks.workunit.client.0.smithi112.stdout:2/276: write d0/d14/d8/d27/f59 [41068,128765] 0 2024-09-21T00:56:45.067 INFO:tasks.workunit.client.0.smithi112.stdout:4/349: dread d1/d7/d9/f5a [0,4194304] 0 2024-09-21T00:56:45.069 INFO:tasks.workunit.client.0.smithi112.stdout:2/277: write d0/d14/d8/d27/f2d [382614,17973] 0 2024-09-21T00:56:45.070 INFO:tasks.workunit.client.0.smithi112.stdout:2/278: write d0/d51/f54 [1036386,15940] 0 2024-09-21T00:56:45.071 INFO:tasks.workunit.client.0.smithi112.stdout:4/350: mknod d1/d7/d9/d1a/d22/d6e/c7a 0 2024-09-21T00:56:45.071 INFO:tasks.workunit.client.1.smithi187.stdout:6/852: write d7/d2a/d29/d40/d50/d83/f87 [426429,11196] 0 2024-09-21T00:56:45.072 INFO:tasks.workunit.client.0.smithi112.stdout:2/279: creat d0/d14/f5d x:0 0 0 2024-09-21T00:56:45.072 INFO:tasks.workunit.client.1.smithi187.stdout:8/897: dread dc/d2f/d80/db8/dba/d29/f2c [0,4194304] 0 2024-09-21T00:56:45.073 INFO:tasks.workunit.client.1.smithi187.stdout:8/898: fdatasync dc/d2f/d80/db8/dba/f21 0 2024-09-21T00:56:45.073 INFO:tasks.workunit.client.0.smithi112.stdout:4/351: dread - d1/d2d/f50 zero size 2024-09-21T00:56:45.074 INFO:tasks.workunit.client.0.smithi112.stdout:4/352: chown d1/d7/f17 462100 1 2024-09-21T00:56:45.076 INFO:tasks.workunit.client.0.smithi112.stdout:2/280: mknod d0/c5e 0 2024-09-21T00:56:45.078 INFO:tasks.workunit.client.1.smithi187.stdout:6/853: truncate d7/d2a/d29/d40/d6a/da1/ff3 964131 0 2024-09-21T00:56:45.079 INFO:tasks.workunit.client.0.smithi112.stdout:2/281: unlink d0/d14/c49 0 2024-09-21T00:56:45.080 INFO:tasks.workunit.client.0.smithi112.stdout:2/282: truncate d0/d14/f4e 401017 0 2024-09-21T00:56:45.081 INFO:tasks.workunit.client.1.smithi187.stdout:8/899: fdatasync dc/d2f/f45 0 2024-09-21T00:56:45.082 INFO:tasks.workunit.client.0.smithi112.stdout:4/353: symlink d1/l7b 0 2024-09-21T00:56:45.083 INFO:tasks.workunit.client.0.smithi112.stdout:4/354: chown d1/d5/d1c/d1e/d76 1203984 1 2024-09-21T00:56:45.083 INFO:tasks.workunit.client.1.smithi187.stdout:6/854: write d7/ff [2516285,128769] 0 2024-09-21T00:56:45.083 INFO:tasks.workunit.client.0.smithi112.stdout:4/355: stat d1/d5/d1c/d1e/d4a 0 2024-09-21T00:56:45.084 INFO:tasks.workunit.client.0.smithi112.stdout:4/356: stat d1/d5/d1c/d1e 0 2024-09-21T00:56:45.085 INFO:tasks.workunit.client.0.smithi112.stdout:4/357: read - d1/d7/d9/d1a/f78 zero size 2024-09-21T00:56:45.086 INFO:tasks.workunit.client.0.smithi112.stdout:4/358: write d1/d2d/d34/f58 [812490,89315] 0 2024-09-21T00:56:45.087 INFO:tasks.workunit.client.0.smithi112.stdout:4/359: read - d1/d5/d1c/d6c/f6d zero size 2024-09-21T00:56:45.089 INFO:tasks.workunit.client.0.smithi112.stdout:8/183: truncate d0/d13/f16 2824885 0 2024-09-21T00:56:45.090 INFO:tasks.workunit.client.1.smithi187.stdout:7/772: fdatasync d1/dc/d15/d22/f86 0 2024-09-21T00:56:45.093 INFO:tasks.workunit.client.1.smithi187.stdout:9/997: truncate d4/d13/d14/f1e 2763336 0 2024-09-21T00:56:45.095 INFO:tasks.workunit.client.0.smithi112.stdout:4/360: unlink d1/d7/d9/l27 0 2024-09-21T00:56:45.096 INFO:tasks.workunit.client.0.smithi112.stdout:4/361: readlink d1/d7/d9/d1a/l33 0 2024-09-21T00:56:45.097 INFO:tasks.workunit.client.1.smithi187.stdout:7/773: dread d1/dce/dd0/d97/df1/d31/d33/f95 [0,4194304] 0 2024-09-21T00:56:45.097 INFO:tasks.workunit.client.1.smithi187.stdout:8/900: rename dc/d2f/d80/db8/dba/d3e/d75/f11c to dc/d2f/d80/db8/d122/f13c 0 2024-09-21T00:56:45.098 INFO:tasks.workunit.client.1.smithi187.stdout:9/998: dwrite d4/d10/d8f/f95 [0,4194304] 0 2024-09-21T00:56:45.103 INFO:tasks.workunit.client.0.smithi112.stdout:4/362: symlink d1/d5/l7c 0 2024-09-21T00:56:45.104 INFO:tasks.workunit.client.0.smithi112.stdout:8/184: link d0/d13/d1b/c1c d0/d13/c3b 0 2024-09-21T00:56:45.107 INFO:tasks.workunit.client.1.smithi187.stdout:8/901: truncate dc/d2f/d54/d69/f9c 955888 0 2024-09-21T00:56:45.109 INFO:tasks.workunit.client.1.smithi187.stdout:8/902: read dc/d2f/d37/fbe [121939,7399] 0 2024-09-21T00:56:45.110 INFO:tasks.workunit.client.1.smithi187.stdout:8/903: stat dc/d2f/d37/fda 0 2024-09-21T00:56:45.110 INFO:tasks.workunit.client.1.smithi187.stdout:7/774: creat d1/dc/d15/f109 x:0 0 0 2024-09-21T00:56:45.113 INFO:tasks.workunit.client.1.smithi187.stdout:7/775: write d1/d55/d80/f84 [14336,80104] 0 2024-09-21T00:56:45.114 INFO:tasks.workunit.client.1.smithi187.stdout:3/785: dwrite d9/d7f/dcb/d87/d94/d53/d56/d61/f63 [0,4194304] 0 2024-09-21T00:56:45.117 INFO:tasks.workunit.client.1.smithi187.stdout:7/776: creat d1/dce/dd0/d97/df1/d31/d41/d8a/dd5/f10a x:0 0 0 2024-09-21T00:56:45.118 INFO:tasks.workunit.client.1.smithi187.stdout:3/786: mknod d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/c109 0 2024-09-21T00:56:45.120 INFO:tasks.workunit.client.1.smithi187.stdout:0/794: write d0/d5a/f85 [503854,4336] 0 2024-09-21T00:56:45.122 INFO:tasks.workunit.client.1.smithi187.stdout:7/777: mknod d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/c10b 0 2024-09-21T00:56:45.122 INFO:tasks.workunit.client.0.smithi112.stdout:3/410: write d2/d8/f16 [449853,83783] 0 2024-09-21T00:56:45.123 INFO:tasks.workunit.client.1.smithi187.stdout:0/795: dread - d0/d17/d1c/d23/df/d41/d3b/d46/fc5 zero size 2024-09-21T00:56:45.123 INFO:tasks.workunit.client.1.smithi187.stdout:7/778: dread - d1/d55/d80/f101 zero size 2024-09-21T00:56:45.123 INFO:tasks.workunit.client.1.smithi187.stdout:3/787: truncate d9/d7f/dcb/d87/d94/d53/d56/d61/f74 4371254 0 2024-09-21T00:56:45.125 INFO:tasks.workunit.client.0.smithi112.stdout:3/411: creat d2/d38/f91 x:0 0 0 2024-09-21T00:56:45.129 INFO:tasks.workunit.client.1.smithi187.stdout:3/788: dwrite d9/d19/ffe [0,4194304] 0 2024-09-21T00:56:45.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/412: dread f1 [0,4194304] 0 2024-09-21T00:56:45.130 INFO:tasks.workunit.client.1.smithi187.stdout:7/779: symlink d1/dce/dd0/d97/df1/l10c 0 2024-09-21T00:56:45.133 INFO:tasks.workunit.client.1.smithi187.stdout:8/904: dread dc/f15 [0,4194304] 0 2024-09-21T00:56:45.135 INFO:tasks.workunit.client.0.smithi112.stdout:3/413: symlink d2/d8/dd/l92 0 2024-09-21T00:56:45.137 INFO:tasks.workunit.client.1.smithi187.stdout:3/789: link d9/d7f/dcb/d20/ld9 d9/d7f/dcb/d87/d94/d89/dc1/l10a 0 2024-09-21T00:56:45.140 INFO:tasks.workunit.client.0.smithi112.stdout:2/283: dwrite d0/fe [0,4194304] 0 2024-09-21T00:56:45.142 INFO:tasks.workunit.client.1.smithi187.stdout:7/780: rename d1/dce/dd0/d97/df1/d31/f51 to d1/dce/dd0/d97/df1/d31/d41/d8a/d100/f10d 0 2024-09-21T00:56:45.144 INFO:tasks.workunit.client.1.smithi187.stdout:8/905: symlink dc/d2f/d34/d137/l13d 0 2024-09-21T00:56:45.146 INFO:tasks.workunit.client.0.smithi112.stdout:3/414: creat d2/d3e/d7b/f93 x:0 0 0 2024-09-21T00:56:45.146 INFO:tasks.workunit.client.0.smithi112.stdout:3/415: stat d2/d8/c2d 0 2024-09-21T00:56:45.147 INFO:tasks.workunit.client.1.smithi187.stdout:3/790: creat d9/d19/dca/dd6/f10b x:0 0 0 2024-09-21T00:56:45.149 INFO:tasks.workunit.client.1.smithi187.stdout:9/999: write d4/d8/d46/d54/d10f/d121/fdb [1026474,46287] 0 2024-09-21T00:56:45.149 INFO:tasks.workunit.client.0.smithi112.stdout:3/416: creat d2/d33/f94 x:0 0 0 2024-09-21T00:56:45.150 INFO:tasks.workunit.client.1.smithi187.stdout:3/791: truncate d9/d7f/dcb/d87/d94/d89/f93 553063 0 2024-09-21T00:56:45.150 INFO:tasks.workunit.client.1.smithi187.stdout:7/781: rmdir d1/dc/d15/d2b 39 2024-09-21T00:56:45.151 INFO:tasks.workunit.client.1.smithi187.stdout:3/792: stat d9/d19/da7/daa/dce 0 2024-09-21T00:56:45.153 INFO:tasks.workunit.client.1.smithi187.stdout:8/906: symlink dc/d2f/d80/db8/dba/d113/l13e 0 2024-09-21T00:56:45.154 INFO:tasks.workunit.client.1.smithi187.stdout:7/782: stat d1/f2 0 2024-09-21T00:56:45.155 INFO:tasks.workunit.client.1.smithi187.stdout:8/907: rmdir dc/d94/dfb 39 2024-09-21T00:56:45.156 INFO:tasks.workunit.client.0.smithi112.stdout:8/185: dwrite d0/d13/f29 [0,4194304] 0 2024-09-21T00:56:45.157 INFO:tasks.workunit.client.1.smithi187.stdout:8/908: chown dc/d44/dc1/d11e 219584 1 2024-09-21T00:56:45.157 INFO:tasks.workunit.client.0.smithi112.stdout:3/417: creat d2/f95 x:0 0 0 2024-09-21T00:56:45.158 INFO:tasks.workunit.client.1.smithi187.stdout:3/793: dwrite d9/d19/d9b/fcf [0,4194304] 0 2024-09-21T00:56:45.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:44 smithi187 ceph-mon[34997]: pgmap v25: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 65 MiB/s rd, 210 MiB/s wr, 395 op/s 2024-09-21T00:56:45.159 INFO:tasks.workunit.client.0.smithi112.stdout:3/418: write d2/f5e [921265,120192] 0 2024-09-21T00:56:45.165 INFO:tasks.workunit.client.0.smithi112.stdout:3/419: mkdir d2/d38/d3f/d53/d96 0 2024-09-21T00:56:45.167 INFO:tasks.workunit.client.1.smithi187.stdout:3/794: fsync d9/d7f/dcb/d87/fb8 0 2024-09-21T00:56:45.168 INFO:tasks.workunit.client.1.smithi187.stdout:8/909: mknod dc/d2f/d80/db8/c13f 0 2024-09-21T00:56:45.169 INFO:tasks.workunit.client.1.smithi187.stdout:0/796: write d0/d17/d1c/d23/f99 [569916,53739] 0 2024-09-21T00:56:45.169 INFO:tasks.workunit.client.0.smithi112.stdout:3/420: mknod d2/d38/d3f/c97 0 2024-09-21T00:56:45.170 INFO:tasks.workunit.client.0.smithi112.stdout:3/421: write d2/d3e/f47 [779786,18498] 0 2024-09-21T00:56:45.170 INFO:tasks.workunit.client.1.smithi187.stdout:8/910: chown dc/d2f/d80/db8/dba/d29/f31 49302 1 2024-09-21T00:56:45.172 INFO:tasks.workunit.client.1.smithi187.stdout:3/795: unlink d9/d7f/dcb/d87/d94/f65 0 2024-09-21T00:56:45.176 INFO:tasks.workunit.client.1.smithi187.stdout:0/797: dread d0/d5a/fef [0,4194304] 0 2024-09-21T00:56:45.177 INFO:tasks.workunit.client.1.smithi187.stdout:0/798: rename d0 to d0/d17/d18/d90/d98/d10f 22 2024-09-21T00:56:45.177 INFO:tasks.workunit.client.0.smithi112.stdout:2/284: dread d0/d14/f35 [0,4194304] 0 2024-09-21T00:56:45.178 INFO:tasks.workunit.client.1.smithi187.stdout:0/799: dread - d0/fa7 zero size 2024-09-21T00:56:45.178 INFO:tasks.workunit.client.0.smithi112.stdout:2/285: fdatasync d0/d14/d8/f44 0 2024-09-21T00:56:45.178 INFO:tasks.workunit.client.0.smithi112.stdout:3/422: rename d2/l39 to d2/d3e/l98 0 2024-09-21T00:56:45.184 INFO:tasks.workunit.client.1.smithi187.stdout:8/911: symlink dc/d44/dc1/d11e/l140 0 2024-09-21T00:56:45.189 INFO:tasks.workunit.client.0.smithi112.stdout:3/423: mknod d2/d8/dd/de/d4a/d4c/d7c/c99 0 2024-09-21T00:56:45.190 INFO:tasks.workunit.client.1.smithi187.stdout:3/796: creat d9/d7f/dcb/d87/d94/d53/d56/dc9/f10c x:0 0 0 2024-09-21T00:56:45.190 INFO:tasks.workunit.client.1.smithi187.stdout:3/797: fsync d9/d19/d1c/d5f/f92 0 2024-09-21T00:56:45.198 INFO:tasks.workunit.client.1.smithi187.stdout:3/798: creat d9/d7f/dcb/d87/d94/d53/f10d x:0 0 0 2024-09-21T00:56:45.200 INFO:tasks.workunit.client.1.smithi187.stdout:3/799: mknod d9/d7f/dcb/d87/d94/d89/c10e 0 2024-09-21T00:56:45.201 INFO:tasks.workunit.client.1.smithi187.stdout:3/800: chown d9/d7f/dcb/d20 2753375 1 2024-09-21T00:56:45.201 INFO:tasks.workunit.client.1.smithi187.stdout:0/800: dread d0/f70 [0,4194304] 0 2024-09-21T00:56:45.203 INFO:tasks.workunit.client.1.smithi187.stdout:8/912: write dc/d2f/d80/db8/dba/f2a [582404,20536] 0 2024-09-21T00:56:45.204 INFO:tasks.workunit.client.0.smithi112.stdout:2/286: dwrite d0/df/f34 [0,4194304] 0 2024-09-21T00:56:45.206 INFO:tasks.workunit.client.1.smithi187.stdout:7/783: dread d1/dce/dd0/d97/df1/d31/d41/d64/d93/ff0 [0,4194304] 0 2024-09-21T00:56:45.211 INFO:tasks.workunit.client.0.smithi112.stdout:3/424: dwrite d2/d8/f5b [0,4194304] 0 2024-09-21T00:56:45.212 INFO:tasks.workunit.client.1.smithi187.stdout:3/801: write d9/f37 [1738457,58417] 0 2024-09-21T00:56:45.212 INFO:tasks.workunit.client.1.smithi187.stdout:8/913: dread dc/d2f/d54/d69/fa0 [0,4194304] 0 2024-09-21T00:56:45.214 INFO:tasks.workunit.client.0.smithi112.stdout:3/425: write d2/d33/d78/f7f [338459,35783] 0 2024-09-21T00:56:45.214 INFO:tasks.workunit.client.1.smithi187.stdout:7/784: getdents d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d106 0 2024-09-21T00:56:45.214 INFO:tasks.workunit.client.1.smithi187.stdout:0/801: creat d0/d17/d18/f110 x:0 0 0 2024-09-21T00:56:45.214 INFO:tasks.workunit.client.1.smithi187.stdout:3/802: chown d9/d7f/dcb/d87/d94/d53/d56/d61/cea 23 1 2024-09-21T00:56:45.215 INFO:tasks.workunit.client.1.smithi187.stdout:7/785: stat d1/c4b 0 2024-09-21T00:56:45.216 INFO:tasks.workunit.client.1.smithi187.stdout:7/786: fsync d1/dce/dd0/d97/f9b 0 2024-09-21T00:56:45.216 INFO:tasks.workunit.client.0.smithi112.stdout:8/186: dwrite d0/d13/d1b/d22/f24 [0,4194304] 0 2024-09-21T00:56:45.217 INFO:tasks.workunit.client.0.smithi112.stdout:8/187: fdatasync d0/d13/d2a/f39 0 2024-09-21T00:56:45.218 INFO:tasks.workunit.client.0.smithi112.stdout:3/426: creat d2/d8/dd/de/d5c/f9a x:0 0 0 2024-09-21T00:56:45.219 INFO:tasks.workunit.client.0.smithi112.stdout:3/427: dread - d2/d33/f94 zero size 2024-09-21T00:56:45.220 INFO:tasks.workunit.client.0.smithi112.stdout:8/188: stat d0/d13/c3b 0 2024-09-21T00:56:45.220 INFO:tasks.workunit.client.1.smithi187.stdout:0/802: symlink d0/d17/d1c/d23/df/dca/d100/l111 0 2024-09-21T00:56:45.221 INFO:tasks.workunit.client.1.smithi187.stdout:2/903: sync 2024-09-21T00:56:45.221 INFO:tasks.workunit.client.0.smithi112.stdout:8/189: chown d0/d13/d1b/c1c 1411 1 2024-09-21T00:56:45.221 INFO:tasks.workunit.client.0.smithi112.stdout:3/428: creat d2/d33/f9b x:0 0 0 2024-09-21T00:56:45.222 INFO:tasks.workunit.client.1.smithi187.stdout:0/803: chown d0/d17/d1c/d23/df/d41/f8e 0 1 2024-09-21T00:56:45.223 INFO:tasks.workunit.client.0.smithi112.stdout:2/287: write d0/d14/f9 [640407,32021] 0 2024-09-21T00:56:45.225 INFO:tasks.workunit.client.1.smithi187.stdout:2/904: rmdir d2/da8/d6c/d97 39 2024-09-21T00:56:45.227 INFO:tasks.workunit.client.0.smithi112.stdout:3/429: unlink d2/d3e/f66 0 2024-09-21T00:56:45.232 INFO:tasks.workunit.client.0.smithi112.stdout:3/430: getdents d2/d8/dd/de/d6b 0 2024-09-21T00:56:45.234 INFO:tasks.workunit.client.0.smithi112.stdout:3/431: getdents d2/d38/d3f/d53/d96 0 2024-09-21T00:56:45.234 INFO:tasks.workunit.client.0.smithi112.stdout:2/288: dwrite d0/d14/f19 [0,4194304] 0 2024-09-21T00:56:45.235 INFO:tasks.workunit.client.0.smithi112.stdout:2/289: truncate d0/d51/f57 678203 0 2024-09-21T00:56:45.236 INFO:tasks.workunit.client.0.smithi112.stdout:3/432: rmdir d2/d8/dd/de/d4a/d4c 39 2024-09-21T00:56:45.237 INFO:tasks.workunit.client.0.smithi112.stdout:2/290: truncate d0/d14/f50 978860 0 2024-09-21T00:56:45.237 INFO:tasks.workunit.client.0.smithi112.stdout:2/291: fsync d0/f5 0 2024-09-21T00:56:45.238 INFO:tasks.workunit.client.0.smithi112.stdout:3/433: readlink d2/l32 0 2024-09-21T00:56:45.238 INFO:tasks.workunit.client.0.smithi112.stdout:3/434: dread - d2/d38/f4b zero size 2024-09-21T00:56:45.241 INFO:tasks.workunit.client.0.smithi112.stdout:3/435: rmdir d2/d38 39 2024-09-21T00:56:45.244 INFO:tasks.workunit.client.0.smithi112.stdout:3/436: mknod d2/d8/dd/de/d6b/c9c 0 2024-09-21T00:56:45.246 INFO:tasks.workunit.client.0.smithi112.stdout:2/292: rmdir d0/d14/d8/d4f 0 2024-09-21T00:56:45.247 INFO:tasks.workunit.client.0.smithi112.stdout:2/293: dread - d0/d14/d8/f44 zero size 2024-09-21T00:56:45.248 INFO:tasks.workunit.client.0.smithi112.stdout:3/437: mkdir d2/d8/d28/d9d 0 2024-09-21T00:56:45.248 INFO:tasks.workunit.client.0.smithi112.stdout:3/438: chown d2/d8/l6e 1427 1 2024-09-21T00:56:45.249 INFO:tasks.workunit.client.0.smithi112.stdout:8/190: write d0/fd [4178958,127393] 0 2024-09-21T00:56:45.251 INFO:tasks.workunit.client.0.smithi112.stdout:2/294: dread d0/d14/f9 [0,4194304] 0 2024-09-21T00:56:45.255 INFO:tasks.workunit.client.0.smithi112.stdout:8/191: link d0/fb d0/f3c 0 2024-09-21T00:56:45.255 INFO:tasks.workunit.client.0.smithi112.stdout:3/439: dwrite d2/f95 [0,4194304] 0 2024-09-21T00:56:45.260 INFO:tasks.workunit.client.0.smithi112.stdout:3/440: mkdir d2/d8/d28/d35/d9e 0 2024-09-21T00:56:45.264 INFO:tasks.workunit.client.0.smithi112.stdout:8/192: dwrite d0/d13/d1b/d22/f25 [0,4194304] 0 2024-09-21T00:56:45.265 INFO:tasks.workunit.client.0.smithi112.stdout:3/441: getdents d2/d8 0 2024-09-21T00:56:45.266 INFO:tasks.workunit.client.0.smithi112.stdout:3/442: dread - d2/d33/f94 zero size 2024-09-21T00:56:45.268 INFO:tasks.workunit.client.0.smithi112.stdout:8/193: getdents d0/d13/d1b 0 2024-09-21T00:56:45.269 INFO:tasks.workunit.client.0.smithi112.stdout:8/194: chown d0/d13/d2a 236711602 1 2024-09-21T00:56:45.270 INFO:tasks.workunit.client.0.smithi112.stdout:8/195: fsync d0/d13/f16 0 2024-09-21T00:56:45.272 INFO:tasks.workunit.client.0.smithi112.stdout:3/443: link d2/d33/f56 d2/d8/d28/d9d/f9f 0 2024-09-21T00:56:45.273 INFO:tasks.workunit.client.0.smithi112.stdout:2/295: dwrite d0/d51/f55 [4194304,4194304] 0 2024-09-21T00:56:45.279 INFO:tasks.workunit.client.0.smithi112.stdout:8/196: dread d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:56:45.279 INFO:tasks.workunit.client.0.smithi112.stdout:2/296: unlink d0/d14/d8/d27/f2d 0 2024-09-21T00:56:45.280 INFO:tasks.workunit.client.1.smithi187.stdout:7/787: dread d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/da6/fb9 [0,4194304] 0 2024-09-21T00:56:45.280 INFO:tasks.workunit.client.1.smithi187.stdout:0/804: rename d0/d17/d1c to d0/d17/d18/d3a/d97/d112 0 2024-09-21T00:56:45.280 INFO:tasks.workunit.client.0.smithi112.stdout:8/197: write d0/f21 [2146332,27802] 0 2024-09-21T00:56:45.281 INFO:tasks.workunit.client.0.smithi112.stdout:3/444: dread d2/f95 [0,4194304] 0 2024-09-21T00:56:45.286 INFO:tasks.workunit.client.0.smithi112.stdout:8/198: mkdir d0/d13/d1b/d22/d2e/d3d 0 2024-09-21T00:56:45.288 INFO:tasks.workunit.client.0.smithi112.stdout:8/199: dread - d0/d13/d1b/f35 zero size 2024-09-21T00:56:45.290 INFO:tasks.workunit.client.0.smithi112.stdout:3/445: dwrite d2/d8/dd/f1f [0,4194304] 0 2024-09-21T00:56:45.290 INFO:tasks.workunit.client.1.smithi187.stdout:0/805: creat d0/d17/d18/d90/d98/ddd/f113 x:0 0 0 2024-09-21T00:56:45.290 INFO:tasks.workunit.client.1.smithi187.stdout:7/788: creat d1/dce/dd0/d97/df1/d31/d41/d8a/f10e x:0 0 0 2024-09-21T00:56:45.290 INFO:tasks.workunit.client.0.smithi112.stdout:2/297: truncate d0/f5 1655404 0 2024-09-21T00:56:45.291 INFO:tasks.workunit.client.0.smithi112.stdout:8/200: fdatasync d0/f3c 0 2024-09-21T00:56:45.298 INFO:tasks.workunit.client.0.smithi112.stdout:8/201: creat d0/f3e x:0 0 0 2024-09-21T00:56:45.299 INFO:tasks.workunit.client.0.smithi112.stdout:2/298: dwrite d0/d51/f54 [0,4194304] 0 2024-09-21T00:56:45.299 INFO:tasks.workunit.client.0.smithi112.stdout:8/202: write d0/f21 [4765311,48185] 0 2024-09-21T00:56:45.300 INFO:tasks.workunit.client.0.smithi112.stdout:8/203: dread - d0/d13/d1b/f35 zero size 2024-09-21T00:56:45.301 INFO:tasks.workunit.client.0.smithi112.stdout:3/446: creat d2/d8/dd/de/d4a/d4c/fa0 x:0 0 0 2024-09-21T00:56:45.302 INFO:tasks.workunit.client.1.smithi187.stdout:8/914: dread dc/fc3 [0,4194304] 0 2024-09-21T00:56:45.303 INFO:tasks.workunit.client.1.smithi187.stdout:8/915: stat l5 0 2024-09-21T00:56:45.307 INFO:tasks.workunit.client.1.smithi187.stdout:2/905: dread d2/d3/d15/dfe/d2d/d8f/d9f/fa2 [0,4194304] 0 2024-09-21T00:56:45.308 INFO:tasks.workunit.client.0.smithi112.stdout:8/204: dwrite d0/d13/f27 [0,4194304] 0 2024-09-21T00:56:45.309 INFO:tasks.workunit.client.0.smithi112.stdout:3/447: write d2/d8/dd/f2e [489111,6926] 0 2024-09-21T00:56:45.314 INFO:tasks.workunit.client.0.smithi112.stdout:3/448: symlink d2/d8/d28/la1 0 2024-09-21T00:56:45.316 INFO:tasks.workunit.client.0.smithi112.stdout:3/449: write d2/d8/dd/f2e [2669572,129069] 0 2024-09-21T00:56:45.319 INFO:tasks.workunit.client.0.smithi112.stdout:8/205: link d0/d13/d1b/d22/f24 d0/d13/f3f 0 2024-09-21T00:56:45.322 INFO:tasks.workunit.client.0.smithi112.stdout:3/450: creat d2/d8/d6d/fa2 x:0 0 0 2024-09-21T00:56:45.325 INFO:tasks.workunit.client.0.smithi112.stdout:8/206: creat d0/d13/d1b/d22/d2e/d3d/f40 x:0 0 0 2024-09-21T00:56:45.325 INFO:tasks.workunit.client.0.smithi112.stdout:2/299: write d0/d14/d8/d27/f38 [930448,64905] 0 2024-09-21T00:56:45.327 INFO:tasks.workunit.client.0.smithi112.stdout:3/451: rename d2/d8/dd/de/c34 to d2/d8/dd/de/ca3 0 2024-09-21T00:56:45.330 INFO:tasks.workunit.client.0.smithi112.stdout:3/452: mknod d2/d33/d78/ca4 0 2024-09-21T00:56:45.331 INFO:tasks.workunit.client.0.smithi112.stdout:8/207: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:45.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/453: readlink d2/d33/l36 0 2024-09-21T00:56:45.332 INFO:tasks.workunit.client.0.smithi112.stdout:6/265: sync 2024-09-21T00:56:45.332 INFO:tasks.workunit.client.0.smithi112.stdout:7/237: sync 2024-09-21T00:56:45.332 INFO:tasks.workunit.client.0.smithi112.stdout:3/454: fsync d2/d33/d8c/f76 0 2024-09-21T00:56:45.334 INFO:tasks.workunit.client.0.smithi112.stdout:7/238: write d0/f10 [6801103,120962] 0 2024-09-21T00:56:45.335 INFO:tasks.workunit.client.0.smithi112.stdout:7/239: fdatasync d0/d2/d36/d39/d1a/f44 0 2024-09-21T00:56:45.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/208: creat d0/f41 x:0 0 0 2024-09-21T00:56:45.337 INFO:tasks.workunit.client.0.smithi112.stdout:7/240: write d0/d2/d36/d39/d1a/f44 [667180,91502] 0 2024-09-21T00:56:45.338 INFO:tasks.workunit.client.0.smithi112.stdout:6/266: symlink d9/d13/d31/d41/l67 0 2024-09-21T00:56:45.339 INFO:tasks.workunit.client.0.smithi112.stdout:3/455: symlink d2/d33/d8c/la5 0 2024-09-21T00:56:45.347 INFO:tasks.workunit.client.0.smithi112.stdout:3/456: dwrite d2/d8/dd/de/f18 [0,4194304] 0 2024-09-21T00:56:45.348 INFO:tasks.workunit.client.0.smithi112.stdout:3/457: chown d2/d8/d28/d9d/f9f 576009 1 2024-09-21T00:56:45.348 INFO:tasks.workunit.client.1.smithi187.stdout:4/878: sync 2024-09-21T00:56:45.349 INFO:tasks.workunit.client.0.smithi112.stdout:3/458: write d2/d8/dd/de/d4a/d4c/f6c [1082530,55452] 0 2024-09-21T00:56:45.350 INFO:tasks.workunit.client.0.smithi112.stdout:6/267: creat d9/d13/d31/f68 x:0 0 0 2024-09-21T00:56:45.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/459: mknod d2/d8/d28/d35/d9e/ca6 0 2024-09-21T00:56:45.366 INFO:tasks.workunit.client.0.smithi112.stdout:7/241: dread d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:45.367 INFO:tasks.workunit.client.0.smithi112.stdout:3/460: fdatasync d2/d38/d3f/f49 0 2024-09-21T00:56:45.371 INFO:tasks.workunit.client.0.smithi112.stdout:3/461: symlink d2/d33/d78/la7 0 2024-09-21T00:56:45.371 INFO:tasks.workunit.client.0.smithi112.stdout:3/462: dread - d2/d8/d28/f54 zero size 2024-09-21T00:56:45.376 INFO:tasks.workunit.client.0.smithi112.stdout:3/463: creat d2/d3e/fa8 x:0 0 0 2024-09-21T00:56:45.379 INFO:tasks.workunit.client.0.smithi112.stdout:3/464: rmdir d2/d8 39 2024-09-21T00:56:45.387 INFO:tasks.workunit.client.0.smithi112.stdout:8/209: dwrite d0/d13/d1b/d22/f23 [0,4194304] 0 2024-09-21T00:56:45.390 INFO:tasks.workunit.client.1.smithi187.stdout:0/806: rename d0/d17/d18/d3a/d97/d112/d23/df/dca to d0/d17/d18/d3a/d114 0 2024-09-21T00:56:45.394 INFO:tasks.workunit.client.1.smithi187.stdout:2/906: rmdir d2/d3/d15/dfe/d2d/d8f/d9f/d8c 39 2024-09-21T00:56:45.396 INFO:tasks.workunit.client.1.smithi187.stdout:4/879: creat d2/d3/da/d2f/d4b/d7e/dc8/d97/f10a x:0 0 0 2024-09-21T00:56:45.396 INFO:tasks.workunit.client.0.smithi112.stdout:6/268: write d9/d13/d26/f52 [132727,34583] 0 2024-09-21T00:56:45.397 INFO:tasks.workunit.client.0.smithi112.stdout:8/210: unlink d0/ff 0 2024-09-21T00:56:45.398 INFO:tasks.workunit.client.0.smithi112.stdout:6/269: read d9/d13/f15 [3537154,116864] 0 2024-09-21T00:56:45.399 INFO:tasks.workunit.client.1.smithi187.stdout:0/807: creat d0/d5a/f115 x:0 0 0 2024-09-21T00:56:45.400 INFO:tasks.workunit.client.0.smithi112.stdout:8/211: fdatasync d0/d13/d1b/d22/f24 0 2024-09-21T00:56:45.401 INFO:tasks.workunit.client.1.smithi187.stdout:6/855: sync 2024-09-21T00:56:45.401 INFO:tasks.workunit.client.1.smithi187.stdout:5/776: sync 2024-09-21T00:56:45.401 INFO:tasks.workunit.client.1.smithi187.stdout:1/946: sync 2024-09-21T00:56:45.401 INFO:tasks.workunit.client.0.smithi112.stdout:8/212: write d0/f11 [101774,6274] 0 2024-09-21T00:56:45.402 INFO:tasks.workunit.client.1.smithi187.stdout:5/777: write d0/dc/daa/f6e [858,98238] 0 2024-09-21T00:56:45.402 INFO:tasks.workunit.client.1.smithi187.stdout:6/856: chown d7/d2a/da2/fab 609744 1 2024-09-21T00:56:45.403 INFO:tasks.workunit.client.1.smithi187.stdout:4/880: unlink d2/d3/da/d2f/d4b/d7e/dc8/d89/cca 0 2024-09-21T00:56:45.405 INFO:tasks.workunit.client.1.smithi187.stdout:0/808: symlink d0/d17/d18/d3a/d97/dcc/l116 0 2024-09-21T00:56:45.406 INFO:tasks.workunit.client.0.smithi112.stdout:8/213: dread d0/d13/d1b/d22/f31 [0,4194304] 0 2024-09-21T00:56:45.407 INFO:tasks.workunit.client.1.smithi187.stdout:2/907: fdatasync d2/fa 0 2024-09-21T00:56:45.409 INFO:tasks.workunit.client.1.smithi187.stdout:6/857: dwrite d7/d2a/d29/d40/d50/d68/ff5 [0,4194304] 0 2024-09-21T00:56:45.409 INFO:tasks.workunit.client.0.smithi112.stdout:7/242: truncate d0/d2/d36/d39/d1a/f1f 1678399 0 2024-09-21T00:56:45.410 INFO:tasks.workunit.client.1.smithi187.stdout:5/778: rmdir d0/dc/d1f/df4 39 2024-09-21T00:56:45.411 INFO:tasks.workunit.client.1.smithi187.stdout:4/881: write d2/d3/da/d48/f9c [3935004,97781] 0 2024-09-21T00:56:45.412 INFO:tasks.workunit.client.0.smithi112.stdout:8/214: dread d0/d13/d1b/d22/f31 [0,4194304] 0 2024-09-21T00:56:45.412 INFO:tasks.workunit.client.1.smithi187.stdout:6/858: truncate d7/d2a/d29/d40/d6a/dbc/fc4 200494 0 2024-09-21T00:56:45.414 INFO:tasks.workunit.client.1.smithi187.stdout:6/859: chown d7/d2a/d29/d40/d5e/cf1 1883 1 2024-09-21T00:56:45.415 INFO:tasks.workunit.client.1.smithi187.stdout:4/882: read d2/d3/f33 [1543822,114818] 0 2024-09-21T00:56:45.416 INFO:tasks.workunit.client.1.smithi187.stdout:6/860: fdatasync d7/d2a/d29/d40/d6a/dbc/fc4 0 2024-09-21T00:56:45.417 INFO:tasks.workunit.client.0.smithi112.stdout:8/215: mkdir d0/d13/d1b/d22/d42 0 2024-09-21T00:56:45.418 INFO:tasks.workunit.client.0.smithi112.stdout:6/270: dread d9/d1b/f1d [0,4194304] 0 2024-09-21T00:56:45.421 INFO:tasks.workunit.client.1.smithi187.stdout:4/883: dwrite d2/d3/da/f5b [0,4194304] 0 2024-09-21T00:56:45.423 INFO:tasks.workunit.client.0.smithi112.stdout:3/465: truncate d2/d8/d28/d35/f51 184040 0 2024-09-21T00:56:45.424 INFO:tasks.workunit.client.1.smithi187.stdout:7/789: write d1/dce/dd0/d97/df1/f6b [3623506,5308] 0 2024-09-21T00:56:45.425 INFO:tasks.workunit.client.0.smithi112.stdout:6/271: dwrite d9/df/f59 [0,4194304] 0 2024-09-21T00:56:45.432 INFO:tasks.workunit.client.1.smithi187.stdout:8/916: dwrite dc/d2f/d37/fbe [0,4194304] 0 2024-09-21T00:56:45.433 INFO:tasks.workunit.client.1.smithi187.stdout:6/861: unlink d7/d2a/d29/d94/ff9 0 2024-09-21T00:56:45.435 INFO:tasks.workunit.client.1.smithi187.stdout:2/908: mkdir d2/dc/d2e/d4a/d7c/d13c 0 2024-09-21T00:56:45.436 INFO:tasks.workunit.client.0.smithi112.stdout:8/216: truncate d0/d13/f16 4852154 0 2024-09-21T00:56:45.437 INFO:tasks.workunit.client.1.smithi187.stdout:1/947: link d4/d6/d23/l4a d4/d6/d23/d6f/l137 0 2024-09-21T00:56:45.440 INFO:tasks.workunit.client.0.smithi112.stdout:3/466: link d2/d8/dd/de/d6b/f72 d2/d38/d3f/fa9 0 2024-09-21T00:56:45.442 INFO:tasks.workunit.client.0.smithi112.stdout:8/217: creat d0/f43 x:0 0 0 2024-09-21T00:56:45.442 INFO:tasks.workunit.client.0.smithi112.stdout:8/218: stat d0/la 0 2024-09-21T00:56:45.443 INFO:tasks.workunit.client.0.smithi112.stdout:8/219: write d0/d13/d1b/f30 [2226416,25886] 0 2024-09-21T00:56:45.444 INFO:tasks.workunit.client.0.smithi112.stdout:7/243: rename d0/d2/d36/d39/d1a/f1f to d0/f46 0 2024-09-21T00:56:45.447 INFO:tasks.workunit.client.0.smithi112.stdout:3/467: mknod d2/d33/d78/caa 0 2024-09-21T00:56:45.450 INFO:tasks.workunit.client.1.smithi187.stdout:0/809: dwrite d0/d60/d6b/f8d [0,4194304] 0 2024-09-21T00:56:45.453 INFO:tasks.workunit.client.0.smithi112.stdout:8/220: dwrite d0/d13/f27 [4194304,4194304] 0 2024-09-21T00:56:45.454 INFO:tasks.workunit.client.0.smithi112.stdout:3/468: creat d2/d8/d28/fab x:0 0 0 2024-09-21T00:56:45.455 INFO:tasks.workunit.client.0.smithi112.stdout:7/244: dwrite d0/d2/d36/f45 [0,4194304] 0 2024-09-21T00:56:45.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/221: write d0/d13/d1b/d22/d2e/d3d/f40 [957779,47592] 0 2024-09-21T00:56:45.462 INFO:tasks.workunit.client.0.smithi112.stdout:6/272: write d9/d1b/d23/f48 [2269537,86317] 0 2024-09-21T00:56:45.464 INFO:tasks.workunit.client.0.smithi112.stdout:3/469: mkdir d2/d8/d28/dac 0 2024-09-21T00:56:45.465 INFO:tasks.workunit.client.0.smithi112.stdout:3/470: chown d2/d8/dd/de/d4a/d4c/d7c 15963457 1 2024-09-21T00:56:45.466 INFO:tasks.workunit.client.0.smithi112.stdout:7/245: dread d0/d2/d36/d39/d1a/f44 [0,4194304] 0 2024-09-21T00:56:45.467 INFO:tasks.workunit.client.0.smithi112.stdout:6/273: dread d9/d1f/d47/d34/f36 [0,4194304] 0 2024-09-21T00:56:45.468 INFO:tasks.workunit.client.0.smithi112.stdout:6/274: chown d9/fc 61 1 2024-09-21T00:56:45.470 INFO:tasks.workunit.client.0.smithi112.stdout:8/222: rmdir d0 39 2024-09-21T00:56:45.476 INFO:tasks.workunit.client.1.smithi187.stdout:5/779: truncate d0/dc/daa/d67/d14/d38/d5a/d6c/fca 644945 0 2024-09-21T00:56:45.479 INFO:tasks.workunit.client.1.smithi187.stdout:2/909: mkdir d2/d3/d13d 0 2024-09-21T00:56:45.479 INFO:tasks.workunit.client.1.smithi187.stdout:2/910: fsync d2/d3/d15/f63 0 2024-09-21T00:56:45.480 INFO:tasks.workunit.client.0.smithi112.stdout:6/275: creat d9/d13/d31/d41/f69 x:0 0 0 2024-09-21T00:56:45.481 INFO:tasks.workunit.client.1.smithi187.stdout:7/790: link d1/dce/dd0/d97/df1/d31/d41/d8a/dd5/ff5 d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f10f 0 2024-09-21T00:56:45.483 INFO:tasks.workunit.client.1.smithi187.stdout:0/810: unlink d0/d17/d18/d3a/d97/d112/d23/l82 0 2024-09-21T00:56:45.485 INFO:tasks.workunit.client.0.smithi112.stdout:7/246: symlink d0/d2/d36/d39/d1a/l47 0 2024-09-21T00:56:45.486 INFO:tasks.workunit.client.1.smithi187.stdout:6/862: creat d7/d2a/d29/d40/d6a/f11a x:0 0 0 2024-09-21T00:56:45.487 INFO:tasks.workunit.client.1.smithi187.stdout:6/863: readlink d7/d2a/d29/l95 0 2024-09-21T00:56:45.488 INFO:tasks.workunit.client.0.smithi112.stdout:6/276: symlink d9/d1f/d3e/l6a 0 2024-09-21T00:56:45.489 INFO:tasks.workunit.client.1.smithi187.stdout:7/791: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/fe4 [0,4194304] 0 2024-09-21T00:56:45.489 INFO:tasks.workunit.client.1.smithi187.stdout:5/780: creat d0/dc/daa/d67/d30/f103 x:0 0 0 2024-09-21T00:56:45.490 INFO:tasks.workunit.client.0.smithi112.stdout:8/223: creat d0/d13/f44 x:0 0 0 2024-09-21T00:56:45.491 INFO:tasks.workunit.client.1.smithi187.stdout:6/864: chown d7/d2a/d29/d40/d45/df7/dfc 355983038 1 2024-09-21T00:56:45.491 INFO:tasks.workunit.client.0.smithi112.stdout:7/247: mkdir d0/d2/d38/d48 0 2024-09-21T00:56:45.491 INFO:tasks.workunit.client.0.smithi112.stdout:7/248: stat d0/l14 0 2024-09-21T00:56:45.491 INFO:tasks.workunit.client.0.smithi112.stdout:8/224: dread - d0/d13/d2a/f39 zero size 2024-09-21T00:56:45.492 INFO:tasks.workunit.client.0.smithi112.stdout:6/277: mknod d9/df/c6b 0 2024-09-21T00:56:45.492 INFO:tasks.workunit.client.1.smithi187.stdout:0/811: dwrite d0/d17/d18/d3a/d97/d112/d23/df/f53 [4194304,4194304] 0 2024-09-21T00:56:45.493 INFO:tasks.workunit.client.1.smithi187.stdout:5/781: symlink d0/dc/d39/l104 0 2024-09-21T00:56:45.493 INFO:tasks.workunit.client.0.smithi112.stdout:7/249: creat d0/d2/d36/f49 x:0 0 0 2024-09-21T00:56:45.494 INFO:tasks.workunit.client.0.smithi112.stdout:8/225: fdatasync d0/f1d 0 2024-09-21T00:56:45.496 INFO:tasks.workunit.client.0.smithi112.stdout:6/278: creat d9/df/f6c x:0 0 0 2024-09-21T00:56:45.498 INFO:tasks.workunit.client.1.smithi187.stdout:4/884: truncate d2/d3/da/d2f/d4b/d7e/dc8/f62 924261 0 2024-09-21T00:56:45.498 INFO:tasks.workunit.client.1.smithi187.stdout:5/782: write d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9/fff [524239,118396] 0 2024-09-21T00:56:45.500 INFO:tasks.workunit.client.0.smithi112.stdout:7/250: dread d0/d2/d36/f45 [0,4194304] 0 2024-09-21T00:56:45.502 INFO:tasks.workunit.client.1.smithi187.stdout:0/812: unlink d0/d17/d18/d3a/d97/d112/d23/df/d41/cf5 0 2024-09-21T00:56:45.502 INFO:tasks.workunit.client.0.smithi112.stdout:8/226: dread d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:56:45.507 INFO:tasks.workunit.client.1.smithi187.stdout:5/783: creat d0/dc/daa/d67/d14/d38/d5a/d6c/f105 x:0 0 0 2024-09-21T00:56:45.507 INFO:tasks.workunit.client.1.smithi187.stdout:3/803: sync 2024-09-21T00:56:45.508 INFO:tasks.workunit.client.1.smithi187.stdout:4/885: dwrite d2/d3/da/d2f/d32/d26/d66/d6e/f8e [0,4194304] 0 2024-09-21T00:56:45.510 INFO:tasks.workunit.client.1.smithi187.stdout:3/804: readlink d9/d7f/dcb/d87/d94/l58 0 2024-09-21T00:56:45.510 INFO:tasks.workunit.client.1.smithi187.stdout:6/865: rename d7/d2a/da2/l115 to d7/l11b 0 2024-09-21T00:56:45.511 INFO:tasks.workunit.client.0.smithi112.stdout:8/227: creat d0/d13/d2a/f45 x:0 0 0 2024-09-21T00:56:45.514 INFO:tasks.workunit.client.1.smithi187.stdout:5/784: chown d0/dc/daa/d67/d14/d38/d5a/d6c/db7/fcb 917200822 1 2024-09-21T00:56:45.515 INFO:tasks.workunit.client.1.smithi187.stdout:6/866: chown d7/d2a/d29/d40/d6a/d9e/ff2 7208 1 2024-09-21T00:56:45.516 INFO:tasks.workunit.client.0.smithi112.stdout:7/251: creat d0/d2/d38/d48/f4a x:0 0 0 2024-09-21T00:56:45.518 INFO:tasks.workunit.client.1.smithi187.stdout:7/792: rename d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f99 to d1/d55/d80/f110 0 2024-09-21T00:56:45.518 INFO:tasks.workunit.client.0.smithi112.stdout:3/471: truncate d2/d38/d3f/f60 3889594 0 2024-09-21T00:56:45.519 INFO:tasks.workunit.client.0.smithi112.stdout:8/228: dwrite d0/d13/d1b/d22/d2e/d3d/f40 [0,4194304] 0 2024-09-21T00:56:45.520 INFO:tasks.workunit.client.0.smithi112.stdout:8/229: stat d0/d13/d1b/f1e 0 2024-09-21T00:56:45.521 INFO:tasks.workunit.client.1.smithi187.stdout:0/813: symlink d0/d17/d18/d3a/d97/d112/d23/df/d41/l117 0 2024-09-21T00:56:45.522 INFO:tasks.workunit.client.0.smithi112.stdout:8/230: write d0/f26 [4038678,114360] 0 2024-09-21T00:56:45.526 INFO:tasks.workunit.client.1.smithi187.stdout:2/911: dread d2/dc/d2e/de1/ff4 [0,4194304] 0 2024-09-21T00:56:45.527 INFO:tasks.workunit.client.1.smithi187.stdout:2/912: write d2/da8/d3f/f137 [387836,58642] 0 2024-09-21T00:56:45.527 INFO:tasks.workunit.client.1.smithi187.stdout:3/805: rmdir d9/d7f/dcb/d87/d94/d53 39 2024-09-21T00:56:45.528 INFO:tasks.workunit.client.1.smithi187.stdout:2/913: fsync d2/d25/f43 0 2024-09-21T00:56:45.529 INFO:tasks.workunit.client.0.smithi112.stdout:8/231: mknod d0/d13/d1b/d22/c46 0 2024-09-21T00:56:45.529 INFO:tasks.workunit.client.1.smithi187.stdout:5/785: chown d0/dc/daa/d67/d30/c93 22119678 1 2024-09-21T00:56:45.532 INFO:tasks.workunit.client.0.smithi112.stdout:8/232: symlink d0/d13/d1b/d22/l47 0 2024-09-21T00:56:45.534 INFO:tasks.workunit.client.1.smithi187.stdout:7/793: write d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fd2 [3352351,119177] 0 2024-09-21T00:56:45.535 INFO:tasks.workunit.client.1.smithi187.stdout:8/917: sync 2024-09-21T00:56:45.535 INFO:tasks.workunit.client.1.smithi187.stdout:4/886: rmdir d2/d3/d56/d109 0 2024-09-21T00:56:45.536 INFO:tasks.workunit.client.1.smithi187.stdout:6/867: dwrite d7/d2a/fa7 [0,4194304] 0 2024-09-21T00:56:45.536 INFO:tasks.workunit.client.0.smithi112.stdout:8/233: rmdir d0/d13/d1b/d22/d2e 39 2024-09-21T00:56:45.540 INFO:tasks.workunit.client.1.smithi187.stdout:3/806: read d9/d19/d1c/f5b [435144,38209] 0 2024-09-21T00:56:45.540 INFO:tasks.workunit.client.0.smithi112.stdout:6/279: truncate d9/df/d19/f5d 798621 0 2024-09-21T00:56:45.541 INFO:tasks.workunit.client.0.smithi112.stdout:6/280: stat d9/df/d56 0 2024-09-21T00:56:45.541 INFO:tasks.workunit.client.1.smithi187.stdout:2/914: read d2/d3/df/f41 [2452121,16997] 0 2024-09-21T00:56:45.541 INFO:tasks.workunit.client.0.smithi112.stdout:6/281: readlink d9/l16 0 2024-09-21T00:56:45.542 INFO:tasks.workunit.client.0.smithi112.stdout:8/234: creat d0/d13/d2a/f48 x:0 0 0 2024-09-21T00:56:45.543 INFO:tasks.workunit.client.0.smithi112.stdout:8/235: chown d0/l2b 635397484 1 2024-09-21T00:56:45.543 INFO:tasks.workunit.client.1.smithi187.stdout:5/786: unlink d0/dc/daa/d67/d14/d38/d5a/d6c/db7/cbf 0 2024-09-21T00:56:45.544 INFO:tasks.workunit.client.0.smithi112.stdout:8/236: write d0/f10 [7816055,62841] 0 2024-09-21T00:56:45.547 INFO:tasks.workunit.client.0.smithi112.stdout:6/282: write d9/d1b/f1d [1192065,4721] 0 2024-09-21T00:56:45.549 INFO:tasks.workunit.client.1.smithi187.stdout:0/814: creat d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d46/dd8/f118 x:0 0 0 2024-09-21T00:56:45.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/283: write d9/df/d19/f64 [81502,105115] 0 2024-09-21T00:56:45.550 INFO:tasks.workunit.client.0.smithi112.stdout:8/237: dread d0/f26 [0,4194304] 0 2024-09-21T00:56:45.556 INFO:tasks.workunit.client.1.smithi187.stdout:8/918: creat dc/d2f/d54/d69/db3/f141 x:0 0 0 2024-09-21T00:56:45.557 INFO:tasks.workunit.client.0.smithi112.stdout:7/252: write d0/f46 [720424,73642] 0 2024-09-21T00:56:45.557 INFO:tasks.workunit.client.1.smithi187.stdout:8/919: readlink dc/d2f/d80/db8/dba/d29/lf0 0 2024-09-21T00:56:45.558 INFO:tasks.workunit.client.0.smithi112.stdout:8/238: dwrite d0/f11 [0,4194304] 0 2024-09-21T00:56:45.560 INFO:tasks.workunit.client.1.smithi187.stdout:6/868: rename d7/d2a/d29/d40/d5e to d7/d2a/d29/de4/d11c 0 2024-09-21T00:56:45.562 INFO:tasks.workunit.client.1.smithi187.stdout:3/807: mknod d9/d7f/dcb/d20/c10f 0 2024-09-21T00:56:45.562 INFO:tasks.workunit.client.1.smithi187.stdout:0/815: dread d0/d17/d18/d3a/d97/d112/d65/fe8 [0,4194304] 0 2024-09-21T00:56:45.566 INFO:tasks.workunit.client.0.smithi112.stdout:7/253: dwrite d0/f46 [0,4194304] 0 2024-09-21T00:56:45.566 INFO:tasks.workunit.client.1.smithi187.stdout:2/915: creat d2/d3/d15/dfe/dc6/f13e x:0 0 0 2024-09-21T00:56:45.568 INFO:tasks.workunit.client.1.smithi187.stdout:3/808: dwrite d9/f37 [0,4194304] 0 2024-09-21T00:56:45.571 INFO:tasks.workunit.client.1.smithi187.stdout:3/809: write d9/d19/d9b/fad [3948227,102919] 0 2024-09-21T00:56:45.571 INFO:tasks.workunit.client.1.smithi187.stdout:7/794: truncate d1/dce/dd0/d97/df1/d31/f6d 3361102 0 2024-09-21T00:56:45.573 INFO:tasks.workunit.client.0.smithi112.stdout:8/239: symlink d0/d13/d1b/l49 0 2024-09-21T00:56:45.573 INFO:tasks.workunit.client.0.smithi112.stdout:8/240: chown d0/d13 966975456 1 2024-09-21T00:56:45.574 INFO:tasks.workunit.client.0.smithi112.stdout:8/241: fsync d0/d13/d2a/f39 0 2024-09-21T00:56:45.577 INFO:tasks.workunit.client.1.smithi187.stdout:4/887: rename d2/d3/da/d2f/d32/d24/l7d to d2/d3/da/d2f/l10b 0 2024-09-21T00:56:45.582 INFO:tasks.workunit.client.1.smithi187.stdout:0/816: unlink d0/d17/d18/d3a/d97/d112/d23/f30 0 2024-09-21T00:56:45.587 INFO:tasks.workunit.client.0.smithi112.stdout:7/254: rename d0/d2/d36/d39/l25 to d0/d2/l4b 0 2024-09-21T00:56:45.589 INFO:tasks.workunit.client.1.smithi187.stdout:3/810: chown d9/d7f/dcb/d87/d94/f90 1 1 2024-09-21T00:56:45.591 INFO:tasks.workunit.client.1.smithi187.stdout:7/795: mknod d1/dce/dd0/d97/c111 0 2024-09-21T00:56:45.591 INFO:tasks.workunit.client.0.smithi112.stdout:6/284: truncate d9/df/d19/f64 77964 0 2024-09-21T00:56:45.592 INFO:tasks.workunit.client.0.smithi112.stdout:7/255: mknod d0/d2/d38/d48/c4c 0 2024-09-21T00:56:45.593 INFO:tasks.workunit.client.1.smithi187.stdout:8/920: rename dc/d44/dcb to dc/dea/d142 0 2024-09-21T00:56:45.597 INFO:tasks.workunit.client.0.smithi112.stdout:8/242: dread d0/f10 [4194304,4194304] 0 2024-09-21T00:56:45.597 INFO:tasks.workunit.client.1.smithi187.stdout:7/796: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/ff7 [0,4194304] 0 2024-09-21T00:56:45.600 INFO:tasks.workunit.client.0.smithi112.stdout:1/206: sync 2024-09-21T00:56:45.603 INFO:tasks.workunit.client.1.smithi187.stdout:0/817: mknod d0/dc2/c119 0 2024-09-21T00:56:45.605 INFO:tasks.workunit.client.1.smithi187.stdout:0/818: chown d0/d17/d18/d3a/d97/d112/d23/df/d41/f4a 82 1 2024-09-21T00:56:45.608 INFO:tasks.workunit.client.1.smithi187.stdout:4/888: dread d2/d3/da/d2f/d32/d22/f3d [0,4194304] 0 2024-09-21T00:56:45.608 INFO:tasks.workunit.client.1.smithi187.stdout:3/811: read d9/d7f/dcb/d87/d94/f8a [211796,119466] 0 2024-09-21T00:56:45.610 INFO:tasks.workunit.client.1.smithi187.stdout:6/869: rename d7/d2a/d29 to d7/d59/d11d 0 2024-09-21T00:56:45.615 INFO:tasks.workunit.client.0.smithi112.stdout:8/243: chown d0/d13/d1b/f32 0 1 2024-09-21T00:56:45.617 INFO:tasks.workunit.client.0.smithi112.stdout:1/207: fsync d5/d8/d10/f17 0 2024-09-21T00:56:45.618 INFO:tasks.workunit.client.1.smithi187.stdout:2/916: dwrite d2/dc/d2e/d4a/d7c/d52/dba/f102 [0,4194304] 0 2024-09-21T00:56:45.620 INFO:tasks.workunit.client.0.smithi112.stdout:7/256: creat d0/d2/d36/d39/d1a/f4d x:0 0 0 2024-09-21T00:56:45.621 INFO:tasks.workunit.client.0.smithi112.stdout:6/285: write d9/df/f27 [1862530,112347] 0 2024-09-21T00:56:45.623 INFO:tasks.workunit.client.1.smithi187.stdout:4/889: creat d2/d3/da/d2f/f10c x:0 0 0 2024-09-21T00:56:45.624 INFO:tasks.workunit.client.1.smithi187.stdout:4/890: fdatasync d2/d3/da/f5b 0 2024-09-21T00:56:45.628 INFO:tasks.workunit.client.0.smithi112.stdout:7/257: creat d0/d2/d32/f4e x:0 0 0 2024-09-21T00:56:45.631 INFO:tasks.workunit.client.1.smithi187.stdout:7/797: symlink d1/dc/d104/l112 0 2024-09-21T00:56:45.632 INFO:tasks.workunit.client.1.smithi187.stdout:3/812: write d9/d7f/fa9 [1320527,99605] 0 2024-09-21T00:56:45.633 INFO:tasks.workunit.client.1.smithi187.stdout:1/948: sync 2024-09-21T00:56:45.633 INFO:tasks.workunit.client.1.smithi187.stdout:7/798: chown d1/dce/dd0/d97/df1/d31/d41/d8a/dd5 2433 1 2024-09-21T00:56:45.633 INFO:tasks.workunit.client.1.smithi187.stdout:3/813: stat d9/d19/d1c/d5f/c7c 0 2024-09-21T00:56:45.634 INFO:tasks.workunit.client.1.smithi187.stdout:0/819: symlink d0/d17/d18/d90/l11a 0 2024-09-21T00:56:45.634 INFO:tasks.workunit.client.1.smithi187.stdout:7/799: stat d1/dce/dd0/d97/df1/fb4 0 2024-09-21T00:56:45.635 INFO:tasks.workunit.client.0.smithi112.stdout:1/208: write d5/fc [1732112,89647] 0 2024-09-21T00:56:45.635 INFO:tasks.workunit.client.0.smithi112.stdout:8/244: symlink d0/d13/d1b/d22/l4a 0 2024-09-21T00:56:45.636 INFO:tasks.workunit.client.1.smithi187.stdout:0/820: chown d0/d17/d18/f24 855978939 1 2024-09-21T00:56:45.640 INFO:tasks.workunit.client.0.smithi112.stdout:1/209: rename d5/d3a/f40 to d5/d3a/f48 0 2024-09-21T00:56:45.640 INFO:tasks.workunit.client.0.smithi112.stdout:1/210: stat d5/d8/f1f 0 2024-09-21T00:56:45.641 INFO:tasks.workunit.client.1.smithi187.stdout:6/870: dwrite d7/d2a/da2/fd7 [0,4194304] 0 2024-09-21T00:56:45.642 INFO:tasks.workunit.client.0.smithi112.stdout:7/258: link d0/d2/d38/d48/c4c d0/d2/d36/d39/d1a/d23/c4f 0 2024-09-21T00:56:45.643 INFO:tasks.workunit.client.1.smithi187.stdout:8/921: dwrite dc/d2f/d80/db8/dba/d29/f4c [0,4194304] 0 2024-09-21T00:56:45.646 INFO:tasks.workunit.client.0.smithi112.stdout:8/245: rename d0/d13/d1b/d22/f25 to d0/d13/d1b/d22/d2e/f4b 0 2024-09-21T00:56:45.648 INFO:tasks.workunit.client.0.smithi112.stdout:7/259: mknod d0/d2/d36/d39/c50 0 2024-09-21T00:56:45.650 INFO:tasks.workunit.client.1.smithi187.stdout:7/800: dread - d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f98 zero size 2024-09-21T00:56:45.654 INFO:tasks.workunit.client.1.smithi187.stdout:4/891: write d2/d3/da/d2f/d4b/d7e/dc8/d97/fbd [1268300,11156] 0 2024-09-21T00:56:45.656 INFO:tasks.workunit.client.1.smithi187.stdout:8/922: dread dc/d44/f5a [0,4194304] 0 2024-09-21T00:56:45.656 INFO:tasks.workunit.client.1.smithi187.stdout:6/871: stat d7/d59/d11d/d94/cec 0 2024-09-21T00:56:45.657 INFO:tasks.workunit.client.1.smithi187.stdout:3/814: rmdir d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d 39 2024-09-21T00:56:45.659 INFO:tasks.workunit.client.1.smithi187.stdout:7/801: write d1/dce/dd4/ffd [4866033,92770] 0 2024-09-21T00:56:45.660 INFO:tasks.workunit.client.1.smithi187.stdout:7/802: chown d1/d55/dd7/ldf 384 1 2024-09-21T00:56:45.660 INFO:tasks.workunit.client.0.smithi112.stdout:7/260: rename d0/l14 to d0/l51 0 2024-09-21T00:56:45.661 INFO:tasks.workunit.client.0.smithi112.stdout:8/246: dwrite d0/d13/d1b/f30 [0,4194304] 0 2024-09-21T00:56:45.661 INFO:tasks.workunit.client.1.smithi187.stdout:6/872: truncate d7/d59/d11d/f49 9360396 0 2024-09-21T00:56:45.663 INFO:tasks.workunit.client.1.smithi187.stdout:4/892: mknod d2/d3/da/d2f/d32/d22/d37/dcf/c10d 0 2024-09-21T00:56:45.663 INFO:tasks.workunit.client.1.smithi187.stdout:7/803: dread - d1/dce/dd0/d97/df1/d31/d41/d8a/d100/f105 zero size 2024-09-21T00:56:45.663 INFO:tasks.workunit.client.0.smithi112.stdout:8/247: dread d0/d13/d1b/f32 [0,4194304] 0 2024-09-21T00:56:45.665 INFO:tasks.workunit.client.1.smithi187.stdout:3/815: dwrite d9/d7f/dcb/d87/d94/d53/d56/dc9/f10c [0,4194304] 0 2024-09-21T00:56:45.665 INFO:tasks.workunit.client.1.smithi187.stdout:0/821: getdents d0/d17/d18/d3a/d97/dcc 0 2024-09-21T00:56:45.667 INFO:tasks.workunit.client.0.smithi112.stdout:1/211: write d5/d8/d10/f17 [1212326,3111] 0 2024-09-21T00:56:45.669 INFO:tasks.workunit.client.1.smithi187.stdout:4/893: creat d2/d3/da/d2f/d32/d26/f10e x:0 0 0 2024-09-21T00:56:45.670 INFO:tasks.workunit.client.0.smithi112.stdout:7/261: creat d0/d2/d36/d39/d1a/f52 x:0 0 0 2024-09-21T00:56:45.670 INFO:tasks.workunit.client.1.smithi187.stdout:4/894: chown d2/d3/da/d2f/d4b/d7e/fe8 46 1 2024-09-21T00:56:45.672 INFO:tasks.workunit.client.1.smithi187.stdout:1/949: write d4/d6/d23/d2e/d94/d35/d4c/f85 [677416,93814] 0 2024-09-21T00:56:45.672 INFO:tasks.workunit.client.1.smithi187.stdout:0/822: mknod d0/d60/d6b/d9f/de6/c11b 0 2024-09-21T00:56:45.675 INFO:tasks.workunit.client.0.smithi112.stdout:1/212: creat d5/d34/f49 x:0 0 0 2024-09-21T00:56:45.676 INFO:tasks.workunit.client.0.smithi112.stdout:1/213: write d5/d8/d10/f20 [59140,124895] 0 2024-09-21T00:56:45.677 INFO:tasks.workunit.client.0.smithi112.stdout:8/248: creat d0/d13/d1b/f4c x:0 0 0 2024-09-21T00:56:45.677 INFO:tasks.workunit.client.1.smithi187.stdout:3/816: dread - d9/d7f/dcb/d87/d94/d53/d56/d61/fbe zero size 2024-09-21T00:56:45.680 INFO:tasks.workunit.client.0.smithi112.stdout:8/249: dread d0/fb [0,4194304] 0 2024-09-21T00:56:45.683 INFO:tasks.workunit.client.1.smithi187.stdout:1/950: creat d4/d75/f138 x:0 0 0 2024-09-21T00:56:45.685 INFO:tasks.workunit.client.1.smithi187.stdout:0/823: rename d0/d17/d18/d3a/d97/d112/d23/d36/la5 to d0/d17/d18/d3a/d97/d112/d23/d108/l11c 0 2024-09-21T00:56:45.687 INFO:tasks.workunit.client.1.smithi187.stdout:8/923: dread dc/fd [0,4194304] 0 2024-09-21T00:56:45.688 INFO:tasks.workunit.client.1.smithi187.stdout:4/895: creat d2/d3/da/d2f/d32/d24/dcd/db3/df9/f10f x:0 0 0 2024-09-21T00:56:45.688 INFO:tasks.workunit.client.1.smithi187.stdout:7/804: getdents d1/dce/dd0/d97/df1/d31/d41/d64/d93 0 2024-09-21T00:56:45.688 INFO:tasks.workunit.client.0.smithi112.stdout:1/214: dread d5/d34/f42 [0,4194304] 0 2024-09-21T00:56:45.688 INFO:tasks.workunit.client.0.smithi112.stdout:8/250: dread d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:56:45.690 INFO:tasks.workunit.client.1.smithi187.stdout:1/951: chown d4/d6/d23/d2e/d53/d6a/c9a 48 1 2024-09-21T00:56:45.691 INFO:tasks.workunit.client.1.smithi187.stdout:6/873: dwrite d7/f8e [4194304,4194304] 0 2024-09-21T00:56:45.692 INFO:tasks.workunit.client.1.smithi187.stdout:0/824: rename d0/l56 to d0/dcf/l11d 0 2024-09-21T00:56:45.693 INFO:tasks.workunit.client.1.smithi187.stdout:7/805: chown d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/lfc 0 1 2024-09-21T00:56:45.695 INFO:tasks.workunit.client.0.smithi112.stdout:1/215: dwrite d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:45.697 INFO:tasks.workunit.client.1.smithi187.stdout:7/806: truncate d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fc3 665581 0 2024-09-21T00:56:45.701 INFO:tasks.workunit.client.1.smithi187.stdout:5/787: sync 2024-09-21T00:56:45.702 INFO:tasks.workunit.client.0.smithi112.stdout:1/216: rmdir d5/d8/d10/d2e 39 2024-09-21T00:56:45.703 INFO:tasks.workunit.client.0.smithi112.stdout:7/262: truncate d0/fa 2629147 0 2024-09-21T00:56:45.705 INFO:tasks.workunit.client.1.smithi187.stdout:6/874: creat d7/d59/d11d/d40/d6a/d88/f11e x:0 0 0 2024-09-21T00:56:45.706 INFO:tasks.workunit.client.1.smithi187.stdout:6/875: fsync d7/d59/f109 0 2024-09-21T00:56:45.708 INFO:tasks.workunit.client.0.smithi112.stdout:7/263: creat d0/d2/d38/d48/f53 x:0 0 0 2024-09-21T00:56:45.709 INFO:tasks.workunit.client.0.smithi112.stdout:7/264: write d0/f22 [2779400,83394] 0 2024-09-21T00:56:45.710 INFO:tasks.workunit.client.1.smithi187.stdout:7/807: creat d1/d55/d80/d87/f113 x:0 0 0 2024-09-21T00:56:45.710 INFO:tasks.workunit.client.1.smithi187.stdout:7/808: fsync d1/dc/fbb 0 2024-09-21T00:56:45.714 INFO:tasks.workunit.client.1.smithi187.stdout:5/788: mkdir d0/dc/daa/d67/d14/d1b/d27/dc7/d106 0 2024-09-21T00:56:45.715 INFO:tasks.workunit.client.0.smithi112.stdout:8/251: dwrite d0/d13/f16 [0,4194304] 0 2024-09-21T00:56:45.716 INFO:tasks.workunit.client.1.smithi187.stdout:8/924: creat dc/d2f/d80/db8/f143 x:0 0 0 2024-09-21T00:56:45.716 INFO:tasks.workunit.client.1.smithi187.stdout:4/896: dwrite d2/d3/d56/d84/d60/d6c/d77/fae [0,4194304] 0 2024-09-21T00:56:45.716 INFO:tasks.workunit.client.0.smithi112.stdout:7/265: dwrite d0/d2/d38/f43 [0,4194304] 0 2024-09-21T00:56:45.720 INFO:tasks.workunit.client.1.smithi187.stdout:6/876: symlink d7/d59/d11d/de4/d11c/ddc/l11f 0 2024-09-21T00:56:45.721 INFO:tasks.workunit.client.0.smithi112.stdout:8/252: creat d0/d13/d2a/f4d x:0 0 0 2024-09-21T00:56:45.722 INFO:tasks.workunit.client.0.smithi112.stdout:8/253: dread - d0/d13/f44 zero size 2024-09-21T00:56:45.723 INFO:tasks.workunit.client.0.smithi112.stdout:7/266: rename d0/d2/d38/d48/f4a to d0/d2/d32/f54 0 2024-09-21T00:56:45.729 INFO:tasks.workunit.client.1.smithi187.stdout:3/817: dread d9/d7f/dcb/d87/d94/d53/d56/d61/f74 [0,4194304] 0 2024-09-21T00:56:45.729 INFO:tasks.workunit.client.0.smithi112.stdout:7/267: mkdir d0/d2/d36/d39/d55 0 2024-09-21T00:56:45.729 INFO:tasks.workunit.client.0.smithi112.stdout:1/217: truncate d5/fc 1933637 0 2024-09-21T00:56:45.730 INFO:tasks.workunit.client.0.smithi112.stdout:8/254: getdents d0/d13/d1b/d22/d2e/d34 0 2024-09-21T00:56:45.731 INFO:tasks.workunit.client.1.smithi187.stdout:8/925: mkdir dc/d144 0 2024-09-21T00:56:45.733 INFO:tasks.workunit.client.0.smithi112.stdout:7/268: mkdir d0/d2/d36/d39/d56 0 2024-09-21T00:56:45.735 INFO:tasks.workunit.client.1.smithi187.stdout:0/825: dwrite d0/d17/f2e [0,4194304] 0 2024-09-21T00:56:45.736 INFO:tasks.workunit.client.1.smithi187.stdout:6/877: mkdir d7/d59/d11d/de4/d11c/ddc/d120 0 2024-09-21T00:56:45.739 INFO:tasks.workunit.client.1.smithi187.stdout:7/809: mknod d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/dda/c114 0 2024-09-21T00:56:45.746 INFO:tasks.workunit.client.0.smithi112.stdout:8/255: creat d0/d13/d1b/d22/f4e x:0 0 0 2024-09-21T00:56:45.747 INFO:tasks.workunit.client.0.smithi112.stdout:7/269: link d0/d2/d36/d39/d1a/d23/c2d d0/d2/d38/c57 0 2024-09-21T00:56:45.747 INFO:tasks.workunit.client.1.smithi187.stdout:7/810: dread d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/fdb [0,4194304] 0 2024-09-21T00:56:45.748 INFO:tasks.workunit.client.0.smithi112.stdout:8/256: chown d0/d13/d1b/c1c 693953347 1 2024-09-21T00:56:45.749 INFO:tasks.workunit.client.1.smithi187.stdout:1/952: link d4/d6/d23/d2e/d94/d35/d79/dd2/le2 d4/d6/d23/d2e/d94/d35/d22/l139 0 2024-09-21T00:56:45.750 INFO:tasks.workunit.client.0.smithi112.stdout:7/270: creat d0/d2/d2e/f58 x:0 0 0 2024-09-21T00:56:45.751 INFO:tasks.workunit.client.1.smithi187.stdout:0/826: fdatasync d0/d17/d18/d3a/d97/d112/d23/df/d41/f42 0 2024-09-21T00:56:45.751 INFO:tasks.workunit.client.0.smithi112.stdout:7/271: chown d0/d2/d36/d39/d1a/f4d 54 1 2024-09-21T00:56:45.751 INFO:tasks.workunit.client.1.smithi187.stdout:6/878: truncate d7/d59/d11d/fd2 2425915 0 2024-09-21T00:56:45.752 INFO:tasks.workunit.client.1.smithi187.stdout:0/827: stat d0/d17/l31 0 2024-09-21T00:56:45.754 INFO:tasks.workunit.client.0.smithi112.stdout:8/257: symlink d0/d13/d1b/l4f 0 2024-09-21T00:56:45.754 INFO:tasks.workunit.client.0.smithi112.stdout:7/272: symlink d0/d2/d2e/l59 0 2024-09-21T00:56:45.755 INFO:tasks.workunit.client.1.smithi187.stdout:8/926: dwrite dc/d2f/d54/d69/db3/fca [0,4194304] 0 2024-09-21T00:56:45.755 INFO:tasks.workunit.client.0.smithi112.stdout:7/273: readlink d0/d2/l28 0 2024-09-21T00:56:45.755 INFO:tasks.workunit.client.1.smithi187.stdout:0/828: chown d0/f70 0 1 2024-09-21T00:56:45.760 INFO:tasks.workunit.client.1.smithi187.stdout:6/879: link d7/d2a/ffb d7/d59/d11d/d40/d50/d83/de5/f121 0 2024-09-21T00:56:45.761 INFO:tasks.workunit.client.1.smithi187.stdout:0/829: creat d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d46/dd8/f11e x:0 0 0 2024-09-21T00:56:45.764 INFO:tasks.workunit.client.0.smithi112.stdout:8/258: dwrite d0/d13/d1b/d22/d2e/f4b [0,4194304] 0 2024-09-21T00:56:45.764 INFO:tasks.workunit.client.1.smithi187.stdout:1/953: dwrite d4/d6/d23/d2e/d94/d35/d22/d2c/fec [0,4194304] 0 2024-09-21T00:56:45.765 INFO:tasks.workunit.client.0.smithi112.stdout:7/274: dwrite d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:45.765 INFO:tasks.workunit.client.1.smithi187.stdout:6/880: mkdir d7/d59/d11d/de4/d122 0 2024-09-21T00:56:45.768 INFO:tasks.workunit.client.1.smithi187.stdout:0/830: mkdir d0/d60/d11f 0 2024-09-21T00:56:45.769 INFO:tasks.workunit.client.0.smithi112.stdout:7/275: rmdir d0/d2/d38/d48 39 2024-09-21T00:56:45.771 INFO:tasks.workunit.client.0.smithi112.stdout:8/259: creat d0/d13/d1b/d22/d2e/d3d/f50 x:0 0 0 2024-09-21T00:56:45.772 INFO:tasks.workunit.client.1.smithi187.stdout:1/954: symlink d4/d6/d23/d2e/d94/d10e/l13a 0 2024-09-21T00:56:45.775 INFO:tasks.workunit.client.1.smithi187.stdout:0/831: rmdir d0/d17/d18/d3a/d97/d112/d23/d36 39 2024-09-21T00:56:45.777 INFO:tasks.workunit.client.0.smithi112.stdout:8/260: mkdir d0/d13/d1b/d22/d42/d51 0 2024-09-21T00:56:45.777 INFO:tasks.workunit.client.1.smithi187.stdout:0/832: write d0/d17/d18/d90/fbf [1699737,47634] 0 2024-09-21T00:56:45.778 INFO:tasks.workunit.client.1.smithi187.stdout:1/955: mkdir d4/d6/d23/d2e/d94/dae/d12b/d13b 0 2024-09-21T00:56:45.781 INFO:tasks.workunit.client.1.smithi187.stdout:1/956: symlink d4/d6/d23/d2e/d94/d35/d79/dd2/l13c 0 2024-09-21T00:56:45.785 INFO:tasks.workunit.client.1.smithi187.stdout:1/957: fdatasync d4/d6/d23/d2e/d94/f4e 0 2024-09-21T00:56:45.786 INFO:tasks.workunit.client.1.smithi187.stdout:0/833: dwrite d0/d60/d6b/fa9 [0,4194304] 0 2024-09-21T00:56:45.787 INFO:tasks.workunit.client.1.smithi187.stdout:1/958: chown d4/d6/d23/d2e/d94/d35/d22/d65 30912 1 2024-09-21T00:56:45.790 INFO:tasks.workunit.client.1.smithi187.stdout:1/959: symlink d4/d6/d23/d6f/l13d 0 2024-09-21T00:56:45.792 INFO:tasks.workunit.client.1.smithi187.stdout:8/927: dread dc/d2f/d80/db8/dba/f33 [0,4194304] 0 2024-09-21T00:56:45.792 INFO:tasks.workunit.client.1.smithi187.stdout:1/960: readlink d4/d6/d23/d2e/d94/d35/d4c/l72 0 2024-09-21T00:56:45.794 INFO:tasks.workunit.client.1.smithi187.stdout:8/928: chown dc/d2f/d80/db8/dba/d29/da7 1947 1 2024-09-21T00:56:45.795 INFO:tasks.workunit.client.1.smithi187.stdout:1/961: creat d4/d6/d23/d2e/d94/d35/d79/dce/f13e x:0 0 0 2024-09-21T00:56:45.797 INFO:tasks.workunit.client.1.smithi187.stdout:1/962: mkdir d4/d6/d64/d13f 0 2024-09-21T00:56:45.799 INFO:tasks.workunit.client.1.smithi187.stdout:1/963: fdatasync d4/d6/d23/d2e/d94/d35/d4c/d5b/f8a 0 2024-09-21T00:56:45.802 INFO:tasks.workunit.client.1.smithi187.stdout:1/964: rename d4/d6/d23/d2e/d94/l11a to d4/l140 0 2024-09-21T00:56:45.804 INFO:tasks.workunit.client.1.smithi187.stdout:1/965: mknod d4/d6/d23/d2e/d94/d35/d4c/d5b/db0/c141 0 2024-09-21T00:56:45.807 INFO:tasks.workunit.client.1.smithi187.stdout:1/966: write d4/d6/d23/d2e/d94/d35/d22/d65/f9d [3917953,2762] 0 2024-09-21T00:56:45.807 INFO:tasks.workunit.client.1.smithi187.stdout:6/881: dread d7/d2a/d7a/f99 [0,4194304] 0 2024-09-21T00:56:45.808 INFO:tasks.workunit.client.1.smithi187.stdout:2/917: sync 2024-09-21T00:56:45.816 INFO:tasks.workunit.client.1.smithi187.stdout:6/882: dwrite d7/d59/d11d/d40/d6a/d9e/ff4 [0,4194304] 0 2024-09-21T00:56:45.817 INFO:tasks.workunit.client.1.smithi187.stdout:0/834: dread d0/d17/d18/f68 [0,4194304] 0 2024-09-21T00:56:45.821 INFO:tasks.workunit.client.1.smithi187.stdout:6/883: truncate d7/d59/d11d/de4/d11c/ddc/fdd 1858205 0 2024-09-21T00:56:45.822 INFO:tasks.workunit.client.1.smithi187.stdout:0/835: mknod d0/d17/d18/d3a/d97/d112/d65/dd0/c120 0 2024-09-21T00:56:45.825 INFO:tasks.workunit.client.1.smithi187.stdout:5/789: dwrite d0/dc/daa/d67/d14/f3d [0,4194304] 0 2024-09-21T00:56:45.826 INFO:tasks.workunit.client.1.smithi187.stdout:6/884: truncate d7/d2a/fd3 234428 0 2024-09-21T00:56:45.832 INFO:tasks.workunit.client.1.smithi187.stdout:5/790: link d0/dc/d1f/d26/c78 d0/dc/daa/d67/d14/d38/d5a/d6c/c107 0 2024-09-21T00:56:45.832 INFO:tasks.workunit.client.1.smithi187.stdout:6/885: link d7/d59/d11d/d40/cb4 d7/d59/c123 0 2024-09-21T00:56:45.833 INFO:tasks.workunit.client.1.smithi187.stdout:0/836: read d0/d17/d18/d3a/d97/d112/d23/d36/f38 [1093465,105404] 0 2024-09-21T00:56:45.834 INFO:tasks.workunit.client.1.smithi187.stdout:6/886: dread d7/d59/d11d/d40/d50/f96 [0,4194304] 0 2024-09-21T00:56:45.836 INFO:tasks.workunit.client.1.smithi187.stdout:6/887: mknod d7/d2a/d7a/c124 0 2024-09-21T00:56:45.849 INFO:tasks.workunit.client.1.smithi187.stdout:2/918: dread d2/d25/fee [0,4194304] 0 2024-09-21T00:56:45.853 INFO:tasks.workunit.client.1.smithi187.stdout:2/919: truncate d2/dc/d2e/d4a/d7c/d52/da3/f112 1269861 0 2024-09-21T00:56:45.855 INFO:tasks.workunit.client.0.smithi112.stdout:1/218: truncate d5/d8/f1f 1220518 0 2024-09-21T00:56:45.857 INFO:tasks.workunit.client.1.smithi187.stdout:4/897: truncate d2/d3/da/d2f/d4b/f6a 1049511 0 2024-09-21T00:56:45.859 INFO:tasks.workunit.client.1.smithi187.stdout:4/898: readlink d2/d3/d56/d84/d60/d9e/lce 0 2024-09-21T00:56:45.861 INFO:tasks.workunit.client.1.smithi187.stdout:3/818: dwrite d9/d7f/dcb/d87/d94/d53/d56/d61/fbe [0,4194304] 0 2024-09-21T00:56:45.862 INFO:tasks.workunit.client.0.smithi112.stdout:1/219: dwrite d5/d8/d10/f29 [0,4194304] 0 2024-09-21T00:56:45.863 INFO:tasks.workunit.client.0.smithi112.stdout:1/220: chown d5/d8/d13/d3e/c41 189 1 2024-09-21T00:56:45.865 INFO:tasks.workunit.client.1.smithi187.stdout:3/819: creat d9/d7f/dcb/d87/d94/d53/d75/de2/f110 x:0 0 0 2024-09-21T00:56:45.887 INFO:tasks.workunit.client.0.smithi112.stdout:7/276: write d0/d2/d36/d39/d1a/f44 [169177,19650] 0 2024-09-21T00:56:45.888 INFO:tasks.workunit.client.0.smithi112.stdout:7/277: dread - d0/d2/f31 zero size 2024-09-21T00:56:45.895 INFO:tasks.workunit.client.1.smithi187.stdout:8/929: dwrite dc/d2f/d80/db8/dba/f33 [0,4194304] 0 2024-09-21T00:56:45.897 INFO:tasks.workunit.client.1.smithi187.stdout:5/791: truncate d0/dc/daa/d67/d14/d38/d5a/fde 3559557 0 2024-09-21T00:56:45.898 INFO:tasks.workunit.client.0.smithi112.stdout:5/152: sync 2024-09-21T00:56:45.899 INFO:tasks.workunit.client.1.smithi187.stdout:1/967: dwrite d4/d6/d23/d2e/d94/d35/d4c/f4d [0,4194304] 0 2024-09-21T00:56:45.899 INFO:tasks.workunit.client.0.smithi112.stdout:5/153: chown d8/d9 10586 1 2024-09-21T00:56:45.900 INFO:tasks.workunit.client.1.smithi187.stdout:1/968: stat d4/d6/d23/d2e/f4b 0 2024-09-21T00:56:45.900 INFO:tasks.workunit.client.1.smithi187.stdout:5/792: chown d0/dc/daa/d67/d14/d38/d5a/d99 0 1 2024-09-21T00:56:45.902 INFO:tasks.workunit.client.0.smithi112.stdout:5/154: creat d8/d9/d13/f2d x:0 0 0 2024-09-21T00:56:45.903 INFO:tasks.workunit.client.1.smithi187.stdout:8/930: dwrite dc/d2f/d37/f42 [8388608,4194304] 0 2024-09-21T00:56:45.905 INFO:tasks.workunit.client.1.smithi187.stdout:7/811: sync 2024-09-21T00:56:45.906 INFO:tasks.workunit.client.0.smithi112.stdout:5/155: truncate d8/fa 4700328 0 2024-09-21T00:56:45.906 INFO:tasks.workunit.client.1.smithi187.stdout:8/931: fsync dc/d2f/d54/d69/db3/f130 0 2024-09-21T00:56:45.907 INFO:tasks.workunit.client.0.smithi112.stdout:5/156: write d8/f1a [2985973,88508] 0 2024-09-21T00:56:45.907 INFO:tasks.workunit.client.1.smithi187.stdout:8/932: dread - dc/d2f/d80/db8/dba/d3e/f120 zero size 2024-09-21T00:56:45.907 INFO:tasks.workunit.client.1.smithi187.stdout:7/812: rmdir d1/dc/d104 39 2024-09-21T00:56:45.909 INFO:tasks.workunit.client.0.smithi112.stdout:5/157: write d8/d9/d13/d1c/f22 [2978474,13215] 0 2024-09-21T00:56:45.910 INFO:tasks.workunit.client.0.smithi112.stdout:5/158: dread - d8/d9/d13/d2a/df/f23 zero size 2024-09-21T00:56:45.910 INFO:tasks.workunit.client.1.smithi187.stdout:8/933: creat dc/f145 x:0 0 0 2024-09-21T00:56:45.914 INFO:tasks.workunit.client.1.smithi187.stdout:6/888: dwrite d7/d59/d11d/f49 [4194304,4194304] 0 2024-09-21T00:56:45.915 INFO:tasks.workunit.client.1.smithi187.stdout:7/813: rename d1/dce/dd4/ffd to d1/dce/dd0/d97/f115 0 2024-09-21T00:56:45.919 INFO:tasks.workunit.client.1.smithi187.stdout:2/920: truncate d2/da8/d6c/db8/d40/feb 1148613 0 2024-09-21T00:56:45.920 INFO:tasks.workunit.client.0.smithi112.stdout:5/159: symlink d8/d9/d13/d2a/l2e 0 2024-09-21T00:56:45.924 INFO:tasks.workunit.client.1.smithi187.stdout:7/814: dwrite d1/dc/d15/fa1 [0,4194304] 0 2024-09-21T00:56:45.930 INFO:tasks.workunit.client.1.smithi187.stdout:2/921: creat d2/dc/d2e/d4a/d7c/d52/da3/de6/f13f x:0 0 0 2024-09-21T00:56:45.930 INFO:tasks.workunit.client.0.smithi112.stdout:1/221: truncate d5/d8/f35 1741566 0 2024-09-21T00:56:45.931 INFO:tasks.workunit.client.0.smithi112.stdout:1/222: readlink d5/d8/d13/l21 0 2024-09-21T00:56:45.932 INFO:tasks.workunit.client.0.smithi112.stdout:5/160: dwrite d8/d9/d13/d2a/f26 [0,4194304] 0 2024-09-21T00:56:45.932 INFO:tasks.workunit.client.1.smithi187.stdout:6/889: rename d7/d2a/c66 to d7/d2a/da2/c125 0 2024-09-21T00:56:45.933 INFO:tasks.workunit.client.0.smithi112.stdout:5/161: fdatasync d8/d9/f28 0 2024-09-21T00:56:45.933 INFO:tasks.workunit.client.1.smithi187.stdout:3/820: write d9/d19/d1c/d5f/f78 [1021561,32831] 0 2024-09-21T00:56:45.933 INFO:tasks.workunit.client.0.smithi112.stdout:1/223: chown d5/d8/d14/l22 7950600 1 2024-09-21T00:56:45.935 INFO:tasks.workunit.client.0.smithi112.stdout:7/278: truncate d0/d2/d38/f43 2316255 0 2024-09-21T00:56:45.935 INFO:tasks.workunit.client.1.smithi187.stdout:3/821: write d9/d19/da7/daa/dce/fd2 [870662,120914] 0 2024-09-21T00:56:45.935 INFO:tasks.workunit.client.1.smithi187.stdout:7/815: chown d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/ca2 67 1 2024-09-21T00:56:45.937 INFO:tasks.workunit.client.1.smithi187.stdout:3/822: chown d9/d7f/dcb/d87/d94/d53/d56/d61/lb4 818 1 2024-09-21T00:56:45.938 INFO:tasks.workunit.client.0.smithi112.stdout:5/162: unlink f3 0 2024-09-21T00:56:45.940 INFO:tasks.workunit.client.0.smithi112.stdout:1/224: creat d5/d3a/f4a x:0 0 0 2024-09-21T00:56:45.941 INFO:tasks.workunit.client.0.smithi112.stdout:1/225: fdatasync d5/d8/f3d 0 2024-09-21T00:56:45.944 INFO:tasks.workunit.client.1.smithi187.stdout:6/890: chown d7/d59/d11d/d94/cec 1708550 1 2024-09-21T00:56:45.946 INFO:tasks.workunit.client.1.smithi187.stdout:3/823: dwrite d9/d19/da7/daa/f103 [0,4194304] 0 2024-09-21T00:56:45.947 INFO:tasks.workunit.client.0.smithi112.stdout:1/226: dwrite d5/d3a/f3c [0,4194304] 0 2024-09-21T00:56:45.948 INFO:tasks.workunit.client.0.smithi112.stdout:7/279: mknod d0/d2/d36/d39/d1a/c5a 0 2024-09-21T00:56:45.952 INFO:tasks.workunit.client.0.smithi112.stdout:5/163: creat d8/d9/d13/d2a/d2c/f2f x:0 0 0 2024-09-21T00:56:45.958 INFO:tasks.workunit.client.0.smithi112.stdout:1/227: mkdir d5/d3a/d4b 0 2024-09-21T00:56:45.960 INFO:tasks.workunit.client.1.smithi187.stdout:6/891: creat d7/d59/d11d/d40/d6a/d9e/f126 x:0 0 0 2024-09-21T00:56:45.961 INFO:tasks.workunit.client.0.smithi112.stdout:7/280: creat d0/d2/d32/f5b x:0 0 0 2024-09-21T00:56:45.961 INFO:tasks.workunit.client.0.smithi112.stdout:7/281: stat d0/d2/d2e/l59 0 2024-09-21T00:56:45.961 INFO:tasks.workunit.client.0.smithi112.stdout:7/282: chown d0/d2 100835 1 2024-09-21T00:56:45.962 INFO:tasks.workunit.client.0.smithi112.stdout:7/283: chown d0/d2/d2e/l30 8025659 1 2024-09-21T00:56:45.963 INFO:tasks.workunit.client.1.smithi187.stdout:3/824: unlink d9/d7f/dcb/d87/fab 0 2024-09-21T00:56:45.965 INFO:tasks.workunit.client.1.smithi187.stdout:8/934: write dc/d2f/d54/f116 [158161,108813] 0 2024-09-21T00:56:45.966 INFO:tasks.workunit.client.1.smithi187.stdout:8/935: write dc/d2f/d80/db8/dba/d29/f31 [60006,5082] 0 2024-09-21T00:56:45.967 INFO:tasks.workunit.client.0.smithi112.stdout:7/284: chown d0/d2/d36/d39/d1a/d23/c2d 499534915 1 2024-09-21T00:56:45.968 INFO:tasks.workunit.client.0.smithi112.stdout:7/285: stat d0/f10 0 2024-09-21T00:56:45.968 INFO:tasks.workunit.client.1.smithi187.stdout:3/825: chown d9/d7f/dcb/d87/d94/d89/dc1/l10a 442 1 2024-09-21T00:56:45.969 INFO:tasks.workunit.client.1.smithi187.stdout:3/826: stat d9/d7f/dcb/d87/d94/c46 0 2024-09-21T00:56:45.969 INFO:tasks.workunit.client.1.smithi187.stdout:2/922: dread d2/da8/d6c/db8/f74 [4194304,4194304] 0 2024-09-21T00:56:45.970 INFO:tasks.workunit.client.0.smithi112.stdout:1/228: creat d5/d8/dd/f4c x:0 0 0 2024-09-21T00:56:45.970 INFO:tasks.workunit.client.1.smithi187.stdout:6/892: symlink d7/d59/d11d/de4/d11c/ddc/d120/l127 0 2024-09-21T00:56:45.971 INFO:tasks.workunit.client.0.smithi112.stdout:1/229: write d5/d8/d10/f17 [824240,122965] 0 2024-09-21T00:56:45.971 INFO:tasks.workunit.client.0.smithi112.stdout:5/164: creat d8/f30 x:0 0 0 2024-09-21T00:56:45.972 INFO:tasks.workunit.client.0.smithi112.stdout:5/165: fsync d8/d9/f27 0 2024-09-21T00:56:45.975 INFO:tasks.workunit.client.0.smithi112.stdout:5/166: truncate d8/d9/f27 776718 0 2024-09-21T00:56:45.975 INFO:tasks.workunit.client.1.smithi187.stdout:8/936: symlink dc/d2f/d80/db8/d122/l146 0 2024-09-21T00:56:45.975 INFO:tasks.workunit.client.1.smithi187.stdout:7/816: getdents d1/dce/dd0/d97/df1/d31/d33/d3b/d62 0 2024-09-21T00:56:45.976 INFO:tasks.workunit.client.1.smithi187.stdout:3/827: symlink d9/d7f/dcb/d87/l111 0 2024-09-21T00:56:45.977 INFO:tasks.workunit.client.0.smithi112.stdout:5/167: write d8/d9/f27 [322550,30773] 0 2024-09-21T00:56:45.979 INFO:tasks.workunit.client.0.smithi112.stdout:1/230: dwrite d5/d8/d10/f1d [0,4194304] 0 2024-09-21T00:56:45.981 INFO:tasks.workunit.client.1.smithi187.stdout:6/893: read d7/f9f [3755616,111086] 0 2024-09-21T00:56:45.983 INFO:tasks.workunit.client.0.smithi112.stdout:1/231: rename d5/d3a/f48 to d5/d34/f4d 0 2024-09-21T00:56:45.986 INFO:tasks.workunit.client.0.smithi112.stdout:1/232: creat d5/d8/dd/f4e x:0 0 0 2024-09-21T00:56:45.987 INFO:tasks.workunit.client.1.smithi187.stdout:8/937: creat dc/d2f/d80/db8/dba/f147 x:0 0 0 2024-09-21T00:56:45.990 INFO:tasks.workunit.client.0.smithi112.stdout:1/233: read d5/d8/d10/f20 [144672,79810] 0 2024-09-21T00:56:45.991 INFO:tasks.workunit.client.1.smithi187.stdout:6/894: dwrite d7/d59/d11d/d40/d45/f5a [4194304,4194304] 0 2024-09-21T00:56:45.991 INFO:tasks.workunit.client.0.smithi112.stdout:1/234: chown d5/l2b 21045608 1 2024-09-21T00:56:45.998 INFO:tasks.workunit.client.1.smithi187.stdout:6/895: dwrite d7/d59/d11d/d94/fea [0,4194304] 0 2024-09-21T00:56:45.999 INFO:tasks.workunit.client.1.smithi187.stdout:0/837: sync 2024-09-21T00:56:45.999 INFO:tasks.workunit.client.0.smithi112.stdout:1/235: dwrite d5/d34/f4d [0,4194304] 0 2024-09-21T00:56:46.003 INFO:tasks.workunit.client.1.smithi187.stdout:8/938: getdents dc/d2f/d54/d69/db3 0 2024-09-21T00:56:46.005 INFO:tasks.workunit.client.1.smithi187.stdout:6/896: mkdir d7/d59/d128 0 2024-09-21T00:56:46.007 INFO:tasks.workunit.client.1.smithi187.stdout:7/817: dread d1/f21 [0,4194304] 0 2024-09-21T00:56:46.007 INFO:tasks.workunit.client.1.smithi187.stdout:6/897: stat d7/d59/d11d/d40/d6a/d9e/f118 0 2024-09-21T00:56:46.023 INFO:tasks.workunit.client.0.smithi112.stdout:0/282: sync 2024-09-21T00:56:46.023 INFO:tasks.workunit.client.0.smithi112.stdout:9/294: sync 2024-09-21T00:56:46.024 INFO:tasks.workunit.client.0.smithi112.stdout:0/283: dread - d8/d11/d28/d54/f57 zero size 2024-09-21T00:56:46.027 INFO:tasks.workunit.client.1.smithi187.stdout:8/939: creat dc/d2f/d34/d4b/d85/f148 x:0 0 0 2024-09-21T00:56:46.028 INFO:tasks.workunit.client.1.smithi187.stdout:0/838: dread d0/d60/d6e/f74 [0,4194304] 0 2024-09-21T00:56:46.028 INFO:tasks.workunit.client.1.smithi187.stdout:8/940: fsync dc/d2f/d80/db8/dba/d29/f31 0 2024-09-21T00:56:46.032 INFO:tasks.workunit.client.0.smithi112.stdout:0/284: rename d8/d11/d28/c40 to d8/d1b/d2c/d2e/d4c/c5c 0 2024-09-21T00:56:46.033 INFO:tasks.workunit.client.0.smithi112.stdout:1/236: link d5/d8/c45 d5/c4f 0 2024-09-21T00:56:46.035 INFO:tasks.workunit.client.0.smithi112.stdout:9/295: mknod d5/d6/de/c5c 0 2024-09-21T00:56:46.037 INFO:tasks.workunit.client.0.smithi112.stdout:9/296: truncate d5/d6/d3f/f4c 74504 0 2024-09-21T00:56:46.038 INFO:tasks.workunit.client.0.smithi112.stdout:9/297: write d5/d6/d3f/f46 [185145,17171] 0 2024-09-21T00:56:46.038 INFO:tasks.workunit.client.0.smithi112.stdout:0/285: read d8/f20 [74658,15500] 0 2024-09-21T00:56:46.039 INFO:tasks.workunit.client.0.smithi112.stdout:1/237: rmdir d5/d8 39 2024-09-21T00:56:46.040 INFO:tasks.workunit.client.0.smithi112.stdout:1/238: fdatasync d5/d3a/f3c 0 2024-09-21T00:56:46.040 INFO:tasks.workunit.client.1.smithi187.stdout:0/839: dread d0/d17/d18/faf [0,4194304] 0 2024-09-21T00:56:46.041 INFO:tasks.workunit.client.0.smithi112.stdout:7/286: truncate d0/f42 3399908 0 2024-09-21T00:56:46.042 INFO:tasks.workunit.client.0.smithi112.stdout:0/286: unlink d8/d1b/d2c/c47 0 2024-09-21T00:56:46.044 INFO:tasks.workunit.client.0.smithi112.stdout:9/298: creat d5/d6/de/d13/f5d x:0 0 0 2024-09-21T00:56:46.045 INFO:tasks.workunit.client.0.smithi112.stdout:5/168: truncate d8/f1a 17219 0 2024-09-21T00:56:46.046 INFO:tasks.workunit.client.1.smithi187.stdout:8/941: symlink dc/d44/d132/l149 0 2024-09-21T00:56:46.046 INFO:tasks.workunit.client.0.smithi112.stdout:1/239: dwrite d5/d34/f4d [0,4194304] 0 2024-09-21T00:56:46.046 INFO:tasks.workunit.client.1.smithi187.stdout:2/923: dwrite d2/da8/d3f/fb9 [0,4194304] 0 2024-09-21T00:56:46.048 INFO:tasks.workunit.client.1.smithi187.stdout:0/840: truncate d0/d17/d18/d3a/d97/fd7 117157 0 2024-09-21T00:56:46.050 INFO:tasks.workunit.client.1.smithi187.stdout:3/828: truncate d9/d7f/dcb/d87/d94/d53/d56/d61/fe6 2124883 0 2024-09-21T00:56:46.052 INFO:tasks.workunit.client.0.smithi112.stdout:7/287: symlink d0/d2/d32/l5c 0 2024-09-21T00:56:46.053 INFO:tasks.workunit.client.0.smithi112.stdout:7/288: read d0/f46 [944793,102513] 0 2024-09-21T00:56:46.054 INFO:tasks.workunit.client.0.smithi112.stdout:7/289: readlink d0/d2/l40 0 2024-09-21T00:56:46.054 INFO:tasks.workunit.client.0.smithi112.stdout:0/287: rmdir d8/d11 39 2024-09-21T00:56:46.057 INFO:tasks.workunit.client.0.smithi112.stdout:9/299: creat d5/f5e x:0 0 0 2024-09-21T00:56:46.060 INFO:tasks.workunit.client.0.smithi112.stdout:1/240: dread - d5/d8/d14/f3b zero size 2024-09-21T00:56:46.064 INFO:tasks.workunit.client.1.smithi187.stdout:8/942: symlink dc/d94/l14a 0 2024-09-21T00:56:46.065 INFO:tasks.workunit.client.1.smithi187.stdout:8/943: write dc/d2f/d37/f42 [10773639,25465] 0 2024-09-21T00:56:46.067 INFO:tasks.workunit.client.1.smithi187.stdout:2/924: creat d2/d3/d13d/f140 x:0 0 0 2024-09-21T00:56:46.069 INFO:tasks.workunit.client.1.smithi187.stdout:0/841: mknod d0/d17/d18/d3a/d97/d112/d23/c121 0 2024-09-21T00:56:46.070 INFO:tasks.workunit.client.1.smithi187.stdout:7/818: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/fde [0,4194304] 0 2024-09-21T00:56:46.077 INFO:tasks.workunit.client.0.smithi112.stdout:7/290: dwrite d0/d2/d36/f45 [4194304,4194304] 0 2024-09-21T00:56:46.078 INFO:tasks.workunit.client.0.smithi112.stdout:1/241: chown d5/d8/dd/c18 45899046 1 2024-09-21T00:56:46.078 INFO:tasks.workunit.client.0.smithi112.stdout:7/291: dread - d0/d2/d32/f4e zero size 2024-09-21T00:56:46.079 INFO:tasks.workunit.client.0.smithi112.stdout:1/242: readlink d5/l2b 0 2024-09-21T00:56:46.080 INFO:tasks.workunit.client.1.smithi187.stdout:8/944: rename dc/d2f/d54/d69/ffe to dc/d2f/d80/db8/dba/d29/d105/f14b 0 2024-09-21T00:56:46.081 INFO:tasks.workunit.client.1.smithi187.stdout:8/945: readlink dc/d2f/d54/laa 0 2024-09-21T00:56:46.083 INFO:tasks.workunit.client.1.smithi187.stdout:7/819: symlink d1/dce/l116 0 2024-09-21T00:56:46.084 INFO:tasks.workunit.client.1.smithi187.stdout:4/899: sync 2024-09-21T00:56:46.084 INFO:tasks.workunit.client.1.smithi187.stdout:1/969: sync 2024-09-21T00:56:46.087 INFO:tasks.workunit.client.0.smithi112.stdout:1/243: mkdir d5/d8/dd/d50 0 2024-09-21T00:56:46.088 INFO:tasks.workunit.client.1.smithi187.stdout:1/970: truncate d4/d6/d23/d2e/d94/d35/d22/d65/f128 963806 0 2024-09-21T00:56:46.092 INFO:tasks.workunit.client.1.smithi187.stdout:8/946: rmdir dc/d2f/d80/db8/dba/d29 39 2024-09-21T00:56:46.094 INFO:tasks.workunit.client.0.smithi112.stdout:0/288: write d8/d1b/f36 [979478,105732] 0 2024-09-21T00:56:46.096 INFO:tasks.workunit.client.1.smithi187.stdout:7/820: mknod d1/d55/c117 0 2024-09-21T00:56:46.097 INFO:tasks.workunit.client.1.smithi187.stdout:7/821: stat d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fd2 0 2024-09-21T00:56:46.097 INFO:tasks.workunit.client.0.smithi112.stdout:7/292: rename d0/d2/d36/d39/d1a/f52 to d0/d2/f5d 0 2024-09-21T00:56:46.098 INFO:tasks.workunit.client.1.smithi187.stdout:3/829: write d9/f4e [271668,39627] 0 2024-09-21T00:56:46.098 INFO:tasks.workunit.client.1.smithi187.stdout:7/822: chown d1/dce/dd0/d97/df1/d31/d33/d3b/f4a 2901 1 2024-09-21T00:56:46.099 INFO:tasks.workunit.client.1.smithi187.stdout:0/842: link d0/d17/d18/d90/d98/fcd d0/d17/d18/d3a/d114/f122 0 2024-09-21T00:56:46.100 INFO:tasks.workunit.client.0.smithi112.stdout:1/244: truncate d5/d8/f35 2114326 0 2024-09-21T00:56:46.100 INFO:tasks.workunit.client.0.smithi112.stdout:2/300: sync 2024-09-21T00:56:46.100 INFO:tasks.workunit.client.0.smithi112.stdout:4/363: sync 2024-09-21T00:56:46.100 INFO:tasks.workunit.client.1.smithi187.stdout:7/823: fdatasync d1/dce/dd0/d97/df1/d31/d33/d3b/d62/ffb 0 2024-09-21T00:56:46.101 INFO:tasks.workunit.client.0.smithi112.stdout:4/364: write d1/d7/f17 [5523522,73960] 0 2024-09-21T00:56:46.103 INFO:tasks.workunit.client.0.smithi112.stdout:0/289: write d8/d11/d59/f5a [779497,35399] 0 2024-09-21T00:56:46.103 INFO:tasks.workunit.client.0.smithi112.stdout:9/300: dread d5/d6/de/d13/f1a [4194304,4194304] 0 2024-09-21T00:56:46.103 INFO:tasks.workunit.client.1.smithi187.stdout:7/824: readlink d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/le0 0 2024-09-21T00:56:46.104 INFO:tasks.workunit.client.1.smithi187.stdout:5/793: sync 2024-09-21T00:56:46.104 INFO:tasks.workunit.client.1.smithi187.stdout:6/898: sync 2024-09-21T00:56:46.104 INFO:tasks.workunit.client.0.smithi112.stdout:0/290: write d8/d1b/d2c/d2e/f39 [72357,6611] 0 2024-09-21T00:56:46.105 INFO:tasks.workunit.client.0.smithi112.stdout:0/291: fsync d8/f35 0 2024-09-21T00:56:46.107 INFO:tasks.workunit.client.1.smithi187.stdout:2/925: creat d2/d3/f141 x:0 0 0 2024-09-21T00:56:46.109 INFO:tasks.workunit.client.1.smithi187.stdout:8/947: readlink dc/d2f/d80/db8/l115 0 2024-09-21T00:56:46.109 INFO:tasks.workunit.client.1.smithi187.stdout:0/843: dwrite d0/d17/d18/d3a/f5e [4194304,4194304] 0 2024-09-21T00:56:46.110 INFO:tasks.workunit.client.1.smithi187.stdout:3/830: fsync d9/d7f/dcb/f1e 0 2024-09-21T00:56:46.110 INFO:tasks.workunit.client.1.smithi187.stdout:6/899: write d7/d59/d11d/d40/d50/d83/f87 [1401489,91844] 0 2024-09-21T00:56:46.111 INFO:tasks.workunit.client.0.smithi112.stdout:7/293: rename d0/d2/d36/d39/d1a/d23/l3f to d0/d2/d36/d39/l5e 0 2024-09-21T00:56:46.111 INFO:tasks.workunit.client.0.smithi112.stdout:7/294: chown d0/d2/d36/d39/d1a/l47 2025 1 2024-09-21T00:56:46.112 INFO:tasks.workunit.client.1.smithi187.stdout:2/926: write d2/dc/d21/fea [1193606,70791] 0 2024-09-21T00:56:46.112 INFO:tasks.workunit.client.0.smithi112.stdout:5/169: dread d8/d9/d13/d2a/df/f10 [0,4194304] 0 2024-09-21T00:56:46.114 INFO:tasks.workunit.client.0.smithi112.stdout:5/170: write d8/d9/d13/d2a/f12 [1239270,114384] 0 2024-09-21T00:56:46.117 INFO:tasks.workunit.client.0.smithi112.stdout:2/301: mknod d0/d14/d22/c5f 0 2024-09-21T00:56:46.117 INFO:tasks.workunit.client.1.smithi187.stdout:5/794: dwrite d0/dc/daa/d67/f50 [4194304,4194304] 0 2024-09-21T00:56:46.118 INFO:tasks.workunit.client.0.smithi112.stdout:2/302: chown d0/d14/f40 475295 1 2024-09-21T00:56:46.118 INFO:tasks.workunit.client.1.smithi187.stdout:5/795: fsync d0/fa5 0 2024-09-21T00:56:46.118 INFO:tasks.workunit.client.0.smithi112.stdout:2/303: fsync d0/f53 0 2024-09-21T00:56:46.121 INFO:tasks.workunit.client.1.smithi187.stdout:1/971: write d4/d86/fe8 [222920,86633] 0 2024-09-21T00:56:46.125 INFO:tasks.workunit.client.1.smithi187.stdout:1/972: dread - d4/d6/d23/d2e/d94/d35/d4c/df7/f123 zero size 2024-09-21T00:56:46.127 INFO:tasks.workunit.client.1.smithi187.stdout:4/900: dwrite d2/d3/d74/f80 [4194304,4194304] 0 2024-09-21T00:56:46.128 INFO:tasks.workunit.client.1.smithi187.stdout:8/948: symlink dc/d44/dc1/l14c 0 2024-09-21T00:56:46.129 INFO:tasks.workunit.client.1.smithi187.stdout:8/949: readlink dc/dea/ld3 0 2024-09-21T00:56:46.129 INFO:tasks.workunit.client.0.smithi112.stdout:7/295: creat d0/d2/d2e/f5f x:0 0 0 2024-09-21T00:56:46.131 INFO:tasks.workunit.client.0.smithi112.stdout:7/296: dread - d0/d2/f5d zero size 2024-09-21T00:56:46.131 INFO:tasks.workunit.client.0.smithi112.stdout:1/245: creat d5/d8/d13/d3e/d46/f51 x:0 0 0 2024-09-21T00:56:46.132 INFO:tasks.workunit.client.0.smithi112.stdout:7/297: stat d0/f46 0 2024-09-21T00:56:46.133 INFO:tasks.workunit.client.1.smithi187.stdout:2/927: creat d2/dc/d6b/f142 x:0 0 0 2024-09-21T00:56:46.133 INFO:tasks.workunit.client.1.smithi187.stdout:3/831: dwrite d9/fb7 [0,4194304] 0 2024-09-21T00:56:46.134 INFO:tasks.workunit.client.0.smithi112.stdout:5/171: mknod d8/d9/d13/d2a/d2c/c31 0 2024-09-21T00:56:46.135 INFO:tasks.workunit.client.0.smithi112.stdout:0/292: dwrite d8/d1b/f44 [0,4194304] 0 2024-09-21T00:56:46.135 INFO:tasks.workunit.client.0.smithi112.stdout:2/304: rmdir d0/df 39 2024-09-21T00:56:46.137 INFO:tasks.workunit.client.1.smithi187.stdout:6/900: mknod d7/d59/d11d/d40/d45/df7/c129 0 2024-09-21T00:56:46.137 INFO:tasks.workunit.client.0.smithi112.stdout:7/298: read - d0/d2/d36/d39/d1a/f4d zero size 2024-09-21T00:56:46.138 INFO:tasks.workunit.client.0.smithi112.stdout:1/246: chown d5/d34/f49 1076052038 1 2024-09-21T00:56:46.138 INFO:tasks.workunit.client.0.smithi112.stdout:7/299: stat d0/d2/d38 0 2024-09-21T00:56:46.139 INFO:tasks.workunit.client.1.smithi187.stdout:3/832: dread d9/d7f/dcb/d87/d94/d53/d56/d61/f74 [0,4194304] 0 2024-09-21T00:56:46.139 INFO:tasks.workunit.client.0.smithi112.stdout:9/301: rename d5/d6/de to d5/d3b/d5f 0 2024-09-21T00:56:46.140 INFO:tasks.workunit.client.0.smithi112.stdout:7/300: write d0/d2/d32/f4e [579704,30617] 0 2024-09-21T00:56:46.141 INFO:tasks.workunit.client.1.smithi187.stdout:3/833: fsync d9/d7f/dcb/d87/d94/d53/d56/dc9/f10c 0 2024-09-21T00:56:46.141 INFO:tasks.workunit.client.1.smithi187.stdout:5/796: unlink d0/dc/daa/d67/d14/d1b/d27/d3a/fb0 0 2024-09-21T00:56:46.142 INFO:tasks.workunit.client.0.smithi112.stdout:7/301: dread - d0/d2/d36/d39/d1a/f4d zero size 2024-09-21T00:56:46.143 INFO:tasks.workunit.client.0.smithi112.stdout:2/305: read d0/d14/d8/d27/f2a [1903594,55824] 0 2024-09-21T00:56:46.147 INFO:tasks.workunit.client.0.smithi112.stdout:7/302: symlink d0/d2/d36/l60 0 2024-09-21T00:56:46.147 INFO:tasks.workunit.client.1.smithi187.stdout:7/825: dread d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/f7d [0,4194304] 0 2024-09-21T00:56:46.148 INFO:tasks.workunit.client.1.smithi187.stdout:0/844: dread d0/d17/d18/f81 [0,4194304] 0 2024-09-21T00:56:46.150 INFO:tasks.workunit.client.1.smithi187.stdout:0/845: read d0/d17/d18/d3a/d97/d112/d23/d36/f38 [920439,31786] 0 2024-09-21T00:56:46.150 INFO:tasks.workunit.client.1.smithi187.stdout:2/928: rename d2/d3/d15/dfe/dc6/cde to d2/dc/d2e/d4a/d7c/d52/dac/c143 0 2024-09-21T00:56:46.153 INFO:tasks.workunit.client.0.smithi112.stdout:1/247: mknod d5/d8/d10/d2e/c52 0 2024-09-21T00:56:46.154 INFO:tasks.workunit.client.0.smithi112.stdout:1/248: readlink d5/d8/d10/l2d 0 2024-09-21T00:56:46.154 INFO:tasks.workunit.client.1.smithi187.stdout:0/846: dread d0/d17/d18/d3a/d97/d112/d23/df/f53 [4194304,4194304] 0 2024-09-21T00:56:46.155 INFO:tasks.workunit.client.0.smithi112.stdout:7/303: creat d0/d2/d32/f61 x:0 0 0 2024-09-21T00:56:46.156 INFO:tasks.workunit.client.1.smithi187.stdout:5/797: symlink d0/dc/daa/d67/d14/d38/d5a/d6c/l108 0 2024-09-21T00:56:46.156 INFO:tasks.workunit.client.0.smithi112.stdout:1/249: dread d5/d8/d10/d2e/f44 [0,4194304] 0 2024-09-21T00:56:46.158 INFO:tasks.workunit.client.1.smithi187.stdout:4/901: mknod d2/d3/d74/de2/c110 0 2024-09-21T00:56:46.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:45 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:46.160 INFO:tasks.workunit.client.1.smithi187.stdout:7/826: creat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/da6/f118 x:0 0 0 2024-09-21T00:56:46.161 INFO:tasks.workunit.client.0.smithi112.stdout:9/302: getdents d5 0 2024-09-21T00:56:46.162 INFO:tasks.workunit.client.1.smithi187.stdout:0/847: dwrite d0/d17/d18/d90/d98/ddd/f113 [0,4194304] 0 2024-09-21T00:56:46.162 INFO:tasks.workunit.client.1.smithi187.stdout:6/901: fdatasync d7/f5f 0 2024-09-21T00:56:46.163 INFO:tasks.workunit.client.1.smithi187.stdout:7/827: readlink d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/la0 0 2024-09-21T00:56:46.163 INFO:tasks.workunit.client.0.smithi112.stdout:7/304: symlink d0/d2/d36/l62 0 2024-09-21T00:56:46.165 INFO:tasks.workunit.client.1.smithi187.stdout:3/834: chown d9/d19/d43/cc7 2 1 2024-09-21T00:56:46.167 INFO:tasks.workunit.client.1.smithi187.stdout:1/973: creat d4/d6/d23/d2e/d53/f142 x:0 0 0 2024-09-21T00:56:46.169 INFO:tasks.workunit.client.1.smithi187.stdout:5/798: rmdir d0/dc/daa/d67/d14/d38/d5a/d6c 39 2024-09-21T00:56:46.171 INFO:tasks.workunit.client.0.smithi112.stdout:2/306: getdents d0/d51 0 2024-09-21T00:56:46.173 INFO:tasks.workunit.client.0.smithi112.stdout:7/305: write d0/d2/f5d [292931,125813] 0 2024-09-21T00:56:46.176 INFO:tasks.workunit.client.0.smithi112.stdout:7/306: symlink d0/d2/d32/l63 0 2024-09-21T00:56:46.177 INFO:tasks.workunit.client.0.smithi112.stdout:7/307: write d0/d2/d36/d39/f35 [1788075,11760] 0 2024-09-21T00:56:46.181 INFO:tasks.workunit.client.1.smithi187.stdout:8/950: dread dc/d2f/d34/d4b/d85/fe4 [0,4194304] 0 2024-09-21T00:56:46.181 INFO:tasks.workunit.client.1.smithi187.stdout:0/848: unlink d0/d5a/f89 0 2024-09-21T00:56:46.183 INFO:tasks.workunit.client.0.smithi112.stdout:9/303: dread d5/f22 [0,4194304] 0 2024-09-21T00:56:46.183 INFO:tasks.workunit.client.1.smithi187.stdout:6/902: rmdir d7/d59/d11d 39 2024-09-21T00:56:46.185 INFO:tasks.workunit.client.1.smithi187.stdout:7/828: creat d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/f119 x:0 0 0 2024-09-21T00:56:46.185 INFO:tasks.workunit.client.1.smithi187.stdout:7/829: chown d1/dce/dd4/fe2 1103644 1 2024-09-21T00:56:46.186 INFO:tasks.workunit.client.1.smithi187.stdout:3/835: mknod d9/d19/da7/c112 0 2024-09-21T00:56:46.189 INFO:tasks.workunit.client.1.smithi187.stdout:1/974: write d4/d6/d23/d2e/d94/f37 [3887487,124034] 0 2024-09-21T00:56:46.189 INFO:tasks.workunit.client.0.smithi112.stdout:9/304: dwrite d5/f49 [0,4194304] 0 2024-09-21T00:56:46.191 INFO:tasks.workunit.client.1.smithi187.stdout:1/975: chown d4/d6/fa9 6270210 1 2024-09-21T00:56:46.191 INFO:tasks.workunit.client.1.smithi187.stdout:7/830: dwrite d1/f9 [4194304,4194304] 0 2024-09-21T00:56:46.192 INFO:tasks.workunit.client.0.smithi112.stdout:7/308: creat d0/d2/f64 x:0 0 0 2024-09-21T00:56:46.192 INFO:tasks.workunit.client.1.smithi187.stdout:4/902: dread d2/d3/f36 [0,4194304] 0 2024-09-21T00:56:46.193 INFO:tasks.workunit.client.1.smithi187.stdout:1/976: dread - d4/d6/d23/d2e/d94/d35/d22/dcd/ff8 zero size 2024-09-21T00:56:46.193 INFO:tasks.workunit.client.1.smithi187.stdout:7/831: dread - d1/dce/dd0/d97/df1/d31/d41/d8a/dd5/f10a zero size 2024-09-21T00:56:46.195 INFO:tasks.workunit.client.1.smithi187.stdout:2/929: creat d2/dc/d2e/f144 x:0 0 0 2024-09-21T00:56:46.199 INFO:tasks.workunit.client.0.smithi112.stdout:9/305: creat d5/d6/d19/d1b/d57/f60 x:0 0 0 2024-09-21T00:56:46.202 INFO:tasks.workunit.client.0.smithi112.stdout:7/309: dread d0/f46 [0,4194304] 0 2024-09-21T00:56:46.204 INFO:tasks.workunit.client.0.smithi112.stdout:7/310: truncate d0/d2/f64 1039971 0 2024-09-21T00:56:46.205 INFO:tasks.workunit.client.0.smithi112.stdout:7/311: write d0/d2/d32/f61 [457030,70998] 0 2024-09-21T00:56:46.205 INFO:tasks.workunit.client.0.smithi112.stdout:5/172: truncate d8/d9/f27 603056 0 2024-09-21T00:56:46.206 INFO:tasks.workunit.client.0.smithi112.stdout:7/312: stat d0/d2/d36/d39/d1a/c5a 0 2024-09-21T00:56:46.207 INFO:tasks.workunit.client.1.smithi187.stdout:4/903: mkdir d2/d3/da/d111 0 2024-09-21T00:56:46.207 INFO:tasks.workunit.client.0.smithi112.stdout:7/313: write d0/d2/f31 [633518,67698] 0 2024-09-21T00:56:46.208 INFO:tasks.workunit.client.0.smithi112.stdout:7/314: readlink d0/d2/d36/d39/l27 0 2024-09-21T00:56:46.213 INFO:tasks.workunit.client.1.smithi187.stdout:2/930: mknod d2/da8/d6c/db8/d94/c145 0 2024-09-21T00:56:46.214 INFO:tasks.workunit.client.0.smithi112.stdout:1/250: write d5/d8/f1f [1751244,42834] 0 2024-09-21T00:56:46.215 INFO:tasks.workunit.client.0.smithi112.stdout:9/306: getdents d5 0 2024-09-21T00:56:46.216 INFO:tasks.workunit.client.0.smithi112.stdout:7/315: dwrite d0/d2/f64 [0,4194304] 0 2024-09-21T00:56:46.216 INFO:tasks.workunit.client.1.smithi187.stdout:3/836: creat d9/dcc/d105/f113 x:0 0 0 2024-09-21T00:56:46.217 INFO:tasks.workunit.client.0.smithi112.stdout:1/251: write d5/d34/f36 [179455,94723] 0 2024-09-21T00:56:46.218 INFO:tasks.workunit.client.0.smithi112.stdout:5/173: rename d8/d9/d13/d2a/df/c1f to d8/d9/c32 0 2024-09-21T00:56:46.218 INFO:tasks.workunit.client.0.smithi112.stdout:1/252: fdatasync d5/f43 0 2024-09-21T00:56:46.218 INFO:tasks.workunit.client.1.smithi187.stdout:3/837: fsync d9/f4e 0 2024-09-21T00:56:46.219 INFO:tasks.workunit.client.1.smithi187.stdout:7/832: dwrite d1/dce/dd0/d97/df1/d31/d41/dbe/ff4 [0,4194304] 0 2024-09-21T00:56:46.221 INFO:tasks.workunit.client.0.smithi112.stdout:7/316: dread d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:46.222 INFO:tasks.workunit.client.1.smithi187.stdout:5/799: dread d0/dc/d1f/d26/f71 [0,4194304] 0 2024-09-21T00:56:46.222 INFO:tasks.workunit.client.1.smithi187.stdout:8/951: creat dc/d2f/d80/db8/dba/d3e/f14d x:0 0 0 2024-09-21T00:56:46.223 INFO:tasks.workunit.client.0.smithi112.stdout:1/253: creat d5/d8/d13/f53 x:0 0 0 2024-09-21T00:56:46.225 INFO:tasks.workunit.client.0.smithi112.stdout:1/254: dread d5/d8/d10/f16 [0,4194304] 0 2024-09-21T00:56:46.225 INFO:tasks.workunit.client.0.smithi112.stdout:9/307: creat d5/d3b/d5f/d13/d56/f61 x:0 0 0 2024-09-21T00:56:46.227 INFO:tasks.workunit.client.0.smithi112.stdout:9/308: fdatasync d5/d6/d19/d1b/d57/f60 0 2024-09-21T00:56:46.227 INFO:tasks.workunit.client.1.smithi187.stdout:2/931: write d2/da8/f5e [3805929,94008] 0 2024-09-21T00:56:46.228 INFO:tasks.workunit.client.1.smithi187.stdout:8/952: stat dc/d2f/d34/d137 0 2024-09-21T00:56:46.228 INFO:tasks.workunit.client.1.smithi187.stdout:4/904: symlink d2/d3/da/d2f/d4b/daf/l112 0 2024-09-21T00:56:46.228 INFO:tasks.workunit.client.0.smithi112.stdout:5/174: symlink d8/d9/d13/d2a/d2c/l33 0 2024-09-21T00:56:46.228 INFO:tasks.workunit.client.1.smithi187.stdout:2/932: readlink d2/d25/l7d 0 2024-09-21T00:56:46.229 INFO:tasks.workunit.client.1.smithi187.stdout:2/933: stat d2/d3/d15/dfe/dc6/f13e 0 2024-09-21T00:56:46.233 INFO:tasks.workunit.client.1.smithi187.stdout:2/934: dread d2/f8 [8388608,4194304] 0 2024-09-21T00:56:46.234 INFO:tasks.workunit.client.0.smithi112.stdout:7/317: mkdir d0/d2/d36/d39/d56/d65 0 2024-09-21T00:56:46.235 INFO:tasks.workunit.client.0.smithi112.stdout:1/255: dwrite d5/d8/d13/f53 [0,4194304] 0 2024-09-21T00:56:46.235 INFO:tasks.workunit.client.1.smithi187.stdout:0/849: getdents d0/d17/d18/d3a 0 2024-09-21T00:56:46.242 INFO:tasks.workunit.client.0.smithi112.stdout:5/175: symlink d8/d9/d13/l34 0 2024-09-21T00:56:46.243 INFO:tasks.workunit.client.1.smithi187.stdout:4/905: truncate d2/f65 819869 0 2024-09-21T00:56:46.244 INFO:tasks.workunit.client.0.smithi112.stdout:1/256: dwrite d5/d8/dd/f4e [0,4194304] 0 2024-09-21T00:56:46.244 INFO:tasks.workunit.client.1.smithi187.stdout:3/838: readlink d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/la5 0 2024-09-21T00:56:46.246 INFO:tasks.workunit.client.1.smithi187.stdout:1/977: getdents d4/d75 0 2024-09-21T00:56:46.250 INFO:tasks.workunit.client.0.smithi112.stdout:5/176: creat d8/d9/d13/f35 x:0 0 0 2024-09-21T00:56:46.251 INFO:tasks.workunit.client.1.smithi187.stdout:6/903: dwrite d7/f64 [0,4194304] 0 2024-09-21T00:56:46.251 INFO:tasks.workunit.client.0.smithi112.stdout:5/177: chown d8/d9/d13/f2d 1651 1 2024-09-21T00:56:46.252 INFO:tasks.workunit.client.1.smithi187.stdout:0/850: unlink d0/fbb 0 2024-09-21T00:56:46.255 INFO:tasks.workunit.client.1.smithi187.stdout:4/906: creat d2/d3/da/f113 x:0 0 0 2024-09-21T00:56:46.256 INFO:tasks.workunit.client.0.smithi112.stdout:5/178: mknod d8/d9/d13/d2a/d2c/c36 0 2024-09-21T00:56:46.259 INFO:tasks.workunit.client.0.smithi112.stdout:7/318: creat d0/d2/d36/d39/d1a/f66 x:0 0 0 2024-09-21T00:56:46.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:45 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:56:46.260 INFO:tasks.workunit.client.0.smithi112.stdout:5/179: mknod d8/d9/d13/c37 0 2024-09-21T00:56:46.262 INFO:tasks.workunit.client.1.smithi187.stdout:0/851: dwrite d0/d17/d18/d3a/d97/d112/d65/fe5 [0,4194304] 0 2024-09-21T00:56:46.264 INFO:tasks.workunit.client.1.smithi187.stdout:4/907: fdatasync d2/d3/da/d16/fab 0 2024-09-21T00:56:46.266 INFO:tasks.workunit.client.0.smithi112.stdout:5/180: rename d8/d9/d13/d2a/df/f23 to d8/d9/d13/d2a/f38 0 2024-09-21T00:56:46.267 INFO:tasks.workunit.client.0.smithi112.stdout:7/319: creat d0/f67 x:0 0 0 2024-09-21T00:56:46.272 INFO:tasks.workunit.client.0.smithi112.stdout:5/181: creat d8/d9/d13/f39 x:0 0 0 2024-09-21T00:56:46.273 INFO:tasks.workunit.client.1.smithi187.stdout:0/852: symlink d0/d17/d18/d3a/d114/l123 0 2024-09-21T00:56:46.274 INFO:tasks.workunit.client.0.smithi112.stdout:5/182: symlink d8/d9/d13/l3a 0 2024-09-21T00:56:46.275 INFO:tasks.workunit.client.1.smithi187.stdout:4/908: write d2/d3/fbb [4964178,104142] 0 2024-09-21T00:56:46.276 INFO:tasks.workunit.client.1.smithi187.stdout:4/909: dread - d2/d3/da/d2f/d32/d22/d37/f108 zero size 2024-09-21T00:56:46.276 INFO:tasks.workunit.client.1.smithi187.stdout:6/904: creat d7/f12a x:0 0 0 2024-09-21T00:56:46.277 INFO:tasks.workunit.client.0.smithi112.stdout:7/320: creat d0/d2/f68 x:0 0 0 2024-09-21T00:56:46.278 INFO:tasks.workunit.client.1.smithi187.stdout:1/978: link d4/d6/d64/f71 d4/d86/f143 0 2024-09-21T00:56:46.279 INFO:tasks.workunit.client.1.smithi187.stdout:1/979: write d4/d6/d64/fb3 [4379172,4814] 0 2024-09-21T00:56:46.280 INFO:tasks.workunit.client.1.smithi187.stdout:6/905: write d7/d59/d11d/d40/d6a/d88/f11e [32041,22093] 0 2024-09-21T00:56:46.280 INFO:tasks.workunit.client.1.smithi187.stdout:4/910: truncate d2/d3/da/d2f/d32/d24/f45 5332949 0 2024-09-21T00:56:46.280 INFO:tasks.workunit.client.1.smithi187.stdout:1/980: write d4/d86/f8e [739886,31373] 0 2024-09-21T00:56:46.282 INFO:tasks.workunit.client.0.smithi112.stdout:5/183: dwrite d8/d9/d13/f2d [0,4194304] 0 2024-09-21T00:56:46.282 INFO:tasks.workunit.client.0.smithi112.stdout:7/321: unlink d0/d2/d32/f4e 0 2024-09-21T00:56:46.282 INFO:tasks.workunit.client.1.smithi187.stdout:1/981: fdatasync d4/d6/d23/d2e/d94/d35/d4c/f132 0 2024-09-21T00:56:46.282 INFO:tasks.workunit.client.1.smithi187.stdout:4/911: chown d2/d3/da/d2f/d32/d24/dcd/lea 141 1 2024-09-21T00:56:46.283 INFO:tasks.workunit.client.1.smithi187.stdout:1/982: chown d4/d6/d23/d2e/d94/d66/ddf/d12a 1068554 1 2024-09-21T00:56:46.283 INFO:tasks.workunit.client.0.smithi112.stdout:5/184: read - d8/d9/d13/f39 zero size 2024-09-21T00:56:46.288 INFO:tasks.workunit.client.0.smithi112.stdout:7/322: unlink d0/f10 0 2024-09-21T00:56:46.295 INFO:tasks.workunit.client.0.smithi112.stdout:7/323: creat d0/d2/f69 x:0 0 0 2024-09-21T00:56:46.296 INFO:tasks.workunit.client.1.smithi187.stdout:0/853: getdents d0/d17/d18/d3a/d97/d112/d23/d108 0 2024-09-21T00:56:46.297 INFO:tasks.workunit.client.0.smithi112.stdout:7/324: readlink d0/d2/l37 0 2024-09-21T00:56:46.300 INFO:tasks.workunit.client.0.smithi112.stdout:7/325: dread d0/d2/f5d [0,4194304] 0 2024-09-21T00:56:46.300 INFO:tasks.workunit.client.0.smithi112.stdout:7/326: chown d0/f3b 1157946752 1 2024-09-21T00:56:46.300 INFO:tasks.workunit.client.0.smithi112.stdout:7/327: chown d0/d2/f31 12558 1 2024-09-21T00:56:46.307 INFO:tasks.workunit.client.1.smithi187.stdout:7/833: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/fa4 [0,4194304] 0 2024-09-21T00:56:46.308 INFO:tasks.workunit.client.0.smithi112.stdout:9/309: dwrite d5/d6/f30 [0,4194304] 0 2024-09-21T00:56:46.308 INFO:tasks.workunit.client.0.smithi112.stdout:7/328: mknod d0/c6a 0 2024-09-21T00:56:46.310 INFO:tasks.workunit.client.1.smithi187.stdout:8/953: dwrite dc/f12 [0,4194304] 0 2024-09-21T00:56:46.311 INFO:tasks.workunit.client.1.smithi187.stdout:8/954: chown dc/d94 744 1 2024-09-21T00:56:46.316 INFO:tasks.workunit.client.0.smithi112.stdout:8/261: sync 2024-09-21T00:56:46.316 INFO:tasks.workunit.client.0.smithi112.stdout:6/286: sync 2024-09-21T00:56:46.316 INFO:tasks.workunit.client.0.smithi112.stdout:3/472: sync 2024-09-21T00:56:46.317 INFO:tasks.workunit.client.1.smithi187.stdout:2/935: dwrite d2/dc/d2e/f82 [0,4194304] 0 2024-09-21T00:56:46.318 INFO:tasks.workunit.client.0.smithi112.stdout:3/473: chown d2/d38/c88 24835203 1 2024-09-21T00:56:46.319 INFO:tasks.workunit.client.0.smithi112.stdout:8/262: truncate d0/d13/d2a/f39 895156 0 2024-09-21T00:56:46.324 INFO:tasks.workunit.client.0.smithi112.stdout:1/257: write d5/fc [1840307,80781] 0 2024-09-21T00:56:46.324 INFO:tasks.workunit.client.1.smithi187.stdout:5/800: sync 2024-09-21T00:56:46.326 INFO:tasks.workunit.client.0.smithi112.stdout:6/287: mknod d9/df/d56/d33/c6d 0 2024-09-21T00:56:46.328 INFO:tasks.workunit.client.1.smithi187.stdout:3/839: dwrite d9/d7f/dcb/d87/d94/f45 [0,4194304] 0 2024-09-21T00:56:46.328 INFO:tasks.workunit.client.1.smithi187.stdout:3/840: fsync d9/d19/da7/daa/dce/fd2 0 2024-09-21T00:56:46.329 INFO:tasks.workunit.client.0.smithi112.stdout:7/329: dwrite d0/d2/d38/d48/f53 [0,4194304] 0 2024-09-21T00:56:46.329 INFO:tasks.workunit.client.0.smithi112.stdout:3/474: mknod d2/d3e/d7b/cad 0 2024-09-21T00:56:46.331 INFO:tasks.workunit.client.0.smithi112.stdout:8/263: creat d0/d13/f52 x:0 0 0 2024-09-21T00:56:46.333 INFO:tasks.workunit.client.0.smithi112.stdout:8/264: chown d0/d13/d2a/f48 33478 1 2024-09-21T00:56:46.334 INFO:tasks.workunit.client.0.smithi112.stdout:8/265: stat d0/d13/d1b/l4f 0 2024-09-21T00:56:46.335 INFO:tasks.workunit.client.0.smithi112.stdout:8/266: chown d0/f3e 0 1 2024-09-21T00:56:46.336 INFO:tasks.workunit.client.0.smithi112.stdout:8/267: dread - d0/d13/d1b/d22/f4e zero size 2024-09-21T00:56:46.336 INFO:tasks.workunit.client.0.smithi112.stdout:1/258: rmdir d5/d8/d13 39 2024-09-21T00:56:46.337 INFO:tasks.workunit.client.0.smithi112.stdout:1/259: chown d5/d3a/f3c 250095 1 2024-09-21T00:56:46.337 INFO:tasks.workunit.client.0.smithi112.stdout:8/268: read d0/d13/f3f [136038,9255] 0 2024-09-21T00:56:46.341 INFO:tasks.workunit.client.0.smithi112.stdout:6/288: rename d9/fd to d9/d1b/f6e 0 2024-09-21T00:56:46.344 INFO:tasks.workunit.client.0.smithi112.stdout:7/330: unlink d0/d2/d38/c57 0 2024-09-21T00:56:46.346 INFO:tasks.workunit.client.0.smithi112.stdout:3/475: symlink d2/d33/d8c/lae 0 2024-09-21T00:56:46.346 INFO:tasks.workunit.client.0.smithi112.stdout:3/476: write d2/d8/d6d/fa2 [877405,109211] 0 2024-09-21T00:56:46.349 INFO:tasks.workunit.client.1.smithi187.stdout:6/906: write d7/d59/d11d/d40/d50/f7b [354691,111772] 0 2024-09-21T00:56:46.350 INFO:tasks.workunit.client.1.smithi187.stdout:6/907: dread - d7/d59/d11d/d40/d50/d83/f112 zero size 2024-09-21T00:56:46.350 INFO:tasks.workunit.client.0.smithi112.stdout:1/260: mkdir d5/d8/dd/d54 0 2024-09-21T00:56:46.350 INFO:tasks.workunit.client.1.smithi187.stdout:4/912: write d2/d3/da/fc [292476,115161] 0 2024-09-21T00:56:46.352 INFO:tasks.workunit.client.0.smithi112.stdout:6/289: mkdir d9/d1f/d3e/d6f 0 2024-09-21T00:56:46.354 INFO:tasks.workunit.client.0.smithi112.stdout:5/185: truncate d8/d9/d13/d2a/f26 4169852 0 2024-09-21T00:56:46.357 INFO:tasks.workunit.client.0.smithi112.stdout:3/477: symlink d2/d38/d3f/d53/laf 0 2024-09-21T00:56:46.364 INFO:tasks.workunit.client.0.smithi112.stdout:7/331: fsync d0/fa 0 2024-09-21T00:56:46.364 INFO:tasks.workunit.client.0.smithi112.stdout:7/332: readlink d0/d2/l37 0 2024-09-21T00:56:46.366 INFO:tasks.workunit.client.0.smithi112.stdout:3/478: unlink d2/d8/l24 0 2024-09-21T00:56:46.368 INFO:tasks.workunit.client.0.smithi112.stdout:8/269: creat d0/d13/d1b/f53 x:0 0 0 2024-09-21T00:56:46.370 INFO:tasks.workunit.client.0.smithi112.stdout:6/290: mkdir d9/d13/d21/d4c/d70 0 2024-09-21T00:56:46.376 INFO:tasks.workunit.client.0.smithi112.stdout:9/310: dwrite d5/fb [0,4194304] 0 2024-09-21T00:56:46.385 INFO:tasks.workunit.client.0.smithi112.stdout:7/333: creat d0/d2/d36/d39/d1a/f6b x:0 0 0 2024-09-21T00:56:46.389 INFO:tasks.workunit.client.0.smithi112.stdout:7/334: rmdir d0/d2/d36/d39/d1a/d23 39 2024-09-21T00:56:46.393 INFO:tasks.workunit.client.0.smithi112.stdout:7/335: mkdir d0/d2/d6c 0 2024-09-21T00:56:46.394 INFO:tasks.workunit.client.0.smithi112.stdout:7/336: chown d0/d2/d38/l3a 215187 1 2024-09-21T00:56:46.398 INFO:tasks.workunit.client.0.smithi112.stdout:9/311: dread d5/d6/d19/f2a [4194304,4194304] 0 2024-09-21T00:56:46.399 INFO:tasks.workunit.client.1.smithi187.stdout:7/834: creat d1/d55/d80/f11a x:0 0 0 2024-09-21T00:56:46.401 INFO:tasks.workunit.client.0.smithi112.stdout:7/337: dwrite d0/d2/d32/f5b [0,4194304] 0 2024-09-21T00:56:46.401 INFO:tasks.workunit.client.0.smithi112.stdout:7/338: dread - d0/f67 zero size 2024-09-21T00:56:46.402 INFO:tasks.workunit.client.0.smithi112.stdout:7/339: chown d0/d2/l40 80 1 2024-09-21T00:56:46.403 INFO:tasks.workunit.client.0.smithi112.stdout:9/312: mkdir d5/d62 0 2024-09-21T00:56:46.404 INFO:tasks.workunit.client.0.smithi112.stdout:1/261: write d5/d8/d10/f16 [81343,57163] 0 2024-09-21T00:56:46.405 INFO:tasks.workunit.client.1.smithi187.stdout:5/801: creat d0/dc/d1f/d26/d8b/f109 x:0 0 0 2024-09-21T00:56:46.414 INFO:tasks.workunit.client.0.smithi112.stdout:3/479: fsync d2/d8/d28/fab 0 2024-09-21T00:56:46.414 INFO:tasks.workunit.client.0.smithi112.stdout:3/480: fdatasync d2/f5e 0 2024-09-21T00:56:46.418 INFO:tasks.workunit.client.0.smithi112.stdout:3/481: dread d2/f95 [0,4194304] 0 2024-09-21T00:56:46.418 INFO:tasks.workunit.client.1.smithi187.stdout:8/955: symlink dc/d2f/d80/db8/l14e 0 2024-09-21T00:56:46.419 INFO:tasks.workunit.client.1.smithi187.stdout:7/835: creat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/f11b x:0 0 0 2024-09-21T00:56:46.420 INFO:tasks.workunit.client.0.smithi112.stdout:6/291: truncate d9/df/d56/f5c 1806393 0 2024-09-21T00:56:46.421 INFO:tasks.workunit.client.1.smithi187.stdout:5/802: write d0/dc/daa/d67/d14/d38/d5a/f8d [4862383,38350] 0 2024-09-21T00:56:46.424 INFO:tasks.workunit.client.0.smithi112.stdout:7/340: getdents d0/d2/d36/d39/d1a/d23 0 2024-09-21T00:56:46.428 INFO:tasks.workunit.client.1.smithi187.stdout:1/983: getdents d4/d6/d23/d2e/d94/d119 0 2024-09-21T00:56:46.430 INFO:tasks.workunit.client.1.smithi187.stdout:0/854: rename d0/d17/d18/cf4 to d0/d17/d18/d90/c124 0 2024-09-21T00:56:46.432 INFO:tasks.workunit.client.1.smithi187.stdout:7/836: rmdir d1/dce/dd0/d97/df1/d31/d33 39 2024-09-21T00:56:46.432 INFO:tasks.workunit.client.1.smithi187.stdout:8/956: chown dc/d2f/d80/db8/dba/d29/f4c 11 1 2024-09-21T00:56:46.432 INFO:tasks.workunit.client.1.smithi187.stdout:8/957: stat dc/fb0 0 2024-09-21T00:56:46.433 INFO:tasks.workunit.client.1.smithi187.stdout:0/855: read d0/d17/d18/d3a/d97/d112/d23/df/fe3 [1571822,97742] 0 2024-09-21T00:56:46.434 INFO:tasks.workunit.client.1.smithi187.stdout:5/803: dread d0/dc/d1f/d26/d8b/fdb [0,4194304] 0 2024-09-21T00:56:46.435 INFO:tasks.workunit.client.1.smithi187.stdout:5/804: chown d0/dc/d1f/d26/f64 444024939 1 2024-09-21T00:56:46.435 INFO:tasks.workunit.client.1.smithi187.stdout:2/936: rename d2/da8/d6c/d97/db0/f113 to d2/dc/d2e/d51/dc5/f146 0 2024-09-21T00:56:46.436 INFO:tasks.workunit.client.1.smithi187.stdout:5/805: stat d0/dc/daa/d67/d14/d1b/ca3 0 2024-09-21T00:56:46.437 INFO:tasks.workunit.client.1.smithi187.stdout:3/841: link d9/d7f/dcb/c36 d9/d7f/dcb/d87/d94/d53/d56/d61/c114 0 2024-09-21T00:56:46.440 INFO:tasks.workunit.client.1.smithi187.stdout:4/913: rename d2/d3/da/d2f/d32/d24/dcd/db3/f105 to d2/d3/d74/d98/dc2/def/f114 0 2024-09-21T00:56:46.440 INFO:tasks.workunit.client.1.smithi187.stdout:6/908: write d7/d59/d11d/f60 [4492575,104100] 0 2024-09-21T00:56:46.442 INFO:tasks.workunit.client.1.smithi187.stdout:7/837: mknod d1/dc/d15/c11c 0 2024-09-21T00:56:46.447 INFO:tasks.workunit.client.1.smithi187.stdout:6/909: fsync d7/d59/f1d 0 2024-09-21T00:56:46.449 INFO:tasks.workunit.client.1.smithi187.stdout:2/937: mkdir d2/dc/d2e/d147 0 2024-09-21T00:56:46.453 INFO:tasks.workunit.client.1.smithi187.stdout:3/842: mknod d9/d19/c115 0 2024-09-21T00:56:46.453 INFO:tasks.workunit.client.1.smithi187.stdout:1/984: write d4/f7 [6890726,48924] 0 2024-09-21T00:56:46.454 INFO:tasks.workunit.client.1.smithi187.stdout:1/985: write d4/d6/f48 [984819,129405] 0 2024-09-21T00:56:46.455 INFO:tasks.workunit.client.1.smithi187.stdout:6/910: rename d7/d59/c1f to d7/d59/d11d/d40/d50/d83/d114/c12b 0 2024-09-21T00:56:46.456 INFO:tasks.workunit.client.1.smithi187.stdout:3/843: write d9/d7f/dcb/d87/d94/d53/d75/de2/f110 [11185,128544] 0 2024-09-21T00:56:46.456 INFO:tasks.workunit.client.1.smithi187.stdout:5/806: creat d0/dc/daa/d67/d14/f10a x:0 0 0 2024-09-21T00:56:46.460 INFO:tasks.workunit.client.1.smithi187.stdout:2/938: rename d2/da8/d6c/d97/da1/fad to d2/da8/d6c/db8/d40/f148 0 2024-09-21T00:56:46.461 INFO:tasks.workunit.client.1.smithi187.stdout:4/914: dread d2/d3/da/d2f/d32/d22/d37/d3a/f8d [0,4194304] 0 2024-09-21T00:56:46.462 INFO:tasks.workunit.client.1.smithi187.stdout:3/844: chown d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/f84 424 1 2024-09-21T00:56:46.464 INFO:tasks.workunit.client.1.smithi187.stdout:5/807: symlink d0/dc/l10b 0 2024-09-21T00:56:46.465 INFO:tasks.workunit.client.1.smithi187.stdout:2/939: mkdir d2/dc/d2e/d149 0 2024-09-21T00:56:46.465 INFO:tasks.workunit.client.1.smithi187.stdout:0/856: dwrite d0/d17/d18/d3a/d114/f122 [4194304,4194304] 0 2024-09-21T00:56:46.466 INFO:tasks.workunit.client.1.smithi187.stdout:1/986: dread d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/f10a [0,4194304] 0 2024-09-21T00:56:46.468 INFO:tasks.workunit.client.1.smithi187.stdout:3/845: mknod d9/d19/d9b/c116 0 2024-09-21T00:56:46.470 INFO:tasks.workunit.client.1.smithi187.stdout:5/808: mkdir d0/dc/dc6/d10c 0 2024-09-21T00:56:46.472 INFO:tasks.workunit.client.1.smithi187.stdout:2/940: creat d2/da8/d6c/db8/d40/f14a x:0 0 0 2024-09-21T00:56:46.473 INFO:tasks.workunit.client.1.smithi187.stdout:4/915: rename d2/d3/d56/d84/d60/c64 to d2/d3/da/d48/db0/c115 0 2024-09-21T00:56:46.476 INFO:tasks.workunit.client.1.smithi187.stdout:7/838: dwrite d1/f1c [0,4194304] 0 2024-09-21T00:56:46.476 INFO:tasks.workunit.client.1.smithi187.stdout:2/941: write d2/d3/d13d/f140 [731434,58747] 0 2024-09-21T00:56:46.476 INFO:tasks.workunit.client.1.smithi187.stdout:5/809: fsync d0/dc/daa/d67/dcc/fdf 0 2024-09-21T00:56:46.478 INFO:tasks.workunit.client.1.smithi187.stdout:3/846: symlink d9/d7f/dcb/d87/d94/d53/d56/dc9/l117 0 2024-09-21T00:56:46.478 INFO:tasks.workunit.client.1.smithi187.stdout:6/911: dwrite d7/d59/f1d [0,4194304] 0 2024-09-21T00:56:46.479 INFO:tasks.workunit.client.1.smithi187.stdout:4/916: read - d2/d3/d56/d84/d60/d6c/d77/ffd zero size 2024-09-21T00:56:46.480 INFO:tasks.workunit.client.0.smithi112.stdout:7/341: dread - d0/d2/f68 zero size 2024-09-21T00:56:46.480 INFO:tasks.workunit.client.0.smithi112.stdout:6/292: creat d9/d1b/f71 x:0 0 0 2024-09-21T00:56:46.481 INFO:tasks.workunit.client.0.smithi112.stdout:3/482: unlink d2/d8/dd/de/d6b/l8d 0 2024-09-21T00:56:46.483 INFO:tasks.workunit.client.1.smithi187.stdout:5/810: write d0/dc/daa/d67/d14/d1b/d27/f4a [4650551,42585] 0 2024-09-21T00:56:46.483 INFO:tasks.workunit.client.0.smithi112.stdout:6/293: chown d9/df/d56/d33 43 1 2024-09-21T00:56:46.483 INFO:tasks.workunit.client.0.smithi112.stdout:1/262: link d5/d8/d13/c2f d5/d8/d10/c55 0 2024-09-21T00:56:46.484 INFO:tasks.workunit.client.0.smithi112.stdout:9/313: dread d5/d3b/d5f/f31 [0,4194304] 0 2024-09-21T00:56:46.485 INFO:tasks.workunit.client.0.smithi112.stdout:3/483: read d2/d38/d3f/f49 [175473,99467] 0 2024-09-21T00:56:46.485 INFO:tasks.workunit.client.0.smithi112.stdout:9/314: chown d5/d3b 137305 1 2024-09-21T00:56:46.486 INFO:tasks.workunit.client.1.smithi187.stdout:1/987: truncate d4/d6/d23/d2e/d94/d35/d22/d65/f102 428031 0 2024-09-21T00:56:46.489 INFO:tasks.workunit.client.1.smithi187.stdout:3/847: symlink d9/l118 0 2024-09-21T00:56:46.493 INFO:tasks.workunit.client.0.smithi112.stdout:7/342: dread d0/f3b [0,4194304] 0 2024-09-21T00:56:46.494 INFO:tasks.workunit.client.0.smithi112.stdout:1/263: symlink d5/d8/d10/d2e/l56 0 2024-09-21T00:56:46.498 INFO:tasks.workunit.client.0.smithi112.stdout:6/294: mknod d9/df/d19/c72 0 2024-09-21T00:56:46.498 INFO:tasks.workunit.client.1.smithi187.stdout:2/942: dread d2/da8/d6c/db8/d40/d75/de8/f10f [0,4194304] 0 2024-09-21T00:56:46.498 INFO:tasks.workunit.client.1.smithi187.stdout:0/857: link d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d46/f4f d0/d60/d11f/f125 0 2024-09-21T00:56:46.499 INFO:tasks.workunit.client.1.smithi187.stdout:2/943: write d2/dc/d2e/d4a/fc0 [1150635,59816] 0 2024-09-21T00:56:46.499 INFO:tasks.workunit.client.0.smithi112.stdout:9/315: rename d5/d6/d19/c42 to d5/d6/d19/c63 0 2024-09-21T00:56:46.500 INFO:tasks.workunit.client.1.smithi187.stdout:1/988: fsync d4/d6/d23/d6f/f96 0 2024-09-21T00:56:46.501 INFO:tasks.workunit.client.0.smithi112.stdout:7/343: write d0/d2/d32/f54 [727510,41031] 0 2024-09-21T00:56:46.502 INFO:tasks.workunit.client.0.smithi112.stdout:7/344: fdatasync d0/f67 0 2024-09-21T00:56:46.503 INFO:tasks.workunit.client.0.smithi112.stdout:1/264: rename d5/d8/d10/f20 to d5/d8/d13/d3e/d46/f57 0 2024-09-21T00:56:46.504 INFO:tasks.workunit.client.0.smithi112.stdout:1/265: stat d5/d8/d13/d3e/c41 0 2024-09-21T00:56:46.505 INFO:tasks.workunit.client.0.smithi112.stdout:1/266: fsync d5/d8/dd/f4e 0 2024-09-21T00:56:46.507 INFO:tasks.workunit.client.1.smithi187.stdout:5/811: symlink d0/dc/dc6/d10c/l10d 0 2024-09-21T00:56:46.508 INFO:tasks.workunit.client.0.smithi112.stdout:9/316: symlink d5/d3b/d5f/d13/l64 0 2024-09-21T00:56:46.509 INFO:tasks.workunit.client.0.smithi112.stdout:9/317: write d5/d6/d19/f1d [1462934,77836] 0 2024-09-21T00:56:46.511 INFO:tasks.workunit.client.1.smithi187.stdout:6/912: write d7/d59/d11d/d40/d6a/d9e/fad [827940,65691] 0 2024-09-21T00:56:46.513 INFO:tasks.workunit.client.0.smithi112.stdout:6/295: symlink d9/d1f/l73 0 2024-09-21T00:56:46.514 INFO:tasks.workunit.client.1.smithi187.stdout:2/944: truncate d2/d3/d15/f87 3386743 0 2024-09-21T00:56:46.516 INFO:tasks.workunit.client.1.smithi187.stdout:1/989: dread d4/d6/d23/d2e/d53/d6a/faf [0,4194304] 0 2024-09-21T00:56:46.517 INFO:tasks.workunit.client.1.smithi187.stdout:3/848: creat d9/d7f/dcb/d87/d94/dd1/f119 x:0 0 0 2024-09-21T00:56:46.518 INFO:tasks.workunit.client.0.smithi112.stdout:7/345: rename d0/d2/d36/d39/d1a/l24 to d0/d2/d36/d39/d1a/d23/l6d 0 2024-09-21T00:56:46.518 INFO:tasks.workunit.client.1.smithi187.stdout:4/917: dwrite d2/d3/da/d2f/d32/d24/f53 [0,4194304] 0 2024-09-21T00:56:46.518 INFO:tasks.workunit.client.0.smithi112.stdout:7/346: dread - d0/f67 zero size 2024-09-21T00:56:46.519 INFO:tasks.workunit.client.0.smithi112.stdout:7/347: read - d0/d2/f69 zero size 2024-09-21T00:56:46.519 INFO:tasks.workunit.client.1.smithi187.stdout:1/990: chown d4/d6/d23/d2e/d94/d35/d22/f46 71 1 2024-09-21T00:56:46.519 INFO:tasks.workunit.client.0.smithi112.stdout:6/296: rmdir d9/d13/d26 39 2024-09-21T00:56:46.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/267: truncate d5/d8/f35 456273 0 2024-09-21T00:56:46.521 INFO:tasks.workunit.client.0.smithi112.stdout:1/268: truncate d5/d8/f3d 621683 0 2024-09-21T00:56:46.522 INFO:tasks.workunit.client.1.smithi187.stdout:8/958: sync 2024-09-21T00:56:46.523 INFO:tasks.workunit.client.0.smithi112.stdout:3/484: getdents d2/d3e/d7b 0 2024-09-21T00:56:46.523 INFO:tasks.workunit.client.0.smithi112.stdout:3/485: fdatasync d2/d8/d28/d35/f59 0 2024-09-21T00:56:46.526 INFO:tasks.workunit.client.1.smithi187.stdout:0/858: truncate d0/d17/d18/d3a/d97/fd7 39869 0 2024-09-21T00:56:46.529 INFO:tasks.workunit.client.0.smithi112.stdout:6/297: mkdir d9/d1f/d47/d74 0 2024-09-21T00:56:46.529 INFO:tasks.workunit.client.0.smithi112.stdout:6/298: chown d9/df/l2c 8221 1 2024-09-21T00:56:46.530 INFO:tasks.workunit.client.1.smithi187.stdout:2/945: symlink d2/dc/d2e/de1/de3/l14b 0 2024-09-21T00:56:46.532 INFO:tasks.workunit.client.0.smithi112.stdout:3/486: creat d2/d8/dd/de/d4a/d4c/d7c/fb0 x:0 0 0 2024-09-21T00:56:46.532 INFO:tasks.workunit.client.1.smithi187.stdout:3/849: rmdir d9/d7f/dcb/d9c 39 2024-09-21T00:56:46.533 INFO:tasks.workunit.client.0.smithi112.stdout:3/487: dread d2/d8/dd/f27 [0,4194304] 0 2024-09-21T00:56:46.534 INFO:tasks.workunit.client.0.smithi112.stdout:9/318: link d5/d3b/d5f/d13/l64 d5/d6/l65 0 2024-09-21T00:56:46.534 INFO:tasks.workunit.client.0.smithi112.stdout:3/488: chown d2/d8/d28/f54 32237416 1 2024-09-21T00:56:46.535 INFO:tasks.workunit.client.1.smithi187.stdout:2/946: dwrite d2/dc/d2e/f82 [0,4194304] 0 2024-09-21T00:56:46.536 INFO:tasks.workunit.client.0.smithi112.stdout:3/489: fdatasync d2/d8/dd/de/d4a/d4c/fa0 0 2024-09-21T00:56:46.539 INFO:tasks.workunit.client.0.smithi112.stdout:7/348: write d0/fa [137217,111797] 0 2024-09-21T00:56:46.540 INFO:tasks.workunit.client.1.smithi187.stdout:7/839: link d1/dce/dd0/d97/df1/d31/d41/d8a/d100/f105 d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f11d 0 2024-09-21T00:56:46.547 INFO:tasks.workunit.client.0.smithi112.stdout:7/349: dwrite d0/d2/d36/d39/d1a/f44 [0,4194304] 0 2024-09-21T00:56:46.548 INFO:tasks.workunit.client.1.smithi187.stdout:7/840: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/da6/f118 [0,4194304] 0 2024-09-21T00:56:46.557 INFO:tasks.workunit.client.0.smithi112.stdout:6/299: dwrite d9/d1f/d47/d34/f36 [0,4194304] 0 2024-09-21T00:56:46.557 INFO:tasks.workunit.client.1.smithi187.stdout:6/913: write d7/d59/d11d/f3f [1713376,106582] 0 2024-09-21T00:56:46.558 INFO:tasks.workunit.client.0.smithi112.stdout:6/300: write d9/d13/f15 [4971536,2550] 0 2024-09-21T00:56:46.558 INFO:tasks.workunit.client.1.smithi187.stdout:6/914: chown d7/d59/d11d/d40/fb9 20908504 1 2024-09-21T00:56:46.559 INFO:tasks.workunit.client.1.smithi187.stdout:0/859: write d0/d17/d18/d3a/d97/d112/d23/d36/fd6 [986602,74575] 0 2024-09-21T00:56:46.562 INFO:tasks.workunit.client.1.smithi187.stdout:0/860: dread - d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d46/dd8/f11e zero size 2024-09-21T00:56:46.562 INFO:tasks.workunit.client.1.smithi187.stdout:5/812: creat d0/dc/daa/d67/d14/f10e x:0 0 0 2024-09-21T00:56:46.564 INFO:tasks.workunit.client.1.smithi187.stdout:5/813: write d0/dc/daa/d67/d14/d38/f5b [2354075,86897] 0 2024-09-21T00:56:46.568 INFO:tasks.workunit.client.0.smithi112.stdout:6/301: dwrite d9/d1f/d47/f42 [0,4194304] 0 2024-09-21T00:56:46.570 INFO:tasks.workunit.client.0.smithi112.stdout:3/490: symlink d2/d38/d3f/d53/d96/lb1 0 2024-09-21T00:56:46.571 INFO:tasks.workunit.client.0.smithi112.stdout:7/350: mkdir d0/d6e 0 2024-09-21T00:56:46.574 INFO:tasks.workunit.client.1.smithi187.stdout:8/959: link dc/d2f/d80/db8/c13f dc/d2f/d34/d137/c14f 0 2024-09-21T00:56:46.575 INFO:tasks.workunit.client.0.smithi112.stdout:6/302: creat d9/d1b/d23/f75 x:0 0 0 2024-09-21T00:56:46.575 INFO:tasks.workunit.client.0.smithi112.stdout:7/351: write d0/d2/d2e/f58 [256040,33793] 0 2024-09-21T00:56:46.575 INFO:tasks.workunit.client.0.smithi112.stdout:1/269: dwrite d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:46.577 INFO:tasks.workunit.client.0.smithi112.stdout:3/491: mknod d2/d8/d28/d35/d9e/cb2 0 2024-09-21T00:56:46.582 INFO:tasks.workunit.client.1.smithi187.stdout:3/850: truncate d9/f12 2645004 0 2024-09-21T00:56:46.582 INFO:tasks.workunit.client.0.smithi112.stdout:7/352: mknod d0/d2/d6c/c6f 0 2024-09-21T00:56:46.584 INFO:tasks.workunit.client.1.smithi187.stdout:3/851: read d9/d7f/dcb/fe9 [3516027,43936] 0 2024-09-21T00:56:46.585 INFO:tasks.workunit.client.0.smithi112.stdout:6/303: dwrite d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:46.585 INFO:tasks.workunit.client.1.smithi187.stdout:5/814: creat d0/dc/daa/d67/d14/d57/d5c/dc9/f10f x:0 0 0 2024-09-21T00:56:46.587 INFO:tasks.workunit.client.1.smithi187.stdout:5/815: write d0/dc/daa/d67/d14/d57/d5c/dc9/f10f [124937,34456] 0 2024-09-21T00:56:46.588 INFO:tasks.workunit.client.1.smithi187.stdout:6/915: rename d7/d59/d11d/d40/d45/l85 to d7/d59/d11d/d40/l12c 0 2024-09-21T00:56:46.589 INFO:tasks.workunit.client.0.smithi112.stdout:7/353: symlink d0/d2/d36/d39/d1a/d23/l70 0 2024-09-21T00:56:46.590 INFO:tasks.workunit.client.1.smithi187.stdout:3/852: dread - d9/d7f/dcb/d9c/fe7 zero size 2024-09-21T00:56:46.592 INFO:tasks.workunit.client.1.smithi187.stdout:4/918: write d2/d3/da/d2f/d4b/f6a [2009366,108186] 0 2024-09-21T00:56:46.595 INFO:tasks.workunit.client.1.smithi187.stdout:0/861: rename d0/dc2/lf6 to d0/d17/d18/d90/d98/ddd/l126 0 2024-09-21T00:56:46.595 INFO:tasks.workunit.client.0.smithi112.stdout:6/304: unlink d9/df/d56/f5c 0 2024-09-21T00:56:46.596 INFO:tasks.workunit.client.0.smithi112.stdout:6/305: readlink d9/l10 0 2024-09-21T00:56:46.597 INFO:tasks.workunit.client.1.smithi187.stdout:2/947: dwrite d2/d3/d15/dfe/f54 [4194304,4194304] 0 2024-09-21T00:56:46.598 INFO:tasks.workunit.client.0.smithi112.stdout:7/354: creat d0/d2/d36/d39/d56/d65/f71 x:0 0 0 2024-09-21T00:56:46.600 INFO:tasks.workunit.client.0.smithi112.stdout:6/306: rmdir d9/df/d56 39 2024-09-21T00:56:46.601 INFO:tasks.workunit.client.1.smithi187.stdout:3/853: mknod d9/d7f/dcb/dd0/c11a 0 2024-09-21T00:56:46.602 INFO:tasks.workunit.client.1.smithi187.stdout:4/919: dread - d2/d3/da/d2f/d32/d24/fb7 zero size 2024-09-21T00:56:46.603 INFO:tasks.workunit.client.0.smithi112.stdout:9/319: dwrite d5/d3b/d5f/d13/f47 [0,4194304] 0 2024-09-21T00:56:46.604 INFO:tasks.workunit.client.1.smithi187.stdout:8/960: rename dc/d2f/d54/c64 to dc/d2f/d34/d4b/d85/d10b/c150 0 2024-09-21T00:56:46.606 INFO:tasks.workunit.client.1.smithi187.stdout:6/916: dread d7/f84 [0,4194304] 0 2024-09-21T00:56:46.608 INFO:tasks.workunit.client.0.smithi112.stdout:7/355: dwrite d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:46.611 INFO:tasks.workunit.client.1.smithi187.stdout:0/862: mknod d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/c127 0 2024-09-21T00:56:46.612 INFO:tasks.workunit.client.1.smithi187.stdout:7/841: truncate d1/dce/dd0/fdc 3253074 0 2024-09-21T00:56:46.613 INFO:tasks.workunit.client.1.smithi187.stdout:0/863: stat d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/c127 0 2024-09-21T00:56:46.613 INFO:tasks.workunit.client.0.smithi112.stdout:9/320: readlink d5/d3b/d5f/d13/l64 0 2024-09-21T00:56:46.615 INFO:tasks.workunit.client.1.smithi187.stdout:2/948: creat d2/dc/d2e/d4a/d7c/d52/da3/de6/f14c x:0 0 0 2024-09-21T00:56:46.617 INFO:tasks.workunit.client.0.smithi112.stdout:3/492: truncate d2/d8/dd/de/f18 2614731 0 2024-09-21T00:56:46.619 INFO:tasks.workunit.client.1.smithi187.stdout:7/842: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/f7d [0,4194304] 0 2024-09-21T00:56:46.619 INFO:tasks.workunit.client.0.smithi112.stdout:7/356: symlink d0/d2/d36/l72 0 2024-09-21T00:56:46.621 INFO:tasks.workunit.client.1.smithi187.stdout:7/843: chown d1/dce/dd0/d97/df1/d31/d41/d64/d93/fa4 31008569 1 2024-09-21T00:56:46.621 INFO:tasks.workunit.client.1.smithi187.stdout:3/854: rename d9/d19/d1c to d9/dcc/d105/d11b 0 2024-09-21T00:56:46.622 INFO:tasks.workunit.client.0.smithi112.stdout:3/493: creat d2/d8/d28/fb3 x:0 0 0 2024-09-21T00:56:46.623 INFO:tasks.workunit.client.0.smithi112.stdout:6/307: getdents d9/d1f/d47/d34 0 2024-09-21T00:56:46.623 INFO:tasks.workunit.client.1.smithi187.stdout:8/961: dread - dc/d2f/d54/d69/de8/fef zero size 2024-09-21T00:56:46.623 INFO:tasks.workunit.client.0.smithi112.stdout:9/321: dwrite d5/d6/d19/d1b/f3c [0,4194304] 0 2024-09-21T00:56:46.624 INFO:tasks.workunit.client.1.smithi187.stdout:6/917: fsync d7/d2a/fba 0 2024-09-21T00:56:46.626 INFO:tasks.workunit.client.1.smithi187.stdout:0/864: mknod d0/dc2/c128 0 2024-09-21T00:56:46.627 INFO:tasks.workunit.client.0.smithi112.stdout:3/494: write d2/d38/f4b [820904,21344] 0 2024-09-21T00:56:46.628 INFO:tasks.workunit.client.1.smithi187.stdout:0/865: fsync d0/d17/d18/d3a/d97/d112/d23/f99 0 2024-09-21T00:56:46.632 INFO:tasks.workunit.client.0.smithi112.stdout:9/322: creat d5/d6/d19/d51/f66 x:0 0 0 2024-09-21T00:56:46.632 INFO:tasks.workunit.client.0.smithi112.stdout:7/357: dwrite d0/d2/d32/f61 [0,4194304] 0 2024-09-21T00:56:46.635 INFO:tasks.workunit.client.1.smithi187.stdout:4/920: rename d2/d3/da/d2f/d32/d26/f44 to d2/d3/d56/d84/d60/d6c/f116 0 2024-09-21T00:56:46.635 INFO:tasks.workunit.client.0.smithi112.stdout:7/358: readlink d0/d2/d36/l60 0 2024-09-21T00:56:46.635 INFO:tasks.workunit.client.0.smithi112.stdout:7/359: readlink d0/d2/l37 0 2024-09-21T00:56:46.639 INFO:tasks.workunit.client.0.smithi112.stdout:6/308: rename d9/df/f4e to d9/d1b/d23/f76 0 2024-09-21T00:56:46.640 INFO:tasks.workunit.client.1.smithi187.stdout:5/816: write d0/f3f [517527,25821] 0 2024-09-21T00:56:46.641 INFO:tasks.workunit.client.0.smithi112.stdout:3/495: dwrite d2/d8/dd/de/f8e [0,4194304] 0 2024-09-21T00:56:46.641 INFO:tasks.workunit.client.1.smithi187.stdout:5/817: fsync d0/dc/daa/d67/d30/fd2 0 2024-09-21T00:56:46.642 INFO:tasks.workunit.client.0.smithi112.stdout:3/496: write d2/f5e [1511641,27359] 0 2024-09-21T00:56:46.644 INFO:tasks.workunit.client.0.smithi112.stdout:9/323: dread d5/d3b/d5f/f3d [0,4194304] 0 2024-09-21T00:56:46.645 INFO:tasks.workunit.client.1.smithi187.stdout:8/962: truncate dc/f10 1458842 0 2024-09-21T00:56:46.648 INFO:tasks.workunit.client.0.smithi112.stdout:9/324: fdatasync d5/d6/d19/f1d 0 2024-09-21T00:56:46.651 INFO:tasks.workunit.client.0.smithi112.stdout:7/360: dwrite d0/d2/f69 [0,4194304] 0 2024-09-21T00:56:46.654 INFO:tasks.workunit.client.0.smithi112.stdout:6/309: dwrite d9/df/f2e [0,4194304] 0 2024-09-21T00:56:46.654 INFO:tasks.workunit.client.1.smithi187.stdout:0/866: creat d0/d17/d18/d3a/d114/d100/f129 x:0 0 0 2024-09-21T00:56:46.656 INFO:tasks.workunit.client.1.smithi187.stdout:0/867: chown d0/d17/d18/d3a/d97/d112/d65/dd0 2 1 2024-09-21T00:56:46.661 INFO:tasks.workunit.client.1.smithi187.stdout:4/921: mkdir d2/d3/d74/db1/da2/d117 0 2024-09-21T00:56:46.663 INFO:tasks.workunit.client.0.smithi112.stdout:7/361: creat d0/d2/d36/d39/f73 x:0 0 0 2024-09-21T00:56:46.665 INFO:tasks.workunit.client.0.smithi112.stdout:6/310: fdatasync d9/d13/d26/f52 0 2024-09-21T00:56:46.667 INFO:tasks.workunit.client.0.smithi112.stdout:3/497: mknod d2/d8/dd/cb4 0 2024-09-21T00:56:46.670 INFO:tasks.workunit.client.1.smithi187.stdout:4/922: dwrite d2/d3/da/d2f/d4b/d7e/dc8/d89/ffe [0,4194304] 0 2024-09-21T00:56:46.672 INFO:tasks.workunit.client.1.smithi187.stdout:2/949: dwrite d2/dc/d2e/d4a/d7c/d52/dac/fd9 [0,4194304] 0 2024-09-21T00:56:46.673 INFO:tasks.workunit.client.1.smithi187.stdout:6/918: symlink d7/d59/d11d/d40/l12d 0 2024-09-21T00:56:46.674 INFO:tasks.workunit.client.0.smithi112.stdout:6/311: rename d9/d1b to d9/d1f/d3e/d77 0 2024-09-21T00:56:46.676 INFO:tasks.workunit.client.1.smithi187.stdout:0/868: rename d0/d17/d18/d3a/d97/d112/d23/df/d41/l117 to d0/dcf/l12a 0 2024-09-21T00:56:46.677 INFO:tasks.workunit.client.0.smithi112.stdout:3/498: write d2/d8/f5b [259627,45572] 0 2024-09-21T00:56:46.678 INFO:tasks.workunit.client.0.smithi112.stdout:7/362: symlink d0/l74 0 2024-09-21T00:56:46.681 INFO:tasks.workunit.client.1.smithi187.stdout:3/855: creat d9/d7f/dcb/d87/d94/d53/d56/d7d/f11c x:0 0 0 2024-09-21T00:56:46.682 INFO:tasks.workunit.client.0.smithi112.stdout:6/312: creat d9/d13/d21/d4c/f78 x:0 0 0 2024-09-21T00:56:46.683 INFO:tasks.workunit.client.1.smithi187.stdout:5/818: creat d0/dc/daa/d67/d14/d38/d5a/d99/f110 x:0 0 0 2024-09-21T00:56:46.683 INFO:tasks.workunit.client.1.smithi187.stdout:0/869: dread d0/d5a/f85 [0,4194304] 0 2024-09-21T00:56:46.684 INFO:tasks.workunit.client.1.smithi187.stdout:8/963: dwrite dc/df2/f12c [0,4194304] 0 2024-09-21T00:56:46.687 INFO:tasks.workunit.client.1.smithi187.stdout:4/923: creat d2/d3/d56/f118 x:0 0 0 2024-09-21T00:56:46.688 INFO:tasks.workunit.client.1.smithi187.stdout:0/870: read d0/d17/d18/d3a/d97/d112/d23/d36/fd6 [310674,54418] 0 2024-09-21T00:56:46.689 INFO:tasks.workunit.client.0.smithi112.stdout:3/499: creat d2/d38/d3f/d53/d96/fb5 x:0 0 0 2024-09-21T00:56:46.690 INFO:tasks.workunit.client.0.smithi112.stdout:3/500: write d2/d3e/f71 [222735,103120] 0 2024-09-21T00:56:46.691 INFO:tasks.workunit.client.1.smithi187.stdout:0/871: chown d0/d17/d18/d3a/d97/d112/d65/dd0 118 1 2024-09-21T00:56:46.691 INFO:tasks.workunit.client.1.smithi187.stdout:6/919: chown d7/d59/d11d/d40/l12c 347027 1 2024-09-21T00:56:46.692 INFO:tasks.workunit.client.0.smithi112.stdout:3/501: fdatasync d2/d8/dd/de/d4a/d4c/fa0 0 2024-09-21T00:56:46.695 INFO:tasks.workunit.client.0.smithi112.stdout:7/363: getdents d0/d2/d36/d39/d1a 0 2024-09-21T00:56:46.695 INFO:tasks.workunit.client.1.smithi187.stdout:8/964: dwrite dc/d2f/d37/fbe [4194304,4194304] 0 2024-09-21T00:56:46.696 INFO:tasks.workunit.client.1.smithi187.stdout:3/856: truncate d9/d7f/dcb/d87/fb8 185027 0 2024-09-21T00:56:46.699 INFO:tasks.workunit.client.0.smithi112.stdout:7/364: mkdir d0/d2/d36/d39/d56/d65/d75 0 2024-09-21T00:56:46.701 INFO:tasks.workunit.client.1.smithi187.stdout:4/924: creat d2/d3/d56/f119 x:0 0 0 2024-09-21T00:56:46.703 INFO:tasks.workunit.client.1.smithi187.stdout:2/950: dread d2/da8/fc9 [0,4194304] 0 2024-09-21T00:56:46.703 INFO:tasks.workunit.client.0.smithi112.stdout:7/365: creat d0/d2/d38/d48/f76 x:0 0 0 2024-09-21T00:56:46.703 INFO:tasks.workunit.client.1.smithi187.stdout:5/819: mknod d0/dc/d1f/c111 0 2024-09-21T00:56:46.704 INFO:tasks.workunit.client.1.smithi187.stdout:1/991: sync 2024-09-21T00:56:46.705 INFO:tasks.workunit.client.0.smithi112.stdout:9/325: dread d5/d6/d19/f1d [0,4194304] 0 2024-09-21T00:56:46.705 INFO:tasks.workunit.client.1.smithi187.stdout:5/820: write d0/dc/daa/d67/d30/f60 [1752582,107677] 0 2024-09-21T00:56:46.707 INFO:tasks.workunit.client.0.smithi112.stdout:7/366: creat d0/d2/d36/d39/d56/f77 x:0 0 0 2024-09-21T00:56:46.709 INFO:tasks.workunit.client.0.smithi112.stdout:9/326: fsync d5/f20 0 2024-09-21T00:56:46.712 INFO:tasks.workunit.client.0.smithi112.stdout:7/367: dread d0/d2/d32/f5b [0,4194304] 0 2024-09-21T00:56:46.715 INFO:tasks.workunit.client.1.smithi187.stdout:2/951: write d2/da8/d6c/db8/f74 [8819569,99032] 0 2024-09-21T00:56:46.716 INFO:tasks.workunit.client.0.smithi112.stdout:7/368: dread d0/d2/d2e/f58 [0,4194304] 0 2024-09-21T00:56:46.723 INFO:tasks.workunit.client.1.smithi187.stdout:4/925: dread d2/d3/da/d2f/d32/d22/f23 [0,4194304] 0 2024-09-21T00:56:46.723 INFO:tasks.workunit.client.0.smithi112.stdout:7/369: dwrite d0/d2/d38/d48/f76 [0,4194304] 0 2024-09-21T00:56:46.724 INFO:tasks.workunit.client.1.smithi187.stdout:4/926: truncate d2/d3/d56/f118 596624 0 2024-09-21T00:56:46.730 INFO:tasks.workunit.client.1.smithi187.stdout:7/844: sync 2024-09-21T00:56:46.730 INFO:tasks.workunit.client.0.smithi112.stdout:9/327: dread d5/d3b/d5f/f2c [0,4194304] 0 2024-09-21T00:56:46.732 INFO:tasks.workunit.client.1.smithi187.stdout:8/965: symlink dc/d2f/d80/db8/dba/l151 0 2024-09-21T00:56:46.732 INFO:tasks.workunit.client.0.smithi112.stdout:7/370: dwrite d0/d2/f64 [0,4194304] 0 2024-09-21T00:56:46.733 INFO:tasks.workunit.client.0.smithi112.stdout:3/502: write d2/d8/dd/f27 [610609,34844] 0 2024-09-21T00:56:46.734 INFO:tasks.workunit.client.0.smithi112.stdout:7/371: fsync d0/d2/d38/d48/f53 0 2024-09-21T00:56:46.736 INFO:tasks.workunit.client.1.smithi187.stdout:4/927: creat d2/d3/da/d2f/d32/d24/dcd/db3/df9/f11a x:0 0 0 2024-09-21T00:56:46.737 INFO:tasks.workunit.client.1.smithi187.stdout:5/821: rmdir d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9 39 2024-09-21T00:56:46.742 INFO:tasks.workunit.client.0.smithi112.stdout:9/328: dread d5/d3b/d5f/f2c [0,4194304] 0 2024-09-21T00:56:46.743 INFO:tasks.workunit.client.0.smithi112.stdout:3/503: dwrite d2/f5e [0,4194304] 0 2024-09-21T00:56:46.747 INFO:tasks.workunit.client.0.smithi112.stdout:7/372: dwrite d0/d2/f69 [0,4194304] 0 2024-09-21T00:56:46.748 INFO:tasks.workunit.client.1.smithi187.stdout:7/845: creat d1/dce/dd0/d97/df1/d31/d41/dbe/f11e x:0 0 0 2024-09-21T00:56:46.751 INFO:tasks.workunit.client.1.smithi187.stdout:0/872: write d0/d17/d18/d3a/d97/d112/d23/d36/f38 [361099,92873] 0 2024-09-21T00:56:46.754 INFO:tasks.workunit.client.0.smithi112.stdout:9/329: rename d5/l39 to d5/d6/l67 0 2024-09-21T00:56:46.755 INFO:tasks.workunit.client.0.smithi112.stdout:3/504: fsync d2/d8/d28/d9d/f9f 0 2024-09-21T00:56:46.757 INFO:tasks.workunit.client.1.smithi187.stdout:4/928: creat d2/d3/da/d2f/d4b/daf/f11b x:0 0 0 2024-09-21T00:56:46.758 INFO:tasks.workunit.client.0.smithi112.stdout:7/373: mknod d0/d2/d32/c78 0 2024-09-21T00:56:46.759 INFO:tasks.workunit.client.0.smithi112.stdout:7/374: readlink d0/d2/d32/l63 0 2024-09-21T00:56:46.760 INFO:tasks.workunit.client.1.smithi187.stdout:3/857: dwrite f3 [0,4194304] 0 2024-09-21T00:56:46.760 INFO:tasks.workunit.client.1.smithi187.stdout:1/992: link d4/d6/d64/c9e d4/d6/d23/d2e/d94/d10e/c144 0 2024-09-21T00:56:46.762 INFO:tasks.workunit.client.0.smithi112.stdout:9/330: creat d5/d6/d19/d1b/d57/f68 x:0 0 0 2024-09-21T00:56:46.762 INFO:tasks.workunit.client.1.smithi187.stdout:3/858: fsync d9/d7f/dcb/d87/d94/d89/f93 0 2024-09-21T00:56:46.763 INFO:tasks.workunit.client.1.smithi187.stdout:3/859: chown d9/d19/d43/cc7 0 1 2024-09-21T00:56:46.763 INFO:tasks.workunit.client.1.smithi187.stdout:6/920: truncate d7/d2a/f5b 2176020 0 2024-09-21T00:56:46.765 INFO:tasks.workunit.client.0.smithi112.stdout:3/505: creat d2/d38/fb6 x:0 0 0 2024-09-21T00:56:46.770 INFO:tasks.workunit.client.0.smithi112.stdout:9/331: dwrite d5/d3b/d5f/d13/d56/f61 [0,4194304] 0 2024-09-21T00:56:46.772 INFO:tasks.workunit.client.0.smithi112.stdout:9/332: truncate d5/d3b/d5f/f58 331857 0 2024-09-21T00:56:46.773 INFO:tasks.workunit.client.0.smithi112.stdout:3/506: mkdir d2/d33/d8c/db7 0 2024-09-21T00:56:46.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/375: mkdir d0/d79 0 2024-09-21T00:56:46.780 INFO:tasks.workunit.client.1.smithi187.stdout:2/952: dwrite d2/dc/f67 [0,4194304] 0 2024-09-21T00:56:46.781 INFO:tasks.workunit.client.1.smithi187.stdout:4/929: creat d2/d3/da/d2f/d32/d22/d37/dcf/f11c x:0 0 0 2024-09-21T00:56:46.782 INFO:tasks.workunit.client.0.smithi112.stdout:9/333: symlink d5/d3b/d5f/d13/l69 0 2024-09-21T00:56:46.783 INFO:tasks.workunit.client.0.smithi112.stdout:9/334: stat d5/d3b/d5f/f2e 0 2024-09-21T00:56:46.785 INFO:tasks.workunit.client.0.smithi112.stdout:7/376: dread d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:46.785 INFO:tasks.workunit.client.0.smithi112.stdout:3/507: truncate d2/d8/dd/f10 699355 0 2024-09-21T00:56:46.785 INFO:tasks.workunit.client.0.smithi112.stdout:9/335: read d5/d6/d3f/f46 [81802,80779] 0 2024-09-21T00:56:46.788 INFO:tasks.workunit.client.0.smithi112.stdout:7/377: fdatasync d0/d2/d38/d48/f76 0 2024-09-21T00:56:46.789 INFO:tasks.workunit.client.1.smithi187.stdout:1/993: creat d4/d6/d23/d2e/d94/d35/d22/d65/db9/d115/f145 x:0 0 0 2024-09-21T00:56:46.790 INFO:tasks.workunit.client.1.smithi187.stdout:1/994: dread - d4/d6/d23/d2e/d94/d6c/f105 zero size 2024-09-21T00:56:46.791 INFO:tasks.workunit.client.1.smithi187.stdout:7/846: rmdir d1/dc/d104 39 2024-09-21T00:56:46.792 INFO:tasks.workunit.client.1.smithi187.stdout:1/995: chown d4/d6/d23/d2e/d94/d10b 8 1 2024-09-21T00:56:46.793 INFO:tasks.workunit.client.0.smithi112.stdout:7/378: dread d0/d2/d32/f5b [0,4194304] 0 2024-09-21T00:56:46.795 INFO:tasks.workunit.client.0.smithi112.stdout:7/379: write d0/d2/d32/f54 [1344688,119763] 0 2024-09-21T00:56:46.795 INFO:tasks.workunit.client.0.smithi112.stdout:9/336: rmdir d5/d3b 39 2024-09-21T00:56:46.799 INFO:tasks.workunit.client.1.smithi187.stdout:7/847: dwrite d1/dce/dd0/d97/df1/d31/d41/dbe/ff4 [0,4194304] 0 2024-09-21T00:56:46.800 INFO:tasks.workunit.client.1.smithi187.stdout:7/848: readlink d1/l38 0 2024-09-21T00:56:46.801 INFO:tasks.workunit.client.0.smithi112.stdout:9/337: dwrite d5/f16 [0,4194304] 0 2024-09-21T00:56:46.802 INFO:tasks.workunit.client.1.smithi187.stdout:5/822: creat d0/dc/daa/d67/d14/d57/d5c/f112 x:0 0 0 2024-09-21T00:56:46.805 INFO:tasks.workunit.client.1.smithi187.stdout:4/930: rename d2/d3/d74/de2/c110 to d2/d3/da/d2f/d32/d24/c11d 0 2024-09-21T00:56:46.805 INFO:tasks.workunit.client.1.smithi187.stdout:7/849: read d1/f2 [868994,91693] 0 2024-09-21T00:56:46.809 INFO:tasks.workunit.client.1.smithi187.stdout:3/860: mknod d9/d7f/dcb/d87/d94/c11d 0 2024-09-21T00:56:46.811 INFO:tasks.workunit.client.0.smithi112.stdout:9/338: mkdir d5/d6/d19/d1b/d57/d6a 0 2024-09-21T00:56:46.812 INFO:tasks.workunit.client.0.smithi112.stdout:9/339: chown d5/d6/d19/f1d 2087 1 2024-09-21T00:56:46.813 INFO:tasks.workunit.client.0.smithi112.stdout:9/340: read d5/d6/d3f/f4c [52570,94351] 0 2024-09-21T00:56:46.815 INFO:tasks.workunit.client.1.smithi187.stdout:8/966: truncate dc/d2f/d80/db8/dba/d29/f4c 2430232 0 2024-09-21T00:56:46.815 INFO:tasks.workunit.client.1.smithi187.stdout:8/967: chown dc/d2f/d34/c58 9 1 2024-09-21T00:56:46.816 INFO:tasks.workunit.client.0.smithi112.stdout:7/380: creat d0/d2/f7a x:0 0 0 2024-09-21T00:56:46.817 INFO:tasks.workunit.client.1.smithi187.stdout:8/968: write dc/d44/dc1/fe6 [2259693,37709] 0 2024-09-21T00:56:46.818 INFO:tasks.workunit.client.0.smithi112.stdout:7/381: fsync d0/f22 0 2024-09-21T00:56:46.818 INFO:tasks.workunit.client.1.smithi187.stdout:0/873: write d0/d17/d18/d90/dd1/fe9 [2593793,24643] 0 2024-09-21T00:56:46.819 INFO:tasks.workunit.client.0.smithi112.stdout:7/382: read - d0/d2/d2e/f5f zero size 2024-09-21T00:56:46.821 INFO:tasks.workunit.client.0.smithi112.stdout:9/341: dwrite d5/d6/d19/d1b/f3c [0,4194304] 0 2024-09-21T00:56:46.822 INFO:tasks.workunit.client.0.smithi112.stdout:9/342: fdatasync d5/d6/d19/f1d 0 2024-09-21T00:56:46.823 INFO:tasks.workunit.client.1.smithi187.stdout:4/931: mkdir d2/d3/da/d2f/d32/d22/d37/d3a/d11e 0 2024-09-21T00:56:46.824 INFO:tasks.workunit.client.1.smithi187.stdout:4/932: chown d2/d3/d74/d98/dc2 190616 1 2024-09-21T00:56:46.826 INFO:tasks.workunit.client.1.smithi187.stdout:3/861: dread - d9/d19/da7/fc2 zero size 2024-09-21T00:56:46.828 INFO:tasks.workunit.client.1.smithi187.stdout:6/921: dread d7/d59/d11d/fc2 [0,4194304] 0 2024-09-21T00:56:46.830 INFO:tasks.workunit.client.0.smithi112.stdout:7/383: dwrite d0/f3b [0,4194304] 0 2024-09-21T00:56:46.831 INFO:tasks.workunit.client.0.smithi112.stdout:7/384: chown d0/d2/d36/d39/d1a/d23/l41 33227037 1 2024-09-21T00:56:46.832 INFO:tasks.workunit.client.0.smithi112.stdout:7/385: chown d0/d2/d36/d39/d1a/c5a 492881354 1 2024-09-21T00:56:46.832 INFO:tasks.workunit.client.1.smithi187.stdout:5/823: rename d0/dc/cc1 to d0/dc/daa/d67/d14/d57/d5c/db2/c113 0 2024-09-21T00:56:46.833 INFO:tasks.workunit.client.0.smithi112.stdout:7/386: chown d0/d2/d38/d48 257735425 1 2024-09-21T00:56:46.834 INFO:tasks.workunit.client.1.smithi187.stdout:8/969: truncate dc/d2f/d80/db8/dba/d3e/fc2 285313 0 2024-09-21T00:56:46.834 INFO:tasks.workunit.client.0.smithi112.stdout:7/387: write d0/d2/d38/d48/f76 [224431,116683] 0 2024-09-21T00:56:46.835 INFO:tasks.workunit.client.1.smithi187.stdout:5/824: truncate d0/dc/daa/d67/d14/d38/d5a/f100 762582 0 2024-09-21T00:56:46.837 INFO:tasks.workunit.client.1.smithi187.stdout:7/850: mkdir d1/dce/dd0/d97/df1/d31/d33/d3b/d11f 0 2024-09-21T00:56:46.838 INFO:tasks.workunit.client.0.smithi112.stdout:3/508: truncate d2/f5e 452049 0 2024-09-21T00:56:46.838 INFO:tasks.workunit.client.1.smithi187.stdout:7/851: chown d1/f37 0 1 2024-09-21T00:56:46.839 INFO:tasks.workunit.client.1.smithi187.stdout:7/852: read - d1/d55/d80/f101 zero size 2024-09-21T00:56:46.839 INFO:tasks.workunit.client.1.smithi187.stdout:4/933: mknod d2/d3/da/d2f/d4b/d7e/dc8/d89/c11f 0 2024-09-21T00:56:46.840 INFO:tasks.workunit.client.1.smithi187.stdout:3/862: fsync d9/dcc/d105/d11b/f31 0 2024-09-21T00:56:46.841 INFO:tasks.workunit.client.0.smithi112.stdout:7/388: mknod d0/d79/c7b 0 2024-09-21T00:56:46.846 INFO:tasks.workunit.client.1.smithi187.stdout:1/996: dwrite d4/d6/d23/d2e/d94/d35/d79/dce/fd1 [0,4194304] 0 2024-09-21T00:56:46.848 INFO:tasks.workunit.client.1.smithi187.stdout:5/825: unlink d0/dc/daa/d67/d14/d1b/d27/d3a/cab 0 2024-09-21T00:56:46.848 INFO:tasks.workunit.client.1.smithi187.stdout:2/953: write d2/f7 [226008,50559] 0 2024-09-21T00:56:46.849 INFO:tasks.workunit.client.0.smithi112.stdout:3/509: creat d2/d8/fb8 x:0 0 0 2024-09-21T00:56:46.850 INFO:tasks.workunit.client.0.smithi112.stdout:3/510: truncate d2/d38/f91 191745 0 2024-09-21T00:56:46.850 INFO:tasks.workunit.client.0.smithi112.stdout:3/511: stat f1 0 2024-09-21T00:56:46.854 INFO:tasks.workunit.client.0.smithi112.stdout:3/512: fsync d2/d8/dd/de/f1c 0 2024-09-21T00:56:46.856 INFO:tasks.workunit.client.1.smithi187.stdout:0/874: creat d0/d17/d18/d3a/d97/d112/d23/df/f12b x:0 0 0 2024-09-21T00:56:46.858 INFO:tasks.workunit.client.0.smithi112.stdout:3/513: fdatasync d2/d8/f5b 0 2024-09-21T00:56:46.858 INFO:tasks.workunit.client.0.smithi112.stdout:9/343: truncate d5/d6/d19/f2a 1713666 0 2024-09-21T00:56:46.861 INFO:tasks.workunit.client.1.smithi187.stdout:2/954: creat d2/da8/d6c/db8/d40/f14d x:0 0 0 2024-09-21T00:56:46.867 INFO:tasks.workunit.client.1.smithi187.stdout:6/922: write d7/f9f [3616467,10224] 0 2024-09-21T00:56:46.868 INFO:tasks.workunit.client.0.smithi112.stdout:9/344: creat d5/d6/d19/d1b/d57/d6a/f6b x:0 0 0 2024-09-21T00:56:46.869 INFO:tasks.workunit.client.1.smithi187.stdout:7/853: write d1/f68 [1599315,26436] 0 2024-09-21T00:56:46.871 INFO:tasks.workunit.client.1.smithi187.stdout:7/854: dread - d1/dce/dd0/d97/df1/d31/d33/d3b/d62/ffb zero size 2024-09-21T00:56:46.872 INFO:tasks.workunit.client.1.smithi187.stdout:0/875: symlink d0/d17/d18/d3a/d97/dcc/l12c 0 2024-09-21T00:56:46.873 INFO:tasks.workunit.client.1.smithi187.stdout:4/934: write d2/d3/da/d2f/d32/d24/fdf [984349,55855] 0 2024-09-21T00:56:46.878 INFO:tasks.workunit.client.1.smithi187.stdout:8/970: getdents dc/d2f/d54/d69 0 2024-09-21T00:56:46.878 INFO:tasks.workunit.client.1.smithi187.stdout:3/863: dwrite d9/d7f/dcb/f54 [0,4194304] 0 2024-09-21T00:56:46.880 INFO:tasks.workunit.client.1.smithi187.stdout:1/997: creat d4/d6/d23/d2e/d53/f146 x:0 0 0 2024-09-21T00:56:46.881 INFO:tasks.workunit.client.1.smithi187.stdout:5/826: write d0/dc/daa/d67/d30/d6b/f9b [4628742,6868] 0 2024-09-21T00:56:46.882 INFO:tasks.workunit.client.1.smithi187.stdout:4/935: mknod d2/d3/d56/c120 0 2024-09-21T00:56:46.884 INFO:tasks.workunit.client.1.smithi187.stdout:2/955: truncate d2/fb 3439556 0 2024-09-21T00:56:46.885 INFO:tasks.workunit.client.0.smithi112.stdout:9/345: write d5/f14 [9267487,101957] 0 2024-09-21T00:56:46.885 INFO:tasks.workunit.client.1.smithi187.stdout:2/956: chown d2/da8/d6c/db8/d40/c70 925 1 2024-09-21T00:56:46.886 INFO:tasks.workunit.client.1.smithi187.stdout:6/923: write d7/d59/feb [2924598,56242] 0 2024-09-21T00:56:46.888 INFO:tasks.workunit.client.0.smithi112.stdout:3/514: dwrite d2/d8/dd/f10 [0,4194304] 0 2024-09-21T00:56:46.890 INFO:tasks.workunit.client.1.smithi187.stdout:0/876: symlink d0/d17/d18/d90/dd1/l12d 0 2024-09-21T00:56:46.891 INFO:tasks.workunit.client.1.smithi187.stdout:0/877: write d0/d17/d18/d90/d98/fcd [3061394,41242] 0 2024-09-21T00:56:46.892 INFO:tasks.workunit.client.0.smithi112.stdout:3/515: truncate d2/d8/dd/de/d4a/d4c/d7c/fb0 685782 0 2024-09-21T00:56:46.892 INFO:tasks.workunit.client.1.smithi187.stdout:5/827: mknod d0/dc/daa/d67/dcc/c114 0 2024-09-21T00:56:46.897 INFO:tasks.workunit.client.1.smithi187.stdout:4/936: rename d2/d3/da/dc4/ff6 to d2/d3/da/d2f/d4b/d7e/dc8/d97/f121 0 2024-09-21T00:56:46.898 INFO:tasks.workunit.client.1.smithi187.stdout:4/937: dread - d2/d3/da/d48/f104 zero size 2024-09-21T00:56:46.900 INFO:tasks.workunit.client.0.smithi112.stdout:9/346: dwrite d5/d3b/d5f/f58 [0,4194304] 0 2024-09-21T00:56:46.900 INFO:tasks.workunit.client.1.smithi187.stdout:3/864: truncate f2 1172248 0 2024-09-21T00:56:46.900 INFO:tasks.workunit.client.1.smithi187.stdout:3/865: chown d9/d7f/dcb/d9c/fe7 60 1 2024-09-21T00:56:46.902 INFO:tasks.workunit.client.1.smithi187.stdout:7/855: getdents d1/dce/dd0/d97/df1/d31/d41/dd1 0 2024-09-21T00:56:46.903 INFO:tasks.workunit.client.1.smithi187.stdout:8/971: write dc/d2f/d54/d69/db3/fe7 [586177,19816] 0 2024-09-21T00:56:46.905 INFO:tasks.workunit.client.1.smithi187.stdout:6/924: unlink d7/d59/f7f 0 2024-09-21T00:56:46.907 INFO:tasks.workunit.client.0.smithi112.stdout:3/516: getdents d2/d8/dd/de 0 2024-09-21T00:56:46.910 INFO:tasks.workunit.client.1.smithi187.stdout:4/938: creat d2/d3/da/d2f/d32/d26/d66/f122 x:0 0 0 2024-09-21T00:56:46.910 INFO:tasks.workunit.client.1.smithi187.stdout:8/972: dread dc/d2f/d80/db8/dba/d29/d105/f14b [0,4194304] 0 2024-09-21T00:56:46.911 INFO:tasks.workunit.client.0.smithi112.stdout:3/517: truncate d2/d8/d28/f54 897944 0 2024-09-21T00:56:46.912 INFO:tasks.workunit.client.1.smithi187.stdout:4/939: write d2/d3/d74/d98/f100 [926430,129884] 0 2024-09-21T00:56:46.913 INFO:tasks.workunit.client.1.smithi187.stdout:0/878: dread - d0/d17/d18/d3a/d97/d112/d23/df/d51/fec zero size 2024-09-21T00:56:46.915 INFO:tasks.workunit.client.0.smithi112.stdout:3/518: creat d2/d3e/fb9 x:0 0 0 2024-09-21T00:56:46.915 INFO:tasks.workunit.client.1.smithi187.stdout:6/925: dwrite d7/d59/d11d/d40/d50/d83/fcd [0,4194304] 0 2024-09-21T00:56:46.916 INFO:tasks.workunit.client.1.smithi187.stdout:1/998: write d4/d6/d23/d2e/d94/d35/d22/d65/db9/ded/fa8 [995780,4447] 0 2024-09-21T00:56:46.916 INFO:tasks.workunit.client.0.smithi112.stdout:3/519: fsync d2/d8/dd/de/d5c/f9a 0 2024-09-21T00:56:46.918 INFO:tasks.workunit.client.0.smithi112.stdout:9/347: rename d5/d6/d19/d1b/f4d to d5/d6/f6c 0 2024-09-21T00:56:46.920 INFO:tasks.workunit.client.0.smithi112.stdout:9/348: write d5/d6/d19/d1b/f32 [966671,53568] 0 2024-09-21T00:56:47.014 INFO:tasks.workunit.client.0.smithi112.stdout:3/520: rename d2/d33/f9b to d2/d8/d28/d35/d9e/fba 0 2024-09-21T00:56:47.015 INFO:tasks.workunit.client.1.smithi187.stdout:3/866: creat d9/d7f/dcb/d87/d94/f11e x:0 0 0 2024-09-21T00:56:47.016 INFO:tasks.workunit.client.1.smithi187.stdout:8/973: fdatasync dc/f10 0 2024-09-21T00:56:47.018 INFO:tasks.workunit.client.0.smithi112.stdout:3/521: fdatasync d2/d8/dd/de/f18 0 2024-09-21T00:56:47.020 INFO:tasks.workunit.client.0.smithi112.stdout:9/349: mknod d5/c6d 0 2024-09-21T00:56:47.023 INFO:tasks.workunit.client.1.smithi187.stdout:2/957: dwrite d2/da8/d6c/fe0 [0,4194304] 0 2024-09-21T00:56:47.024 INFO:tasks.workunit.client.0.smithi112.stdout:3/522: mknod d2/d38/cbb 0 2024-09-21T00:56:47.025 INFO:tasks.workunit.client.0.smithi112.stdout:3/523: write d2/d3e/f47 [923519,30850] 0 2024-09-21T00:56:47.026 INFO:tasks.workunit.client.0.smithi112.stdout:9/350: mkdir d5/d3b/d5f/d13/d6e 0 2024-09-21T00:56:47.028 INFO:tasks.workunit.client.1.smithi187.stdout:3/867: mknod d9/d7f/dcb/d20/c11f 0 2024-09-21T00:56:47.029 INFO:tasks.workunit.client.1.smithi187.stdout:5/828: dwrite d0/dc/daa/d67/d30/d68/f92 [0,4194304] 0 2024-09-21T00:56:47.032 INFO:tasks.workunit.client.0.smithi112.stdout:9/351: link d5/f17 d5/d6/d19/d1b/d57/f6f 0 2024-09-21T00:56:47.033 INFO:tasks.workunit.client.1.smithi187.stdout:8/974: dwrite dc/d2f/d54/d69/db3/f141 [0,4194304] 0 2024-09-21T00:56:47.033 INFO:tasks.workunit.client.1.smithi187.stdout:7/856: dwrite d1/f37 [0,4194304] 0 2024-09-21T00:56:47.033 INFO:tasks.workunit.client.0.smithi112.stdout:9/352: chown d5/d6/d19/d1b/f3c 439702 1 2024-09-21T00:56:47.034 INFO:tasks.workunit.client.1.smithi187.stdout:6/926: write d7/d59/d11d/d40/d6a/dbc/fc1 [559731,24175] 0 2024-09-21T00:56:47.036 INFO:tasks.workunit.client.0.smithi112.stdout:9/353: mkdir d5/d6/d70 0 2024-09-21T00:56:47.039 INFO:tasks.workunit.client.1.smithi187.stdout:4/940: mkdir d2/d3/d56/d84/d60/d6c/d123 0 2024-09-21T00:56:47.039 INFO:tasks.workunit.client.1.smithi187.stdout:2/958: mkdir d2/da8/d6c/db8/d40/d75/d14e 0 2024-09-21T00:56:47.039 INFO:tasks.workunit.client.1.smithi187.stdout:4/941: chown d2/d3/da/d2f/d4b/d7e/dc8/d97/f121 0 1 2024-09-21T00:56:47.041 INFO:tasks.workunit.client.1.smithi187.stdout:0/879: rename d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d46/dd8 to d0/d12e 0 2024-09-21T00:56:47.042 INFO:tasks.workunit.client.0.smithi112.stdout:9/354: mknod d5/c71 0 2024-09-21T00:56:47.042 INFO:tasks.workunit.client.0.smithi112.stdout:9/355: readlink d5/d6/l65 0 2024-09-21T00:56:47.042 INFO:tasks.workunit.client.1.smithi187.stdout:5/829: rmdir d0/dc/daa/d67/d14/d38/d5a 39 2024-09-21T00:56:47.043 INFO:tasks.workunit.client.1.smithi187.stdout:6/927: rmdir d7/d59/d11d/de4/d11c 39 2024-09-21T00:56:47.043 INFO:tasks.workunit.client.0.smithi112.stdout:9/356: write d5/d6/d19/d1b/d57/f60 [1024466,35017] 0 2024-09-21T00:56:47.044 INFO:tasks.workunit.client.1.smithi187.stdout:1/999: getdents d4/d6/d64 0 2024-09-21T00:56:47.045 INFO:tasks.workunit.client.1.smithi187.stdout:5/830: readlink d0/dc/daa/d67/d14/lce 0 2024-09-21T00:56:47.046 INFO:tasks.workunit.client.1.smithi187.stdout:0/880: chown d0/d17/d18/d3a/d97/d112/d23/d36/fa3 757340529 1 2024-09-21T00:56:47.046 INFO:tasks.workunit.client.1.smithi187.stdout:7/857: read d1/dce/dd0/d97/df1/fb4 [264082,29859] 0 2024-09-21T00:56:47.048 INFO:tasks.workunit.client.1.smithi187.stdout:2/959: creat d2/dc/d2e/d4a/d7c/d13c/f14f x:0 0 0 2024-09-21T00:56:47.048 INFO:tasks.workunit.client.1.smithi187.stdout:8/975: creat dc/d94/f152 x:0 0 0 2024-09-21T00:56:47.049 INFO:tasks.workunit.client.1.smithi187.stdout:7/858: dread - d1/d55/dd7/fee zero size 2024-09-21T00:56:47.049 INFO:tasks.workunit.client.1.smithi187.stdout:8/976: stat dc/d94/df6 0 2024-09-21T00:56:47.051 INFO:tasks.workunit.client.1.smithi187.stdout:6/928: write d7/d2a/faa [370464,38145] 0 2024-09-21T00:56:47.053 INFO:tasks.workunit.client.1.smithi187.stdout:2/960: rename d2/dc/c7e to d2/d3/d15/c150 0 2024-09-21T00:56:47.054 INFO:tasks.workunit.client.1.smithi187.stdout:0/881: creat d0/d17/f12f x:0 0 0 2024-09-21T00:56:47.056 INFO:tasks.workunit.client.1.smithi187.stdout:7/859: write d1/dce/dd0/d97/df1/d31/d33/d3b/d62/ffb [229369,77189] 0 2024-09-21T00:56:47.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:46 smithi112 ceph-mon[28078]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 95 MiB/s rd, 287 MiB/s wr, 561 op/s 2024-09-21T00:56:47.057 INFO:tasks.workunit.client.1.smithi187.stdout:0/882: rmdir d0/dcf 39 2024-09-21T00:56:47.058 INFO:tasks.workunit.client.1.smithi187.stdout:7/860: read d1/f37 [3474573,129962] 0 2024-09-21T00:56:47.059 INFO:tasks.workunit.client.1.smithi187.stdout:6/929: dread d7/d2a/da2/fb6 [0,4194304] 0 2024-09-21T00:56:47.059 INFO:tasks.workunit.client.1.smithi187.stdout:5/831: dwrite d0/dc/daa/d67/d14/d38/d5a/d6c/fe4 [0,4194304] 0 2024-09-21T00:56:47.063 INFO:tasks.workunit.client.1.smithi187.stdout:8/977: rename dc/d2f/d34/d137/c14f to dc/d2f/d80/db8/dba/d29/d105/c153 0 2024-09-21T00:56:47.064 INFO:tasks.workunit.client.1.smithi187.stdout:7/861: chown d1/d55/cc4 324210 1 2024-09-21T00:56:47.065 INFO:tasks.workunit.client.1.smithi187.stdout:5/832: dread - d0/dc/daa/d67/fc4 zero size 2024-09-21T00:56:47.067 INFO:tasks.workunit.client.1.smithi187.stdout:8/978: read dc/f92 [1056043,81221] 0 2024-09-21T00:56:47.071 INFO:tasks.workunit.client.1.smithi187.stdout:7/862: unlink d1/dce/dd0/d97/df1/f6b 0 2024-09-21T00:56:47.073 INFO:tasks.workunit.client.1.smithi187.stdout:0/883: link d0/d17/d18/d3a/d97/d112/ldc d0/d5a/l130 0 2024-09-21T00:56:47.073 INFO:tasks.workunit.client.1.smithi187.stdout:3/868: write d9/d7f/dcb/f48 [44438,36667] 0 2024-09-21T00:56:47.075 INFO:tasks.workunit.client.0.smithi112.stdout:9/357: dread d5/d6/d19/d1b/f40 [0,4194304] 0 2024-09-21T00:56:47.080 INFO:tasks.workunit.client.1.smithi187.stdout:5/833: chown d0/dc/d1f/df4/f101 204253270 1 2024-09-21T00:56:47.080 INFO:tasks.workunit.client.0.smithi112.stdout:9/358: symlink d5/d3b/d5f/d13/d6e/l72 0 2024-09-21T00:56:47.082 INFO:tasks.workunit.client.1.smithi187.stdout:0/884: mknod d0/dc2/c131 0 2024-09-21T00:56:47.083 INFO:tasks.workunit.client.1.smithi187.stdout:2/961: link d2/d3/d15/dfe/d2d/d8f/d9f/d8c/l12e d2/dc/d2e/d4a/d7c/d52/l151 0 2024-09-21T00:56:47.084 INFO:tasks.workunit.client.1.smithi187.stdout:3/869: mknod d9/d19/dca/dd6/df0/c120 0 2024-09-21T00:56:47.085 INFO:tasks.workunit.client.0.smithi112.stdout:9/359: symlink d5/d3b/d5f/d59/l73 0 2024-09-21T00:56:47.087 INFO:tasks.workunit.client.1.smithi187.stdout:7/863: dread d1/f1a [0,4194304] 0 2024-09-21T00:56:47.087 INFO:tasks.workunit.client.1.smithi187.stdout:8/979: mkdir dc/df2/d10c/d154 0 2024-09-21T00:56:47.088 INFO:tasks.workunit.client.1.smithi187.stdout:8/980: write dc/f12 [4657223,93381] 0 2024-09-21T00:56:47.091 INFO:tasks.workunit.client.1.smithi187.stdout:3/870: creat d9/d19/dca/dd6/de4/f121 x:0 0 0 2024-09-21T00:56:47.091 INFO:tasks.workunit.client.0.smithi112.stdout:9/360: dwrite d5/d3b/d5f/d13/f5d [0,4194304] 0 2024-09-21T00:56:47.092 INFO:tasks.workunit.client.1.smithi187.stdout:3/871: fsync d9/d7f/dcb/d87/d94/fe5 0 2024-09-21T00:56:47.099 INFO:tasks.workunit.client.0.smithi112.stdout:9/361: unlink d5/d3b/f3e 0 2024-09-21T00:56:47.100 INFO:tasks.workunit.client.1.smithi187.stdout:8/981: fsync dc/f10 0 2024-09-21T00:56:47.101 INFO:tasks.workunit.client.1.smithi187.stdout:8/982: dread - dc/d2f/d80/db8/dba/d3e/f14d zero size 2024-09-21T00:56:47.103 INFO:tasks.workunit.client.1.smithi187.stdout:2/962: mknod d2/d3/c152 0 2024-09-21T00:56:47.103 INFO:tasks.workunit.client.1.smithi187.stdout:2/963: stat d2/dc/d2e/d51/dc5/ddf/f133 0 2024-09-21T00:56:47.105 INFO:tasks.workunit.client.1.smithi187.stdout:5/834: write d0/dc/d1f/d26/f71 [1663993,120333] 0 2024-09-21T00:56:47.106 INFO:tasks.workunit.client.1.smithi187.stdout:7/864: write d1/dce/dd0/d97/df1/f35 [263154,16783] 0 2024-09-21T00:56:47.106 INFO:tasks.workunit.client.1.smithi187.stdout:5/835: stat d0/dc/daa/d67/d14/l37 0 2024-09-21T00:56:47.109 INFO:tasks.workunit.client.0.smithi112.stdout:9/362: getdents d5/d3b/d5f 0 2024-09-21T00:56:47.110 INFO:tasks.workunit.client.1.smithi187.stdout:0/885: rename d0/dcf/l12a to d0/d17/d18/d3a/d97/dcc/l132 0 2024-09-21T00:56:47.111 INFO:tasks.workunit.client.1.smithi187.stdout:2/964: fsync d2/dc/d2e/fae 0 2024-09-21T00:56:47.115 INFO:tasks.workunit.client.1.smithi187.stdout:5/836: creat d0/dc/daa/d67/d14/d57/f115 x:0 0 0 2024-09-21T00:56:47.116 INFO:tasks.workunit.client.0.smithi112.stdout:9/363: truncate d5/d6/d19/f2a 2567606 0 2024-09-21T00:56:47.118 INFO:tasks.workunit.client.1.smithi187.stdout:7/865: chown d1/dce/dd0/d97/df1/d31/d41/ca3 46640 1 2024-09-21T00:56:47.118 INFO:tasks.workunit.client.1.smithi187.stdout:8/983: dwrite dc/d2f/f45 [0,4194304] 0 2024-09-21T00:56:47.122 INFO:tasks.workunit.client.1.smithi187.stdout:2/965: rmdir d2/dc/d2e/d4a/d7c 39 2024-09-21T00:56:47.127 INFO:tasks.workunit.client.1.smithi187.stdout:7/866: symlink d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d5d/l120 0 2024-09-21T00:56:47.130 INFO:tasks.workunit.client.1.smithi187.stdout:3/872: getdents d9/d7f/dcb/d87/d94/d89 0 2024-09-21T00:56:47.131 INFO:tasks.workunit.client.0.smithi112.stdout:9/364: dwrite d5/f22 [0,4194304] 0 2024-09-21T00:56:47.131 INFO:tasks.workunit.client.1.smithi187.stdout:5/837: creat d0/dc/daa/d67/d30/d6b/d8e/f116 x:0 0 0 2024-09-21T00:56:47.131 INFO:tasks.workunit.client.0.smithi112.stdout:9/365: readlink d5/d3b/d5f/d13/l64 0 2024-09-21T00:56:47.132 INFO:tasks.workunit.client.1.smithi187.stdout:8/984: creat dc/d2f/d80/db8/dba/d135/f155 x:0 0 0 2024-09-21T00:56:47.134 INFO:tasks.workunit.client.1.smithi187.stdout:7/867: chown d1/dc/d15/cec 338 1 2024-09-21T00:56:47.135 INFO:tasks.workunit.client.1.smithi187.stdout:0/886: dwrite d0/d60/d6b/fc7 [0,4194304] 0 2024-09-21T00:56:47.140 INFO:tasks.workunit.client.0.smithi112.stdout:9/366: dwrite d5/d6/f37 [0,4194304] 0 2024-09-21T00:56:47.142 INFO:tasks.workunit.client.1.smithi187.stdout:2/966: dwrite d2/dc/d2e/d4a/d7c/d52/dba/f102 [0,4194304] 0 2024-09-21T00:56:47.144 INFO:tasks.workunit.client.1.smithi187.stdout:0/887: unlink d0/d60/ffe 0 2024-09-21T00:56:47.144 INFO:tasks.workunit.client.1.smithi187.stdout:3/873: dwrite d9/d7f/dcb/f54 [0,4194304] 0 2024-09-21T00:56:47.146 INFO:tasks.workunit.client.1.smithi187.stdout:2/967: write d2/da8/d6c/d97/fb7 [4935037,124196] 0 2024-09-21T00:56:47.148 INFO:tasks.workunit.client.0.smithi112.stdout:9/367: creat d5/d3b/d5f/d13/d54/f74 x:0 0 0 2024-09-21T00:56:47.150 INFO:tasks.workunit.client.1.smithi187.stdout:7/868: dread d1/dce/dd0/d97/df1/d31/d41/dbe/ff4 [0,4194304] 0 2024-09-21T00:56:47.152 INFO:tasks.workunit.client.1.smithi187.stdout:5/838: write d0/dc/d1f/d26/fb1 [589814,34072] 0 2024-09-21T00:56:47.152 INFO:tasks.workunit.client.0.smithi112.stdout:9/368: read d5/d6/d19/f2a [1667368,51504] 0 2024-09-21T00:56:47.153 INFO:tasks.workunit.client.0.smithi112.stdout:9/369: chown d5/d6/c38 18804627 1 2024-09-21T00:56:47.154 INFO:tasks.workunit.client.1.smithi187.stdout:0/888: mknod d0/d17/d18/d3a/d97/dcc/c133 0 2024-09-21T00:56:47.158 INFO:tasks.workunit.client.1.smithi187.stdout:5/839: unlink d0/dc/daa/d67/d14/d38/d5a/d6c/db7/fcb 0 2024-09-21T00:56:47.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:46 smithi187 ceph-mon[34997]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 95 MiB/s rd, 287 MiB/s wr, 561 op/s 2024-09-21T00:56:47.160 INFO:tasks.workunit.client.1.smithi187.stdout:5/840: stat d0/dc/daa/d67/l45 0 2024-09-21T00:56:47.160 INFO:tasks.workunit.client.1.smithi187.stdout:7/869: creat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/f121 x:0 0 0 2024-09-21T00:56:47.160 INFO:tasks.workunit.client.0.smithi112.stdout:9/370: symlink d5/d3b/d5f/d13/d54/d55/l75 0 2024-09-21T00:56:47.162 INFO:tasks.workunit.client.1.smithi187.stdout:0/889: creat d0/d60/d6b/d9f/f134 x:0 0 0 2024-09-21T00:56:47.163 INFO:tasks.workunit.client.1.smithi187.stdout:7/870: write d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/f121 [700939,74770] 0 2024-09-21T00:56:47.164 INFO:tasks.workunit.client.1.smithi187.stdout:5/841: fdatasync d0/f7 0 2024-09-21T00:56:47.166 INFO:tasks.workunit.client.0.smithi112.stdout:9/371: rename d5/d6/d3f/f46 to d5/d6/f76 0 2024-09-21T00:56:47.166 INFO:tasks.workunit.client.1.smithi187.stdout:3/874: dread d9/f4e [0,4194304] 0 2024-09-21T00:56:47.169 INFO:tasks.workunit.client.1.smithi187.stdout:0/890: unlink d0/d17/d18/d3a/d97/d112/d23/df/d51/fec 0 2024-09-21T00:56:47.171 INFO:tasks.workunit.client.0.smithi112.stdout:9/372: creat d5/d6/d19/f77 x:0 0 0 2024-09-21T00:56:47.172 INFO:tasks.workunit.client.1.smithi187.stdout:3/875: unlink d9/d7f/dcb/d87/d94/d53/d56/d7d/f86 0 2024-09-21T00:56:47.174 INFO:tasks.workunit.client.1.smithi187.stdout:5/842: dread d0/dc/daa/d67/d14/d1b/d27/d3a/f72 [0,4194304] 0 2024-09-21T00:56:47.176 INFO:tasks.workunit.client.1.smithi187.stdout:0/891: fdatasync d0/d17/d18/f78 0 2024-09-21T00:56:47.177 INFO:tasks.workunit.client.0.smithi112.stdout:9/373: dwrite d5/d3b/d5f/f52 [0,4194304] 0 2024-09-21T00:56:47.179 INFO:tasks.workunit.client.1.smithi187.stdout:0/892: mknod d0/dcf/c135 0 2024-09-21T00:56:47.181 INFO:tasks.workunit.client.0.smithi112.stdout:9/374: rename d5/d6/d19/d1b/c27 to d5/d6/d19/c78 0 2024-09-21T00:56:47.182 INFO:tasks.workunit.client.1.smithi187.stdout:3/876: dwrite d9/d7f/dcb/d87/d94/d89/f93 [0,4194304] 0 2024-09-21T00:56:47.185 INFO:tasks.workunit.client.0.smithi112.stdout:9/375: unlink d5/d3b/d5f/d13/f47 0 2024-09-21T00:56:47.187 INFO:tasks.workunit.client.1.smithi187.stdout:2/968: dread d2/d3/d15/f87 [0,4194304] 0 2024-09-21T00:56:47.188 INFO:tasks.workunit.client.1.smithi187.stdout:3/877: symlink d9/df2/l122 0 2024-09-21T00:56:47.188 INFO:tasks.workunit.client.0.smithi112.stdout:9/376: rmdir d5/d6/d19/d1b/d57 39 2024-09-21T00:56:47.189 INFO:tasks.workunit.client.1.smithi187.stdout:2/969: stat d2/dc/d2e/d4a/f77 0 2024-09-21T00:56:47.190 INFO:tasks.workunit.client.0.smithi112.stdout:9/377: read d5/d6/d19/d1b/f40 [3090632,26834] 0 2024-09-21T00:56:47.191 INFO:tasks.workunit.client.1.smithi187.stdout:0/893: dwrite d0/d17/d18/d3a/f77 [4194304,4194304] 0 2024-09-21T00:56:47.193 INFO:tasks.workunit.client.1.smithi187.stdout:3/878: symlink d9/dcc/d105/d11b/d5f/l123 0 2024-09-21T00:56:47.196 INFO:tasks.workunit.client.0.smithi112.stdout:9/378: dread d5/d3b/d5f/f58 [0,4194304] 0 2024-09-21T00:56:47.198 INFO:tasks.workunit.client.0.smithi112.stdout:9/379: truncate d5/d3b/d5f/f2e 4702197 0 2024-09-21T00:56:47.199 INFO:tasks.workunit.client.0.smithi112.stdout:9/380: dread - d5/f5e zero size 2024-09-21T00:56:47.202 INFO:tasks.workunit.client.1.smithi187.stdout:0/894: chown d0/d17/d18/c40 8340146 1 2024-09-21T00:56:47.205 INFO:tasks.workunit.client.0.smithi112.stdout:9/381: mkdir d5/d3b/d79 0 2024-09-21T00:56:47.207 INFO:tasks.workunit.client.1.smithi187.stdout:2/970: mknod d2/da8/d6c/db8/d40/d75/d14e/c153 0 2024-09-21T00:56:47.207 INFO:tasks.workunit.client.1.smithi187.stdout:7/871: write d1/dce/dd0/d97/df1/f29 [3644833,111677] 0 2024-09-21T00:56:47.208 INFO:tasks.workunit.client.0.smithi112.stdout:9/382: symlink d5/d3b/d5f/d13/l7a 0 2024-09-21T00:56:47.211 INFO:tasks.workunit.client.1.smithi187.stdout:0/895: mknod d0/d17/d18/d3a/d97/d112/c136 0 2024-09-21T00:56:47.213 INFO:tasks.workunit.client.0.smithi112.stdout:9/383: creat d5/d6/d19/f7b x:0 0 0 2024-09-21T00:56:47.214 INFO:tasks.workunit.client.0.smithi112.stdout:9/384: write d5/d3b/d5f/d13/d56/f61 [1524800,29647] 0 2024-09-21T00:56:47.215 INFO:tasks.workunit.client.1.smithi187.stdout:7/872: mkdir d1/dce/dd4/d122 0 2024-09-21T00:56:47.216 INFO:tasks.workunit.client.1.smithi187.stdout:7/873: write d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fac [306170,126395] 0 2024-09-21T00:56:47.218 INFO:tasks.workunit.client.1.smithi187.stdout:0/896: mkdir d0/d17/d18/d3a/d97/d112/d65/d137 0 2024-09-21T00:56:47.219 INFO:tasks.workunit.client.0.smithi112.stdout:9/385: truncate d5/d6/f6c 1819567 0 2024-09-21T00:56:47.220 INFO:tasks.workunit.client.1.smithi187.stdout:0/897: stat d0/d17/d18/d3a/d97/d112/d23/df/d41/f4a 0 2024-09-21T00:56:47.221 INFO:tasks.workunit.client.1.smithi187.stdout:7/874: fdatasync d1/d55/fcc 0 2024-09-21T00:56:47.223 INFO:tasks.workunit.client.1.smithi187.stdout:5/843: dwrite d0/dc/daa/d67/d14/d38/f4f [0,4194304] 0 2024-09-21T00:56:47.223 INFO:tasks.workunit.client.1.smithi187.stdout:2/971: rmdir d2/da8/d6c/db8/d40/d104 0 2024-09-21T00:56:47.225 INFO:tasks.workunit.client.1.smithi187.stdout:2/972: chown d2/d3/d15/f63 12041087 1 2024-09-21T00:56:47.227 INFO:tasks.workunit.client.1.smithi187.stdout:5/844: write d0/dc/d1f/d26/d8b/fdb [4609017,67716] 0 2024-09-21T00:56:47.228 INFO:tasks.workunit.client.1.smithi187.stdout:5/845: stat d0/dc/d1f/df4/ff7 0 2024-09-21T00:56:47.230 INFO:tasks.workunit.client.1.smithi187.stdout:2/973: creat d2/dc/d2e/d4a/d7c/d52/da3/f154 x:0 0 0 2024-09-21T00:56:47.231 INFO:tasks.workunit.client.1.smithi187.stdout:7/875: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f50 3858011 0 2024-09-21T00:56:47.233 INFO:tasks.workunit.client.1.smithi187.stdout:5/846: creat d0/dc/daa/d67/d14/d1b/d27/dc7/f117 x:0 0 0 2024-09-21T00:56:47.237 INFO:tasks.workunit.client.1.smithi187.stdout:3/879: dwrite d9/dcc/d105/d11b/d5f/f92 [0,4194304] 0 2024-09-21T00:56:47.237 INFO:tasks.workunit.client.1.smithi187.stdout:2/974: read d2/dc/f13 [946586,90463] 0 2024-09-21T00:56:47.237 INFO:tasks.workunit.client.1.smithi187.stdout:7/876: mkdir d1/dce/dd0/d97/df1/d31/d41/dd1/d123 0 2024-09-21T00:56:47.237 INFO:tasks.workunit.client.0.smithi112.stdout:9/386: dread d5/d6/f6c [0,4194304] 0 2024-09-21T00:56:47.239 INFO:tasks.workunit.client.0.smithi112.stdout:9/387: write d5/d6/d19/d1b/f21 [458854,73409] 0 2024-09-21T00:56:47.244 INFO:tasks.workunit.client.1.smithi187.stdout:0/898: dread d0/d17/d18/d90/d98/fcd [0,4194304] 0 2024-09-21T00:56:47.263 INFO:tasks.workunit.client.1.smithi187.stdout:4/942: sync 2024-09-21T00:56:47.271 INFO:tasks.workunit.client.0.smithi112.stdout:4/365: sync 2024-09-21T00:56:47.271 INFO:tasks.workunit.client.0.smithi112.stdout:0/293: sync 2024-09-21T00:56:47.272 INFO:tasks.workunit.client.0.smithi112.stdout:4/366: read - d1/d5/d1c/d6c/f6d zero size 2024-09-21T00:56:47.273 INFO:tasks.workunit.client.0.smithi112.stdout:4/367: read - d1/d5/d1c/d1e/d4a/d5f/f71 zero size 2024-09-21T00:56:47.276 INFO:tasks.workunit.client.0.smithi112.stdout:0/294: dwrite d8/d1b/f42 [0,4194304] 0 2024-09-21T00:56:47.277 INFO:tasks.workunit.client.0.smithi112.stdout:0/295: write d8/d11/f23 [722858,100882] 0 2024-09-21T00:56:47.279 INFO:tasks.workunit.client.0.smithi112.stdout:0/296: write d8/d11/d28/d54/f57 [13873,49614] 0 2024-09-21T00:56:47.296 INFO:tasks.workunit.client.0.smithi112.stdout:9/388: creat d5/d3b/d5f/d13/d56/f7c x:0 0 0 2024-09-21T00:56:47.302 INFO:tasks.workunit.client.0.smithi112.stdout:0/297: truncate d8/fd 820150 0 2024-09-21T00:56:47.303 INFO:tasks.workunit.client.0.smithi112.stdout:0/298: write d8/d1b/d2c/d2e/f4a [957308,62313] 0 2024-09-21T00:56:47.303 INFO:tasks.workunit.client.1.smithi187.stdout:2/975: write d2/da8/d6c/db8/d40/f148 [440359,87060] 0 2024-09-21T00:56:47.303 INFO:tasks.workunit.client.1.smithi187.stdout:0/899: write d0/f70 [2398111,23875] 0 2024-09-21T00:56:47.304 INFO:tasks.workunit.client.0.smithi112.stdout:0/299: write d8/d11/d59/f5a [238749,118647] 0 2024-09-21T00:56:47.305 INFO:tasks.workunit.client.0.smithi112.stdout:9/389: rename d5/d6/d19/d1b to d5/d3b/d5f/d13/d54/d7d 0 2024-09-21T00:56:47.306 INFO:tasks.workunit.client.0.smithi112.stdout:9/390: dread - d5/d3b/d5f/d13/f50 zero size 2024-09-21T00:56:47.307 INFO:tasks.workunit.client.1.smithi187.stdout:4/943: chown d2/d3/da/d2f/d4b/d7e/dc8/f62 482221806 1 2024-09-21T00:56:47.307 INFO:tasks.workunit.client.1.smithi187.stdout:4/944: fdatasync d2/d3/da/d16/f1d 0 2024-09-21T00:56:47.308 INFO:tasks.workunit.client.1.smithi187.stdout:5/847: dwrite d0/dc/dbe/fee [0,4194304] 0 2024-09-21T00:56:47.308 INFO:tasks.workunit.client.1.smithi187.stdout:3/880: mkdir d9/d7f/df5/d124 0 2024-09-21T00:56:47.314 INFO:tasks.workunit.client.1.smithi187.stdout:7/877: dwrite d1/dc/fb2 [0,4194304] 0 2024-09-21T00:56:47.314 INFO:tasks.workunit.client.0.smithi112.stdout:4/368: truncate d1/f46 1610975 0 2024-09-21T00:56:47.316 INFO:tasks.workunit.client.0.smithi112.stdout:9/391: mknod d5/d3b/d5f/d13/d6e/c7e 0 2024-09-21T00:56:47.317 INFO:tasks.workunit.client.1.smithi187.stdout:4/945: dwrite d2/d3/da/d16/f103 [0,4194304] 0 2024-09-21T00:56:47.320 INFO:tasks.workunit.client.0.smithi112.stdout:9/392: mkdir d5/d6/d3f/d7f 0 2024-09-21T00:56:47.321 INFO:tasks.workunit.client.0.smithi112.stdout:0/300: dread d8/fa [0,4194304] 0 2024-09-21T00:56:47.321 INFO:tasks.workunit.client.0.smithi112.stdout:0/301: stat d8/f3c 0 2024-09-21T00:56:47.322 INFO:tasks.workunit.client.0.smithi112.stdout:0/302: chown d8/f20 1034274 1 2024-09-21T00:56:47.325 INFO:tasks.workunit.client.0.smithi112.stdout:9/393: creat d5/d6/d19/f80 x:0 0 0 2024-09-21T00:56:47.326 INFO:tasks.workunit.client.0.smithi112.stdout:4/369: dread d1/d7/d30/f44 [0,4194304] 0 2024-09-21T00:56:47.329 INFO:tasks.workunit.client.1.smithi187.stdout:8/985: sync 2024-09-21T00:56:47.329 INFO:tasks.workunit.client.1.smithi187.stdout:6/930: sync 2024-09-21T00:56:47.336 INFO:tasks.workunit.client.0.smithi112.stdout:4/370: getdents d1/d2d 0 2024-09-21T00:56:47.341 INFO:tasks.workunit.client.0.smithi112.stdout:4/371: link d1/d7/d30/f44 d1/d5/d1c/d1e/d4a/f7d 0 2024-09-21T00:56:47.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/372: rename d1/d7/d9/d1a/d22/f4c to d1/d5/d1c/d1e/d4a/f7e 0 2024-09-21T00:56:47.355 INFO:tasks.workunit.client.0.smithi112.stdout:0/303: write d8/d11/f13 [3229408,14267] 0 2024-09-21T00:56:47.357 INFO:tasks.workunit.client.1.smithi187.stdout:2/976: rename d2/da8/d6c/db8/d94 to d2/dc/d2e/d4a/d7c/d52/d155 0 2024-09-21T00:56:47.357 INFO:tasks.workunit.client.0.smithi112.stdout:0/304: dread d8/d1b/d2c/d2e/f39 [0,4194304] 0 2024-09-21T00:56:47.360 INFO:tasks.workunit.client.0.smithi112.stdout:0/305: unlink l2 0 2024-09-21T00:56:47.361 INFO:tasks.workunit.client.0.smithi112.stdout:4/373: dread d1/d7/f2e [0,4194304] 0 2024-09-21T00:56:47.361 INFO:tasks.workunit.client.0.smithi112.stdout:0/306: truncate d8/d1b/f32 1792399 0 2024-09-21T00:56:47.362 INFO:tasks.workunit.client.0.smithi112.stdout:4/374: fsync d1/d5/d1c/d1e/d4a/d5f/f71 0 2024-09-21T00:56:47.365 INFO:tasks.workunit.client.1.smithi187.stdout:8/986: mknod dc/d2f/d54/d69/db3/c156 0 2024-09-21T00:56:47.369 INFO:tasks.workunit.client.0.smithi112.stdout:4/375: truncate d1/d7/f39 1283284 0 2024-09-21T00:56:47.371 INFO:tasks.workunit.client.1.smithi187.stdout:0/900: mkdir d0/d138 0 2024-09-21T00:56:47.372 INFO:tasks.workunit.client.0.smithi112.stdout:0/307: rename d8/d1b/d2c/d2e/d4c/c5c to d8/d11/d28/c5d 0 2024-09-21T00:56:47.375 INFO:tasks.workunit.client.1.smithi187.stdout:3/881: mkdir d9/d7f/dcb/d125 0 2024-09-21T00:56:47.375 INFO:tasks.workunit.client.0.smithi112.stdout:4/376: dwrite d1/d2d/d34/f58 [0,4194304] 0 2024-09-21T00:56:47.376 INFO:tasks.workunit.client.0.smithi112.stdout:4/377: read - d1/d7/d9/d1a/d22/f72 zero size 2024-09-21T00:56:47.376 INFO:tasks.workunit.client.1.smithi187.stdout:8/987: symlink dc/d2f/d34/d137/l157 0 2024-09-21T00:56:47.377 INFO:tasks.workunit.client.0.smithi112.stdout:4/378: dread - d1/d5/f74 zero size 2024-09-21T00:56:47.379 INFO:tasks.workunit.client.1.smithi187.stdout:0/901: fdatasync d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/fb2 0 2024-09-21T00:56:47.380 INFO:tasks.workunit.client.1.smithi187.stdout:4/946: dread d2/d3/f21 [4194304,4194304] 0 2024-09-21T00:56:47.383 INFO:tasks.workunit.client.1.smithi187.stdout:5/848: rename d0/dc/daa/d67/d14/c2a to d0/dc/daa/d67/d14/d57/d5c/db2/c118 0 2024-09-21T00:56:47.386 INFO:tasks.workunit.client.1.smithi187.stdout:8/988: mknod dc/d2f/d34/d4b/c158 0 2024-09-21T00:56:47.387 INFO:tasks.workunit.client.1.smithi187.stdout:4/947: dwrite d2/d3/da/d2f/f10c [0,4194304] 0 2024-09-21T00:56:47.388 INFO:tasks.workunit.client.1.smithi187.stdout:4/948: chown d2/d3/da/d2f/d32/d26/d66/d6e/fd6 26036460 1 2024-09-21T00:56:47.390 INFO:tasks.workunit.client.1.smithi187.stdout:7/878: rename d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/ff7 to d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/dda/f124 0 2024-09-21T00:56:47.392 INFO:tasks.workunit.client.1.smithi187.stdout:3/882: symlink d9/d7f/dcb/d87/d94/d53/l126 0 2024-09-21T00:56:47.393 INFO:tasks.workunit.client.1.smithi187.stdout:5/849: fdatasync d0/dc/daa/d67/d14/d1b/d27/f9a 0 2024-09-21T00:56:47.394 INFO:tasks.workunit.client.1.smithi187.stdout:7/879: chown d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/la0 5 1 2024-09-21T00:56:47.395 INFO:tasks.workunit.client.1.smithi187.stdout:3/883: truncate d9/dcc/d105/f113 777638 0 2024-09-21T00:56:47.395 INFO:tasks.workunit.client.1.smithi187.stdout:4/949: creat d2/d3/da/d2f/d32/d22/d37/dcf/f124 x:0 0 0 2024-09-21T00:56:47.399 INFO:tasks.workunit.client.1.smithi187.stdout:5/850: unlink d0/dc/daa/d67/d30/l94 0 2024-09-21T00:56:47.400 INFO:tasks.workunit.client.1.smithi187.stdout:5/851: write d0/dc/daa/f6e [482762,31056] 0 2024-09-21T00:56:47.400 INFO:tasks.workunit.client.1.smithi187.stdout:7/880: creat d1/dce/dd4/f125 x:0 0 0 2024-09-21T00:56:47.404 INFO:tasks.workunit.client.1.smithi187.stdout:4/950: symlink d2/d3/da/d2f/d32/d24/dcd/d102/l125 0 2024-09-21T00:56:47.404 INFO:tasks.workunit.client.1.smithi187.stdout:6/931: write d7/d59/d11d/d40/d6a/dbc/fe7 [468744,14637] 0 2024-09-21T00:56:47.407 INFO:tasks.workunit.client.1.smithi187.stdout:8/989: rename dc/l4e to dc/d2f/d34/l159 0 2024-09-21T00:56:47.408 INFO:tasks.workunit.client.1.smithi187.stdout:8/990: readlink dc/d2f/d34/d4b/le1 0 2024-09-21T00:56:47.408 INFO:tasks.workunit.client.1.smithi187.stdout:8/991: readlink dc/d2f/d80/db8/l115 0 2024-09-21T00:56:47.410 INFO:tasks.workunit.client.0.smithi112.stdout:0/308: write d8/d11/d28/f2f [466761,124395] 0 2024-09-21T00:56:47.411 INFO:tasks.workunit.client.1.smithi187.stdout:4/951: dwrite d2/d3/da/d2f/d4b/d7e/dc8/d97/fbd [0,4194304] 0 2024-09-21T00:56:47.414 INFO:tasks.workunit.client.1.smithi187.stdout:7/881: rename d1/d55/dd7/ce5 to d1/dce/dd4/d122/c126 0 2024-09-21T00:56:47.415 INFO:tasks.workunit.client.1.smithi187.stdout:8/992: chown dc/d2f/d80/db8/dba/d29/d105/c153 145010404 1 2024-09-21T00:56:47.415 INFO:tasks.workunit.client.1.smithi187.stdout:5/852: link d0/dc/daa/d67/d14/d38/d5a/l7a d0/dc/d1f/df4/l119 0 2024-09-21T00:56:47.416 INFO:tasks.workunit.client.1.smithi187.stdout:5/853: chown d0/dc/d1f 3931 1 2024-09-21T00:56:47.417 INFO:tasks.workunit.client.1.smithi187.stdout:0/902: write d0/d60/d6b/fa9 [426257,123141] 0 2024-09-21T00:56:47.418 INFO:tasks.workunit.client.1.smithi187.stdout:0/903: chown d0/d17/d18/d3a/d97/d112/f71 292836 1 2024-09-21T00:56:47.420 INFO:tasks.workunit.client.0.smithi112.stdout:4/379: dwrite d1/d7/d30/f44 [0,4194304] 0 2024-09-21T00:56:47.421 INFO:tasks.workunit.client.1.smithi187.stdout:7/882: unlink d1/dce/dd0/d97/df1/f76 0 2024-09-21T00:56:47.426 INFO:tasks.workunit.client.0.smithi112.stdout:4/380: stat d1/d5/d1c/d1e/l35 0 2024-09-21T00:56:47.427 INFO:tasks.workunit.client.0.smithi112.stdout:4/381: chown d1/d7 1281 1 2024-09-21T00:56:47.428 INFO:tasks.workunit.client.1.smithi187.stdout:6/932: link d7/d2a/d7a/cbb d7/d59/d11d/de4/c12e 0 2024-09-21T00:56:47.429 INFO:tasks.workunit.client.1.smithi187.stdout:7/883: dwrite d1/dce/dd0/fa5 [0,4194304] 0 2024-09-21T00:56:47.431 INFO:tasks.workunit.client.1.smithi187.stdout:4/952: mkdir d2/d3/da/d111/d126 0 2024-09-21T00:56:47.432 INFO:tasks.workunit.client.1.smithi187.stdout:8/993: dwrite dc/d2f/d34/d4b/f99 [4194304,4194304] 0 2024-09-21T00:56:47.433 INFO:tasks.workunit.client.1.smithi187.stdout:7/884: write d1/d55/dd7/ffa [895806,73320] 0 2024-09-21T00:56:47.434 INFO:tasks.workunit.client.1.smithi187.stdout:0/904: readlink d0/d5a/l130 0 2024-09-21T00:56:47.434 INFO:tasks.workunit.client.0.smithi112.stdout:4/382: dwrite d1/d7/d9/d1a/f78 [0,4194304] 0 2024-09-21T00:56:47.438 INFO:tasks.workunit.client.1.smithi187.stdout:7/885: write d1/f68 [5161819,44615] 0 2024-09-21T00:56:47.439 INFO:tasks.workunit.client.1.smithi187.stdout:6/933: mkdir d7/d59/d11d/d40/d12f 0 2024-09-21T00:56:47.441 INFO:tasks.workunit.client.0.smithi112.stdout:4/383: creat d1/f7f x:0 0 0 2024-09-21T00:56:47.441 INFO:tasks.workunit.client.1.smithi187.stdout:6/934: write d7/d59/d11d/d40/f20 [1185564,5812] 0 2024-09-21T00:56:47.441 INFO:tasks.workunit.client.1.smithi187.stdout:7/886: stat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/f96 0 2024-09-21T00:56:47.446 INFO:tasks.workunit.client.1.smithi187.stdout:5/854: link d0/dc/daa/d67/d14/d38/l87 d0/l11a 0 2024-09-21T00:56:47.447 INFO:tasks.workunit.client.1.smithi187.stdout:4/953: mknod d2/d3/da/d111/d126/c127 0 2024-09-21T00:56:47.450 INFO:tasks.workunit.client.1.smithi187.stdout:7/887: mkdir d1/dce/dd0/d97/df1/d31/d41/dbe/d127 0 2024-09-21T00:56:47.450 INFO:tasks.workunit.client.0.smithi112.stdout:0/309: truncate d8/d11/d28/f4e 1482331 0 2024-09-21T00:56:47.455 INFO:tasks.workunit.client.1.smithi187.stdout:4/954: read d2/d3/da/d2f/d32/d26/d66/d6e/f7b [49367,100263] 0 2024-09-21T00:56:47.456 INFO:tasks.workunit.client.1.smithi187.stdout:6/935: link d7/d59/d11d/d40/d6a/d9e/ff4 d7/d59/d11d/de4/d122/f130 0 2024-09-21T00:56:47.457 INFO:tasks.workunit.client.0.smithi112.stdout:0/310: dwrite d8/d11/f37 [4194304,4194304] 0 2024-09-21T00:56:47.457 INFO:tasks.workunit.client.1.smithi187.stdout:2/977: sync 2024-09-21T00:56:47.458 INFO:tasks.workunit.client.1.smithi187.stdout:4/955: mkdir d2/d3/da/d2f/d32/d22/d37/d128 0 2024-09-21T00:56:47.459 INFO:tasks.workunit.client.0.smithi112.stdout:0/311: read d8/f20 [963567,77163] 0 2024-09-21T00:56:47.459 INFO:tasks.workunit.client.1.smithi187.stdout:4/956: write d2/d3/da/d2f/d4b/fa9 [4978938,24244] 0 2024-09-21T00:56:47.459 INFO:tasks.workunit.client.1.smithi187.stdout:6/936: creat d7/d59/d11d/d40/d6a/dbc/f131 x:0 0 0 2024-09-21T00:56:47.460 INFO:tasks.workunit.client.0.smithi112.stdout:5/186: sync 2024-09-21T00:56:47.461 INFO:tasks.workunit.client.0.smithi112.stdout:2/307: sync 2024-09-21T00:56:47.461 INFO:tasks.workunit.client.1.smithi187.stdout:6/937: write d7/d59/d11d/d40/d6a/f111 [658226,80153] 0 2024-09-21T00:56:47.464 INFO:tasks.workunit.client.1.smithi187.stdout:4/957: creat d2/d3/d56/d84/d60/d9e/f129 x:0 0 0 2024-09-21T00:56:47.464 INFO:tasks.workunit.client.0.smithi112.stdout:2/308: mkdir d0/d60 0 2024-09-21T00:56:47.467 INFO:tasks.workunit.client.0.smithi112.stdout:5/187: creat d8/d9/d13/d2a/f3b x:0 0 0 2024-09-21T00:56:47.467 INFO:tasks.workunit.client.0.smithi112.stdout:0/312: dwrite d8/f19 [0,4194304] 0 2024-09-21T00:56:47.468 INFO:tasks.workunit.client.1.smithi187.stdout:6/938: symlink d7/d59/d11d/d40/d50/d83/l132 0 2024-09-21T00:56:47.468 INFO:tasks.workunit.client.0.smithi112.stdout:4/384: dread d1/d5/d1c/d1e/f41 [4194304,4194304] 0 2024-09-21T00:56:47.470 INFO:tasks.workunit.client.1.smithi187.stdout:4/958: rmdir d2/d3/da/d48 39 2024-09-21T00:56:47.473 INFO:tasks.workunit.client.1.smithi187.stdout:6/939: truncate d7/d59/d11d/d40/fb8 668142 0 2024-09-21T00:56:47.473 INFO:tasks.workunit.client.0.smithi112.stdout:2/309: dwrite d0/f18 [0,4194304] 0 2024-09-21T00:56:47.475 INFO:tasks.workunit.client.0.smithi112.stdout:0/313: unlink d8/l25 0 2024-09-21T00:56:47.476 INFO:tasks.workunit.client.0.smithi112.stdout:0/314: write d8/d1b/f32 [1114843,26808] 0 2024-09-21T00:56:47.477 INFO:tasks.workunit.client.1.smithi187.stdout:8/994: dwrite dc/d2f/d54/d69/f84 [0,4194304] 0 2024-09-21T00:56:47.478 INFO:tasks.workunit.client.0.smithi112.stdout:5/188: creat d8/d9/d13/d1c/f3c x:0 0 0 2024-09-21T00:56:47.479 INFO:tasks.workunit.client.0.smithi112.stdout:5/189: readlink d8/l1e 0 2024-09-21T00:56:47.481 INFO:tasks.workunit.client.0.smithi112.stdout:0/315: dread d8/fa [0,4194304] 0 2024-09-21T00:56:47.482 INFO:tasks.workunit.client.1.smithi187.stdout:5/855: write d0/dc/d39/fe2 [227416,110195] 0 2024-09-21T00:56:47.482 INFO:tasks.workunit.client.1.smithi187.stdout:6/940: dread d7/d2a/f9d [0,4194304] 0 2024-09-21T00:56:47.482 INFO:tasks.workunit.client.0.smithi112.stdout:4/385: rename d1/d7/d9/d1a/d22/f6f to d1/d5/d1c/d1e/d3d/f80 0 2024-09-21T00:56:47.485 INFO:tasks.workunit.client.1.smithi187.stdout:5/856: write d0/dc/daa/d67/d14/f21 [1111458,9145] 0 2024-09-21T00:56:47.487 INFO:tasks.workunit.client.0.smithi112.stdout:0/316: dread d8/f19 [0,4194304] 0 2024-09-21T00:56:47.488 INFO:tasks.workunit.client.0.smithi112.stdout:0/317: readlink d8/d1b/l1f 0 2024-09-21T00:56:47.490 INFO:tasks.workunit.client.1.smithi187.stdout:2/978: truncate d2/d25/fee 2653360 0 2024-09-21T00:56:47.495 INFO:tasks.workunit.client.0.smithi112.stdout:0/318: dwrite d8/d1b/f32 [0,4194304] 0 2024-09-21T00:56:47.497 INFO:tasks.workunit.client.0.smithi112.stdout:2/310: creat d0/df/d46/f61 x:0 0 0 2024-09-21T00:56:47.499 INFO:tasks.workunit.client.1.smithi187.stdout:5/857: symlink d0/dc/daa/d67/d14/l11b 0 2024-09-21T00:56:47.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/386: mknod d1/d75/c81 0 2024-09-21T00:56:47.504 INFO:tasks.workunit.client.0.smithi112.stdout:2/311: mkdir d0/d51/d62 0 2024-09-21T00:56:47.505 INFO:tasks.workunit.client.0.smithi112.stdout:2/312: chown d0/d14/f5d 2 1 2024-09-21T00:56:47.507 INFO:tasks.workunit.client.0.smithi112.stdout:0/319: link d8/d11/f2d d8/f5e 0 2024-09-21T00:56:47.507 INFO:tasks.workunit.client.1.smithi187.stdout:4/959: dwrite d2/d3/da/f4d [0,4194304] 0 2024-09-21T00:56:47.509 INFO:tasks.workunit.client.0.smithi112.stdout:9/394: sync 2024-09-21T00:56:47.509 INFO:tasks.workunit.client.0.smithi112.stdout:8/270: sync 2024-09-21T00:56:47.510 INFO:tasks.workunit.client.0.smithi112.stdout:7/389: sync 2024-09-21T00:56:47.510 INFO:tasks.workunit.client.0.smithi112.stdout:1/270: sync 2024-09-21T00:56:47.510 INFO:tasks.workunit.client.0.smithi112.stdout:6/313: sync 2024-09-21T00:56:47.510 INFO:tasks.workunit.client.0.smithi112.stdout:3/524: sync 2024-09-21T00:56:47.510 INFO:tasks.workunit.client.1.smithi187.stdout:4/960: mknod d2/d3/da/d2f/d32/d24/dcd/db3/df9/c12a 0 2024-09-21T00:56:47.511 INFO:tasks.workunit.client.1.smithi187.stdout:4/961: stat d2/d3/da/d2f/d32/d24/f67 0 2024-09-21T00:56:47.512 INFO:tasks.workunit.client.0.smithi112.stdout:9/395: chown d5/d3b/d5f/d13/d54/d7d 396 1 2024-09-21T00:56:47.512 INFO:tasks.workunit.client.0.smithi112.stdout:6/314: fdatasync d9/df/d4b/f55 0 2024-09-21T00:56:47.513 INFO:tasks.workunit.client.1.smithi187.stdout:5/858: link d0/dc/daa/d67/d14/d1b/d27/dc7/ce0 d0/c11c 0 2024-09-21T00:56:47.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/271: chown d5/d8/dd/c37 948560001 1 2024-09-21T00:56:47.514 INFO:tasks.workunit.client.0.smithi112.stdout:0/320: mkdir d8/d5f 0 2024-09-21T00:56:47.520 INFO:tasks.workunit.client.0.smithi112.stdout:8/271: write d0/f26 [90402,4928] 0 2024-09-21T00:56:47.520 INFO:tasks.workunit.client.1.smithi187.stdout:4/962: symlink d2/d3/d74/d98/dc2/l12b 0 2024-09-21T00:56:47.521 INFO:tasks.workunit.client.0.smithi112.stdout:7/390: dread d0/f46 [0,4194304] 0 2024-09-21T00:56:47.521 INFO:tasks.workunit.client.0.smithi112.stdout:9/396: creat d5/d3b/d5f/f81 x:0 0 0 2024-09-21T00:56:47.524 INFO:tasks.workunit.client.1.smithi187.stdout:4/963: mknod d2/d3/da/d16/d5f/c12c 0 2024-09-21T00:56:47.526 INFO:tasks.workunit.client.0.smithi112.stdout:8/272: write d0/d13/d1b/d22/d2e/f4b [2640664,35182] 0 2024-09-21T00:56:47.527 INFO:tasks.workunit.client.1.smithi187.stdout:5/859: creat d0/dc/daa/d67/d14/d38/f11d x:0 0 0 2024-09-21T00:56:47.528 INFO:tasks.workunit.client.1.smithi187.stdout:3/884: sync 2024-09-21T00:56:47.528 INFO:tasks.workunit.client.0.smithi112.stdout:8/273: dread - d0/f43 zero size 2024-09-21T00:56:47.529 INFO:tasks.workunit.client.0.smithi112.stdout:6/315: dwrite d9/df/d4b/f55 [0,4194304] 0 2024-09-21T00:56:47.529 INFO:tasks.workunit.client.0.smithi112.stdout:3/525: symlink d2/d8/d28/d9d/lbc 0 2024-09-21T00:56:47.531 INFO:tasks.workunit.client.0.smithi112.stdout:0/321: dwrite d8/d1b/d2c/d2e/f4a [0,4194304] 0 2024-09-21T00:56:47.531 INFO:tasks.workunit.client.1.smithi187.stdout:6/941: dwrite d7/d59/d11d/d40/d6a/d9e/ff2 [0,4194304] 0 2024-09-21T00:56:47.536 INFO:tasks.workunit.client.1.smithi187.stdout:5/860: read d0/dc/daa/d67/d14/fda [3319858,93436] 0 2024-09-21T00:56:47.536 INFO:tasks.workunit.client.0.smithi112.stdout:5/190: write d8/d9/f27 [891708,15658] 0 2024-09-21T00:56:47.537 INFO:tasks.workunit.client.1.smithi187.stdout:2/979: truncate d2/d3/df/f72 1222374 0 2024-09-21T00:56:47.538 INFO:tasks.workunit.client.1.smithi187.stdout:3/885: mknod d9/d7f/dcb/d87/d94/d89/c127 0 2024-09-21T00:56:47.542 INFO:tasks.workunit.client.1.smithi187.stdout:6/942: rename d7/d59/d11d/d40/d6a/dbc/fe7 to d7/d59/d11d/d40/d50/d83/de5/f133 0 2024-09-21T00:56:47.543 INFO:tasks.workunit.client.0.smithi112.stdout:0/322: write d8/d11/f23 [593931,91404] 0 2024-09-21T00:56:47.544 INFO:tasks.workunit.client.1.smithi187.stdout:6/943: chown d7/f8e 960 1 2024-09-21T00:56:47.545 INFO:tasks.workunit.client.0.smithi112.stdout:4/387: dread d1/d5/d1c/f65 [0,4194304] 0 2024-09-21T00:56:47.547 INFO:tasks.workunit.client.1.smithi187.stdout:3/886: rmdir d9/d19/dca/dd6/df0 39 2024-09-21T00:56:47.548 INFO:tasks.workunit.client.0.smithi112.stdout:6/316: dwrite d9/d1f/d47/d34/f36 [0,4194304] 0 2024-09-21T00:56:47.548 INFO:tasks.workunit.client.1.smithi187.stdout:4/964: read d2/d3/da/d48/f6d [2176551,42807] 0 2024-09-21T00:56:47.549 INFO:tasks.workunit.client.0.smithi112.stdout:2/313: dread d0/df/f34 [0,4194304] 0 2024-09-21T00:56:47.550 INFO:tasks.workunit.client.1.smithi187.stdout:5/861: dwrite d0/dc/daa/d67/f50 [0,4194304] 0 2024-09-21T00:56:47.553 INFO:tasks.workunit.client.0.smithi112.stdout:0/323: rename d8/d1b/d2c/d2e/d4c to d8/d1b/d2c/d2e/d4c/d60 22 2024-09-21T00:56:47.553 INFO:tasks.workunit.client.0.smithi112.stdout:3/526: dwrite d2/d8/dd/f2e [4194304,4194304] 0 2024-09-21T00:56:47.553 INFO:tasks.workunit.client.0.smithi112.stdout:8/274: mknod d0/d13/d1b/d22/d2e/d3d/c54 0 2024-09-21T00:56:47.556 INFO:tasks.workunit.client.1.smithi187.stdout:2/980: chown d2/d3/df/f72 207735 1 2024-09-21T00:56:47.557 INFO:tasks.workunit.client.0.smithi112.stdout:1/272: rmdir d5/d8/dd/d50 0 2024-09-21T00:56:47.559 INFO:tasks.workunit.client.1.smithi187.stdout:5/862: dwrite d0/dc/daa/d67/d30/f60 [0,4194304] 0 2024-09-21T00:56:47.560 INFO:tasks.workunit.client.1.smithi187.stdout:5/863: readlink d0/dc/dbe/le1 0 2024-09-21T00:56:47.560 INFO:tasks.workunit.client.0.smithi112.stdout:1/273: write d5/d8/f35 [821993,68959] 0 2024-09-21T00:56:47.564 INFO:tasks.workunit.client.0.smithi112.stdout:4/388: dwrite d1/d7/d9/f61 [4194304,4194304] 0 2024-09-21T00:56:47.566 INFO:tasks.workunit.client.1.smithi187.stdout:4/965: creat d2/d3/da/d2f/d32/d22/d37/d51/f12d x:0 0 0 2024-09-21T00:56:47.566 INFO:tasks.workunit.client.0.smithi112.stdout:8/275: dwrite d0/f26 [4194304,4194304] 0 2024-09-21T00:56:47.567 INFO:tasks.workunit.client.0.smithi112.stdout:8/276: fsync d0/d13/d2a/f45 0 2024-09-21T00:56:47.571 INFO:tasks.workunit.client.1.smithi187.stdout:2/981: truncate d2/d3/d15/dfe/d2d/d8f/d9f/fcc 994596 0 2024-09-21T00:56:47.579 INFO:tasks.workunit.client.1.smithi187.stdout:4/966: unlink d2/d3/d74/d98/dc2/l12b 0 2024-09-21T00:56:47.579 INFO:tasks.workunit.client.1.smithi187.stdout:2/982: dwrite d2/da8/d6c/db8/d40/f148 [0,4194304] 0 2024-09-21T00:56:47.581 INFO:tasks.workunit.client.1.smithi187.stdout:6/944: link d7/l61 d7/d59/d11d/d40/d6a/da1/l134 0 2024-09-21T00:56:47.582 INFO:tasks.workunit.client.1.smithi187.stdout:5/864: symlink d0/dc/daa/d67/d14/d38/d5a/d6c/db7/l11e 0 2024-09-21T00:56:47.582 INFO:tasks.workunit.client.1.smithi187.stdout:4/967: truncate d2/d3/da/d2f/ffc 439505 0 2024-09-21T00:56:47.583 INFO:tasks.workunit.client.0.smithi112.stdout:7/391: mknod d0/d2/d36/d39/d55/c7c 0 2024-09-21T00:56:47.584 INFO:tasks.workunit.client.1.smithi187.stdout:2/983: creat d2/d3/d15/dfe/f156 x:0 0 0 2024-09-21T00:56:47.584 INFO:tasks.workunit.client.1.smithi187.stdout:5/865: write d0/dc/daa/d67/d14/d38/d5a/fbc [6757065,42342] 0 2024-09-21T00:56:47.585 INFO:tasks.workunit.client.1.smithi187.stdout:2/984: dread - d2/da8/d6c/db8/f132 zero size 2024-09-21T00:56:47.585 INFO:tasks.workunit.client.1.smithi187.stdout:6/945: write d7/d59/d11d/de4/d11c/f93 [3465422,36029] 0 2024-09-21T00:56:47.587 INFO:tasks.workunit.client.0.smithi112.stdout:6/317: unlink d9/df/d4b/f5f 0 2024-09-21T00:56:47.589 INFO:tasks.workunit.client.0.smithi112.stdout:0/324: chown d8/fd 75 1 2024-09-21T00:56:47.590 INFO:tasks.workunit.client.1.smithi187.stdout:4/968: truncate d2/d3/da/f1f 1290906 0 2024-09-21T00:56:47.595 INFO:tasks.workunit.client.1.smithi187.stdout:5/866: unlink d0/dc/daa/d67/d30/f103 0 2024-09-21T00:56:47.596 INFO:tasks.workunit.client.1.smithi187.stdout:7/888: sync 2024-09-21T00:56:47.596 INFO:tasks.workunit.client.1.smithi187.stdout:0/905: sync 2024-09-21T00:56:47.598 INFO:tasks.workunit.client.1.smithi187.stdout:0/906: dread - d0/d17/d18/d90/d98/ddd/ffd zero size 2024-09-21T00:56:47.600 INFO:tasks.workunit.client.1.smithi187.stdout:7/889: write d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/f11b [960959,87059] 0 2024-09-21T00:56:47.602 INFO:tasks.workunit.client.0.smithi112.stdout:1/274: creat d5/d8/dd/f58 x:0 0 0 2024-09-21T00:56:47.603 INFO:tasks.workunit.client.1.smithi187.stdout:5/867: rename d0/c4 to d0/dc/d1f/df4/c11f 0 2024-09-21T00:56:47.604 INFO:tasks.workunit.client.0.smithi112.stdout:3/527: dwrite d2/d8/d6d/fa2 [0,4194304] 0 2024-09-21T00:56:47.604 INFO:tasks.workunit.client.0.smithi112.stdout:8/277: dread d0/fd [0,4194304] 0 2024-09-21T00:56:47.605 INFO:tasks.workunit.client.1.smithi187.stdout:0/907: dwrite d0/d60/d6b/fa9 [4194304,4194304] 0 2024-09-21T00:56:47.607 INFO:tasks.workunit.client.0.smithi112.stdout:5/191: symlink d8/d9/l3d 0 2024-09-21T00:56:47.608 INFO:tasks.workunit.client.1.smithi187.stdout:3/887: write d9/d7f/dcb/f1e [5128276,54516] 0 2024-09-21T00:56:47.608 INFO:tasks.workunit.client.1.smithi187.stdout:6/946: truncate d7/d2a/f116 1352313 0 2024-09-21T00:56:47.609 INFO:tasks.workunit.client.0.smithi112.stdout:1/275: read d5/d8/dd/f4e [864772,103599] 0 2024-09-21T00:56:47.611 INFO:tasks.workunit.client.0.smithi112.stdout:7/392: rmdir d0/d79 39 2024-09-21T00:56:47.615 INFO:tasks.workunit.client.1.smithi187.stdout:6/947: chown d7/d59/d11d/d40/d50/c89 34785200 1 2024-09-21T00:56:47.616 INFO:tasks.workunit.client.0.smithi112.stdout:5/192: dwrite d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:56:47.617 INFO:tasks.workunit.client.1.smithi187.stdout:5/868: dwrite d0/dc/d1f/d26/d8b/fa1 [8388608,4194304] 0 2024-09-21T00:56:47.617 INFO:tasks.workunit.client.1.smithi187.stdout:3/888: fsync d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/faf 0 2024-09-21T00:56:47.618 INFO:tasks.workunit.client.1.smithi187.stdout:0/908: creat d0/dc2/f139 x:0 0 0 2024-09-21T00:56:47.619 INFO:tasks.workunit.client.0.smithi112.stdout:7/393: dwrite d0/f3b [0,4194304] 0 2024-09-21T00:56:47.622 INFO:tasks.workunit.client.1.smithi187.stdout:0/909: rename d0/d17/d18/d3a to d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d13a 22 2024-09-21T00:56:47.625 INFO:tasks.workunit.client.0.smithi112.stdout:9/397: unlink d5/d3b/d5f/f2e 0 2024-09-21T00:56:47.625 INFO:tasks.workunit.client.0.smithi112.stdout:9/398: dread - d5/d6/f5a zero size 2024-09-21T00:56:47.629 INFO:tasks.workunit.client.1.smithi187.stdout:6/948: truncate d7/d59/d11d/fc2 918424 0 2024-09-21T00:56:47.630 INFO:tasks.workunit.client.1.smithi187.stdout:5/869: dwrite d0/dc/daa/d67/d14/d1b/d27/dc7/f117 [0,4194304] 0 2024-09-21T00:56:47.632 INFO:tasks.workunit.client.1.smithi187.stdout:3/889: mknod d9/d19/da7/c128 0 2024-09-21T00:56:47.634 INFO:tasks.workunit.client.0.smithi112.stdout:9/399: dwrite d5/f5e [0,4194304] 0 2024-09-21T00:56:47.634 INFO:tasks.workunit.client.0.smithi112.stdout:9/400: dread - d5/d3b/d5f/f81 zero size 2024-09-21T00:56:47.637 INFO:tasks.workunit.client.1.smithi187.stdout:4/969: link d2/d3/d56/d84/d60/d6c/d77/fae d2/d3/da/d48/f12e 0 2024-09-21T00:56:47.645 INFO:tasks.workunit.client.1.smithi187.stdout:6/949: rmdir d7/d59/d11d/d40/d50/d68 39 2024-09-21T00:56:47.648 INFO:tasks.workunit.client.1.smithi187.stdout:0/910: dread d0/f70 [0,4194304] 0 2024-09-21T00:56:47.650 INFO:tasks.workunit.client.1.smithi187.stdout:7/890: write d1/dc/d15/d22/fc2 [406196,82060] 0 2024-09-21T00:56:47.653 INFO:tasks.workunit.client.0.smithi112.stdout:4/389: rename d1/d5/d1c/d6c/c79 to d1/c82 0 2024-09-21T00:56:47.654 INFO:tasks.workunit.client.1.smithi187.stdout:0/911: read d0/d17/d18/d3a/d97/d112/d23/df/f69 [1997690,38940] 0 2024-09-21T00:56:47.655 INFO:tasks.workunit.client.1.smithi187.stdout:0/912: stat d0/d60/d6b/f8d 0 2024-09-21T00:56:47.655 INFO:tasks.workunit.client.1.smithi187.stdout:3/890: mkdir d9/dcc/d105/d11b/d129 0 2024-09-21T00:56:47.656 INFO:tasks.workunit.client.0.smithi112.stdout:8/278: mknod d0/d13/d1b/d22/d42/d51/c55 0 2024-09-21T00:56:47.656 INFO:tasks.workunit.client.1.smithi187.stdout:3/891: chown d9/d7f/dcb/f48 2132 1 2024-09-21T00:56:47.657 INFO:tasks.workunit.client.0.smithi112.stdout:8/279: write d0/d13/d1b/d22/d2e/d3d/f50 [526982,94933] 0 2024-09-21T00:56:47.658 INFO:tasks.workunit.client.1.smithi187.stdout:7/891: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/fe4 [0,4194304] 0 2024-09-21T00:56:47.658 INFO:tasks.workunit.client.0.smithi112.stdout:9/401: rmdir d5/d3b 39 2024-09-21T00:56:47.660 INFO:tasks.workunit.client.0.smithi112.stdout:1/276: mknod d5/c59 0 2024-09-21T00:56:47.663 INFO:tasks.workunit.client.0.smithi112.stdout:5/193: symlink d8/d9/l3e 0 2024-09-21T00:56:47.666 INFO:tasks.workunit.client.0.smithi112.stdout:3/528: creat d2/d8/dd/de/d4a/fbd x:0 0 0 2024-09-21T00:56:47.667 INFO:tasks.workunit.client.1.smithi187.stdout:7/892: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/f11b [0,4194304] 0 2024-09-21T00:56:47.668 INFO:tasks.workunit.client.0.smithi112.stdout:4/390: mkdir d1/d5/d1c/d1e/d4a/d5f/d83 0 2024-09-21T00:56:47.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/529: dwrite d2/d3e/fa8 [0,4194304] 0 2024-09-21T00:56:47.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/530: stat d2/d33/d8c/la5 0 2024-09-21T00:56:47.675 INFO:tasks.workunit.client.1.smithi187.stdout:8/995: sync 2024-09-21T00:56:47.676 INFO:tasks.workunit.client.1.smithi187.stdout:8/996: fdatasync dc/d2f/d34/d4b/d85/fa8 0 2024-09-21T00:56:47.689 INFO:tasks.workunit.client.0.smithi112.stdout:2/314: truncate d0/d14/f12 1185335 0 2024-09-21T00:56:47.690 INFO:tasks.workunit.client.0.smithi112.stdout:8/280: mknod d0/c56 0 2024-09-21T00:56:47.691 INFO:tasks.workunit.client.0.smithi112.stdout:8/281: write d0/f43 [475655,109980] 0 2024-09-21T00:56:47.692 INFO:tasks.workunit.client.1.smithi187.stdout:6/950: creat d7/d59/d11d/d40/f135 x:0 0 0 2024-09-21T00:56:47.692 INFO:tasks.workunit.client.0.smithi112.stdout:8/282: truncate d0/f10 9199703 0 2024-09-21T00:56:47.693 INFO:tasks.workunit.client.1.smithi187.stdout:6/951: chown d7/d59/d11d/d40/d6a/d9e/f126 1554969 1 2024-09-21T00:56:47.694 INFO:tasks.workunit.client.1.smithi187.stdout:0/913: mkdir d0/d17/d18/df8/d13b 0 2024-09-21T00:56:47.698 INFO:tasks.workunit.client.0.smithi112.stdout:6/318: getdents d9/d13/d31/d41 0 2024-09-21T00:56:47.699 INFO:tasks.workunit.client.1.smithi187.stdout:7/893: mknod d1/dce/dd0/d97/df1/d31/d41/d8a/c128 0 2024-09-21T00:56:47.700 INFO:tasks.workunit.client.1.smithi187.stdout:6/952: dwrite d7/d59/d11d/d94/f98 [0,4194304] 0 2024-09-21T00:56:47.700 INFO:tasks.workunit.client.0.smithi112.stdout:7/394: creat d0/f7d x:0 0 0 2024-09-21T00:56:47.705 INFO:tasks.workunit.client.0.smithi112.stdout:0/325: truncate d8/f35 2909907 0 2024-09-21T00:56:47.705 INFO:tasks.workunit.client.0.smithi112.stdout:3/531: fdatasync d2/f95 0 2024-09-21T00:56:47.706 INFO:tasks.workunit.client.0.smithi112.stdout:3/532: read - d2/d3e/d7b/f93 zero size 2024-09-21T00:56:47.707 INFO:tasks.workunit.client.1.smithi187.stdout:0/914: symlink d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d46/l13c 0 2024-09-21T00:56:47.707 INFO:tasks.workunit.client.0.smithi112.stdout:2/315: mkdir d0/d14/d8/d27/d63 0 2024-09-21T00:56:47.709 INFO:tasks.workunit.client.1.smithi187.stdout:7/894: symlink d1/dce/dd0/d97/df1/d31/d41/d8a/l129 0 2024-09-21T00:56:47.710 INFO:tasks.workunit.client.0.smithi112.stdout:8/283: fsync d0/f3c 0 2024-09-21T00:56:47.711 INFO:tasks.workunit.client.1.smithi187.stdout:5/870: dwrite d0/f20 [4194304,4194304] 0 2024-09-21T00:56:47.713 INFO:tasks.workunit.client.1.smithi187.stdout:4/970: dwrite d2/d3/da/d16/fdd [0,4194304] 0 2024-09-21T00:56:47.714 INFO:tasks.workunit.client.0.smithi112.stdout:1/277: mkdir d5/d8/dd/d54/d5a 0 2024-09-21T00:56:47.715 INFO:tasks.workunit.client.1.smithi187.stdout:7/895: dread d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fc3 [0,4194304] 0 2024-09-21T00:56:47.721 INFO:tasks.workunit.client.0.smithi112.stdout:6/319: mkdir d9/d1f/d3e/d77/d79 0 2024-09-21T00:56:47.721 INFO:tasks.workunit.client.0.smithi112.stdout:1/278: dwrite d5/d8/d10/f16 [0,4194304] 0 2024-09-21T00:56:47.722 INFO:tasks.workunit.client.1.smithi187.stdout:6/953: getdents d7/d59/d11d/d40/d12f 0 2024-09-21T00:56:47.724 INFO:tasks.workunit.client.0.smithi112.stdout:7/395: symlink d0/d2/d36/d39/d56/l7e 0 2024-09-21T00:56:47.726 INFO:tasks.workunit.client.0.smithi112.stdout:4/391: mknod d1/d5/d1c/d1e/d4a/d5f/d83/c84 0 2024-09-21T00:56:47.731 INFO:tasks.workunit.client.0.smithi112.stdout:9/402: write d5/d6/f6c [897084,118146] 0 2024-09-21T00:56:47.733 INFO:tasks.workunit.client.0.smithi112.stdout:3/533: creat d2/d3e/fbe x:0 0 0 2024-09-21T00:56:47.735 INFO:tasks.workunit.client.1.smithi187.stdout:3/892: write f2 [1094829,3376] 0 2024-09-21T00:56:47.740 INFO:tasks.workunit.client.1.smithi187.stdout:6/954: creat d7/d2a/da2/f136 x:0 0 0 2024-09-21T00:56:47.741 INFO:tasks.workunit.client.0.smithi112.stdout:8/284: mknod d0/d13/d1b/d22/d42/d51/c57 0 2024-09-21T00:56:47.747 INFO:tasks.workunit.client.0.smithi112.stdout:1/279: creat d5/d8/d13/d3e/f5b x:0 0 0 2024-09-21T00:56:47.751 INFO:tasks.workunit.client.0.smithi112.stdout:7/396: dread d0/d2/d36/d39/d1a/f44 [0,4194304] 0 2024-09-21T00:56:47.751 INFO:tasks.workunit.client.0.smithi112.stdout:4/392: fsync d1/d2d/f55 0 2024-09-21T00:56:47.753 INFO:tasks.workunit.client.1.smithi187.stdout:3/893: creat d9/d7f/dcb/d87/f12a x:0 0 0 2024-09-21T00:56:47.754 INFO:tasks.workunit.client.1.smithi187.stdout:2/985: sync 2024-09-21T00:56:47.755 INFO:tasks.workunit.client.1.smithi187.stdout:2/986: stat d2/d25/f44 0 2024-09-21T00:56:47.756 INFO:tasks.workunit.client.1.smithi187.stdout:2/987: fdatasync d2/d25/f43 0 2024-09-21T00:56:47.757 INFO:tasks.workunit.client.0.smithi112.stdout:7/397: dwrite d0/f3b [0,4194304] 0 2024-09-21T00:56:47.757 INFO:tasks.workunit.client.1.smithi187.stdout:4/971: rename d2/d3/da/f5b to d2/d3/da/d2f/d32/d22/f12f 0 2024-09-21T00:56:47.758 INFO:tasks.workunit.client.1.smithi187.stdout:0/915: dwrite d0/d60/d6b/fae [0,4194304] 0 2024-09-21T00:56:47.759 INFO:tasks.workunit.client.1.smithi187.stdout:0/916: read d0/f70 [3252692,129624] 0 2024-09-21T00:56:47.760 INFO:tasks.workunit.client.1.smithi187.stdout:3/894: mknod d9/d7f/dcb/d87/d94/d53/d56/d61/c12b 0 2024-09-21T00:56:47.761 INFO:tasks.workunit.client.1.smithi187.stdout:3/895: chown d9/dcc/d105/d11b/d5f/lcd 770 1 2024-09-21T00:56:47.762 INFO:tasks.workunit.client.1.smithi187.stdout:3/896: stat d9/d19/da7/c128 0 2024-09-21T00:56:47.762 INFO:tasks.workunit.client.1.smithi187.stdout:0/917: chown d0/d17/d18/d3a/d97/d112/d65/laa 29084119 1 2024-09-21T00:56:47.763 INFO:tasks.workunit.client.1.smithi187.stdout:0/918: write d0/d17/f12f [832121,122412] 0 2024-09-21T00:56:47.765 INFO:tasks.workunit.client.1.smithi187.stdout:6/955: mkdir d7/d137 0 2024-09-21T00:56:47.766 INFO:tasks.workunit.client.0.smithi112.stdout:8/285: mknod d0/d13/d1b/d22/d2e/c58 0 2024-09-21T00:56:47.768 INFO:tasks.workunit.client.0.smithi112.stdout:1/280: rmdir d5/d8/d13/d3e 39 2024-09-21T00:56:47.771 INFO:tasks.workunit.client.1.smithi187.stdout:5/871: write d0/dc/daa/d67/d30/d6b/fd0 [759666,11268] 0 2024-09-21T00:56:47.772 INFO:tasks.workunit.client.1.smithi187.stdout:2/988: rmdir d2/d3/d13d 39 2024-09-21T00:56:47.774 INFO:tasks.workunit.client.1.smithi187.stdout:8/997: sync 2024-09-21T00:56:47.774 INFO:tasks.workunit.client.1.smithi187.stdout:5/872: dread - d0/dc/daa/d67/d14/d38/d5a/d6c/db7/fe3 zero size 2024-09-21T00:56:47.776 INFO:tasks.workunit.client.1.smithi187.stdout:5/873: write d0/dc/d1f/ffa [54307,2060] 0 2024-09-21T00:56:47.777 INFO:tasks.workunit.client.0.smithi112.stdout:2/316: dwrite d0/d14/f40 [0,4194304] 0 2024-09-21T00:56:47.778 INFO:tasks.workunit.client.0.smithi112.stdout:2/317: write d0/d14/f4e [778315,86234] 0 2024-09-21T00:56:47.779 INFO:tasks.workunit.client.0.smithi112.stdout:2/318: read d0/f18 [610078,39030] 0 2024-09-21T00:56:47.781 INFO:tasks.workunit.client.1.smithi187.stdout:3/897: chown d9/d19/d43/f52 1532 1 2024-09-21T00:56:47.783 INFO:tasks.workunit.client.1.smithi187.stdout:0/919: write d0/d17/d18/d3a/d97/d112/fff [894261,89827] 0 2024-09-21T00:56:47.784 INFO:tasks.workunit.client.0.smithi112.stdout:7/398: mknod d0/d2/d36/d39/d55/c7f 0 2024-09-21T00:56:47.786 INFO:tasks.workunit.client.0.smithi112.stdout:7/399: read - d0/d2/d36/f49 zero size 2024-09-21T00:56:47.786 INFO:tasks.workunit.client.0.smithi112.stdout:3/534: fdatasync d2/d8/f22 0 2024-09-21T00:56:47.789 INFO:tasks.workunit.client.0.smithi112.stdout:8/286: rename d0/d13/d1b/d22/d2e/f4b to d0/d13/f59 0 2024-09-21T00:56:47.790 INFO:tasks.workunit.client.0.smithi112.stdout:9/403: dwrite d5/d3b/d5f/d13/f45 [0,4194304] 0 2024-09-21T00:56:47.791 INFO:tasks.workunit.client.1.smithi187.stdout:0/920: dwrite d0/d17/d18/d90/d98/f105 [0,4194304] 0 2024-09-21T00:56:47.791 INFO:tasks.workunit.client.1.smithi187.stdout:7/896: rename d1/dc/d104 to d1/dc/d15/d2b/d12a 0 2024-09-21T00:56:47.793 INFO:tasks.workunit.client.1.smithi187.stdout:8/998: rmdir dc/d2f/d80/db8/dba 39 2024-09-21T00:56:47.794 INFO:tasks.workunit.client.1.smithi187.stdout:0/921: truncate d0/d17/d18/d3a/d97/d112/d65/f109 469437 0 2024-09-21T00:56:47.796 INFO:tasks.workunit.client.0.smithi112.stdout:1/281: mknod d5/d34/c5c 0 2024-09-21T00:56:47.799 INFO:tasks.workunit.client.0.smithi112.stdout:1/282: readlink d5/l2b 0 2024-09-21T00:56:47.802 INFO:tasks.workunit.client.0.smithi112.stdout:9/404: dwrite d5/f49 [0,4194304] 0 2024-09-21T00:56:47.803 INFO:tasks.workunit.client.0.smithi112.stdout:0/326: getdents d8/d11/d28/d54 0 2024-09-21T00:56:47.805 INFO:tasks.workunit.client.0.smithi112.stdout:8/287: dwrite d0/d13/d1b/d22/f4e [0,4194304] 0 2024-09-21T00:56:47.806 INFO:tasks.workunit.client.1.smithi187.stdout:6/956: dread d7/f4a [0,4194304] 0 2024-09-21T00:56:47.807 INFO:tasks.workunit.client.0.smithi112.stdout:2/319: fsync d0/f2b 0 2024-09-21T00:56:47.808 INFO:tasks.workunit.client.1.smithi187.stdout:6/957: chown d7/d59/d11d/d40/d6a/d88/la3 1 1 2024-09-21T00:56:47.812 INFO:tasks.workunit.client.0.smithi112.stdout:9/405: dread d5/d3b/d5f/d13/f5d [0,4194304] 0 2024-09-21T00:56:47.812 INFO:tasks.workunit.client.1.smithi187.stdout:8/999: fdatasync dc/d2f/d80/db8/dba/f2a 0 2024-09-21T00:56:47.814 INFO:tasks.workunit.client.1.smithi187.stdout:5/874: mknod d0/dc/daa/d67/dcc/de5/df3/c120 0 2024-09-21T00:56:47.817 INFO:tasks.workunit.client.0.smithi112.stdout:3/535: symlink d2/d8/d28/d35/lbf 0 2024-09-21T00:56:47.819 INFO:tasks.workunit.client.0.smithi112.stdout:8/288: read d0/d13/f59 [2924929,115518] 0 2024-09-21T00:56:47.819 INFO:tasks.workunit.client.1.smithi187.stdout:2/989: dread d2/da8/d6c/fca [0,4194304] 0 2024-09-21T00:56:47.820 INFO:tasks.workunit.client.1.smithi187.stdout:4/972: write d2/d3/da/d2f/d32/d25/fb8 [4520960,103606] 0 2024-09-21T00:56:47.822 INFO:tasks.workunit.client.0.smithi112.stdout:7/400: dread d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:47.826 INFO:tasks.workunit.client.1.smithi187.stdout:2/990: read d2/dc/d2e/d4a/f77 [3225954,32486] 0 2024-09-21T00:56:47.827 INFO:tasks.workunit.client.1.smithi187.stdout:5/875: truncate d0/dc/daa/d67/d30/f34 2947858 0 2024-09-21T00:56:47.827 INFO:tasks.workunit.client.1.smithi187.stdout:5/876: stat d0/dc/daa/d67/d14/d1b/d27/f9a 0 2024-09-21T00:56:47.828 INFO:tasks.workunit.client.0.smithi112.stdout:0/327: unlink d8/d1b/l27 0 2024-09-21T00:56:47.829 INFO:tasks.workunit.client.1.smithi187.stdout:6/958: unlink d7/l61 0 2024-09-21T00:56:47.834 INFO:tasks.workunit.client.1.smithi187.stdout:0/922: link d0/d17/d18/d3a/d97/dcc/c133 d0/dcf/c13d 0 2024-09-21T00:56:47.836 INFO:tasks.workunit.client.0.smithi112.stdout:8/289: rmdir d0 39 2024-09-21T00:56:47.836 INFO:tasks.workunit.client.1.smithi187.stdout:3/898: getdents d9/d7f/dcb/d20 0 2024-09-21T00:56:47.838 INFO:tasks.workunit.client.0.smithi112.stdout:1/283: mknod d5/d8/c5d 0 2024-09-21T00:56:47.840 INFO:tasks.workunit.client.1.smithi187.stdout:7/897: write d1/dce/dd0/d97/df1/d31/d33/f95 [1127375,354] 0 2024-09-21T00:56:47.841 INFO:tasks.workunit.client.0.smithi112.stdout:0/328: creat d8/d1b/f61 x:0 0 0 2024-09-21T00:56:47.841 INFO:tasks.workunit.client.0.smithi112.stdout:1/284: chown d5/d8/d10/f17 3171 1 2024-09-21T00:56:47.842 INFO:tasks.workunit.client.0.smithi112.stdout:3/536: dwrite d2/d8/f11 [4194304,4194304] 0 2024-09-21T00:56:47.849 INFO:tasks.workunit.client.0.smithi112.stdout:9/406: rename d5/d3b/d5f/f2c to d5/d3b/d5f/d13/f82 0 2024-09-21T00:56:47.851 INFO:tasks.workunit.client.0.smithi112.stdout:0/329: dwrite d8/d1b/d2c/d2e/d4c/f50 [0,4194304] 0 2024-09-21T00:56:47.851 INFO:tasks.workunit.client.0.smithi112.stdout:9/407: read d5/d3b/d5f/d13/d54/d7d/f3c [1320961,69025] 0 2024-09-21T00:56:47.851 INFO:tasks.workunit.client.1.smithi187.stdout:3/899: unlink d9/cc 0 2024-09-21T00:56:47.852 INFO:tasks.workunit.client.1.smithi187.stdout:4/973: dread d2/d3/da/d2f/d32/f4e [0,4194304] 0 2024-09-21T00:56:47.852 INFO:tasks.workunit.client.1.smithi187.stdout:3/900: chown d9/d7f/dcb/d87/d94/dd1 373 1 2024-09-21T00:56:47.853 INFO:tasks.workunit.client.1.smithi187.stdout:7/898: creat d1/dce/dd4/f12b x:0 0 0 2024-09-21T00:56:47.854 INFO:tasks.workunit.client.0.smithi112.stdout:8/290: write d0/f1d [3537308,8867] 0 2024-09-21T00:56:47.855 INFO:tasks.workunit.client.0.smithi112.stdout:8/291: truncate d0/f43 899637 0 2024-09-21T00:56:47.856 INFO:tasks.workunit.client.1.smithi187.stdout:2/991: rename d2/da8/d6c/fe0 to d2/da8/d6c/db8/f157 0 2024-09-21T00:56:47.857 INFO:tasks.workunit.client.0.smithi112.stdout:8/292: write d0/d13/d2a/f39 [1393439,108467] 0 2024-09-21T00:56:47.861 INFO:tasks.workunit.client.0.smithi112.stdout:1/285: creat d5/d8/d10/d2e/f5e x:0 0 0 2024-09-21T00:56:47.863 INFO:tasks.workunit.client.0.smithi112.stdout:3/537: creat d2/d8/d28/d9d/fc0 x:0 0 0 2024-09-21T00:56:47.865 INFO:tasks.workunit.client.1.smithi187.stdout:7/899: creat d1/dce/dd0/d97/df1/d31/d33/d3b/f12c x:0 0 0 2024-09-21T00:56:47.868 INFO:tasks.workunit.client.1.smithi187.stdout:7/900: dread d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fac [0,4194304] 0 2024-09-21T00:56:47.869 INFO:tasks.workunit.client.0.smithi112.stdout:0/330: readlink l6 0 2024-09-21T00:56:47.872 INFO:tasks.workunit.client.0.smithi112.stdout:2/320: dwrite d0/d14/f50 [0,4194304] 0 2024-09-21T00:56:47.872 INFO:tasks.workunit.client.1.smithi187.stdout:6/959: link d7/f4a d7/d59/d11d/d40/d50/d68/f138 0 2024-09-21T00:56:47.878 INFO:tasks.workunit.client.0.smithi112.stdout:8/293: symlink d0/d13/d1b/d22/d2e/l5a 0 2024-09-21T00:56:47.881 INFO:tasks.workunit.client.0.smithi112.stdout:3/538: mknod d2/d33/d78/cc1 0 2024-09-21T00:56:47.881 INFO:tasks.workunit.client.0.smithi112.stdout:3/539: readlink d2/d33/l4f 0 2024-09-21T00:56:47.886 INFO:tasks.workunit.client.1.smithi187.stdout:3/901: creat d9/dcc/d105/d11b/f12c x:0 0 0 2024-09-21T00:56:47.887 INFO:tasks.workunit.client.1.smithi187.stdout:4/974: write d2/d3/d56/d84/d60/d6c/d77/f93 [1882290,26332] 0 2024-09-21T00:56:47.888 INFO:tasks.workunit.client.0.smithi112.stdout:9/408: read d5/d6/f37 [731352,117454] 0 2024-09-21T00:56:47.890 INFO:tasks.workunit.client.0.smithi112.stdout:2/321: rename d0/d14/d22/f2f to d0/d14/d8/d27/f64 0 2024-09-21T00:56:47.891 INFO:tasks.workunit.client.1.smithi187.stdout:6/960: mknod d7/d59/d11d/d40/d50/c139 0 2024-09-21T00:56:47.892 INFO:tasks.workunit.client.0.smithi112.stdout:7/401: link d0/d2/d36/d39/c26 d0/d2/d36/d39/d1a/d23/c80 0 2024-09-21T00:56:47.893 INFO:tasks.workunit.client.0.smithi112.stdout:7/402: write d0/d2/f64 [4079384,51833] 0 2024-09-21T00:56:47.895 INFO:tasks.workunit.client.1.smithi187.stdout:2/992: dwrite d2/da8/d6c/db8/d40/f6e [0,4194304] 0 2024-09-21T00:56:47.895 INFO:tasks.workunit.client.0.smithi112.stdout:2/322: dread d0/d14/d8/d27/f64 [0,4194304] 0 2024-09-21T00:56:47.895 INFO:tasks.workunit.client.0.smithi112.stdout:8/294: symlink d0/d13/d1b/d22/d2e/d3d/l5b 0 2024-09-21T00:56:47.896 INFO:tasks.workunit.client.0.smithi112.stdout:8/295: fdatasync d0/f21 0 2024-09-21T00:56:47.897 INFO:tasks.workunit.client.1.smithi187.stdout:4/975: creat d2/d3/da/d2f/d4b/d7e/dc8/d89/f130 x:0 0 0 2024-09-21T00:56:47.898 INFO:tasks.workunit.client.0.smithi112.stdout:8/296: write d0/f43 [1659680,107837] 0 2024-09-21T00:56:47.902 INFO:tasks.workunit.client.0.smithi112.stdout:7/403: dwrite d0/d2/d36/d39/d1a/f4d [0,4194304] 0 2024-09-21T00:56:47.903 INFO:tasks.workunit.client.0.smithi112.stdout:0/331: fsync d8/f35 0 2024-09-21T00:56:47.905 INFO:tasks.workunit.client.1.smithi187.stdout:2/993: creat d2/dc/f158 x:0 0 0 2024-09-21T00:56:47.906 INFO:tasks.workunit.client.0.smithi112.stdout:9/409: truncate d5/d3b/d5f/f58 4226244 0 2024-09-21T00:56:47.907 INFO:tasks.workunit.client.1.smithi187.stdout:4/976: symlink d2/d3/da/d2f/d32/d24/l131 0 2024-09-21T00:56:47.911 INFO:tasks.workunit.client.1.smithi187.stdout:2/994: creat d2/d25/f159 x:0 0 0 2024-09-21T00:56:47.913 INFO:tasks.workunit.client.1.smithi187.stdout:4/977: write d2/d3/da/d2f/d4b/d7e/dc8/d97/f121 [484680,50201] 0 2024-09-21T00:56:47.914 INFO:tasks.workunit.client.1.smithi187.stdout:3/902: link d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/le1 d9/d19/d43/l12d 0 2024-09-21T00:56:47.915 INFO:tasks.workunit.client.1.smithi187.stdout:3/903: chown d9/d7f/dcb/d87/d94/f45 43854395 1 2024-09-21T00:56:47.925 INFO:tasks.workunit.client.1.smithi187.stdout:6/961: dread d7/d59/d11d/f7c [0,4194304] 0 2024-09-21T00:56:47.925 INFO:tasks.workunit.client.1.smithi187.stdout:4/978: symlink d2/d3/da/d48/db0/l132 0 2024-09-21T00:56:47.926 INFO:tasks.workunit.client.0.smithi112.stdout:1/286: link d5/d8/d10/d2e/l56 d5/d8/d10/d2e/l5f 0 2024-09-21T00:56:47.926 INFO:tasks.workunit.client.1.smithi187.stdout:6/962: write d7/f64 [3696250,111142] 0 2024-09-21T00:56:47.927 INFO:tasks.workunit.client.1.smithi187.stdout:6/963: stat d7/d59/d11d/d94/fe2 0 2024-09-21T00:56:47.931 INFO:tasks.workunit.client.0.smithi112.stdout:3/540: mknod d2/d8/dd/de/d4a/cc2 0 2024-09-21T00:56:47.936 INFO:tasks.workunit.client.1.smithi187.stdout:6/964: mkdir d7/d59/d11d/d40/d6a/dbc/d13a 0 2024-09-21T00:56:47.936 INFO:tasks.workunit.client.0.smithi112.stdout:0/332: truncate d8/fd 318467 0 2024-09-21T00:56:47.937 INFO:tasks.workunit.client.1.smithi187.stdout:2/995: write d2/d3/d15/dfe/d2d/d8f/d9f/fcc [538161,78021] 0 2024-09-21T00:56:47.938 INFO:tasks.workunit.client.0.smithi112.stdout:0/333: write d8/d1b/f4f [213362,10298] 0 2024-09-21T00:56:47.940 INFO:tasks.workunit.client.0.smithi112.stdout:2/323: creat d0/d51/d62/f65 x:0 0 0 2024-09-21T00:56:47.941 INFO:tasks.workunit.client.0.smithi112.stdout:8/297: dwrite d0/d13/d1b/d22/f31 [0,4194304] 0 2024-09-21T00:56:47.942 INFO:tasks.workunit.client.0.smithi112.stdout:1/287: creat d5/d8/d10/d2e/f60 x:0 0 0 2024-09-21T00:56:47.942 INFO:tasks.workunit.client.1.smithi187.stdout:2/996: symlink d2/da8/d9d/l15a 0 2024-09-21T00:56:47.943 INFO:tasks.workunit.client.0.smithi112.stdout:1/288: readlink d5/d8/d13/l21 0 2024-09-21T00:56:47.943 INFO:tasks.workunit.client.0.smithi112.stdout:8/298: stat d0/d13/d2a/f45 0 2024-09-21T00:56:47.944 INFO:tasks.workunit.client.1.smithi187.stdout:2/997: chown d2/dc/d2e/d4a/d7c/d52/dba/c131 882817 1 2024-09-21T00:56:47.944 INFO:tasks.workunit.client.0.smithi112.stdout:3/541: rmdir d2/d8/d28 39 2024-09-21T00:56:47.945 INFO:tasks.workunit.client.1.smithi187.stdout:6/965: truncate d7/d59/d11d/d40/d50/f73 4335226 0 2024-09-21T00:56:47.947 INFO:tasks.workunit.client.1.smithi187.stdout:4/979: getdents d2/d3/da/d2f/d32/d24/dcd 0 2024-09-21T00:56:47.947 INFO:tasks.workunit.client.0.smithi112.stdout:8/299: write d0/d13/d1b/f53 [73697,129048] 0 2024-09-21T00:56:47.947 INFO:tasks.workunit.client.0.smithi112.stdout:3/542: write f1 [7801792,3676] 0 2024-09-21T00:56:47.948 INFO:tasks.workunit.client.1.smithi187.stdout:3/904: dread d9/f37 [0,4194304] 0 2024-09-21T00:56:47.949 INFO:tasks.workunit.client.1.smithi187.stdout:2/998: dread d2/dc/d2e/d4a/d7c/d52/dba/f102 [0,4194304] 0 2024-09-21T00:56:47.949 INFO:tasks.workunit.client.0.smithi112.stdout:7/404: creat d0/d6e/f81 x:0 0 0 2024-09-21T00:56:47.950 INFO:tasks.workunit.client.0.smithi112.stdout:8/300: write d0/fb [3477358,93164] 0 2024-09-21T00:56:47.951 INFO:tasks.workunit.client.1.smithi187.stdout:2/999: truncate d2/da8/d6c/db8/d40/d75/fd3 1528337 0 2024-09-21T00:56:47.951 INFO:tasks.workunit.client.1.smithi187.stdout:6/966: creat d7/d2a/d7a/f13b x:0 0 0 2024-09-21T00:56:47.952 INFO:tasks.workunit.client.1.smithi187.stdout:5/877: sync 2024-09-21T00:56:47.952 INFO:tasks.workunit.client.1.smithi187.stdout:0/923: sync 2024-09-21T00:56:47.953 INFO:tasks.workunit.client.0.smithi112.stdout:0/334: rmdir d8/d11/d28 39 2024-09-21T00:56:47.953 INFO:tasks.workunit.client.0.smithi112.stdout:2/324: dwrite d0/d14/d8/d27/f38 [0,4194304] 0 2024-09-21T00:56:47.955 INFO:tasks.workunit.client.1.smithi187.stdout:3/905: symlink d9/d7f/dcb/d87/d94/d53/d75/de2/l12e 0 2024-09-21T00:56:47.956 INFO:tasks.workunit.client.0.smithi112.stdout:8/301: write d0/d13/d1b/f30 [3224391,130260] 0 2024-09-21T00:56:47.957 INFO:tasks.workunit.client.1.smithi187.stdout:6/967: mkdir d7/d59/d11d/d40/d50/d83/d114/d13c 0 2024-09-21T00:56:47.957 INFO:tasks.workunit.client.0.smithi112.stdout:2/325: chown d0/df/f26 1 1 2024-09-21T00:56:47.959 INFO:tasks.workunit.client.1.smithi187.stdout:5/878: dwrite d0/dc/daa/d67/d30/d6b/fd0 [0,4194304] 0 2024-09-21T00:56:47.959 INFO:tasks.workunit.client.0.smithi112.stdout:1/289: dwrite d5/d8/dd/f4c [0,4194304] 0 2024-09-21T00:56:47.965 INFO:tasks.workunit.client.0.smithi112.stdout:7/405: rename d0/d2/l28 to d0/d2/d36/d39/d56/l82 0 2024-09-21T00:56:47.967 INFO:tasks.workunit.client.1.smithi187.stdout:3/906: mkdir d9/d7f/dcb/d87/d94/d53/d56/dc9/d12f 0 2024-09-21T00:56:47.969 INFO:tasks.workunit.client.1.smithi187.stdout:3/907: chown d9/dcc/d105/d11b/f31 250 1 2024-09-21T00:56:47.970 INFO:tasks.workunit.client.0.smithi112.stdout:8/302: unlink d0/d13/c2c 0 2024-09-21T00:56:47.972 INFO:tasks.workunit.client.1.smithi187.stdout:6/968: rename d7/d59/d11d/d40/d6a/la6 to d7/d59/d11d/d40/d45/df7/l13d 0 2024-09-21T00:56:47.975 INFO:tasks.workunit.client.1.smithi187.stdout:5/879: unlink d0/dc/daa/d67/d14/d1b/d27/d3a/c9f 0 2024-09-21T00:56:47.976 INFO:tasks.workunit.client.1.smithi187.stdout:3/908: dwrite d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/fa8 [0,4194304] 0 2024-09-21T00:56:47.977 INFO:tasks.workunit.client.1.smithi187.stdout:0/924: mkdir d0/d17/d18/d3a/d97/d112/ded/d13e 0 2024-09-21T00:56:47.977 INFO:tasks.workunit.client.0.smithi112.stdout:9/410: getdents d5/d3b/d5f/d13/d54/d7d 0 2024-09-21T00:56:47.979 INFO:tasks.workunit.client.0.smithi112.stdout:0/335: mkdir d8/d62 0 2024-09-21T00:56:47.980 INFO:tasks.workunit.client.0.smithi112.stdout:0/336: fdatasync d8/d1b/f36 0 2024-09-21T00:56:47.982 INFO:tasks.workunit.client.1.smithi187.stdout:0/925: dread d0/d17/f12f [0,4194304] 0 2024-09-21T00:56:47.984 INFO:tasks.workunit.client.0.smithi112.stdout:8/303: truncate d0/d13/d1b/f32 320870 0 2024-09-21T00:56:47.985 INFO:tasks.workunit.client.1.smithi187.stdout:4/980: dwrite d2/d3/da/d2f/d4b/d7e/fe8 [0,4194304] 0 2024-09-21T00:56:47.985 INFO:tasks.workunit.client.0.smithi112.stdout:0/337: dread d8/d11/f2d [0,4194304] 0 2024-09-21T00:56:47.986 INFO:tasks.workunit.client.0.smithi112.stdout:8/304: write d0/f11 [2268791,118870] 0 2024-09-21T00:56:47.986 INFO:tasks.workunit.client.1.smithi187.stdout:4/981: dread d2/d3/da/d2f/ffc [0,4194304] 0 2024-09-21T00:56:47.988 INFO:tasks.workunit.client.0.smithi112.stdout:9/411: write d5/d6/f6c [2594855,80471] 0 2024-09-21T00:56:47.990 INFO:tasks.workunit.client.1.smithi187.stdout:6/969: mkdir d7/d59/d11d/d40/d12f/d13e 0 2024-09-21T00:56:47.992 INFO:tasks.workunit.client.1.smithi187.stdout:7/901: sync 2024-09-21T00:56:47.993 INFO:tasks.workunit.client.0.smithi112.stdout:2/326: rename d0/d14/d8/fd to d0/df/d46/f66 0 2024-09-21T00:56:47.996 INFO:tasks.workunit.client.0.smithi112.stdout:2/327: readlink d0/d14/l21 0 2024-09-21T00:56:47.996 INFO:tasks.workunit.client.0.smithi112.stdout:7/406: symlink d0/d2/d36/d39/d56/d65/d75/l83 0 2024-09-21T00:56:47.998 INFO:tasks.workunit.client.0.smithi112.stdout:2/328: stat d0/df/l41 0 2024-09-21T00:56:47.998 INFO:tasks.workunit.client.1.smithi187.stdout:3/909: mknod d9/d7f/dcb/d87/d94/d53/d56/c130 0 2024-09-21T00:56:47.998 INFO:tasks.workunit.client.0.smithi112.stdout:0/338: dwrite d8/d1b/f36 [0,4194304] 0 2024-09-21T00:56:47.999 INFO:tasks.workunit.client.1.smithi187.stdout:0/926: truncate d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/d46/fd3 1556899 0 2024-09-21T00:56:48.001 INFO:tasks.workunit.client.0.smithi112.stdout:8/305: dwrite d0/d13/d1b/d22/f4e [0,4194304] 0 2024-09-21T00:56:48.001 INFO:tasks.workunit.client.1.smithi187.stdout:4/982: rmdir d2/d3/da/d2f/d4b/d7e/dc8 39 2024-09-21T00:56:48.002 INFO:tasks.workunit.client.0.smithi112.stdout:8/306: dread - d0/d13/d1b/f4c zero size 2024-09-21T00:56:48.005 INFO:tasks.workunit.client.1.smithi187.stdout:6/970: truncate d7/d2a/da2/fee 703605 0 2024-09-21T00:56:48.006 INFO:tasks.workunit.client.1.smithi187.stdout:6/971: chown d7/d59/d11d/d40/d6a/d88/la3 13162444 1 2024-09-21T00:56:48.006 INFO:tasks.workunit.client.0.smithi112.stdout:0/339: dread d8/d11/d59/f5a [0,4194304] 0 2024-09-21T00:56:48.012 INFO:tasks.workunit.client.1.smithi187.stdout:5/880: creat d0/dc/f121 x:0 0 0 2024-09-21T00:56:48.013 INFO:tasks.workunit.client.0.smithi112.stdout:3/543: dwrite d2/d8/d28/d9d/f9f [0,4194304] 0 2024-09-21T00:56:48.016 INFO:tasks.workunit.client.0.smithi112.stdout:3/544: chown d2/d8/d28/d35/d9e/fba 920 1 2024-09-21T00:56:48.017 INFO:tasks.workunit.client.1.smithi187.stdout:3/910: unlink d9/dcc/d105/d11b/d5f/f78 0 2024-09-21T00:56:48.018 INFO:tasks.workunit.client.1.smithi187.stdout:3/911: readlink d9/d7f/dcb/d87/d94/l44 0 2024-09-21T00:56:48.020 INFO:tasks.workunit.client.0.smithi112.stdout:2/329: dwrite d0/d14/f50 [0,4194304] 0 2024-09-21T00:56:48.021 INFO:tasks.workunit.client.0.smithi112.stdout:2/330: chown d0/df/d46/f61 216456 1 2024-09-21T00:56:48.021 INFO:tasks.workunit.client.0.smithi112.stdout:7/407: creat d0/d2/d36/d39/d56/d65/d75/f84 x:0 0 0 2024-09-21T00:56:48.023 INFO:tasks.workunit.client.0.smithi112.stdout:8/307: truncate d0/d13/d1b/f35 913409 0 2024-09-21T00:56:48.024 INFO:tasks.workunit.client.0.smithi112.stdout:8/308: write d0/d13/f52 [578751,35012] 0 2024-09-21T00:56:48.030 INFO:tasks.workunit.client.1.smithi187.stdout:3/912: mknod d9/d19/dca/c131 0 2024-09-21T00:56:48.032 INFO:tasks.workunit.client.1.smithi187.stdout:3/913: fdatasync d9/d7f/dcb/d87/d94/d53/d56/dc9/f10c 0 2024-09-21T00:56:48.032 INFO:tasks.workunit.client.1.smithi187.stdout:0/927: creat d0/d138/f13f x:0 0 0 2024-09-21T00:56:48.033 INFO:tasks.workunit.client.1.smithi187.stdout:4/983: truncate d2/d3/da/d2f/d32/d24/f45 2442842 0 2024-09-21T00:56:48.035 INFO:tasks.workunit.client.0.smithi112.stdout:7/408: stat d0/d2/d36/d39/d56/l82 0 2024-09-21T00:56:48.035 INFO:tasks.workunit.client.1.smithi187.stdout:0/928: rmdir d0/d17/d18/d3a/d97/dcc 39 2024-09-21T00:56:48.036 INFO:tasks.workunit.client.0.smithi112.stdout:8/309: rmdir d0/d13/d1b/d22 39 2024-09-21T00:56:48.036 INFO:tasks.workunit.client.1.smithi187.stdout:0/929: write d0/d60/d6b/fae [4655939,18728] 0 2024-09-21T00:56:48.037 INFO:tasks.workunit.client.0.smithi112.stdout:8/310: write d0/f3c [5105841,130747] 0 2024-09-21T00:56:48.038 INFO:tasks.workunit.client.0.smithi112.stdout:8/311: readlink d0/d13/l17 0 2024-09-21T00:56:48.039 INFO:tasks.workunit.client.1.smithi187.stdout:7/902: dread d1/dce/dd0/fdc [0,4194304] 0 2024-09-21T00:56:48.040 INFO:tasks.workunit.client.0.smithi112.stdout:9/412: mknod d5/d6/d3f/d7f/c83 0 2024-09-21T00:56:48.043 INFO:tasks.workunit.client.0.smithi112.stdout:1/290: rename d5/d8/d13/d3e/c41 to d5/d8/d13/c61 0 2024-09-21T00:56:48.044 INFO:tasks.workunit.client.1.smithi187.stdout:6/972: write d7/d2a/d7a/f8f [660826,83833] 0 2024-09-21T00:56:48.045 INFO:tasks.workunit.client.0.smithi112.stdout:3/545: creat d2/d8/d28/dac/fc3 x:0 0 0 2024-09-21T00:56:48.046 INFO:tasks.workunit.client.1.smithi187.stdout:4/984: fdatasync d2/f65 0 2024-09-21T00:56:48.046 INFO:tasks.workunit.client.1.smithi187.stdout:6/973: read d7/d59/d11d/f60 [4132006,106487] 0 2024-09-21T00:56:48.049 INFO:tasks.workunit.client.1.smithi187.stdout:7/903: chown d1/dc/cd 206 1 2024-09-21T00:56:48.050 INFO:tasks.workunit.client.1.smithi187.stdout:5/881: dwrite d0/dc/d1f/fe8 [0,4194304] 0 2024-09-21T00:56:48.053 INFO:tasks.workunit.client.0.smithi112.stdout:0/340: creat d8/f63 x:0 0 0 2024-09-21T00:56:48.053 INFO:tasks.workunit.client.0.smithi112.stdout:0/341: fdatasync d8/d11/f1a 0 2024-09-21T00:56:48.054 INFO:tasks.workunit.client.1.smithi187.stdout:7/904: read d1/dce/dd0/d97/df1/d31/d41/d64/d93/ff0 [2835789,31257] 0 2024-09-21T00:56:48.055 INFO:tasks.workunit.client.0.smithi112.stdout:9/413: fdatasync d5/d3b/d5f/d13/f5d 0 2024-09-21T00:56:48.056 INFO:tasks.workunit.client.1.smithi187.stdout:3/914: dwrite d9/d7f/dcb/d87/d94/d53/d56/d7d/fb5 [0,4194304] 0 2024-09-21T00:56:48.056 INFO:tasks.workunit.client.0.smithi112.stdout:9/414: chown d5/d3b/d79 1591125 1 2024-09-21T00:56:48.059 INFO:tasks.workunit.client.1.smithi187.stdout:0/930: mknod d0/d17/d18/d3a/d97/d112/d65/d137/c140 0 2024-09-21T00:56:48.061 INFO:tasks.workunit.client.0.smithi112.stdout:3/546: creat d2/d8/d28/d35/d9e/fc4 x:0 0 0 2024-09-21T00:56:48.064 INFO:tasks.workunit.client.0.smithi112.stdout:2/331: creat d0/f67 x:0 0 0 2024-09-21T00:56:48.066 INFO:tasks.workunit.client.0.smithi112.stdout:7/409: creat d0/d79/f85 x:0 0 0 2024-09-21T00:56:48.067 INFO:tasks.workunit.client.0.smithi112.stdout:7/410: write d0/d2/f64 [166266,86692] 0 2024-09-21T00:56:48.071 INFO:tasks.workunit.client.0.smithi112.stdout:9/415: write d5/d6/f5a [757959,115002] 0 2024-09-21T00:56:48.073 INFO:tasks.workunit.client.1.smithi187.stdout:3/915: creat d9/dcc/d105/f132 x:0 0 0 2024-09-21T00:56:48.074 INFO:tasks.workunit.client.0.smithi112.stdout:3/547: symlink d2/d8/d6d/lc5 0 2024-09-21T00:56:48.076 INFO:tasks.workunit.client.0.smithi112.stdout:2/332: creat d0/df/d46/f68 x:0 0 0 2024-09-21T00:56:48.076 INFO:tasks.workunit.client.0.smithi112.stdout:3/548: write d2/d8/d28/fb3 [728726,47540] 0 2024-09-21T00:56:48.077 INFO:tasks.workunit.client.0.smithi112.stdout:3/549: fdatasync d2/d33/d8c/f76 0 2024-09-21T00:56:48.077 INFO:tasks.workunit.client.0.smithi112.stdout:3/550: chown d2/d33/d8c/f76 985 1 2024-09-21T00:56:48.079 INFO:tasks.workunit.client.1.smithi187.stdout:6/974: mkdir d7/d13f 0 2024-09-21T00:56:48.080 INFO:tasks.workunit.client.1.smithi187.stdout:4/985: write d2/d3/da/d2f/d32/d22/d37/fdc [325161,53133] 0 2024-09-21T00:56:48.082 INFO:tasks.workunit.client.0.smithi112.stdout:0/342: write d8/fa [885228,110759] 0 2024-09-21T00:56:48.084 INFO:tasks.workunit.client.0.smithi112.stdout:0/343: write d8/d11/f2d [3793759,106129] 0 2024-09-21T00:56:48.085 INFO:tasks.workunit.client.0.smithi112.stdout:2/333: chown d0/c39 58184422 1 2024-09-21T00:56:48.086 INFO:tasks.workunit.client.0.smithi112.stdout:0/344: write d8/d11/f23 [780560,123547] 0 2024-09-21T00:56:48.086 INFO:tasks.workunit.client.0.smithi112.stdout:1/291: truncate d5/d34/f42 2237609 0 2024-09-21T00:56:48.087 INFO:tasks.workunit.client.0.smithi112.stdout:0/345: stat d8/d11/f26 0 2024-09-21T00:56:48.090 INFO:tasks.workunit.client.0.smithi112.stdout:1/292: read d5/d8/f1f [946105,121205] 0 2024-09-21T00:56:48.092 INFO:tasks.workunit.client.1.smithi187.stdout:5/882: creat d0/dc/daa/f122 x:0 0 0 2024-09-21T00:56:48.095 INFO:tasks.workunit.client.1.smithi187.stdout:6/975: mknod d7/d59/c140 0 2024-09-21T00:56:48.096 INFO:tasks.workunit.client.1.smithi187.stdout:6/976: fdatasync d7/d59/d11d/f49 0 2024-09-21T00:56:48.096 INFO:tasks.workunit.client.1.smithi187.stdout:4/986: fdatasync d2/d3/da/d2f/d32/f8a 0 2024-09-21T00:56:48.098 INFO:tasks.workunit.client.0.smithi112.stdout:0/346: read d8/d11/d28/d54/f55 [201018,95908] 0 2024-09-21T00:56:48.098 INFO:tasks.workunit.client.1.smithi187.stdout:5/883: truncate d0/dc/d1f/f41 4445429 0 2024-09-21T00:56:48.098 INFO:tasks.workunit.client.1.smithi187.stdout:0/931: dread d0/d17/d18/d3a/d97/d112/d23/df/f69 [0,4194304] 0 2024-09-21T00:56:48.098 INFO:tasks.workunit.client.1.smithi187.stdout:3/916: link d9/d19/c64 d9/dcc/d105/d11b/d129/c133 0 2024-09-21T00:56:48.099 INFO:tasks.workunit.client.0.smithi112.stdout:9/416: getdents d5/d6/d3f/d7f 0 2024-09-21T00:56:48.099 INFO:tasks.workunit.client.1.smithi187.stdout:3/917: write d9/fb7 [293986,39151] 0 2024-09-21T00:56:48.100 INFO:tasks.workunit.client.0.smithi112.stdout:3/551: dread d2/d38/d3f/f49 [0,4194304] 0 2024-09-21T00:56:48.101 INFO:tasks.workunit.client.0.smithi112.stdout:3/552: chown d2/d8/dd/de/l2a 20 1 2024-09-21T00:56:48.102 INFO:tasks.workunit.client.0.smithi112.stdout:3/553: fdatasync d2/d33/f94 0 2024-09-21T00:56:48.103 INFO:tasks.workunit.client.0.smithi112.stdout:3/554: write d2/d3e/f47 [4286651,88169] 0 2024-09-21T00:56:48.105 INFO:tasks.workunit.client.1.smithi187.stdout:6/977: dread - d7/d59/d11d/de4/d11c/ddc/f102 zero size 2024-09-21T00:56:48.106 INFO:tasks.workunit.client.0.smithi112.stdout:0/347: mkdir d8/d1b/d2c/d2e/d4c/d64 0 2024-09-21T00:56:48.107 INFO:tasks.workunit.client.1.smithi187.stdout:4/987: mknod d2/d3/d56/d84/c133 0 2024-09-21T00:56:48.108 INFO:tasks.workunit.client.0.smithi112.stdout:9/417: rename d5/c44 to d5/d3b/d5f/d13/d54/c84 0 2024-09-21T00:56:48.109 INFO:tasks.workunit.client.1.smithi187.stdout:5/884: chown d0/f75 1791 1 2024-09-21T00:56:48.113 INFO:tasks.workunit.client.0.smithi112.stdout:2/334: getdents d0/d51 0 2024-09-21T00:56:48.113 INFO:tasks.workunit.client.1.smithi187.stdout:7/905: dread d1/dc/d15/d2b/fb1 [0,4194304] 0 2024-09-21T00:56:48.114 INFO:tasks.workunit.client.0.smithi112.stdout:2/335: stat d0/d14/d8/c2e 0 2024-09-21T00:56:48.114 INFO:tasks.workunit.client.1.smithi187.stdout:3/918: dread d9/d7f/dcb/d87/d94/d53/d56/fd3 [0,4194304] 0 2024-09-21T00:56:48.114 INFO:tasks.workunit.client.1.smithi187.stdout:5/885: dread d0/dc/daa/d67/d30/d6b/fac [8388608,4194304] 0 2024-09-21T00:56:48.115 INFO:tasks.workunit.client.1.smithi187.stdout:7/906: fsync d1/dce/dd4/f125 0 2024-09-21T00:56:48.115 INFO:tasks.workunit.client.0.smithi112.stdout:0/348: fsync d8/f20 0 2024-09-21T00:56:48.116 INFO:tasks.workunit.client.0.smithi112.stdout:0/349: chown d8/d1b/l1f 64944 1 2024-09-21T00:56:48.116 INFO:tasks.workunit.client.1.smithi187.stdout:7/907: chown d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/f88 3117 1 2024-09-21T00:56:48.118 INFO:tasks.workunit.client.1.smithi187.stdout:6/978: rename d7/d59/d11d/d40/d6a/d9e/d113 to d7/d59/d11d/d40/d45/df7/d141 0 2024-09-21T00:56:48.121 INFO:tasks.workunit.client.1.smithi187.stdout:4/988: mknod d2/d3/da/d2f/d32/d24/c134 0 2024-09-21T00:56:48.123 INFO:tasks.workunit.client.0.smithi112.stdout:2/336: mknod d0/df/d46/c69 0 2024-09-21T00:56:48.123 INFO:tasks.workunit.client.0.smithi112.stdout:2/337: chown d0/d14/d8/d27/f59 52 1 2024-09-21T00:56:48.127 INFO:tasks.workunit.client.1.smithi187.stdout:4/989: dwrite d2/d3/da/d2f/d32/d24/fdf [0,4194304] 0 2024-09-21T00:56:48.127 INFO:tasks.workunit.client.0.smithi112.stdout:9/418: rename d5/d3b/d5f/d13/d54/c84 to d5/d3b/c85 0 2024-09-21T00:56:48.128 INFO:tasks.workunit.client.1.smithi187.stdout:0/932: dwrite d0/d17/d18/d3a/d97/d112/d23/d36/f91 [0,4194304] 0 2024-09-21T00:56:48.129 INFO:tasks.workunit.client.0.smithi112.stdout:2/338: mknod d0/d14/d8/c6a 0 2024-09-21T00:56:48.129 INFO:tasks.workunit.client.1.smithi187.stdout:7/908: rmdir d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/da6 39 2024-09-21T00:56:48.131 INFO:tasks.workunit.client.0.smithi112.stdout:0/350: symlink d8/d1b/d2c/d2e/d4c/d64/l65 0 2024-09-21T00:56:48.132 INFO:tasks.workunit.client.0.smithi112.stdout:0/351: truncate d8/d11/f26 227665 0 2024-09-21T00:56:48.133 INFO:tasks.workunit.client.0.smithi112.stdout:3/555: link d2/l1b d2/d8/d28/d9d/lc6 0 2024-09-21T00:56:48.134 INFO:tasks.workunit.client.0.smithi112.stdout:3/556: write d2/d3e/fbe [42892,48146] 0 2024-09-21T00:56:48.135 INFO:tasks.workunit.client.0.smithi112.stdout:2/339: symlink d0/d51/d62/l6b 0 2024-09-21T00:56:48.137 INFO:tasks.workunit.client.1.smithi187.stdout:3/919: symlink d9/d7f/dcb/d87/d94/l134 0 2024-09-21T00:56:48.137 INFO:tasks.workunit.client.0.smithi112.stdout:0/352: truncate d8/f17 685426 0 2024-09-21T00:56:48.138 INFO:tasks.workunit.client.1.smithi187.stdout:5/886: mknod d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9/c123 0 2024-09-21T00:56:48.142 INFO:tasks.workunit.client.0.smithi112.stdout:2/340: unlink d0/d14/f40 0 2024-09-21T00:56:48.142 INFO:tasks.workunit.client.0.smithi112.stdout:3/557: rename d2/d8/d28/f26 to d2/d33/d78/fc7 0 2024-09-21T00:56:48.143 INFO:tasks.workunit.client.1.smithi187.stdout:4/990: truncate d2/d3/da/d2f/d32/d24/f28 2713083 0 2024-09-21T00:56:48.145 INFO:tasks.workunit.client.0.smithi112.stdout:2/341: rename d0/d14/d8/f1d to d0/d51/d62/f6c 0 2024-09-21T00:56:48.147 INFO:tasks.workunit.client.1.smithi187.stdout:0/933: creat d0/d17/d18/d3a/d97/dcc/f141 x:0 0 0 2024-09-21T00:56:48.149 INFO:tasks.workunit.client.0.smithi112.stdout:9/419: getdents d5 0 2024-09-21T00:56:48.150 INFO:tasks.workunit.client.1.smithi187.stdout:7/909: rename d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f50 to d1/dce/dd4/d122/f12d 0 2024-09-21T00:56:48.152 INFO:tasks.workunit.client.1.smithi187.stdout:6/979: creat d7/d59/d11d/de4/f142 x:0 0 0 2024-09-21T00:56:48.152 INFO:tasks.workunit.client.0.smithi112.stdout:2/342: dwrite d0/d51/d62/f65 [0,4194304] 0 2024-09-21T00:56:48.156 INFO:tasks.workunit.client.0.smithi112.stdout:9/420: creat d5/d3b/d5f/d13/d54/f86 x:0 0 0 2024-09-21T00:56:48.157 INFO:tasks.workunit.client.0.smithi112.stdout:2/343: rmdir d0/d14/d22 39 2024-09-21T00:56:48.157 INFO:tasks.workunit.client.0.smithi112.stdout:9/421: read - d5/d3b/d5f/d13/d54/d7d/d57/f68 zero size 2024-09-21T00:56:48.160 INFO:tasks.workunit.client.1.smithi187.stdout:6/980: dwrite d7/d59/d11d/d94/fea [0,4194304] 0 2024-09-21T00:56:48.160 INFO:tasks.workunit.client.1.smithi187.stdout:3/920: rename d9/d7f/dcb/d9c/ce3 to d9/df2/c135 0 2024-09-21T00:56:48.163 INFO:tasks.workunit.client.1.smithi187.stdout:7/910: unlink d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/fde 0 2024-09-21T00:56:48.164 INFO:tasks.workunit.client.0.smithi112.stdout:9/422: mknod d5/d6/d3f/d7f/c87 0 2024-09-21T00:56:48.167 INFO:tasks.workunit.client.0.smithi112.stdout:3/558: fsync d2/d33/d78/fc7 0 2024-09-21T00:56:48.168 INFO:tasks.workunit.client.0.smithi112.stdout:2/344: mkdir d0/d14/d22/d6d 0 2024-09-21T00:56:48.169 INFO:tasks.workunit.client.0.smithi112.stdout:2/345: chown d0/d14/f32 13 1 2024-09-21T00:56:48.174 INFO:tasks.workunit.client.0.smithi112.stdout:2/346: dread d0/d14/f50 [0,4194304] 0 2024-09-21T00:56:48.174 INFO:tasks.workunit.client.1.smithi187.stdout:3/921: rmdir d9/d7f/dcb/d87/d94 39 2024-09-21T00:56:48.177 INFO:tasks.workunit.client.1.smithi187.stdout:5/887: truncate d0/dc/d1f/d26/f9c 4814307 0 2024-09-21T00:56:48.178 INFO:tasks.workunit.client.1.smithi187.stdout:7/911: chown d1/d55/c90 37 1 2024-09-21T00:56:48.181 INFO:tasks.workunit.client.0.smithi112.stdout:2/347: creat d0/df/d46/d58/f6e x:0 0 0 2024-09-21T00:56:48.184 INFO:tasks.workunit.client.1.smithi187.stdout:3/922: mknod d9/dcc/d105/d11b/d5f/c136 0 2024-09-21T00:56:48.187 INFO:tasks.workunit.client.0.smithi112.stdout:2/348: creat d0/d51/f6f x:0 0 0 2024-09-21T00:56:48.187 INFO:tasks.workunit.client.0.smithi112.stdout:3/559: dread d2/d3e/f47 [0,4194304] 0 2024-09-21T00:56:48.189 INFO:tasks.workunit.client.1.smithi187.stdout:6/981: dread d7/f44 [0,4194304] 0 2024-09-21T00:56:48.189 INFO:tasks.workunit.client.0.smithi112.stdout:3/560: write d2/d8/dd/f2e [524220,108301] 0 2024-09-21T00:56:48.189 INFO:tasks.workunit.client.1.smithi187.stdout:0/934: getdents d0 0 2024-09-21T00:56:48.191 INFO:tasks.workunit.client.0.smithi112.stdout:9/423: dread d5/f17 [0,4194304] 0 2024-09-21T00:56:48.191 INFO:tasks.workunit.client.1.smithi187.stdout:3/923: chown d9/d7f/dcb/d87/d94/d53/d75/c82 4107154 1 2024-09-21T00:56:48.192 INFO:tasks.workunit.client.0.smithi112.stdout:9/424: chown d5/d3b/d5f/d13/l69 0 1 2024-09-21T00:56:48.194 INFO:tasks.workunit.client.1.smithi187.stdout:7/912: fsync d1/d55/d80/f110 0 2024-09-21T00:56:48.195 INFO:tasks.workunit.client.0.smithi112.stdout:3/561: chown d2/d8/cc 6583978 1 2024-09-21T00:56:48.196 INFO:tasks.workunit.client.0.smithi112.stdout:3/562: truncate d2/d33/f94 906553 0 2024-09-21T00:56:48.196 INFO:tasks.workunit.client.0.smithi112.stdout:2/349: mkdir d0/d14/d47/d70 0 2024-09-21T00:56:48.198 INFO:tasks.workunit.client.0.smithi112.stdout:2/350: write d0/d14/d8/d27/f3a [708527,98431] 0 2024-09-21T00:56:48.199 INFO:tasks.workunit.client.0.smithi112.stdout:9/425: creat d5/f88 x:0 0 0 2024-09-21T00:56:48.200 INFO:tasks.workunit.client.1.smithi187.stdout:0/935: truncate d0/d17/d18/d3a/d97/d112/d23/df/f53 3738 0 2024-09-21T00:56:48.203 INFO:tasks.workunit.client.1.smithi187.stdout:5/888: dwrite d0/dc/d39/f9e [0,4194304] 0 2024-09-21T00:56:48.203 INFO:tasks.workunit.client.0.smithi112.stdout:9/426: dread d5/d3b/d5f/f58 [0,4194304] 0 2024-09-21T00:56:48.204 INFO:tasks.workunit.client.0.smithi112.stdout:2/351: symlink d0/df/d46/l71 0 2024-09-21T00:56:48.204 INFO:tasks.workunit.client.1.smithi187.stdout:5/889: write d0/dc/daa/d67/d14/d38/f5f [2913789,46365] 0 2024-09-21T00:56:48.206 INFO:tasks.workunit.client.1.smithi187.stdout:6/982: creat d7/d59/d11d/d40/d6a/dbc/d13a/f143 x:0 0 0 2024-09-21T00:56:48.208 INFO:tasks.workunit.client.0.smithi112.stdout:3/563: mkdir d2/dc8 0 2024-09-21T00:56:48.210 INFO:tasks.workunit.client.1.smithi187.stdout:0/936: creat d0/d17/d18/d3a/d97/d112/ded/f142 x:0 0 0 2024-09-21T00:56:48.211 INFO:tasks.workunit.client.0.smithi112.stdout:2/352: dwrite d0/f53 [0,4194304] 0 2024-09-21T00:56:48.213 INFO:tasks.workunit.client.1.smithi187.stdout:3/924: dwrite d9/d7f/dcb/d87/d94/d53/d56/f5d [0,4194304] 0 2024-09-21T00:56:48.216 INFO:tasks.workunit.client.1.smithi187.stdout:6/983: mknod d7/d59/d11d/de4/d11c/ddc/d120/c144 0 2024-09-21T00:56:48.218 INFO:tasks.workunit.client.0.smithi112.stdout:3/564: dread d2/f5 [4194304,4194304] 0 2024-09-21T00:56:48.218 INFO:tasks.workunit.client.1.smithi187.stdout:0/937: unlink d0/d5a/f85 0 2024-09-21T00:56:48.218 INFO:tasks.workunit.client.0.smithi112.stdout:2/353: mknod d0/d14/d47/d70/c72 0 2024-09-21T00:56:48.224 INFO:tasks.workunit.client.0.smithi112.stdout:3/565: mkdir d2/d38/d3f/d53/d96/dc9 0 2024-09-21T00:56:48.226 INFO:tasks.workunit.client.0.smithi112.stdout:3/566: dread d2/d8/dd/de/d4a/d4c/d7c/fb0 [0,4194304] 0 2024-09-21T00:56:48.227 INFO:tasks.workunit.client.1.smithi187.stdout:7/913: dread d1/dce/dd0/d97/df1/d31/f36 [0,4194304] 0 2024-09-21T00:56:48.228 INFO:tasks.workunit.client.0.smithi112.stdout:3/567: truncate d2/d8/d28/d35/d9e/fc4 974240 0 2024-09-21T00:56:48.229 INFO:tasks.workunit.client.1.smithi187.stdout:6/984: rmdir d7/d59/d11d/d40/d50/d68 39 2024-09-21T00:56:48.229 INFO:tasks.workunit.client.0.smithi112.stdout:3/568: chown d2/d8/dd/l7d 534 1 2024-09-21T00:56:48.229 INFO:tasks.workunit.client.1.smithi187.stdout:6/985: dread d7/f5f [0,4194304] 0 2024-09-21T00:56:48.232 INFO:tasks.workunit.client.1.smithi187.stdout:5/890: creat d0/dc/d1f/f124 x:0 0 0 2024-09-21T00:56:48.234 INFO:tasks.workunit.client.0.smithi112.stdout:2/354: rename d0/d14/d8/d27/f59 to d0/d14/f73 0 2024-09-21T00:56:48.235 INFO:tasks.workunit.client.1.smithi187.stdout:7/914: mkdir d1/dc/d15/d2b/d12a/d12e 0 2024-09-21T00:56:48.235 INFO:tasks.workunit.client.0.smithi112.stdout:9/427: truncate d5/d6/f6c 3330893 0 2024-09-21T00:56:48.236 INFO:tasks.workunit.client.1.smithi187.stdout:7/915: write d1/dc/d15/fa1 [302075,116053] 0 2024-09-21T00:56:48.238 INFO:tasks.workunit.client.1.smithi187.stdout:6/986: creat d7/d59/d11d/d40/d50/d83/de5/f145 x:0 0 0 2024-09-21T00:56:48.240 INFO:tasks.workunit.client.1.smithi187.stdout:5/891: creat d0/dc/dbe/f125 x:0 0 0 2024-09-21T00:56:48.240 INFO:tasks.workunit.client.1.smithi187.stdout:5/892: stat d0/dc/daa/d67/dcc 0 2024-09-21T00:56:48.243 INFO:tasks.workunit.client.0.smithi112.stdout:2/355: read d0/d14/f12 [809619,129539] 0 2024-09-21T00:56:48.244 INFO:tasks.workunit.client.1.smithi187.stdout:3/925: write d9/f37 [5234812,60737] 0 2024-09-21T00:56:48.245 INFO:tasks.workunit.client.1.smithi187.stdout:6/987: mkdir d7/d2a/d7a/d146 0 2024-09-21T00:56:48.246 INFO:tasks.workunit.client.0.smithi112.stdout:9/428: creat d5/d62/f89 x:0 0 0 2024-09-21T00:56:48.246 INFO:tasks.workunit.client.0.smithi112.stdout:9/429: stat d5/d3b 0 2024-09-21T00:56:48.248 INFO:tasks.workunit.client.0.smithi112.stdout:2/356: fsync d0/f48 0 2024-09-21T00:56:48.252 INFO:tasks.workunit.client.0.smithi112.stdout:9/430: unlink d5/d3b/d5f/d13/l3a 0 2024-09-21T00:56:48.255 INFO:tasks.workunit.client.1.smithi187.stdout:3/926: truncate d9/d19/d43/f52 1682947 0 2024-09-21T00:56:48.255 INFO:tasks.workunit.client.0.smithi112.stdout:2/357: dwrite d0/f53 [0,4194304] 0 2024-09-21T00:56:48.258 INFO:tasks.workunit.client.0.smithi112.stdout:3/569: dwrite d2/d8/f22 [0,4194304] 0 2024-09-21T00:56:48.259 INFO:tasks.workunit.client.0.smithi112.stdout:3/570: fsync d2/d8/d28/d9d/fc0 0 2024-09-21T00:56:48.260 INFO:tasks.workunit.client.1.smithi187.stdout:6/988: unlink d7/d59/f1d 0 2024-09-21T00:56:48.261 INFO:tasks.workunit.client.1.smithi187.stdout:6/989: stat d7/d59/d11d/d40/l12c 0 2024-09-21T00:56:48.261 INFO:tasks.workunit.client.1.smithi187.stdout:3/927: dwrite d9/d19/dca/fec [0,4194304] 0 2024-09-21T00:56:48.261 INFO:tasks.workunit.client.1.smithi187.stdout:6/990: chown d7/cc6 27 1 2024-09-21T00:56:48.262 INFO:tasks.workunit.client.0.smithi112.stdout:9/431: unlink d5/f88 0 2024-09-21T00:56:48.263 INFO:tasks.workunit.client.1.smithi187.stdout:6/991: readlink d7/d59/d11d/lfe 0 2024-09-21T00:56:48.263 INFO:tasks.workunit.client.1.smithi187.stdout:3/928: write d9/d7f/dcb/d87/d94/d53/f76 [5664403,130171] 0 2024-09-21T00:56:48.272 INFO:tasks.workunit.client.0.smithi112.stdout:2/358: creat d0/d60/f74 x:0 0 0 2024-09-21T00:56:48.273 INFO:tasks.workunit.client.1.smithi187.stdout:3/929: readlink d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/le1 0 2024-09-21T00:56:48.274 INFO:tasks.workunit.client.1.smithi187.stdout:5/893: getdents d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9 0 2024-09-21T00:56:48.275 INFO:tasks.workunit.client.1.smithi187.stdout:6/992: dwrite d7/d59/d11d/f3f [0,4194304] 0 2024-09-21T00:56:48.275 INFO:tasks.workunit.client.1.smithi187.stdout:7/916: dwrite d1/f21 [4194304,4194304] 0 2024-09-21T00:56:48.276 INFO:tasks.workunit.client.0.smithi112.stdout:3/571: rmdir d2/dc8 0 2024-09-21T00:56:48.276 INFO:tasks.workunit.client.1.smithi187.stdout:6/993: stat d7/d59/le9 0 2024-09-21T00:56:48.278 INFO:tasks.workunit.client.0.smithi112.stdout:3/572: creat d2/d8/dd/de/fca x:0 0 0 2024-09-21T00:56:48.279 INFO:tasks.workunit.client.1.smithi187.stdout:5/894: write d0/dc/daa/d67/d14/d1b/d27/d3a/ff9 [543258,43398] 0 2024-09-21T00:56:48.284 INFO:tasks.workunit.client.1.smithi187.stdout:7/917: symlink d1/dc/d15/d2b/l12f 0 2024-09-21T00:56:48.285 INFO:tasks.workunit.client.0.smithi112.stdout:3/573: creat d2/d8/dd/fcb x:0 0 0 2024-09-21T00:56:48.286 INFO:tasks.workunit.client.1.smithi187.stdout:5/895: mkdir d0/dc/daa/d67/d30/d68/d126 0 2024-09-21T00:56:48.287 INFO:tasks.workunit.client.1.smithi187.stdout:6/994: read d7/d59/d11d/d40/d50/fb0 [3703508,3772] 0 2024-09-21T00:56:48.288 INFO:tasks.workunit.client.0.smithi112.stdout:3/574: creat d2/d8/d28/d35/fcc x:0 0 0 2024-09-21T00:56:48.289 INFO:tasks.workunit.client.0.smithi112.stdout:3/575: dread - d2/d8/d28/d35/fcc zero size 2024-09-21T00:56:48.289 INFO:tasks.workunit.client.1.smithi187.stdout:3/930: rmdir d9/d7f/df5/d124 0 2024-09-21T00:56:48.290 INFO:tasks.workunit.client.0.smithi112.stdout:3/576: chown d2/d8/dd/f1f 3525219 1 2024-09-21T00:56:48.291 INFO:tasks.workunit.client.1.smithi187.stdout:6/995: creat d7/d59/d11d/d40/d45/df7/d141/f147 x:0 0 0 2024-09-21T00:56:48.292 INFO:tasks.workunit.client.0.smithi112.stdout:3/577: mknod d2/d38/d3f/d53/ccd 0 2024-09-21T00:56:48.292 INFO:tasks.workunit.client.0.smithi112.stdout:3/578: read d2/d38/d3f/f49 [3538292,45150] 0 2024-09-21T00:56:48.293 INFO:tasks.workunit.client.1.smithi187.stdout:3/931: creat d9/d7f/dcb/d87/d94/d53/d75/f137 x:0 0 0 2024-09-21T00:56:48.294 INFO:tasks.workunit.client.1.smithi187.stdout:7/918: creat d1/f130 x:0 0 0 2024-09-21T00:56:48.295 INFO:tasks.workunit.client.1.smithi187.stdout:3/932: stat d9/d7f/dcb/d87/d94/d53/d56/d61/cea 0 2024-09-21T00:56:48.296 INFO:tasks.workunit.client.0.smithi112.stdout:3/579: link d2/d8/d28/d9d/lbc d2/lce 0 2024-09-21T00:56:48.297 INFO:tasks.workunit.client.1.smithi187.stdout:7/919: mkdir d1/dce/dd4/d122/d131 0 2024-09-21T00:56:48.297 INFO:tasks.workunit.client.1.smithi187.stdout:6/996: dwrite d7/d59/d11d/d40/d6a/d9e/f126 [0,4194304] 0 2024-09-21T00:56:48.298 INFO:tasks.workunit.client.0.smithi112.stdout:3/580: mkdir d2/d38/d3f/d53/d96/dcf 0 2024-09-21T00:56:48.300 INFO:tasks.workunit.client.0.smithi112.stdout:3/581: dread d2/d8/d28/d35/d9e/fc4 [0,4194304] 0 2024-09-21T00:56:48.301 INFO:tasks.workunit.client.1.smithi187.stdout:7/920: rmdir d1/dce/dd4/d122 39 2024-09-21T00:56:48.301 INFO:tasks.workunit.client.0.smithi112.stdout:3/582: write d2/f58 [545321,105970] 0 2024-09-21T00:56:48.303 INFO:tasks.workunit.client.0.smithi112.stdout:3/583: chown d2/d8/dd/l7d 740 1 2024-09-21T00:56:48.308 INFO:tasks.workunit.client.1.smithi187.stdout:6/997: stat d7/d2a/d7a/l92 0 2024-09-21T00:56:48.308 INFO:tasks.workunit.client.0.smithi112.stdout:9/432: write d5/d6/d19/f28 [3732162,127216] 0 2024-09-21T00:56:48.309 INFO:tasks.workunit.client.1.smithi187.stdout:4/991: sync 2024-09-21T00:56:48.312 INFO:tasks.workunit.client.0.smithi112.stdout:9/433: creat d5/d6/d3f/d7f/f8a x:0 0 0 2024-09-21T00:56:48.317 INFO:tasks.workunit.client.0.smithi112.stdout:9/434: creat d5/d3b/d5f/d13/d54/d7d/d57/f8b x:0 0 0 2024-09-21T00:56:48.321 INFO:tasks.workunit.client.1.smithi187.stdout:3/933: dread d9/d7f/dcb/f1e [0,4194304] 0 2024-09-21T00:56:48.322 INFO:tasks.workunit.client.0.smithi112.stdout:9/435: fsync d5/d6/d3f/f4c 0 2024-09-21T00:56:48.323 INFO:tasks.workunit.client.0.smithi112.stdout:9/436: write d5/d6/d19/f77 [929974,95928] 0 2024-09-21T00:56:48.328 INFO:tasks.workunit.client.0.smithi112.stdout:9/437: mknod d5/d3b/d5f/d13/d56/c8c 0 2024-09-21T00:56:48.336 INFO:tasks.workunit.client.0.smithi112.stdout:3/584: dwrite d2/d8/dd/de/f18 [0,4194304] 0 2024-09-21T00:56:48.338 INFO:tasks.workunit.client.0.smithi112.stdout:3/585: chown d2/d8/dd/de/f18 240 1 2024-09-21T00:56:48.340 INFO:tasks.workunit.client.0.smithi112.stdout:9/438: dwrite d5/d3b/d5f/f3d [0,4194304] 0 2024-09-21T00:56:48.351 INFO:tasks.workunit.client.0.smithi112.stdout:9/439: mknod d5/d3b/d5f/d59/c8d 0 2024-09-21T00:56:48.352 INFO:tasks.workunit.client.0.smithi112.stdout:3/586: link d2/d8/dd/de/d5c/c62 d2/d8/dd/de/d6b/cd0 0 2024-09-21T00:56:48.355 INFO:tasks.workunit.client.0.smithi112.stdout:9/440: dread d5/d6/f5a [0,4194304] 0 2024-09-21T00:56:48.358 INFO:tasks.workunit.client.0.smithi112.stdout:3/587: rename d2/d8/fb8 to d2/d3e/d7b/fd1 0 2024-09-21T00:56:48.358 INFO:tasks.workunit.client.0.smithi112.stdout:3/588: dread - d2/d38/fb6 zero size 2024-09-21T00:56:48.362 INFO:tasks.workunit.client.0.smithi112.stdout:9/441: dread d5/d3b/d5f/d13/d54/d7d/f32 [0,4194304] 0 2024-09-21T00:56:48.363 INFO:tasks.workunit.client.0.smithi112.stdout:9/442: truncate d5/d3b/d5f/f81 651457 0 2024-09-21T00:56:48.364 INFO:tasks.workunit.client.0.smithi112.stdout:3/589: unlink d2/d38/f44 0 2024-09-21T00:56:48.367 INFO:tasks.workunit.client.0.smithi112.stdout:3/590: mknod d2/d38/d3f/d53/d96/cd2 0 2024-09-21T00:56:48.368 INFO:tasks.workunit.client.0.smithi112.stdout:9/443: mknod d5/d3b/d5f/c8e 0 2024-09-21T00:56:48.368 INFO:tasks.workunit.client.0.smithi112.stdout:3/591: write d2/d8/d28/dac/fc3 [229024,109948] 0 2024-09-21T00:56:48.371 INFO:tasks.workunit.client.0.smithi112.stdout:3/592: creat d2/d38/d3f/d53/fd3 x:0 0 0 2024-09-21T00:56:48.372 INFO:tasks.workunit.client.0.smithi112.stdout:3/593: write d2/d3e/f71 [916481,111440] 0 2024-09-21T00:56:48.373 INFO:tasks.workunit.client.0.smithi112.stdout:3/594: fsync d2/d8/d28/d35/fcc 0 2024-09-21T00:56:48.373 INFO:tasks.workunit.client.0.smithi112.stdout:9/444: unlink d5/d3b/d5f/f52 0 2024-09-21T00:56:48.374 INFO:tasks.workunit.client.0.smithi112.stdout:3/595: write d2/d8/dd/de/f8e [2452828,101823] 0 2024-09-21T00:56:48.375 INFO:tasks.workunit.client.0.smithi112.stdout:5/194: sync 2024-09-21T00:56:48.375 INFO:tasks.workunit.client.0.smithi112.stdout:6/320: sync 2024-09-21T00:56:48.376 INFO:tasks.workunit.client.0.smithi112.stdout:5/195: fdatasync d8/d9/d13/d2a/f3b 0 2024-09-21T00:56:48.377 INFO:tasks.workunit.client.0.smithi112.stdout:6/321: write d9/d13/d21/d4c/f78 [531577,124752] 0 2024-09-21T00:56:48.378 INFO:tasks.workunit.client.0.smithi112.stdout:6/322: read - d9/d13/d31/f68 zero size 2024-09-21T00:56:48.381 INFO:tasks.workunit.client.1.smithi187.stdout:4/992: chown d2/d3/cba 60520590 1 2024-09-21T00:56:48.381 INFO:tasks.workunit.client.1.smithi187.stdout:0/938: sync 2024-09-21T00:56:48.382 INFO:tasks.workunit.client.1.smithi187.stdout:7/921: rename d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/lf6 to d1/dce/dd0/d97/df1/d31/d33/d3b/d11f/l132 0 2024-09-21T00:56:48.383 INFO:tasks.workunit.client.1.smithi187.stdout:3/934: write d9/d7f/dcb/d87/d94/d53/d56/fd3 [2805137,106469] 0 2024-09-21T00:56:48.385 INFO:tasks.workunit.client.1.smithi187.stdout:4/993: mkdir d2/d3/da/d2f/d32/d24/dcd/db3/d135 0 2024-09-21T00:56:48.386 INFO:tasks.workunit.client.1.smithi187.stdout:4/994: chown d2/d3/da/d2f/d32/d22/f23 33628 1 2024-09-21T00:56:48.386 INFO:tasks.workunit.client.1.smithi187.stdout:3/935: symlink d9/d19/dca/l138 0 2024-09-21T00:56:48.388 INFO:tasks.workunit.client.1.smithi187.stdout:4/995: symlink d2/d3/d74/de2/l136 0 2024-09-21T00:56:48.390 INFO:tasks.workunit.client.1.smithi187.stdout:3/936: creat d9/d7f/dcb/dd0/f139 x:0 0 0 2024-09-21T00:56:48.405 INFO:tasks.workunit.client.1.smithi187.stdout:4/996: creat d2/d3/da/d16/dc9/f137 x:0 0 0 2024-09-21T00:56:48.406 INFO:tasks.workunit.client.1.smithi187.stdout:4/997: chown d2/d3/da/d2f 42186 1 2024-09-21T00:56:48.407 INFO:tasks.workunit.client.1.smithi187.stdout:0/939: dread d0/d17/d18/d90/d98/fcd [4194304,4194304] 0 2024-09-21T00:56:48.408 INFO:tasks.workunit.client.1.smithi187.stdout:3/937: mkdir d9/dcc/d105/d11b/d129/d13a 0 2024-09-21T00:56:48.411 INFO:tasks.workunit.client.1.smithi187.stdout:6/998: dwrite d7/d59/d11d/f3c [0,4194304] 0 2024-09-21T00:56:48.412 INFO:tasks.workunit.client.1.smithi187.stdout:3/938: truncate d9/d7f/dcb/d9c/fe7 477892 0 2024-09-21T00:56:48.413 INFO:tasks.workunit.client.1.smithi187.stdout:6/999: read d7/d59/d11d/d40/d50/d83/dfd/f101 [175331,62778] 0 2024-09-21T00:56:48.415 INFO:tasks.workunit.client.1.smithi187.stdout:3/939: symlink d9/dcc/d105/d11b/d129/l13b 0 2024-09-21T00:56:48.415 INFO:tasks.workunit.client.1.smithi187.stdout:3/940: readlink d9/d7f/dcb/d87/d94/d53/d56/d61/lb4 0 2024-09-21T00:56:48.419 INFO:tasks.workunit.client.1.smithi187.stdout:3/941: creat d9/d7f/dcb/f13c x:0 0 0 2024-09-21T00:56:48.420 INFO:tasks.workunit.client.1.smithi187.stdout:0/940: dwrite d0/d17/d18/d90/d98/ff0 [0,4194304] 0 2024-09-21T00:56:48.423 INFO:tasks.workunit.client.1.smithi187.stdout:3/942: rmdir d9/d7f/dcb/d87/d94/d53/d56 39 2024-09-21T00:56:48.425 INFO:tasks.workunit.client.1.smithi187.stdout:0/941: dread d0/d17/d18/d3a/d97/d112/d65/fb6 [0,4194304] 0 2024-09-21T00:56:48.428 INFO:tasks.workunit.client.1.smithi187.stdout:0/942: mkdir d0/d17/d18/d3a/d97/dcc/d143 0 2024-09-21T00:56:48.440 INFO:tasks.workunit.client.1.smithi187.stdout:5/896: sync 2024-09-21T00:56:48.443 INFO:tasks.workunit.client.1.smithi187.stdout:3/943: dwrite d9/dcc/d105/d11b/f5e [0,4194304] 0 2024-09-21T00:56:48.444 INFO:tasks.workunit.client.1.smithi187.stdout:4/998: dread d2/d3/da/d2f/d32/d22/f49 [0,4194304] 0 2024-09-21T00:56:48.444 INFO:tasks.workunit.client.1.smithi187.stdout:3/944: stat d9/d7f/dcb/d20/c6c 0 2024-09-21T00:56:48.447 INFO:tasks.workunit.client.1.smithi187.stdout:4/999: write d2/d3/d56/d84/d60/d6c/d77/ffd [606958,9057] 0 2024-09-21T00:56:48.447 INFO:tasks.workunit.client.1.smithi187.stdout:3/945: mkdir d9/d7f/dcb/d87/d94/dd1/d13d 0 2024-09-21T00:56:48.448 INFO:tasks.workunit.client.1.smithi187.stdout:5/897: write d0/dc/daa/d67/d14/d1b/d27/f35 [4947104,9245] 0 2024-09-21T00:56:48.450 INFO:tasks.workunit.client.1.smithi187.stdout:5/898: write d0/dc/d1f/d26/f71 [2792671,51671] 0 2024-09-21T00:56:48.451 INFO:tasks.workunit.client.1.smithi187.stdout:5/899: chown d0/dc/daa/d67/d14/d57 186073043 1 2024-09-21T00:56:48.451 INFO:tasks.workunit.client.1.smithi187.stdout:3/946: mknod d9/d7f/dcb/dd0/c13e 0 2024-09-21T00:56:48.455 INFO:tasks.workunit.client.1.smithi187.stdout:0/943: dread d0/d60/d6e/f74 [4194304,4194304] 0 2024-09-21T00:56:48.456 INFO:tasks.workunit.client.1.smithi187.stdout:0/944: readlink d0/d17/d18/d3a/d97/d112/d23/d108/l11c 0 2024-09-21T00:56:48.457 INFO:tasks.workunit.client.1.smithi187.stdout:7/922: sync 2024-09-21T00:56:48.459 INFO:tasks.workunit.client.1.smithi187.stdout:0/945: symlink d0/d17/d18/l144 0 2024-09-21T00:56:48.459 INFO:tasks.workunit.client.1.smithi187.stdout:0/946: readlink d0/d17/lb8 0 2024-09-21T00:56:48.463 INFO:tasks.workunit.client.0.smithi112.stdout:5/196: dwrite d8/d9/d13/d1c/f3c [0,4194304] 0 2024-09-21T00:56:48.465 INFO:tasks.workunit.client.1.smithi187.stdout:7/923: rename d1/dce/dd4/d122/d131 to d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/d133 0 2024-09-21T00:56:48.465 INFO:tasks.workunit.client.0.smithi112.stdout:9/445: dwrite d5/d3b/d5f/d13/d54/d7d/f40 [4194304,4194304] 0 2024-09-21T00:56:48.465 INFO:tasks.workunit.client.1.smithi187.stdout:5/900: write d0/dc/d1f/d26/f64 [5045702,33958] 0 2024-09-21T00:56:48.466 INFO:tasks.workunit.client.0.smithi112.stdout:6/323: dwrite d9/d13/d31/f68 [0,4194304] 0 2024-09-21T00:56:48.466 INFO:tasks.workunit.client.1.smithi187.stdout:0/947: creat d0/d60/d11f/f145 x:0 0 0 2024-09-21T00:56:48.467 INFO:tasks.workunit.client.1.smithi187.stdout:7/924: chown d1/dc/d15/d2b/c3c 0 1 2024-09-21T00:56:48.468 INFO:tasks.workunit.client.1.smithi187.stdout:3/947: truncate d9/f11 754467 0 2024-09-21T00:56:48.468 INFO:tasks.workunit.client.0.smithi112.stdout:6/324: chown d9/df/f27 143195237 1 2024-09-21T00:56:48.475 INFO:tasks.workunit.client.1.smithi187.stdout:5/901: creat d0/dc/d1f/df4/f127 x:0 0 0 2024-09-21T00:56:48.475 INFO:tasks.workunit.client.1.smithi187.stdout:0/948: creat d0/d17/d18/d3a/d97/dcc/f146 x:0 0 0 2024-09-21T00:56:48.475 INFO:tasks.workunit.client.1.smithi187.stdout:3/948: readlink d9/d19/l49 0 2024-09-21T00:56:48.477 INFO:tasks.workunit.client.0.smithi112.stdout:3/596: dread d2/d8/dd/de/f1c [0,4194304] 0 2024-09-21T00:56:48.477 INFO:tasks.workunit.client.1.smithi187.stdout:7/925: unlink d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/lfc 0 2024-09-21T00:56:48.478 INFO:tasks.workunit.client.0.smithi112.stdout:3/597: dread d2/d38/f91 [0,4194304] 0 2024-09-21T00:56:48.479 INFO:tasks.workunit.client.1.smithi187.stdout:5/902: symlink d0/dc/daa/d67/dcc/l128 0 2024-09-21T00:56:48.480 INFO:tasks.workunit.client.0.smithi112.stdout:5/197: getdents d8/d9/d13/d2a/d2c 0 2024-09-21T00:56:48.481 INFO:tasks.workunit.client.0.smithi112.stdout:6/325: rename d9/df/d4b to d9/df/d7a 0 2024-09-21T00:56:48.482 INFO:tasks.workunit.client.0.smithi112.stdout:3/598: mknod d2/d8/d28/d35/cd4 0 2024-09-21T00:56:48.484 INFO:tasks.workunit.client.1.smithi187.stdout:0/949: dwrite d0/d17/d18/f110 [0,4194304] 0 2024-09-21T00:56:48.484 INFO:tasks.workunit.client.1.smithi187.stdout:3/949: dwrite d9/d7f/dcb/d87/d94/f45 [0,4194304] 0 2024-09-21T00:56:48.485 INFO:tasks.workunit.client.0.smithi112.stdout:6/326: fsync d9/d1f/d3e/d77/f6e 0 2024-09-21T00:56:48.486 INFO:tasks.workunit.client.0.smithi112.stdout:6/327: truncate d9/d13/f17 853109 0 2024-09-21T00:56:48.488 INFO:tasks.workunit.client.0.smithi112.stdout:5/198: creat d8/f3f x:0 0 0 2024-09-21T00:56:48.490 INFO:tasks.workunit.client.1.smithi187.stdout:0/950: truncate d0/d17/d18/d3a/d97/dcc/f103 202273 0 2024-09-21T00:56:48.491 INFO:tasks.workunit.client.1.smithi187.stdout:7/926: link d1/dce/dd0/d97/df1/f29 d1/f134 0 2024-09-21T00:56:48.491 INFO:tasks.workunit.client.1.smithi187.stdout:5/903: dwrite d0/dc/daa/d67/d14/d38/f4f [8388608,4194304] 0 2024-09-21T00:56:48.492 INFO:tasks.workunit.client.1.smithi187.stdout:0/951: chown d0/d17/d18/f110 13518 1 2024-09-21T00:56:48.494 INFO:tasks.workunit.client.0.smithi112.stdout:6/328: rename d9/d1f/d47/f42 to d9/df/d7a/f7b 0 2024-09-21T00:56:48.497 INFO:tasks.workunit.client.0.smithi112.stdout:5/199: mkdir d8/d9/d40 0 2024-09-21T00:56:48.497 INFO:tasks.workunit.client.1.smithi187.stdout:5/904: chown d0/c11c 114918 1 2024-09-21T00:56:48.500 INFO:tasks.workunit.client.1.smithi187.stdout:7/927: symlink d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/dea/l135 0 2024-09-21T00:56:48.504 INFO:tasks.workunit.client.1.smithi187.stdout:3/950: dwrite d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/fa8 [0,4194304] 0 2024-09-21T00:56:48.504 INFO:tasks.workunit.client.1.smithi187.stdout:7/928: chown d1/dce/dd0/d97/df1/d31/d41/d8a 1427651 1 2024-09-21T00:56:48.504 INFO:tasks.workunit.client.1.smithi187.stdout:5/905: rmdir d0/dc/daa/d67/d14/d38/d5a 39 2024-09-21T00:56:48.506 INFO:tasks.workunit.client.1.smithi187.stdout:5/906: chown d0/dc/d1f/df4 1 1 2024-09-21T00:56:48.507 INFO:tasks.workunit.client.1.smithi187.stdout:7/929: chown d1/c4b 12735 1 2024-09-21T00:56:48.507 INFO:tasks.workunit.client.1.smithi187.stdout:0/952: dwrite d0/d17/d18/d3a/d97/d112/d23/df/d41/f4a [4194304,4194304] 0 2024-09-21T00:56:48.512 INFO:tasks.workunit.client.1.smithi187.stdout:5/907: fdatasync d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9/fff 0 2024-09-21T00:56:48.512 INFO:tasks.workunit.client.1.smithi187.stdout:7/930: creat d1/d55/dd7/f136 x:0 0 0 2024-09-21T00:56:48.512 INFO:tasks.workunit.client.0.smithi112.stdout:9/446: truncate d5/d3b/d5f/d13/d54/d7d/f40 4123209 0 2024-09-21T00:56:48.513 INFO:tasks.workunit.client.1.smithi187.stdout:0/953: dread - d0/d17/d18/d3a/d97/d112/ff3 zero size 2024-09-21T00:56:48.513 INFO:tasks.workunit.client.0.smithi112.stdout:9/447: read - d5/d6/d19/f80 zero size 2024-09-21T00:56:48.513 INFO:tasks.workunit.client.1.smithi187.stdout:5/908: stat d0/dc/daa/d67/d30/c93 0 2024-09-21T00:56:48.515 INFO:tasks.workunit.client.1.smithi187.stdout:5/909: write d0/dc/daa/d67/d14/d57/d5c/f112 [653044,11868] 0 2024-09-21T00:56:48.517 INFO:tasks.workunit.client.1.smithi187.stdout:5/910: write d0/dc/daa/d67/d14/d38/d5a/d6c/fe4 [4607291,11012] 0 2024-09-21T00:56:48.518 INFO:tasks.workunit.client.1.smithi187.stdout:7/931: mkdir d1/dce/dd0/d97/df1/d31/d41/d64/d93/d137 0 2024-09-21T00:56:48.519 INFO:tasks.workunit.client.1.smithi187.stdout:0/954: rmdir d0/d60/d6b/d9f/de6 39 2024-09-21T00:56:48.521 INFO:tasks.workunit.client.0.smithi112.stdout:9/448: unlink d5/d3b/c4f 0 2024-09-21T00:56:48.524 INFO:tasks.workunit.client.1.smithi187.stdout:7/932: dwrite d1/dce/dd4/f12b [0,4194304] 0 2024-09-21T00:56:48.525 INFO:tasks.workunit.client.0.smithi112.stdout:3/599: dwrite d2/d8/dd/de/d6b/f72 [4194304,4194304] 0 2024-09-21T00:56:48.526 INFO:tasks.workunit.client.0.smithi112.stdout:3/600: chown d2/d8/dd/l92 112874 1 2024-09-21T00:56:48.528 INFO:tasks.workunit.client.1.smithi187.stdout:5/911: dread d0/dc/faf [0,4194304] 0 2024-09-21T00:56:48.534 INFO:tasks.workunit.client.1.smithi187.stdout:7/933: mknod d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/c138 0 2024-09-21T00:56:48.535 INFO:tasks.workunit.client.0.smithi112.stdout:3/601: creat d2/d8/d6d/fd5 x:0 0 0 2024-09-21T00:56:48.537 INFO:tasks.workunit.client.0.smithi112.stdout:5/200: truncate f7 728668 0 2024-09-21T00:56:48.541 INFO:tasks.workunit.client.1.smithi187.stdout:7/934: fsync d1/dce/dd0/d97/df1/fb4 0 2024-09-21T00:56:48.543 INFO:tasks.workunit.client.1.smithi187.stdout:0/955: link d0/d17/d18/d3a/d97/d112/d23/df/d41/l62 d0/d17/d18/d90/d98/ddd/l147 0 2024-09-21T00:56:48.545 INFO:tasks.workunit.client.1.smithi187.stdout:3/951: dwrite d9/d7f/dcb/d87/d94/f90 [0,4194304] 0 2024-09-21T00:56:48.546 INFO:tasks.workunit.client.0.smithi112.stdout:6/329: dwrite d9/df/d19/f5d [0,4194304] 0 2024-09-21T00:56:48.546 INFO:tasks.workunit.client.0.smithi112.stdout:3/602: dread d2/d8/dd/f27 [0,4194304] 0 2024-09-21T00:56:48.549 INFO:tasks.workunit.client.0.smithi112.stdout:9/449: getdents d5/d6/d19 0 2024-09-21T00:56:48.549 INFO:tasks.workunit.client.0.smithi112.stdout:4/393: sync 2024-09-21T00:56:48.551 INFO:tasks.workunit.client.0.smithi112.stdout:4/394: write d1/d5/d1c/f5b [1669057,5766] 0 2024-09-21T00:56:48.552 INFO:tasks.workunit.client.0.smithi112.stdout:4/395: write d1/d7/d9/d1a/f78 [658702,58022] 0 2024-09-21T00:56:48.553 INFO:tasks.workunit.client.1.smithi187.stdout:7/935: mknod d1/dce/dd0/d97/df1/c139 0 2024-09-21T00:56:48.558 INFO:tasks.workunit.client.0.smithi112.stdout:9/450: dwrite d5/d3b/d5f/d13/d54/d7d/d57/d6a/f6b [0,4194304] 0 2024-09-21T00:56:48.558 INFO:tasks.workunit.client.0.smithi112.stdout:5/201: truncate d8/f1a 435993 0 2024-09-21T00:56:48.561 INFO:tasks.workunit.client.0.smithi112.stdout:3/603: creat d2/d38/d3f/d53/fd6 x:0 0 0 2024-09-21T00:56:48.563 INFO:tasks.workunit.client.0.smithi112.stdout:3/604: dread - d2/d8/dd/de/d4a/fbd zero size 2024-09-21T00:56:48.563 INFO:tasks.workunit.client.0.smithi112.stdout:6/330: mknod d9/d13/d21/d4c/d70/c7c 0 2024-09-21T00:56:48.564 INFO:tasks.workunit.client.0.smithi112.stdout:4/396: symlink d1/d5/d1c/d1e/d76/l85 0 2024-09-21T00:56:48.565 INFO:tasks.workunit.client.0.smithi112.stdout:9/451: dwrite d5/f14 [0,4194304] 0 2024-09-21T00:56:48.566 INFO:tasks.workunit.client.1.smithi187.stdout:3/952: dread f2 [0,4194304] 0 2024-09-21T00:56:48.566 INFO:tasks.workunit.client.0.smithi112.stdout:3/605: write d2/d8/dd/de/d4a/d4c/fa0 [508665,22723] 0 2024-09-21T00:56:48.567 INFO:tasks.workunit.client.0.smithi112.stdout:5/202: getdents d8 0 2024-09-21T00:56:48.567 INFO:tasks.workunit.client.0.smithi112.stdout:3/606: stat d2 0 2024-09-21T00:56:48.568 INFO:tasks.workunit.client.0.smithi112.stdout:6/331: write d9/d13/f17 [1601290,92874] 0 2024-09-21T00:56:48.570 INFO:tasks.workunit.client.0.smithi112.stdout:3/607: write d2/d8/d28/f2c [5226665,91440] 0 2024-09-21T00:56:48.571 INFO:tasks.workunit.client.0.smithi112.stdout:5/203: creat d8/d9/d40/f41 x:0 0 0 2024-09-21T00:56:48.571 INFO:tasks.workunit.client.1.smithi187.stdout:3/953: dread d9/d7f/dcb/d87/fb8 [0,4194304] 0 2024-09-21T00:56:48.573 INFO:tasks.workunit.client.1.smithi187.stdout:3/954: creat d9/dcc/f13f x:0 0 0 2024-09-21T00:56:48.575 INFO:tasks.workunit.client.1.smithi187.stdout:3/955: rmdir d9/d19/dca/dd6 39 2024-09-21T00:56:48.578 INFO:tasks.workunit.client.1.smithi187.stdout:3/956: getdents d9/d19/dca/dd6/df0 0 2024-09-21T00:56:48.580 INFO:tasks.workunit.client.1.smithi187.stdout:3/957: mknod d9/d19/da7/daa/dce/c140 0 2024-09-21T00:56:48.580 INFO:tasks.workunit.client.1.smithi187.stdout:3/958: dread - d9/dcc/f13f zero size 2024-09-21T00:56:48.584 INFO:tasks.workunit.client.1.smithi187.stdout:3/959: dwrite d9/f37 [4194304,4194304] 0 2024-09-21T00:56:48.596 INFO:tasks.workunit.client.0.smithi112.stdout:5/204: rmdir d8/d9/d13/d1c 39 2024-09-21T00:56:48.597 INFO:tasks.workunit.client.0.smithi112.stdout:5/205: truncate d8/f30 823417 0 2024-09-21T00:56:48.598 INFO:tasks.workunit.client.0.smithi112.stdout:5/206: dread - d8/d9/d13/d2a/f3b zero size 2024-09-21T00:56:48.599 INFO:tasks.workunit.client.0.smithi112.stdout:3/608: unlink d2/d3e/l98 0 2024-09-21T00:56:48.623 INFO:tasks.workunit.client.1.smithi187.stdout:7/936: dwrite d1/dc/d15/d22/f24 [0,4194304] 0 2024-09-21T00:56:48.628 INFO:tasks.workunit.client.0.smithi112.stdout:3/609: dread d2/d8/dd/f10 [0,4194304] 0 2024-09-21T00:56:48.667 INFO:tasks.workunit.client.1.smithi187.stdout:0/956: sync 2024-09-21T00:56:48.667 INFO:tasks.workunit.client.1.smithi187.stdout:5/912: sync 2024-09-21T00:56:48.674 INFO:tasks.workunit.client.0.smithi112.stdout:3/610: mkdir d2/d8/dd/de/d5c/dd7 0 2024-09-21T00:56:48.676 INFO:tasks.workunit.client.0.smithi112.stdout:3/611: write d2/d33/d78/f7f [661311,43036] 0 2024-09-21T00:56:48.678 INFO:tasks.workunit.client.1.smithi187.stdout:0/957: dread d0/d17/d18/d3a/d97/d112/d23/df/f53 [0,4194304] 0 2024-09-21T00:56:48.682 INFO:tasks.workunit.client.0.smithi112.stdout:3/612: write d2/d8/dd/f89 [779935,80504] 0 2024-09-21T00:56:48.683 INFO:tasks.workunit.client.0.smithi112.stdout:4/397: write d1/d7/f28 [4008293,96940] 0 2024-09-21T00:56:48.683 INFO:tasks.workunit.client.1.smithi187.stdout:5/913: getdents d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9 0 2024-09-21T00:56:48.685 INFO:tasks.workunit.client.1.smithi187.stdout:0/958: dwrite d0/d17/d18/d90/d98/ddd/ffd [0,4194304] 0 2024-09-21T00:56:48.685 INFO:tasks.workunit.client.0.smithi112.stdout:4/398: read d1/d2d/f55 [2478823,102754] 0 2024-09-21T00:56:48.715 INFO:tasks.workunit.client.1.smithi187.stdout:3/960: sync 2024-09-21T00:56:48.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/312: sync 2024-09-21T00:56:48.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/332: write d9/d1f/d3e/d77/f2a [378606,94597] 0 2024-09-21T00:56:48.799 INFO:tasks.workunit.client.1.smithi187.stdout:0/959: mkdir d0/d5a/d148 0 2024-09-21T00:56:48.801 INFO:tasks.workunit.client.0.smithi112.stdout:5/207: write d8/fa [2878014,28182] 0 2024-09-21T00:56:48.802 INFO:tasks.workunit.client.1.smithi187.stdout:3/961: dread d9/fd [0,4194304] 0 2024-09-21T00:56:48.805 INFO:tasks.workunit.client.1.smithi187.stdout:5/914: fsync d0/dc/d1f/f41 0 2024-09-21T00:56:48.809 INFO:tasks.workunit.client.1.smithi187.stdout:3/962: dwrite d9/d7f/dcb/dd0/f139 [0,4194304] 0 2024-09-21T00:56:48.815 INFO:tasks.workunit.client.0.smithi112.stdout:8/313: mknod d0/d13/d1b/d22/d42/c5c 0 2024-09-21T00:56:48.818 INFO:tasks.workunit.client.0.smithi112.stdout:5/208: rename f5 to d8/d9/d40/f42 0 2024-09-21T00:56:48.829 INFO:tasks.workunit.client.1.smithi187.stdout:5/915: link d0/dc/d1f/d26/d8b/fdb d0/dc/d1f/d26/f129 0 2024-09-21T00:56:48.834 INFO:tasks.workunit.client.0.smithi112.stdout:8/314: mknod d0/d13/d1b/d22/d2e/d3d/c5d 0 2024-09-21T00:56:48.835 INFO:tasks.workunit.client.0.smithi112.stdout:8/315: truncate d0/d13/d1b/f30 5030606 0 2024-09-21T00:56:48.835 INFO:tasks.workunit.client.0.smithi112.stdout:5/209: mknod d8/c43 0 2024-09-21T00:56:48.836 INFO:tasks.workunit.client.0.smithi112.stdout:8/316: chown d0/d13/d1b/d22/d2e/d3d/c54 13 1 2024-09-21T00:56:48.841 INFO:tasks.workunit.client.0.smithi112.stdout:8/317: unlink d0/c12 0 2024-09-21T00:56:48.841 INFO:tasks.workunit.client.0.smithi112.stdout:8/318: fsync d0/f26 0 2024-09-21T00:56:48.843 INFO:tasks.workunit.client.0.smithi112.stdout:8/319: unlink d0/l1 0 2024-09-21T00:56:48.843 INFO:tasks.workunit.client.0.smithi112.stdout:8/320: chown d0/d13/l17 503 1 2024-09-21T00:56:48.844 INFO:tasks.workunit.client.0.smithi112.stdout:8/321: chown d0/cc 3364075 1 2024-09-21T00:56:48.868 INFO:tasks.workunit.client.1.smithi187.stdout:7/937: write d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/fdb [770589,62182] 0 2024-09-21T00:56:48.871 INFO:tasks.workunit.client.1.smithi187.stdout:7/938: mknod d1/dc/d15/d2b/d12a/c13a 0 2024-09-21T00:56:48.874 INFO:tasks.workunit.client.0.smithi112.stdout:3/613: link d2/d3e/c68 d2/d38/d3f/cd8 0 2024-09-21T00:56:48.875 INFO:tasks.workunit.client.0.smithi112.stdout:3/614: write d2/d8/d28/d9d/fc0 [199803,40489] 0 2024-09-21T00:56:48.875 INFO:tasks.workunit.client.1.smithi187.stdout:7/939: unlink d1/dce/dd4/d122/c126 0 2024-09-21T00:56:48.876 INFO:tasks.workunit.client.0.smithi112.stdout:3/615: fsync d2/d3e/fbe 0 2024-09-21T00:56:48.877 INFO:tasks.workunit.client.0.smithi112.stdout:3/616: fdatasync d2/d38/d3f/fa9 0 2024-09-21T00:56:48.884 INFO:tasks.workunit.client.0.smithi112.stdout:3/617: dwrite d2/d8/d28/fab [0,4194304] 0 2024-09-21T00:56:48.889 INFO:tasks.workunit.client.0.smithi112.stdout:3/618: creat d2/d38/d3f/d53/d96/fd9 x:0 0 0 2024-09-21T00:56:48.889 INFO:tasks.workunit.client.0.smithi112.stdout:3/619: fsync d2/f58 0 2024-09-21T00:56:48.889 INFO:tasks.workunit.client.1.smithi187.stdout:0/960: write d0/d17/d18/d90/fa8 [1469305,21068] 0 2024-09-21T00:56:48.891 INFO:tasks.workunit.client.0.smithi112.stdout:4/399: truncate d1/d7/d9/d1a/f78 957007 0 2024-09-21T00:56:48.892 INFO:tasks.workunit.client.0.smithi112.stdout:3/620: dread - d2/d8/dd/fcb zero size 2024-09-21T00:56:48.892 INFO:tasks.workunit.client.0.smithi112.stdout:3/621: read - d2/d8/d28/f90 zero size 2024-09-21T00:56:48.893 INFO:tasks.workunit.client.1.smithi187.stdout:0/961: creat d0/dc2/f149 x:0 0 0 2024-09-21T00:56:48.894 INFO:tasks.workunit.client.1.smithi187.stdout:0/962: chown d0/dcf/c135 0 1 2024-09-21T00:56:48.895 INFO:tasks.workunit.client.1.smithi187.stdout:0/963: dread - d0/d5a/f115 zero size 2024-09-21T00:56:48.896 INFO:tasks.workunit.client.0.smithi112.stdout:4/400: symlink d1/l86 0 2024-09-21T00:56:48.897 INFO:tasks.workunit.client.0.smithi112.stdout:4/401: chown d1/d7/d9/d1a/l70 1 1 2024-09-21T00:56:48.900 INFO:tasks.workunit.client.1.smithi187.stdout:0/964: unlink d0/d17/d18/d3a/c86 0 2024-09-21T00:56:48.901 INFO:tasks.workunit.client.1.smithi187.stdout:0/965: fsync d0/d17/d18/f8a 0 2024-09-21T00:56:48.901 INFO:tasks.workunit.client.0.smithi112.stdout:4/402: symlink d1/d7/d30/l87 0 2024-09-21T00:56:48.905 INFO:tasks.workunit.client.1.smithi187.stdout:0/966: dread d0/d17/d18/d90/d98/ddd/ffd [0,4194304] 0 2024-09-21T00:56:48.906 INFO:tasks.workunit.client.1.smithi187.stdout:0/967: chown d0/d17/d18/d3a/d97/dcc/f141 0 1 2024-09-21T00:56:48.909 INFO:tasks.workunit.client.0.smithi112.stdout:4/403: link d1/d7/c59 d1/d7/d9/d1a/d22/d6e/c88 0 2024-09-21T00:56:48.911 INFO:tasks.workunit.client.0.smithi112.stdout:4/404: symlink d1/d2d/l89 0 2024-09-21T00:56:48.913 INFO:tasks.workunit.client.1.smithi187.stdout:3/963: dwrite d9/d7f/dcb/d20/f2e [0,4194304] 0 2024-09-21T00:56:48.915 INFO:tasks.workunit.client.0.smithi112.stdout:6/333: truncate d9/d1f/d3e/d77/d23/f76 689621 0 2024-09-21T00:56:48.915 INFO:tasks.workunit.client.0.smithi112.stdout:4/405: dread d1/d5/d1c/f65 [0,4194304] 0 2024-09-21T00:56:48.916 INFO:tasks.workunit.client.1.smithi187.stdout:3/964: read d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/faf [3309357,80258] 0 2024-09-21T00:56:48.924 INFO:tasks.workunit.client.0.smithi112.stdout:5/210: unlink d8/d9/d13/f35 0 2024-09-21T00:56:48.927 INFO:tasks.workunit.client.0.smithi112.stdout:5/211: dread - d8/f24 zero size 2024-09-21T00:56:48.927 INFO:tasks.workunit.client.0.smithi112.stdout:4/406: dread d1/f46 [0,4194304] 0 2024-09-21T00:56:48.928 INFO:tasks.workunit.client.0.smithi112.stdout:5/212: dread - d8/d9/d13/d2a/f3b zero size 2024-09-21T00:56:48.930 INFO:tasks.workunit.client.0.smithi112.stdout:4/407: mknod d1/d75/c8a 0 2024-09-21T00:56:48.932 INFO:tasks.workunit.client.0.smithi112.stdout:4/408: truncate d1/d5/d1c/d1e/d4a/f7d 4380017 0 2024-09-21T00:56:48.938 INFO:tasks.workunit.client.0.smithi112.stdout:6/334: rmdir d9/d1f/d47 39 2024-09-21T00:56:48.939 INFO:tasks.workunit.client.0.smithi112.stdout:6/335: fsync d9/d13/d21/d4c/f78 0 2024-09-21T00:56:48.944 INFO:tasks.workunit.client.1.smithi187.stdout:5/916: sync 2024-09-21T00:56:48.945 INFO:tasks.workunit.client.1.smithi187.stdout:5/917: rmdir d0/dc/daa/d67/d14/d38 39 2024-09-21T00:56:48.948 INFO:tasks.workunit.client.0.smithi112.stdout:4/409: dread d1/d7/f28 [0,4194304] 0 2024-09-21T00:56:48.953 INFO:tasks.workunit.client.1.smithi187.stdout:7/940: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/ff0 2417786 0 2024-09-21T00:56:48.959 INFO:tasks.workunit.client.1.smithi187.stdout:7/941: dwrite d1/dce/dd0/d97/df1/d31/d41/d8a/dd5/f10a [0,4194304] 0 2024-09-21T00:56:48.960 INFO:tasks.workunit.client.1.smithi187.stdout:0/968: truncate d0/d17/d18/d3a/d97/d112/d23/df/d41/fe1 852716 0 2024-09-21T00:56:48.963 INFO:tasks.workunit.client.1.smithi187.stdout:3/965: truncate d9/d7f/dcb/f48 698389 0 2024-09-21T00:56:48.963 INFO:tasks.workunit.client.1.smithi187.stdout:0/969: rmdir d0/d17/d18/d90/d98 39 2024-09-21T00:56:48.964 INFO:tasks.workunit.client.1.smithi187.stdout:3/966: write d9/d7f/dcb/d9c/fe7 [234463,73110] 0 2024-09-21T00:56:48.965 INFO:tasks.workunit.client.1.smithi187.stdout:3/967: chown d9/d19/ffe 213592920 1 2024-09-21T00:56:48.968 INFO:tasks.workunit.client.1.smithi187.stdout:0/970: mknod d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/c14a 0 2024-09-21T00:56:48.972 INFO:tasks.workunit.client.0.smithi112.stdout:5/213: dwrite d8/d9/d13/d2a/f26 [0,4194304] 0 2024-09-21T00:56:48.976 INFO:tasks.workunit.client.1.smithi187.stdout:0/971: dwrite d0/d17/d18/d3a/d114/d100/f129 [0,4194304] 0 2024-09-21T00:56:48.977 INFO:tasks.workunit.client.1.smithi187.stdout:5/918: dwrite d0/dc/daa/d67/d30/f34 [0,4194304] 0 2024-09-21T00:56:48.978 INFO:tasks.workunit.client.0.smithi112.stdout:6/336: dwrite d9/d1f/d3e/d77/f37 [0,4194304] 0 2024-09-21T00:56:48.979 INFO:tasks.workunit.client.0.smithi112.stdout:6/337: chown d9/f12 46294897 1 2024-09-21T00:56:48.979 INFO:tasks.workunit.client.0.smithi112.stdout:5/214: unlink d8/d9/l3d 0 2024-09-21T00:56:48.980 INFO:tasks.workunit.client.1.smithi187.stdout:0/972: chown d0/d17/d18/d3a/d97/d112/d23/d36/c5f 5891493 1 2024-09-21T00:56:48.981 INFO:tasks.workunit.client.0.smithi112.stdout:4/410: dwrite d1/d5/d1c/d1e/f20 [0,4194304] 0 2024-09-21T00:56:48.985 INFO:tasks.workunit.client.0.smithi112.stdout:5/215: write d8/d9/d13/d2a/f38 [699199,126028] 0 2024-09-21T00:56:48.985 INFO:tasks.workunit.client.1.smithi187.stdout:0/973: symlink d0/d17/d18/d90/dd1/l14b 0 2024-09-21T00:56:48.987 INFO:tasks.workunit.client.1.smithi187.stdout:7/942: dread d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/f88 [0,4194304] 0 2024-09-21T00:56:48.991 INFO:tasks.workunit.client.0.smithi112.stdout:6/338: creat d9/df/d56/f7d x:0 0 0 2024-09-21T00:56:48.992 INFO:tasks.workunit.client.1.smithi187.stdout:3/968: dread d9/d7f/dcb/d20/f3c [0,4194304] 0 2024-09-21T00:56:48.993 INFO:tasks.workunit.client.1.smithi187.stdout:3/969: fsync d9/d7f/dcb/d87/d94/fe5 0 2024-09-21T00:56:48.993 INFO:tasks.workunit.client.0.smithi112.stdout:5/216: mknod d8/d9/d13/d2a/d2c/c44 0 2024-09-21T00:56:48.995 INFO:tasks.workunit.client.1.smithi187.stdout:3/970: truncate d9/d19/dca/dd6/f10b 234405 0 2024-09-21T00:56:48.997 INFO:tasks.workunit.client.1.smithi187.stdout:5/919: rename d0/dc/daa/c96 to d0/dc/d39/c12a 0 2024-09-21T00:56:48.997 INFO:tasks.workunit.client.0.smithi112.stdout:6/339: creat d9/d1f/d3e/f7e x:0 0 0 2024-09-21T00:56:49.000 INFO:tasks.workunit.client.1.smithi187.stdout:0/974: unlink d0/d60/d6b/d9f/de6/c11b 0 2024-09-21T00:56:49.001 INFO:tasks.workunit.client.0.smithi112.stdout:6/340: symlink d9/d13/d21/d4c/d70/l7f 0 2024-09-21T00:56:49.003 INFO:tasks.workunit.client.1.smithi187.stdout:3/971: unlink d9/d7f/dcb/d87/d94/d53/d56/d7d/d81/d9d/cb2 0 2024-09-21T00:56:49.003 INFO:tasks.workunit.client.0.smithi112.stdout:5/217: mkdir d8/d9/d13/d1c/d45 0 2024-09-21T00:56:49.003 INFO:tasks.workunit.client.1.smithi187.stdout:5/920: dread - d0/dc/daa/d67/d14/d1b/d27/fa7 zero size 2024-09-21T00:56:49.004 INFO:tasks.workunit.client.1.smithi187.stdout:0/975: rmdir d0/d17/d18/d3a/d97/d112/ded 39 2024-09-21T00:56:49.005 INFO:tasks.workunit.client.0.smithi112.stdout:5/218: fdatasync d8/d9/d13/d2a/f18 0 2024-09-21T00:56:49.005 INFO:tasks.workunit.client.1.smithi187.stdout:5/921: chown d0/dc/daa/d67/f50 3114 1 2024-09-21T00:56:49.010 INFO:tasks.workunit.client.0.smithi112.stdout:5/219: symlink d8/d9/d40/l46 0 2024-09-21T00:56:49.012 INFO:tasks.workunit.client.0.smithi112.stdout:6/341: link d9/df/d19/f64 d9/d1f/d3e/d77/d45/f80 0 2024-09-21T00:56:49.013 INFO:tasks.workunit.client.1.smithi187.stdout:5/922: mkdir d0/dc/daa/d67/dcc/d12b 0 2024-09-21T00:56:49.014 INFO:tasks.workunit.client.0.smithi112.stdout:5/220: dread d8/d9/d13/d2a/f26 [0,4194304] 0 2024-09-21T00:56:49.016 INFO:tasks.workunit.client.1.smithi187.stdout:0/976: rename d0/d17/d18/d3a/d97/d112/f71 to d0/d17/d18/d90/d98/ddd/f14c 0 2024-09-21T00:56:49.018 INFO:tasks.workunit.client.1.smithi187.stdout:5/923: mkdir d0/dc/daa/d67/dcc/de5/df3/d12c 0 2024-09-21T00:56:49.018 INFO:tasks.workunit.client.0.smithi112.stdout:5/221: symlink d8/d9/d13/d2a/d2c/l47 0 2024-09-21T00:56:49.019 INFO:tasks.workunit.client.0.smithi112.stdout:5/222: stat d8/d9/d13/d2a/l19 0 2024-09-21T00:56:49.020 INFO:tasks.workunit.client.1.smithi187.stdout:7/943: dread d1/f9 [0,4194304] 0 2024-09-21T00:56:49.021 INFO:tasks.workunit.client.1.smithi187.stdout:5/924: mknod d0/dc/daa/c12d 0 2024-09-21T00:56:49.021 INFO:tasks.workunit.client.0.smithi112.stdout:6/342: link d9/df/d56/d33/f3c d9/d1f/f81 0 2024-09-21T00:56:49.024 INFO:tasks.workunit.client.1.smithi187.stdout:7/944: write d1/dce/dd0/d97/df1/d31/f36 [2559934,30946] 0 2024-09-21T00:56:49.024 INFO:tasks.workunit.client.1.smithi187.stdout:0/977: getdents d0/d60 0 2024-09-21T00:56:49.025 INFO:tasks.workunit.client.0.smithi112.stdout:6/343: symlink d9/df/d7a/l82 0 2024-09-21T00:56:49.026 INFO:tasks.workunit.client.0.smithi112.stdout:7/411: sync 2024-09-21T00:56:49.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/223: creat d8/d9/d13/f48 x:0 0 0 2024-09-21T00:56:49.028 INFO:tasks.workunit.client.0.smithi112.stdout:7/412: write d0/d2/d36/d39/d1a/f4d [743413,107002] 0 2024-09-21T00:56:49.028 INFO:tasks.workunit.client.0.smithi112.stdout:6/344: getdents d9/d1f/d3e/d77/d45/d62 0 2024-09-21T00:56:49.028 INFO:tasks.workunit.client.0.smithi112.stdout:5/224: read d8/d9/f27 [134918,34258] 0 2024-09-21T00:56:49.030 INFO:tasks.workunit.client.0.smithi112.stdout:4/411: truncate d1/d7/d9/f61 6651313 0 2024-09-21T00:56:49.031 INFO:tasks.workunit.client.1.smithi187.stdout:5/925: dwrite d0/dc/daa/d67/d30/d6b/d8e/f116 [0,4194304] 0 2024-09-21T00:56:49.034 INFO:tasks.workunit.client.1.smithi187.stdout:7/945: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/fb3 [0,4194304] 0 2024-09-21T00:56:49.035 INFO:tasks.workunit.client.1.smithi187.stdout:3/972: dread d9/d7f/dcb/d87/d94/d53/d56/d61/ded/d100/f102 [0,4194304] 0 2024-09-21T00:56:49.036 INFO:tasks.workunit.client.1.smithi187.stdout:0/978: creat d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/f14d x:0 0 0 2024-09-21T00:56:49.038 INFO:tasks.workunit.client.1.smithi187.stdout:5/926: rmdir d0/dc/daa/d67/d14/d1b/d27 39 2024-09-21T00:56:49.040 INFO:tasks.workunit.client.0.smithi112.stdout:6/345: dread - d9/d1f/d3e/f54 zero size 2024-09-21T00:56:49.041 INFO:tasks.workunit.client.1.smithi187.stdout:3/973: rmdir d9/d7f/dcb/d20 39 2024-09-21T00:56:49.044 INFO:tasks.workunit.client.1.smithi187.stdout:7/946: mkdir d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d13b 0 2024-09-21T00:56:49.045 INFO:tasks.workunit.client.1.smithi187.stdout:7/947: chown d1/dce/dd0/d97/df1/d31/d33/d3b/d62/ffb 0 1 2024-09-21T00:56:49.049 INFO:tasks.workunit.client.0.smithi112.stdout:6/346: rmdir d9/d1f 39 2024-09-21T00:56:49.059 INFO:tasks.workunit.client.0.smithi112.stdout:6/347: mknod d9/d13/d26/c83 0 2024-09-21T00:56:49.061 INFO:tasks.workunit.client.0.smithi112.stdout:7/413: getdents d0/d2/d38 0 2024-09-21T00:56:49.062 INFO:tasks.workunit.client.0.smithi112.stdout:7/414: write d0/d2/d2e/f5f [801348,32357] 0 2024-09-21T00:56:49.064 INFO:tasks.workunit.client.1.smithi187.stdout:7/948: rmdir d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/dba 0 2024-09-21T00:56:49.066 INFO:tasks.workunit.client.0.smithi112.stdout:7/415: rename d0/d79 to d0/d2/d36/d39/d56/d86 0 2024-09-21T00:56:49.066 INFO:tasks.workunit.client.0.smithi112.stdout:4/412: write d1/d5/d1c/d1e/d4a/f7e [584259,8471] 0 2024-09-21T00:56:49.067 INFO:tasks.workunit.client.0.smithi112.stdout:7/416: dread - d0/d6e/f81 zero size 2024-09-21T00:56:49.068 INFO:tasks.workunit.client.1.smithi187.stdout:3/974: dread f3 [0,4194304] 0 2024-09-21T00:56:49.068 INFO:tasks.workunit.client.1.smithi187.stdout:7/949: mkdir d1/dce/dd0/d97/df1/d31/d41/d64/d13c 0 2024-09-21T00:56:49.069 INFO:tasks.workunit.client.0.smithi112.stdout:7/417: write d0/d2/d2e/f5f [1072045,27078] 0 2024-09-21T00:56:49.069 INFO:tasks.workunit.client.0.smithi112.stdout:5/225: truncate d8/d9/d13/d2a/f38 216115 0 2024-09-21T00:56:49.070 INFO:tasks.workunit.client.0.smithi112.stdout:5/226: stat d8/d9/d40/f42 0 2024-09-21T00:56:49.071 INFO:tasks.workunit.client.1.smithi187.stdout:5/927: dwrite d0/dc/daa/d67/d30/f3c [4194304,4194304] 0 2024-09-21T00:56:49.072 INFO:tasks.workunit.client.0.smithi112.stdout:5/227: mkdir d8/d9/d13/d2a/d2c/d49 0 2024-09-21T00:56:49.073 INFO:tasks.workunit.client.1.smithi187.stdout:0/979: dwrite d0/d60/d11f/f125 [0,4194304] 0 2024-09-21T00:56:49.075 INFO:tasks.workunit.client.1.smithi187.stdout:7/950: dread d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/fc3 [0,4194304] 0 2024-09-21T00:56:49.075 INFO:tasks.workunit.client.1.smithi187.stdout:0/980: dread - d0/d17/d18/d3a/d97/dcc/f141 zero size 2024-09-21T00:56:49.076 INFO:tasks.workunit.client.0.smithi112.stdout:6/348: dread d9/f12 [0,4194304] 0 2024-09-21T00:56:49.078 INFO:tasks.workunit.client.1.smithi187.stdout:3/975: truncate d9/f11 884929 0 2024-09-21T00:56:49.082 INFO:tasks.workunit.client.1.smithi187.stdout:0/981: symlink d0/d17/d18/d90/dd1/l14e 0 2024-09-21T00:56:49.084 INFO:tasks.workunit.client.0.smithi112.stdout:6/349: mkdir d9/d13/d21/d84 0 2024-09-21T00:56:49.086 INFO:tasks.workunit.client.0.smithi112.stdout:7/418: dread d0/f46 [0,4194304] 0 2024-09-21T00:56:49.087 INFO:tasks.workunit.client.1.smithi187.stdout:3/976: stat d9/lc5 0 2024-09-21T00:56:49.088 INFO:tasks.workunit.client.1.smithi187.stdout:3/977: stat d9/d7f/dcb/d87/d94/dd1/d13d 0 2024-09-21T00:56:49.088 INFO:tasks.workunit.client.1.smithi187.stdout:3/978: chown d9/d7f/dcb/d87/d94/d89/c8d 132 1 2024-09-21T00:56:49.089 INFO:tasks.workunit.client.1.smithi187.stdout:0/982: chown d0/d17/d18/d90/d98/ddd/f14c 6 1 2024-09-21T00:56:49.091 INFO:tasks.workunit.client.1.smithi187.stdout:3/979: rmdir d9/d7f/dcb/d87/d94/d89/dc1 39 2024-09-21T00:56:49.091 INFO:tasks.workunit.client.1.smithi187.stdout:3/980: readlink d9/d7f/dcb/d87/d94/l134 0 2024-09-21T00:56:49.092 INFO:tasks.workunit.client.1.smithi187.stdout:0/983: creat d0/d17/d18/d3a/d114/f14f x:0 0 0 2024-09-21T00:56:49.093 INFO:tasks.workunit.client.0.smithi112.stdout:5/228: dread d8/d9/d13/f2d [0,4194304] 0 2024-09-21T00:56:49.094 INFO:tasks.workunit.client.1.smithi187.stdout:7/951: write d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f10f [73423,53606] 0 2024-09-21T00:56:49.094 INFO:tasks.workunit.client.1.smithi187.stdout:0/984: symlink d0/d60/d6e/l150 0 2024-09-21T00:56:49.095 INFO:tasks.workunit.client.0.smithi112.stdout:5/229: chown d8/d9 1341308 1 2024-09-21T00:56:49.095 INFO:tasks.workunit.client.0.smithi112.stdout:7/419: dwrite d0/d2/d38/d48/f53 [4194304,4194304] 0 2024-09-21T00:56:49.097 INFO:tasks.workunit.client.1.smithi187.stdout:7/952: rmdir d1/dce/dd0/d97 39 2024-09-21T00:56:49.097 INFO:tasks.workunit.client.0.smithi112.stdout:6/350: dwrite d9/df/d7a/f7b [0,4194304] 0 2024-09-21T00:56:49.098 INFO:tasks.workunit.client.1.smithi187.stdout:3/981: symlink d9/d7f/dcb/d87/d94/d53/d56/d61/ded/d100/l141 0 2024-09-21T00:56:49.099 INFO:tasks.workunit.client.1.smithi187.stdout:5/928: dread d0/dc/daa/f6e [0,4194304] 0 2024-09-21T00:56:49.099 INFO:tasks.workunit.client.1.smithi187.stdout:0/985: dread d0/d17/d18/d3a/d114/d100/f129 [0,4194304] 0 2024-09-21T00:56:49.099 INFO:tasks.workunit.client.1.smithi187.stdout:3/982: write d9/fb7 [2617913,17843] 0 2024-09-21T00:56:49.103 INFO:tasks.workunit.client.1.smithi187.stdout:7/953: fdatasync d1/dce/dd0/d97/df1/d31/d41/dbe/f11e 0 2024-09-21T00:56:49.104 INFO:tasks.workunit.client.0.smithi112.stdout:5/230: mknod d8/d9/d13/d2a/d2c/c4a 0 2024-09-21T00:56:49.107 INFO:tasks.workunit.client.1.smithi187.stdout:0/986: dwrite d0/d17/d18/d90/d98/ddd/f113 [0,4194304] 0 2024-09-21T00:56:49.107 INFO:tasks.workunit.client.0.smithi112.stdout:7/420: dwrite d0/d2/d36/d39/d1a/f66 [0,4194304] 0 2024-09-21T00:56:49.110 INFO:tasks.workunit.client.1.smithi187.stdout:3/983: rmdir d9/d7f/dcb/d87/d94 39 2024-09-21T00:56:49.110 INFO:tasks.workunit.client.1.smithi187.stdout:3/984: fsync d9/f4e 0 2024-09-21T00:56:49.112 INFO:tasks.workunit.client.1.smithi187.stdout:5/929: unlink d0/dc/daa/d67/d14/d1b/d27/d3a/l54 0 2024-09-21T00:56:49.114 INFO:tasks.workunit.client.0.smithi112.stdout:6/351: read d9/d1f/d47/d34/f36 [1095794,128365] 0 2024-09-21T00:56:49.115 INFO:tasks.workunit.client.0.smithi112.stdout:5/231: creat d8/f4b x:0 0 0 2024-09-21T00:56:49.116 INFO:tasks.workunit.client.1.smithi187.stdout:0/987: mknod d0/d17/d18/d3a/d97/dcc/c151 0 2024-09-21T00:56:49.117 INFO:tasks.workunit.client.0.smithi112.stdout:7/421: mkdir d0/d2/d36/d39/d56/d65/d87 0 2024-09-21T00:56:49.118 INFO:tasks.workunit.client.0.smithi112.stdout:7/422: chown d0/f67 2654 1 2024-09-21T00:56:49.119 INFO:tasks.workunit.client.0.smithi112.stdout:7/423: write d0/d2/f31 [1555049,26998] 0 2024-09-21T00:56:49.121 INFO:tasks.workunit.client.1.smithi187.stdout:7/954: dwrite d1/dce/dd0/d97/df1/d31/d41/d8a/d100/f10d [0,4194304] 0 2024-09-21T00:56:49.121 INFO:tasks.workunit.client.1.smithi187.stdout:5/930: unlink d0/dc/d1f/f124 0 2024-09-21T00:56:49.122 INFO:tasks.workunit.client.0.smithi112.stdout:6/352: rmdir d9/d13/d26 39 2024-09-21T00:56:49.125 INFO:tasks.workunit.client.1.smithi187.stdout:0/988: symlink d0/d17/d18/df8/l152 0 2024-09-21T00:56:49.127 INFO:tasks.workunit.client.1.smithi187.stdout:3/985: mkdir d9/d7f/dcb/d87/d94/dd1/d142 0 2024-09-21T00:56:49.128 INFO:tasks.workunit.client.1.smithi187.stdout:3/986: fsync d9/d19/d9b/fcf 0 2024-09-21T00:56:49.129 INFO:tasks.workunit.client.1.smithi187.stdout:3/987: dread - d9/d7f/dcb/d87/d94/fe5 zero size 2024-09-21T00:56:49.130 INFO:tasks.workunit.client.0.smithi112.stdout:7/424: rename d0/f7d to d0/d2/d32/f88 0 2024-09-21T00:56:49.131 INFO:tasks.workunit.client.0.smithi112.stdout:7/425: chown d0/d2/d32/l63 1 1 2024-09-21T00:56:49.132 INFO:tasks.workunit.client.0.smithi112.stdout:7/426: read d0/f22 [413653,74650] 0 2024-09-21T00:56:49.133 INFO:tasks.workunit.client.0.smithi112.stdout:6/353: dread d9/df/d19/f49 [0,4194304] 0 2024-09-21T00:56:49.135 INFO:tasks.workunit.client.1.smithi187.stdout:0/989: creat d0/f153 x:0 0 0 2024-09-21T00:56:49.137 INFO:tasks.workunit.client.0.smithi112.stdout:6/354: fdatasync d9/d1f/d3e/f54 0 2024-09-21T00:56:49.140 INFO:tasks.workunit.client.0.smithi112.stdout:6/355: unlink d9/l10 0 2024-09-21T00:56:49.142 INFO:tasks.workunit.client.0.smithi112.stdout:5/232: rename d8/ld to d8/d9/l4c 0 2024-09-21T00:56:49.145 INFO:tasks.workunit.client.0.smithi112.stdout:6/356: mkdir d9/d1f/d3e/d77/d79/d85 0 2024-09-21T00:56:49.146 INFO:tasks.workunit.client.0.smithi112.stdout:5/233: mkdir d8/d4d 0 2024-09-21T00:56:49.147 INFO:tasks.workunit.client.1.smithi187.stdout:5/931: dread d0/f20 [0,4194304] 0 2024-09-21T00:56:49.150 INFO:tasks.workunit.client.0.smithi112.stdout:5/234: symlink d8/d9/d13/d2a/d2c/l4e 0 2024-09-21T00:56:49.150 INFO:tasks.workunit.client.1.smithi187.stdout:5/932: stat d0/dc/daa/d67/d14/d1b/f24 0 2024-09-21T00:56:49.152 INFO:tasks.workunit.client.0.smithi112.stdout:5/235: write d8/d9/f28 [668699,104773] 0 2024-09-21T00:56:49.154 INFO:tasks.workunit.client.1.smithi187.stdout:7/955: dread d1/dc/fb2 [0,4194304] 0 2024-09-21T00:56:49.156 INFO:tasks.workunit.client.0.smithi112.stdout:5/236: mkdir d8/d9/d13/d1c/d45/d4f 0 2024-09-21T00:56:49.157 INFO:tasks.workunit.client.1.smithi187.stdout:5/933: dwrite d0/f3f [0,4194304] 0 2024-09-21T00:56:49.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:48 smithi187 ceph-mon[34997]: pgmap v27: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-09-21T00:56:49.160 INFO:tasks.workunit.client.1.smithi187.stdout:5/934: read d0/f75 [3705,21514] 0 2024-09-21T00:56:49.161 INFO:tasks.workunit.client.0.smithi112.stdout:5/237: dread d8/d9/f28 [0,4194304] 0 2024-09-21T00:56:49.162 INFO:tasks.workunit.client.0.smithi112.stdout:7/427: dread d0/d2/d32/f5b [0,4194304] 0 2024-09-21T00:56:49.163 INFO:tasks.workunit.client.1.smithi187.stdout:7/956: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/f94 1176194 0 2024-09-21T00:56:49.164 INFO:tasks.workunit.client.1.smithi187.stdout:0/990: dwrite d0/d17/d18/d3a/d97/d112/d23/df/ff2 [0,4194304] 0 2024-09-21T00:56:49.166 INFO:tasks.workunit.client.1.smithi187.stdout:5/935: creat d0/dc/daa/d67/f12e x:0 0 0 2024-09-21T00:56:49.167 INFO:tasks.workunit.client.0.smithi112.stdout:6/357: dwrite d9/fc [0,4194304] 0 2024-09-21T00:56:49.168 INFO:tasks.workunit.client.1.smithi187.stdout:7/957: dread d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/ff3 [0,4194304] 0 2024-09-21T00:56:49.170 INFO:tasks.workunit.client.1.smithi187.stdout:5/936: creat d0/dc/daa/d67/d14/d57/d5c/db2/f12f x:0 0 0 2024-09-21T00:56:49.172 INFO:tasks.workunit.client.1.smithi187.stdout:5/937: readlink d0/dc/daa/d67/dcc/l128 0 2024-09-21T00:56:49.172 INFO:tasks.workunit.client.1.smithi187.stdout:7/958: mknod d1/dc/d15/d2b/d12a/c13d 0 2024-09-21T00:56:49.173 INFO:tasks.workunit.client.0.smithi112.stdout:6/358: rmdir d9/d13/d21/d4c/d70 39 2024-09-21T00:56:49.174 INFO:tasks.workunit.client.0.smithi112.stdout:7/428: dwrite d0/d2/d36/d39/d56/d65/d75/f84 [0,4194304] 0 2024-09-21T00:56:49.175 INFO:tasks.workunit.client.0.smithi112.stdout:5/238: dwrite d8/d9/d13/d1c/f3c [0,4194304] 0 2024-09-21T00:56:49.177 INFO:tasks.workunit.client.1.smithi187.stdout:0/991: creat d0/d17/d18/d3a/d97/d112/d23/df/d51/f154 x:0 0 0 2024-09-21T00:56:49.179 INFO:tasks.workunit.client.1.smithi187.stdout:7/959: rename d1/dc/d15/cec to d1/dce/dd0/d97/df1/c13e 0 2024-09-21T00:56:49.180 INFO:tasks.workunit.client.0.smithi112.stdout:7/429: rmdir d0/d2 39 2024-09-21T00:56:49.184 INFO:tasks.workunit.client.1.smithi187.stdout:0/992: mkdir d0/d17/d155 0 2024-09-21T00:56:49.184 INFO:tasks.workunit.client.0.smithi112.stdout:6/359: getdents d9/d13/d21/d84 0 2024-09-21T00:56:49.189 INFO:tasks.workunit.client.0.smithi112.stdout:6/360: unlink d9/d1f/d3e/d77/f6e 0 2024-09-21T00:56:49.190 INFO:tasks.workunit.client.0.smithi112.stdout:5/239: link d8/d9/d13/d2a/df/f10 d8/d9/d40/f50 0 2024-09-21T00:56:49.192 INFO:tasks.workunit.client.1.smithi187.stdout:0/993: dwrite d0/d60/d6b/f8d [0,4194304] 0 2024-09-21T00:56:49.193 INFO:tasks.workunit.client.0.smithi112.stdout:6/361: mknod d9/d1f/d47/c86 0 2024-09-21T00:56:49.197 INFO:tasks.workunit.client.1.smithi187.stdout:0/994: mknod d0/d60/d6b/d9f/c156 0 2024-09-21T00:56:49.198 INFO:tasks.workunit.client.0.smithi112.stdout:5/240: creat d8/d9/d13/f51 x:0 0 0 2024-09-21T00:56:49.199 INFO:tasks.workunit.client.1.smithi187.stdout:0/995: unlink d0/d17/f12f 0 2024-09-21T00:56:49.200 INFO:tasks.workunit.client.0.smithi112.stdout:5/241: symlink d8/d9/d13/d2a/l52 0 2024-09-21T00:56:49.200 INFO:tasks.workunit.client.1.smithi187.stdout:0/996: chown d0/d60/d6b/d9f/lbc 784573069 1 2024-09-21T00:56:49.201 INFO:tasks.workunit.client.1.smithi187.stdout:0/997: stat d0/d17/d18/d3a/d97/d112/d23/df/d51/f154 0 2024-09-21T00:56:49.202 INFO:tasks.workunit.client.0.smithi112.stdout:5/242: write d8/fa [3692097,59372] 0 2024-09-21T00:56:49.202 INFO:tasks.workunit.client.1.smithi187.stdout:0/998: stat d0/d17/d18/d3a/d97/d112/d23/df/d41/d3b/c72 0 2024-09-21T00:56:49.204 INFO:tasks.workunit.client.0.smithi112.stdout:5/243: fdatasync d8/d9/d13/d2a/f38 0 2024-09-21T00:56:49.205 INFO:tasks.workunit.client.0.smithi112.stdout:5/244: chown d8/d9/d40/f42 4144 1 2024-09-21T00:56:49.206 INFO:tasks.workunit.client.1.smithi187.stdout:0/999: creat d0/d17/d18/d3a/d114/f157 x:0 0 0 2024-09-21T00:56:49.207 INFO:tasks.workunit.client.0.smithi112.stdout:5/245: creat d8/d9/d13/d1c/f53 x:0 0 0 2024-09-21T00:56:49.209 INFO:tasks.workunit.client.0.smithi112.stdout:5/246: unlink d8/d9/d13/d2a/l2e 0 2024-09-21T00:56:49.210 INFO:tasks.workunit.client.0.smithi112.stdout:5/247: rmdir d8/d9 39 2024-09-21T00:56:49.211 INFO:tasks.workunit.client.0.smithi112.stdout:5/248: dread - d8/f3f zero size 2024-09-21T00:56:49.215 INFO:tasks.workunit.client.0.smithi112.stdout:7/430: dread d0/d2/d36/d39/d1a/f44 [0,4194304] 0 2024-09-21T00:56:49.217 INFO:tasks.workunit.client.0.smithi112.stdout:7/431: symlink d0/d2/d36/d39/d56/d65/d87/l89 0 2024-09-21T00:56:49.218 INFO:tasks.workunit.client.0.smithi112.stdout:7/432: write d0/d2/d32/f54 [1387969,124378] 0 2024-09-21T00:56:49.219 INFO:tasks.workunit.client.0.smithi112.stdout:7/433: fsync d0/d2/d36/f49 0 2024-09-21T00:56:49.220 INFO:tasks.workunit.client.1.smithi187.stdout:5/938: dwrite d0/f75 [0,4194304] 0 2024-09-21T00:56:49.224 INFO:tasks.workunit.client.1.smithi187.stdout:5/939: fsync d0/dc/daa/d67/d14/fda 0 2024-09-21T00:56:49.227 INFO:tasks.workunit.client.0.smithi112.stdout:6/362: dwrite d9/d1f/d47/d34/f63 [0,4194304] 0 2024-09-21T00:56:49.227 INFO:tasks.workunit.client.0.smithi112.stdout:7/434: dread d0/d2/d36/d39/d56/d65/d75/f84 [0,4194304] 0 2024-09-21T00:56:49.229 INFO:tasks.workunit.client.0.smithi112.stdout:6/363: chown d9/d1f/d3e/d77/d23/f48 0 1 2024-09-21T00:56:49.231 INFO:tasks.workunit.client.1.smithi187.stdout:5/940: symlink d0/dc/daa/d67/d14/l130 0 2024-09-21T00:56:49.234 INFO:tasks.workunit.client.0.smithi112.stdout:5/249: dread d8/d9/d13/d2a/df/f10 [0,4194304] 0 2024-09-21T00:56:49.236 INFO:tasks.workunit.client.0.smithi112.stdout:7/435: link d0/d2/d36/l60 d0/d2/d38/d48/l8a 0 2024-09-21T00:56:49.237 INFO:tasks.workunit.client.0.smithi112.stdout:7/436: fdatasync d0/d2/d32/f54 0 2024-09-21T00:56:49.237 INFO:tasks.workunit.client.1.smithi187.stdout:5/941: symlink d0/dc/daa/d67/d30/d68/d126/l131 0 2024-09-21T00:56:49.238 INFO:tasks.workunit.client.0.smithi112.stdout:5/250: creat d8/d9/d13/d1c/f54 x:0 0 0 2024-09-21T00:56:49.240 INFO:tasks.workunit.client.0.smithi112.stdout:6/364: getdents d9/d1f/d3e/d77/d46 0 2024-09-21T00:56:49.244 INFO:tasks.workunit.client.1.smithi187.stdout:5/942: link d0/dc/daa/d67/d14/l37 d0/dc/daa/d67/d14/d1b/d27/l132 0 2024-09-21T00:56:49.244 INFO:tasks.workunit.client.0.smithi112.stdout:1/293: sync 2024-09-21T00:56:49.245 INFO:tasks.workunit.client.0.smithi112.stdout:6/365: mkdir d9/d87 0 2024-09-21T00:56:49.246 INFO:tasks.workunit.client.0.smithi112.stdout:7/437: dwrite d0/d6e/f81 [0,4194304] 0 2024-09-21T00:56:49.248 INFO:tasks.workunit.client.0.smithi112.stdout:1/294: truncate d5/d8/d13/d3e/d46/f57 1187295 0 2024-09-21T00:56:49.249 INFO:tasks.workunit.client.0.smithi112.stdout:7/438: creat d0/d2/d2e/f8b x:0 0 0 2024-09-21T00:56:49.251 INFO:tasks.workunit.client.0.smithi112.stdout:7/439: truncate d0/d2/f31 1988319 0 2024-09-21T00:56:49.254 INFO:tasks.workunit.client.0.smithi112.stdout:7/440: mknod d0/d2/d36/d39/d1a/c8c 0 2024-09-21T00:56:49.254 INFO:tasks.workunit.client.1.smithi187.stdout:5/943: link d0/dc/d1f/d26/c78 d0/dc/daa/d67/d14/d57/d5c/c133 0 2024-09-21T00:56:49.257 INFO:tasks.workunit.client.1.smithi187.stdout:5/944: mkdir d0/dc/dbe/d134 0 2024-09-21T00:56:49.257 INFO:tasks.workunit.client.1.smithi187.stdout:5/945: fsync d0/dc/daa/d67/d14/f10a 0 2024-09-21T00:56:49.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:48 smithi112 ceph-mon[28078]: pgmap v27: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-09-21T00:56:49.263 INFO:tasks.workunit.client.0.smithi112.stdout:1/295: write d5/d8/d10/d2e/f44 [1161598,63522] 0 2024-09-21T00:56:49.266 INFO:tasks.workunit.client.0.smithi112.stdout:7/441: truncate d0/d2/d36/f45 6632425 0 2024-09-21T00:56:49.267 INFO:tasks.workunit.client.0.smithi112.stdout:1/296: symlink d5/d8/l62 0 2024-09-21T00:56:49.268 INFO:tasks.workunit.client.0.smithi112.stdout:5/251: dwrite d8/d9/d40/f50 [0,4194304] 0 2024-09-21T00:56:49.269 INFO:tasks.workunit.client.0.smithi112.stdout:5/252: write d8/d9/d40/f41 [322432,43207] 0 2024-09-21T00:56:49.271 INFO:tasks.workunit.client.0.smithi112.stdout:7/442: chown d0/d2/d36/d39/d1a/d23/l3e 0 1 2024-09-21T00:56:49.272 INFO:tasks.workunit.client.0.smithi112.stdout:5/253: rmdir d8/d9 39 2024-09-21T00:56:49.272 INFO:tasks.workunit.client.0.smithi112.stdout:7/443: stat d0/d2/d32/f88 0 2024-09-21T00:56:49.272 INFO:tasks.workunit.client.0.smithi112.stdout:6/366: dread d9/df/d7a/f55 [0,4194304] 0 2024-09-21T00:56:49.274 INFO:tasks.workunit.client.0.smithi112.stdout:7/444: symlink d0/d2/d38/l8d 0 2024-09-21T00:56:49.274 INFO:tasks.workunit.client.0.smithi112.stdout:5/254: truncate d8/d9/d13/f51 607838 0 2024-09-21T00:56:49.275 INFO:tasks.workunit.client.0.smithi112.stdout:7/445: write d0/f22 [2413593,49066] 0 2024-09-21T00:56:49.277 INFO:tasks.workunit.client.0.smithi112.stdout:6/367: rename d9/df/l2c to d9/d13/d31/l88 0 2024-09-21T00:56:49.278 INFO:tasks.workunit.client.0.smithi112.stdout:5/255: creat d8/d9/d40/f55 x:0 0 0 2024-09-21T00:56:49.280 INFO:tasks.workunit.client.0.smithi112.stdout:6/368: symlink d9/d13/d21/d4c/l89 0 2024-09-21T00:56:49.283 INFO:tasks.workunit.client.0.smithi112.stdout:5/256: rmdir d8/d9/d13/d1c/d45/d4f 0 2024-09-21T00:56:49.284 INFO:tasks.workunit.client.0.smithi112.stdout:3/622: sync 2024-09-21T00:56:49.284 INFO:tasks.workunit.client.0.smithi112.stdout:0/353: sync 2024-09-21T00:56:49.284 INFO:tasks.workunit.client.0.smithi112.stdout:2/359: sync 2024-09-21T00:56:49.284 INFO:tasks.workunit.client.0.smithi112.stdout:8/322: sync 2024-09-21T00:56:49.284 INFO:tasks.workunit.client.0.smithi112.stdout:9/452: sync 2024-09-21T00:56:49.285 INFO:tasks.workunit.client.0.smithi112.stdout:4/413: sync 2024-09-21T00:56:49.285 INFO:tasks.workunit.client.0.smithi112.stdout:5/257: symlink d8/d9/d13/d2a/d2c/l56 0 2024-09-21T00:56:49.286 INFO:tasks.workunit.client.0.smithi112.stdout:9/453: write d5/d3b/d5f/d13/d54/f74 [722670,36835] 0 2024-09-21T00:56:49.291 INFO:tasks.workunit.client.0.smithi112.stdout:4/414: rename d1/d5/d1c/l63 to d1/d75/l8b 0 2024-09-21T00:56:49.292 INFO:tasks.workunit.client.0.smithi112.stdout:2/360: mknod d0/d14/c75 0 2024-09-21T00:56:49.295 INFO:tasks.workunit.client.0.smithi112.stdout:2/361: fdatasync d0/df/d46/d58/f6e 0 2024-09-21T00:56:49.295 INFO:tasks.workunit.client.0.smithi112.stdout:9/454: mkdir d5/d6/d19/d51/d8f 0 2024-09-21T00:56:49.296 INFO:tasks.workunit.client.0.smithi112.stdout:4/415: truncate d1/d5/d1c/d1e/d3d/f80 618250 0 2024-09-21T00:56:49.297 INFO:tasks.workunit.client.0.smithi112.stdout:6/369: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:49.298 INFO:tasks.workunit.client.0.smithi112.stdout:5/258: mkdir d8/d9/d57 0 2024-09-21T00:56:49.299 INFO:tasks.workunit.client.0.smithi112.stdout:5/259: stat d8/f4b 0 2024-09-21T00:56:49.299 INFO:tasks.workunit.client.0.smithi112.stdout:2/362: write d0/d51/f56 [1241749,54843] 0 2024-09-21T00:56:49.303 INFO:tasks.workunit.client.0.smithi112.stdout:7/446: rename d0/d2/d38/d48/f53 to d0/d2/d36/d39/d56/d65/d75/f8e 0 2024-09-21T00:56:49.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/363: truncate d0/df/d46/f68 392678 0 2024-09-21T00:56:49.304 INFO:tasks.workunit.client.0.smithi112.stdout:8/323: creat d0/d13/d2a/f5e x:0 0 0 2024-09-21T00:56:49.307 INFO:tasks.workunit.client.0.smithi112.stdout:4/416: symlink d1/d5/d1c/d1e/d3d/l8c 0 2024-09-21T00:56:49.308 INFO:tasks.workunit.client.0.smithi112.stdout:4/417: chown d1/d2d/l67 290 1 2024-09-21T00:56:49.308 INFO:tasks.workunit.client.0.smithi112.stdout:2/364: dread d0/d51/d62/f65 [0,4194304] 0 2024-09-21T00:56:49.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/455: creat d5/d3b/d5f/d13/d54/f90 x:0 0 0 2024-09-21T00:56:49.310 INFO:tasks.workunit.client.0.smithi112.stdout:0/354: dread d8/d11/d28/f43 [0,4194304] 0 2024-09-21T00:56:49.311 INFO:tasks.workunit.client.0.smithi112.stdout:5/260: mkdir d8/d9/d13/d2a/d58 0 2024-09-21T00:56:49.311 INFO:tasks.workunit.client.0.smithi112.stdout:0/355: stat d8/d11/d28/d54/f57 0 2024-09-21T00:56:49.312 INFO:tasks.workunit.client.0.smithi112.stdout:9/456: write d5/d3b/d5f/f81 [418495,37062] 0 2024-09-21T00:56:49.314 INFO:tasks.workunit.client.0.smithi112.stdout:9/457: stat d5/d3b/d5f/d13/d54/d7d/f40 0 2024-09-21T00:56:49.316 INFO:tasks.workunit.client.0.smithi112.stdout:9/458: write d5/f16 [1324171,64074] 0 2024-09-21T00:56:49.317 INFO:tasks.workunit.client.0.smithi112.stdout:2/365: mknod d0/d14/d47/c76 0 2024-09-21T00:56:49.318 INFO:tasks.workunit.client.0.smithi112.stdout:2/366: chown d0/d14/d8/c6a 272333 1 2024-09-21T00:56:49.320 INFO:tasks.workunit.client.0.smithi112.stdout:0/356: dwrite d8/d1b/d2c/f30 [0,4194304] 0 2024-09-21T00:56:49.322 INFO:tasks.workunit.client.1.smithi187.stdout:3/988: sync 2024-09-21T00:56:49.323 INFO:tasks.workunit.client.0.smithi112.stdout:5/261: dread - d8/f24 zero size 2024-09-21T00:56:49.326 INFO:tasks.workunit.client.0.smithi112.stdout:4/418: rename d1/d7/d9/d1a/l33 to d1/d5/d1c/d1e/d3d/l8d 0 2024-09-21T00:56:49.328 INFO:tasks.workunit.client.0.smithi112.stdout:7/447: symlink d0/l8f 0 2024-09-21T00:56:49.333 INFO:tasks.workunit.client.0.smithi112.stdout:9/459: rmdir d5/d3b/d5f 39 2024-09-21T00:56:49.336 INFO:tasks.workunit.client.0.smithi112.stdout:0/357: rename d8/d1b/l29 to d8/d1b/l66 0 2024-09-21T00:56:49.338 INFO:tasks.workunit.client.0.smithi112.stdout:5/262: symlink d8/d9/d13/d2a/d2c/l59 0 2024-09-21T00:56:49.339 INFO:tasks.workunit.client.0.smithi112.stdout:5/263: read d8/d9/d13/f51 [301011,51815] 0 2024-09-21T00:56:49.340 INFO:tasks.workunit.client.0.smithi112.stdout:5/264: chown d8/f24 745 1 2024-09-21T00:56:49.343 INFO:tasks.workunit.client.0.smithi112.stdout:6/370: getdents d9/df 0 2024-09-21T00:56:49.347 INFO:tasks.workunit.client.0.smithi112.stdout:0/358: creat d8/d1b/f67 x:0 0 0 2024-09-21T00:56:49.349 INFO:tasks.workunit.client.0.smithi112.stdout:0/359: write d8/d11/d28/f2f [545230,36989] 0 2024-09-21T00:56:49.353 INFO:tasks.workunit.client.0.smithi112.stdout:4/419: dread d1/d5/d1c/d1e/f31 [0,4194304] 0 2024-09-21T00:56:49.353 INFO:tasks.workunit.client.0.smithi112.stdout:7/448: unlink d0/lb 0 2024-09-21T00:56:49.354 INFO:tasks.workunit.client.0.smithi112.stdout:7/449: chown d0/d2/d2e/f5f 191 1 2024-09-21T00:56:49.355 INFO:tasks.workunit.client.0.smithi112.stdout:7/450: fsync d0/d2/d32/f61 0 2024-09-21T00:56:49.357 INFO:tasks.workunit.client.0.smithi112.stdout:9/460: mkdir d5/d3b/d79/d91 0 2024-09-21T00:56:49.359 INFO:tasks.workunit.client.0.smithi112.stdout:8/324: creat d0/d13/d2a/f5f x:0 0 0 2024-09-21T00:56:49.365 INFO:tasks.workunit.client.0.smithi112.stdout:5/265: dread d8/d9/f25 [0,4194304] 0 2024-09-21T00:56:49.367 INFO:tasks.workunit.client.0.smithi112.stdout:4/420: unlink d1/d5/d1c/d1e/d4a/d5f/c66 0 2024-09-21T00:56:49.368 INFO:tasks.workunit.client.0.smithi112.stdout:2/367: dwrite d0/d45/f4a [0,4194304] 0 2024-09-21T00:56:49.370 INFO:tasks.workunit.client.0.smithi112.stdout:2/368: chown d0/d14/d22/c5f 339 1 2024-09-21T00:56:49.370 INFO:tasks.workunit.client.0.smithi112.stdout:4/421: write d1/d5/d1c/d1e/f20 [3909303,106043] 0 2024-09-21T00:56:49.370 INFO:tasks.workunit.client.0.smithi112.stdout:6/371: creat d9/d13/d26/f8a x:0 0 0 2024-09-21T00:56:49.370 INFO:tasks.workunit.client.0.smithi112.stdout:6/372: readlink d9/la 0 2024-09-21T00:56:49.378 INFO:tasks.workunit.client.0.smithi112.stdout:0/360: link d8/d11/f13 d8/d11/d28/f68 0 2024-09-21T00:56:49.384 INFO:tasks.workunit.client.0.smithi112.stdout:5/266: readlink d8/d9/l4c 0 2024-09-21T00:56:49.385 INFO:tasks.workunit.client.0.smithi112.stdout:5/267: fdatasync d8/d9/d13/f48 0 2024-09-21T00:56:49.388 INFO:tasks.workunit.client.0.smithi112.stdout:4/422: mkdir d1/d7/d9/d1a/d8e 0 2024-09-21T00:56:49.388 INFO:tasks.workunit.client.0.smithi112.stdout:4/423: fsync d1/d5/d1c/d1e/f20 0 2024-09-21T00:56:49.391 INFO:tasks.workunit.client.0.smithi112.stdout:6/373: fsync d9/d1f/d3e/f54 0 2024-09-21T00:56:49.392 INFO:tasks.workunit.client.1.smithi187.stdout:7/960: sync 2024-09-21T00:56:49.393 INFO:tasks.workunit.client.0.smithi112.stdout:9/461: rmdir d5/d3b/d5f/d13/d54/d7d 39 2024-09-21T00:56:49.403 INFO:tasks.workunit.client.0.smithi112.stdout:5/268: rename d8/d9/d13/f2d to d8/d9/d13/d1c/d45/f5a 0 2024-09-21T00:56:49.404 INFO:tasks.workunit.client.0.smithi112.stdout:0/361: dwrite d8/f19 [4194304,4194304] 0 2024-09-21T00:56:49.405 INFO:tasks.workunit.client.1.smithi187.stdout:7/961: mknod d1/c13f 0 2024-09-21T00:56:49.406 INFO:tasks.workunit.client.0.smithi112.stdout:5/269: chown d8/d9/d13/d2a/d2c/l33 974426533 1 2024-09-21T00:56:49.407 INFO:tasks.workunit.client.0.smithi112.stdout:2/369: creat d0/d14/d22/d6d/f77 x:0 0 0 2024-09-21T00:56:49.407 INFO:tasks.workunit.client.0.smithi112.stdout:0/362: write d8/d1b/d2c/d2e/d4c/f50 [1473805,124377] 0 2024-09-21T00:56:49.408 INFO:tasks.workunit.client.0.smithi112.stdout:5/270: write d8/d9/d13/d2a/f12 [1014957,4935] 0 2024-09-21T00:56:49.409 INFO:tasks.workunit.client.1.smithi187.stdout:3/989: rename d9/dcc/d105/d11b/d5f to d9/dcc/d105/d11b/d143 0 2024-09-21T00:56:49.409 INFO:tasks.workunit.client.0.smithi112.stdout:4/424: rmdir d1/d2d/d34 39 2024-09-21T00:56:49.410 INFO:tasks.workunit.client.0.smithi112.stdout:0/363: write d8/d11/f23 [1857433,66601] 0 2024-09-21T00:56:49.411 INFO:tasks.workunit.client.0.smithi112.stdout:5/271: chown d8/d9/d13/d1c/f3c 183 1 2024-09-21T00:56:49.413 INFO:tasks.workunit.client.1.smithi187.stdout:3/990: rmdir d9/d19/da7 39 2024-09-21T00:56:49.413 INFO:tasks.workunit.client.0.smithi112.stdout:6/374: dread d9/f20 [0,4194304] 0 2024-09-21T00:56:49.414 INFO:tasks.workunit.client.0.smithi112.stdout:8/325: truncate d0/fb 618589 0 2024-09-21T00:56:49.416 INFO:tasks.workunit.client.0.smithi112.stdout:8/326: dread - d0/d13/f44 zero size 2024-09-21T00:56:49.419 INFO:tasks.workunit.client.0.smithi112.stdout:0/364: dwrite d8/fa [0,4194304] 0 2024-09-21T00:56:49.419 INFO:tasks.workunit.client.1.smithi187.stdout:3/991: write d9/d19/da7/ffc [475782,100669] 0 2024-09-21T00:56:49.421 INFO:tasks.workunit.client.1.smithi187.stdout:7/962: link d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f98 d1/dce/dd0/d97/df1/d31/d33/d3b/d11f/f140 0 2024-09-21T00:56:49.425 INFO:tasks.workunit.client.0.smithi112.stdout:2/370: mkdir d0/d60/d78 0 2024-09-21T00:56:49.426 INFO:tasks.workunit.client.0.smithi112.stdout:2/371: chown d0/df/d46/f61 687045 1 2024-09-21T00:56:49.428 INFO:tasks.workunit.client.0.smithi112.stdout:2/372: write d0/d51/f55 [1910924,121867] 0 2024-09-21T00:56:49.430 INFO:tasks.workunit.client.0.smithi112.stdout:2/373: write d0/d51/f6f [978776,25147] 0 2024-09-21T00:56:49.433 INFO:tasks.workunit.client.1.smithi187.stdout:5/946: sync 2024-09-21T00:56:49.434 INFO:tasks.workunit.client.0.smithi112.stdout:5/272: write d8/d9/f28 [1133637,44808] 0 2024-09-21T00:56:49.435 INFO:tasks.workunit.client.0.smithi112.stdout:5/273: fdatasync d8/d9/d13/f39 0 2024-09-21T00:56:49.436 INFO:tasks.workunit.client.0.smithi112.stdout:5/274: dread - d8/d9/d40/f55 zero size 2024-09-21T00:56:49.437 INFO:tasks.workunit.client.0.smithi112.stdout:5/275: fdatasync d8/d9/d13/d1c/f53 0 2024-09-21T00:56:49.439 INFO:tasks.workunit.client.0.smithi112.stdout:5/276: chown d8/d9/d13/f48 1767 1 2024-09-21T00:56:49.439 INFO:tasks.workunit.client.0.smithi112.stdout:9/462: rename d5/d3b/d5f/d13/f1a to d5/d6/d70/f92 0 2024-09-21T00:56:49.441 INFO:tasks.workunit.client.0.smithi112.stdout:8/327: dwrite d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:56:49.443 INFO:tasks.workunit.client.1.smithi187.stdout:5/947: creat d0/dc/daa/d67/d14/f135 x:0 0 0 2024-09-21T00:56:49.444 INFO:tasks.workunit.client.1.smithi187.stdout:5/948: dread - d0/dc/dbe/f125 zero size 2024-09-21T00:56:49.445 INFO:tasks.workunit.client.1.smithi187.stdout:3/992: dwrite d9/d7f/dcb/d87/fb8 [0,4194304] 0 2024-09-21T00:56:49.445 INFO:tasks.workunit.client.0.smithi112.stdout:6/375: mkdir d9/d1f/d47/d74/d8b 0 2024-09-21T00:56:49.446 INFO:tasks.workunit.client.1.smithi187.stdout:3/993: chown d9/dcc/d105/d11b/f3e 31 1 2024-09-21T00:56:49.446 INFO:tasks.workunit.client.0.smithi112.stdout:6/376: dread - d9/df/d56/f7d zero size 2024-09-21T00:56:49.447 INFO:tasks.workunit.client.1.smithi187.stdout:7/963: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/fe4 1361162 0 2024-09-21T00:56:49.448 INFO:tasks.workunit.client.0.smithi112.stdout:6/377: truncate d9/fc 5159715 0 2024-09-21T00:56:49.450 INFO:tasks.workunit.client.0.smithi112.stdout:4/425: dwrite d1/d5/fd [0,4194304] 0 2024-09-21T00:56:49.450 INFO:tasks.workunit.client.1.smithi187.stdout:5/949: mknod d0/dc/daa/d98/c136 0 2024-09-21T00:56:49.455 INFO:tasks.workunit.client.0.smithi112.stdout:0/365: mkdir d8/d69 0 2024-09-21T00:56:49.455 INFO:tasks.workunit.client.0.smithi112.stdout:9/463: dread - d5/d3b/d5f/d13/d54/d7d/d57/f68 zero size 2024-09-21T00:56:49.456 INFO:tasks.workunit.client.0.smithi112.stdout:8/328: unlink d0/d13/d1b/l4f 0 2024-09-21T00:56:49.461 INFO:tasks.workunit.client.0.smithi112.stdout:5/277: dwrite d8/f30 [0,4194304] 0 2024-09-21T00:56:49.462 INFO:tasks.workunit.client.1.smithi187.stdout:3/994: dread d9/d7f/fbd [0,4194304] 0 2024-09-21T00:56:49.462 INFO:tasks.workunit.client.0.smithi112.stdout:5/278: stat d8/d9/d13/d2a/d2c/c31 0 2024-09-21T00:56:49.463 INFO:tasks.workunit.client.1.smithi187.stdout:3/995: chown d9/d19/d9b/fcf 665 1 2024-09-21T00:56:49.463 INFO:tasks.workunit.client.1.smithi187.stdout:3/996: fdatasync d9/d19/da7/daa/dce/fd2 0 2024-09-21T00:56:49.464 INFO:tasks.workunit.client.1.smithi187.stdout:5/950: link d0/dc/daa/d67/d14/d57/fa8 d0/dc/daa/d67/d30/d68/d126/f137 0 2024-09-21T00:56:49.465 INFO:tasks.workunit.client.0.smithi112.stdout:0/366: fsync d8/d1b/d2c/f34 0 2024-09-21T00:56:49.466 INFO:tasks.workunit.client.0.smithi112.stdout:9/464: chown d5/d6/d19/f2a 9870 1 2024-09-21T00:56:49.469 INFO:tasks.workunit.client.1.smithi187.stdout:5/951: creat d0/dc/daa/d67/d14/d57/d5c/dc9/f138 x:0 0 0 2024-09-21T00:56:49.470 INFO:tasks.workunit.client.1.smithi187.stdout:3/997: truncate d9/d7f/dcb/f1e 857825 0 2024-09-21T00:56:49.470 INFO:tasks.workunit.client.1.smithi187.stdout:5/952: fdatasync d0/dc/d1f/ffa 0 2024-09-21T00:56:49.471 INFO:tasks.workunit.client.1.smithi187.stdout:5/953: chown d0/dc/daa/d67/dcc/d12b 332013 1 2024-09-21T00:56:49.471 INFO:tasks.workunit.client.0.smithi112.stdout:5/279: dwrite d8/d9/d13/f48 [0,4194304] 0 2024-09-21T00:56:49.472 INFO:tasks.workunit.client.1.smithi187.stdout:5/954: write d0/dc/daa/d67/d14/d1b/d27/f35 [5380610,73849] 0 2024-09-21T00:56:49.474 INFO:tasks.workunit.client.0.smithi112.stdout:9/465: unlink d5/d3b/d5f/d13/d56/c8c 0 2024-09-21T00:56:49.475 INFO:tasks.workunit.client.0.smithi112.stdout:9/466: write d5/d3b/d5f/d13/d56/f7c [163295,74621] 0 2024-09-21T00:56:49.477 INFO:tasks.workunit.client.1.smithi187.stdout:3/998: symlink d9/dcc/d105/d11b/d129/d13a/l144 0 2024-09-21T00:56:49.478 INFO:tasks.workunit.client.0.smithi112.stdout:5/280: chown d8/d9/d13/d1c/c29 7 1 2024-09-21T00:56:49.478 INFO:tasks.workunit.client.0.smithi112.stdout:0/367: link d8/d1b/l1f d8/d62/l6a 0 2024-09-21T00:56:49.479 INFO:tasks.workunit.client.0.smithi112.stdout:5/281: readlink d8/d9/d13/d2a/l19 0 2024-09-21T00:56:49.483 INFO:tasks.workunit.client.0.smithi112.stdout:9/467: unlink d5/d3b/d5f/d13/d54/d7d/f32 0 2024-09-21T00:56:49.484 INFO:tasks.workunit.client.1.smithi187.stdout:5/955: creat d0/dc/daa/d67/d14/f139 x:0 0 0 2024-09-21T00:56:49.485 INFO:tasks.workunit.client.1.smithi187.stdout:3/999: dwrite d9/d7f/dcb/d9c/fe7 [0,4194304] 0 2024-09-21T00:56:49.488 INFO:tasks.workunit.client.0.smithi112.stdout:5/282: rename d8/d4d to d8/d9/d13/d2a/df/d5b 0 2024-09-21T00:56:49.491 INFO:tasks.workunit.client.1.smithi187.stdout:5/956: dread d0/dc/d1f/d26/f64 [4194304,4194304] 0 2024-09-21T00:56:49.493 INFO:tasks.workunit.client.0.smithi112.stdout:4/426: write d1/d2d/f55 [2909267,91515] 0 2024-09-21T00:56:49.495 INFO:tasks.workunit.client.0.smithi112.stdout:5/283: symlink d8/d9/d13/d2a/d2c/d49/l5c 0 2024-09-21T00:56:49.497 INFO:tasks.workunit.client.1.smithi187.stdout:5/957: symlink d0/dc/daa/d67/l13a 0 2024-09-21T00:56:49.497 INFO:tasks.workunit.client.0.smithi112.stdout:6/378: dwrite d9/d13/d26/f3d [0,4194304] 0 2024-09-21T00:56:49.499 INFO:tasks.workunit.client.0.smithi112.stdout:6/379: chown d9/l16 373967986 1 2024-09-21T00:56:49.501 INFO:tasks.workunit.client.1.smithi187.stdout:7/964: sync 2024-09-21T00:56:49.501 INFO:tasks.workunit.client.0.smithi112.stdout:8/329: dread d0/d13/f3f [0,4194304] 0 2024-09-21T00:56:49.502 INFO:tasks.workunit.client.1.smithi187.stdout:5/958: fsync d0/dc/d1f/d26/f64 0 2024-09-21T00:56:49.503 INFO:tasks.workunit.client.0.smithi112.stdout:8/330: read d0/d13/d1b/f35 [473994,77557] 0 2024-09-21T00:56:49.504 INFO:tasks.workunit.client.0.smithi112.stdout:8/331: dread - d0/d13/d2a/f5f zero size 2024-09-21T00:56:49.504 INFO:tasks.workunit.client.0.smithi112.stdout:6/380: mkdir d9/d1f/d3e/d77/d46/d8c 0 2024-09-21T00:56:49.505 INFO:tasks.workunit.client.0.smithi112.stdout:8/332: readlink d0/d13/d1b/d22/l4a 0 2024-09-21T00:56:49.507 INFO:tasks.workunit.client.1.smithi187.stdout:5/959: stat d0/dc/daa/d67/d14/d38/d5a/f100 0 2024-09-21T00:56:49.508 INFO:tasks.workunit.client.0.smithi112.stdout:4/427: rename d1/d2d/f55 to d1/d2d/f8f 0 2024-09-21T00:56:49.510 INFO:tasks.workunit.client.0.smithi112.stdout:4/428: write d1/d2d/f50 [835868,108110] 0 2024-09-21T00:56:49.513 INFO:tasks.workunit.client.0.smithi112.stdout:5/284: creat d8/d9/f5d x:0 0 0 2024-09-21T00:56:49.515 INFO:tasks.workunit.client.0.smithi112.stdout:0/368: write d8/d11/f13 [3267488,116305] 0 2024-09-21T00:56:49.515 INFO:tasks.workunit.client.0.smithi112.stdout:8/333: symlink d0/d13/d1b/d22/d2e/l60 0 2024-09-21T00:56:49.519 INFO:tasks.workunit.client.1.smithi187.stdout:5/960: symlink d0/dc/daa/d67/d14/d38/d5a/d6c/db7/l13b 0 2024-09-21T00:56:49.522 INFO:tasks.workunit.client.1.smithi187.stdout:5/961: symlink d0/dc/daa/d67/d30/d68/d126/l13c 0 2024-09-21T00:56:49.523 INFO:tasks.workunit.client.0.smithi112.stdout:8/334: dread d0/f43 [0,4194304] 0 2024-09-21T00:56:49.524 INFO:tasks.workunit.client.0.smithi112.stdout:0/369: mkdir d8/d1b/d2c/d2e/d4c/d6b 0 2024-09-21T00:56:49.524 INFO:tasks.workunit.client.0.smithi112.stdout:8/335: chown d0/l2 10 1 2024-09-21T00:56:49.526 INFO:tasks.workunit.client.0.smithi112.stdout:4/429: rename d1/c82 to d1/d7/d9/d1a/d22/c90 0 2024-09-21T00:56:49.528 INFO:tasks.workunit.client.0.smithi112.stdout:4/430: fdatasync d1/f7f 0 2024-09-21T00:56:49.530 INFO:tasks.workunit.client.0.smithi112.stdout:6/381: dread d9/d13/d26/f52 [0,4194304] 0 2024-09-21T00:56:49.532 INFO:tasks.workunit.client.0.smithi112.stdout:0/370: dwrite d8/d1b/d2c/d2e/d4c/f50 [0,4194304] 0 2024-09-21T00:56:49.532 INFO:tasks.workunit.client.1.smithi187.stdout:7/965: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/faf [0,4194304] 0 2024-09-21T00:56:49.533 INFO:tasks.workunit.client.0.smithi112.stdout:0/371: write d8/fa [3086433,6982] 0 2024-09-21T00:56:49.534 INFO:tasks.workunit.client.0.smithi112.stdout:5/285: rename d8/d9/d40/f55 to d8/d9/d13/d2a/d58/f5e 0 2024-09-21T00:56:49.535 INFO:tasks.workunit.client.0.smithi112.stdout:4/431: mkdir d1/d7/d30/d91 0 2024-09-21T00:56:49.537 INFO:tasks.workunit.client.1.smithi187.stdout:7/966: rmdir d1/dce/dd0/d97/df1 39 2024-09-21T00:56:49.539 INFO:tasks.workunit.client.0.smithi112.stdout:8/336: mkdir d0/d13/d1b/d22/d61 0 2024-09-21T00:56:49.541 INFO:tasks.workunit.client.0.smithi112.stdout:0/372: dwrite d8/d1b/f44 [0,4194304] 0 2024-09-21T00:56:49.542 INFO:tasks.workunit.client.1.smithi187.stdout:7/967: chown d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/lf8 0 1 2024-09-21T00:56:49.550 INFO:tasks.workunit.client.0.smithi112.stdout:9/468: rename d5/d6/d19/f77 to d5/d3b/d5f/d13/d54/d7d/d57/d6a/f93 0 2024-09-21T00:56:49.550 INFO:tasks.workunit.client.0.smithi112.stdout:6/382: mknod d9/d1f/d3e/d6f/c8d 0 2024-09-21T00:56:49.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/337: unlink d0/d13/d1b/l49 0 2024-09-21T00:56:49.554 INFO:tasks.workunit.client.0.smithi112.stdout:8/338: chown d0/l5 1914 1 2024-09-21T00:56:49.556 INFO:tasks.workunit.client.1.smithi187.stdout:5/962: truncate d0/dc/daa/d67/d30/f60 2569564 0 2024-09-21T00:56:49.556 INFO:tasks.workunit.client.0.smithi112.stdout:8/339: chown d0/d13/d1b/d22/d2e/d3d/c5d 67787 1 2024-09-21T00:56:49.557 INFO:tasks.workunit.client.1.smithi187.stdout:5/963: write d0/dc/daa/d67/d14/d38/d5a/fbc [521870,91358] 0 2024-09-21T00:56:49.557 INFO:tasks.workunit.client.0.smithi112.stdout:8/340: write d0/d13/d1b/d22/d2e/d3d/f50 [1017472,56909] 0 2024-09-21T00:56:49.558 INFO:tasks.workunit.client.0.smithi112.stdout:9/469: dread d5/d3b/d5f/d13/d54/d7d/d57/f60 [0,4194304] 0 2024-09-21T00:56:49.562 INFO:tasks.workunit.client.1.smithi187.stdout:5/964: rmdir d0/dc/daa/d67/d14/d38/d5a/d6c/db7/dd9 39 2024-09-21T00:56:49.563 INFO:tasks.workunit.client.1.smithi187.stdout:5/965: write d0/dc/daa/d67/d14/f21 [680269,97244] 0 2024-09-21T00:56:49.565 INFO:tasks.workunit.client.1.smithi187.stdout:5/966: truncate d0/dc/daa/d67/d30/d6b/d8e/f116 4438349 0 2024-09-21T00:56:49.571 INFO:tasks.workunit.client.1.smithi187.stdout:5/967: mkdir d0/d13d 0 2024-09-21T00:56:49.572 INFO:tasks.workunit.client.0.smithi112.stdout:8/341: creat d0/f62 x:0 0 0 2024-09-21T00:56:49.574 INFO:tasks.workunit.client.1.smithi187.stdout:5/968: creat d0/dc/daa/d67/dcc/f13e x:0 0 0 2024-09-21T00:56:49.576 INFO:tasks.workunit.client.0.smithi112.stdout:5/286: rmdir d8/d9/d57 0 2024-09-21T00:56:49.578 INFO:tasks.workunit.client.1.smithi187.stdout:5/969: creat d0/dc/d39/f13f x:0 0 0 2024-09-21T00:56:49.579 INFO:tasks.workunit.client.0.smithi112.stdout:8/342: unlink d0/f26 0 2024-09-21T00:56:49.581 INFO:tasks.workunit.client.0.smithi112.stdout:5/287: dread d8/d9/f25 [4194304,4194304] 0 2024-09-21T00:56:49.582 INFO:tasks.workunit.client.0.smithi112.stdout:4/432: getdents d1/d2d 0 2024-09-21T00:56:49.584 INFO:tasks.workunit.client.0.smithi112.stdout:6/383: getdents d9/d1f/d3e/d77/d23 0 2024-09-21T00:56:49.585 INFO:tasks.workunit.client.0.smithi112.stdout:8/343: fdatasync d0/d13/f3f 0 2024-09-21T00:56:49.588 INFO:tasks.workunit.client.0.smithi112.stdout:9/470: dread d5/d3b/d5f/f58 [0,4194304] 0 2024-09-21T00:56:49.592 INFO:tasks.workunit.client.1.smithi187.stdout:5/970: dread d0/dc/daa/d67/d30/d6b/fd0 [0,4194304] 0 2024-09-21T00:56:49.593 INFO:tasks.workunit.client.1.smithi187.stdout:5/971: dread - d0/dc/daa/d67/d14/f135 zero size 2024-09-21T00:56:49.593 INFO:tasks.workunit.client.0.smithi112.stdout:8/344: dwrite d0/d13/f27 [4194304,4194304] 0 2024-09-21T00:56:49.594 INFO:tasks.workunit.client.1.smithi187.stdout:5/972: chown d0/dc/daa/d67/c49 81145 1 2024-09-21T00:56:49.594 INFO:tasks.workunit.client.0.smithi112.stdout:9/471: symlink d5/l94 0 2024-09-21T00:56:49.596 INFO:tasks.workunit.client.0.smithi112.stdout:5/288: creat d8/f5f x:0 0 0 2024-09-21T00:56:49.596 INFO:tasks.workunit.client.0.smithi112.stdout:4/433: dwrite d1/d7/f28 [4194304,4194304] 0 2024-09-21T00:56:49.597 INFO:tasks.workunit.client.0.smithi112.stdout:6/384: write d9/d13/f39 [505915,10935] 0 2024-09-21T00:56:49.600 INFO:tasks.workunit.client.1.smithi187.stdout:5/973: dwrite d0/dc/daa/d67/d14/f3d [0,4194304] 0 2024-09-21T00:56:49.602 INFO:tasks.workunit.client.1.smithi187.stdout:7/968: sync 2024-09-21T00:56:49.603 INFO:tasks.workunit.client.0.smithi112.stdout:9/472: rename d5/d3b/d5f/d13/d54/d7d/d57/f68 to d5/d3b/d5f/d13/d56/f95 0 2024-09-21T00:56:49.604 INFO:tasks.workunit.client.0.smithi112.stdout:4/434: truncate d1/d7/f39 1409345 0 2024-09-21T00:56:49.606 INFO:tasks.workunit.client.0.smithi112.stdout:6/385: rename d9/d87 to d9/d1f/d47/d74/d8e 0 2024-09-21T00:56:49.607 INFO:tasks.workunit.client.0.smithi112.stdout:6/386: chown d9/l16 9 1 2024-09-21T00:56:49.607 INFO:tasks.workunit.client.0.smithi112.stdout:8/345: dread d0/fb [0,4194304] 0 2024-09-21T00:56:49.611 INFO:tasks.workunit.client.1.smithi187.stdout:7/969: chown d1/dce/dd0/d97/df1/d31/f32 29425 1 2024-09-21T00:56:49.611 INFO:tasks.workunit.client.0.smithi112.stdout:4/435: rmdir d1/d7/d30 39 2024-09-21T00:56:49.612 INFO:tasks.workunit.client.0.smithi112.stdout:9/473: symlink d5/d6/d19/d51/d8f/l96 0 2024-09-21T00:56:49.618 INFO:tasks.workunit.client.1.smithi187.stdout:7/970: rename d1/l30 to d1/dc/d15/l141 0 2024-09-21T00:56:49.619 INFO:tasks.workunit.client.0.smithi112.stdout:4/436: link d1/d5/d1c/d1e/d4a/d5f/f71 d1/d5/d1c/f92 0 2024-09-21T00:56:49.619 INFO:tasks.workunit.client.1.smithi187.stdout:7/971: write d1/dce/dd0/d97/df1/d31/d41/d8a/dd5/f10a [1973842,110344] 0 2024-09-21T00:56:49.621 INFO:tasks.workunit.client.0.smithi112.stdout:9/474: rename d5/d3b/d5f/d13/f82 to d5/d3b/d5f/d13/d54/d7d/d57/d6a/f97 0 2024-09-21T00:56:49.623 INFO:tasks.workunit.client.0.smithi112.stdout:4/437: truncate d1/f46 174920 0 2024-09-21T00:56:49.624 INFO:tasks.workunit.client.1.smithi187.stdout:7/972: mknod d1/dce/dd0/d97/df1/d31/d41/d64/c142 0 2024-09-21T00:56:49.625 INFO:tasks.workunit.client.0.smithi112.stdout:4/438: mknod d1/d7/d30/c93 0 2024-09-21T00:56:49.626 INFO:tasks.workunit.client.0.smithi112.stdout:9/475: creat d5/d3b/d5f/d13/d54/f98 x:0 0 0 2024-09-21T00:56:49.627 INFO:tasks.workunit.client.0.smithi112.stdout:5/289: write f7 [600290,6078] 0 2024-09-21T00:56:49.631 INFO:tasks.workunit.client.0.smithi112.stdout:9/476: symlink d5/d3b/d5f/d13/d54/d7d/d57/l99 0 2024-09-21T00:56:49.631 INFO:tasks.workunit.client.1.smithi187.stdout:5/974: write d0/dc/d39/f4b [3035069,112561] 0 2024-09-21T00:56:49.631 INFO:tasks.workunit.client.0.smithi112.stdout:4/439: getdents d1/d5/d1c/d1e/d4a/d5f 0 2024-09-21T00:56:49.633 INFO:tasks.workunit.client.0.smithi112.stdout:8/346: write d0/d13/d1b/d22/f24 [1627007,103338] 0 2024-09-21T00:56:49.634 INFO:tasks.workunit.client.0.smithi112.stdout:6/387: truncate d9/df/f2e 768941 0 2024-09-21T00:56:49.634 INFO:tasks.workunit.client.0.smithi112.stdout:4/440: write d1/d5/d1c/d1e/d4a/f7d [1199593,41168] 0 2024-09-21T00:56:49.635 INFO:tasks.workunit.client.1.smithi187.stdout:7/973: dread d1/dc/d15/d22/f86 [0,4194304] 0 2024-09-21T00:56:49.635 INFO:tasks.workunit.client.0.smithi112.stdout:9/477: symlink d5/d3b/d5f/d13/d54/d7d/d57/l9a 0 2024-09-21T00:56:49.637 INFO:tasks.workunit.client.0.smithi112.stdout:5/290: creat d8/d9/f60 x:0 0 0 2024-09-21T00:56:49.639 INFO:tasks.workunit.client.1.smithi187.stdout:5/975: creat d0/dc/dbe/d134/f140 x:0 0 0 2024-09-21T00:56:49.640 INFO:tasks.workunit.client.1.smithi187.stdout:7/974: dwrite d1/dce/dd4/f125 [0,4194304] 0 2024-09-21T00:56:49.641 INFO:tasks.workunit.client.0.smithi112.stdout:9/478: rmdir d5/d6 39 2024-09-21T00:56:49.642 INFO:tasks.workunit.client.1.smithi187.stdout:5/976: truncate d0/dc/daa/d67/d14/d38/d5a/d6c/fe4 4839350 0 2024-09-21T00:56:49.642 INFO:tasks.workunit.client.0.smithi112.stdout:4/441: creat d1/d7/d9/d1a/d22/d6e/f94 x:0 0 0 2024-09-21T00:56:49.644 INFO:tasks.workunit.client.1.smithi187.stdout:7/975: dread d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/d75/f88 [0,4194304] 0 2024-09-21T00:56:49.644 INFO:tasks.workunit.client.0.smithi112.stdout:6/388: mkdir d9/d13/d21/d84/d8f 0 2024-09-21T00:56:49.645 INFO:tasks.workunit.client.0.smithi112.stdout:6/389: fdatasync d9/d13/f39 0 2024-09-21T00:56:49.647 INFO:tasks.workunit.client.1.smithi187.stdout:5/977: readlink d0/dc/d1f/df4/l119 0 2024-09-21T00:56:49.647 INFO:tasks.workunit.client.1.smithi187.stdout:5/978: chown d0/dc/dc6 3541 1 2024-09-21T00:56:49.649 INFO:tasks.workunit.client.0.smithi112.stdout:5/291: mkdir d8/d9/d61 0 2024-09-21T00:56:49.653 INFO:tasks.workunit.client.1.smithi187.stdout:5/979: mknod d0/dc/daa/d67/d14/d1b/d27/dc7/c141 0 2024-09-21T00:56:49.654 INFO:tasks.workunit.client.1.smithi187.stdout:5/980: readlink d0/dc/daa/d67/d14/d57/l8f 0 2024-09-21T00:56:49.657 INFO:tasks.workunit.client.0.smithi112.stdout:8/347: link d0/c6 d0/d13/d1b/d22/d42/d51/c63 0 2024-09-21T00:56:49.658 INFO:tasks.workunit.client.0.smithi112.stdout:8/348: read d0/f10 [2062348,79368] 0 2024-09-21T00:56:49.659 INFO:tasks.workunit.client.0.smithi112.stdout:5/292: symlink d8/d9/d13/d2a/l62 0 2024-09-21T00:56:49.661 INFO:tasks.workunit.client.1.smithi187.stdout:5/981: mknod d0/dc/daa/d67/d30/c142 0 2024-09-21T00:56:49.664 INFO:tasks.workunit.client.1.smithi187.stdout:5/982: symlink d0/dc/d39/l143 0 2024-09-21T00:56:49.665 INFO:tasks.workunit.client.0.smithi112.stdout:8/349: dwrite d0/d13/d2a/f5e [0,4194304] 0 2024-09-21T00:56:49.666 INFO:tasks.workunit.client.1.smithi187.stdout:7/976: truncate d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/d8b/d8f/faf 595258 0 2024-09-21T00:56:49.669 INFO:tasks.workunit.client.1.smithi187.stdout:5/983: symlink d0/dc/daa/d67/dcc/de5/df3/l144 0 2024-09-21T00:56:49.670 INFO:tasks.workunit.client.0.smithi112.stdout:9/479: creat d5/d6/f9b x:0 0 0 2024-09-21T00:56:49.671 INFO:tasks.workunit.client.1.smithi187.stdout:7/977: rmdir d1/dce/dd0/d97/df1/d31/d33/d3b/d62 39 2024-09-21T00:56:49.671 INFO:tasks.workunit.client.0.smithi112.stdout:9/480: write d5/d6/d19/f1d [4781109,32326] 0 2024-09-21T00:56:49.673 INFO:tasks.workunit.client.0.smithi112.stdout:4/442: truncate d1/d5/d1c/d1e/d4a/f7d 937090 0 2024-09-21T00:56:49.673 INFO:tasks.workunit.client.0.smithi112.stdout:4/443: chown d1/d5/d1c/f65 1 1 2024-09-21T00:56:49.674 INFO:tasks.workunit.client.1.smithi187.stdout:5/984: mkdir d0/dc/d1f/df4/d145 0 2024-09-21T00:56:49.675 INFO:tasks.workunit.client.0.smithi112.stdout:5/293: creat d8/d9/d13/d2a/d2c/d49/f63 x:0 0 0 2024-09-21T00:56:49.676 INFO:tasks.workunit.client.0.smithi112.stdout:5/294: fdatasync d8/d9/d40/f50 0 2024-09-21T00:56:49.679 INFO:tasks.workunit.client.0.smithi112.stdout:6/390: creat d9/d13/d21/d4c/f90 x:0 0 0 2024-09-21T00:56:49.681 INFO:tasks.workunit.client.0.smithi112.stdout:5/295: dread d8/d9/f25 [0,4194304] 0 2024-09-21T00:56:49.682 INFO:tasks.workunit.client.1.smithi187.stdout:5/985: creat d0/dc/daa/d67/d30/f146 x:0 0 0 2024-09-21T00:56:49.689 INFO:tasks.workunit.client.0.smithi112.stdout:5/296: fsync d8/d9/d13/d1c/d45/f5a 0 2024-09-21T00:56:49.690 INFO:tasks.workunit.client.0.smithi112.stdout:8/350: link d0/d13/c3b d0/d13/d1b/d22/d2e/d34/c64 0 2024-09-21T00:56:49.691 INFO:tasks.workunit.client.0.smithi112.stdout:6/391: getdents d9/d1f/d3e/d77/d46/d8c 0 2024-09-21T00:56:49.692 INFO:tasks.workunit.client.0.smithi112.stdout:6/392: chown d9/d1f/l73 10501577 1 2024-09-21T00:56:49.694 INFO:tasks.workunit.client.1.smithi187.stdout:7/978: truncate d1/f1c 3906302 0 2024-09-21T00:56:49.695 INFO:tasks.workunit.client.0.smithi112.stdout:8/351: symlink d0/d13/d1b/d22/d2e/d34/l65 0 2024-09-21T00:56:49.696 INFO:tasks.workunit.client.0.smithi112.stdout:4/444: dread d1/d5/fd [4194304,4194304] 0 2024-09-21T00:56:49.697 INFO:tasks.workunit.client.1.smithi187.stdout:5/986: dread d0/f7 [0,4194304] 0 2024-09-21T00:56:49.698 INFO:tasks.workunit.client.0.smithi112.stdout:5/297: creat d8/d9/f64 x:0 0 0 2024-09-21T00:56:49.699 INFO:tasks.workunit.client.0.smithi112.stdout:5/298: readlink d8/d9/d13/d1c/l21 0 2024-09-21T00:56:49.699 INFO:tasks.workunit.client.0.smithi112.stdout:5/299: stat d8/d9/d13/f51 0 2024-09-21T00:56:49.700 INFO:tasks.workunit.client.1.smithi187.stdout:5/987: dread d0/f75 [0,4194304] 0 2024-09-21T00:56:49.702 INFO:tasks.workunit.client.1.smithi187.stdout:5/988: read d0/dc/daa/d67/f15 [1175228,100298] 0 2024-09-21T00:56:49.703 INFO:tasks.workunit.client.0.smithi112.stdout:6/393: link d9/fc d9/df/d56/f91 0 2024-09-21T00:56:49.703 INFO:tasks.workunit.client.1.smithi187.stdout:5/989: fsync d0/dc/daa/d67/d14/d57/d5c/f112 0 2024-09-21T00:56:49.704 INFO:tasks.workunit.client.0.smithi112.stdout:5/300: dread d8/d9/d13/d1c/f3c [0,4194304] 0 2024-09-21T00:56:49.704 INFO:tasks.workunit.client.1.smithi187.stdout:5/990: fdatasync d0/dc/dbe/fee 0 2024-09-21T00:56:49.704 INFO:tasks.workunit.client.0.smithi112.stdout:9/481: truncate d5/d3b/d5f/d13/d54/d7d/f40 1239374 0 2024-09-21T00:56:49.705 INFO:tasks.workunit.client.0.smithi112.stdout:9/482: truncate d5/f22 5174430 0 2024-09-21T00:56:49.705 INFO:tasks.workunit.client.0.smithi112.stdout:4/445: mknod d1/d7/d9/d1a/d22/c95 0 2024-09-21T00:56:49.706 INFO:tasks.workunit.client.0.smithi112.stdout:9/483: write d5/f16 [1757913,79478] 0 2024-09-21T00:56:49.707 INFO:tasks.workunit.client.0.smithi112.stdout:4/446: read d1/d5/d1c/d1e/f20 [1830396,41937] 0 2024-09-21T00:56:49.708 INFO:tasks.workunit.client.1.smithi187.stdout:7/979: creat d1/dc/d15/f143 x:0 0 0 2024-09-21T00:56:49.710 INFO:tasks.workunit.client.0.smithi112.stdout:8/352: write d0/f43 [381148,43817] 0 2024-09-21T00:56:49.711 INFO:tasks.workunit.client.0.smithi112.stdout:8/353: chown d0/d13/f59 37159688 1 2024-09-21T00:56:49.714 INFO:tasks.workunit.client.0.smithi112.stdout:5/301: rename d8/f24 to d8/d9/d13/d2a/d2c/d49/f65 0 2024-09-21T00:56:49.747 INFO:tasks.workunit.client.0.smithi112.stdout:1/297: sync 2024-09-21T00:56:49.748 INFO:tasks.workunit.client.0.smithi112.stdout:1/298: chown d5/d8/d14/f3b 1928 1 2024-09-21T00:56:49.751 INFO:tasks.workunit.client.0.smithi112.stdout:9/484: mknod d5/d3b/d5f/d13/c9c 0 2024-09-21T00:56:49.754 INFO:tasks.workunit.client.1.smithi187.stdout:5/991: mkdir d0/dc/daa/d67/d14/d1b/d147 0 2024-09-21T00:56:49.756 INFO:tasks.workunit.client.0.smithi112.stdout:6/394: fsync d9/d1f/d3e/d77/f1d 0 2024-09-21T00:56:49.760 INFO:tasks.workunit.client.1.smithi187.stdout:7/980: link d1/dce/dd0/d97/df1/d31/d33/d3b/f4a d1/dce/dd0/d97/df1/f144 0 2024-09-21T00:56:49.762 INFO:tasks.workunit.client.0.smithi112.stdout:8/354: rename d0/d13/d1b/d22/d2e/d3d to d0/d66 0 2024-09-21T00:56:49.764 INFO:tasks.workunit.client.0.smithi112.stdout:5/302: symlink d8/d9/d13/d2a/d58/l66 0 2024-09-21T00:56:49.764 INFO:tasks.workunit.client.0.smithi112.stdout:5/303: dread - d8/d9/d13/d1c/f53 zero size 2024-09-21T00:56:49.768 INFO:tasks.workunit.client.0.smithi112.stdout:6/395: creat d9/d1f/d3e/d77/d46/f92 x:0 0 0 2024-09-21T00:56:49.769 INFO:tasks.workunit.client.0.smithi112.stdout:6/396: write d9/df/d56/f7d [299907,50616] 0 2024-09-21T00:56:49.770 INFO:tasks.workunit.client.1.smithi187.stdout:7/981: rename d1/dce/dd0/d97/df1/d31/d33/d3b/d9f/le0 to d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/l145 0 2024-09-21T00:56:49.771 INFO:tasks.workunit.client.0.smithi112.stdout:1/299: rename d5/d8/d13/c24 to d5/d8/d10/d2e/c63 0 2024-09-21T00:56:49.773 INFO:tasks.workunit.client.1.smithi187.stdout:7/982: rmdir d1/dce/dd0/d97/df1/d31/d33 39 2024-09-21T00:56:49.773 INFO:tasks.workunit.client.0.smithi112.stdout:4/447: link d1/l1d d1/d5/d1c/l96 0 2024-09-21T00:56:49.774 INFO:tasks.workunit.client.1.smithi187.stdout:5/992: dwrite d0/dc/daa/d67/d14/d1b/d27/f9a [0,4194304] 0 2024-09-21T00:56:49.775 INFO:tasks.workunit.client.1.smithi187.stdout:7/983: mkdir d1/dce/d146 0 2024-09-21T00:56:49.776 INFO:tasks.workunit.client.1.smithi187.stdout:7/984: write d1/d55/d80/f11a [240334,127117] 0 2024-09-21T00:56:49.781 INFO:tasks.workunit.client.1.smithi187.stdout:7/985: fdatasync d1/dce/dd0/d97/df1/d31/d33/d3b/f12c 0 2024-09-21T00:56:49.783 INFO:tasks.workunit.client.1.smithi187.stdout:7/986: rmdir d1/dce/dd0/d97/df1/d31/d41/dbe 39 2024-09-21T00:56:49.785 INFO:tasks.workunit.client.1.smithi187.stdout:5/993: creat d0/dc/daa/d67/d14/d38/d5a/f148 x:0 0 0 2024-09-21T00:56:49.789 INFO:tasks.workunit.client.1.smithi187.stdout:5/994: dread d0/dc/daa/d67/d30/d6b/d8e/f116 [0,4194304] 0 2024-09-21T00:56:49.789 INFO:tasks.workunit.client.1.smithi187.stdout:7/987: dread d1/d55/dd7/ffa [0,4194304] 0 2024-09-21T00:56:49.790 INFO:tasks.workunit.client.1.smithi187.stdout:7/988: write d1/f21 [1928892,37963] 0 2024-09-21T00:56:49.793 INFO:tasks.workunit.client.1.smithi187.stdout:7/989: truncate d1/dce/dd0/d97/df1/f29 486101 0 2024-09-21T00:56:49.795 INFO:tasks.workunit.client.1.smithi187.stdout:7/990: mkdir d1/dce/dd0/d147 0 2024-09-21T00:56:49.796 INFO:tasks.workunit.client.1.smithi187.stdout:7/991: dread d1/d55/fcc [0,4194304] 0 2024-09-21T00:56:49.803 INFO:tasks.workunit.client.1.smithi187.stdout:7/992: dwrite d1/dc/fb2 [0,4194304] 0 2024-09-21T00:56:49.808 INFO:tasks.workunit.client.1.smithi187.stdout:7/993: mknod d1/dce/dd0/d97/df1/d31/d33/d3b/d11f/c148 0 2024-09-21T00:56:49.815 INFO:tasks.workunit.client.1.smithi187.stdout:7/994: dwrite d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/f11b [0,4194304] 0 2024-09-21T00:56:49.822 INFO:tasks.workunit.client.1.smithi187.stdout:7/995: write d1/dce/dd0/d97/df1/d31/d41/f6a [606178,102667] 0 2024-09-21T00:56:49.826 INFO:tasks.workunit.client.1.smithi187.stdout:7/996: creat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/f149 x:0 0 0 2024-09-21T00:56:49.842 INFO:tasks.workunit.client.1.smithi187.stdout:7/997: dwrite d1/dce/dd0/d97/df1/d31/d33/d3b/f4a [0,4194304] 0 2024-09-21T00:56:49.843 INFO:tasks.workunit.client.1.smithi187.stdout:7/998: chown d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/c44 28308 1 2024-09-21T00:56:49.847 INFO:tasks.workunit.client.1.smithi187.stdout:7/999: creat d1/dce/dd0/d97/df1/d31/d41/d64/d93/dc1/d73/dc8/f14a x:0 0 0 2024-09-21T00:56:49.873 INFO:tasks.workunit.client.0.smithi112.stdout:8/355: creat d0/d13/d1b/d22/d61/f67 x:0 0 0 2024-09-21T00:56:49.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/485: creat d5/d6/f9d x:0 0 0 2024-09-21T00:56:49.874 INFO:tasks.workunit.client.0.smithi112.stdout:4/448: read d1/d5/d1c/d1e/d3d/f80 [497316,59813] 0 2024-09-21T00:56:49.874 INFO:tasks.workunit.client.0.smithi112.stdout:6/397: dwrite d9/d13/f39 [0,4194304] 0 2024-09-21T00:56:49.878 INFO:tasks.workunit.client.0.smithi112.stdout:1/300: rename d5/d8/d10/c3f to d5/d8/d10/d2e/c64 0 2024-09-21T00:56:49.878 INFO:tasks.workunit.client.0.smithi112.stdout:8/356: dread d0/d13/d1b/f53 [0,4194304] 0 2024-09-21T00:56:49.879 INFO:tasks.workunit.client.0.smithi112.stdout:4/449: fdatasync d1/d5/d1c/d1e/f31 0 2024-09-21T00:56:49.881 INFO:tasks.workunit.client.0.smithi112.stdout:6/398: creat d9/d1f/d3e/d77/d46/f93 x:0 0 0 2024-09-21T00:56:49.887 INFO:tasks.workunit.client.0.smithi112.stdout:8/357: dwrite d0/d13/d2a/f5f [0,4194304] 0 2024-09-21T00:56:49.888 INFO:tasks.workunit.client.0.smithi112.stdout:4/450: creat d1/d5/d1c/d1e/d3d/f97 x:0 0 0 2024-09-21T00:56:49.894 INFO:tasks.workunit.client.0.smithi112.stdout:9/486: creat d5/d3b/d5f/d13/d54/d7d/f9e x:0 0 0 2024-09-21T00:56:49.895 INFO:tasks.workunit.client.1.smithi187.stdout:5/995: sync 2024-09-21T00:56:49.896 INFO:tasks.workunit.client.0.smithi112.stdout:4/451: rename d1/d5/d1c/d1e/d4a/c5c to d1/d5/d1c/d1e/d3d/c98 0 2024-09-21T00:56:49.896 INFO:tasks.workunit.client.0.smithi112.stdout:6/399: link d9/d13/d31/c61 d9/d1f/d3e/d77/d46/c94 0 2024-09-21T00:56:49.897 INFO:tasks.workunit.client.0.smithi112.stdout:8/358: dwrite d0/d13/f3f [0,4194304] 0 2024-09-21T00:56:49.897 INFO:tasks.workunit.client.0.smithi112.stdout:1/301: dwrite d5/f33 [0,4194304] 0 2024-09-21T00:56:49.900 INFO:tasks.workunit.client.0.smithi112.stdout:8/359: chown d0/f3c 66159331 1 2024-09-21T00:56:49.901 INFO:tasks.workunit.client.1.smithi187.stdout:5/996: dwrite d0/dc/ffd [0,4194304] 0 2024-09-21T00:56:49.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/400: rename d9/d13/d26/f52 to d9/d13/d31/d41/f95 0 2024-09-21T00:56:49.905 INFO:tasks.workunit.client.0.smithi112.stdout:1/302: dwrite d5/d8/f3d [0,4194304] 0 2024-09-21T00:56:49.906 INFO:tasks.workunit.client.0.smithi112.stdout:4/452: getdents d1/d7/d9/d1a/d8e 0 2024-09-21T00:56:49.907 INFO:tasks.workunit.client.1.smithi187.stdout:5/997: symlink d0/dc/dc6/d10c/l149 0 2024-09-21T00:56:49.909 INFO:tasks.workunit.client.0.smithi112.stdout:8/360: creat d0/d13/d1b/f68 x:0 0 0 2024-09-21T00:56:49.912 INFO:tasks.workunit.client.0.smithi112.stdout:4/453: mkdir d1/d5/d1c/d1e/d3d/d99 0 2024-09-21T00:56:49.913 INFO:tasks.workunit.client.0.smithi112.stdout:4/454: chown d1/d7/d9/d1a/d22/d6e/f94 2260036 1 2024-09-21T00:56:49.913 INFO:tasks.workunit.client.0.smithi112.stdout:8/361: chown d0/d13/d2a/f4d 1439 1 2024-09-21T00:56:49.914 INFO:tasks.workunit.client.1.smithi187.stdout:5/998: read d0/dc/daa/d67/f61 [240693,60418] 0 2024-09-21T00:56:49.916 INFO:tasks.workunit.client.1.smithi187.stdout:5/999: mknod d0/dc/d1f/d26/d8b/c14a 0 2024-09-21T00:56:49.918 INFO:tasks.workunit.client.0.smithi112.stdout:4/455: truncate d1/d5/d1c/d1e/d3d/f48 1211561 0 2024-09-21T00:56:49.919 INFO:tasks.workunit.client.0.smithi112.stdout:4/456: truncate d1/d5/fd 8877360 0 2024-09-21T00:56:49.919 INFO:tasks.workunit.client.0.smithi112.stdout:8/362: link d0/d13/f3f d0/d13/d1b/d22/d42/d51/f69 0 2024-09-21T00:56:49.921 INFO:tasks.workunit.client.0.smithi112.stdout:8/363: write d0/d13/d1b/f68 [719998,112337] 0 2024-09-21T00:56:49.922 INFO:tasks.workunit.client.1.smithi187.stderr:+ rm -rf -- ./tmp.HFhvNpoQ2y 2024-09-21T00:56:49.922 INFO:tasks.workunit.client.0.smithi112.stdout:4/457: creat d1/d7/d9/d1a/f9a x:0 0 0 2024-09-21T00:56:49.922 INFO:tasks.workunit.client.0.smithi112.stdout:3/623: sync 2024-09-21T00:56:49.923 INFO:tasks.workunit.client.0.smithi112.stdout:3/624: write d2/d8/d28/d35/fcc [36326,43148] 0 2024-09-21T00:56:49.924 INFO:tasks.workunit.client.0.smithi112.stdout:4/458: fsync d1/d7/d9/f61 0 2024-09-21T00:56:49.928 INFO:tasks.workunit.client.0.smithi112.stdout:3/625: fsync d2/d8/dd/de/d4a/d4c/fa0 0 2024-09-21T00:56:49.929 INFO:tasks.workunit.client.0.smithi112.stdout:8/364: dwrite d0/f62 [0,4194304] 0 2024-09-21T00:56:49.931 INFO:tasks.workunit.client.0.smithi112.stdout:4/459: creat d1/d5/f9b x:0 0 0 2024-09-21T00:56:49.932 INFO:tasks.workunit.client.0.smithi112.stdout:4/460: readlink d1/d7/l53 0 2024-09-21T00:56:49.934 INFO:tasks.workunit.client.0.smithi112.stdout:8/365: creat d0/f6a x:0 0 0 2024-09-21T00:56:49.937 INFO:tasks.workunit.client.0.smithi112.stdout:3/626: dwrite d2/d8/dd/f89 [0,4194304] 0 2024-09-21T00:56:49.939 INFO:tasks.workunit.client.0.smithi112.stdout:4/461: mknod d1/d5/c9c 0 2024-09-21T00:56:49.941 INFO:tasks.workunit.client.0.smithi112.stdout:4/462: dread d1/d5/d1c/d1e/d3d/f80 [0,4194304] 0 2024-09-21T00:56:49.943 INFO:tasks.workunit.client.0.smithi112.stdout:3/627: dread d2/d8/dd/de/d4a/d4c/d7c/fb0 [0,4194304] 0 2024-09-21T00:56:49.946 INFO:tasks.workunit.client.0.smithi112.stdout:4/463: link d1/d5/d1c/d1e/d3d/f80 d1/d7/d9/d1a/d22/d6e/f9d 0 2024-09-21T00:56:49.949 INFO:tasks.workunit.client.0.smithi112.stdout:4/464: mknod d1/d7/d9/d1a/d22/d6e/c9e 0 2024-09-21T00:56:49.951 INFO:tasks.workunit.client.0.smithi112.stdout:3/628: dwrite d2/d8/dd/de/d6b/f8f [0,4194304] 0 2024-09-21T00:56:49.953 INFO:tasks.workunit.client.0.smithi112.stdout:3/629: write d2/d38/f4b [452550,72331] 0 2024-09-21T00:56:49.960 INFO:tasks.workunit.client.0.smithi112.stdout:1/303: truncate d5/d8/d10/f17 3101462 0 2024-09-21T00:56:49.963 INFO:tasks.workunit.client.0.smithi112.stdout:3/630: creat d2/d8/dd/de/fda x:0 0 0 2024-09-21T00:56:49.969 INFO:tasks.workunit.client.0.smithi112.stdout:1/304: link d5/d8/d10/d2e/c64 d5/d3a/d4b/c65 0 2024-09-21T00:56:49.972 INFO:tasks.workunit.client.0.smithi112.stdout:1/305: creat d5/d8/d13/d3e/d46/f66 x:0 0 0 2024-09-21T00:56:49.976 INFO:tasks.workunit.client.0.smithi112.stdout:8/366: dwrite d0/d13/d1b/d22/f31 [0,4194304] 0 2024-09-21T00:56:49.977 INFO:tasks.workunit.client.0.smithi112.stdout:4/465: write d1/d7/f2e [671960,72830] 0 2024-09-21T00:56:49.979 INFO:tasks.workunit.client.0.smithi112.stdout:4/466: readlink d1/d7/l57 0 2024-09-21T00:56:49.982 INFO:tasks.workunit.client.0.smithi112.stdout:3/631: dread d2/d8/d28/f41 [0,4194304] 0 2024-09-21T00:56:49.983 INFO:tasks.workunit.client.0.smithi112.stdout:8/367: getdents d0/d13/d1b/d22/d61 0 2024-09-21T00:56:49.983 INFO:tasks.workunit.client.0.smithi112.stdout:3/632: read d2/d8/dd/de/d6b/f8f [1790997,86979] 0 2024-09-21T00:56:49.986 INFO:tasks.workunit.client.0.smithi112.stdout:4/467: symlink d1/d5/d1c/d1e/l9f 0 2024-09-21T00:56:49.991 INFO:tasks.workunit.client.0.smithi112.stdout:3/633: dwrite d2/d8/dd/de/d4a/fbd [0,4194304] 0 2024-09-21T00:56:49.998 INFO:tasks.workunit.client.0.smithi112.stdout:4/468: creat d1/d5/d1c/fa0 x:0 0 0 2024-09-21T00:56:50.001 INFO:tasks.workunit.client.0.smithi112.stdout:4/469: fdatasync d1/d5/d1c/d1e/f20 0 2024-09-21T00:56:50.001 INFO:tasks.workunit.client.0.smithi112.stdout:1/306: dwrite d5/d8/f12 [4194304,4194304] 0 2024-09-21T00:56:50.006 INFO:tasks.workunit.client.0.smithi112.stdout:8/368: dwrite d0/d13/f3f [0,4194304] 0 2024-09-21T00:56:50.014 INFO:tasks.workunit.client.0.smithi112.stdout:4/470: mkdir d1/d7/d30/d91/da1 0 2024-09-21T00:56:50.015 INFO:tasks.workunit.client.0.smithi112.stdout:8/369: mkdir d0/d13/d1b/d22/d6b 0 2024-09-21T00:56:50.016 INFO:tasks.workunit.client.0.smithi112.stdout:3/634: dwrite d2/d8/d28/d35/f46 [0,4194304] 0 2024-09-21T00:56:50.017 INFO:tasks.workunit.client.0.smithi112.stdout:1/307: rename d5/l2b to d5/d8/d10/l67 0 2024-09-21T00:56:50.019 INFO:tasks.workunit.client.0.smithi112.stdout:8/370: symlink d0/d13/d1b/d22/d42/d51/l6c 0 2024-09-21T00:56:50.021 INFO:tasks.workunit.client.0.smithi112.stdout:1/308: unlink d5/f43 0 2024-09-21T00:56:50.025 INFO:tasks.workunit.client.0.smithi112.stdout:8/371: mkdir d0/d13/d1b/d22/d42/d6d 0 2024-09-21T00:56:50.026 INFO:tasks.workunit.client.0.smithi112.stdout:4/471: rmdir d1/d7/d30/d91/da1 0 2024-09-21T00:56:50.027 INFO:tasks.workunit.client.0.smithi112.stdout:4/472: chown d1/d5/c9c 165363 1 2024-09-21T00:56:50.029 INFO:tasks.workunit.client.0.smithi112.stdout:3/635: link d2/f58 d2/d8/d28/dac/fdb 0 2024-09-21T00:56:50.031 INFO:tasks.workunit.client.0.smithi112.stdout:4/473: creat d1/d2d/d34/fa2 x:0 0 0 2024-09-21T00:56:50.036 INFO:tasks.workunit.client.0.smithi112.stdout:3/636: write d2/d8/f16 [1773319,43555] 0 2024-09-21T00:56:50.036 INFO:tasks.workunit.client.0.smithi112.stdout:8/372: creat d0/d13/d2a/f6e x:0 0 0 2024-09-21T00:56:50.037 INFO:tasks.workunit.client.0.smithi112.stdout:3/637: dread - d2/d33/d8c/f76 zero size 2024-09-21T00:56:50.038 INFO:tasks.workunit.client.0.smithi112.stdout:3/638: chown d2/d8/d28 4013089 1 2024-09-21T00:56:50.039 INFO:tasks.workunit.client.0.smithi112.stdout:8/373: creat d0/d66/f6f x:0 0 0 2024-09-21T00:56:50.047 INFO:tasks.workunit.client.0.smithi112.stdout:3/639: symlink d2/d8/dd/de/d5c/d8a/ldc 0 2024-09-21T00:56:50.048 INFO:tasks.workunit.client.0.smithi112.stdout:3/640: creat d2/d38/d3f/d53/fdd x:0 0 0 2024-09-21T00:56:50.049 INFO:tasks.workunit.client.0.smithi112.stdout:3/641: fsync d2/d8/dd/f1f 0 2024-09-21T00:56:50.050 INFO:tasks.workunit.client.0.smithi112.stdout:1/309: truncate d5/d34/f4d 2692998 0 2024-09-21T00:56:50.052 INFO:tasks.workunit.client.0.smithi112.stdout:3/642: symlink d2/d33/d78/lde 0 2024-09-21T00:56:50.058 INFO:tasks.workunit.client.0.smithi112.stdout:3/643: dwrite d2/d8/d28/fab [0,4194304] 0 2024-09-21T00:56:50.059 INFO:tasks.workunit.client.0.smithi112.stdout:3/644: chown d2/d8/d28/d35/d9e 21143 1 2024-09-21T00:56:50.060 INFO:tasks.workunit.client.0.smithi112.stdout:3/645: fsync d2/d8/d28/fb3 0 2024-09-21T00:56:50.060 INFO:tasks.workunit.client.0.smithi112.stdout:8/374: truncate d0/f10 5911563 0 2024-09-21T00:56:50.065 INFO:tasks.workunit.client.0.smithi112.stdout:3/646: fsync d2/d8/dd/de/d6b/f8f 0 2024-09-21T00:56:50.067 INFO:tasks.workunit.client.0.smithi112.stdout:3/647: rmdir d2/d8/d28/d9d 39 2024-09-21T00:56:50.073 INFO:tasks.workunit.client.0.smithi112.stdout:3/648: truncate d2/d8/d28/f3c 19840 0 2024-09-21T00:56:50.076 INFO:tasks.workunit.client.0.smithi112.stdout:3/649: rmdir d2/d33/d8c 39 2024-09-21T00:56:50.083 INFO:tasks.workunit.client.0.smithi112.stdout:8/375: link d0/f10 d0/d13/d1b/f70 0 2024-09-21T00:56:50.085 INFO:tasks.workunit.client.0.smithi112.stdout:3/650: link d2/d33/c45 d2/d8/dd/de/d5c/cdf 0 2024-09-21T00:56:50.087 INFO:tasks.workunit.client.0.smithi112.stdout:8/376: creat d0/d13/d1b/d22/d6b/f71 x:0 0 0 2024-09-21T00:56:50.088 INFO:tasks.workunit.client.0.smithi112.stdout:8/377: read d0/fd [3368275,58093] 0 2024-09-21T00:56:50.089 INFO:tasks.workunit.client.0.smithi112.stdout:8/378: write d0/d13/f3f [4460506,64295] 0 2024-09-21T00:56:50.094 INFO:tasks.workunit.client.0.smithi112.stdout:8/379: dread - d0/d13/d2a/f45 zero size 2024-09-21T00:56:50.094 INFO:tasks.workunit.client.0.smithi112.stdout:8/380: stat d0/d13/d1b/d22/f4e 0 2024-09-21T00:56:50.098 INFO:tasks.workunit.client.0.smithi112.stdout:8/381: dread d0/d13/f27 [4194304,4194304] 0 2024-09-21T00:56:50.099 INFO:tasks.workunit.client.0.smithi112.stdout:8/382: fsync d0/d13/f29 0 2024-09-21T00:56:50.105 INFO:tasks.workunit.client.0.smithi112.stdout:8/383: rename d0/c6 to d0/d13/d1b/d22/d61/c72 0 2024-09-21T00:56:50.109 INFO:tasks.workunit.client.0.smithi112.stdout:8/384: dread d0/d13/d1b/d22/f31 [0,4194304] 0 2024-09-21T00:56:50.113 INFO:tasks.workunit.client.0.smithi112.stdout:3/651: dwrite d2/d8/d28/f3c [0,4194304] 0 2024-09-21T00:56:50.113 INFO:tasks.workunit.client.0.smithi112.stdout:8/385: mkdir d0/d13/d2a/d73 0 2024-09-21T00:56:50.117 INFO:tasks.workunit.client.0.smithi112.stdout:8/386: unlink d0/d13/d1b/d22/d42/d51/c57 0 2024-09-21T00:56:50.120 INFO:tasks.workunit.client.0.smithi112.stdout:8/387: mknod d0/d13/d1b/d22/d61/c74 0 2024-09-21T00:56:50.122 INFO:tasks.workunit.client.0.smithi112.stdout:3/652: rename d2/d3e/d7b/fd1 to d2/d8/d28/fe0 0 2024-09-21T00:56:50.122 INFO:tasks.workunit.client.0.smithi112.stdout:8/388: rmdir d0/d13/d1b/d22/d42/d51 39 2024-09-21T00:56:50.126 INFO:tasks.workunit.client.0.smithi112.stdout:3/653: mknod d2/d8/dd/de/d4a/ce1 0 2024-09-21T00:56:50.127 INFO:tasks.workunit.client.0.smithi112.stdout:8/389: mknod d0/d13/d1b/d22/d42/c75 0 2024-09-21T00:56:50.127 INFO:tasks.workunit.client.0.smithi112.stdout:8/390: chown d0/l3a 161 1 2024-09-21T00:56:50.128 INFO:tasks.workunit.client.0.smithi112.stdout:8/391: stat d0/d13/c14 0 2024-09-21T00:56:50.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/654: mkdir d2/d8/dd/de/d4a/d4c/de2 0 2024-09-21T00:56:50.132 INFO:tasks.workunit.client.0.smithi112.stdout:8/392: rename d0/f43 to d0/d13/d1b/d22/d42/d51/f76 0 2024-09-21T00:56:50.133 INFO:tasks.workunit.client.0.smithi112.stdout:3/655: mknod d2/d8/dd/de/ce3 0 2024-09-21T00:56:50.136 INFO:tasks.workunit.client.0.smithi112.stdout:3/656: write d2/d33/d8c/f76 [158559,88214] 0 2024-09-21T00:56:50.137 INFO:tasks.workunit.client.0.smithi112.stdout:8/393: mknod d0/d13/d1b/d22/d42/d6d/c77 0 2024-09-21T00:56:50.140 INFO:tasks.workunit.client.0.smithi112.stdout:8/394: chown d0/d13/d2a/f48 18 1 2024-09-21T00:56:50.144 INFO:tasks.workunit.client.0.smithi112.stdout:8/395: dread d0/d66/f50 [0,4194304] 0 2024-09-21T00:56:50.148 INFO:tasks.workunit.client.0.smithi112.stdout:8/396: link d0/f41 d0/d13/d1b/d22/d42/f78 0 2024-09-21T00:56:50.152 INFO:tasks.workunit.client.0.smithi112.stdout:3/657: dread d2/d8/dd/de/d4a/d4c/f6c [0,4194304] 0 2024-09-21T00:56:50.154 INFO:tasks.workunit.client.0.smithi112.stdout:3/658: write d2/d38/f4b [1750040,54825] 0 2024-09-21T00:56:50.156 INFO:tasks.workunit.client.0.smithi112.stdout:3/659: fdatasync d2/d8/d28/d35/fcc 0 2024-09-21T00:56:50.156 INFO:tasks.workunit.client.0.smithi112.stdout:8/397: dwrite d0/d13/d2a/f4d [0,4194304] 0 2024-09-21T00:56:50.165 INFO:tasks.workunit.client.0.smithi112.stdout:3/660: mknod d2/d8/dd/de/d4a/d4c/de2/ce4 0 2024-09-21T00:56:50.167 INFO:tasks.workunit.client.0.smithi112.stdout:8/398: creat d0/d13/d1b/d22/f79 x:0 0 0 2024-09-21T00:56:50.172 INFO:tasks.workunit.client.0.smithi112.stdout:3/661: truncate d2/d8/d28/dac/fdb 262083 0 2024-09-21T00:56:50.177 INFO:tasks.workunit.client.0.smithi112.stdout:2/374: sync 2024-09-21T00:56:50.177 INFO:tasks.workunit.client.0.smithi112.stdout:7/451: sync 2024-09-21T00:56:50.178 INFO:tasks.workunit.client.0.smithi112.stdout:2/375: dread - d0/df/d46/d58/f6e zero size 2024-09-21T00:56:50.184 INFO:tasks.workunit.client.0.smithi112.stdout:7/452: dwrite d0/d2/d2e/f8b [0,4194304] 0 2024-09-21T00:56:50.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/376: dread d0/df/f13 [0,4194304] 0 2024-09-21T00:56:50.187 INFO:tasks.workunit.client.0.smithi112.stdout:2/377: read d0/fe [2365130,116642] 0 2024-09-21T00:56:50.189 INFO:tasks.workunit.client.0.smithi112.stdout:7/453: creat d0/d2/d36/f90 x:0 0 0 2024-09-21T00:56:50.194 INFO:tasks.workunit.client.0.smithi112.stdout:2/378: fdatasync d0/d14/f32 0 2024-09-21T00:56:50.201 INFO:tasks.workunit.client.0.smithi112.stdout:2/379: dwrite d0/d51/f56 [0,4194304] 0 2024-09-21T00:56:50.206 INFO:tasks.workunit.client.0.smithi112.stdout:2/380: creat d0/df/f79 x:0 0 0 2024-09-21T00:56:50.211 INFO:tasks.workunit.client.0.smithi112.stdout:3/662: dwrite d2/f58 [0,4194304] 0 2024-09-21T00:56:50.213 INFO:tasks.workunit.client.0.smithi112.stdout:7/454: write d0/d2/d36/d39/f35 [1529336,121871] 0 2024-09-21T00:56:50.218 INFO:tasks.workunit.client.0.smithi112.stdout:3/663: truncate d2/d38/d3f/f49 395100 0 2024-09-21T00:56:50.226 INFO:tasks.workunit.client.0.smithi112.stdout:7/455: dwrite d0/d2/d36/d39/d1a/f4d [0,4194304] 0 2024-09-21T00:56:50.227 INFO:tasks.workunit.client.0.smithi112.stdout:3/664: dwrite d2/d8/d28/d35/f59 [0,4194304] 0 2024-09-21T00:56:50.228 INFO:tasks.workunit.client.0.smithi112.stdout:7/456: fsync d0/d2/f68 0 2024-09-21T00:56:50.229 INFO:tasks.workunit.client.0.smithi112.stdout:7/457: chown d0/d2/d32/f88 52107828 1 2024-09-21T00:56:50.232 INFO:tasks.workunit.client.0.smithi112.stdout:2/381: write d0/d14/d8/d27/f64 [877138,7963] 0 2024-09-21T00:56:50.233 INFO:tasks.workunit.client.0.smithi112.stdout:2/382: dread - d0/d60/f74 zero size 2024-09-21T00:56:50.233 INFO:tasks.workunit.client.0.smithi112.stdout:7/458: creat d0/d2/d38/d48/f91 x:0 0 0 2024-09-21T00:56:50.234 INFO:tasks.workunit.client.0.smithi112.stdout:7/459: write d0/d2/f7a [923627,80981] 0 2024-09-21T00:56:50.237 INFO:tasks.workunit.client.0.smithi112.stdout:7/460: fdatasync d0/d2/d2e/f8b 0 2024-09-21T00:56:50.240 INFO:tasks.workunit.client.0.smithi112.stdout:3/665: dwrite d2/d8/dd/de/f1c [0,4194304] 0 2024-09-21T00:56:50.241 INFO:tasks.workunit.client.0.smithi112.stdout:2/383: mkdir d0/d14/d8/d27/d7a 0 2024-09-21T00:56:50.242 INFO:tasks.workunit.client.0.smithi112.stdout:3/666: fdatasync d2/d38/d3f/d53/d96/fd9 0 2024-09-21T00:56:50.246 INFO:tasks.workunit.client.0.smithi112.stdout:2/384: rmdir d0 39 2024-09-21T00:56:50.248 INFO:tasks.workunit.client.0.smithi112.stdout:7/461: mkdir d0/d2/d92 0 2024-09-21T00:56:50.248 INFO:tasks.workunit.client.0.smithi112.stdout:7/462: read - d0/f67 zero size 2024-09-21T00:56:50.250 INFO:tasks.workunit.client.0.smithi112.stdout:3/667: unlink d2/d8/d28/d9d/f9f 0 2024-09-21T00:56:50.258 INFO:tasks.workunit.client.0.smithi112.stdout:2/385: dwrite d0/d60/f74 [0,4194304] 0 2024-09-21T00:56:50.260 INFO:tasks.workunit.client.0.smithi112.stdout:7/463: rename d0/d2/d36/f45 to d0/d2/d2e/f93 0 2024-09-21T00:56:50.261 INFO:tasks.workunit.client.0.smithi112.stdout:2/386: write d0/df/f79 [643638,44215] 0 2024-09-21T00:56:50.262 INFO:tasks.workunit.client.0.smithi112.stdout:3/668: dwrite d2/d8/d28/d35/fcc [0,4194304] 0 2024-09-21T00:56:50.267 INFO:tasks.workunit.client.0.smithi112.stdout:3/669: rmdir d2/d38 39 2024-09-21T00:56:50.269 INFO:tasks.workunit.client.0.smithi112.stdout:2/387: mknod d0/d14/d47/c7b 0 2024-09-21T00:56:50.271 INFO:tasks.workunit.client.0.smithi112.stdout:3/670: write d2/d38/fb6 [171452,56020] 0 2024-09-21T00:56:50.273 INFO:tasks.workunit.client.0.smithi112.stdout:2/388: read d0/fe [2162585,30663] 0 2024-09-21T00:56:50.275 INFO:tasks.workunit.client.0.smithi112.stdout:7/464: write d0/f46 [5201367,87752] 0 2024-09-21T00:56:50.276 INFO:tasks.workunit.client.0.smithi112.stdout:7/465: write d0/d2/d36/f90 [5882,122851] 0 2024-09-21T00:56:50.327 INFO:tasks.workunit.client.0.smithi112.stdout:0/373: sync 2024-09-21T00:56:50.327 INFO:tasks.workunit.client.0.smithi112.stdout:5/304: sync 2024-09-21T00:56:50.328 INFO:tasks.workunit.client.0.smithi112.stdout:3/671: unlink d2/l1b 0 2024-09-21T00:56:50.330 INFO:tasks.workunit.client.0.smithi112.stdout:2/389: truncate d0/d14/f19 225943 0 2024-09-21T00:56:50.331 INFO:tasks.workunit.client.0.smithi112.stdout:7/466: creat d0/d2/d36/d39/d1a/d23/f94 x:0 0 0 2024-09-21T00:56:50.332 INFO:tasks.workunit.client.0.smithi112.stdout:3/672: mknod d2/d8/dd/de/d4a/d4c/d7c/ce5 0 2024-09-21T00:56:50.334 INFO:tasks.workunit.client.0.smithi112.stdout:5/305: dwrite d8/d9/d13/d2a/df/f10 [0,4194304] 0 2024-09-21T00:56:50.336 INFO:tasks.workunit.client.0.smithi112.stdout:2/390: symlink d0/d60/d78/l7c 0 2024-09-21T00:56:50.337 INFO:tasks.workunit.client.0.smithi112.stdout:5/306: read f7 [535702,90556] 0 2024-09-21T00:56:50.343 INFO:tasks.workunit.client.0.smithi112.stdout:7/467: creat d0/f95 x:0 0 0 2024-09-21T00:56:50.344 INFO:tasks.workunit.client.0.smithi112.stdout:5/307: dwrite d8/d9/d13/d2a/d2c/f2f [0,4194304] 0 2024-09-21T00:56:50.351 INFO:tasks.workunit.client.0.smithi112.stdout:5/308: mknod d8/d9/d13/d2a/df/d5b/c67 0 2024-09-21T00:56:50.351 INFO:tasks.workunit.client.0.smithi112.stdout:5/309: readlink d8/d9/l3e 0 2024-09-21T00:56:50.352 INFO:tasks.workunit.client.0.smithi112.stdout:5/310: truncate d8/d9/f28 2218395 0 2024-09-21T00:56:50.353 INFO:tasks.workunit.client.0.smithi112.stdout:2/391: getdents d0/d45 0 2024-09-21T00:56:50.354 INFO:tasks.workunit.client.0.smithi112.stdout:5/311: read d8/d9/d13/d2a/df/f10 [611298,28731] 0 2024-09-21T00:56:50.355 INFO:tasks.workunit.client.0.smithi112.stdout:5/312: read - d8/f3f zero size 2024-09-21T00:56:50.356 INFO:tasks.workunit.client.0.smithi112.stdout:5/313: stat d8/d9/d13/c37 0 2024-09-21T00:56:50.372 INFO:tasks.workunit.client.0.smithi112.stdout:5/314: link d8/d9/d13/d2a/d2c/l47 d8/d9/d13/d1c/d45/l68 0 2024-09-21T00:56:50.378 INFO:tasks.workunit.client.0.smithi112.stdout:5/315: dread d8/d9/f28 [0,4194304] 0 2024-09-21T00:56:50.378 INFO:tasks.workunit.client.0.smithi112.stdout:2/392: dread d0/f3c [0,4194304] 0 2024-09-21T00:56:50.379 INFO:tasks.workunit.client.0.smithi112.stdout:5/316: dread - d8/d9/d13/d2a/d2c/d49/f65 zero size 2024-09-21T00:56:50.383 INFO:tasks.workunit.client.0.smithi112.stdout:2/393: rename d0/c6 to d0/d51/c7d 0 2024-09-21T00:56:50.383 INFO:tasks.workunit.client.0.smithi112.stdout:7/468: write d0/d2/d38/f43 [2401753,50206] 0 2024-09-21T00:56:50.384 INFO:tasks.workunit.client.0.smithi112.stdout:5/317: dwrite d8/f5f [0,4194304] 0 2024-09-21T00:56:50.393 INFO:tasks.workunit.client.0.smithi112.stdout:5/318: creat d8/d9/d13/d2a/d2c/f69 x:0 0 0 2024-09-21T00:56:50.394 INFO:tasks.workunit.client.0.smithi112.stdout:5/319: readlink d8/d9/d13/d2a/l62 0 2024-09-21T00:56:50.398 INFO:tasks.workunit.client.0.smithi112.stdout:7/469: rename d0/d2/d36/d39/l1b to d0/d2/d36/d39/d1a/d23/l96 0 2024-09-21T00:56:50.409 INFO:tasks.workunit.client.0.smithi112.stdout:5/320: dread d8/d9/d40/f42 [0,4194304] 0 2024-09-21T00:56:50.410 INFO:tasks.workunit.client.0.smithi112.stdout:5/321: fdatasync d8/f4b 0 2024-09-21T00:56:50.411 INFO:tasks.workunit.client.0.smithi112.stdout:5/322: chown d8/d9/d40/f41 106471109 1 2024-09-21T00:56:50.411 INFO:tasks.workunit.client.0.smithi112.stdout:2/394: dwrite d0/fe [0,4194304] 0 2024-09-21T00:56:50.415 INFO:tasks.workunit.client.0.smithi112.stdout:2/395: creat d0/d14/d22/f7e x:0 0 0 2024-09-21T00:56:50.415 INFO:tasks.workunit.client.0.smithi112.stdout:2/396: chown d0/df/c30 133627977 1 2024-09-21T00:56:50.417 INFO:tasks.workunit.client.0.smithi112.stdout:5/323: read d8/f1a [65142,20078] 0 2024-09-21T00:56:50.418 INFO:tasks.workunit.client.0.smithi112.stdout:2/397: truncate d0/f5 22210 0 2024-09-21T00:56:50.418 INFO:tasks.workunit.client.0.smithi112.stdout:2/398: chown d0/f67 0 1 2024-09-21T00:56:50.419 INFO:tasks.workunit.client.0.smithi112.stdout:5/324: mknod d8/d9/d13/d1c/c6a 0 2024-09-21T00:56:50.421 INFO:tasks.workunit.client.0.smithi112.stdout:5/325: mknod d8/d9/d40/c6b 0 2024-09-21T00:56:50.421 INFO:tasks.workunit.client.0.smithi112.stdout:5/326: read - d8/d9/f5d zero size 2024-09-21T00:56:50.423 INFO:tasks.workunit.client.0.smithi112.stdout:5/327: mknod d8/d9/d13/d2a/df/c6c 0 2024-09-21T00:56:50.425 INFO:tasks.workunit.client.0.smithi112.stdout:5/328: creat d8/d9/d13/d2a/f6d x:0 0 0 2024-09-21T00:56:50.427 INFO:tasks.workunit.client.0.smithi112.stdout:5/329: creat d8/d9/d13/d2a/d2c/d49/f6e x:0 0 0 2024-09-21T00:56:50.427 INFO:tasks.workunit.client.0.smithi112.stdout:5/330: chown d8 2410454 1 2024-09-21T00:56:50.429 INFO:tasks.workunit.client.0.smithi112.stdout:5/331: symlink d8/d9/d13/l6f 0 2024-09-21T00:56:50.430 INFO:tasks.workunit.client.0.smithi112.stdout:5/332: fdatasync d8/d9/d13/d2a/d2c/d49/f63 0 2024-09-21T00:56:50.439 INFO:tasks.workunit.client.0.smithi112.stdout:2/399: write d0/f18 [1613959,35869] 0 2024-09-21T00:56:50.440 INFO:tasks.workunit.client.0.smithi112.stdout:2/400: readlink d0/d14/d8/l11 0 2024-09-21T00:56:50.445 INFO:tasks.workunit.client.0.smithi112.stdout:2/401: getdents d0/d14/d8/d27 0 2024-09-21T00:56:50.447 INFO:tasks.workunit.client.0.smithi112.stdout:2/402: write d0/d51/d62/f65 [1180312,89099] 0 2024-09-21T00:56:50.449 INFO:tasks.workunit.client.0.smithi112.stdout:5/333: dwrite d8/d9/d40/f50 [0,4194304] 0 2024-09-21T00:56:50.452 INFO:tasks.workunit.client.0.smithi112.stdout:2/403: unlink d0/d14/d8/d27/f38 0 2024-09-21T00:56:50.453 INFO:tasks.workunit.client.0.smithi112.stdout:5/334: mknod d8/d9/d13/d2a/d2c/d49/c70 0 2024-09-21T00:56:50.455 INFO:tasks.workunit.client.0.smithi112.stdout:2/404: creat d0/d60/d78/f7f x:0 0 0 2024-09-21T00:56:50.456 INFO:tasks.workunit.client.0.smithi112.stdout:2/405: write d0/df/f79 [1359413,49643] 0 2024-09-21T00:56:50.457 INFO:tasks.workunit.client.0.smithi112.stdout:2/406: chown d0/f67 12 1 2024-09-21T00:56:50.457 INFO:tasks.workunit.client.0.smithi112.stdout:2/407: chown d0 1 1 2024-09-21T00:56:50.466 INFO:tasks.workunit.client.0.smithi112.stdout:5/335: write d8/d9/d13/d2a/d58/f5e [2113,79365] 0 2024-09-21T00:56:50.473 INFO:tasks.workunit.client.0.smithi112.stdout:2/408: dwrite d0/f5 [0,4194304] 0 2024-09-21T00:56:50.475 INFO:tasks.workunit.client.0.smithi112.stdout:2/409: truncate d0/d14/f4e 923128 0 2024-09-21T00:56:50.476 INFO:tasks.workunit.client.0.smithi112.stdout:2/410: unlink d0/f18 0 2024-09-21T00:56:50.479 INFO:tasks.workunit.client.0.smithi112.stdout:2/411: truncate d0/d14/d8/d27/f2a 4763451 0 2024-09-21T00:56:50.480 INFO:tasks.workunit.client.0.smithi112.stdout:2/412: chown d0/d51/d62 725879 1 2024-09-21T00:56:50.483 INFO:tasks.workunit.client.0.smithi112.stdout:2/413: creat d0/d14/f80 x:0 0 0 2024-09-21T00:56:50.486 INFO:tasks.workunit.client.0.smithi112.stdout:5/336: dread d8/d9/d13/d2a/f18 [0,4194304] 0 2024-09-21T00:56:50.487 INFO:tasks.workunit.client.0.smithi112.stdout:5/337: mknod d8/d9/d13/d2a/df/d5b/c71 0 2024-09-21T00:56:50.488 INFO:tasks.workunit.client.0.smithi112.stdout:2/414: link d0/d51/d62/l6b d0/d60/d78/l81 0 2024-09-21T00:56:50.489 INFO:tasks.workunit.client.0.smithi112.stdout:5/338: creat d8/d9/d13/d2a/df/f72 x:0 0 0 2024-09-21T00:56:50.490 INFO:tasks.workunit.client.0.smithi112.stdout:2/415: dread - d0/d14/d8/f1a zero size 2024-09-21T00:56:50.490 INFO:tasks.workunit.client.0.smithi112.stdout:2/416: stat d0/d14/f73 0 2024-09-21T00:56:50.491 INFO:tasks.workunit.client.0.smithi112.stdout:2/417: chown d0/d14/d8/l11 104 1 2024-09-21T00:56:50.492 INFO:tasks.workunit.client.0.smithi112.stdout:5/339: dread d8/d9/d13/d2a/f38 [0,4194304] 0 2024-09-21T00:56:50.495 INFO:tasks.workunit.client.0.smithi112.stdout:5/340: creat d8/d9/d13/d2a/d58/f73 x:0 0 0 2024-09-21T00:56:50.501 INFO:tasks.workunit.client.0.smithi112.stdout:5/341: dwrite d8/d9/d13/d2a/f3b [0,4194304] 0 2024-09-21T00:56:50.505 INFO:tasks.workunit.client.0.smithi112.stdout:9/487: sync 2024-09-21T00:56:50.505 INFO:tasks.workunit.client.0.smithi112.stdout:6/401: sync 2024-09-21T00:56:50.509 INFO:tasks.workunit.client.0.smithi112.stdout:5/342: getdents d8/d9/d13/d1c 0 2024-09-21T00:56:50.510 INFO:tasks.workunit.client.0.smithi112.stdout:6/402: dread d9/d13/d21/d4c/f78 [0,4194304] 0 2024-09-21T00:56:50.513 INFO:tasks.workunit.client.0.smithi112.stdout:9/488: dwrite d5/d6/d19/f33 [0,4194304] 0 2024-09-21T00:56:50.515 INFO:tasks.workunit.client.0.smithi112.stdout:9/489: stat d5/d6/d3f/d7f 0 2024-09-21T00:56:50.520 INFO:tasks.workunit.client.0.smithi112.stdout:6/403: dwrite d9/d13/d26/f3d [4194304,4194304] 0 2024-09-21T00:56:50.521 INFO:tasks.workunit.client.0.smithi112.stdout:2/418: dread d0/f53 [0,4194304] 0 2024-09-21T00:56:50.521 INFO:tasks.workunit.client.0.smithi112.stdout:6/404: dread - d9/d1f/d3e/f7e zero size 2024-09-21T00:56:50.547 INFO:tasks.workunit.client.0.smithi112.stdout:5/343: dread d8/fa [0,4194304] 0 2024-09-21T00:56:50.547 INFO:tasks.workunit.client.0.smithi112.stdout:2/419: truncate d0/f5 2798146 0 2024-09-21T00:56:50.548 INFO:tasks.workunit.client.0.smithi112.stdout:5/344: stat d8/d9/d13/f39 0 2024-09-21T00:56:50.548 INFO:tasks.workunit.client.0.smithi112.stdout:2/420: dread - d0/df/d46/d58/f6e zero size 2024-09-21T00:56:50.549 INFO:tasks.workunit.client.0.smithi112.stdout:2/421: chown d0/fe 1200797 1 2024-09-21T00:56:50.549 INFO:tasks.workunit.client.0.smithi112.stdout:6/405: truncate d9/d13/d26/f3d 576099 0 2024-09-21T00:56:50.554 INFO:tasks.workunit.client.0.smithi112.stdout:6/406: stat d9/d1f/d3e/d77/d23/f76 0 2024-09-21T00:56:50.555 INFO:tasks.workunit.client.0.smithi112.stdout:6/407: stat d9/d1f/d3e/d6f/c8d 0 2024-09-21T00:56:50.558 INFO:tasks.workunit.client.0.smithi112.stdout:5/345: dwrite d8/d9/d13/d2a/d58/f73 [0,4194304] 0 2024-09-21T00:56:50.566 INFO:tasks.workunit.client.0.smithi112.stdout:5/346: dwrite d8/d9/d13/d2a/df/f10 [0,4194304] 0 2024-09-21T00:56:50.567 INFO:tasks.workunit.client.0.smithi112.stdout:5/347: fsync d8/d9/f5d 0 2024-09-21T00:56:50.572 INFO:tasks.workunit.client.0.smithi112.stdout:6/408: chown d9/df/d56/d33/c57 5069221 1 2024-09-21T00:56:50.574 INFO:tasks.workunit.client.0.smithi112.stdout:5/348: mknod d8/d9/d40/c74 0 2024-09-21T00:56:50.574 INFO:tasks.workunit.client.0.smithi112.stdout:6/409: rmdir d9/d13/d31/d41 39 2024-09-21T00:56:50.579 INFO:tasks.workunit.client.0.smithi112.stdout:6/410: creat d9/d1f/d3e/d77/f96 x:0 0 0 2024-09-21T00:56:50.586 INFO:tasks.workunit.client.0.smithi112.stdout:6/411: symlink d9/d1f/d3e/d77/d79/d85/l97 0 2024-09-21T00:56:50.587 INFO:tasks.workunit.client.0.smithi112.stdout:6/412: stat d9/f20 0 2024-09-21T00:56:50.599 INFO:tasks.workunit.client.0.smithi112.stdout:6/413: dread d9/df/d7a/f7b [0,4194304] 0 2024-09-21T00:56:50.602 INFO:tasks.workunit.client.0.smithi112.stdout:6/414: dread - d9/d1f/d3e/f54 zero size 2024-09-21T00:56:50.604 INFO:tasks.workunit.client.0.smithi112.stdout:6/415: mknod d9/d1f/d3e/d6f/c98 0 2024-09-21T00:56:50.612 INFO:tasks.workunit.client.0.smithi112.stdout:2/422: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:50.612 INFO:tasks.workunit.client.0.smithi112.stdout:2/423: stat d0/c39 0 2024-09-21T00:56:50.617 INFO:tasks.workunit.client.0.smithi112.stdout:5/349: write d8/d9/d13/f51 [723285,16977] 0 2024-09-21T00:56:50.620 INFO:tasks.workunit.client.0.smithi112.stdout:5/350: chown d8/d9/d13/d2a/d2c/l47 1512 1 2024-09-21T00:56:50.620 INFO:tasks.workunit.client.0.smithi112.stdout:5/351: chown d8/d9/d13/d2a 443164768 1 2024-09-21T00:56:50.621 INFO:tasks.workunit.client.0.smithi112.stdout:5/352: fsync d8/d9/d13/d1c/f53 0 2024-09-21T00:56:50.625 INFO:tasks.workunit.client.0.smithi112.stdout:5/353: mkdir d8/d9/d13/d2a/df/d5b/d75 0 2024-09-21T00:56:50.625 INFO:tasks.workunit.client.0.smithi112.stdout:5/354: stat d8/f3f 0 2024-09-21T00:56:50.632 INFO:tasks.workunit.client.0.smithi112.stdout:6/416: truncate d9/df/f27 1699524 0 2024-09-21T00:56:50.641 INFO:tasks.workunit.client.0.smithi112.stdout:5/355: write d8/f1a [152652,108355] 0 2024-09-21T00:56:50.642 INFO:tasks.workunit.client.0.smithi112.stdout:5/356: readlink d8/d9/d13/l6f 0 2024-09-21T00:56:50.643 INFO:tasks.workunit.client.0.smithi112.stdout:2/424: dwrite d0/d14/d8/f1a [0,4194304] 0 2024-09-21T00:56:50.702 INFO:tasks.workunit.client.0.smithi112.stdout:4/474: sync 2024-09-21T00:56:50.702 INFO:tasks.workunit.client.0.smithi112.stdout:1/310: sync 2024-09-21T00:56:50.743 INFO:tasks.workunit.client.0.smithi112.stdout:6/417: dread d9/df/f59 [0,4194304] 0 2024-09-21T00:56:50.745 INFO:tasks.workunit.client.0.smithi112.stdout:5/357: creat d8/d9/d13/d2a/d2c/f76 x:0 0 0 2024-09-21T00:56:50.749 INFO:tasks.workunit.client.0.smithi112.stdout:1/311: unlink d5/d8/d13/d3e/d46/f51 0 2024-09-21T00:56:50.751 INFO:tasks.workunit.client.0.smithi112.stdout:2/425: dwrite d0/d60/d78/f7f [0,4194304] 0 2024-09-21T00:56:50.753 INFO:tasks.workunit.client.0.smithi112.stdout:4/475: write d1/d7/d9/f5a [3349634,37078] 0 2024-09-21T00:56:50.755 INFO:tasks.workunit.client.0.smithi112.stdout:6/418: dwrite d9/d1f/d3e/d77/d46/f93 [0,4194304] 0 2024-09-21T00:56:50.760 INFO:tasks.workunit.client.0.smithi112.stdout:5/358: dread d8/d9/d13/f48 [0,4194304] 0 2024-09-21T00:56:50.762 INFO:tasks.workunit.client.0.smithi112.stdout:4/476: creat d1/d5/d1c/d1e/d3d/fa3 x:0 0 0 2024-09-21T00:56:50.763 INFO:tasks.workunit.client.0.smithi112.stdout:4/477: read - d1/d5/f9b zero size 2024-09-21T00:56:50.763 INFO:tasks.workunit.client.0.smithi112.stdout:6/419: mkdir d9/d1f/d3e/d77/d46/d99 0 2024-09-21T00:56:50.769 INFO:tasks.workunit.client.0.smithi112.stdout:6/420: dwrite d9/df/d56/f7d [0,4194304] 0 2024-09-21T00:56:50.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/421: read d9/df/d7a/f7b [2413829,15550] 0 2024-09-21T00:56:50.846 INFO:tasks.workunit.client.0.smithi112.stdout:1/312: mkdir d5/d68 0 2024-09-21T00:56:50.847 INFO:tasks.workunit.client.0.smithi112.stdout:1/313: fsync d5/d8/f3d 0 2024-09-21T00:56:50.852 INFO:tasks.workunit.client.0.smithi112.stdout:5/359: symlink d8/d9/l77 0 2024-09-21T00:56:50.855 INFO:tasks.workunit.client.0.smithi112.stdout:1/314: rename d5/d3a/f3c to d5/d8/d14/f69 0 2024-09-21T00:56:50.856 INFO:tasks.workunit.client.0.smithi112.stdout:4/478: dread d1/d7/d30/f44 [0,4194304] 0 2024-09-21T00:56:50.861 INFO:tasks.workunit.client.0.smithi112.stdout:1/315: dwrite d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:50.862 INFO:tasks.workunit.client.0.smithi112.stdout:4/479: creat d1/d5/d1c/fa4 x:0 0 0 2024-09-21T00:56:50.863 INFO:tasks.workunit.client.0.smithi112.stdout:5/360: symlink d8/d9/d13/l78 0 2024-09-21T00:56:50.865 INFO:tasks.workunit.client.0.smithi112.stdout:5/361: write d8/d9/d13/d1c/f53 [180395,28753] 0 2024-09-21T00:56:50.867 INFO:tasks.workunit.client.0.smithi112.stdout:5/362: chown d8/d9/d13/d2a/d2c/d49 130706 1 2024-09-21T00:56:50.867 INFO:tasks.workunit.client.0.smithi112.stdout:4/480: mknod d1/d2d/ca5 0 2024-09-21T00:56:50.871 INFO:tasks.workunit.client.0.smithi112.stdout:6/422: getdents d9/d13/d31/d41 0 2024-09-21T00:56:50.875 INFO:tasks.workunit.client.0.smithi112.stdout:4/481: dwrite d1/d5/d1c/d1e/f20 [0,4194304] 0 2024-09-21T00:56:50.877 INFO:tasks.workunit.client.0.smithi112.stdout:1/316: getdents d5/d8/dd/d54 0 2024-09-21T00:56:50.877 INFO:tasks.workunit.client.0.smithi112.stdout:6/423: mkdir d9/d1f/d3e/d9a 0 2024-09-21T00:56:50.877 INFO:tasks.workunit.client.0.smithi112.stdout:6/424: chown d9/d1f/d47 566 1 2024-09-21T00:56:50.878 INFO:tasks.workunit.client.0.smithi112.stdout:6/425: readlink d9/d13/d21/d4c/l89 0 2024-09-21T00:56:50.884 INFO:tasks.workunit.client.0.smithi112.stdout:4/482: getdents d1/d7/d30/d91 0 2024-09-21T00:56:50.885 INFO:tasks.workunit.client.0.smithi112.stdout:6/426: dread d9/d1f/d3e/d77/d46/f93 [0,4194304] 0 2024-09-21T00:56:50.885 INFO:tasks.workunit.client.0.smithi112.stdout:1/317: dread d5/d34/f36 [0,4194304] 0 2024-09-21T00:56:50.891 INFO:tasks.workunit.client.0.smithi112.stdout:4/483: dwrite d1/d7/f28 [4194304,4194304] 0 2024-09-21T00:56:50.891 INFO:tasks.workunit.client.0.smithi112.stdout:8/399: sync 2024-09-21T00:56:50.893 INFO:tasks.workunit.client.0.smithi112.stdout:4/484: write d1/d7/d9/d1a/f9a [653150,82564] 0 2024-09-21T00:56:50.895 INFO:tasks.workunit.client.0.smithi112.stdout:6/427: creat d9/d13/d21/d4c/f9b x:0 0 0 2024-09-21T00:56:50.897 INFO:tasks.workunit.client.0.smithi112.stdout:5/363: dread d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:56:50.897 INFO:tasks.workunit.client.0.smithi112.stdout:6/428: write d9/d13/d21/d4c/f9b [262407,70289] 0 2024-09-21T00:56:50.898 INFO:tasks.workunit.client.0.smithi112.stdout:6/429: dread - d9/d13/d26/f8a zero size 2024-09-21T00:56:50.901 INFO:tasks.workunit.client.0.smithi112.stdout:6/430: fsync d9/d1f/d3e/d77/d23/f75 0 2024-09-21T00:56:50.904 INFO:tasks.workunit.client.0.smithi112.stdout:4/485: creat d1/fa6 x:0 0 0 2024-09-21T00:56:50.905 INFO:tasks.workunit.client.0.smithi112.stdout:5/364: dwrite d8/f3f [0,4194304] 0 2024-09-21T00:56:50.906 INFO:tasks.workunit.client.0.smithi112.stdout:5/365: chown d8/f30 17 1 2024-09-21T00:56:50.907 INFO:tasks.workunit.client.0.smithi112.stdout:6/431: mknod d9/d13/d21/d84/c9c 0 2024-09-21T00:56:50.912 INFO:tasks.workunit.client.0.smithi112.stdout:4/486: creat d1/d5/d1c/d1e/fa7 x:0 0 0 2024-09-21T00:56:50.913 INFO:tasks.workunit.client.0.smithi112.stdout:4/487: dread - d1/d5/f9b zero size 2024-09-21T00:56:50.914 INFO:tasks.workunit.client.0.smithi112.stdout:6/432: creat d9/d1f/d47/d74/d8e/f9d x:0 0 0 2024-09-21T00:56:50.914 INFO:tasks.workunit.client.0.smithi112.stdout:5/366: dwrite d8/d9/f64 [0,4194304] 0 2024-09-21T00:56:50.915 INFO:tasks.workunit.client.0.smithi112.stdout:5/367: dread - d8/d9/d13/d1c/f54 zero size 2024-09-21T00:56:50.917 INFO:tasks.workunit.client.0.smithi112.stdout:1/318: truncate d5/d8/d10/f1d 340266 0 2024-09-21T00:56:50.918 INFO:tasks.workunit.client.0.smithi112.stdout:1/319: dread - d5/d8/d14/f3b zero size 2024-09-21T00:56:50.920 INFO:tasks.workunit.client.0.smithi112.stdout:8/400: write d0/d13/d1b/f70 [249645,119903] 0 2024-09-21T00:56:50.924 INFO:tasks.workunit.client.0.smithi112.stdout:5/368: dwrite d8/d9/d13/d2a/d2c/d49/f6e [0,4194304] 0 2024-09-21T00:56:50.924 INFO:tasks.workunit.client.0.smithi112.stdout:4/488: readlink d1/d2d/l3f 0 2024-09-21T00:56:50.928 INFO:tasks.workunit.client.0.smithi112.stdout:5/369: truncate d8/d9/f27 1546770 0 2024-09-21T00:56:50.933 INFO:tasks.workunit.client.0.smithi112.stdout:8/401: dread d0/d13/d1b/f53 [0,4194304] 0 2024-09-21T00:56:50.937 INFO:tasks.workunit.client.0.smithi112.stdout:6/433: write d9/d1f/d3e/f54 [516454,53676] 0 2024-09-21T00:56:50.939 INFO:tasks.workunit.client.0.smithi112.stdout:4/489: dwrite d1/d5/d1c/fa0 [0,4194304] 0 2024-09-21T00:56:50.940 INFO:tasks.workunit.client.0.smithi112.stdout:8/402: mknod d0/d13/c7a 0 2024-09-21T00:56:50.942 INFO:tasks.workunit.client.0.smithi112.stdout:1/320: dwrite d5/d8/d14/f69 [0,4194304] 0 2024-09-21T00:56:50.945 INFO:tasks.workunit.client.0.smithi112.stdout:5/370: dwrite d8/d9/d13/d2a/d2c/f69 [0,4194304] 0 2024-09-21T00:56:50.950 INFO:tasks.workunit.client.0.smithi112.stdout:4/490: creat d1/d5/d1c/d1e/d3d/fa8 x:0 0 0 2024-09-21T00:56:50.954 INFO:tasks.workunit.client.0.smithi112.stdout:8/403: rename d0/d13/d1b/d22/d6b to d0/d13/d1b/d22/d2e/d34/d7b 0 2024-09-21T00:56:50.955 INFO:tasks.workunit.client.0.smithi112.stdout:1/321: dwrite d5/d8/f3d [0,4194304] 0 2024-09-21T00:56:50.958 INFO:tasks.workunit.client.0.smithi112.stdout:5/371: symlink d8/d9/d13/d2a/d2c/l79 0 2024-09-21T00:56:50.963 INFO:tasks.workunit.client.0.smithi112.stdout:1/322: mkdir d5/d34/d6a 0 2024-09-21T00:56:50.963 INFO:tasks.workunit.client.0.smithi112.stdout:4/491: creat d1/d7/d9/d1a/d8e/fa9 x:0 0 0 2024-09-21T00:56:50.963 INFO:tasks.workunit.client.0.smithi112.stdout:8/404: getdents d0/d13/d2a/d73 0 2024-09-21T00:56:50.963 INFO:tasks.workunit.client.0.smithi112.stdout:1/323: chown d5/d8/d13/f53 37609 1 2024-09-21T00:56:50.964 INFO:tasks.workunit.client.0.smithi112.stdout:4/492: dread - d1/d5/f9b zero size 2024-09-21T00:56:50.970 INFO:tasks.workunit.client.0.smithi112.stdout:8/405: creat d0/d13/d1b/d22/f7c x:0 0 0 2024-09-21T00:56:50.971 INFO:tasks.workunit.client.0.smithi112.stdout:8/406: write d0/d13/f16 [1406701,71023] 0 2024-09-21T00:56:50.972 INFO:tasks.workunit.client.0.smithi112.stdout:4/493: rename d1/d7/d9/d1a/c24 to d1/d7/d9/d1a/d8e/caa 0 2024-09-21T00:56:50.973 INFO:tasks.workunit.client.0.smithi112.stdout:1/324: getdents d5/d8/d13/d3e/d46 0 2024-09-21T00:56:50.974 INFO:tasks.workunit.client.0.smithi112.stdout:1/325: write d5/d8/d10/f29 [1169668,123106] 0 2024-09-21T00:56:50.975 INFO:tasks.workunit.client.0.smithi112.stdout:8/407: rmdir d0/d13/d1b/d22/d42 39 2024-09-21T00:56:50.976 INFO:tasks.workunit.client.0.smithi112.stdout:8/408: write d0/d13/d2a/f5f [5198577,7331] 0 2024-09-21T00:56:50.976 INFO:tasks.workunit.client.0.smithi112.stdout:4/494: creat d1/d7/d9/d1a/d22/d6e/fab x:0 0 0 2024-09-21T00:56:50.979 INFO:tasks.workunit.client.0.smithi112.stdout:4/495: write d1/d7/d9/d1a/d22/f72 [839784,71070] 0 2024-09-21T00:56:50.980 INFO:tasks.workunit.client.0.smithi112.stdout:4/496: chown d1/d7/l57 14 1 2024-09-21T00:56:50.981 INFO:tasks.workunit.client.0.smithi112.stdout:8/409: rename d0/l5 to d0/d66/l7d 0 2024-09-21T00:56:50.982 INFO:tasks.workunit.client.0.smithi112.stdout:1/326: mknod d5/d8/c6b 0 2024-09-21T00:56:50.982 INFO:tasks.workunit.client.0.smithi112.stdout:8/410: chown d0/d13/d1b/d22/l4a 37768591 1 2024-09-21T00:56:50.984 INFO:tasks.workunit.client.0.smithi112.stdout:4/497: mknod d1/d7/d30/d91/cac 0 2024-09-21T00:56:50.986 INFO:tasks.workunit.client.0.smithi112.stdout:1/327: unlink d5/d8/d13/c1b 0 2024-09-21T00:56:50.988 INFO:tasks.workunit.client.0.smithi112.stdout:4/498: rmdir d1/d7/d9/d1a 39 2024-09-21T00:56:50.990 INFO:tasks.workunit.client.0.smithi112.stdout:1/328: mknod d5/d3a/c6c 0 2024-09-21T00:56:50.991 INFO:tasks.workunit.client.0.smithi112.stdout:8/411: symlink d0/d13/d2a/d73/l7e 0 2024-09-21T00:56:50.991 INFO:tasks.workunit.client.0.smithi112.stdout:1/329: write d5/d8/d14/f3b [638259,23910] 0 2024-09-21T00:56:50.993 INFO:tasks.workunit.client.0.smithi112.stdout:1/330: write d5/d8/f35 [811389,88737] 0 2024-09-21T00:56:50.999 INFO:tasks.workunit.client.0.smithi112.stdout:4/499: fsync d1/d2d/f8f 0 2024-09-21T00:56:51.000 INFO:tasks.workunit.client.0.smithi112.stdout:4/500: write d1/d7/f17 [482252,40384] 0 2024-09-21T00:56:51.010 INFO:tasks.workunit.client.0.smithi112.stdout:4/501: mknod d1/d7/d9/d1a/d22/d6e/cad 0 2024-09-21T00:56:51.014 INFO:tasks.workunit.client.0.smithi112.stdout:1/331: dread d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:51.017 INFO:tasks.workunit.client.0.smithi112.stdout:1/332: symlink d5/d8/dd/l6d 0 2024-09-21T00:56:51.020 INFO:tasks.workunit.client.0.smithi112.stdout:8/412: dwrite d0/d66/f40 [0,4194304] 0 2024-09-21T00:56:51.022 INFO:tasks.workunit.client.0.smithi112.stdout:4/502: dwrite d1/d2d/d34/fa2 [0,4194304] 0 2024-09-21T00:56:51.026 INFO:tasks.workunit.client.0.smithi112.stdout:8/413: symlink d0/d13/d2a/d73/l7f 0 2024-09-21T00:56:51.029 INFO:tasks.workunit.client.0.smithi112.stdout:4/503: unlink d1/d5/l7c 0 2024-09-21T00:56:51.033 INFO:tasks.workunit.client.0.smithi112.stdout:8/414: mkdir d0/d13/d1b/d22/d2e/d34/d7b/d80 0 2024-09-21T00:56:51.034 INFO:tasks.workunit.client.0.smithi112.stdout:8/415: chown d0/d13/c14 2 1 2024-09-21T00:56:51.035 INFO:tasks.workunit.client.0.smithi112.stdout:8/416: chown d0/fb 9 1 2024-09-21T00:56:51.035 INFO:tasks.workunit.client.0.smithi112.stdout:1/333: dread d5/d34/f42 [0,4194304] 0 2024-09-21T00:56:51.036 INFO:tasks.workunit.client.0.smithi112.stdout:8/417: fdatasync d0/d66/f6f 0 2024-09-21T00:56:51.037 INFO:tasks.workunit.client.0.smithi112.stdout:8/418: chown d0 109271 1 2024-09-21T00:56:51.037 INFO:tasks.workunit.client.0.smithi112.stdout:4/504: dwrite d1/d5/d1c/f5b [0,4194304] 0 2024-09-21T00:56:51.041 INFO:tasks.workunit.client.0.smithi112.stdout:8/419: truncate d0/d13/d1b/d22/f31 4970578 0 2024-09-21T00:56:51.042 INFO:tasks.workunit.client.0.smithi112.stdout:4/505: unlink d1/d5/d1c/d1e/d3d/f80 0 2024-09-21T00:56:51.045 INFO:tasks.workunit.client.0.smithi112.stdout:4/506: truncate d1/d5/d1c/f92 745521 0 2024-09-21T00:56:51.048 INFO:tasks.workunit.client.0.smithi112.stdout:8/420: dwrite d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:56:51.051 INFO:tasks.workunit.client.0.smithi112.stdout:0/374: sync 2024-09-21T00:56:51.051 INFO:tasks.workunit.client.0.smithi112.stdout:3/673: sync 2024-09-21T00:56:51.051 INFO:tasks.workunit.client.0.smithi112.stdout:1/334: dread d5/d8/f1f [0,4194304] 0 2024-09-21T00:56:51.054 INFO:tasks.workunit.client.0.smithi112.stdout:1/335: write d5/d3a/f4a [671059,36599] 0 2024-09-21T00:56:51.057 INFO:tasks.workunit.client.0.smithi112.stdout:3/674: creat d2/d33/d8c/fe6 x:0 0 0 2024-09-21T00:56:51.057 INFO:tasks.workunit.client.0.smithi112.stdout:0/375: write d8/d1b/f4b [143992,27844] 0 2024-09-21T00:56:51.060 INFO:tasks.workunit.client.0.smithi112.stdout:3/675: read - d2/d8/d28/d35/d9e/fba zero size 2024-09-21T00:56:51.060 INFO:tasks.workunit.client.0.smithi112.stdout:1/336: creat d5/d8/d10/d2e/f6e x:0 0 0 2024-09-21T00:56:51.061 INFO:tasks.workunit.client.0.smithi112.stdout:8/421: dwrite d0/d13/f27 [0,4194304] 0 2024-09-21T00:56:51.063 INFO:tasks.workunit.client.0.smithi112.stdout:8/422: write d0/d13/d1b/f4c [969587,43254] 0 2024-09-21T00:56:51.063 INFO:tasks.workunit.client.0.smithi112.stdout:0/376: symlink d8/d1b/l6c 0 2024-09-21T00:56:51.068 INFO:tasks.workunit.client.0.smithi112.stdout:3/676: fsync d2/d8/dd/de/d4a/d4c/f6c 0 2024-09-21T00:56:51.070 INFO:tasks.workunit.client.0.smithi112.stdout:0/377: creat d8/d1b/d2c/f6d x:0 0 0 2024-09-21T00:56:51.073 INFO:tasks.workunit.client.0.smithi112.stdout:1/337: mknod d5/d3a/d4b/c6f 0 2024-09-21T00:56:51.074 INFO:tasks.workunit.client.0.smithi112.stdout:8/423: rename d0/d13/d1b to d0/d13/d1b/d81 22 2024-09-21T00:56:51.074 INFO:tasks.workunit.client.0.smithi112.stdout:4/507: truncate d1/d5/d1c/f65 1255415 0 2024-09-21T00:56:51.076 INFO:tasks.workunit.client.0.smithi112.stdout:0/378: creat d8/d1b/d2c/d2e/d4c/d64/f6e x:0 0 0 2024-09-21T00:56:51.076 INFO:tasks.workunit.client.0.smithi112.stdout:4/508: dread d1/d5/d1c/f92 [0,4194304] 0 2024-09-21T00:56:51.081 INFO:tasks.workunit.client.0.smithi112.stdout:8/424: dwrite d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:56:51.081 INFO:tasks.workunit.client.0.smithi112.stdout:3/677: rename d2/d8/dd/f89 to d2/d8/dd/de/d4a/d4c/d7c/fe7 0 2024-09-21T00:56:51.093 INFO:tasks.workunit.client.0.smithi112.stdout:4/509: creat d1/d5/d1c/d6c/fae x:0 0 0 2024-09-21T00:56:51.099 INFO:tasks.workunit.client.0.smithi112.stdout:3/678: symlink d2/d38/d3f/le8 0 2024-09-21T00:56:51.102 INFO:tasks.workunit.client.0.smithi112.stdout:1/338: mkdir d5/d8/d13/d3e/d46/d70 0 2024-09-21T00:56:51.104 INFO:tasks.workunit.client.0.smithi112.stdout:1/339: read d5/d8/dd/f4e [594468,91422] 0 2024-09-21T00:56:51.105 INFO:tasks.workunit.client.0.smithi112.stdout:4/510: mkdir d1/d5/d1c/d1e/daf 0 2024-09-21T00:56:51.107 INFO:tasks.workunit.client.0.smithi112.stdout:4/511: stat d1/d5/d1c/d1e/d3d/c51 0 2024-09-21T00:56:51.107 INFO:tasks.workunit.client.0.smithi112.stdout:0/379: dread d8/d11/f22 [0,4194304] 0 2024-09-21T00:56:51.107 INFO:tasks.workunit.client.0.smithi112.stdout:8/425: write d0/d13/d2a/f48 [952881,110182] 0 2024-09-21T00:56:51.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/426: chown d0/d13 0 1 2024-09-21T00:56:51.108 INFO:tasks.workunit.client.0.smithi112.stdout:1/340: read d5/d8/d10/f1d [224433,8194] 0 2024-09-21T00:56:51.111 INFO:tasks.workunit.client.0.smithi112.stdout:0/380: unlink d8/d1b/d2c/d2e/c3a 0 2024-09-21T00:56:51.112 INFO:tasks.workunit.client.0.smithi112.stdout:1/341: rmdir d5 39 2024-09-21T00:56:51.114 INFO:tasks.workunit.client.0.smithi112.stdout:8/427: mknod d0/d13/d1b/d22/d2e/d34/d7b/c82 0 2024-09-21T00:56:51.114 INFO:tasks.workunit.client.0.smithi112.stdout:4/512: dwrite d1/d5/d1c/d6c/f6d [0,4194304] 0 2024-09-21T00:56:51.115 INFO:tasks.workunit.client.0.smithi112.stdout:8/428: fdatasync d0/d66/f6f 0 2024-09-21T00:56:51.117 INFO:tasks.workunit.client.0.smithi112.stdout:1/342: read d5/d8/f3d [384164,39607] 0 2024-09-21T00:56:51.118 INFO:tasks.workunit.client.0.smithi112.stdout:0/381: creat d8/d5f/f6f x:0 0 0 2024-09-21T00:56:51.119 INFO:tasks.workunit.client.0.smithi112.stdout:4/513: mkdir d1/d5/d1c/d1e/d76/db0 0 2024-09-21T00:56:51.125 INFO:tasks.workunit.client.0.smithi112.stdout:4/514: mkdir d1/d5/d1c/d1e/d4a/d5f/db1 0 2024-09-21T00:56:51.127 INFO:tasks.workunit.client.0.smithi112.stdout:0/382: dwrite d8/d1b/d2c/d2e/d4c/d64/f6e [0,4194304] 0 2024-09-21T00:56:51.129 INFO:tasks.workunit.client.0.smithi112.stdout:4/515: fsync d1/d5/d1c/d1e/f20 0 2024-09-21T00:56:51.129 INFO:tasks.workunit.client.0.smithi112.stdout:8/429: dwrite d0/d13/d1b/d22/f31 [4194304,4194304] 0 2024-09-21T00:56:51.130 INFO:tasks.workunit.client.0.smithi112.stdout:1/343: creat d5/d8/d13/d3e/d46/d70/f71 x:0 0 0 2024-09-21T00:56:51.134 INFO:tasks.workunit.client.0.smithi112.stdout:1/344: dread - d5/d8/d10/d2e/f5e zero size 2024-09-21T00:56:51.137 INFO:tasks.workunit.client.0.smithi112.stdout:0/383: dread - d8/f31 zero size 2024-09-21T00:56:51.137 INFO:tasks.workunit.client.0.smithi112.stdout:8/430: creat d0/d13/d2a/d73/f83 x:0 0 0 2024-09-21T00:56:51.144 INFO:tasks.workunit.client.0.smithi112.stdout:8/431: link d0/d13/d1b/d22/d42/d51/c55 d0/d13/d1b/d22/d2e/d34/d7b/c84 0 2024-09-21T00:56:51.147 INFO:tasks.workunit.client.0.smithi112.stdout:8/432: creat d0/d13/d2a/f85 x:0 0 0 2024-09-21T00:56:51.153 INFO:tasks.workunit.client.0.smithi112.stdout:8/433: dwrite d0/d13/d1b/d22/d42/d51/f76 [0,4194304] 0 2024-09-21T00:56:51.157 INFO:tasks.workunit.client.0.smithi112.stdout:8/434: creat d0/d13/d1b/d22/d42/d51/f86 x:0 0 0 2024-09-21T00:56:51.158 INFO:tasks.workunit.client.0.smithi112.stdout:8/435: chown d0/d13/d2a/d73 15333639 1 2024-09-21T00:56:51.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:50 smithi187 ceph-mon[34997]: pgmap v28: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-09-21T00:56:51.158 INFO:tasks.workunit.client.0.smithi112.stdout:8/436: readlink d0/d66/l5b 0 2024-09-21T00:56:51.159 INFO:tasks.workunit.client.0.smithi112.stdout:4/516: write d1/d5/d1c/d1e/f41 [5107449,34874] 0 2024-09-21T00:56:51.166 INFO:tasks.workunit.client.0.smithi112.stdout:1/345: dwrite d5/d34/f4d [0,4194304] 0 2024-09-21T00:56:51.166 INFO:tasks.workunit.client.0.smithi112.stdout:4/517: creat d1/d5/d1c/d1e/fb2 x:0 0 0 2024-09-21T00:56:51.167 INFO:tasks.workunit.client.0.smithi112.stdout:0/384: dwrite d8/f18 [0,4194304] 0 2024-09-21T00:56:51.168 INFO:tasks.workunit.client.0.smithi112.stdout:0/385: fdatasync d8/f5e 0 2024-09-21T00:56:51.169 INFO:tasks.workunit.client.0.smithi112.stdout:0/386: readlink d8/d1b/l6c 0 2024-09-21T00:56:51.173 INFO:tasks.workunit.client.0.smithi112.stdout:4/518: mkdir d1/d5/d1c/db3 0 2024-09-21T00:56:51.178 INFO:tasks.workunit.client.0.smithi112.stdout:1/346: dwrite d5/d8/d10/d2e/f6e [0,4194304] 0 2024-09-21T00:56:51.181 INFO:tasks.workunit.client.0.smithi112.stdout:8/437: truncate d0/fb 5650238 0 2024-09-21T00:56:51.181 INFO:tasks.workunit.client.0.smithi112.stdout:4/519: chown d1/d2d/l89 49 1 2024-09-21T00:56:51.185 INFO:tasks.workunit.client.0.smithi112.stdout:8/438: symlink d0/d13/d1b/d22/d2e/d34/d7b/l87 0 2024-09-21T00:56:51.188 INFO:tasks.workunit.client.0.smithi112.stdout:4/520: rename d1/d7/f39 to d1/d5/d1c/d1e/daf/fb4 0 2024-09-21T00:56:51.189 INFO:tasks.workunit.client.0.smithi112.stdout:8/439: mkdir d0/d66/d88 0 2024-09-21T00:56:51.189 INFO:tasks.workunit.client.0.smithi112.stdout:4/521: write d1/d5/d1c/fa0 [2416069,80015] 0 2024-09-21T00:56:51.192 INFO:tasks.workunit.client.0.smithi112.stdout:8/440: creat d0/d13/f89 x:0 0 0 2024-09-21T00:56:51.193 INFO:tasks.workunit.client.0.smithi112.stdout:1/347: dread d5/fc [0,4194304] 0 2024-09-21T00:56:51.193 INFO:tasks.workunit.client.0.smithi112.stdout:1/348: chown d5/d8/d13/d3e/d46 57142 1 2024-09-21T00:56:51.194 INFO:tasks.workunit.client.0.smithi112.stdout:8/441: creat d0/d13/d2a/d73/f8a x:0 0 0 2024-09-21T00:56:51.199 INFO:tasks.workunit.client.0.smithi112.stdout:8/442: getdents d0 0 2024-09-21T00:56:51.204 INFO:tasks.workunit.client.0.smithi112.stdout:0/387: truncate d8/d11/d28/f68 470289 0 2024-09-21T00:56:51.210 INFO:tasks.workunit.client.0.smithi112.stdout:0/388: creat d8/d69/f70 x:0 0 0 2024-09-21T00:56:51.214 INFO:tasks.workunit.client.0.smithi112.stdout:8/443: chown d0/fb 337 1 2024-09-21T00:56:51.221 INFO:tasks.workunit.client.0.smithi112.stdout:0/389: dread d8/f5e [0,4194304] 0 2024-09-21T00:56:51.224 INFO:tasks.workunit.client.0.smithi112.stdout:8/444: rmdir d0/d13/d1b/d22 39 2024-09-21T00:56:51.227 INFO:tasks.workunit.client.0.smithi112.stdout:8/445: write d0/d66/f50 [2078196,34347] 0 2024-09-21T00:56:51.231 INFO:tasks.workunit.client.0.smithi112.stdout:8/446: symlink d0/d13/l8b 0 2024-09-21T00:56:51.231 INFO:tasks.workunit.client.0.smithi112.stdout:8/447: fdatasync d0/d13/f44 0 2024-09-21T00:56:51.239 INFO:tasks.workunit.client.0.smithi112.stdout:0/390: dread d8/d11/f37 [4194304,4194304] 0 2024-09-21T00:56:51.242 INFO:tasks.workunit.client.0.smithi112.stdout:0/391: symlink d8/d1b/l71 0 2024-09-21T00:56:51.244 INFO:tasks.workunit.client.0.smithi112.stdout:8/448: dread d0/d13/f29 [0,4194304] 0 2024-09-21T00:56:51.249 INFO:tasks.workunit.client.0.smithi112.stdout:0/392: dwrite d8/d11/f1a [0,4194304] 0 2024-09-21T00:56:51.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:50 smithi112 ceph-mon[28078]: pgmap v28: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-09-21T00:56:51.263 INFO:tasks.workunit.client.0.smithi112.stdout:8/449: dread d0/d13/f16 [0,4194304] 0 2024-09-21T00:56:51.264 INFO:tasks.workunit.client.0.smithi112.stdout:8/450: symlink d0/l8c 0 2024-09-21T00:56:51.284 INFO:tasks.workunit.client.0.smithi112.stdout:8/451: dread d0/d13/f59 [0,4194304] 0 2024-09-21T00:56:51.285 INFO:tasks.workunit.client.0.smithi112.stdout:8/452: fdatasync d0/d13/d1b/f70 0 2024-09-21T00:56:51.287 INFO:tasks.workunit.client.0.smithi112.stdout:8/453: dread - d0/d13/d1b/d22/d42/f78 zero size 2024-09-21T00:56:51.290 INFO:tasks.workunit.client.0.smithi112.stdout:8/454: rename d0/d13/d1b/d22/d2e/c58 to d0/d13/d1b/d22/d2e/d34/c8d 0 2024-09-21T00:56:51.293 INFO:tasks.workunit.client.0.smithi112.stdout:8/455: dread d0/fd [4194304,4194304] 0 2024-09-21T00:56:51.293 INFO:tasks.workunit.client.0.smithi112.stdout:8/456: write d0/d13/f27 [7036726,96753] 0 2024-09-21T00:56:51.295 INFO:tasks.workunit.client.0.smithi112.stdout:8/457: dread d0/d13/d1b/f53 [0,4194304] 0 2024-09-21T00:56:51.298 INFO:tasks.workunit.client.0.smithi112.stdout:2/426: sync 2024-09-21T00:56:51.298 INFO:tasks.workunit.client.0.smithi112.stdout:7/470: sync 2024-09-21T00:56:51.298 INFO:tasks.workunit.client.0.smithi112.stdout:9/490: sync 2024-09-21T00:56:51.299 INFO:tasks.workunit.client.0.smithi112.stdout:8/458: rename d0/d13/d1b/d22/f79 to d0/d13/d1b/d22/d2e/d34/d7b/f8e 0 2024-09-21T00:56:51.299 INFO:tasks.workunit.client.0.smithi112.stdout:9/491: dread - d5/d6/d19/f80 zero size 2024-09-21T00:56:51.301 INFO:tasks.workunit.client.0.smithi112.stdout:9/492: read d5/d6/d19/f1d [4183125,105299] 0 2024-09-21T00:56:51.303 INFO:tasks.workunit.client.0.smithi112.stdout:8/459: dread d0/d13/d2a/f48 [0,4194304] 0 2024-09-21T00:56:51.304 INFO:tasks.workunit.client.0.smithi112.stdout:8/460: dread - d0/d13/d1b/d22/d2e/d34/d7b/f71 zero size 2024-09-21T00:56:51.306 INFO:tasks.workunit.client.0.smithi112.stdout:7/471: symlink d0/d2/d92/l97 0 2024-09-21T00:56:51.309 INFO:tasks.workunit.client.0.smithi112.stdout:9/493: creat d5/d6/d70/f9f x:0 0 0 2024-09-21T00:56:51.312 INFO:tasks.workunit.client.0.smithi112.stdout:2/427: write d0/d14/f19 [784698,57708] 0 2024-09-21T00:56:51.315 INFO:tasks.workunit.client.0.smithi112.stdout:2/428: fdatasync d0/d14/f12 0 2024-09-21T00:56:51.318 INFO:tasks.workunit.client.0.smithi112.stdout:7/472: symlink d0/d2/d38/l98 0 2024-09-21T00:56:51.319 INFO:tasks.workunit.client.0.smithi112.stdout:8/461: dwrite d0/d13/f59 [4194304,4194304] 0 2024-09-21T00:56:51.319 INFO:tasks.workunit.client.0.smithi112.stdout:7/473: fdatasync d0/d2/d36/f90 0 2024-09-21T00:56:51.320 INFO:tasks.workunit.client.0.smithi112.stdout:2/429: rename d0/fa to d0/d51/d62/f82 0 2024-09-21T00:56:51.325 INFO:tasks.workunit.client.0.smithi112.stdout:8/462: stat d0/d13/d1b/c1c 0 2024-09-21T00:56:51.328 INFO:tasks.workunit.client.0.smithi112.stdout:2/430: mkdir d0/d51/d83 0 2024-09-21T00:56:51.329 INFO:tasks.workunit.client.0.smithi112.stdout:9/494: dread d5/d6/d70/f92 [0,4194304] 0 2024-09-21T00:56:51.329 INFO:tasks.workunit.client.0.smithi112.stdout:2/431: truncate d0/d51/f6f 1612516 0 2024-09-21T00:56:51.331 INFO:tasks.workunit.client.0.smithi112.stdout:7/474: mkdir d0/d2/d92/d99 0 2024-09-21T00:56:51.343 INFO:tasks.workunit.client.0.smithi112.stdout:8/463: creat d0/d13/d1b/f8f x:0 0 0 2024-09-21T00:56:51.345 INFO:tasks.workunit.client.0.smithi112.stdout:9/495: getdents d5/d3b/d5f/d13/d6e 0 2024-09-21T00:56:51.348 INFO:tasks.workunit.client.0.smithi112.stdout:2/432: getdents d0/d14/d22/d6d 0 2024-09-21T00:56:51.348 INFO:tasks.workunit.client.0.smithi112.stdout:7/475: dread d0/d2/d2e/f8b [0,4194304] 0 2024-09-21T00:56:51.349 INFO:tasks.workunit.client.0.smithi112.stdout:8/464: dwrite d0/f1d [0,4194304] 0 2024-09-21T00:56:51.350 INFO:tasks.workunit.client.0.smithi112.stdout:7/476: truncate d0/d2/f68 234350 0 2024-09-21T00:56:51.350 INFO:tasks.workunit.client.0.smithi112.stdout:9/496: mkdir d5/d3b/d5f/d13/d6e/da0 0 2024-09-21T00:56:51.353 INFO:tasks.workunit.client.0.smithi112.stdout:8/465: creat d0/d13/d1b/d22/d2e/d34/f90 x:0 0 0 2024-09-21T00:56:51.356 INFO:tasks.workunit.client.0.smithi112.stdout:9/497: creat d5/d3b/d5f/d13/fa1 x:0 0 0 2024-09-21T00:56:51.361 INFO:tasks.workunit.client.0.smithi112.stdout:7/477: mkdir d0/d2/d36/d39/d56/d65/d75/d9a 0 2024-09-21T00:56:51.363 INFO:tasks.workunit.client.0.smithi112.stdout:9/498: dwrite d5/d3b/d5f/d13/d56/f7c [0,4194304] 0 2024-09-21T00:56:51.378 INFO:tasks.workunit.client.0.smithi112.stdout:7/478: fdatasync d0/d2/d2e/f58 0 2024-09-21T00:56:51.380 INFO:tasks.workunit.client.0.smithi112.stdout:9/499: mkdir d5/d6/d3f/d7f/da2 0 2024-09-21T00:56:51.383 INFO:tasks.workunit.client.0.smithi112.stdout:7/479: creat d0/d2/d6c/f9b x:0 0 0 2024-09-21T00:56:51.385 INFO:tasks.workunit.client.0.smithi112.stdout:2/433: write d0/d51/f52 [1295727,105781] 0 2024-09-21T00:56:51.387 INFO:tasks.workunit.client.0.smithi112.stdout:7/480: symlink d0/d2/d36/d39/d56/d65/d75/l9c 0 2024-09-21T00:56:51.393 INFO:tasks.workunit.client.0.smithi112.stdout:7/481: dwrite d0/f22 [0,4194304] 0 2024-09-21T00:56:51.393 INFO:tasks.workunit.client.0.smithi112.stdout:2/434: rename d0/d14/d8/d27/l4d to d0/d60/l84 0 2024-09-21T00:56:51.399 INFO:tasks.workunit.client.0.smithi112.stdout:8/466: truncate d0/f11 2057112 0 2024-09-21T00:56:51.399 INFO:tasks.workunit.client.0.smithi112.stdout:7/482: dwrite d0/d2/f31 [0,4194304] 0 2024-09-21T00:56:51.400 INFO:tasks.workunit.client.0.smithi112.stdout:2/435: symlink d0/d14/d47/l85 0 2024-09-21T00:56:51.405 INFO:tasks.workunit.client.0.smithi112.stdout:8/467: symlink d0/d13/d2a/d73/l91 0 2024-09-21T00:56:51.409 INFO:tasks.workunit.client.0.smithi112.stdout:9/500: link d5/d3b/d5f/d13/d54/d7d/f40 d5/d3b/fa3 0 2024-09-21T00:56:51.410 INFO:tasks.workunit.client.0.smithi112.stdout:2/436: dwrite d0/d14/f19 [0,4194304] 0 2024-09-21T00:56:51.413 INFO:tasks.workunit.client.0.smithi112.stdout:2/437: write d0/d51/d62/f65 [1131272,76540] 0 2024-09-21T00:56:51.414 INFO:tasks.workunit.client.0.smithi112.stdout:8/468: dwrite d0/d13/d1b/f4c [0,4194304] 0 2024-09-21T00:56:51.415 INFO:tasks.workunit.client.0.smithi112.stdout:2/438: read d0/d51/f6f [1499203,31172] 0 2024-09-21T00:56:51.417 INFO:tasks.workunit.client.0.smithi112.stdout:2/439: stat d0/d14/d22/f7e 0 2024-09-21T00:56:51.420 INFO:tasks.workunit.client.0.smithi112.stdout:8/469: dread d0/d13/f29 [0,4194304] 0 2024-09-21T00:56:51.494 INFO:tasks.workunit.client.0.smithi112.stdout:7/483: creat d0/d2/d36/d39/d55/f9d x:0 0 0 2024-09-21T00:56:51.500 INFO:tasks.workunit.client.0.smithi112.stdout:2/440: mknod d0/df/d46/c86 0 2024-09-21T00:56:51.500 INFO:tasks.workunit.client.0.smithi112.stdout:2/441: dread - d0/d14/f80 zero size 2024-09-21T00:56:51.505 INFO:tasks.workunit.client.0.smithi112.stdout:9/501: mkdir d5/d3b/d5f/d13/d6e/da0/da4 0 2024-09-21T00:56:51.507 INFO:tasks.workunit.client.0.smithi112.stdout:2/442: dwrite d0/df/f79 [0,4194304] 0 2024-09-21T00:56:51.514 INFO:tasks.workunit.client.0.smithi112.stdout:9/502: dwrite d5/f14 [8388608,4194304] 0 2024-09-21T00:56:51.518 INFO:tasks.workunit.client.0.smithi112.stdout:2/443: read - d0/d14/f37 zero size 2024-09-21T00:56:51.519 INFO:tasks.workunit.client.0.smithi112.stdout:2/444: write d0/d14/f80 [768251,42752] 0 2024-09-21T00:56:51.520 INFO:tasks.workunit.client.0.smithi112.stdout:7/484: dwrite d0/d2/d36/d39/d1a/f44 [0,4194304] 0 2024-09-21T00:56:51.524 INFO:tasks.workunit.client.0.smithi112.stdout:9/503: mkdir d5/d6/d19/d51/da5 0 2024-09-21T00:56:51.527 INFO:tasks.workunit.client.0.smithi112.stdout:8/470: getdents d0/d13 0 2024-09-21T00:56:51.531 INFO:tasks.workunit.client.0.smithi112.stdout:8/471: creat d0/d13/d1b/d22/d2e/f92 x:0 0 0 2024-09-21T00:56:51.533 INFO:tasks.workunit.client.0.smithi112.stdout:7/485: fsync d0/d2/d2e/f93 0 2024-09-21T00:56:51.538 INFO:tasks.workunit.client.0.smithi112.stdout:2/445: rename d0/df/f34 to d0/d14/f87 0 2024-09-21T00:56:51.539 INFO:tasks.workunit.client.0.smithi112.stdout:8/472: creat d0/d13/d1b/d22/d2e/d34/d7b/d80/f93 x:0 0 0 2024-09-21T00:56:51.540 INFO:tasks.workunit.client.0.smithi112.stdout:7/486: symlink d0/d2/d36/d39/d1a/l9e 0 2024-09-21T00:56:51.542 INFO:tasks.workunit.client.0.smithi112.stdout:9/504: rename d5/d3b/d5f/d13/c4e to d5/d6/d3f/d7f/ca6 0 2024-09-21T00:56:51.546 INFO:tasks.workunit.client.0.smithi112.stdout:7/487: write d0/d2/d38/d48/f76 [3996329,84466] 0 2024-09-21T00:56:51.547 INFO:tasks.workunit.client.0.smithi112.stdout:7/488: chown d0/d2/d36/d39/d1a/l9e 14229486 1 2024-09-21T00:56:51.557 INFO:tasks.workunit.client.0.smithi112.stdout:6/434: sync 2024-09-21T00:56:51.558 INFO:tasks.workunit.client.0.smithi112.stdout:8/473: symlink d0/d13/d1b/d22/d42/l94 0 2024-09-21T00:56:51.558 INFO:tasks.workunit.client.0.smithi112.stdout:9/505: mknod d5/d3b/d5f/d13/d54/ca7 0 2024-09-21T00:56:51.559 INFO:tasks.workunit.client.0.smithi112.stdout:6/435: chown d9/df/c6b 360 1 2024-09-21T00:56:51.560 INFO:tasks.workunit.client.0.smithi112.stdout:6/436: readlink d9/l66 0 2024-09-21T00:56:51.561 INFO:tasks.workunit.client.0.smithi112.stdout:7/489: dread d0/d2/d36/f90 [0,4194304] 0 2024-09-21T00:56:51.563 INFO:tasks.workunit.client.0.smithi112.stdout:8/474: dread d0/d13/d1b/f32 [0,4194304] 0 2024-09-21T00:56:51.563 INFO:tasks.workunit.client.0.smithi112.stdout:6/437: write d9/d1f/d3e/d77/d23/f48 [965013,5059] 0 2024-09-21T00:56:51.566 INFO:tasks.workunit.client.0.smithi112.stdout:9/506: mkdir d5/d3b/d5f/d13/d54/d7d/d57/da8 0 2024-09-21T00:56:51.566 INFO:tasks.workunit.client.0.smithi112.stdout:2/446: dwrite d0/d14/d8/d27/f3f [0,4194304] 0 2024-09-21T00:56:51.568 INFO:tasks.workunit.client.0.smithi112.stdout:2/447: write d0/d14/d8/d27/f3a [1340231,88077] 0 2024-09-21T00:56:51.568 INFO:tasks.workunit.client.0.smithi112.stdout:6/438: rmdir d9/d13/d31/d41 39 2024-09-21T00:56:51.571 INFO:tasks.workunit.client.0.smithi112.stdout:7/490: dread d0/d2/d2e/f8b [0,4194304] 0 2024-09-21T00:56:51.571 INFO:tasks.workunit.client.0.smithi112.stdout:2/448: write d0/d14/f9 [535066,51290] 0 2024-09-21T00:56:51.573 INFO:tasks.workunit.client.0.smithi112.stdout:2/449: write d0/d14/d8/d27/f3f [2626390,78267] 0 2024-09-21T00:56:51.574 INFO:tasks.workunit.client.0.smithi112.stdout:8/475: creat d0/d66/d88/f95 x:0 0 0 2024-09-21T00:56:51.577 INFO:tasks.workunit.client.0.smithi112.stdout:7/491: symlink d0/d2/d36/d39/d56/d65/d87/l9f 0 2024-09-21T00:56:51.578 INFO:tasks.workunit.client.0.smithi112.stdout:8/476: mkdir d0/d13/d2a/d73/d96 0 2024-09-21T00:56:51.580 INFO:tasks.workunit.client.0.smithi112.stdout:6/439: mkdir d9/d13/d31/d41/d9e 0 2024-09-21T00:56:51.581 INFO:tasks.workunit.client.0.smithi112.stdout:7/492: mknod d0/d2/d36/d39/d56/d65/ca0 0 2024-09-21T00:56:51.584 INFO:tasks.workunit.client.0.smithi112.stdout:2/450: dwrite d0/d51/d62/f82 [0,4194304] 0 2024-09-21T00:56:51.584 INFO:tasks.workunit.client.0.smithi112.stdout:7/493: mknod d0/d2/d92/ca1 0 2024-09-21T00:56:51.590 INFO:tasks.workunit.client.0.smithi112.stdout:9/507: dread d5/d6/f37 [0,4194304] 0 2024-09-21T00:56:51.590 INFO:tasks.workunit.client.0.smithi112.stdout:6/440: dwrite d9/d13/f17 [0,4194304] 0 2024-09-21T00:56:51.593 INFO:tasks.workunit.client.0.smithi112.stdout:2/451: rename d0/df/d46/f66 to d0/d51/d62/f88 0 2024-09-21T00:56:51.594 INFO:tasks.workunit.client.0.smithi112.stdout:2/452: chown d0/d51/d62/f65 88693 1 2024-09-21T00:56:51.594 INFO:tasks.workunit.client.0.smithi112.stdout:7/494: creat d0/d2/d36/d39/d1a/fa2 x:0 0 0 2024-09-21T00:56:51.597 INFO:tasks.workunit.client.0.smithi112.stdout:6/441: read - d9/df/f6c zero size 2024-09-21T00:56:51.598 INFO:tasks.workunit.client.0.smithi112.stdout:6/442: fsync d9/d13/d21/d4c/f90 0 2024-09-21T00:56:51.601 INFO:tasks.workunit.client.0.smithi112.stdout:2/453: dwrite d0/d14/f9 [0,4194304] 0 2024-09-21T00:56:51.601 INFO:tasks.workunit.client.0.smithi112.stdout:7/495: rename d0/d2/f5d to d0/d2/d6c/fa3 0 2024-09-21T00:56:51.603 INFO:tasks.workunit.client.0.smithi112.stdout:9/508: symlink d5/d6/la9 0 2024-09-21T00:56:51.605 INFO:tasks.workunit.client.0.smithi112.stdout:6/443: unlink d9/d13/d21/d4c/f90 0 2024-09-21T00:56:51.608 INFO:tasks.workunit.client.0.smithi112.stdout:8/477: dwrite d0/f3e [0,4194304] 0 2024-09-21T00:56:51.611 INFO:tasks.workunit.client.0.smithi112.stdout:9/509: mknod d5/caa 0 2024-09-21T00:56:51.615 INFO:tasks.workunit.client.0.smithi112.stdout:7/496: dwrite d0/f3b [0,4194304] 0 2024-09-21T00:56:51.615 INFO:tasks.workunit.client.0.smithi112.stdout:8/478: write d0/d13/f16 [1712927,68690] 0 2024-09-21T00:56:51.616 INFO:tasks.workunit.client.0.smithi112.stdout:9/510: write d5/d6/d19/f80 [942153,27871] 0 2024-09-21T00:56:51.620 INFO:tasks.workunit.client.0.smithi112.stdout:8/479: chown d0/d13/f89 70389 1 2024-09-21T00:56:51.622 INFO:tasks.workunit.client.0.smithi112.stdout:2/454: dwrite d0/d14/f35 [0,4194304] 0 2024-09-21T00:56:51.623 INFO:tasks.workunit.client.0.smithi112.stdout:6/444: dwrite d9/d13/d21/d4c/f9b [0,4194304] 0 2024-09-21T00:56:51.625 INFO:tasks.workunit.client.0.smithi112.stdout:2/455: write d0/df/f16 [8864462,53645] 0 2024-09-21T00:56:51.627 INFO:tasks.workunit.client.0.smithi112.stdout:8/480: mknod d0/d13/d1b/d22/c97 0 2024-09-21T00:56:51.630 INFO:tasks.workunit.client.0.smithi112.stdout:8/481: chown d0/d13/d1b/d22/d2e/l5a 27341 1 2024-09-21T00:56:51.631 INFO:tasks.workunit.client.0.smithi112.stdout:6/445: rename d9/df/d19 to d9/d1f/d47/d34/d9f 0 2024-09-21T00:56:51.632 INFO:tasks.workunit.client.0.smithi112.stdout:2/456: symlink d0/l89 0 2024-09-21T00:56:51.634 INFO:tasks.workunit.client.0.smithi112.stdout:9/511: dwrite d5/d3b/d5f/d13/d54/d7d/d57/d6a/f6b [0,4194304] 0 2024-09-21T00:56:51.635 INFO:tasks.workunit.client.0.smithi112.stdout:9/512: chown d5/d6/d19/d51/c53 3945798 1 2024-09-21T00:56:51.640 INFO:tasks.workunit.client.0.smithi112.stdout:2/457: rename d0/d51 to d0/d45/d8a 0 2024-09-21T00:56:51.642 INFO:tasks.workunit.client.0.smithi112.stdout:2/458: dread - d0/d14/f5d zero size 2024-09-21T00:56:51.644 INFO:tasks.workunit.client.0.smithi112.stdout:2/459: truncate d0/d45/d8a/f6f 2313638 0 2024-09-21T00:56:51.646 INFO:tasks.workunit.client.0.smithi112.stdout:2/460: rename d0/df/c29 to d0/d60/d78/c8b 0 2024-09-21T00:56:51.647 INFO:tasks.workunit.client.0.smithi112.stdout:2/461: chown d0/d14/f35 0 1 2024-09-21T00:56:51.648 INFO:tasks.workunit.client.0.smithi112.stdout:2/462: write d0/d14/d8/f1a [2531013,41501] 0 2024-09-21T00:56:51.649 INFO:tasks.workunit.client.0.smithi112.stdout:2/463: chown d0/d14/d47/c7b 1 1 2024-09-21T00:56:51.654 INFO:tasks.workunit.client.0.smithi112.stdout:7/497: write d0/f42 [997595,102500] 0 2024-09-21T00:56:51.665 INFO:tasks.workunit.client.0.smithi112.stdout:6/446: rmdir d9/df 39 2024-09-21T00:56:51.666 INFO:tasks.workunit.client.0.smithi112.stdout:6/447: fsync d9/d1f/d3e/f54 0 2024-09-21T00:56:51.666 INFO:tasks.workunit.client.0.smithi112.stdout:8/482: truncate d0/d13/f59 2944639 0 2024-09-21T00:56:51.667 INFO:tasks.workunit.client.0.smithi112.stdout:8/483: write d0/d13/d1b/f70 [4205804,91055] 0 2024-09-21T00:56:51.674 INFO:tasks.workunit.client.0.smithi112.stdout:8/484: dwrite d0/d13/d1b/f4c [0,4194304] 0 2024-09-21T00:56:51.677 INFO:tasks.workunit.client.0.smithi112.stdout:8/485: stat d0/d13/d2a/c37 0 2024-09-21T00:56:51.677 INFO:tasks.workunit.client.0.smithi112.stdout:5/372: sync 2024-09-21T00:56:51.678 INFO:tasks.workunit.client.0.smithi112.stdout:2/464: dread d0/d45/f4a [0,4194304] 0 2024-09-21T00:56:51.679 INFO:tasks.workunit.client.0.smithi112.stdout:5/373: chown d8/d9/d13/f51 47 1 2024-09-21T00:56:51.683 INFO:tasks.workunit.client.0.smithi112.stdout:2/465: creat d0/d14/d8/f8c x:0 0 0 2024-09-21T00:56:51.684 INFO:tasks.workunit.client.0.smithi112.stdout:2/466: write d0/d14/f80 [1734502,113962] 0 2024-09-21T00:56:51.686 INFO:tasks.workunit.client.0.smithi112.stdout:2/467: write d0/d60/f74 [2515726,23099] 0 2024-09-21T00:56:51.687 INFO:tasks.workunit.client.0.smithi112.stdout:5/374: mknod d8/d9/d13/d2a/df/c7a 0 2024-09-21T00:56:51.688 INFO:tasks.workunit.client.0.smithi112.stdout:8/486: dwrite d0/d13/d1b/d22/d2e/d34/d7b/d80/f93 [0,4194304] 0 2024-09-21T00:56:51.699 INFO:tasks.workunit.client.0.smithi112.stdout:2/468: rmdir d0/d60/d78 39 2024-09-21T00:56:51.703 INFO:tasks.workunit.client.0.smithi112.stdout:5/375: symlink d8/d9/d13/d2a/df/d5b/d75/l7b 0 2024-09-21T00:56:51.705 INFO:tasks.workunit.client.0.smithi112.stdout:6/448: dwrite d9/df/f2e [0,4194304] 0 2024-09-21T00:56:51.707 INFO:tasks.workunit.client.0.smithi112.stdout:2/469: dread d0/d14/f32 [0,4194304] 0 2024-09-21T00:56:51.708 INFO:tasks.workunit.client.0.smithi112.stdout:2/470: chown d0/f48 13 1 2024-09-21T00:56:51.709 INFO:tasks.workunit.client.0.smithi112.stdout:2/471: write d0/d14/f19 [102329,93630] 0 2024-09-21T00:56:51.711 INFO:tasks.workunit.client.0.smithi112.stdout:5/376: symlink d8/d9/d13/d2a/d2c/l7c 0 2024-09-21T00:56:51.714 INFO:tasks.workunit.client.0.smithi112.stdout:6/449: creat d9/d13/d21/fa0 x:0 0 0 2024-09-21T00:56:51.716 INFO:tasks.workunit.client.0.smithi112.stdout:6/450: write d9/d13/f39 [888176,117698] 0 2024-09-21T00:56:51.717 INFO:tasks.workunit.client.0.smithi112.stdout:2/472: creat d0/d45/d8a/d62/f8d x:0 0 0 2024-09-21T00:56:51.719 INFO:tasks.workunit.client.0.smithi112.stdout:2/473: readlink d0/df/l41 0 2024-09-21T00:56:51.721 INFO:tasks.workunit.client.0.smithi112.stdout:8/487: dread d0/d13/d1b/d22/f23 [0,4194304] 0 2024-09-21T00:56:51.723 INFO:tasks.workunit.client.0.smithi112.stdout:5/377: creat d8/d9/d61/f7d x:0 0 0 2024-09-21T00:56:51.723 INFO:tasks.workunit.client.0.smithi112.stdout:2/474: mknod d0/d14/d8/d27/c8e 0 2024-09-21T00:56:51.725 INFO:tasks.workunit.client.0.smithi112.stdout:6/451: dwrite d9/d1f/d3e/f54 [0,4194304] 0 2024-09-21T00:56:51.728 INFO:tasks.workunit.client.0.smithi112.stdout:8/488: chown d0/d66/l7d 34 1 2024-09-21T00:56:51.733 INFO:tasks.workunit.client.0.smithi112.stdout:6/452: mknod d9/d1f/d3e/d77/d79/ca1 0 2024-09-21T00:56:51.742 INFO:tasks.workunit.client.0.smithi112.stdout:2/475: getdents d0/df 0 2024-09-21T00:56:51.743 INFO:tasks.workunit.client.0.smithi112.stdout:6/453: creat d9/df/fa2 x:0 0 0 2024-09-21T00:56:51.744 INFO:tasks.workunit.client.0.smithi112.stdout:8/489: getdents d0/d13/d1b/d22/d2e/d34/d7b 0 2024-09-21T00:56:51.746 INFO:tasks.workunit.client.0.smithi112.stdout:2/476: rename d0/df/d46/d58/l5b to d0/df/d46/d58/l8f 0 2024-09-21T00:56:51.746 INFO:tasks.workunit.client.0.smithi112.stdout:8/490: mkdir d0/d13/d98 0 2024-09-21T00:56:51.748 INFO:tasks.workunit.client.0.smithi112.stdout:8/491: fdatasync d0/d13/d2a/f85 0 2024-09-21T00:56:51.749 INFO:tasks.workunit.client.0.smithi112.stdout:2/477: mknod d0/d14/d47/d70/c90 0 2024-09-21T00:56:51.753 INFO:tasks.workunit.client.0.smithi112.stdout:5/378: dread d8/d9/d13/d2a/f3b [0,4194304] 0 2024-09-21T00:56:51.754 INFO:tasks.workunit.client.0.smithi112.stdout:2/478: rename d0/c5e to d0/d45/d8a/d83/c91 0 2024-09-21T00:56:51.755 INFO:tasks.workunit.client.0.smithi112.stdout:8/492: dwrite d0/d13/d1b/f30 [4194304,4194304] 0 2024-09-21T00:56:51.756 INFO:tasks.workunit.client.0.smithi112.stdout:8/493: truncate d0/f21 9210646 0 2024-09-21T00:56:51.757 INFO:tasks.workunit.client.0.smithi112.stdout:8/494: write d0/d13/d2a/f6e [295751,104567] 0 2024-09-21T00:56:51.758 INFO:tasks.workunit.client.0.smithi112.stdout:2/479: symlink d0/d14/d22/d6d/l92 0 2024-09-21T00:56:51.759 INFO:tasks.workunit.client.0.smithi112.stdout:8/495: dread d0/d13/d1b/f32 [0,4194304] 0 2024-09-21T00:56:51.761 INFO:tasks.workunit.client.0.smithi112.stdout:6/454: truncate d9/d1f/d47/d34/d9f/f5d 1581041 0 2024-09-21T00:56:51.764 INFO:tasks.workunit.client.0.smithi112.stdout:8/496: symlink d0/d13/d1b/d22/d2e/d34/d7b/d80/l99 0 2024-09-21T00:56:51.765 INFO:tasks.workunit.client.0.smithi112.stdout:8/497: write d0/f10 [2778623,12080] 0 2024-09-21T00:56:51.766 INFO:tasks.workunit.client.0.smithi112.stdout:2/480: creat d0/d14/d8/d27/d7a/f93 x:0 0 0 2024-09-21T00:56:51.766 INFO:tasks.workunit.client.0.smithi112.stdout:6/455: truncate d9/d1f/d3e/d77/d23/f76 1496768 0 2024-09-21T00:56:51.767 INFO:tasks.workunit.client.0.smithi112.stdout:5/379: link d8/d9/d13/d1c/f3c d8/d9/d13/d2a/df/d5b/d75/f7e 0 2024-09-21T00:56:51.770 INFO:tasks.workunit.client.0.smithi112.stdout:5/380: write d8/d9/d13/d2a/f26 [4043315,74504] 0 2024-09-21T00:56:51.771 INFO:tasks.workunit.client.0.smithi112.stdout:6/456: mkdir d9/d13/d60/da3 0 2024-09-21T00:56:51.772 INFO:tasks.workunit.client.0.smithi112.stdout:5/381: truncate d8/d9/d13/d1c/f54 723413 0 2024-09-21T00:56:51.773 INFO:tasks.workunit.client.0.smithi112.stdout:5/382: fsync d8/d9/d13/d2a/d58/f73 0 2024-09-21T00:56:51.775 INFO:tasks.workunit.client.0.smithi112.stdout:6/457: mkdir d9/d13/d60/da4 0 2024-09-21T00:56:51.779 INFO:tasks.workunit.client.0.smithi112.stdout:8/498: getdents d0/d13/d1b/d22/d2e/d34/d7b/d80 0 2024-09-21T00:56:51.785 INFO:tasks.workunit.client.0.smithi112.stdout:8/499: dread d0/d13/f59 [0,4194304] 0 2024-09-21T00:56:51.787 INFO:tasks.workunit.client.0.smithi112.stdout:8/500: write d0/f1a [6322327,73028] 0 2024-09-21T00:56:51.788 INFO:tasks.workunit.client.0.smithi112.stdout:8/501: fdatasync d0/f10 0 2024-09-21T00:56:51.789 INFO:tasks.workunit.client.0.smithi112.stdout:6/458: dread d9/df/d56/d33/f3c [0,4194304] 0 2024-09-21T00:56:51.790 INFO:tasks.workunit.client.0.smithi112.stdout:2/481: dwrite d0/f2b [0,4194304] 0 2024-09-21T00:56:51.790 INFO:tasks.workunit.client.0.smithi112.stdout:8/502: stat d0/d13/d2a/f6e 0 2024-09-21T00:56:51.795 INFO:tasks.workunit.client.0.smithi112.stdout:6/459: getdents d9/d1f/d3e/d77/d79 0 2024-09-21T00:56:51.797 INFO:tasks.workunit.client.0.smithi112.stdout:8/503: dwrite d0/d13/f89 [0,4194304] 0 2024-09-21T00:56:51.797 INFO:tasks.workunit.client.0.smithi112.stdout:6/460: truncate d9/d13/d26/f8a 899017 0 2024-09-21T00:56:51.798 INFO:tasks.workunit.client.0.smithi112.stdout:6/461: fdatasync d9/d13/d31/f68 0 2024-09-21T00:56:51.801 INFO:tasks.workunit.client.0.smithi112.stdout:8/504: mkdir d0/d13/d1b/d22/d42/d51/d9a 0 2024-09-21T00:56:51.805 INFO:tasks.workunit.client.0.smithi112.stdout:8/505: unlink d0/f6a 0 2024-09-21T00:56:51.805 INFO:tasks.workunit.client.0.smithi112.stdout:8/506: dread - d0/d13/d1b/d22/d2e/d34/d7b/f71 zero size 2024-09-21T00:56:51.809 INFO:tasks.workunit.client.0.smithi112.stdout:8/507: mknod d0/d13/c9b 0 2024-09-21T00:56:51.812 INFO:tasks.workunit.client.0.smithi112.stdout:6/462: link d9/df/d56/l40 d9/d1f/d3e/d9a/la5 0 2024-09-21T00:56:51.816 INFO:tasks.workunit.client.0.smithi112.stdout:6/463: rename d9/d1f/d47/d34/d9f to d9/d1f/d47/d34/da6 0 2024-09-21T00:56:51.817 INFO:tasks.workunit.client.0.smithi112.stdout:8/508: rmdir d0/d13/d98 0 2024-09-21T00:56:51.818 INFO:tasks.workunit.client.0.smithi112.stdout:8/509: readlink d0/d13/d1b/d22/l47 0 2024-09-21T00:56:51.819 INFO:tasks.workunit.client.0.smithi112.stdout:6/464: dread d9/df/d56/d33/f3c [0,4194304] 0 2024-09-21T00:56:51.819 INFO:tasks.workunit.client.0.smithi112.stdout:8/510: dread d0/d13/d1b/f53 [0,4194304] 0 2024-09-21T00:56:51.823 INFO:tasks.workunit.client.0.smithi112.stdout:6/465: rename d9/d1f/d3e/d77/d23 to d9/d1f/d47/d34/da6/da7 0 2024-09-21T00:56:51.824 INFO:tasks.workunit.client.0.smithi112.stdout:6/466: write d9/df/f2e [273927,68052] 0 2024-09-21T00:56:51.825 INFO:tasks.workunit.client.0.smithi112.stdout:8/511: dwrite d0/d13/f44 [0,4194304] 0 2024-09-21T00:56:51.826 INFO:tasks.workunit.client.0.smithi112.stdout:8/512: fdatasync d0/d66/d88/f95 0 2024-09-21T00:56:51.830 INFO:tasks.workunit.client.0.smithi112.stdout:6/467: fsync d9/d1f/d47/d34/f36 0 2024-09-21T00:56:51.833 INFO:tasks.workunit.client.0.smithi112.stdout:6/468: creat d9/d1f/d3e/d77/d79/fa8 x:0 0 0 2024-09-21T00:56:51.834 INFO:tasks.workunit.client.0.smithi112.stdout:8/513: symlink d0/d13/d1b/l9c 0 2024-09-21T00:56:51.836 INFO:tasks.workunit.client.0.smithi112.stdout:8/514: write d0/d13/d2a/d73/f8a [81046,88404] 0 2024-09-21T00:56:51.839 INFO:tasks.workunit.client.0.smithi112.stdout:8/515: stat d0/d13/d1b/c1f 0 2024-09-21T00:56:51.840 INFO:tasks.workunit.client.0.smithi112.stdout:8/516: write d0/f62 [2800543,58742] 0 2024-09-21T00:56:51.843 INFO:tasks.workunit.client.0.smithi112.stdout:6/469: dwrite d9/d1f/f35 [0,4194304] 0 2024-09-21T00:56:51.848 INFO:tasks.workunit.client.0.smithi112.stdout:8/517: creat d0/d13/d1b/d22/d42/d51/f9d x:0 0 0 2024-09-21T00:56:51.859 INFO:tasks.workunit.client.0.smithi112.stdout:6/470: symlink d9/d13/d31/d41/la9 0 2024-09-21T00:56:51.860 INFO:tasks.workunit.client.0.smithi112.stdout:6/471: dread - d9/d1f/d3e/d77/d46/f92 zero size 2024-09-21T00:56:51.862 INFO:tasks.workunit.client.0.smithi112.stdout:8/518: creat d0/d13/d1b/d22/d42/d51/f9e x:0 0 0 2024-09-21T00:56:51.864 INFO:tasks.workunit.client.0.smithi112.stdout:6/472: chown d9/df/d56/l40 61021289 1 2024-09-21T00:56:51.865 INFO:tasks.workunit.client.0.smithi112.stdout:8/519: mkdir d0/d13/d9f 0 2024-09-21T00:56:51.867 INFO:tasks.workunit.client.0.smithi112.stdout:8/520: symlink d0/d13/d2a/d73/d96/la0 0 2024-09-21T00:56:51.867 INFO:tasks.workunit.client.0.smithi112.stdout:8/521: chown d0/c33 1296866 1 2024-09-21T00:56:51.869 INFO:tasks.workunit.client.0.smithi112.stdout:8/522: read d0/f1d [8150096,80338] 0 2024-09-21T00:56:51.873 INFO:tasks.workunit.client.0.smithi112.stdout:8/523: getdents d0/d13/d1b/d22/d2e 0 2024-09-21T00:56:51.877 INFO:tasks.workunit.client.0.smithi112.stdout:8/524: truncate d0/f11 139096 0 2024-09-21T00:56:51.881 INFO:tasks.workunit.client.0.smithi112.stdout:8/525: dread d0/d13/f89 [0,4194304] 0 2024-09-21T00:56:51.882 INFO:tasks.workunit.client.0.smithi112.stdout:8/526: stat d0/f1d 0 2024-09-21T00:56:51.884 INFO:tasks.workunit.client.0.smithi112.stdout:8/527: truncate d0/d13/d1b/d22/d42/d51/f86 877206 0 2024-09-21T00:56:52.017 INFO:tasks.workunit.client.0.smithi112.stdout:3/679: sync 2024-09-21T00:56:52.028 INFO:tasks.workunit.client.0.smithi112.stdout:8/528: creat d0/d13/d1b/d22/d2e/fa1 x:0 0 0 2024-09-21T00:56:52.030 INFO:tasks.workunit.client.0.smithi112.stdout:8/529: write d0/d13/d2a/f6e [673326,12428] 0 2024-09-21T00:56:52.031 INFO:tasks.workunit.client.0.smithi112.stdout:8/530: stat d0/d13 0 2024-09-21T00:56:52.033 INFO:tasks.workunit.client.0.smithi112.stdout:8/531: truncate d0/d13/d1b/d22/d42/d51/f9d 66082 0 2024-09-21T00:56:52.034 INFO:tasks.workunit.client.0.smithi112.stdout:3/680: mkdir d2/d8/dd/de/de9 0 2024-09-21T00:56:52.040 INFO:tasks.workunit.client.0.smithi112.stdout:8/532: link d0/d66/f50 d0/d13/d2a/d73/fa2 0 2024-09-21T00:56:52.048 INFO:tasks.workunit.client.0.smithi112.stdout:8/533: dwrite d0/d13/d2a/d73/f83 [0,4194304] 0 2024-09-21T00:56:52.051 INFO:tasks.workunit.client.0.smithi112.stdout:3/681: dread d2/d8/d6d/fa2 [0,4194304] 0 2024-09-21T00:56:52.051 INFO:tasks.workunit.client.0.smithi112.stdout:8/534: creat d0/d13/d1b/d22/d2e/d34/d7b/d80/fa3 x:0 0 0 2024-09-21T00:56:52.053 INFO:tasks.workunit.client.0.smithi112.stdout:8/535: write d0/d66/d88/f95 [275729,8071] 0 2024-09-21T00:56:52.056 INFO:tasks.workunit.client.0.smithi112.stdout:3/682: mkdir d2/d33/dea 0 2024-09-21T00:56:52.058 INFO:tasks.workunit.client.0.smithi112.stdout:8/536: unlink d0/d13/d1b/d22/d2e/f92 0 2024-09-21T00:56:52.059 INFO:tasks.workunit.client.0.smithi112.stdout:8/537: write d0/d13/d1b/d22/d42/d51/f9e [453970,88561] 0 2024-09-21T00:56:52.060 INFO:tasks.workunit.client.0.smithi112.stdout:8/538: fsync d0/f21 0 2024-09-21T00:56:52.063 INFO:tasks.workunit.client.0.smithi112.stdout:3/683: creat d2/d33/feb x:0 0 0 2024-09-21T00:56:52.064 INFO:tasks.workunit.client.0.smithi112.stdout:8/539: rename d0/cc to d0/d13/d1b/d22/d2e/d34/d7b/d80/ca4 0 2024-09-21T00:56:52.066 INFO:tasks.workunit.client.0.smithi112.stdout:3/684: creat d2/d8/d6d/fec x:0 0 0 2024-09-21T00:56:52.069 INFO:tasks.workunit.client.0.smithi112.stdout:8/540: dread d0/d13/d1b/d22/d2e/d34/d7b/d80/f93 [0,4194304] 0 2024-09-21T00:56:52.071 INFO:tasks.workunit.client.0.smithi112.stdout:3/685: dread d2/d8/dd/f27 [0,4194304] 0 2024-09-21T00:56:52.077 INFO:tasks.workunit.client.0.smithi112.stdout:8/541: dwrite d0/f1d [0,4194304] 0 2024-09-21T00:56:52.079 INFO:tasks.workunit.client.0.smithi112.stdout:3/686: symlink d2/d8/dd/de/d4a/led 0 2024-09-21T00:56:52.080 INFO:tasks.workunit.client.0.smithi112.stdout:8/542: creat d0/d13/d2a/d73/d96/fa5 x:0 0 0 2024-09-21T00:56:52.085 INFO:tasks.workunit.client.0.smithi112.stdout:3/687: creat d2/d8/fee x:0 0 0 2024-09-21T00:56:52.088 INFO:tasks.workunit.client.0.smithi112.stdout:8/543: link d0/d13/d2a/f6e d0/d13/d2a/fa6 0 2024-09-21T00:56:52.089 INFO:tasks.workunit.client.0.smithi112.stdout:3/688: mkdir d2/d8/dd/de/d5c/dd7/def 0 2024-09-21T00:56:52.101 INFO:tasks.workunit.client.0.smithi112.stdout:3/689: dread d2/f5e [0,4194304] 0 2024-09-21T00:56:52.102 INFO:tasks.workunit.client.0.smithi112.stdout:3/690: dread - d2/d33/d8c/fe6 zero size 2024-09-21T00:56:52.103 INFO:tasks.workunit.client.0.smithi112.stdout:8/544: dwrite d0/d13/d2a/d73/fa2 [0,4194304] 0 2024-09-21T00:56:52.104 INFO:tasks.workunit.client.0.smithi112.stdout:3/691: dread - d2/d38/d3f/d53/fd3 zero size 2024-09-21T00:56:52.104 INFO:tasks.workunit.client.0.smithi112.stdout:3/692: chown d2/d8/dd/de 3165756 1 2024-09-21T00:56:52.111 INFO:tasks.workunit.client.0.smithi112.stdout:8/545: write d0/f41 [157640,20150] 0 2024-09-21T00:56:52.111 INFO:tasks.workunit.client.0.smithi112.stdout:8/546: chown d0/d13/d1b/d22/f23 4075 1 2024-09-21T00:56:52.112 INFO:tasks.workunit.client.0.smithi112.stdout:8/547: write d0/d66/f6f [667157,78969] 0 2024-09-21T00:56:52.115 INFO:tasks.workunit.client.0.smithi112.stdout:8/548: creat d0/d13/d1b/d22/d2e/d34/d7b/d80/fa7 x:0 0 0 2024-09-21T00:56:52.119 INFO:tasks.workunit.client.0.smithi112.stdout:3/693: dread d2/d8/f16 [0,4194304] 0 2024-09-21T00:56:52.119 INFO:tasks.workunit.client.0.smithi112.stdout:3/694: fsync d2/d8/d28/f90 0 2024-09-21T00:56:52.120 INFO:tasks.workunit.client.0.smithi112.stdout:8/549: rename d0/d13/d2a/f85 to d0/d13/d1b/d22/d2e/d34/d7b/d80/fa8 0 2024-09-21T00:56:52.120 INFO:tasks.workunit.client.0.smithi112.stdout:8/550: stat d0/d13/l8b 0 2024-09-21T00:56:52.121 INFO:tasks.workunit.client.0.smithi112.stdout:8/551: readlink d0/d13/d2a/d73/d96/la0 0 2024-09-21T00:56:52.122 INFO:tasks.workunit.client.0.smithi112.stdout:3/695: unlink d2/d8/d6d/fd5 0 2024-09-21T00:56:52.125 INFO:tasks.workunit.client.0.smithi112.stdout:3/696: chown d2/c1a 3 1 2024-09-21T00:56:52.128 INFO:tasks.workunit.client.0.smithi112.stdout:8/552: dwrite d0/d66/f50 [4194304,4194304] 0 2024-09-21T00:56:52.128 INFO:tasks.workunit.client.0.smithi112.stdout:3/697: dread d2/d38/fb6 [0,4194304] 0 2024-09-21T00:56:52.129 INFO:tasks.workunit.client.0.smithi112.stdout:8/553: chown d0/d13/d2a/fa6 134974 1 2024-09-21T00:56:52.136 INFO:tasks.workunit.client.0.smithi112.stdout:3/698: getdents d2/d38 0 2024-09-21T00:56:52.136 INFO:tasks.workunit.client.0.smithi112.stdout:8/554: getdents d0/d13/d1b/d22/d42/d6d 0 2024-09-21T00:56:52.139 INFO:tasks.workunit.client.0.smithi112.stdout:3/699: symlink d2/d8/dd/de/d4a/lf0 0 2024-09-21T00:56:52.141 INFO:tasks.workunit.client.0.smithi112.stdout:3/700: symlink d2/d33/d8c/lf1 0 2024-09-21T00:56:52.143 INFO:tasks.workunit.client.0.smithi112.stdout:3/701: dread d2/d33/f94 [0,4194304] 0 2024-09-21T00:56:52.145 INFO:tasks.workunit.client.0.smithi112.stdout:3/702: rename d2/d8/d6d/fec to d2/d8/dd/de/d5c/dd7/ff2 0 2024-09-21T00:56:52.147 INFO:tasks.workunit.client.0.smithi112.stdout:8/555: write d0/d13/d1b/f35 [1836297,68213] 0 2024-09-21T00:56:52.147 INFO:tasks.workunit.client.0.smithi112.stdout:4/522: sync 2024-09-21T00:56:52.154 INFO:tasks.workunit.client.0.smithi112.stdout:3/703: dwrite d2/d8/f16 [0,4194304] 0 2024-09-21T00:56:52.156 INFO:tasks.workunit.client.0.smithi112.stdout:8/556: dread d0/d13/d1b/d22/d42/d51/f76 [0,4194304] 0 2024-09-21T00:56:52.157 INFO:tasks.workunit.client.0.smithi112.stdout:8/557: fdatasync d0/d13/d1b/f35 0 2024-09-21T00:56:52.159 INFO:tasks.workunit.client.0.smithi112.stdout:8/558: chown d0/d13/d1b/d22/d61/c74 168733135 1 2024-09-21T00:56:52.160 INFO:tasks.workunit.client.0.smithi112.stdout:4/523: dread d1/d5/fd [4194304,4194304] 0 2024-09-21T00:56:52.164 INFO:tasks.workunit.client.0.smithi112.stdout:8/559: dread d0/d13/d2a/d73/fa2 [0,4194304] 0 2024-09-21T00:56:52.168 INFO:tasks.workunit.client.0.smithi112.stdout:8/560: creat d0/fa9 x:0 0 0 2024-09-21T00:56:52.169 INFO:tasks.workunit.client.0.smithi112.stdout:4/524: dwrite d1/d5/d1c/d1e/d3d/fa8 [0,4194304] 0 2024-09-21T00:56:52.176 INFO:tasks.workunit.client.0.smithi112.stdout:4/525: creat d1/d5/d1c/d1e/d3d/d99/fb5 x:0 0 0 2024-09-21T00:56:52.179 INFO:tasks.workunit.client.0.smithi112.stdout:4/526: write d1/d5/d1c/d6c/f6d [827450,21231] 0 2024-09-21T00:56:52.179 INFO:tasks.workunit.client.0.smithi112.stdout:3/704: dwrite d2/d38/d3f/f49 [0,4194304] 0 2024-09-21T00:56:52.184 INFO:tasks.workunit.client.0.smithi112.stdout:3/705: chown d2/d8/dd/de/d5c/dd7/ff2 922599 1 2024-09-21T00:56:52.187 INFO:tasks.workunit.client.0.smithi112.stdout:8/561: dwrite d0/d13/d1b/f53 [0,4194304] 0 2024-09-21T00:56:52.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/393: sync 2024-09-21T00:56:52.192 INFO:tasks.workunit.client.0.smithi112.stdout:5/383: sync 2024-09-21T00:56:52.192 INFO:tasks.workunit.client.0.smithi112.stdout:9/513: sync 2024-09-21T00:56:52.193 INFO:tasks.workunit.client.0.smithi112.stdout:7/498: sync 2024-09-21T00:56:52.193 INFO:tasks.workunit.client.0.smithi112.stdout:1/349: sync 2024-09-21T00:56:52.193 INFO:tasks.workunit.client.0.smithi112.stdout:6/473: sync 2024-09-21T00:56:52.193 INFO:tasks.workunit.client.0.smithi112.stdout:2/482: sync 2024-09-21T00:56:52.194 INFO:tasks.workunit.client.0.smithi112.stdout:9/514: stat d5/d3b/d5f/d13/fa1 0 2024-09-21T00:56:52.195 INFO:tasks.workunit.client.0.smithi112.stdout:3/706: dwrite d2/d8/dd/f2e [4194304,4194304] 0 2024-09-21T00:56:52.195 INFO:tasks.workunit.client.0.smithi112.stdout:8/562: creat d0/d13/d1b/d22/d2e/d34/d7b/faa x:0 0 0 2024-09-21T00:56:52.199 INFO:tasks.workunit.client.0.smithi112.stdout:7/499: mkdir d0/d2/d32/da4 0 2024-09-21T00:56:52.201 INFO:tasks.workunit.client.0.smithi112.stdout:7/500: write d0/d2/d36/f49 [676896,117622] 0 2024-09-21T00:56:52.203 INFO:tasks.workunit.client.0.smithi112.stdout:2/483: mknod d0/d14/d8/d27/c94 0 2024-09-21T00:56:52.204 INFO:tasks.workunit.client.0.smithi112.stdout:2/484: stat d0/d14/d22/c2c 0 2024-09-21T00:56:52.204 INFO:tasks.workunit.client.0.smithi112.stdout:9/515: creat d5/d6/d70/fab x:0 0 0 2024-09-21T00:56:52.206 INFO:tasks.workunit.client.0.smithi112.stdout:8/563: mkdir d0/d13/dab 0 2024-09-21T00:56:52.208 INFO:tasks.workunit.client.0.smithi112.stdout:8/564: stat d0/d13/d1b 0 2024-09-21T00:56:52.208 INFO:tasks.workunit.client.0.smithi112.stdout:4/527: link d1/d5/l11 d1/d5/lb6 0 2024-09-21T00:56:52.209 INFO:tasks.workunit.client.0.smithi112.stdout:6/474: mkdir d9/d1f/d47/d74/d8b/daa 0 2024-09-21T00:56:52.212 INFO:tasks.workunit.client.0.smithi112.stdout:5/384: dread d8/d9/f27 [0,4194304] 0 2024-09-21T00:56:52.213 INFO:tasks.workunit.client.0.smithi112.stdout:5/385: fdatasync d8/d9/f60 0 2024-09-21T00:56:52.217 INFO:tasks.workunit.client.0.smithi112.stdout:9/516: dwrite d5/d6/d70/f9f [0,4194304] 0 2024-09-21T00:56:52.221 INFO:tasks.workunit.client.0.smithi112.stdout:1/350: dwrite d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:52.222 INFO:tasks.workunit.client.0.smithi112.stdout:1/351: fsync d5/d34/f4d 0 2024-09-21T00:56:52.224 INFO:tasks.workunit.client.0.smithi112.stdout:7/501: mkdir d0/d2/d36/d39/d1a/da5 0 2024-09-21T00:56:52.226 INFO:tasks.workunit.client.0.smithi112.stdout:5/386: rmdir d8/d9/d13/d2a 39 2024-09-21T00:56:52.227 INFO:tasks.workunit.client.0.smithi112.stdout:5/387: stat d8/d9/d13/d1c/f53 0 2024-09-21T00:56:52.237 INFO:tasks.workunit.client.0.smithi112.stdout:9/517: write d5/d6/d70/f9f [4843999,95812] 0 2024-09-21T00:56:52.238 INFO:tasks.workunit.client.0.smithi112.stdout:8/565: dread d0/d13/f27 [4194304,4194304] 0 2024-09-21T00:56:52.241 INFO:tasks.workunit.client.0.smithi112.stdout:0/394: rename d8/d1b/l1f to d8/d11/l72 0 2024-09-21T00:56:52.241 INFO:tasks.workunit.client.0.smithi112.stdout:8/566: write d0/f41 [1110607,62810] 0 2024-09-21T00:56:52.243 INFO:tasks.workunit.client.0.smithi112.stdout:9/518: write d5/d3b/d5f/f81 [996729,94604] 0 2024-09-21T00:56:52.244 INFO:tasks.workunit.client.0.smithi112.stdout:3/707: link d2/lce d2/d33/dea/lf3 0 2024-09-21T00:56:52.250 INFO:tasks.workunit.client.0.smithi112.stdout:1/352: dread d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:52.253 INFO:tasks.workunit.client.0.smithi112.stdout:6/475: dwrite d9/df/d7a/f55 [0,4194304] 0 2024-09-21T00:56:52.254 INFO:tasks.workunit.client.0.smithi112.stdout:1/353: chown d5/d8/dd/d54/d5a 160 1 2024-09-21T00:56:52.258 INFO:tasks.workunit.client.0.smithi112.stdout:3/708: write d2/d8/dd/de/fca [1026298,87712] 0 2024-09-21T00:56:52.259 INFO:tasks.workunit.client.0.smithi112.stdout:5/388: dwrite d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:56:52.260 INFO:tasks.workunit.client.0.smithi112.stdout:6/476: chown d9/df/f2e 63408 1 2024-09-21T00:56:52.262 INFO:tasks.workunit.client.0.smithi112.stdout:4/528: rename d1/d5/c3c to d1/d5/d1c/d1e/d3d/cb7 0 2024-09-21T00:56:52.262 INFO:tasks.workunit.client.0.smithi112.stdout:0/395: dwrite d8/d1b/f4b [0,4194304] 0 2024-09-21T00:56:52.263 INFO:tasks.workunit.client.0.smithi112.stdout:7/502: write d0/d2/d2e/f58 [707974,12348] 0 2024-09-21T00:56:52.264 INFO:tasks.workunit.client.0.smithi112.stdout:7/503: readlink d0/d2/lf 0 2024-09-21T00:56:52.266 INFO:tasks.workunit.client.0.smithi112.stdout:1/354: creat d5/d34/f72 x:0 0 0 2024-09-21T00:56:52.270 INFO:tasks.workunit.client.0.smithi112.stdout:8/567: write d0/d13/d2a/d73/fa2 [3361266,90027] 0 2024-09-21T00:56:52.272 INFO:tasks.workunit.client.0.smithi112.stdout:5/389: readlink d8/d9/d13/d2a/d2c/l7c 0 2024-09-21T00:56:52.273 INFO:tasks.workunit.client.0.smithi112.stdout:9/519: mknod d5/d3b/d5f/d13/d6e/da0/da4/cac 0 2024-09-21T00:56:52.273 INFO:tasks.workunit.client.0.smithi112.stdout:8/568: write d0/d66/f50 [1938036,78497] 0 2024-09-21T00:56:52.276 INFO:tasks.workunit.client.0.smithi112.stdout:7/504: dwrite d0/d2/d36/d39/d1a/f44 [4194304,4194304] 0 2024-09-21T00:56:52.279 INFO:tasks.workunit.client.0.smithi112.stdout:1/355: rmdir d5/d3a/d4b 39 2024-09-21T00:56:52.279 INFO:tasks.workunit.client.0.smithi112.stdout:7/505: dread - d0/d2/d36/d39/d56/d65/f71 zero size 2024-09-21T00:56:52.281 INFO:tasks.workunit.client.0.smithi112.stdout:3/709: truncate d2/d8/d28/d35/f51 897314 0 2024-09-21T00:56:52.283 INFO:tasks.workunit.client.0.smithi112.stdout:3/710: truncate d2/d8/d28/dac/fdb 4412366 0 2024-09-21T00:56:52.284 INFO:tasks.workunit.client.0.smithi112.stdout:7/506: truncate d0/f3b 4637371 0 2024-09-21T00:56:52.287 INFO:tasks.workunit.client.0.smithi112.stdout:4/529: write d1/d5/d1c/d1e/f31 [3815715,88809] 0 2024-09-21T00:56:52.289 INFO:tasks.workunit.client.0.smithi112.stdout:1/356: rmdir d5/d8/d13/d3e 39 2024-09-21T00:56:52.292 INFO:tasks.workunit.client.0.smithi112.stdout:3/711: unlink d2/d38/d3f/d53/laf 0 2024-09-21T00:56:52.293 INFO:tasks.workunit.client.0.smithi112.stdout:3/712: chown d2/d8/cc 83 1 2024-09-21T00:56:52.295 INFO:tasks.workunit.client.0.smithi112.stdout:6/477: getdents d9 0 2024-09-21T00:56:52.297 INFO:tasks.workunit.client.0.smithi112.stdout:7/507: rename d0/d2/d2e/f8b to d0/d2/d36/d39/d56/d65/d75/fa6 0 2024-09-21T00:56:52.298 INFO:tasks.workunit.client.0.smithi112.stdout:7/508: fdatasync d0/d2/d38/d48/f91 0 2024-09-21T00:56:52.298 INFO:tasks.workunit.client.0.smithi112.stdout:0/396: getdents d8/d1b/d2c/d2e/d4c/d64 0 2024-09-21T00:56:52.300 INFO:tasks.workunit.client.0.smithi112.stdout:1/357: truncate d5/d8/f1f 201091 0 2024-09-21T00:56:52.301 INFO:tasks.workunit.client.0.smithi112.stdout:8/569: creat d0/d13/d1b/d22/d42/fac x:0 0 0 2024-09-21T00:56:52.302 INFO:tasks.workunit.client.0.smithi112.stdout:6/478: unlink d9/la 0 2024-09-21T00:56:52.305 INFO:tasks.workunit.client.0.smithi112.stdout:4/530: rename d1/d5/d1c/d1e/d3d/f97 to d1/d5/d1c/d6c/fb8 0 2024-09-21T00:56:52.307 INFO:tasks.workunit.client.0.smithi112.stdout:1/358: dwrite d5/d8/dd/f4e [0,4194304] 0 2024-09-21T00:56:52.311 INFO:tasks.workunit.client.0.smithi112.stdout:3/713: link d2/d38/d3f/d53/fdd d2/d8/dd/de/d5c/dd7/def/ff4 0 2024-09-21T00:56:52.313 INFO:tasks.workunit.client.0.smithi112.stdout:7/509: mknod d0/d2/d36/d39/d56/d65/ca7 0 2024-09-21T00:56:52.319 INFO:tasks.workunit.client.0.smithi112.stdout:9/520: link d5/d6/d19/c78 d5/d3b/d5f/d13/d54/d7d/cad 0 2024-09-21T00:56:52.320 INFO:tasks.workunit.client.0.smithi112.stdout:9/521: truncate d5/f22 5935225 0 2024-09-21T00:56:52.326 INFO:tasks.workunit.client.0.smithi112.stdout:0/397: write d8/d11/d28/d54/f55 [611846,52832] 0 2024-09-21T00:56:52.333 INFO:tasks.workunit.client.0.smithi112.stdout:0/398: dwrite d8/f18 [4194304,4194304] 0 2024-09-21T00:56:52.338 INFO:tasks.workunit.client.0.smithi112.stdout:3/714: write d2/d38/d3f/d53/fdd [767877,74623] 0 2024-09-21T00:56:52.339 INFO:tasks.workunit.client.0.smithi112.stdout:3/715: dread - d2/d8/dd/de/d5c/dd7/ff2 zero size 2024-09-21T00:56:52.341 INFO:tasks.workunit.client.0.smithi112.stdout:3/716: stat d2/d8/dd/de/d4a/fbd 0 2024-09-21T00:56:52.341 INFO:tasks.workunit.client.0.smithi112.stdout:6/479: stat d9/d1f/d47/d74/d8e 0 2024-09-21T00:56:52.342 INFO:tasks.workunit.client.0.smithi112.stdout:3/717: chown d2/d8/dd/de/d4a/c6f 104712 1 2024-09-21T00:56:52.344 INFO:tasks.workunit.client.0.smithi112.stdout:3/718: dread d2/d8/dd/f27 [0,4194304] 0 2024-09-21T00:56:52.346 INFO:tasks.workunit.client.0.smithi112.stdout:1/359: creat d5/d8/d13/d3e/d46/d70/f73 x:0 0 0 2024-09-21T00:56:52.347 INFO:tasks.workunit.client.0.smithi112.stdout:3/719: write d2/d8/fee [740940,9863] 0 2024-09-21T00:56:52.347 INFO:tasks.workunit.client.0.smithi112.stdout:4/531: write d1/d7/d9/d1a/f78 [1825173,116608] 0 2024-09-21T00:56:52.348 INFO:tasks.workunit.client.0.smithi112.stdout:1/360: read - d5/d8/d10/d2e/f5e zero size 2024-09-21T00:56:52.349 INFO:tasks.workunit.client.0.smithi112.stdout:4/532: fdatasync d1/d5/d1c/d1e/d3d/fa8 0 2024-09-21T00:56:52.351 INFO:tasks.workunit.client.0.smithi112.stdout:4/533: fdatasync d1/d7/d9/d1a/f9a 0 2024-09-21T00:56:52.353 INFO:tasks.workunit.client.0.smithi112.stdout:7/510: unlink d0/d2/d36/l60 0 2024-09-21T00:56:52.355 INFO:tasks.workunit.client.0.smithi112.stdout:0/399: creat d8/d5f/f73 x:0 0 0 2024-09-21T00:56:52.356 INFO:tasks.workunit.client.0.smithi112.stdout:0/400: read d8/d11/f26 [116237,13482] 0 2024-09-21T00:56:52.358 INFO:tasks.workunit.client.0.smithi112.stdout:8/570: link d0/d13/d1b/d22/d2e/d34/d7b/l87 d0/d13/dab/lad 0 2024-09-21T00:56:52.369 INFO:tasks.workunit.client.0.smithi112.stdout:0/401: dread d8/fa [0,4194304] 0 2024-09-21T00:56:52.373 INFO:tasks.workunit.client.0.smithi112.stdout:9/522: truncate d5/d6/f5a 797249 0 2024-09-21T00:56:52.374 INFO:tasks.workunit.client.0.smithi112.stdout:9/523: write d5/d3b/d5f/f3d [443541,41357] 0 2024-09-21T00:56:52.378 INFO:tasks.workunit.client.0.smithi112.stdout:3/720: mknod d2/d38/d3f/d53/d96/dcf/cf5 0 2024-09-21T00:56:52.385 INFO:tasks.workunit.client.0.smithi112.stdout:4/534: dwrite d1/d5/d1c/d1e/d4a/d5f/f71 [0,4194304] 0 2024-09-21T00:56:52.386 INFO:tasks.workunit.client.0.smithi112.stdout:0/402: read d8/d11/f13 [263709,122416] 0 2024-09-21T00:56:52.386 INFO:tasks.workunit.client.0.smithi112.stdout:4/535: write d1/d7/d9/d1a/f9a [72999,75428] 0 2024-09-21T00:56:52.398 INFO:tasks.workunit.client.0.smithi112.stdout:8/571: mknod d0/d13/d2a/cae 0 2024-09-21T00:56:52.399 INFO:tasks.workunit.client.0.smithi112.stdout:1/361: creat d5/f74 x:0 0 0 2024-09-21T00:56:52.401 INFO:tasks.workunit.client.0.smithi112.stdout:3/721: truncate d2/f5 3739155 0 2024-09-21T00:56:52.401 INFO:tasks.workunit.client.0.smithi112.stdout:3/722: readlink d2/l81 0 2024-09-21T00:56:52.401 INFO:tasks.workunit.client.0.smithi112.stdout:3/723: chown d2/d8/d28/f54 1347443 1 2024-09-21T00:56:52.407 INFO:tasks.workunit.client.0.smithi112.stdout:7/511: rename d0/d2/d36/d39/d56/l82 to d0/d2/d36/d39/d1a/la8 0 2024-09-21T00:56:52.407 INFO:tasks.workunit.client.0.smithi112.stdout:3/724: dwrite d2/d8/dd/f1f [0,4194304] 0 2024-09-21T00:56:52.407 INFO:tasks.workunit.client.0.smithi112.stdout:7/512: stat d0/f3b 0 2024-09-21T00:56:52.408 INFO:tasks.workunit.client.0.smithi112.stdout:0/403: fdatasync d8/f31 0 2024-09-21T00:56:52.416 INFO:tasks.workunit.client.0.smithi112.stdout:7/513: dwrite d0/d2/f68 [0,4194304] 0 2024-09-21T00:56:52.422 INFO:tasks.workunit.client.0.smithi112.stdout:1/362: mknod d5/d8/dd/d54/c75 0 2024-09-21T00:56:52.424 INFO:tasks.workunit.client.0.smithi112.stdout:6/480: link d9/d1f/d3e/d6f/c8d d9/df/d56/cab 0 2024-09-21T00:56:52.428 INFO:tasks.workunit.client.0.smithi112.stdout:1/363: dwrite d5/d8/d14/f3b [0,4194304] 0 2024-09-21T00:56:52.430 INFO:tasks.workunit.client.0.smithi112.stdout:1/364: dread - d5/d8/d13/d3e/d46/d70/f73 zero size 2024-09-21T00:56:52.432 INFO:tasks.workunit.client.0.smithi112.stdout:0/404: creat d8/d1b/f74 x:0 0 0 2024-09-21T00:56:52.433 INFO:tasks.workunit.client.0.smithi112.stdout:8/572: write d0/fb [3570302,103192] 0 2024-09-21T00:56:52.434 INFO:tasks.workunit.client.0.smithi112.stdout:4/536: chown d1/d7/d9/d1a/d22/d6e/f9d 0 1 2024-09-21T00:56:52.435 INFO:tasks.workunit.client.0.smithi112.stdout:0/405: truncate d8/f63 583762 0 2024-09-21T00:56:52.440 INFO:tasks.workunit.client.0.smithi112.stdout:8/573: dread d0/d13/d1b/d22/d2e/d34/d7b/d80/f93 [0,4194304] 0 2024-09-21T00:56:52.440 INFO:tasks.workunit.client.0.smithi112.stdout:6/481: dread - d9/df/f6c zero size 2024-09-21T00:56:52.445 INFO:tasks.workunit.client.0.smithi112.stdout:9/524: getdents d5/d6/d3f 0 2024-09-21T00:56:52.447 INFO:tasks.workunit.client.0.smithi112.stdout:4/537: mkdir d1/d5/d1c/d1e/d3d/db9 0 2024-09-21T00:56:52.448 INFO:tasks.workunit.client.0.smithi112.stdout:4/538: read - d1/d7/d9/d1a/d8e/fa9 zero size 2024-09-21T00:56:52.455 INFO:tasks.workunit.client.0.smithi112.stdout:6/482: creat d9/d1f/d3e/d77/d45/fac x:0 0 0 2024-09-21T00:56:52.461 INFO:tasks.workunit.client.0.smithi112.stdout:4/539: mkdir d1/d5/d1c/d1e/d76/dba 0 2024-09-21T00:56:52.462 INFO:tasks.workunit.client.0.smithi112.stdout:4/540: chown d1/d2d/d34/f58 12803141 1 2024-09-21T00:56:52.463 INFO:tasks.workunit.client.0.smithi112.stdout:4/541: write d1/d7/d9/d1a/f78 [285525,60016] 0 2024-09-21T00:56:52.464 INFO:tasks.workunit.client.0.smithi112.stdout:3/725: rename d2/d33/dea/lf3 to d2/d33/lf6 0 2024-09-21T00:56:52.466 INFO:tasks.workunit.client.0.smithi112.stdout:6/483: creat d9/d1f/d47/d34/da6/fad x:0 0 0 2024-09-21T00:56:52.471 INFO:tasks.workunit.client.0.smithi112.stdout:0/406: rename d8/d69 to d8/d75 0 2024-09-21T00:56:52.472 INFO:tasks.workunit.client.0.smithi112.stdout:7/514: truncate d0/d2/d36/d39/d1a/f4d 1043287 0 2024-09-21T00:56:52.479 INFO:tasks.workunit.client.0.smithi112.stdout:3/726: mknod d2/d8/dd/de/d4a/d4c/cf7 0 2024-09-21T00:56:52.482 INFO:tasks.workunit.client.0.smithi112.stdout:1/365: getdents d5/d8 0 2024-09-21T00:56:52.482 INFO:tasks.workunit.client.0.smithi112.stdout:9/525: dwrite d5/d3b/d5f/d13/f45 [0,4194304] 0 2024-09-21T00:56:52.484 INFO:tasks.workunit.client.0.smithi112.stdout:0/407: readlink d8/d11/l72 0 2024-09-21T00:56:52.484 INFO:tasks.workunit.client.0.smithi112.stdout:9/526: chown d5/d3b/d5f/d13/d54/f98 2798 1 2024-09-21T00:56:52.484 INFO:tasks.workunit.client.0.smithi112.stdout:7/515: mknod d0/d6e/ca9 0 2024-09-21T00:56:52.487 INFO:tasks.workunit.client.0.smithi112.stdout:6/484: symlink d9/d1f/lae 0 2024-09-21T00:56:52.489 INFO:tasks.workunit.client.0.smithi112.stdout:1/366: creat d5/d8/dd/f76 x:0 0 0 2024-09-21T00:56:52.492 INFO:tasks.workunit.client.0.smithi112.stdout:9/527: creat d5/d3b/d5f/d13/fae x:0 0 0 2024-09-21T00:56:52.494 INFO:tasks.workunit.client.0.smithi112.stdout:1/367: symlink d5/d8/d13/d3e/d46/d70/l77 0 2024-09-21T00:56:52.495 INFO:tasks.workunit.client.0.smithi112.stdout:0/408: symlink d8/d62/l76 0 2024-09-21T00:56:52.499 INFO:tasks.workunit.client.0.smithi112.stdout:9/528: unlink d5/d3b/d5f/d13/d54/d7d/d57/f60 0 2024-09-21T00:56:52.500 INFO:tasks.workunit.client.0.smithi112.stdout:9/529: write d5/d6/f9b [810404,83943] 0 2024-09-21T00:56:52.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/542: link d1/d5/cb d1/cbb 0 2024-09-21T00:56:52.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/543: stat d1/d7/d30/c4d 0 2024-09-21T00:56:52.505 INFO:tasks.workunit.client.0.smithi112.stdout:3/727: getdents d2/d8/dd/de/d4a 0 2024-09-21T00:56:52.505 INFO:tasks.workunit.client.0.smithi112.stdout:4/544: truncate d1/d5/d1c/d6c/fae 221260 0 2024-09-21T00:56:52.507 INFO:tasks.workunit.client.0.smithi112.stdout:7/516: dread d0/d2/f64 [0,4194304] 0 2024-09-21T00:56:52.509 INFO:tasks.workunit.client.0.smithi112.stdout:7/517: truncate d0/d2/d32/f88 391188 0 2024-09-21T00:56:52.511 INFO:tasks.workunit.client.0.smithi112.stdout:0/409: creat d8/d1b/d2c/d2e/d4c/d6b/f77 x:0 0 0 2024-09-21T00:56:52.512 INFO:tasks.workunit.client.0.smithi112.stdout:3/728: rmdir d2/d8/dd/de/d4a/d4c/de2 39 2024-09-21T00:56:52.513 INFO:tasks.workunit.client.0.smithi112.stdout:3/729: write d2/d3e/d7b/f93 [86120,40354] 0 2024-09-21T00:56:52.515 INFO:tasks.workunit.client.0.smithi112.stdout:6/485: dread d9/d13/f15 [0,4194304] 0 2024-09-21T00:56:52.515 INFO:tasks.workunit.client.0.smithi112.stdout:3/730: truncate d2/d33/d78/f7f 1174735 0 2024-09-21T00:56:52.516 INFO:tasks.workunit.client.0.smithi112.stdout:4/545: rename d1/d5/d1c/d1e/f31 to d1/d5/d1c/d1e/d76/db0/fbc 0 2024-09-21T00:56:52.516 INFO:tasks.workunit.client.0.smithi112.stdout:6/486: write d9/d13/f39 [4060877,92886] 0 2024-09-21T00:56:52.518 INFO:tasks.workunit.client.0.smithi112.stdout:7/518: mknod d0/d2/d36/d39/d1a/d23/caa 0 2024-09-21T00:56:52.519 INFO:tasks.workunit.client.0.smithi112.stdout:9/530: rmdir d5/d6/d19/d51/da5 0 2024-09-21T00:56:52.526 INFO:tasks.workunit.client.0.smithi112.stdout:9/531: dwrite d5/d3b/d5f/d13/d54/f74 [0,4194304] 0 2024-09-21T00:56:52.526 INFO:tasks.workunit.client.0.smithi112.stdout:6/487: unlink d9/df/fa2 0 2024-09-21T00:56:52.528 INFO:tasks.workunit.client.0.smithi112.stdout:4/546: rename d1/d5/f15 to d1/d5/d1c/db3/fbd 0 2024-09-21T00:56:52.531 INFO:tasks.workunit.client.0.smithi112.stdout:7/519: symlink d0/d2/d92/lab 0 2024-09-21T00:56:52.535 INFO:tasks.workunit.client.0.smithi112.stdout:4/547: dwrite d1/d5/f9b [0,4194304] 0 2024-09-21T00:56:52.535 INFO:tasks.workunit.client.0.smithi112.stdout:3/731: creat d2/d8/dd/de/d5c/dd7/def/ff8 x:0 0 0 2024-09-21T00:56:52.540 INFO:tasks.workunit.client.0.smithi112.stdout:9/532: fsync d5/d3b/d5f/f58 0 2024-09-21T00:56:52.543 INFO:tasks.workunit.client.0.smithi112.stdout:1/368: dwrite d5/d8/d13/f53 [0,4194304] 0 2024-09-21T00:56:52.543 INFO:tasks.workunit.client.0.smithi112.stdout:3/732: mknod d2/d38/d3f/d53/cf9 0 2024-09-21T00:56:52.546 INFO:tasks.workunit.client.0.smithi112.stdout:3/733: chown d2/d8/dd/de/d5c/l7e 53206 1 2024-09-21T00:56:52.548 INFO:tasks.workunit.client.0.smithi112.stdout:4/548: rename d1/d5/d1c/d1e/d76/l85 to d1/d5/d1c/d1e/d3d/db9/lbe 0 2024-09-21T00:56:52.549 INFO:tasks.workunit.client.0.smithi112.stdout:0/410: getdents d8/d11 0 2024-09-21T00:56:52.551 INFO:tasks.workunit.client.0.smithi112.stdout:7/520: truncate d0/d2/d38/d48/f91 143761 0 2024-09-21T00:56:52.552 INFO:tasks.workunit.client.0.smithi112.stdout:9/533: dread d5/d3b/d5f/d13/d54/d7d/d57/d6a/f93 [0,4194304] 0 2024-09-21T00:56:52.553 INFO:tasks.workunit.client.0.smithi112.stdout:9/534: write d5/d3b/d5f/f3d [2270918,118977] 0 2024-09-21T00:56:52.556 INFO:tasks.workunit.client.0.smithi112.stdout:3/734: mkdir d2/d8/d28/d35/d9e/dfa 0 2024-09-21T00:56:52.563 INFO:tasks.workunit.client.0.smithi112.stdout:1/369: link d5/d8/dd/f58 d5/d8/dd/f78 0 2024-09-21T00:56:52.564 INFO:tasks.workunit.client.0.smithi112.stdout:9/535: dwrite d5/d6/d19/f80 [0,4194304] 0 2024-09-21T00:56:52.564 INFO:tasks.workunit.client.0.smithi112.stdout:0/411: dread d8/d1b/d2c/d2e/f39 [0,4194304] 0 2024-09-21T00:56:52.571 INFO:tasks.workunit.client.0.smithi112.stdout:4/549: mknod d1/d7/cbf 0 2024-09-21T00:56:52.582 INFO:tasks.workunit.client.0.smithi112.stdout:0/412: mkdir d8/d11/d59/d78 0 2024-09-21T00:56:52.583 INFO:tasks.workunit.client.0.smithi112.stdout:0/413: fdatasync d8/d1b/d2c/d2e/d4c/d6b/f77 0 2024-09-21T00:56:52.583 INFO:tasks.workunit.client.0.smithi112.stdout:9/536: rename d5/d3b/d5f/d59/c8d to d5/d3b/d5f/d13/d54/d7d/d57/d6a/caf 0 2024-09-21T00:56:52.584 INFO:tasks.workunit.client.0.smithi112.stdout:3/735: mknod d2/d33/d8c/db7/cfb 0 2024-09-21T00:56:52.585 INFO:tasks.workunit.client.0.smithi112.stdout:1/370: symlink d5/l79 0 2024-09-21T00:56:52.586 INFO:tasks.workunit.client.0.smithi112.stdout:0/414: chown l5 57180148 1 2024-09-21T00:56:52.587 INFO:tasks.workunit.client.0.smithi112.stdout:3/736: symlink d2/d38/d3f/lfc 0 2024-09-21T00:56:52.589 INFO:tasks.workunit.client.0.smithi112.stdout:7/521: link d0/d2/d36/d39/d56/l7e d0/d2/d38/lac 0 2024-09-21T00:56:52.634 INFO:tasks.workunit.client.0.smithi112.stdout:1/371: dwrite d5/fc [0,4194304] 0 2024-09-21T00:56:52.641 INFO:tasks.workunit.client.0.smithi112.stdout:1/372: mknod d5/d8/d14/c7a 0 2024-09-21T00:56:52.642 INFO:tasks.workunit.client.0.smithi112.stdout:3/737: dread d2/d8/f22 [0,4194304] 0 2024-09-21T00:56:52.643 INFO:tasks.workunit.client.0.smithi112.stdout:0/415: getdents d8/d1b/d2c/d2e/d4c 0 2024-09-21T00:56:52.645 INFO:tasks.workunit.client.0.smithi112.stdout:3/738: write d2/d8/dd/de/d5c/dd7/def/ff8 [129497,55172] 0 2024-09-21T00:56:52.646 INFO:tasks.workunit.client.0.smithi112.stdout:3/739: stat d2/d8/dd/de/d4a/l69 0 2024-09-21T00:56:52.646 INFO:tasks.workunit.client.0.smithi112.stdout:7/522: rename d0/d2/d6c to d0/d2/d38/d48/dad 0 2024-09-21T00:56:52.647 INFO:tasks.workunit.client.0.smithi112.stdout:7/523: dread - d0/f67 zero size 2024-09-21T00:56:52.647 INFO:tasks.workunit.client.0.smithi112.stdout:3/740: write d2/d38/d3f/d53/fd6 [772745,84956] 0 2024-09-21T00:56:52.649 INFO:tasks.workunit.client.0.smithi112.stdout:7/524: write d0/d2/d36/d39/d1a/f44 [9379220,47675] 0 2024-09-21T00:56:52.650 INFO:tasks.workunit.client.0.smithi112.stdout:3/741: write d2/d8/dd/fcb [260726,47998] 0 2024-09-21T00:56:52.650 INFO:tasks.workunit.client.0.smithi112.stdout:0/416: link d8/d1b/f32 d8/d75/f79 0 2024-09-21T00:56:52.650 INFO:tasks.workunit.client.0.smithi112.stdout:7/525: fsync d0/f22 0 2024-09-21T00:56:52.656 INFO:tasks.workunit.client.0.smithi112.stdout:3/742: stat d2/d8/dd/de/f18 0 2024-09-21T00:56:52.661 INFO:tasks.workunit.client.0.smithi112.stdout:3/743: dread d2/d8/dd/de/d4a/d4c/fa0 [0,4194304] 0 2024-09-21T00:56:52.662 INFO:tasks.workunit.client.0.smithi112.stdout:3/744: chown d2/d8/dd 892131 1 2024-09-21T00:56:52.668 INFO:tasks.workunit.client.0.smithi112.stdout:3/745: symlink d2/d8/dd/de/d4a/d4c/de2/lfd 0 2024-09-21T00:56:52.670 INFO:tasks.workunit.client.0.smithi112.stdout:3/746: rename d2/d38/f4b to d2/d33/ffe 0 2024-09-21T00:56:52.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/747: dread d2/d3e/d7b/f93 [0,4194304] 0 2024-09-21T00:56:52.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/748: mknod d2/d3e/d7b/cff 0 2024-09-21T00:56:52.675 INFO:tasks.workunit.client.0.smithi112.stdout:3/749: write d2/d8/dd/de/f8e [4493020,95486] 0 2024-09-21T00:56:52.677 INFO:tasks.workunit.client.0.smithi112.stdout:3/750: mknod d2/d33/d78/c100 0 2024-09-21T00:56:52.681 INFO:tasks.workunit.client.0.smithi112.stdout:3/751: getdents d2/d33/d8c/db7 0 2024-09-21T00:56:52.683 INFO:tasks.workunit.client.0.smithi112.stdout:3/752: stat d2/d33/f56 0 2024-09-21T00:56:52.684 INFO:tasks.workunit.client.0.smithi112.stdout:3/753: write d2/d8/f16 [4627425,116146] 0 2024-09-21T00:56:52.687 INFO:tasks.workunit.client.0.smithi112.stdout:1/373: dwrite d5/d34/f49 [0,4194304] 0 2024-09-21T00:56:52.695 INFO:tasks.workunit.client.0.smithi112.stdout:0/417: dwrite d8/f17 [0,4194304] 0 2024-09-21T00:56:52.696 INFO:tasks.workunit.client.0.smithi112.stdout:3/754: creat d2/d8/dd/f101 x:0 0 0 2024-09-21T00:56:52.698 INFO:tasks.workunit.client.0.smithi112.stdout:7/526: dwrite d0/d2/d36/d39/d1a/f6b [0,4194304] 0 2024-09-21T00:56:52.702 INFO:tasks.workunit.client.0.smithi112.stdout:1/374: dread d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:52.706 INFO:tasks.workunit.client.0.smithi112.stdout:7/527: link d0/d2/d2e/l59 d0/d2/d36/d39/d1a/da5/lae 0 2024-09-21T00:56:52.709 INFO:tasks.workunit.client.0.smithi112.stdout:7/528: mkdir d0/d2/d36/d39/daf 0 2024-09-21T00:56:52.710 INFO:tasks.workunit.client.0.smithi112.stdout:7/529: readlink d0/d2/d36/d39/d1a/d23/l41 0 2024-09-21T00:56:52.713 INFO:tasks.workunit.client.0.smithi112.stdout:7/530: getdents d0/d2/d36/d39/d56/d86 0 2024-09-21T00:56:52.714 INFO:tasks.workunit.client.0.smithi112.stdout:7/531: stat d0/d2/d32/l63 0 2024-09-21T00:56:52.716 INFO:tasks.workunit.client.0.smithi112.stdout:7/532: creat d0/d2/d36/d39/d1a/da5/fb0 x:0 0 0 2024-09-21T00:56:52.720 INFO:tasks.workunit.client.0.smithi112.stdout:7/533: rename d0/d2/d32/f61 to d0/d2/d36/d39/d56/d65/fb1 0 2024-09-21T00:56:52.728 INFO:tasks.workunit.client.0.smithi112.stdout:3/755: dread d2/d38/d3f/fa9 [0,4194304] 0 2024-09-21T00:56:52.730 INFO:tasks.workunit.client.0.smithi112.stdout:0/418: dread d8/d1b/f32 [0,4194304] 0 2024-09-21T00:56:52.731 INFO:tasks.workunit.client.0.smithi112.stdout:0/419: fdatasync d8/f3c 0 2024-09-21T00:56:52.734 INFO:tasks.workunit.client.0.smithi112.stdout:3/756: truncate d2/d33/d78/fc7 2908557 0 2024-09-21T00:56:52.739 INFO:tasks.workunit.client.0.smithi112.stdout:0/420: dwrite d8/d11/d28/d54/f55 [0,4194304] 0 2024-09-21T00:56:52.739 INFO:tasks.workunit.client.0.smithi112.stdout:3/757: creat d2/d33/f102 x:0 0 0 2024-09-21T00:56:52.741 INFO:tasks.workunit.client.0.smithi112.stdout:3/758: mkdir d2/d3e/d103 0 2024-09-21T00:56:52.743 INFO:tasks.workunit.client.0.smithi112.stdout:3/759: write d2/d3e/fbe [259207,23597] 0 2024-09-21T00:56:52.747 INFO:tasks.workunit.client.0.smithi112.stdout:3/760: dread d2/d8/dd/fcb [0,4194304] 0 2024-09-21T00:56:52.752 INFO:tasks.workunit.client.0.smithi112.stdout:0/421: truncate d8/d1b/d2c/d2e/d4c/d64/f6e 3951413 0 2024-09-21T00:56:52.755 INFO:tasks.workunit.client.0.smithi112.stdout:0/422: unlink d8/d1b/f4f 0 2024-09-21T00:56:52.758 INFO:tasks.workunit.client.0.smithi112.stdout:3/761: truncate d2/d3e/f71 1019075 0 2024-09-21T00:56:52.760 INFO:tasks.workunit.client.0.smithi112.stdout:3/762: mkdir d2/d33/d8c/d104 0 2024-09-21T00:56:52.767 INFO:tasks.workunit.client.0.smithi112.stdout:3/763: dwrite d2/d8/dd/de/d4a/fbd [0,4194304] 0 2024-09-21T00:56:52.770 INFO:tasks.workunit.client.0.smithi112.stdout:3/764: dread d2/d8/dd/de/d4a/d4c/d7c/fb0 [0,4194304] 0 2024-09-21T00:56:52.771 INFO:tasks.workunit.client.0.smithi112.stdout:0/423: dread d8/d11/f22 [0,4194304] 0 2024-09-21T00:56:52.774 INFO:tasks.workunit.client.0.smithi112.stdout:3/765: creat d2/d8/dd/de/d4a/d4c/de2/f105 x:0 0 0 2024-09-21T00:56:52.777 INFO:tasks.workunit.client.0.smithi112.stdout:0/424: creat d8/d11/d59/d78/f7a x:0 0 0 2024-09-21T00:56:52.778 INFO:tasks.workunit.client.0.smithi112.stdout:3/766: readlink d2/d8/l6e 0 2024-09-21T00:56:52.783 INFO:tasks.workunit.client.0.smithi112.stdout:3/767: rename d2/l17 to d2/d8/d28/d35/l106 0 2024-09-21T00:56:52.792 INFO:tasks.workunit.client.0.smithi112.stdout:3/768: dwrite d2/d8/dd/de/d5c/dd7/ff2 [0,4194304] 0 2024-09-21T00:56:52.795 INFO:tasks.workunit.client.0.smithi112.stdout:0/425: dread d8/d11/d28/f43 [0,4194304] 0 2024-09-21T00:56:52.796 INFO:tasks.workunit.client.0.smithi112.stdout:3/769: symlink d2/d8/dd/de/d4a/d4c/de2/l107 0 2024-09-21T00:56:52.800 INFO:tasks.workunit.client.0.smithi112.stdout:0/426: getdents d8/d1b/d2c/d2e/d4c/d64 0 2024-09-21T00:56:52.803 INFO:tasks.workunit.client.0.smithi112.stdout:0/427: symlink d8/d11/d59/d78/l7b 0 2024-09-21T00:56:52.805 INFO:tasks.workunit.client.0.smithi112.stdout:0/428: mknod d8/d1b/c7c 0 2024-09-21T00:56:52.807 INFO:tasks.workunit.client.0.smithi112.stdout:0/429: write d8/d1b/f67 [839165,97465] 0 2024-09-21T00:56:52.811 INFO:tasks.workunit.client.0.smithi112.stdout:3/770: dwrite d2/d33/f94 [0,4194304] 0 2024-09-21T00:56:52.811 INFO:tasks.workunit.client.0.smithi112.stdout:0/430: chown d8/d1b/d2c/d2e/d4c/d64/f6e 2695459 1 2024-09-21T00:56:52.812 INFO:tasks.workunit.client.0.smithi112.stdout:3/771: readlink d2/d8/dd/de/d4a/led 0 2024-09-21T00:56:52.814 INFO:tasks.workunit.client.0.smithi112.stdout:0/431: fdatasync d8/d11/d28/f4e 0 2024-09-21T00:56:52.815 INFO:tasks.workunit.client.0.smithi112.stdout:0/432: chown d8/f63 1131 1 2024-09-21T00:56:52.815 INFO:tasks.workunit.client.0.smithi112.stdout:3/772: creat d2/d3e/f108 x:0 0 0 2024-09-21T00:56:52.819 INFO:tasks.workunit.client.0.smithi112.stdout:0/433: creat d8/d5f/f7d x:0 0 0 2024-09-21T00:56:52.825 INFO:tasks.workunit.client.0.smithi112.stdout:3/773: link d2/d33/d8c/lae d2/d8/l109 0 2024-09-21T00:56:53.122 INFO:tasks.workunit.client.0.smithi112.stdout:2/485: sync 2024-09-21T00:56:53.122 INFO:tasks.workunit.client.0.smithi112.stdout:5/390: sync 2024-09-21T00:56:53.123 INFO:tasks.workunit.client.0.smithi112.stdout:5/391: truncate d8/d9/d40/f41 1219307 0 2024-09-21T00:56:53.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:52 smithi187 ceph-mon[34997]: pgmap v29: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 112 MiB/s rd, 315 MiB/s wr, 615 op/s 2024-09-21T00:56:53.203 INFO:tasks.workunit.client.0.smithi112.stdout:2/486: read - d0/df/d46/f61 zero size 2024-09-21T00:56:53.208 INFO:tasks.workunit.client.0.smithi112.stdout:2/487: dwrite d0/d14/f50 [0,4194304] 0 2024-09-21T00:56:53.245 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:52 smithi112 ceph-mon[28078]: pgmap v29: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 112 MiB/s rd, 315 MiB/s wr, 615 op/s 2024-09-21T00:56:53.247 INFO:tasks.workunit.client.0.smithi112.stdout:5/392: creat d8/d9/d13/d2a/df/f7f x:0 0 0 2024-09-21T00:56:53.250 INFO:tasks.workunit.client.0.smithi112.stdout:5/393: mkdir d8/d9/d13/d2a/df/d5b/d80 0 2024-09-21T00:56:53.257 INFO:tasks.workunit.client.0.smithi112.stdout:5/394: dwrite d8/d9/d13/d2a/d2c/f69 [0,4194304] 0 2024-09-21T00:56:53.261 INFO:tasks.workunit.client.0.smithi112.stdout:2/488: getdents d0/d14/d8/d27 0 2024-09-21T00:56:53.304 INFO:tasks.workunit.client.0.smithi112.stdout:2/489: mkdir d0/d14/d22/d95 0 2024-09-21T00:56:53.304 INFO:tasks.workunit.client.0.smithi112.stdout:2/490: fdatasync d0/d14/f12 0 2024-09-21T00:56:53.308 INFO:tasks.workunit.client.0.smithi112.stdout:2/491: truncate d0/df/d46/f61 241837 0 2024-09-21T00:56:53.310 INFO:tasks.workunit.client.0.smithi112.stdout:2/492: creat d0/d14/d47/d70/f96 x:0 0 0 2024-09-21T00:56:53.311 INFO:tasks.workunit.client.0.smithi112.stdout:2/493: read d0/d14/d8/d27/f3a [1210676,104855] 0 2024-09-21T00:56:53.314 INFO:tasks.workunit.client.0.smithi112.stdout:2/494: mkdir d0/df/d46/d97 0 2024-09-21T00:56:53.318 INFO:tasks.workunit.client.0.smithi112.stdout:2/495: creat d0/d14/d8/d27/f98 x:0 0 0 2024-09-21T00:56:53.319 INFO:tasks.workunit.client.0.smithi112.stdout:2/496: dread - d0/d14/d47/d70/f96 zero size 2024-09-21T00:56:53.332 INFO:tasks.workunit.client.0.smithi112.stdout:8/574: sync 2024-09-21T00:56:53.333 INFO:tasks.workunit.client.0.smithi112.stdout:8/575: write d0/d13/f44 [1945444,121658] 0 2024-09-21T00:56:53.337 INFO:tasks.workunit.client.0.smithi112.stdout:2/497: write d0/d14/f5d [793514,104755] 0 2024-09-21T00:56:53.338 INFO:tasks.workunit.client.0.smithi112.stdout:2/498: truncate d0/d14/d8/f8c 95013 0 2024-09-21T00:56:53.345 INFO:tasks.workunit.client.0.smithi112.stdout:2/499: mkdir d0/d45/d8a/d99 0 2024-09-21T00:56:53.349 INFO:tasks.workunit.client.0.smithi112.stdout:2/500: creat d0/d45/d8a/f9a x:0 0 0 2024-09-21T00:56:53.351 INFO:tasks.workunit.client.0.smithi112.stdout:8/576: truncate d0/f41 609724 0 2024-09-21T00:56:53.357 INFO:tasks.workunit.client.0.smithi112.stdout:8/577: unlink d0/d13/d1b/d22/d2e/d34/d7b/faa 0 2024-09-21T00:56:53.364 INFO:tasks.workunit.client.0.smithi112.stdout:8/578: dwrite d0/d13/d1b/f8f [0,4194304] 0 2024-09-21T00:56:53.370 INFO:tasks.workunit.client.0.smithi112.stdout:8/579: mknod d0/d13/d2a/d73/d96/caf 0 2024-09-21T00:56:53.372 INFO:tasks.workunit.client.0.smithi112.stdout:8/580: fdatasync d0/d13/d1b/d22/d2e/d34/d7b/d80/fa7 0 2024-09-21T00:56:53.375 INFO:tasks.workunit.client.0.smithi112.stdout:2/501: dwrite d0/f5 [0,4194304] 0 2024-09-21T00:56:53.377 INFO:tasks.workunit.client.0.smithi112.stdout:6/488: sync 2024-09-21T00:56:53.377 INFO:tasks.workunit.client.0.smithi112.stdout:4/550: sync 2024-09-21T00:56:53.377 INFO:tasks.workunit.client.0.smithi112.stdout:7/534: sync 2024-09-21T00:56:53.379 INFO:tasks.workunit.client.0.smithi112.stdout:8/581: creat d0/d13/d1b/d22/d61/fb0 x:0 0 0 2024-09-21T00:56:53.385 INFO:tasks.workunit.client.0.smithi112.stdout:6/489: symlink d9/d1f/d47/d74/d8e/laf 0 2024-09-21T00:56:53.385 INFO:tasks.workunit.client.0.smithi112.stdout:4/551: dwrite d1/d5/d1c/d1e/d3d/fa3 [0,4194304] 0 2024-09-21T00:56:53.388 INFO:tasks.workunit.client.0.smithi112.stdout:2/502: creat d0/d60/d78/f9b x:0 0 0 2024-09-21T00:56:53.388 INFO:tasks.workunit.client.0.smithi112.stdout:2/503: stat d0/d14/f87 0 2024-09-21T00:56:53.389 INFO:tasks.workunit.client.0.smithi112.stdout:8/582: rmdir d0/d13/d1b/d22/d2e/d34/d7b 39 2024-09-21T00:56:53.390 INFO:tasks.workunit.client.0.smithi112.stdout:7/535: mkdir d0/d2/d32/da4/db2 0 2024-09-21T00:56:53.393 INFO:tasks.workunit.client.0.smithi112.stdout:4/552: unlink d1/d2d/l3f 0 2024-09-21T00:56:53.394 INFO:tasks.workunit.client.0.smithi112.stdout:4/553: chown d1/d5/d1c/d6c 1 1 2024-09-21T00:56:53.396 INFO:tasks.workunit.client.0.smithi112.stdout:8/583: dread - d0/d13/d1b/d22/d2e/d34/d7b/f8e zero size 2024-09-21T00:56:53.398 INFO:tasks.workunit.client.0.smithi112.stdout:2/504: creat d0/d14/d47/f9c x:0 0 0 2024-09-21T00:56:53.399 INFO:tasks.workunit.client.0.smithi112.stdout:6/490: mkdir d9/d13/d60/da4/db0 0 2024-09-21T00:56:53.400 INFO:tasks.workunit.client.0.smithi112.stdout:6/491: write d9/d13/f39 [2229161,83737] 0 2024-09-21T00:56:53.401 INFO:tasks.workunit.client.0.smithi112.stdout:4/554: creat d1/d5/d1c/d1e/d76/fc0 x:0 0 0 2024-09-21T00:56:53.412 INFO:tasks.workunit.client.0.smithi112.stdout:4/555: creat d1/d5/d1c/db3/fc1 x:0 0 0 2024-09-21T00:56:53.412 INFO:tasks.workunit.client.0.smithi112.stdout:4/556: stat d1/d5/d1c/d1e/fb2 0 2024-09-21T00:56:53.414 INFO:tasks.workunit.client.0.smithi112.stdout:4/557: write d1/d7/d9/d1a/f78 [1568147,127177] 0 2024-09-21T00:56:53.414 INFO:tasks.workunit.client.0.smithi112.stdout:4/558: fsync d1/f7f 0 2024-09-21T00:56:53.415 INFO:tasks.workunit.client.0.smithi112.stdout:4/559: fdatasync d1/d7/d9/d1a/d8e/fa9 0 2024-09-21T00:56:53.416 INFO:tasks.workunit.client.0.smithi112.stdout:6/492: truncate d9/df/f27 1403835 0 2024-09-21T00:56:53.418 INFO:tasks.workunit.client.0.smithi112.stdout:8/584: creat d0/d13/d1b/d22/d2e/d34/fb1 x:0 0 0 2024-09-21T00:56:53.422 INFO:tasks.workunit.client.0.smithi112.stdout:6/493: mkdir d9/d1f/d3e/d77/d79/db1 0 2024-09-21T00:56:53.423 INFO:tasks.workunit.client.0.smithi112.stdout:2/505: write d0/df/f1b [348421,59474] 0 2024-09-21T00:56:53.428 INFO:tasks.workunit.client.0.smithi112.stdout:2/506: rename d0/d14/d8/l3b to d0/df/d46/d58/l9d 0 2024-09-21T00:56:53.431 INFO:tasks.workunit.client.0.smithi112.stdout:6/494: mknod d9/d1f/cb2 0 2024-09-21T00:56:53.436 INFO:tasks.workunit.client.0.smithi112.stdout:8/585: getdents d0/d13/d2a 0 2024-09-21T00:56:53.440 INFO:tasks.workunit.client.0.smithi112.stdout:2/507: dread d0/f48 [0,4194304] 0 2024-09-21T00:56:53.441 INFO:tasks.workunit.client.0.smithi112.stdout:6/495: creat d9/d1f/fb3 x:0 0 0 2024-09-21T00:56:53.442 INFO:tasks.workunit.client.0.smithi112.stdout:4/560: write d1/d5/d1c/f65 [42537,123244] 0 2024-09-21T00:56:53.443 INFO:tasks.workunit.client.0.smithi112.stdout:8/586: mknod d0/d13/d1b/d22/cb2 0 2024-09-21T00:56:53.444 INFO:tasks.workunit.client.0.smithi112.stdout:4/561: write d1/d5/d1c/d1e/f20 [6049262,90001] 0 2024-09-21T00:56:53.444 INFO:tasks.workunit.client.0.smithi112.stdout:8/587: chown d0/d13/d1b/f8f 98255 1 2024-09-21T00:56:53.445 INFO:tasks.workunit.client.0.smithi112.stdout:2/508: symlink d0/d14/d8/d27/l9e 0 2024-09-21T00:56:53.449 INFO:tasks.workunit.client.0.smithi112.stdout:2/509: write d0/d14/d8/d27/d7a/f93 [246080,105776] 0 2024-09-21T00:56:53.452 INFO:tasks.workunit.client.0.smithi112.stdout:2/510: chown d0/df/d46/d97 473539249 1 2024-09-21T00:56:53.456 INFO:tasks.workunit.client.0.smithi112.stdout:8/588: dwrite d0/d13/d1b/f68 [0,4194304] 0 2024-09-21T00:56:53.456 INFO:tasks.workunit.client.0.smithi112.stdout:4/562: dwrite d1/fa6 [0,4194304] 0 2024-09-21T00:56:53.458 INFO:tasks.workunit.client.0.smithi112.stdout:2/511: symlink d0/d14/d8/d27/d7a/l9f 0 2024-09-21T00:56:53.460 INFO:tasks.workunit.client.0.smithi112.stdout:2/512: write d0/df/f1b [1427346,47153] 0 2024-09-21T00:56:53.460 INFO:tasks.workunit.client.0.smithi112.stdout:2/513: chown d0/d14/d47 6922369 1 2024-09-21T00:56:53.466 INFO:tasks.workunit.client.0.smithi112.stdout:8/589: creat d0/d13/d2a/fb3 x:0 0 0 2024-09-21T00:56:53.472 INFO:tasks.workunit.client.0.smithi112.stdout:2/514: mknod d0/d14/d47/ca0 0 2024-09-21T00:56:53.478 INFO:tasks.workunit.client.0.smithi112.stdout:4/563: unlink d1/d5/d1c/d1e/d3d/cb7 0 2024-09-21T00:56:53.483 INFO:tasks.workunit.client.0.smithi112.stdout:4/564: rmdir d1/d5/d1c/d1e/d3d/d99 39 2024-09-21T00:56:53.485 INFO:tasks.workunit.client.0.smithi112.stdout:4/565: write d1/d7/f28 [9317653,85034] 0 2024-09-21T00:56:53.486 INFO:tasks.workunit.client.0.smithi112.stdout:2/515: rename d0/df/d46/f61 to d0/d14/d8/fa1 0 2024-09-21T00:56:53.491 INFO:tasks.workunit.client.0.smithi112.stdout:8/590: dread d0/d13/d1b/d22/d42/d51/f69 [0,4194304] 0 2024-09-21T00:56:53.494 INFO:tasks.workunit.client.0.smithi112.stdout:6/496: write d9/df/f27 [273624,107708] 0 2024-09-21T00:56:53.497 INFO:tasks.workunit.client.0.smithi112.stdout:6/497: chown d9/df/d56/d33/c57 5340 1 2024-09-21T00:56:53.499 INFO:tasks.workunit.client.0.smithi112.stdout:8/591: dwrite d0/d13/f29 [0,4194304] 0 2024-09-21T00:56:53.503 INFO:tasks.workunit.client.0.smithi112.stdout:6/498: link d9/d13/d21/d4c/f9b d9/d1f/d47/d74/fb4 0 2024-09-21T00:56:53.504 INFO:tasks.workunit.client.0.smithi112.stdout:4/566: dread d1/d5/fd [0,4194304] 0 2024-09-21T00:56:53.508 INFO:tasks.workunit.client.0.smithi112.stdout:4/567: mkdir d1/d75/dc2 0 2024-09-21T00:56:53.510 INFO:tasks.workunit.client.0.smithi112.stdout:8/592: link d0/d13/d1b/d22/d42/d51/f9e d0/d13/d1b/d22/d42/d6d/fb4 0 2024-09-21T00:56:53.513 INFO:tasks.workunit.client.0.smithi112.stdout:6/499: creat d9/d13/d60/da4/db0/fb5 x:0 0 0 2024-09-21T00:56:53.515 INFO:tasks.workunit.client.0.smithi112.stdout:4/568: creat d1/d5/d1c/d1e/d3d/db9/fc3 x:0 0 0 2024-09-21T00:56:53.518 INFO:tasks.workunit.client.0.smithi112.stdout:6/500: creat d9/fb6 x:0 0 0 2024-09-21T00:56:53.524 INFO:tasks.workunit.client.0.smithi112.stdout:4/569: dwrite d1/d7/d9/d1a/f9a [0,4194304] 0 2024-09-21T00:56:53.526 INFO:tasks.workunit.client.0.smithi112.stdout:6/501: rename d9/d1f/d3e/d9a/la5 to d9/d1f/d3e/lb7 0 2024-09-21T00:56:53.528 INFO:tasks.workunit.client.0.smithi112.stdout:4/570: write d1/d5/d1c/d6c/fb8 [334017,87417] 0 2024-09-21T00:56:53.530 INFO:tasks.workunit.client.0.smithi112.stdout:8/593: dread d0/d13/d1b/d22/f23 [0,4194304] 0 2024-09-21T00:56:53.531 INFO:tasks.workunit.client.0.smithi112.stdout:6/502: mkdir d9/d13/d26/db8 0 2024-09-21T00:56:53.533 INFO:tasks.workunit.client.0.smithi112.stdout:4/571: symlink d1/d5/d1c/d1e/d76/db0/lc4 0 2024-09-21T00:56:53.537 INFO:tasks.workunit.client.0.smithi112.stdout:8/594: mknod d0/d13/d1b/cb5 0 2024-09-21T00:56:53.539 INFO:tasks.workunit.client.0.smithi112.stdout:6/503: rename d9/d1f/cb2 to d9/df/d56/cb9 0 2024-09-21T00:56:53.540 INFO:tasks.workunit.client.0.smithi112.stdout:4/572: dwrite d1/d5/d1c/d6c/fae [0,4194304] 0 2024-09-21T00:56:53.540 INFO:tasks.workunit.client.0.smithi112.stdout:6/504: fsync d9/d1f/f65 0 2024-09-21T00:56:53.546 INFO:tasks.workunit.client.0.smithi112.stdout:8/595: truncate d0/d13/d2a/f45 43028 0 2024-09-21T00:56:53.550 INFO:tasks.workunit.client.0.smithi112.stdout:4/573: creat d1/d7/d30/d91/fc5 x:0 0 0 2024-09-21T00:56:53.552 INFO:tasks.workunit.client.0.smithi112.stdout:6/505: mknod d9/d1f/d3e/d77/d45/d62/cba 0 2024-09-21T00:56:53.560 INFO:tasks.workunit.client.0.smithi112.stdout:6/506: dread d9/d1f/d47/d34/da6/f64 [0,4194304] 0 2024-09-21T00:56:53.560 INFO:tasks.workunit.client.0.smithi112.stdout:8/596: symlink d0/d13/d2a/lb6 0 2024-09-21T00:56:53.561 INFO:tasks.workunit.client.0.smithi112.stdout:8/597: chown d0/d13/d1b/d22/d42/c5c 409668 1 2024-09-21T00:56:53.561 INFO:tasks.workunit.client.0.smithi112.stdout:4/574: mknod d1/d5/d1c/d1e/d76/dba/cc6 0 2024-09-21T00:56:53.566 INFO:tasks.workunit.client.0.smithi112.stdout:8/598: unlink d0/d13/f52 0 2024-09-21T00:56:53.570 INFO:tasks.workunit.client.0.smithi112.stdout:6/507: dwrite d9/f12 [0,4194304] 0 2024-09-21T00:56:53.589 INFO:tasks.workunit.client.0.smithi112.stdout:8/599: dread d0/d13/d1b/d22/d42/d51/f76 [0,4194304] 0 2024-09-21T00:56:53.593 INFO:tasks.workunit.client.0.smithi112.stdout:4/575: creat d1/d7/d9/d1a/d22/fc7 x:0 0 0 2024-09-21T00:56:53.595 INFO:tasks.workunit.client.0.smithi112.stdout:6/508: unlink d9/d1f/d3e/d77/f96 0 2024-09-21T00:56:53.598 INFO:tasks.workunit.client.0.smithi112.stdout:6/509: rename d9/d1f/d47/c32 to d9/d1f/d47/d74/d8b/cbb 0 2024-09-21T00:56:53.600 INFO:tasks.workunit.client.0.smithi112.stdout:8/600: dread d0/d13/d2a/f48 [0,4194304] 0 2024-09-21T00:56:53.601 INFO:tasks.workunit.client.0.smithi112.stdout:6/510: mkdir d9/df/d56/dbc 0 2024-09-21T00:56:53.601 INFO:tasks.workunit.client.0.smithi112.stdout:8/601: fdatasync d0/d13/d1b/d22/f31 0 2024-09-21T00:56:53.604 INFO:tasks.workunit.client.0.smithi112.stdout:4/576: dread d1/d7/d9/f61 [4194304,4194304] 0 2024-09-21T00:56:53.604 INFO:tasks.workunit.client.0.smithi112.stdout:6/511: creat d9/df/d56/dbc/fbd x:0 0 0 2024-09-21T00:56:53.607 INFO:tasks.workunit.client.0.smithi112.stdout:4/577: mkdir d1/d5/d1c/d1e/d4a/dc8 0 2024-09-21T00:56:53.611 INFO:tasks.workunit.client.0.smithi112.stdout:8/602: dwrite d0/d13/d1b/d22/d2e/d34/fb1 [0,4194304] 0 2024-09-21T00:56:53.612 INFO:tasks.workunit.client.0.smithi112.stdout:8/603: chown d0/d13/l17 29942270 1 2024-09-21T00:56:53.614 INFO:tasks.workunit.client.0.smithi112.stdout:6/512: dwrite d9/d13/d31/d41/f95 [0,4194304] 0 2024-09-21T00:56:53.647 INFO:tasks.workunit.client.0.smithi112.stdout:3/774: sync 2024-09-21T00:56:53.648 INFO:tasks.workunit.client.0.smithi112.stdout:9/537: sync 2024-09-21T00:56:53.648 INFO:tasks.workunit.client.0.smithi112.stdout:1/375: sync 2024-09-21T00:56:53.648 INFO:tasks.workunit.client.0.smithi112.stdout:0/434: sync 2024-09-21T00:56:53.648 INFO:tasks.workunit.client.0.smithi112.stdout:5/395: sync 2024-09-21T00:56:53.649 INFO:tasks.workunit.client.0.smithi112.stdout:1/376: write d5/f74 [938244,29219] 0 2024-09-21T00:56:53.667 INFO:tasks.workunit.client.0.smithi112.stdout:1/377: dread d5/d8/dd/f4e [0,4194304] 0 2024-09-21T00:56:53.677 INFO:tasks.workunit.client.0.smithi112.stdout:7/536: sync 2024-09-21T00:56:53.678 INFO:tasks.workunit.client.0.smithi112.stdout:7/537: chown d0/d2/d36/d39/d56/d65/ca7 52991 1 2024-09-21T00:56:53.679 INFO:tasks.workunit.client.0.smithi112.stdout:7/538: write d0/d2/d36/d39/d1a/f6b [7270,6623] 0 2024-09-21T00:56:53.683 INFO:tasks.workunit.client.0.smithi112.stdout:9/538: mknod d5/d3b/d5f/d13/d6e/da0/da4/cb0 0 2024-09-21T00:56:53.685 INFO:tasks.workunit.client.0.smithi112.stdout:1/378: dread - d5/d8/d13/d3e/f5b zero size 2024-09-21T00:56:53.686 INFO:tasks.workunit.client.0.smithi112.stdout:4/578: link d1/d5/d1c/d1e/c4b d1/d7/d9/cc9 0 2024-09-21T00:56:53.687 INFO:tasks.workunit.client.0.smithi112.stdout:4/579: fsync d1/d5/d1c/fa4 0 2024-09-21T00:56:53.688 INFO:tasks.workunit.client.0.smithi112.stdout:3/775: chown d2/d8/d28/d9d/fc0 220811642 1 2024-09-21T00:56:53.691 INFO:tasks.workunit.client.0.smithi112.stdout:9/539: creat d5/d3b/d5f/d59/fb1 x:0 0 0 2024-09-21T00:56:53.696 INFO:tasks.workunit.client.0.smithi112.stdout:3/776: creat d2/d8/dd/de/d5c/f10a x:0 0 0 2024-09-21T00:56:53.702 INFO:tasks.workunit.client.0.smithi112.stdout:1/379: truncate d5/d34/f4d 2411060 0 2024-09-21T00:56:53.702 INFO:tasks.workunit.client.0.smithi112.stdout:2/516: sync 2024-09-21T00:56:53.705 INFO:tasks.workunit.client.0.smithi112.stdout:3/777: dwrite d2/d8/fee [0,4194304] 0 2024-09-21T00:56:53.705 INFO:tasks.workunit.client.0.smithi112.stdout:9/540: dread - d5/d3b/d5f/d13/d54/d7d/d57/f8b zero size 2024-09-21T00:56:53.709 INFO:tasks.workunit.client.0.smithi112.stdout:2/517: mkdir d0/d14/d8/da2 0 2024-09-21T00:56:53.710 INFO:tasks.workunit.client.0.smithi112.stdout:2/518: dread - d0/d14/d22/d6d/f77 zero size 2024-09-21T00:56:53.716 INFO:tasks.workunit.client.0.smithi112.stdout:2/519: creat d0/d14/d8/d27/d7a/fa3 x:0 0 0 2024-09-21T00:56:53.719 INFO:tasks.workunit.client.0.smithi112.stdout:1/380: link d5/d8/d13/d3e/d46/d70/f73 d5/d8/dd/d54/d5a/f7b 0 2024-09-21T00:56:53.721 INFO:tasks.workunit.client.0.smithi112.stdout:2/520: symlink d0/d60/d78/la4 0 2024-09-21T00:56:53.721 INFO:tasks.workunit.client.0.smithi112.stdout:2/521: fdatasync d0/d14/f12 0 2024-09-21T00:56:53.722 INFO:tasks.workunit.client.0.smithi112.stdout:1/381: truncate d5/d8/f3d 1396822 0 2024-09-21T00:56:53.723 INFO:tasks.workunit.client.0.smithi112.stdout:1/382: write d5/f74 [1900427,18576] 0 2024-09-21T00:56:53.728 INFO:tasks.workunit.client.0.smithi112.stdout:2/522: mknod d0/d14/d22/d95/ca5 0 2024-09-21T00:56:53.733 INFO:tasks.workunit.client.0.smithi112.stdout:2/523: mknod d0/df/d46/d97/ca6 0 2024-09-21T00:56:53.736 INFO:tasks.workunit.client.0.smithi112.stdout:2/524: creat d0/d45/d8a/d83/fa7 x:0 0 0 2024-09-21T00:56:53.736 INFO:tasks.workunit.client.0.smithi112.stdout:2/525: chown d0/d45/d8a/f55 1524090 1 2024-09-21T00:56:53.738 INFO:tasks.workunit.client.0.smithi112.stdout:2/526: mknod d0/d14/d22/ca8 0 2024-09-21T00:56:53.741 INFO:tasks.workunit.client.0.smithi112.stdout:2/527: mknod d0/d45/d8a/d62/ca9 0 2024-09-21T00:56:53.742 INFO:tasks.workunit.client.0.smithi112.stdout:2/528: chown d0/d60/d78/f9b 3 1 2024-09-21T00:56:53.742 INFO:tasks.workunit.client.0.smithi112.stdout:2/529: fsync d0/d60/d78/f7f 0 2024-09-21T00:56:53.743 INFO:tasks.workunit.client.0.smithi112.stdout:2/530: chown d0/df/c30 386308 1 2024-09-21T00:56:53.747 INFO:tasks.workunit.client.0.smithi112.stdout:2/531: mkdir d0/d14/d8/da2/daa 0 2024-09-21T00:56:53.748 INFO:tasks.workunit.client.0.smithi112.stdout:2/532: chown d0/fe 2 1 2024-09-21T00:56:53.753 INFO:tasks.workunit.client.0.smithi112.stdout:2/533: link d0/d14/f32 d0/d60/fab 0 2024-09-21T00:56:53.755 INFO:tasks.workunit.client.0.smithi112.stdout:2/534: symlink d0/d60/d78/lac 0 2024-09-21T00:56:53.793 INFO:tasks.workunit.client.0.smithi112.stdout:0/435: write d8/d11/d28/f68 [1413057,12797] 0 2024-09-21T00:56:53.796 INFO:tasks.workunit.client.0.smithi112.stdout:0/436: creat d8/d1b/f7e x:0 0 0 2024-09-21T00:56:53.799 INFO:tasks.workunit.client.0.smithi112.stdout:0/437: mknod d8/d1b/d2c/d2e/d4c/d6b/c7f 0 2024-09-21T00:56:53.802 INFO:tasks.workunit.client.0.smithi112.stdout:0/438: link d8/f17 d8/d1b/d2c/d2e/d4c/f80 0 2024-09-21T00:56:53.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/580: write d1/d2d/d34/f58 [396042,33720] 0 2024-09-21T00:56:53.804 INFO:tasks.workunit.client.0.smithi112.stdout:0/439: creat d8/d11/f81 x:0 0 0 2024-09-21T00:56:53.807 INFO:tasks.workunit.client.0.smithi112.stdout:0/440: mknod d8/d1b/d2c/d2e/d4c/d6b/c82 0 2024-09-21T00:56:53.809 INFO:tasks.workunit.client.0.smithi112.stdout:4/581: rename d1/d5/d1c/d6c/f6d to d1/d5/d1c/d1e/d4a/d5f/db1/fca 0 2024-09-21T00:56:53.813 INFO:tasks.workunit.client.0.smithi112.stdout:0/441: creat d8/d1b/d2c/d2e/d4c/f83 x:0 0 0 2024-09-21T00:56:53.814 INFO:tasks.workunit.client.0.smithi112.stdout:4/582: chown d1/d7/d9/d1a/d22/d6e/c9e 281 1 2024-09-21T00:56:53.820 INFO:tasks.workunit.client.0.smithi112.stdout:4/583: getdents d1 0 2024-09-21T00:56:53.820 INFO:tasks.workunit.client.0.smithi112.stdout:9/541: dwrite d5/f49 [0,4194304] 0 2024-09-21T00:56:53.822 INFO:tasks.workunit.client.0.smithi112.stdout:4/584: write d1/d5/d1c/d1e/f20 [6782583,53002] 0 2024-09-21T00:56:53.822 INFO:tasks.workunit.client.0.smithi112.stdout:3/778: truncate d2/d8/d6d/fa2 1993673 0 2024-09-21T00:56:53.823 INFO:tasks.workunit.client.0.smithi112.stdout:9/542: dread - d5/d3b/d5f/d13/d54/f90 zero size 2024-09-21T00:56:53.829 INFO:tasks.workunit.client.0.smithi112.stdout:3/779: mknod d2/d3e/d7b/c10b 0 2024-09-21T00:56:53.829 INFO:tasks.workunit.client.0.smithi112.stdout:9/543: symlink d5/d3b/d5f/d13/d6e/da0/lb2 0 2024-09-21T00:56:53.830 INFO:tasks.workunit.client.0.smithi112.stdout:3/780: readlink d2/d8/d6d/l73 0 2024-09-21T00:56:53.831 INFO:tasks.workunit.client.0.smithi112.stdout:4/585: write d1/d5/d1c/d1e/d4a/d5f/db1/fca [5093461,35725] 0 2024-09-21T00:56:53.832 INFO:tasks.workunit.client.0.smithi112.stdout:4/586: readlink d1/d7/l57 0 2024-09-21T00:56:53.836 INFO:tasks.workunit.client.0.smithi112.stdout:3/781: mknod d2/d33/d78/c10c 0 2024-09-21T00:56:53.841 INFO:tasks.workunit.client.0.smithi112.stdout:3/782: dread d2/d8/dd/de/d5c/dd7/ff2 [0,4194304] 0 2024-09-21T00:56:53.848 INFO:tasks.workunit.client.0.smithi112.stdout:4/587: creat d1/d7/d9/fcb x:0 0 0 2024-09-21T00:56:53.851 INFO:tasks.workunit.client.0.smithi112.stdout:9/544: getdents d5/d3b/d5f/d13/d54/d7d/d57/d6a 0 2024-09-21T00:56:53.852 INFO:tasks.workunit.client.0.smithi112.stdout:4/588: stat d1/d5/d1c/d1e/d3d/db9/lbe 0 2024-09-21T00:56:53.859 INFO:tasks.workunit.client.0.smithi112.stdout:4/589: dwrite d1/d7/d9/d1a/d22/fc7 [0,4194304] 0 2024-09-21T00:56:53.860 INFO:tasks.workunit.client.0.smithi112.stdout:9/545: unlink d5/d3b/d5f/d13/d54/d7d/d57/l99 0 2024-09-21T00:56:53.879 INFO:tasks.workunit.client.0.smithi112.stdout:9/546: dread d5/f20 [0,4194304] 0 2024-09-21T00:56:53.895 INFO:tasks.workunit.client.0.smithi112.stdout:7/539: mkdir d0/d2/d36/d39/db3 0 2024-09-21T00:56:53.896 INFO:tasks.workunit.client.0.smithi112.stdout:7/540: chown d0/d2/d36/d39/d56/d65/d87 347440815 1 2024-09-21T00:56:53.896 INFO:tasks.workunit.client.0.smithi112.stdout:9/547: dread d5/d3b/d5f/d13/f5d [0,4194304] 0 2024-09-21T00:56:53.899 INFO:tasks.workunit.client.0.smithi112.stdout:9/548: symlink d5/d6/d70/lb3 0 2024-09-21T00:56:53.902 INFO:tasks.workunit.client.0.smithi112.stdout:7/541: mkdir d0/d2/d32/da4/db2/db4 0 2024-09-21T00:56:53.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/542: stat d0/d2/d36/d39/l27 0 2024-09-21T00:56:53.907 INFO:tasks.workunit.client.0.smithi112.stdout:6/513: mkdir d9/d13/dbe 0 2024-09-21T00:56:53.913 INFO:tasks.workunit.client.0.smithi112.stdout:2/535: creat d0/d45/d8a/fad x:0 0 0 2024-09-21T00:56:53.913 INFO:tasks.workunit.client.0.smithi112.stdout:2/536: fsync d0/d14/f4e 0 2024-09-21T00:56:53.914 INFO:tasks.workunit.client.0.smithi112.stdout:2/537: fsync d0/d14/f19 0 2024-09-21T00:56:53.915 INFO:tasks.workunit.client.0.smithi112.stdout:1/383: symlink d5/d8/dd/l7c 0 2024-09-21T00:56:53.916 INFO:tasks.workunit.client.0.smithi112.stdout:0/442: rename d8/f31 to d8/d1b/d2c/d2e/d4c/f84 0 2024-09-21T00:56:53.918 INFO:tasks.workunit.client.0.smithi112.stdout:8/604: symlink d0/d13/d1b/d22/lb7 0 2024-09-21T00:56:53.922 INFO:tasks.workunit.client.0.smithi112.stdout:3/783: rename d2/d8/dd/de/d5c to d2/d3e/d7b/d10d 0 2024-09-21T00:56:53.926 INFO:tasks.workunit.client.0.smithi112.stdout:0/443: symlink d8/l85 0 2024-09-21T00:56:53.927 INFO:tasks.workunit.client.0.smithi112.stdout:2/538: dread d0/f3c [0,4194304] 0 2024-09-21T00:56:53.929 INFO:tasks.workunit.client.0.smithi112.stdout:6/514: rename d9/d1f/d3e/d77/d45/fac to d9/d1f/d3e/d6f/fbf 0 2024-09-21T00:56:53.930 INFO:tasks.workunit.client.0.smithi112.stdout:3/784: mkdir d2/d8/d6d/d10e 0 2024-09-21T00:56:53.933 INFO:tasks.workunit.client.0.smithi112.stdout:0/444: creat d8/d1b/d2c/d2e/d4c/f86 x:0 0 0 2024-09-21T00:56:53.934 INFO:tasks.workunit.client.0.smithi112.stdout:0/445: chown d8/d1b/f61 0 1 2024-09-21T00:56:53.944 INFO:tasks.workunit.client.0.smithi112.stdout:8/605: rename d0/d13/f16 to d0/d13/d1b/d22/d42/d6d/fb8 0 2024-09-21T00:56:53.946 INFO:tasks.workunit.client.0.smithi112.stdout:8/606: read - d0/d13/d1b/d22/d2e/d34/d7b/d80/fa7 zero size 2024-09-21T00:56:53.950 INFO:tasks.workunit.client.0.smithi112.stdout:2/539: dread d0/df/f16 [0,4194304] 0 2024-09-21T00:56:53.951 INFO:tasks.workunit.client.0.smithi112.stdout:2/540: fdatasync d0/df/d46/d58/f6e 0 2024-09-21T00:56:53.956 INFO:tasks.workunit.client.0.smithi112.stdout:6/515: dread d9/d13/f17 [0,4194304] 0 2024-09-21T00:56:53.961 INFO:tasks.workunit.client.0.smithi112.stdout:1/384: link d5/d8/d13/c61 d5/d3a/c7d 0 2024-09-21T00:56:53.963 INFO:tasks.workunit.client.0.smithi112.stdout:3/785: dread d2/d8/dd/de/f8e [0,4194304] 0 2024-09-21T00:56:53.965 INFO:tasks.workunit.client.0.smithi112.stdout:3/786: write d2/d8/dd/de/d6b/f72 [8884209,116286] 0 2024-09-21T00:56:53.970 INFO:tasks.workunit.client.0.smithi112.stdout:2/541: creat d0/d14/d22/d95/fae x:0 0 0 2024-09-21T00:56:53.970 INFO:tasks.workunit.client.0.smithi112.stdout:6/516: rename d9/d13/d31/d41/la9 to d9/d1f/d47/d34/da6/lc0 0 2024-09-21T00:56:53.973 INFO:tasks.workunit.client.0.smithi112.stdout:8/607: symlink d0/d13/d9f/lb9 0 2024-09-21T00:56:53.974 INFO:tasks.workunit.client.0.smithi112.stdout:1/385: chown d5/d8/d10/d2e/c63 4 1 2024-09-21T00:56:53.975 INFO:tasks.workunit.client.0.smithi112.stdout:8/608: write d0/d13/d1b/f70 [423787,33857] 0 2024-09-21T00:56:53.977 INFO:tasks.workunit.client.0.smithi112.stdout:0/446: creat d8/d11/d28/f87 x:0 0 0 2024-09-21T00:56:53.977 INFO:tasks.workunit.client.0.smithi112.stdout:0/447: dread - d8/d1b/f7e zero size 2024-09-21T00:56:53.979 INFO:tasks.workunit.client.0.smithi112.stdout:3/787: rename d2/d8/dd/de/d6b/f8f to d2/d8/d28/d35/d9e/dfa/f10f 0 2024-09-21T00:56:53.981 INFO:tasks.workunit.client.0.smithi112.stdout:2/542: read - d0/d45/d8a/d62/f6c zero size 2024-09-21T00:56:53.983 INFO:tasks.workunit.client.0.smithi112.stdout:8/609: rmdir d0/d13/d1b/d22/d2e/d34/d7b 39 2024-09-21T00:56:53.985 INFO:tasks.workunit.client.0.smithi112.stdout:4/590: write d1/d5/d1c/db3/fbd [3163347,40027] 0 2024-09-21T00:56:53.988 INFO:tasks.workunit.client.0.smithi112.stdout:2/543: mkdir d0/d14/d8/daf 0 2024-09-21T00:56:53.989 INFO:tasks.workunit.client.0.smithi112.stdout:2/544: write d0/d14/d22/f7e [717491,79485] 0 2024-09-21T00:56:53.990 INFO:tasks.workunit.client.0.smithi112.stdout:5/396: link d8/f5f d8/f81 0 2024-09-21T00:56:53.993 INFO:tasks.workunit.client.0.smithi112.stdout:0/448: mknod d8/d11/d59/c88 0 2024-09-21T00:56:53.997 INFO:tasks.workunit.client.0.smithi112.stdout:2/545: symlink d0/d14/d8/da2/lb0 0 2024-09-21T00:56:53.998 INFO:tasks.workunit.client.0.smithi112.stdout:8/610: mknod d0/d13/d1b/d22/d42/cba 0 2024-09-21T00:56:53.999 INFO:tasks.workunit.client.0.smithi112.stdout:3/788: dread d2/d8/f11 [4194304,4194304] 0 2024-09-21T00:56:53.999 INFO:tasks.workunit.client.0.smithi112.stdout:5/397: creat d8/d9/d40/f82 x:0 0 0 2024-09-21T00:56:54.001 INFO:tasks.workunit.client.0.smithi112.stdout:0/449: unlink d8/d1b/d2c/f6d 0 2024-09-21T00:56:54.001 INFO:tasks.workunit.client.0.smithi112.stdout:0/450: readlink d8/d1b/l71 0 2024-09-21T00:56:54.002 INFO:tasks.workunit.client.0.smithi112.stdout:6/517: getdents d9/d13/d60 0 2024-09-21T00:56:54.003 INFO:tasks.workunit.client.0.smithi112.stdout:4/591: rename d1/d5/d1c/d1e/d3d/c98 to d1/d5/d1c/d1e/d3d/db9/ccc 0 2024-09-21T00:56:54.004 INFO:tasks.workunit.client.0.smithi112.stdout:1/386: getdents d5/d8/d13 0 2024-09-21T00:56:54.006 INFO:tasks.workunit.client.0.smithi112.stdout:8/611: mknod d0/d13/d1b/d22/d42/d6d/cbb 0 2024-09-21T00:56:54.009 INFO:tasks.workunit.client.0.smithi112.stdout:3/789: symlink d2/d38/d3f/d53/d96/l110 0 2024-09-21T00:56:54.010 INFO:tasks.workunit.client.0.smithi112.stdout:2/546: dwrite d0/df/f16 [4194304,4194304] 0 2024-09-21T00:56:54.010 INFO:tasks.workunit.client.0.smithi112.stdout:5/398: symlink d8/d9/d13/d2a/d2c/l83 0 2024-09-21T00:56:54.012 INFO:tasks.workunit.client.0.smithi112.stdout:5/399: fdatasync d8/d9/d40/f41 0 2024-09-21T00:56:54.013 INFO:tasks.workunit.client.0.smithi112.stdout:5/400: write d8/d9/d13/d2a/d58/f5e [42116,7875] 0 2024-09-21T00:56:54.014 INFO:tasks.workunit.client.0.smithi112.stdout:0/451: mknod d8/d1b/d2c/d2e/c89 0 2024-09-21T00:56:54.015 INFO:tasks.workunit.client.0.smithi112.stdout:6/518: creat d9/d13/d21/fc1 x:0 0 0 2024-09-21T00:56:54.016 INFO:tasks.workunit.client.0.smithi112.stdout:6/519: chown d9/d1f/d47/c86 1134 1 2024-09-21T00:56:54.018 INFO:tasks.workunit.client.0.smithi112.stdout:4/592: truncate d1/d5/d1c/d1e/d3d/d99/fb5 103332 0 2024-09-21T00:56:54.018 INFO:tasks.workunit.client.0.smithi112.stdout:1/387: truncate d5/d8/d14/f25 761226 0 2024-09-21T00:56:54.019 INFO:tasks.workunit.client.0.smithi112.stdout:4/593: dread - d1/d5/d1c/d1e/d76/fc0 zero size 2024-09-21T00:56:54.020 INFO:tasks.workunit.client.0.smithi112.stdout:8/612: write d0/d13/d2a/f4d [337037,130281] 0 2024-09-21T00:56:54.021 INFO:tasks.workunit.client.0.smithi112.stdout:2/547: unlink d0/d14/f73 0 2024-09-21T00:56:54.024 INFO:tasks.workunit.client.0.smithi112.stdout:3/790: rename d2/d33/d8c/lf1 to d2/d33/d8c/db7/l111 0 2024-09-21T00:56:54.026 INFO:tasks.workunit.client.0.smithi112.stdout:4/594: dwrite d1/d5/d1c/d1e/d3d/fa3 [0,4194304] 0 2024-09-21T00:56:54.027 INFO:tasks.workunit.client.0.smithi112.stdout:5/401: mkdir d8/d9/d13/d2a/d84 0 2024-09-21T00:56:54.029 INFO:tasks.workunit.client.0.smithi112.stdout:0/452: creat d8/d11/d59/f8a x:0 0 0 2024-09-21T00:56:54.031 INFO:tasks.workunit.client.0.smithi112.stdout:1/388: symlink d5/d8/dd/d54/l7e 0 2024-09-21T00:56:54.040 INFO:tasks.workunit.client.0.smithi112.stdout:5/402: mkdir d8/d9/d13/d2a/d85 0 2024-09-21T00:56:54.043 INFO:tasks.workunit.client.0.smithi112.stdout:0/453: unlink d8/d1b/d2c/d2e/d4c/f86 0 2024-09-21T00:56:54.043 INFO:tasks.workunit.client.0.smithi112.stdout:9/549: truncate d5/d3b/d5f/d13/f45 2505689 0 2024-09-21T00:56:54.047 INFO:tasks.workunit.client.0.smithi112.stdout:2/548: mkdir d0/db1 0 2024-09-21T00:56:54.049 INFO:tasks.workunit.client.0.smithi112.stdout:8/613: getdents d0/d13/d1b/d22/d42/d51/d9a 0 2024-09-21T00:56:54.053 INFO:tasks.workunit.client.0.smithi112.stdout:7/543: truncate d0/d2/f64 1095346 0 2024-09-21T00:56:54.053 INFO:tasks.workunit.client.0.smithi112.stdout:7/544: chown d0/d2/d36/f90 3 1 2024-09-21T00:56:54.054 INFO:tasks.workunit.client.0.smithi112.stdout:2/549: creat d0/df/fb2 x:0 0 0 2024-09-21T00:56:54.055 INFO:tasks.workunit.client.0.smithi112.stdout:7/545: write d0/f46 [5014168,80818] 0 2024-09-21T00:56:54.056 INFO:tasks.workunit.client.0.smithi112.stdout:9/550: mkdir d5/db4 0 2024-09-21T00:56:54.059 INFO:tasks.workunit.client.0.smithi112.stdout:2/550: readlink d0/d60/l84 0 2024-09-21T00:56:54.061 INFO:tasks.workunit.client.0.smithi112.stdout:8/614: mkdir d0/d13/d2a/d73/d96/dbc 0 2024-09-21T00:56:54.063 INFO:tasks.workunit.client.0.smithi112.stdout:7/546: dwrite d0/d2/f7a [0,4194304] 0 2024-09-21T00:56:54.064 INFO:tasks.workunit.client.0.smithi112.stdout:7/547: chown d0/d2/d92 8775076 1 2024-09-21T00:56:54.064 INFO:tasks.workunit.client.0.smithi112.stdout:2/551: unlink d0/d14/d8/c2e 0 2024-09-21T00:56:54.064 INFO:tasks.workunit.client.0.smithi112.stdout:5/403: dread d8/d9/d13/d2a/f18 [0,4194304] 0 2024-09-21T00:56:54.068 INFO:tasks.workunit.client.0.smithi112.stdout:7/548: write d0/d2/d36/f49 [1785409,54288] 0 2024-09-21T00:56:54.069 INFO:tasks.workunit.client.0.smithi112.stdout:8/615: mknod d0/d13/d2a/cbd 0 2024-09-21T00:56:54.071 INFO:tasks.workunit.client.0.smithi112.stdout:7/549: mknod d0/d2/d32/da4/cb5 0 2024-09-21T00:56:54.073 INFO:tasks.workunit.client.0.smithi112.stdout:5/404: rmdir d8/d9/d13/d2a/df/d5b/d80 0 2024-09-21T00:56:54.074 INFO:tasks.workunit.client.0.smithi112.stdout:5/405: truncate d8/f3f 5090938 0 2024-09-21T00:56:54.075 INFO:tasks.workunit.client.0.smithi112.stdout:8/616: creat d0/d13/d2a/d73/d96/dbc/fbe x:0 0 0 2024-09-21T00:56:54.075 INFO:tasks.workunit.client.0.smithi112.stdout:5/406: fsync d8/d9/d13/d2a/d58/f5e 0 2024-09-21T00:56:54.076 INFO:tasks.workunit.client.0.smithi112.stdout:7/550: mknod d0/d2/d92/cb6 0 2024-09-21T00:56:54.078 INFO:tasks.workunit.client.0.smithi112.stdout:8/617: symlink d0/d13/d9f/lbf 0 2024-09-21T00:56:54.079 INFO:tasks.workunit.client.0.smithi112.stdout:8/618: fdatasync d0/d13/d2a/d73/d96/dbc/fbe 0 2024-09-21T00:56:54.080 INFO:tasks.workunit.client.0.smithi112.stdout:7/551: rename d0/d2/d36/d39/f73 to d0/d2/d32/fb7 0 2024-09-21T00:56:54.085 INFO:tasks.workunit.client.0.smithi112.stdout:7/552: creat d0/d2/d92/fb8 x:0 0 0 2024-09-21T00:56:54.086 INFO:tasks.workunit.client.0.smithi112.stdout:2/552: dread d0/f53 [0,4194304] 0 2024-09-21T00:56:54.087 INFO:tasks.workunit.client.0.smithi112.stdout:7/553: dread - d0/f95 zero size 2024-09-21T00:56:54.089 INFO:tasks.workunit.client.0.smithi112.stdout:8/619: dwrite d0/d13/d2a/f45 [0,4194304] 0 2024-09-21T00:56:54.092 INFO:tasks.workunit.client.0.smithi112.stdout:2/553: unlink d0/f2b 0 2024-09-21T00:56:54.094 INFO:tasks.workunit.client.0.smithi112.stdout:2/554: chown d0/df/d46/d97/ca6 12555595 1 2024-09-21T00:56:54.095 INFO:tasks.workunit.client.0.smithi112.stdout:7/554: symlink d0/d2/d2e/lb9 0 2024-09-21T00:56:54.096 INFO:tasks.workunit.client.0.smithi112.stdout:5/407: dread d8/d9/d13/d2a/d58/f73 [0,4194304] 0 2024-09-21T00:56:54.097 INFO:tasks.workunit.client.0.smithi112.stdout:5/408: stat d8/d9/d13/d2a/l52 0 2024-09-21T00:56:54.099 INFO:tasks.workunit.client.0.smithi112.stdout:2/555: creat d0/df/fb3 x:0 0 0 2024-09-21T00:56:54.103 INFO:tasks.workunit.client.0.smithi112.stdout:7/555: mkdir d0/d2/d32/da4/db2/db4/dba 0 2024-09-21T00:56:54.104 INFO:tasks.workunit.client.0.smithi112.stdout:2/556: rename d0/d14/d8/d27/d7a/fa3 to d0/d14/d8/fb4 0 2024-09-21T00:56:54.106 INFO:tasks.workunit.client.0.smithi112.stdout:2/557: chown d0/d14/d8/d27/d7a/f93 29460480 1 2024-09-21T00:56:54.107 INFO:tasks.workunit.client.0.smithi112.stdout:7/556: write d0/d2/d36/d39/d56/d65/fb1 [461431,106507] 0 2024-09-21T00:56:54.108 INFO:tasks.workunit.client.0.smithi112.stdout:8/620: link d0/f41 d0/d13/d1b/d22/d2e/fc0 0 2024-09-21T00:56:54.113 INFO:tasks.workunit.client.0.smithi112.stdout:7/557: dread d0/d2/d2e/f5f [0,4194304] 0 2024-09-21T00:56:54.114 INFO:tasks.workunit.client.0.smithi112.stdout:8/621: write d0/d13/d1b/d22/d2e/d34/d7b/f8e [976366,21295] 0 2024-09-21T00:56:54.114 INFO:tasks.workunit.client.0.smithi112.stdout:2/558: link d0/d45/d8a/f57 d0/d14/d22/d6d/fb5 0 2024-09-21T00:56:54.115 INFO:tasks.workunit.client.0.smithi112.stdout:8/622: fsync d0/d13/d1b/f1e 0 2024-09-21T00:56:54.115 INFO:tasks.workunit.client.0.smithi112.stdout:2/559: stat d0/d14/d47/c76 0 2024-09-21T00:56:54.116 INFO:tasks.workunit.client.0.smithi112.stdout:8/623: stat d0/d13/d1b/d22/d2e/d34/d7b/d80/fa7 0 2024-09-21T00:56:54.121 INFO:tasks.workunit.client.0.smithi112.stdout:8/624: dwrite d0/d66/f50 [0,4194304] 0 2024-09-21T00:56:54.122 INFO:tasks.workunit.client.0.smithi112.stdout:7/558: rename d0/d2/d32/l63 to d0/lbb 0 2024-09-21T00:56:54.123 INFO:tasks.workunit.client.0.smithi112.stdout:8/625: read d0/d13/d1b/f30 [128174,38817] 0 2024-09-21T00:56:54.124 INFO:tasks.workunit.client.0.smithi112.stdout:2/560: creat d0/d14/fb6 x:0 0 0 2024-09-21T00:56:54.124 INFO:tasks.workunit.client.0.smithi112.stdout:8/626: fdatasync d0/f62 0 2024-09-21T00:56:54.129 INFO:tasks.workunit.client.0.smithi112.stdout:8/627: mkdir d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1 0 2024-09-21T00:56:54.129 INFO:tasks.workunit.client.0.smithi112.stdout:3/791: write d2/d38/f91 [115957,20210] 0 2024-09-21T00:56:54.132 INFO:tasks.workunit.client.0.smithi112.stdout:2/561: creat d0/d60/fb7 x:0 0 0 2024-09-21T00:56:54.134 INFO:tasks.workunit.client.0.smithi112.stdout:2/562: chown d0/d14/d47/d70 14494 1 2024-09-21T00:56:54.136 INFO:tasks.workunit.client.0.smithi112.stdout:8/628: rename d0/d13/d1b/d22/d42/d6d to d0/d13/d9f/dc2 0 2024-09-21T00:56:54.138 INFO:tasks.workunit.client.0.smithi112.stdout:8/629: readlink d0/d66/l7d 0 2024-09-21T00:56:54.139 INFO:tasks.workunit.client.0.smithi112.stdout:2/563: chown d0/d14/d8/d27/f3f 479 1 2024-09-21T00:56:54.142 INFO:tasks.workunit.client.0.smithi112.stdout:4/595: dwrite d1/d7/d9/d1a/d22/d6e/f9d [0,4194304] 0 2024-09-21T00:56:54.143 INFO:tasks.workunit.client.0.smithi112.stdout:7/559: link d0/d2/d36/d39/d56/d65/ca0 d0/d2/d32/da4/db2/db4/dba/cbc 0 2024-09-21T00:56:54.144 INFO:tasks.workunit.client.0.smithi112.stdout:6/520: dwrite d9/fc [0,4194304] 0 2024-09-21T00:56:54.144 INFO:tasks.workunit.client.0.smithi112.stdout:1/389: write d5/d8/d10/d2e/f60 [724806,94661] 0 2024-09-21T00:56:54.146 INFO:tasks.workunit.client.0.smithi112.stdout:2/564: dread - d0/d45/d8a/d62/f6c zero size 2024-09-21T00:56:54.150 INFO:tasks.workunit.client.0.smithi112.stdout:3/792: dwrite d2/d38/fb6 [0,4194304] 0 2024-09-21T00:56:54.150 INFO:tasks.workunit.client.0.smithi112.stdout:1/390: write d5/f74 [1065535,13274] 0 2024-09-21T00:56:54.156 INFO:tasks.workunit.client.0.smithi112.stdout:0/454: truncate d8/d1b/d2c/f30 879394 0 2024-09-21T00:56:54.160 INFO:tasks.workunit.client.0.smithi112.stdout:4/596: unlink d1/d7/d9/d1a/d8e/fa9 0 2024-09-21T00:56:54.164 INFO:tasks.workunit.client.0.smithi112.stdout:8/630: dread d0/d66/d88/f95 [0,4194304] 0 2024-09-21T00:56:54.174 INFO:tasks.workunit.client.0.smithi112.stdout:1/391: mkdir d5/d34/d6a/d7f 0 2024-09-21T00:56:54.176 INFO:tasks.workunit.client.0.smithi112.stdout:8/631: write d0/d13/d1b/d22/f24 [3431660,108657] 0 2024-09-21T00:56:54.181 INFO:tasks.workunit.client.0.smithi112.stdout:4/597: dread d1/d5/d1c/d1e/f20 [0,4194304] 0 2024-09-21T00:56:54.186 INFO:tasks.workunit.client.0.smithi112.stdout:5/409: dwrite d8/d9/d40/f42 [0,4194304] 0 2024-09-21T00:56:54.188 INFO:tasks.workunit.client.0.smithi112.stdout:0/455: symlink d8/d11/d28/d54/l8b 0 2024-09-21T00:56:54.191 INFO:tasks.workunit.client.0.smithi112.stdout:8/632: creat d0/d13/d1b/d22/d61/fc3 x:0 0 0 2024-09-21T00:56:54.197 INFO:tasks.workunit.client.0.smithi112.stdout:5/410: unlink d8/d9/d13/d2a/d58/f73 0 2024-09-21T00:56:54.198 INFO:tasks.workunit.client.0.smithi112.stdout:0/456: creat d8/d1b/d2c/d2e/d4c/d64/f8c x:0 0 0 2024-09-21T00:56:54.201 INFO:tasks.workunit.client.0.smithi112.stdout:8/633: mknod d0/d13/cc4 0 2024-09-21T00:56:54.205 INFO:tasks.workunit.client.0.smithi112.stdout:9/551: write d5/d6/d19/f2a [1396292,114004] 0 2024-09-21T00:56:54.207 INFO:tasks.workunit.client.0.smithi112.stdout:8/634: dwrite d0/fb [0,4194304] 0 2024-09-21T00:56:54.209 INFO:tasks.workunit.client.0.smithi112.stdout:8/635: write d0/d13/d2a/fb3 [204047,82719] 0 2024-09-21T00:56:54.211 INFO:tasks.workunit.client.0.smithi112.stdout:0/457: creat d8/d1b/d2c/d2e/f8d x:0 0 0 2024-09-21T00:56:54.213 INFO:tasks.workunit.client.0.smithi112.stdout:4/598: link d1/d7/c10 d1/d75/ccd 0 2024-09-21T00:56:54.219 INFO:tasks.workunit.client.0.smithi112.stdout:9/552: creat d5/d3b/d5f/d13/d54/d7d/d57/fb5 x:0 0 0 2024-09-21T00:56:54.221 INFO:tasks.workunit.client.0.smithi112.stdout:8/636: symlink d0/d13/d9f/lc5 0 2024-09-21T00:56:54.221 INFO:tasks.workunit.client.0.smithi112.stdout:8/637: chown d0/l8c 266 1 2024-09-21T00:56:54.223 INFO:tasks.workunit.client.0.smithi112.stdout:8/638: chown d0/d13/d2a/d73/d96/caf 1922 1 2024-09-21T00:56:54.223 INFO:tasks.workunit.client.0.smithi112.stdout:8/639: chown d0/d13/d2a/d73/d96/caf 445 1 2024-09-21T00:56:54.224 INFO:tasks.workunit.client.0.smithi112.stdout:0/458: creat d8/d1b/f8e x:0 0 0 2024-09-21T00:56:54.225 INFO:tasks.workunit.client.0.smithi112.stdout:6/521: write d9/d1f/d47/d34/da6/f5d [1880866,56515] 0 2024-09-21T00:56:54.233 INFO:tasks.workunit.client.0.smithi112.stdout:1/392: dwrite d5/d34/f42 [0,4194304] 0 2024-09-21T00:56:54.234 INFO:tasks.workunit.client.0.smithi112.stdout:3/793: dwrite d2/d8/d6d/fa2 [0,4194304] 0 2024-09-21T00:56:54.242 INFO:tasks.workunit.client.0.smithi112.stdout:9/553: mknod d5/d3b/d5f/d13/d54/d7d/cb6 0 2024-09-21T00:56:54.244 INFO:tasks.workunit.client.0.smithi112.stdout:8/640: mkdir d0/d13/dab/dc6 0 2024-09-21T00:56:54.245 INFO:tasks.workunit.client.0.smithi112.stdout:8/641: readlink d0/d13/d1b/d22/d2e/l5a 0 2024-09-21T00:56:54.245 INFO:tasks.workunit.client.0.smithi112.stdout:1/393: read d5/d8/f1f [46135,112912] 0 2024-09-21T00:56:54.246 INFO:tasks.workunit.client.0.smithi112.stdout:1/394: write d5/d8/d10/f29 [3675388,50676] 0 2024-09-21T00:56:54.249 INFO:tasks.workunit.client.0.smithi112.stdout:3/794: unlink d2/d3e/c75 0 2024-09-21T00:56:54.249 INFO:tasks.workunit.client.0.smithi112.stdout:5/411: truncate d8/d9/d13/d2a/f12 1154068 0 2024-09-21T00:56:54.251 INFO:tasks.workunit.client.0.smithi112.stdout:3/795: write d2/d8/d28/d9d/fc0 [1232483,3362] 0 2024-09-21T00:56:54.254 INFO:tasks.workunit.client.0.smithi112.stdout:9/554: creat d5/d3b/d5f/d13/d6e/da0/da4/fb7 x:0 0 0 2024-09-21T00:56:54.256 INFO:tasks.workunit.client.0.smithi112.stdout:4/599: write d1/d5/d1c/d1e/d4a/f7d [363737,92582] 0 2024-09-21T00:56:54.259 INFO:tasks.workunit.client.0.smithi112.stdout:1/395: mknod d5/d8/d10/d2e/c80 0 2024-09-21T00:56:54.261 INFO:tasks.workunit.client.0.smithi112.stdout:6/522: write d9/d1f/f81 [84465,66158] 0 2024-09-21T00:56:54.262 INFO:tasks.workunit.client.0.smithi112.stdout:6/523: chown d9/d13/d26 0 1 2024-09-21T00:56:54.265 INFO:tasks.workunit.client.0.smithi112.stdout:0/459: truncate d8/d11/d28/d54/f55 2636522 0 2024-09-21T00:56:54.266 INFO:tasks.workunit.client.0.smithi112.stdout:0/460: write d8/d1b/f4b [3267213,6251] 0 2024-09-21T00:56:54.267 INFO:tasks.workunit.client.0.smithi112.stdout:3/796: symlink d2/d33/d78/l112 0 2024-09-21T00:56:54.268 INFO:tasks.workunit.client.0.smithi112.stdout:3/797: dread - d2/d8/d28/fe0 zero size 2024-09-21T00:56:54.269 INFO:tasks.workunit.client.0.smithi112.stdout:7/560: dread d0/d2/f64 [0,4194304] 0 2024-09-21T00:56:54.269 INFO:tasks.workunit.client.0.smithi112.stdout:4/600: rmdir d1/d2d 39 2024-09-21T00:56:54.271 INFO:tasks.workunit.client.0.smithi112.stdout:1/396: truncate d5/d8/d13/d3e/f5b 139087 0 2024-09-21T00:56:54.273 INFO:tasks.workunit.client.0.smithi112.stdout:6/524: chown d9/d13/d31/l88 199461359 1 2024-09-21T00:56:54.277 INFO:tasks.workunit.client.0.smithi112.stdout:0/461: rmdir d8/d11/d28 39 2024-09-21T00:56:54.279 INFO:tasks.workunit.client.0.smithi112.stdout:0/462: write d8/d75/f70 [779574,126435] 0 2024-09-21T00:56:54.281 INFO:tasks.workunit.client.0.smithi112.stdout:6/525: dwrite d9/d1f/d47/d34/da6/da7/f75 [0,4194304] 0 2024-09-21T00:56:54.283 INFO:tasks.workunit.client.0.smithi112.stdout:3/798: fdatasync d2/f86 0 2024-09-21T00:56:54.283 INFO:tasks.workunit.client.0.smithi112.stdout:9/555: write d5/d3b/d5f/d13/d54/d7d/d57/d6a/f97 [5114924,109330] 0 2024-09-21T00:56:54.285 INFO:tasks.workunit.client.0.smithi112.stdout:3/799: fdatasync d2/d38/d3f/fa9 0 2024-09-21T00:56:54.286 INFO:tasks.workunit.client.0.smithi112.stdout:3/800: readlink d2/d8/l6e 0 2024-09-21T00:56:54.288 INFO:tasks.workunit.client.0.smithi112.stdout:7/561: stat d0/d2/d38/d48/l8a 0 2024-09-21T00:56:54.290 INFO:tasks.workunit.client.0.smithi112.stdout:5/412: rename d8/d9/d13/d2a/f3b to d8/d9/d13/f86 0 2024-09-21T00:56:54.294 INFO:tasks.workunit.client.0.smithi112.stdout:9/556: dwrite d5/d3b/d5f/d13/d6e/da0/da4/fb7 [0,4194304] 0 2024-09-21T00:56:54.294 INFO:tasks.workunit.client.0.smithi112.stdout:8/642: getdents d0/d13/d1b 0 2024-09-21T00:56:54.297 INFO:tasks.workunit.client.0.smithi112.stdout:6/526: mknod d9/d1f/d3e/cc2 0 2024-09-21T00:56:54.297 INFO:tasks.workunit.client.0.smithi112.stdout:8/643: dread - d0/d13/d1b/d22/d61/f67 zero size 2024-09-21T00:56:54.299 INFO:tasks.workunit.client.0.smithi112.stdout:8/644: write d0/f10 [629940,82124] 0 2024-09-21T00:56:54.302 INFO:tasks.workunit.client.0.smithi112.stdout:8/645: stat d0/d13/d2a/lb6 0 2024-09-21T00:56:54.305 INFO:tasks.workunit.client.0.smithi112.stdout:0/463: dwrite d8/d11/d28/f87 [0,4194304] 0 2024-09-21T00:56:54.307 INFO:tasks.workunit.client.0.smithi112.stdout:4/601: stat d1/d5/d1c/d1e/d76/fc0 0 2024-09-21T00:56:54.312 INFO:tasks.workunit.client.0.smithi112.stdout:7/562: dread - d0/d2/d32/fb7 zero size 2024-09-21T00:56:54.314 INFO:tasks.workunit.client.0.smithi112.stdout:6/527: dwrite d9/d1f/fb3 [0,4194304] 0 2024-09-21T00:56:54.315 INFO:tasks.workunit.client.0.smithi112.stdout:9/557: dwrite d5/d3b/d5f/d13/fa1 [0,4194304] 0 2024-09-21T00:56:54.318 INFO:tasks.workunit.client.0.smithi112.stdout:9/558: truncate d5/d3b/d5f/d13/d54/d7d/d57/fb5 86812 0 2024-09-21T00:56:54.321 INFO:tasks.workunit.client.0.smithi112.stdout:0/464: symlink d8/d1b/d2c/d2e/d4c/d64/l8f 0 2024-09-21T00:56:54.325 INFO:tasks.workunit.client.0.smithi112.stdout:7/563: rename d0/f46 to d0/d2/d36/d39/d56/d65/d87/fbd 0 2024-09-21T00:56:54.325 INFO:tasks.workunit.client.0.smithi112.stdout:0/465: stat d8/d11/d28/f68 0 2024-09-21T00:56:54.326 INFO:tasks.workunit.client.0.smithi112.stdout:7/564: chown d0/d2/d92 3 1 2024-09-21T00:56:54.327 INFO:tasks.workunit.client.0.smithi112.stdout:6/528: mkdir d9/d13/d60/dc3 0 2024-09-21T00:56:54.328 INFO:tasks.workunit.client.0.smithi112.stdout:9/559: dread - d5/d3b/d5f/d13/f50 zero size 2024-09-21T00:56:54.330 INFO:tasks.workunit.client.0.smithi112.stdout:7/565: write d0/d2/d36/d39/d55/f9d [248910,75620] 0 2024-09-21T00:56:54.331 INFO:tasks.workunit.client.0.smithi112.stdout:3/801: write d2/d3e/f71 [1778999,434] 0 2024-09-21T00:56:54.332 INFO:tasks.workunit.client.0.smithi112.stdout:9/560: chown d5/d6/d19/d51 15548217 1 2024-09-21T00:56:54.335 INFO:tasks.workunit.client.0.smithi112.stdout:7/566: dread d0/d2/d2e/f5f [0,4194304] 0 2024-09-21T00:56:54.336 INFO:tasks.workunit.client.0.smithi112.stdout:4/602: rename d1/d2d/l89 to d1/d5/d1c/d1e/daf/lce 0 2024-09-21T00:56:54.336 INFO:tasks.workunit.client.0.smithi112.stdout:5/413: dwrite d8/f5f [4194304,4194304] 0 2024-09-21T00:56:54.341 INFO:tasks.workunit.client.0.smithi112.stdout:4/603: read - d1/d5/d1c/d1e/d76/fc0 zero size 2024-09-21T00:56:54.341 INFO:tasks.workunit.client.0.smithi112.stdout:7/567: stat d0/d2/d36/d39/d56/d65/d75/l9c 0 2024-09-21T00:56:54.341 INFO:tasks.workunit.client.0.smithi112.stdout:4/604: fsync d1/d2d/d34/f58 0 2024-09-21T00:56:54.345 INFO:tasks.workunit.client.0.smithi112.stdout:9/561: rename d5/d3b/d5f/f31 to d5/d6/d19/d51/d8f/fb8 0 2024-09-21T00:56:54.345 INFO:tasks.workunit.client.0.smithi112.stdout:8/646: dread d0/d13/f44 [0,4194304] 0 2024-09-21T00:56:54.346 INFO:tasks.workunit.client.0.smithi112.stdout:9/562: write d5/fb [1483366,94494] 0 2024-09-21T00:56:54.346 INFO:tasks.workunit.client.0.smithi112.stdout:3/802: read d2/d8/dd/de/d4a/d4c/d7c/fe7 [880807,131012] 0 2024-09-21T00:56:54.348 INFO:tasks.workunit.client.0.smithi112.stdout:9/563: readlink d5/d3b/d5f/d13/d54/d7d/d57/l9a 0 2024-09-21T00:56:54.349 INFO:tasks.workunit.client.0.smithi112.stdout:5/414: symlink d8/d9/d13/d1c/l87 0 2024-09-21T00:56:54.353 INFO:tasks.workunit.client.0.smithi112.stdout:0/466: write d8/d1b/d2c/d2e/f4a [4465067,80381] 0 2024-09-21T00:56:54.355 INFO:tasks.workunit.client.0.smithi112.stdout:0/467: truncate d8/f63 1440253 0 2024-09-21T00:56:54.357 INFO:tasks.workunit.client.0.smithi112.stdout:8/647: creat d0/d13/dab/fc7 x:0 0 0 2024-09-21T00:56:54.359 INFO:tasks.workunit.client.0.smithi112.stdout:5/415: creat d8/d9/d13/d2a/df/d5b/f88 x:0 0 0 2024-09-21T00:56:54.361 INFO:tasks.workunit.client.0.smithi112.stdout:5/416: read d8/f81 [1761390,20373] 0 2024-09-21T00:56:54.362 INFO:tasks.workunit.client.0.smithi112.stdout:0/468: fdatasync d8/f35 0 2024-09-21T00:56:54.365 INFO:tasks.workunit.client.0.smithi112.stdout:7/568: dread d0/d2/d36/d39/d1a/f44 [4194304,4194304] 0 2024-09-21T00:56:54.365 INFO:tasks.workunit.client.0.smithi112.stdout:9/564: mkdir d5/d3b/d5f/db9 0 2024-09-21T00:56:54.367 INFO:tasks.workunit.client.0.smithi112.stdout:8/648: truncate d0/d13/d1b/f30 2892943 0 2024-09-21T00:56:54.373 INFO:tasks.workunit.client.0.smithi112.stdout:5/417: creat d8/d9/d13/d2a/d2c/d49/f89 x:0 0 0 2024-09-21T00:56:54.377 INFO:tasks.workunit.client.0.smithi112.stdout:9/565: truncate d5/f5e 592011 0 2024-09-21T00:56:54.378 INFO:tasks.workunit.client.0.smithi112.stdout:9/566: write d5/d3b/d5f/d13/d54/f90 [495124,130612] 0 2024-09-21T00:56:54.380 INFO:tasks.workunit.client.0.smithi112.stdout:7/569: dread d0/d2/d36/d39/d56/d65/d75/f84 [0,4194304] 0 2024-09-21T00:56:54.383 INFO:tasks.workunit.client.0.smithi112.stdout:3/803: getdents d2/d38 0 2024-09-21T00:56:54.384 INFO:tasks.workunit.client.0.smithi112.stdout:7/570: dread d0/d2/f7a [0,4194304] 0 2024-09-21T00:56:54.386 INFO:tasks.workunit.client.0.smithi112.stdout:5/418: unlink d8/d9/d13/d2a/d2c/f76 0 2024-09-21T00:56:54.387 INFO:tasks.workunit.client.0.smithi112.stdout:0/469: rename d8/d11/f26 to d8/d1b/d2c/d2e/d4c/d64/f90 0 2024-09-21T00:56:54.388 INFO:tasks.workunit.client.0.smithi112.stdout:5/419: dread d8/d9/d13/d1c/f53 [0,4194304] 0 2024-09-21T00:56:54.391 INFO:tasks.workunit.client.0.smithi112.stdout:4/605: link d1/d7/c59 d1/d7/d9/d1a/d22/ccf 0 2024-09-21T00:56:54.392 INFO:tasks.workunit.client.0.smithi112.stdout:3/804: symlink d2/d3e/d7b/d10d/l113 0 2024-09-21T00:56:54.393 INFO:tasks.workunit.client.0.smithi112.stdout:3/805: stat d2/d8/f16 0 2024-09-21T00:56:54.394 INFO:tasks.workunit.client.0.smithi112.stdout:3/806: write d2/d8/dd/de/d4a/fbd [2049933,7965] 0 2024-09-21T00:56:54.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/807: read - d2/d3e/f108 zero size 2024-09-21T00:56:54.396 INFO:tasks.workunit.client.0.smithi112.stdout:3/808: fdatasync d2/d33/d8c/fe6 0 2024-09-21T00:56:54.403 INFO:tasks.workunit.client.0.smithi112.stdout:7/571: dwrite d0/d2/d36/d39/d56/d65/d75/f84 [4194304,4194304] 0 2024-09-21T00:56:54.404 INFO:tasks.workunit.client.0.smithi112.stdout:8/649: rename d0/fa9 to d0/d66/fc8 0 2024-09-21T00:56:54.405 INFO:tasks.workunit.client.0.smithi112.stdout:3/809: dwrite d2/d8/dd/f101 [0,4194304] 0 2024-09-21T00:56:54.410 INFO:tasks.workunit.client.0.smithi112.stdout:5/420: mkdir d8/d9/d13/d1c/d45/d8a 0 2024-09-21T00:56:54.417 INFO:tasks.workunit.client.0.smithi112.stdout:3/810: dread d2/d8/d28/d9d/fc0 [0,4194304] 0 2024-09-21T00:56:54.417 INFO:tasks.workunit.client.0.smithi112.stdout:7/572: dwrite d0/d2/d36/f90 [0,4194304] 0 2024-09-21T00:56:54.426 INFO:tasks.workunit.client.0.smithi112.stdout:5/421: dwrite d8/d9/d13/d2a/d2c/f69 [0,4194304] 0 2024-09-21T00:56:54.434 INFO:tasks.workunit.client.0.smithi112.stdout:4/606: rename d1/d5/d1c/d1e/d76/db0/fbc to d1/d5/d1c/d1e/d3d/db9/fd0 0 2024-09-21T00:56:54.442 INFO:tasks.workunit.client.0.smithi112.stdout:7/573: fsync d0/d2/d36/f90 0 2024-09-21T00:56:54.443 INFO:tasks.workunit.client.0.smithi112.stdout:3/811: rmdir d2/d38/d3f/d53/d96 39 2024-09-21T00:56:54.443 INFO:tasks.workunit.client.0.smithi112.stdout:9/567: write d5/d3b/d5f/d13/d54/d7d/f40 [1236544,87410] 0 2024-09-21T00:56:54.446 INFO:tasks.workunit.client.0.smithi112.stdout:5/422: rename d8/d9/d40 to d8/d9/d13/d2a/d84/d8b 0 2024-09-21T00:56:54.447 INFO:tasks.workunit.client.0.smithi112.stdout:8/650: mknod d0/d13/d2a/cc9 0 2024-09-21T00:56:54.448 INFO:tasks.workunit.client.0.smithi112.stdout:5/423: stat d8/d9/d13/d1c 0 2024-09-21T00:56:54.451 INFO:tasks.workunit.client.0.smithi112.stdout:9/568: dwrite d5/d3b/d5f/d13/d54/d7d/f40 [0,4194304] 0 2024-09-21T00:56:54.451 INFO:tasks.workunit.client.0.smithi112.stdout:7/574: symlink d0/d2/d32/lbe 0 2024-09-21T00:56:54.458 INFO:tasks.workunit.client.0.smithi112.stdout:0/470: dwrite d8/d11/f22 [4194304,4194304] 0 2024-09-21T00:56:54.460 INFO:tasks.workunit.client.0.smithi112.stdout:8/651: creat d0/d13/d9f/fca x:0 0 0 2024-09-21T00:56:54.465 INFO:tasks.workunit.client.0.smithi112.stdout:3/812: mknod d2/d8/dd/de/de9/c114 0 2024-09-21T00:56:54.467 INFO:tasks.workunit.client.0.smithi112.stdout:7/575: rmdir d0/d2/d32/da4/db2/db4/dba 39 2024-09-21T00:56:54.470 INFO:tasks.workunit.client.0.smithi112.stdout:0/471: mkdir d8/d75/d91 0 2024-09-21T00:56:54.474 INFO:tasks.workunit.client.0.smithi112.stdout:3/813: dwrite d2/d8/dd/de/d4a/d4c/f6c [4194304,4194304] 0 2024-09-21T00:56:54.475 INFO:tasks.workunit.client.0.smithi112.stdout:7/576: symlink d0/d2/d36/d39/d56/lbf 0 2024-09-21T00:56:54.477 INFO:tasks.workunit.client.0.smithi112.stdout:8/652: fsync d0/d13/d1b/d22/d2e/fc0 0 2024-09-21T00:56:54.480 INFO:tasks.workunit.client.0.smithi112.stdout:9/569: link d5/d3b/d5f/d59/l73 d5/d6/d3f/lba 0 2024-09-21T00:56:54.482 INFO:tasks.workunit.client.0.smithi112.stdout:9/570: fdatasync d5/d3b/d5f/d13/d54/f90 0 2024-09-21T00:56:54.483 INFO:tasks.workunit.client.0.smithi112.stdout:7/577: creat d0/d2/d36/d39/d56/d65/d87/fc0 x:0 0 0 2024-09-21T00:56:54.485 INFO:tasks.workunit.client.0.smithi112.stdout:7/578: dread - d0/d2/d36/d39/d1a/da5/fb0 zero size 2024-09-21T00:56:54.485 INFO:tasks.workunit.client.0.smithi112.stdout:9/571: read d5/d3b/d5f/d13/d54/d7d/d57/d6a/f93 [602324,6206] 0 2024-09-21T00:56:54.486 INFO:tasks.workunit.client.0.smithi112.stdout:8/653: unlink d0/d13/d2a/fb3 0 2024-09-21T00:56:54.488 INFO:tasks.workunit.client.0.smithi112.stdout:9/572: truncate d5/d6/f9d 353747 0 2024-09-21T00:56:54.489 INFO:tasks.workunit.client.0.smithi112.stdout:3/814: mkdir d2/d8/d115 0 2024-09-21T00:56:54.493 INFO:tasks.workunit.client.0.smithi112.stdout:0/472: dread d8/d11/f37 [0,4194304] 0 2024-09-21T00:56:54.495 INFO:tasks.workunit.client.0.smithi112.stdout:7/579: dwrite d0/d6e/f81 [0,4194304] 0 2024-09-21T00:56:54.495 INFO:tasks.workunit.client.0.smithi112.stdout:0/473: chown d8/d1b/d2c/d2e/d4c 0 1 2024-09-21T00:56:54.499 INFO:tasks.workunit.client.0.smithi112.stdout:8/654: mkdir d0/d13/dab/dcb 0 2024-09-21T00:56:54.502 INFO:tasks.workunit.client.0.smithi112.stdout:0/474: fsync d8/d1b/f4b 0 2024-09-21T00:56:54.505 INFO:tasks.workunit.client.0.smithi112.stdout:8/655: fdatasync d0/d13/d1b/d22/d2e/fa1 0 2024-09-21T00:56:54.505 INFO:tasks.workunit.client.0.smithi112.stdout:7/580: creat d0/d2/d36/d39/d56/d86/fc1 x:0 0 0 2024-09-21T00:56:54.507 INFO:tasks.workunit.client.0.smithi112.stdout:9/573: dwrite d5/d3b/d5f/d13/d6e/da0/da4/fb7 [0,4194304] 0 2024-09-21T00:56:54.507 INFO:tasks.workunit.client.0.smithi112.stdout:0/475: chown d8/d11/d59/f5a 184 1 2024-09-21T00:56:54.508 INFO:tasks.workunit.client.0.smithi112.stdout:5/424: dwrite d8/d9/f27 [0,4194304] 0 2024-09-21T00:56:54.512 INFO:tasks.workunit.client.0.smithi112.stdout:5/425: dread - d8/d9/d13/d2a/df/f7f zero size 2024-09-21T00:56:54.513 INFO:tasks.workunit.client.0.smithi112.stdout:9/574: truncate d5/d3b/d5f/d13/d54/f90 868581 0 2024-09-21T00:56:54.515 INFO:tasks.workunit.client.0.smithi112.stdout:5/426: readlink d8/d9/d13/d2a/d58/l66 0 2024-09-21T00:56:54.516 INFO:tasks.workunit.client.0.smithi112.stdout:8/656: dwrite d0/f10 [0,4194304] 0 2024-09-21T00:56:54.516 INFO:tasks.workunit.client.0.smithi112.stdout:9/575: fdatasync d5/d3b/d5f/d13/d54/f90 0 2024-09-21T00:56:54.519 INFO:tasks.workunit.client.0.smithi112.stdout:7/581: mkdir d0/d2/d36/d39/d56/d86/dc2 0 2024-09-21T00:56:54.525 INFO:tasks.workunit.client.0.smithi112.stdout:3/815: write d2/d8/d28/d35/d9e/fc4 [1506869,78197] 0 2024-09-21T00:56:54.529 INFO:tasks.workunit.client.0.smithi112.stdout:8/657: rename d0/d13/d9f/dc2/c77 to d0/d13/dab/dcb/ccc 0 2024-09-21T00:56:54.532 INFO:tasks.workunit.client.0.smithi112.stdout:9/576: mkdir d5/d3b/d5f/d13/d54/dbb 0 2024-09-21T00:56:54.535 INFO:tasks.workunit.client.0.smithi112.stdout:3/816: mknod d2/d33/d8c/db7/c116 0 2024-09-21T00:56:54.537 INFO:tasks.workunit.client.0.smithi112.stdout:0/476: write d8/d11/f15 [4499208,29637] 0 2024-09-21T00:56:54.538 INFO:tasks.workunit.client.0.smithi112.stdout:5/427: creat d8/f8c x:0 0 0 2024-09-21T00:56:54.538 INFO:tasks.workunit.client.0.smithi112.stdout:9/577: truncate d5/d3b/d5f/d13/d56/f61 2826657 0 2024-09-21T00:56:54.538 INFO:tasks.workunit.client.0.smithi112.stdout:5/428: readlink d8/d9/l3e 0 2024-09-21T00:56:54.602 INFO:tasks.workunit.client.0.smithi112.stdout:3/817: unlink d2/d8/d28/c2b 0 2024-09-21T00:56:54.602 INFO:tasks.workunit.client.0.smithi112.stdout:0/477: creat d8/d1b/d2c/d2e/d4c/d64/f92 x:0 0 0 2024-09-21T00:56:54.602 INFO:tasks.workunit.client.0.smithi112.stdout:9/578: truncate d5/f4b 1053773 0 2024-09-21T00:56:54.603 INFO:tasks.workunit.client.0.smithi112.stdout:5/429: symlink d8/d9/d13/d2a/d2c/d49/l8d 0 2024-09-21T00:56:54.604 INFO:tasks.workunit.client.0.smithi112.stdout:9/579: write d5/f14 [13381053,48242] 0 2024-09-21T00:56:54.605 INFO:tasks.workunit.client.0.smithi112.stdout:5/430: fsync d8/d9/d13/d2a/d2c/d49/f6e 0 2024-09-21T00:56:54.606 INFO:tasks.workunit.client.0.smithi112.stdout:5/431: fdatasync d8/d9/d13/d1c/d45/f5a 0 2024-09-21T00:56:54.609 INFO:tasks.workunit.client.0.smithi112.stdout:7/582: truncate d0/f3b 3587658 0 2024-09-21T00:56:54.624 INFO:tasks.workunit.client.0.smithi112.stdout:3/818: creat d2/d8/dd/de/d6b/f117 x:0 0 0 2024-09-21T00:56:54.630 INFO:tasks.workunit.client.0.smithi112.stdout:9/580: symlink d5/d3b/d79/d91/lbc 0 2024-09-21T00:56:54.632 INFO:tasks.workunit.client.0.smithi112.stdout:3/819: creat d2/d8/dd/de/d6b/f118 x:0 0 0 2024-09-21T00:56:54.633 INFO:tasks.workunit.client.0.smithi112.stdout:7/583: dwrite d0/d2/d36/d39/d1a/f44 [0,4194304] 0 2024-09-21T00:56:54.639 INFO:tasks.workunit.client.0.smithi112.stdout:7/584: mkdir d0/d2/d36/d39/d1a/d23/dc3 0 2024-09-21T00:56:54.641 INFO:tasks.workunit.client.0.smithi112.stdout:3/820: mknod d2/d3e/d103/c119 0 2024-09-21T00:56:54.641 INFO:tasks.workunit.client.0.smithi112.stdout:5/432: dread d8/f5f [0,4194304] 0 2024-09-21T00:56:54.642 INFO:tasks.workunit.client.0.smithi112.stdout:7/585: truncate d0/fa 538670 0 2024-09-21T00:56:54.646 INFO:tasks.workunit.client.0.smithi112.stdout:5/433: rename d8/d9/l4c to d8/d9/d13/d2a/d84/l8e 0 2024-09-21T00:56:54.647 INFO:tasks.workunit.client.0.smithi112.stdout:3/821: dwrite d2/d3e/f71 [0,4194304] 0 2024-09-21T00:56:54.647 INFO:tasks.workunit.client.0.smithi112.stdout:7/586: chown d0/d2/d36/d39/d1a/d23/c80 110681299 1 2024-09-21T00:56:54.649 INFO:tasks.workunit.client.0.smithi112.stdout:7/587: write d0/d2/d38/d48/f91 [1188862,10054] 0 2024-09-21T00:56:54.649 INFO:tasks.workunit.client.0.smithi112.stdout:5/434: dread - d8/d9/d13/f39 zero size 2024-09-21T00:56:54.651 INFO:tasks.workunit.client.0.smithi112.stdout:7/588: read d0/d2/d36/d39/d56/d65/d75/f84 [207864,117978] 0 2024-09-21T00:56:54.651 INFO:tasks.workunit.client.0.smithi112.stdout:5/435: fdatasync d8/d9/d13/d2a/d84/d8b/f50 0 2024-09-21T00:56:54.653 INFO:tasks.workunit.client.0.smithi112.stdout:3/822: read d2/d8/dd/de/f18 [641201,81932] 0 2024-09-21T00:56:54.659 INFO:tasks.workunit.client.0.smithi112.stdout:7/589: dwrite d0/d2/d36/f49 [0,4194304] 0 2024-09-21T00:56:54.667 INFO:tasks.workunit.client.0.smithi112.stdout:5/436: getdents d8/d9/d13/d1c/d45 0 2024-09-21T00:56:54.667 INFO:tasks.workunit.client.0.smithi112.stdout:7/590: dread d0/d2/d38/d48/dad/fa3 [0,4194304] 0 2024-09-21T00:56:54.669 INFO:tasks.workunit.client.0.smithi112.stdout:7/591: readlink d0/d2/lf 0 2024-09-21T00:56:54.671 INFO:tasks.workunit.client.0.smithi112.stdout:9/581: write d5/d6/f30 [164239,124859] 0 2024-09-21T00:56:54.671 INFO:tasks.workunit.client.0.smithi112.stdout:0/478: dwrite d8/f3c [0,4194304] 0 2024-09-21T00:56:54.673 INFO:tasks.workunit.client.0.smithi112.stdout:9/582: write d5/d3b/d5f/d13/fa1 [5025332,126014] 0 2024-09-21T00:56:54.674 INFO:tasks.workunit.client.0.smithi112.stdout:9/583: chown d5/d6/d70/fab 218402729 1 2024-09-21T00:56:54.679 INFO:tasks.workunit.client.0.smithi112.stdout:3/823: dread d2/d8/d28/d35/d9e/dfa/f10f [0,4194304] 0 2024-09-21T00:56:54.681 INFO:tasks.workunit.client.0.smithi112.stdout:5/437: symlink d8/d9/d13/d2a/df/l8f 0 2024-09-21T00:56:54.685 INFO:tasks.workunit.client.0.smithi112.stdout:9/584: mkdir d5/d3b/d5f/d13/d56/dbd 0 2024-09-21T00:56:54.687 INFO:tasks.workunit.client.0.smithi112.stdout:5/438: dwrite d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:56:54.688 INFO:tasks.workunit.client.0.smithi112.stdout:3/824: mkdir d2/d38/d11a 0 2024-09-21T00:56:54.688 INFO:tasks.workunit.client.0.smithi112.stdout:0/479: creat d8/d75/d91/f93 x:0 0 0 2024-09-21T00:56:54.691 INFO:tasks.workunit.client.0.smithi112.stdout:3/825: dread - d2/d8/dd/de/fda zero size 2024-09-21T00:56:54.691 INFO:tasks.workunit.client.0.smithi112.stdout:7/592: unlink d0/d2/d36/d39/d1a/da5/lae 0 2024-09-21T00:56:54.693 INFO:tasks.workunit.client.0.smithi112.stdout:3/826: write d2/f58 [5248760,13785] 0 2024-09-21T00:56:54.694 INFO:tasks.workunit.client.0.smithi112.stdout:3/827: write d2/d8/d6d/fa2 [2299884,15636] 0 2024-09-21T00:56:54.695 INFO:tasks.workunit.client.0.smithi112.stdout:7/593: write d0/d2/d36/d39/d1a/fa2 [625654,48418] 0 2024-09-21T00:56:54.695 INFO:tasks.workunit.client.0.smithi112.stdout:0/480: rename d8/d1b/d2c/d2e/d4c/f83 to d8/d1b/d2c/d2e/f94 0 2024-09-21T00:56:54.697 INFO:tasks.workunit.client.0.smithi112.stdout:0/481: write d8/d11/f81 [840436,16] 0 2024-09-21T00:56:54.699 INFO:tasks.workunit.client.0.smithi112.stdout:0/482: read - d8/d75/d91/f93 zero size 2024-09-21T00:56:54.699 INFO:tasks.workunit.client.0.smithi112.stdout:5/439: mknod d8/d9/d13/d1c/d45/d8a/c90 0 2024-09-21T00:56:54.700 INFO:tasks.workunit.client.0.smithi112.stdout:5/440: dread - d8/d9/f5d zero size 2024-09-21T00:56:54.702 INFO:tasks.workunit.client.0.smithi112.stdout:5/441: chown d8/d9/d13/d2a/d2c/f2f 17796528 1 2024-09-21T00:56:54.702 INFO:tasks.workunit.client.0.smithi112.stdout:3/828: mkdir d2/d33/d8c/db7/d11b 0 2024-09-21T00:56:54.705 INFO:tasks.workunit.client.0.smithi112.stdout:7/594: symlink d0/d2/lc4 0 2024-09-21T00:56:54.711 INFO:tasks.workunit.client.0.smithi112.stdout:7/595: truncate d0/d2/d32/f5b 4168661 0 2024-09-21T00:56:54.714 INFO:tasks.workunit.client.0.smithi112.stdout:3/829: rename d2/d8/d28/d35/d9e/dfa to d2/d38/d3f/d53/d96/dc9/d11c 0 2024-09-21T00:56:54.716 INFO:tasks.workunit.client.0.smithi112.stdout:7/596: read - d0/d2/d36/d39/d56/f77 zero size 2024-09-21T00:56:54.719 INFO:tasks.workunit.client.0.smithi112.stdout:9/585: write d5/d6/f76 [1139852,6573] 0 2024-09-21T00:56:54.721 INFO:tasks.workunit.client.0.smithi112.stdout:3/830: unlink d2/d38/l5a 0 2024-09-21T00:56:54.724 INFO:tasks.workunit.client.0.smithi112.stdout:7/597: dwrite d0/d2/d2e/f58 [0,4194304] 0 2024-09-21T00:56:54.728 INFO:tasks.workunit.client.0.smithi112.stdout:9/586: dwrite d5/d6/d19/f33 [0,4194304] 0 2024-09-21T00:56:54.737 INFO:tasks.workunit.client.0.smithi112.stdout:5/442: dwrite d8/f30 [0,4194304] 0 2024-09-21T00:56:54.737 INFO:tasks.workunit.client.0.smithi112.stdout:0/483: dwrite d8/d11/d28/d54/f57 [0,4194304] 0 2024-09-21T00:56:54.740 INFO:tasks.workunit.client.0.smithi112.stdout:3/831: creat d2/d8/dd/de/d4a/d4c/f11d x:0 0 0 2024-09-21T00:56:54.741 INFO:tasks.workunit.client.0.smithi112.stdout:3/832: chown d2/d8/f5b 6 1 2024-09-21T00:56:54.742 INFO:tasks.workunit.client.0.smithi112.stdout:7/598: creat d0/d2/d38/d48/fc5 x:0 0 0 2024-09-21T00:56:54.744 INFO:tasks.workunit.client.0.smithi112.stdout:5/443: creat d8/d9/d13/d1c/f91 x:0 0 0 2024-09-21T00:56:54.745 INFO:tasks.workunit.client.0.smithi112.stdout:0/484: creat d8/d1b/d2c/d2e/d4c/d64/f95 x:0 0 0 2024-09-21T00:56:54.746 INFO:tasks.workunit.client.0.smithi112.stdout:3/833: readlink d2/l7 0 2024-09-21T00:56:54.747 INFO:tasks.workunit.client.0.smithi112.stdout:7/599: symlink d0/d2/d36/d39/d56/d65/d87/lc6 0 2024-09-21T00:56:54.749 INFO:tasks.workunit.client.0.smithi112.stdout:3/834: dread - d2/d38/d3f/d53/fd3 zero size 2024-09-21T00:56:54.750 INFO:tasks.workunit.client.0.smithi112.stdout:5/444: mknod d8/c92 0 2024-09-21T00:56:54.753 INFO:tasks.workunit.client.0.smithi112.stdout:0/485: mkdir d8/d1b/d2c/d2e/d4c/d64/d96 0 2024-09-21T00:56:54.753 INFO:tasks.workunit.client.0.smithi112.stdout:9/587: dread d5/d6/f6c [0,4194304] 0 2024-09-21T00:56:54.765 INFO:tasks.workunit.client.0.smithi112.stdout:7/600: getdents d0/d2/d32 0 2024-09-21T00:56:54.767 INFO:tasks.workunit.client.0.smithi112.stdout:9/588: dwrite d5/d3b/d5f/d13/f45 [0,4194304] 0 2024-09-21T00:56:54.768 INFO:tasks.workunit.client.0.smithi112.stdout:7/601: write d0/d2/d2e/f5f [2037508,115094] 0 2024-09-21T00:56:54.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/602: rename d0/d2/d36/d39/d1a/d23/c4f to d0/d2/d36/d39/d1a/d23/cc7 0 2024-09-21T00:56:54.778 INFO:tasks.workunit.client.0.smithi112.stdout:9/589: dwrite d5/d6/f30 [0,4194304] 0 2024-09-21T00:56:54.780 INFO:tasks.workunit.client.0.smithi112.stdout:0/486: dread d8/fb [0,4194304] 0 2024-09-21T00:56:54.784 INFO:tasks.workunit.client.0.smithi112.stdout:7/603: creat d0/d2/d36/d39/d56/d65/d87/fc8 x:0 0 0 2024-09-21T00:56:54.785 INFO:tasks.workunit.client.0.smithi112.stdout:3/835: dread d2/d38/d3f/f49 [0,4194304] 0 2024-09-21T00:56:54.786 INFO:tasks.workunit.client.0.smithi112.stdout:0/487: creat d8/d1b/d2c/d2e/d4c/d64/d96/f97 x:0 0 0 2024-09-21T00:56:54.787 INFO:tasks.workunit.client.0.smithi112.stdout:7/604: fsync d0/d2/d36/d39/d1a/f6b 0 2024-09-21T00:56:54.789 INFO:tasks.workunit.client.0.smithi112.stdout:9/590: dwrite d5/fb [0,4194304] 0 2024-09-21T00:56:54.791 INFO:tasks.workunit.client.0.smithi112.stdout:0/488: unlink l5 0 2024-09-21T00:56:54.792 INFO:tasks.workunit.client.0.smithi112.stdout:7/605: mkdir d0/d2/d36/d39/d56/dc9 0 2024-09-21T00:56:54.795 INFO:tasks.workunit.client.0.smithi112.stdout:9/591: creat d5/d3b/d5f/fbe x:0 0 0 2024-09-21T00:56:54.798 INFO:tasks.workunit.client.0.smithi112.stdout:0/489: creat d8/d11/d28/d54/f98 x:0 0 0 2024-09-21T00:56:54.798 INFO:tasks.workunit.client.0.smithi112.stdout:7/606: symlink d0/d2/d36/d39/d56/d65/d75/d9a/lca 0 2024-09-21T00:56:54.799 INFO:tasks.workunit.client.0.smithi112.stdout:9/592: mknod d5/d3b/d5f/d13/d54/d7d/d57/d6a/cbf 0 2024-09-21T00:56:54.800 INFO:tasks.workunit.client.0.smithi112.stdout:0/490: mknod d8/d75/d91/c99 0 2024-09-21T00:56:54.801 INFO:tasks.workunit.client.0.smithi112.stdout:7/607: creat d0/d2/d36/fcb x:0 0 0 2024-09-21T00:56:54.802 INFO:tasks.workunit.client.0.smithi112.stdout:0/491: mknod d8/d75/d91/c9a 0 2024-09-21T00:56:54.805 INFO:tasks.workunit.client.0.smithi112.stdout:7/608: mknod d0/d2/d36/d39/d1a/da5/ccc 0 2024-09-21T00:56:54.806 INFO:tasks.workunit.client.0.smithi112.stdout:7/609: read - d0/d2/d38/d48/dad/f9b zero size 2024-09-21T00:56:54.813 INFO:tasks.workunit.client.0.smithi112.stdout:7/610: getdents d0/d2/d36/d39/d56/d65/d75 0 2024-09-21T00:56:54.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/593: truncate d5/d6/f6c 1086253 0 2024-09-21T00:56:54.824 INFO:tasks.workunit.client.0.smithi112.stdout:9/594: getdents d5/d6/d19/d51/d8f 0 2024-09-21T00:56:54.825 INFO:tasks.workunit.client.0.smithi112.stdout:7/611: dread d0/d2/d36/d39/f35 [0,4194304] 0 2024-09-21T00:56:54.826 INFO:tasks.workunit.client.0.smithi112.stdout:9/595: dread - d5/d6/d19/f7b zero size 2024-09-21T00:56:54.827 INFO:tasks.workunit.client.0.smithi112.stdout:7/612: creat d0/d6e/fcd x:0 0 0 2024-09-21T00:56:54.828 INFO:tasks.workunit.client.0.smithi112.stdout:9/596: unlink d5/d6/d19/d51/f66 0 2024-09-21T00:56:54.829 INFO:tasks.workunit.client.0.smithi112.stdout:7/613: creat d0/d2/d2e/fce x:0 0 0 2024-09-21T00:56:54.835 INFO:tasks.workunit.client.0.smithi112.stdout:7/614: dwrite d0/f22 [0,4194304] 0 2024-09-21T00:56:54.836 INFO:tasks.workunit.client.0.smithi112.stdout:7/615: write d0/d2/d36/d39/d55/f9d [818037,49880] 0 2024-09-21T00:56:54.841 INFO:tasks.workunit.client.0.smithi112.stdout:7/616: rename d0/d2/d36/d39/d1a/d23 to d0/d2/d2e/dcf 0 2024-09-21T00:56:54.841 INFO:tasks.workunit.client.0.smithi112.stdout:9/597: write d5/d3b/d5f/d13/d54/d7d/f21 [1337906,127988] 0 2024-09-21T00:56:54.844 INFO:tasks.workunit.client.0.smithi112.stdout:7/617: unlink d0/d2/d2e/fce 0 2024-09-21T00:56:54.845 INFO:tasks.workunit.client.0.smithi112.stdout:9/598: creat d5/d6/d3f/fc0 x:0 0 0 2024-09-21T00:56:54.848 INFO:tasks.workunit.client.0.smithi112.stdout:9/599: mkdir d5/d3b/d5f/d13/d54/dc1 0 2024-09-21T00:56:54.849 INFO:tasks.workunit.client.0.smithi112.stdout:9/600: dread - d5/d3b/d5f/d13/d56/f95 zero size 2024-09-21T00:56:54.853 INFO:tasks.workunit.client.0.smithi112.stdout:9/601: dread d5/d3b/d5f/d13/fa1 [0,4194304] 0 2024-09-21T00:56:54.921 INFO:tasks.workunit.client.0.smithi112.stdout:9/602: write d5/d6/d3f/d7f/f8a [398465,1307] 0 2024-09-21T00:56:54.924 INFO:tasks.workunit.client.0.smithi112.stdout:9/603: creat d5/d3b/d5f/d13/fc2 x:0 0 0 2024-09-21T00:56:54.924 INFO:tasks.workunit.client.0.smithi112.stdout:9/604: dread - d5/d3b/d5f/d13/d56/f95 zero size 2024-09-21T00:56:54.939 INFO:tasks.workunit.client.0.smithi112.stdout:9/605: dread d5/f49 [0,4194304] 0 2024-09-21T00:56:54.942 INFO:tasks.workunit.client.0.smithi112.stdout:9/606: mknod d5/d3b/d5f/d13/d54/d7d/d57/d6a/cc3 0 2024-09-21T00:56:54.949 INFO:tasks.workunit.client.0.smithi112.stdout:9/607: dwrite d5/d6/d70/f9f [0,4194304] 0 2024-09-21T00:56:54.953 INFO:tasks.workunit.client.0.smithi112.stdout:9/608: read d5/d3b/d5f/d13/d54/d7d/f40 [2574424,64522] 0 2024-09-21T00:56:54.958 INFO:tasks.workunit.client.0.smithi112.stdout:9/609: write d5/d3b/d5f/d13/d54/d7d/d57/d6a/f93 [2798,2738] 0 2024-09-21T00:56:54.959 INFO:tasks.workunit.client.0.smithi112.stdout:9/610: stat d5/d6/d19/f28 0 2024-09-21T00:56:55.001 INFO:tasks.workunit.client.0.smithi112.stdout:9/611: write d5/d3b/d5f/d13/d54/d7d/f2b [594757,91651] 0 2024-09-21T00:56:55.002 INFO:tasks.workunit.client.0.smithi112.stdout:9/612: chown d5/d3b/d5f/d13/d54/dbb 19896 1 2024-09-21T00:56:55.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:54 smithi187 ceph-mon[34997]: pgmap v30: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 76 MiB/s rd, 210 MiB/s wr, 411 op/s 2024-09-21T00:56:55.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:54 smithi112 ceph-mon[28078]: pgmap v30: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 76 MiB/s rd, 210 MiB/s wr, 411 op/s 2024-09-21T00:56:55.547 INFO:tasks.workunit.client.0.smithi112.stdout:2/565: sync 2024-09-21T00:56:55.550 INFO:tasks.workunit.client.0.smithi112.stdout:2/566: rename d0/d14/d8/d27/f3a to d0/d14/d8/d27/fb8 0 2024-09-21T00:56:55.556 INFO:tasks.workunit.client.0.smithi112.stdout:2/567: dwrite d0/d45/d8a/f56 [4194304,4194304] 0 2024-09-21T00:56:55.572 INFO:tasks.workunit.client.0.smithi112.stdout:2/568: write d0/d14/d8/f44 [581188,54459] 0 2024-09-21T00:56:55.573 INFO:tasks.workunit.client.0.smithi112.stdout:2/569: mkdir d0/d45/db9 0 2024-09-21T00:56:55.577 INFO:tasks.workunit.client.0.smithi112.stdout:2/570: mkdir d0/d14/d8/da2/dba 0 2024-09-21T00:56:55.586 INFO:tasks.workunit.client.0.smithi112.stdout:2/571: dwrite d0/df/f13 [0,4194304] 0 2024-09-21T00:56:55.589 INFO:tasks.workunit.client.0.smithi112.stdout:2/572: fsync d0/d60/fab 0 2024-09-21T00:56:55.598 INFO:tasks.workunit.client.0.smithi112.stdout:2/573: getdents d0/df/d46/d97 0 2024-09-21T00:56:55.604 INFO:tasks.workunit.client.0.smithi112.stdout:2/574: creat d0/d45/d8a/d83/fbb x:0 0 0 2024-09-21T00:56:55.617 INFO:tasks.workunit.client.0.smithi112.stdout:4/607: sync 2024-09-21T00:56:55.617 INFO:tasks.workunit.client.0.smithi112.stdout:6/529: sync 2024-09-21T00:56:55.617 INFO:tasks.workunit.client.0.smithi112.stdout:9/613: sync 2024-09-21T00:56:55.618 INFO:tasks.workunit.client.0.smithi112.stdout:8/658: sync 2024-09-21T00:56:55.618 INFO:tasks.workunit.client.0.smithi112.stdout:1/397: sync 2024-09-21T00:56:55.618 INFO:tasks.workunit.client.0.smithi112.stdout:3/836: sync 2024-09-21T00:56:55.618 INFO:tasks.workunit.client.0.smithi112.stdout:5/445: sync 2024-09-21T00:56:55.618 INFO:tasks.workunit.client.0.smithi112.stdout:0/492: sync 2024-09-21T00:56:55.618 INFO:tasks.workunit.client.0.smithi112.stdout:7/618: sync 2024-09-21T00:56:55.624 INFO:tasks.workunit.client.0.smithi112.stdout:2/575: unlink d0/d14/d22/ca8 0 2024-09-21T00:56:55.627 INFO:tasks.workunit.client.0.smithi112.stdout:2/576: symlink d0/d45/d8a/d99/lbc 0 2024-09-21T00:56:55.627 INFO:tasks.workunit.client.0.smithi112.stdout:5/446: readlink d8/d9/d13/l3a 0 2024-09-21T00:56:55.628 INFO:tasks.workunit.client.0.smithi112.stdout:0/493: read d8/d1b/f67 [358772,57186] 0 2024-09-21T00:56:55.629 INFO:tasks.workunit.client.0.smithi112.stdout:1/398: fsync d5/d8/d13/d3e/d46/f57 0 2024-09-21T00:56:55.631 INFO:tasks.workunit.client.0.smithi112.stdout:3/837: rmdir d2/d38/d3f/d53/d96/dcf 39 2024-09-21T00:56:55.632 INFO:tasks.workunit.client.0.smithi112.stdout:7/619: truncate d0/d2/d36/d39/d55/f9d 1095080 0 2024-09-21T00:56:55.632 INFO:tasks.workunit.client.0.smithi112.stdout:5/447: chown d8/d9/d13/d2a/d2c/l47 695 1 2024-09-21T00:56:55.633 INFO:tasks.workunit.client.0.smithi112.stdout:9/614: dread d5/d3b/d5f/d13/d54/f90 [0,4194304] 0 2024-09-21T00:56:55.633 INFO:tasks.workunit.client.0.smithi112.stdout:7/620: dread - d0/f67 zero size 2024-09-21T00:56:55.634 INFO:tasks.workunit.client.0.smithi112.stdout:4/608: dread d1/d7/f28 [0,4194304] 0 2024-09-21T00:56:55.634 INFO:tasks.workunit.client.0.smithi112.stdout:8/659: creat d0/d13/d1b/d22/d42/d51/fcd x:0 0 0 2024-09-21T00:56:55.636 INFO:tasks.workunit.client.0.smithi112.stdout:0/494: mkdir d8/d75/d91/d9b 0 2024-09-21T00:56:55.637 INFO:tasks.workunit.client.0.smithi112.stdout:3/838: dread d2/d8/dd/f27 [0,4194304] 0 2024-09-21T00:56:55.639 INFO:tasks.workunit.client.0.smithi112.stdout:0/495: dread - d8/d1b/d2c/d2e/d4c/d6b/f77 zero size 2024-09-21T00:56:55.639 INFO:tasks.workunit.client.0.smithi112.stdout:6/530: rename d9/d13/d21/d84/d8f to d9/d13/d60/da4/db0/dc4 0 2024-09-21T00:56:55.645 INFO:tasks.workunit.client.0.smithi112.stdout:3/839: dwrite d2/d38/d3f/fa9 [0,4194304] 0 2024-09-21T00:56:55.646 INFO:tasks.workunit.client.0.smithi112.stdout:0/496: dread d8/f3c [0,4194304] 0 2024-09-21T00:56:55.653 INFO:tasks.workunit.client.0.smithi112.stdout:8/660: stat d0/d13/d2a/f5f 0 2024-09-21T00:56:55.654 INFO:tasks.workunit.client.0.smithi112.stdout:7/621: write d0/d2/d36/d39/d56/d65/d75/f8e [2716736,124433] 0 2024-09-21T00:56:55.657 INFO:tasks.workunit.client.0.smithi112.stdout:0/497: dwrite d8/d1b/f74 [0,4194304] 0 2024-09-21T00:56:55.657 INFO:tasks.workunit.client.0.smithi112.stdout:0/498: stat d8/d75/d91/c99 0 2024-09-21T00:56:55.659 INFO:tasks.workunit.client.0.smithi112.stdout:0/499: write d8/d1b/f7e [622491,74609] 0 2024-09-21T00:56:55.660 INFO:tasks.workunit.client.0.smithi112.stdout:9/615: rename d5/d6/f30 to d5/d3b/d5f/d13/fc4 0 2024-09-21T00:56:55.666 INFO:tasks.workunit.client.0.smithi112.stdout:6/531: dread d9/d13/d31/d41/f95 [0,4194304] 0 2024-09-21T00:56:55.666 INFO:tasks.workunit.client.0.smithi112.stdout:8/661: dwrite d0/f62 [0,4194304] 0 2024-09-21T00:56:55.675 INFO:tasks.workunit.client.0.smithi112.stdout:7/622: rmdir d0/d2/d36/d39/d56/d65 39 2024-09-21T00:56:55.676 INFO:tasks.workunit.client.0.smithi112.stdout:0/500: mkdir d8/d75/d9c 0 2024-09-21T00:56:55.678 INFO:tasks.workunit.client.0.smithi112.stdout:5/448: rename d8/d9/d13/d2a/d84/d8b/f41 to d8/d9/d13/d2a/f93 0 2024-09-21T00:56:55.688 INFO:tasks.workunit.client.0.smithi112.stdout:2/577: write d0/d14/d22/d6d/fb5 [1046114,51490] 0 2024-09-21T00:56:55.689 INFO:tasks.workunit.client.0.smithi112.stdout:6/532: rename d9/d1f/d47/d34/da6/f49 to d9/d1f/d47/d74/fc5 0 2024-09-21T00:56:55.690 INFO:tasks.workunit.client.0.smithi112.stdout:9/616: dread d5/d3b/d5f/f58 [0,4194304] 0 2024-09-21T00:56:55.691 INFO:tasks.workunit.client.0.smithi112.stdout:6/533: fsync d9/d1f/d3e/d77/f1d 0 2024-09-21T00:56:55.692 INFO:tasks.workunit.client.0.smithi112.stdout:5/449: read d8/d9/d13/d1c/f3c [1964505,19087] 0 2024-09-21T00:56:55.692 INFO:tasks.workunit.client.0.smithi112.stdout:9/617: read - d5/d6/d3f/fc0 zero size 2024-09-21T00:56:55.696 INFO:tasks.workunit.client.0.smithi112.stdout:3/840: link d2/d38/d3f/f43 d2/d33/d8c/db7/f11e 0 2024-09-21T00:56:55.698 INFO:tasks.workunit.client.0.smithi112.stdout:1/399: dwrite d5/d8/d10/f1d [0,4194304] 0 2024-09-21T00:56:55.699 INFO:tasks.workunit.client.0.smithi112.stdout:3/841: dread - d2/d8/dd/de/fda zero size 2024-09-21T00:56:55.700 INFO:tasks.workunit.client.0.smithi112.stdout:1/400: chown d5/d8/dd/c28 244001 1 2024-09-21T00:56:55.703 INFO:tasks.workunit.client.0.smithi112.stdout:3/842: read d2/d8/dd/de/d4a/fbd [2767592,125744] 0 2024-09-21T00:56:55.703 INFO:tasks.workunit.client.0.smithi112.stdout:6/534: dread d9/d1f/f81 [0,4194304] 0 2024-09-21T00:56:55.705 INFO:tasks.workunit.client.0.smithi112.stdout:3/843: write d2/d8/dd/f101 [3301318,39030] 0 2024-09-21T00:56:55.705 INFO:tasks.workunit.client.0.smithi112.stdout:8/662: creat d0/d13/d2a/fce x:0 0 0 2024-09-21T00:56:55.707 INFO:tasks.workunit.client.0.smithi112.stdout:4/609: link d1/d5/l11 d1/d2d/ld1 0 2024-09-21T00:56:55.707 INFO:tasks.workunit.client.0.smithi112.stdout:9/618: fsync d5/f49 0 2024-09-21T00:56:55.707 INFO:tasks.workunit.client.0.smithi112.stdout:2/578: dread d0/d60/d78/f7f [0,4194304] 0 2024-09-21T00:56:55.712 INFO:tasks.workunit.client.0.smithi112.stdout:5/450: dread d8/d9/d13/d1c/f53 [0,4194304] 0 2024-09-21T00:56:55.715 INFO:tasks.workunit.client.0.smithi112.stdout:4/610: dwrite d1/d5/d1c/d1e/d4a/d5f/f71 [0,4194304] 0 2024-09-21T00:56:55.715 INFO:tasks.workunit.client.0.smithi112.stdout:7/623: rmdir d0/d2/d36/d39/d56/d86/dc2 0 2024-09-21T00:56:55.722 INFO:tasks.workunit.client.0.smithi112.stdout:1/401: fdatasync d5/d8/dd/d54/d5a/f7b 0 2024-09-21T00:56:55.724 INFO:tasks.workunit.client.0.smithi112.stdout:5/451: dwrite d8/d9/d13/d2a/d2c/d49/f6e [0,4194304] 0 2024-09-21T00:56:55.725 INFO:tasks.workunit.client.0.smithi112.stdout:6/535: creat d9/d13/d60/fc6 x:0 0 0 2024-09-21T00:56:55.727 INFO:tasks.workunit.client.0.smithi112.stdout:0/501: dwrite d8/d11/d28/d54/f55 [0,4194304] 0 2024-09-21T00:56:55.729 INFO:tasks.workunit.client.0.smithi112.stdout:3/844: write d2/d33/ffe [2534931,72387] 0 2024-09-21T00:56:55.732 INFO:tasks.workunit.client.0.smithi112.stdout:4/611: creat d1/d7/d30/fd2 x:0 0 0 2024-09-21T00:56:55.736 INFO:tasks.workunit.client.0.smithi112.stdout:7/624: symlink d0/d2/d32/da4/db2/db4/dba/ld0 0 2024-09-21T00:56:55.739 INFO:tasks.workunit.client.0.smithi112.stdout:5/452: unlink d8/d9/d13/d2a/d2c/c36 0 2024-09-21T00:56:55.741 INFO:tasks.workunit.client.0.smithi112.stdout:9/619: dread d5/d3b/fa3 [0,4194304] 0 2024-09-21T00:56:55.744 INFO:tasks.workunit.client.0.smithi112.stdout:6/536: symlink d9/d1f/d3e/d6f/lc7 0 2024-09-21T00:56:55.745 INFO:tasks.workunit.client.0.smithi112.stdout:0/502: mkdir d8/d62/d9d 0 2024-09-21T00:56:55.747 INFO:tasks.workunit.client.0.smithi112.stdout:2/579: dwrite d0/d14/f35 [4194304,4194304] 0 2024-09-21T00:56:55.747 INFO:tasks.workunit.client.0.smithi112.stdout:5/453: stat d8/d9/d13/d2a/d2c/l7c 0 2024-09-21T00:56:55.749 INFO:tasks.workunit.client.0.smithi112.stdout:6/537: fsync d9/d1f/f35 0 2024-09-21T00:56:55.749 INFO:tasks.workunit.client.0.smithi112.stdout:9/620: chown d5/d3b/d5f/d13/fae 26649 1 2024-09-21T00:56:55.750 INFO:tasks.workunit.client.0.smithi112.stdout:1/402: dwrite d5/d34/f49 [0,4194304] 0 2024-09-21T00:56:55.752 INFO:tasks.workunit.client.0.smithi112.stdout:4/612: mkdir d1/d2d/d34/dd3 0 2024-09-21T00:56:55.754 INFO:tasks.workunit.client.0.smithi112.stdout:2/580: chown d0/d14/d8/d27/c94 515308 1 2024-09-21T00:56:55.755 INFO:tasks.workunit.client.0.smithi112.stdout:8/663: dwrite d0/f1d [4194304,4194304] 0 2024-09-21T00:56:55.763 INFO:tasks.workunit.client.0.smithi112.stdout:5/454: creat d8/d9/d13/d2a/df/f94 x:0 0 0 2024-09-21T00:56:55.764 INFO:tasks.workunit.client.0.smithi112.stdout:5/455: chown d8/d9/d13/d2a/d2c/d49/f65 52650 1 2024-09-21T00:56:55.765 INFO:tasks.workunit.client.0.smithi112.stdout:3/845: creat d2/f11f x:0 0 0 2024-09-21T00:56:55.770 INFO:tasks.workunit.client.0.smithi112.stdout:9/621: creat d5/d3b/d5f/d13/d54/d55/fc5 x:0 0 0 2024-09-21T00:56:55.771 INFO:tasks.workunit.client.0.smithi112.stdout:6/538: symlink d9/d1f/d47/d74/d8b/lc8 0 2024-09-21T00:56:55.771 INFO:tasks.workunit.client.0.smithi112.stdout:0/503: creat d8/d75/d9c/f9e x:0 0 0 2024-09-21T00:56:55.775 INFO:tasks.workunit.client.0.smithi112.stdout:5/456: mknod d8/d9/d13/d2a/d2c/d49/c95 0 2024-09-21T00:56:55.775 INFO:tasks.workunit.client.0.smithi112.stdout:3/846: symlink d2/d38/l120 0 2024-09-21T00:56:55.777 INFO:tasks.workunit.client.0.smithi112.stdout:1/403: fdatasync d5/d8/f3d 0 2024-09-21T00:56:55.777 INFO:tasks.workunit.client.0.smithi112.stdout:6/539: chown d9/d1f/d3e/d77/f2a 1097361901 1 2024-09-21T00:56:55.777 INFO:tasks.workunit.client.0.smithi112.stdout:7/625: dwrite d0/fa [0,4194304] 0 2024-09-21T00:56:55.780 INFO:tasks.workunit.client.0.smithi112.stdout:0/504: write d8/d11/f2d [246953,105774] 0 2024-09-21T00:56:55.787 INFO:tasks.workunit.client.0.smithi112.stdout:2/581: link d0/d14/d22/c2c d0/df/d46/d58/cbd 0 2024-09-21T00:56:55.790 INFO:tasks.workunit.client.0.smithi112.stdout:4/613: write d1/d5/d1c/d1e/d4a/f7e [439428,116239] 0 2024-09-21T00:56:55.790 INFO:tasks.workunit.client.0.smithi112.stdout:2/582: readlink d0/d60/d78/lac 0 2024-09-21T00:56:55.790 INFO:tasks.workunit.client.0.smithi112.stdout:2/583: dread - d0/d60/fb7 zero size 2024-09-21T00:56:55.793 INFO:tasks.workunit.client.0.smithi112.stdout:4/614: chown d1/d7/d9/d1a/d22/f72 73002628 1 2024-09-21T00:56:55.793 INFO:tasks.workunit.client.0.smithi112.stdout:2/584: chown d0/d14/d22/c5c 5 1 2024-09-21T00:56:55.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/457: mkdir d8/d9/d13/d2a/d2c/d96 0 2024-09-21T00:56:55.795 INFO:tasks.workunit.client.0.smithi112.stdout:8/664: rename d0/d13/d1b/d22/d42/l94 to d0/d13/d1b/d22/d2e/d34/lcf 0 2024-09-21T00:56:55.796 INFO:tasks.workunit.client.0.smithi112.stdout:2/585: readlink d0/d14/d47/l85 0 2024-09-21T00:56:55.797 INFO:tasks.workunit.client.0.smithi112.stdout:6/540: dwrite d9/d1f/d47/d34/f36 [0,4194304] 0 2024-09-21T00:56:55.799 INFO:tasks.workunit.client.0.smithi112.stdout:0/505: symlink d8/d75/l9f 0 2024-09-21T00:56:55.801 INFO:tasks.workunit.client.0.smithi112.stdout:3/847: write d2/d8/d28/d9d/fc0 [1955428,86947] 0 2024-09-21T00:56:55.804 INFO:tasks.workunit.client.0.smithi112.stdout:5/458: creat d8/d9/d13/d2a/df/f97 x:0 0 0 2024-09-21T00:56:55.807 INFO:tasks.workunit.client.0.smithi112.stdout:8/665: creat d0/d13/d1b/d22/d42/d51/fd0 x:0 0 0 2024-09-21T00:56:55.808 INFO:tasks.workunit.client.0.smithi112.stdout:6/541: mknod d9/d1f/d3e/d77/d79/cc9 0 2024-09-21T00:56:55.811 INFO:tasks.workunit.client.0.smithi112.stdout:2/586: unlink d0/df/d46/d58/f6e 0 2024-09-21T00:56:55.811 INFO:tasks.workunit.client.0.smithi112.stdout:6/542: write d9/df/d7a/f55 [3406843,117049] 0 2024-09-21T00:56:55.812 INFO:tasks.workunit.client.0.smithi112.stdout:7/626: unlink d0/d2/d36/d39/d1a/f66 0 2024-09-21T00:56:55.814 INFO:tasks.workunit.client.0.smithi112.stdout:9/622: link d5/d3b/d5f/d13/d54/f86 d5/d6/d19/fc6 0 2024-09-21T00:56:55.814 INFO:tasks.workunit.client.0.smithi112.stdout:1/404: getdents d5/d8/d13 0 2024-09-21T00:56:55.816 INFO:tasks.workunit.client.0.smithi112.stdout:4/615: rename d1/d7/d9/d1a/d8e/caa to d1/d5/d1c/d1e/d76/dba/cd4 0 2024-09-21T00:56:55.822 INFO:tasks.workunit.client.0.smithi112.stdout:8/666: mknod d0/d13/d1b/d22/d2e/d34/d7b/d80/cd1 0 2024-09-21T00:56:55.826 INFO:tasks.workunit.client.0.smithi112.stdout:6/543: write d9/d1f/d3e/d6f/fbf [1030668,100869] 0 2024-09-21T00:56:55.827 INFO:tasks.workunit.client.0.smithi112.stdout:3/848: symlink d2/d8/dd/de/l121 0 2024-09-21T00:56:55.828 INFO:tasks.workunit.client.0.smithi112.stdout:1/405: dwrite d5/d8/dd/f76 [0,4194304] 0 2024-09-21T00:56:55.829 INFO:tasks.workunit.client.0.smithi112.stdout:8/667: write d0/d13/d1b/f53 [449925,97023] 0 2024-09-21T00:56:55.829 INFO:tasks.workunit.client.0.smithi112.stdout:9/623: rename d5/d3b/d5f/d13/d54/d7d/d57/f6f to d5/d3b/d5f/d13/d54/d7d/d57/fc7 0 2024-09-21T00:56:55.831 INFO:tasks.workunit.client.0.smithi112.stdout:3/849: readlink d2/d8/dd/de/l121 0 2024-09-21T00:56:55.832 INFO:tasks.workunit.client.0.smithi112.stdout:5/459: dread d8/d9/d13/d2a/f18 [0,4194304] 0 2024-09-21T00:56:55.835 INFO:tasks.workunit.client.0.smithi112.stdout:8/668: chown d0/la 45783 1 2024-09-21T00:56:55.838 INFO:tasks.workunit.client.0.smithi112.stdout:2/587: dread d0/d45/d8a/f55 [4194304,4194304] 0 2024-09-21T00:56:55.840 INFO:tasks.workunit.client.0.smithi112.stdout:2/588: dread - d0/d45/d8a/d83/fbb zero size 2024-09-21T00:56:55.848 INFO:tasks.workunit.client.0.smithi112.stdout:5/460: dread - d8/d9/d13/d2a/d2c/d49/f63 zero size 2024-09-21T00:56:55.850 INFO:tasks.workunit.client.0.smithi112.stdout:8/669: rename d0/d13/d2a/f5f to d0/d13/d1b/d22/d2e/d34/d7b/d80/fd2 0 2024-09-21T00:56:55.851 INFO:tasks.workunit.client.0.smithi112.stdout:7/627: write d0/d2/f64 [523791,124040] 0 2024-09-21T00:56:55.852 INFO:tasks.workunit.client.0.smithi112.stdout:6/544: mkdir d9/df/dca 0 2024-09-21T00:56:55.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/624: truncate d5/f4b 556182 0 2024-09-21T00:56:55.855 INFO:tasks.workunit.client.0.smithi112.stdout:1/406: mknod d5/d34/d6a/d7f/c81 0 2024-09-21T00:56:55.855 INFO:tasks.workunit.client.0.smithi112.stdout:6/545: write d9/d1f/d47/d34/da6/da7/f75 [786503,82438] 0 2024-09-21T00:56:55.858 INFO:tasks.workunit.client.0.smithi112.stdout:5/461: unlink d8/d9/d13/l78 0 2024-09-21T00:56:55.864 INFO:tasks.workunit.client.0.smithi112.stdout:9/625: dwrite d5/d6/f9d [0,4194304] 0 2024-09-21T00:56:55.868 INFO:tasks.workunit.client.0.smithi112.stdout:8/670: symlink d0/d13/d9f/dc2/ld3 0 2024-09-21T00:56:55.871 INFO:tasks.workunit.client.0.smithi112.stdout:3/850: truncate d2/d8/fee 264764 0 2024-09-21T00:56:55.876 INFO:tasks.workunit.client.0.smithi112.stdout:1/407: symlink d5/d8/d10/d2e/l82 0 2024-09-21T00:56:55.879 INFO:tasks.workunit.client.0.smithi112.stdout:6/546: symlink d9/d1f/d47/d34/lcb 0 2024-09-21T00:56:55.883 INFO:tasks.workunit.client.0.smithi112.stdout:4/616: getdents d1/d75 0 2024-09-21T00:56:55.884 INFO:tasks.workunit.client.0.smithi112.stdout:8/671: creat d0/d13/d9f/fd4 x:0 0 0 2024-09-21T00:56:55.885 INFO:tasks.workunit.client.0.smithi112.stdout:3/851: unlink d2/d8/dd/de/ce3 0 2024-09-21T00:56:55.886 INFO:tasks.workunit.client.0.smithi112.stdout:3/852: dread - d2/f11f zero size 2024-09-21T00:56:55.889 INFO:tasks.workunit.client.0.smithi112.stdout:7/628: creat d0/d2/d36/d39/d56/d65/d87/fd1 x:0 0 0 2024-09-21T00:56:55.891 INFO:tasks.workunit.client.0.smithi112.stdout:7/629: stat d0/d2/d36/d39/d1a/c8c 0 2024-09-21T00:56:55.893 INFO:tasks.workunit.client.0.smithi112.stdout:5/462: link d8/d9/d13/f51 d8/d9/d13/d2a/df/d5b/f98 0 2024-09-21T00:56:55.895 INFO:tasks.workunit.client.0.smithi112.stdout:6/547: symlink d9/d1f/d47/d34/da6/lcc 0 2024-09-21T00:56:55.896 INFO:tasks.workunit.client.0.smithi112.stdout:1/408: dread d5/fc [0,4194304] 0 2024-09-21T00:56:55.898 INFO:tasks.workunit.client.0.smithi112.stdout:2/589: dwrite d0/d45/d8a/f6f [0,4194304] 0 2024-09-21T00:56:55.899 INFO:tasks.workunit.client.0.smithi112.stdout:1/409: chown d5/d8/d14/l22 74613 1 2024-09-21T00:56:55.900 INFO:tasks.workunit.client.0.smithi112.stdout:8/672: symlink d0/d13/d1b/ld5 0 2024-09-21T00:56:55.902 INFO:tasks.workunit.client.0.smithi112.stdout:7/630: dread d0/d2/d2e/f5f [0,4194304] 0 2024-09-21T00:56:55.904 INFO:tasks.workunit.client.0.smithi112.stdout:9/626: creat d5/d3b/fc8 x:0 0 0 2024-09-21T00:56:55.905 INFO:tasks.workunit.client.0.smithi112.stdout:9/627: fdatasync d5/d6/d19/f33 0 2024-09-21T00:56:55.908 INFO:tasks.workunit.client.0.smithi112.stdout:1/410: rmdir d5/d8/d10 39 2024-09-21T00:56:55.911 INFO:tasks.workunit.client.0.smithi112.stdout:3/853: rename d2/d38/d3f/cd8 to d2/d8/d6d/c122 0 2024-09-21T00:56:55.915 INFO:tasks.workunit.client.0.smithi112.stdout:2/590: dread d0/d14/f19 [0,4194304] 0 2024-09-21T00:56:55.915 INFO:tasks.workunit.client.0.smithi112.stdout:7/631: mknod d0/d2/d36/d39/d56/d65/cd2 0 2024-09-21T00:56:55.917 INFO:tasks.workunit.client.0.smithi112.stdout:7/632: write d0/d2/d38/d48/f91 [1391169,6271] 0 2024-09-21T00:56:55.918 INFO:tasks.workunit.client.0.smithi112.stdout:7/633: write d0/d2/d92/fb8 [379684,123082] 0 2024-09-21T00:56:55.921 INFO:tasks.workunit.client.0.smithi112.stdout:4/617: creat d1/d5/d1c/d1e/d3d/fd5 x:0 0 0 2024-09-21T00:56:55.921 INFO:tasks.workunit.client.0.smithi112.stdout:4/618: chown d1/d7/f28 15 1 2024-09-21T00:56:55.925 INFO:tasks.workunit.client.0.smithi112.stdout:4/619: dread d1/d5/d1c/d6c/fb8 [0,4194304] 0 2024-09-21T00:56:55.928 INFO:tasks.workunit.client.0.smithi112.stdout:5/463: rename d8/d9/d13/d2a/d2c/d49 to d8/d9/d13/d1c/d99 0 2024-09-21T00:56:55.928 INFO:tasks.workunit.client.0.smithi112.stdout:9/628: rename d5/d3b/d5f/d13/d54 to d5/d3b/d5f/d13/d54/dc1/dc9 22 2024-09-21T00:56:55.937 INFO:tasks.workunit.client.0.smithi112.stdout:1/411: rmdir d5/d8/d10 39 2024-09-21T00:56:55.942 INFO:tasks.workunit.client.0.smithi112.stdout:5/464: mknod d8/d9/d13/d2a/d84/c9a 0 2024-09-21T00:56:55.942 INFO:tasks.workunit.client.0.smithi112.stdout:9/629: dread d5/d3b/d5f/d13/d54/d7d/d57/d6a/f6b [0,4194304] 0 2024-09-21T00:56:55.943 INFO:tasks.workunit.client.0.smithi112.stdout:6/548: getdents d9/d13/d60 0 2024-09-21T00:56:55.946 INFO:tasks.workunit.client.0.smithi112.stdout:7/634: dread d0/f3b [0,4194304] 0 2024-09-21T00:56:55.952 INFO:tasks.workunit.client.0.smithi112.stdout:6/549: dwrite d9/df/f27 [0,4194304] 0 2024-09-21T00:56:55.958 INFO:tasks.workunit.client.0.smithi112.stdout:4/620: creat d1/d2d/fd6 x:0 0 0 2024-09-21T00:56:55.961 INFO:tasks.workunit.client.0.smithi112.stdout:1/412: creat d5/d8/f83 x:0 0 0 2024-09-21T00:56:55.965 INFO:tasks.workunit.client.0.smithi112.stdout:5/465: rename d8/d9/d13/d2a/df/f10 to d8/d9/f9b 0 2024-09-21T00:56:55.967 INFO:tasks.workunit.client.0.smithi112.stdout:6/550: mkdir d9/d1f/d47/d74/d8b/daa/dcd 0 2024-09-21T00:56:55.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/551: fsync d9/df/f2e 0 2024-09-21T00:56:55.970 INFO:tasks.workunit.client.0.smithi112.stdout:8/673: dwrite d0/d13/d1b/f4c [0,4194304] 0 2024-09-21T00:56:55.975 INFO:tasks.workunit.client.0.smithi112.stdout:7/635: dwrite d0/d2/d32/f88 [0,4194304] 0 2024-09-21T00:56:55.976 INFO:tasks.workunit.client.0.smithi112.stdout:6/552: chown d9/d13/d21/fa0 3784 1 2024-09-21T00:56:55.977 INFO:tasks.workunit.client.0.smithi112.stdout:1/413: creat d5/d8/d13/d3e/d46/d70/f84 x:0 0 0 2024-09-21T00:56:55.978 INFO:tasks.workunit.client.0.smithi112.stdout:7/636: fsync d0/d2/d36/fcb 0 2024-09-21T00:56:55.982 INFO:tasks.workunit.client.0.smithi112.stdout:7/637: chown d0/d2/d38/l8d 29719719 1 2024-09-21T00:56:55.985 INFO:tasks.workunit.client.0.smithi112.stdout:4/621: getdents d1/d5 0 2024-09-21T00:56:55.987 INFO:tasks.workunit.client.0.smithi112.stdout:8/674: read d0/d13/d1b/d22/d42/d51/f9e [117133,35460] 0 2024-09-21T00:56:55.989 INFO:tasks.workunit.client.0.smithi112.stdout:6/553: fdatasync d9/d13/f17 0 2024-09-21T00:56:55.991 INFO:tasks.workunit.client.0.smithi112.stdout:7/638: rmdir d0/d2/d36 39 2024-09-21T00:56:55.994 INFO:tasks.workunit.client.0.smithi112.stdout:3/854: dwrite d2/d8/f11 [4194304,4194304] 0 2024-09-21T00:56:55.995 INFO:tasks.workunit.client.0.smithi112.stdout:4/622: creat d1/d5/d1c/d1e/d4a/d5f/fd7 x:0 0 0 2024-09-21T00:56:55.997 INFO:tasks.workunit.client.0.smithi112.stdout:4/623: truncate d1/d7/f17 5787224 0 2024-09-21T00:56:55.999 INFO:tasks.workunit.client.0.smithi112.stdout:6/554: symlink d9/d1f/d47/d74/d8b/lce 0 2024-09-21T00:56:56.003 INFO:tasks.workunit.client.0.smithi112.stdout:3/855: creat d2/d8/dd/de/d4a/d4c/de2/f123 x:0 0 0 2024-09-21T00:56:56.003 INFO:tasks.workunit.client.0.smithi112.stdout:4/624: creat d1/d5/d1c/d1e/d4a/d5f/d83/fd8 x:0 0 0 2024-09-21T00:56:56.005 INFO:tasks.workunit.client.0.smithi112.stdout:8/675: mkdir d0/d13/d1b/d22/d2e/d34/dd6 0 2024-09-21T00:56:56.005 INFO:tasks.workunit.client.0.smithi112.stdout:4/625: write d1/d5/d1c/d1e/d4a/f7d [450302,126257] 0 2024-09-21T00:56:56.102 INFO:tasks.workunit.client.0.smithi112.stdout:7/639: creat d0/d2/d38/fd3 x:0 0 0 2024-09-21T00:56:56.102 INFO:tasks.workunit.client.0.smithi112.stdout:6/555: rmdir d9/d13/d21 39 2024-09-21T00:56:56.103 INFO:tasks.workunit.client.0.smithi112.stdout:3/856: creat d2/d3e/d7b/d10d/f124 x:0 0 0 2024-09-21T00:56:56.103 INFO:tasks.workunit.client.0.smithi112.stdout:6/556: dread - d9/fb6 zero size 2024-09-21T00:56:56.107 INFO:tasks.workunit.client.0.smithi112.stdout:5/466: write d8/f5f [4170377,78983] 0 2024-09-21T00:56:56.107 INFO:tasks.workunit.client.0.smithi112.stdout:4/626: write d1/d5/d1c/d1e/d4a/d5f/f71 [2177164,18304] 0 2024-09-21T00:56:56.114 INFO:tasks.workunit.client.0.smithi112.stdout:8/676: creat d0/d13/d2a/d73/fd7 x:0 0 0 2024-09-21T00:56:56.115 INFO:tasks.workunit.client.0.smithi112.stdout:3/857: symlink d2/d8/d28/d35/d9e/l125 0 2024-09-21T00:56:56.115 INFO:tasks.workunit.client.0.smithi112.stdout:7/640: truncate d0/d2/d2e/f93 1552524 0 2024-09-21T00:56:56.116 INFO:tasks.workunit.client.0.smithi112.stdout:9/630: dwrite d5/d3b/d5f/d13/d54/d7d/f40 [4194304,4194304] 0 2024-09-21T00:56:56.122 INFO:tasks.workunit.client.0.smithi112.stdout:1/414: dwrite d5/d8/dd/f4c [0,4194304] 0 2024-09-21T00:56:56.130 INFO:tasks.workunit.client.0.smithi112.stdout:9/631: dread d5/d3b/d5f/f81 [0,4194304] 0 2024-09-21T00:56:56.130 INFO:tasks.workunit.client.0.smithi112.stdout:1/415: dread d5/d34/f49 [0,4194304] 0 2024-09-21T00:56:56.130 INFO:tasks.workunit.client.0.smithi112.stdout:1/416: chown d5/d8/d13 227456251 1 2024-09-21T00:56:56.138 INFO:tasks.workunit.client.0.smithi112.stdout:4/627: dread d1/d7/d9/d1a/f9a [0,4194304] 0 2024-09-21T00:56:56.142 INFO:tasks.workunit.client.0.smithi112.stdout:6/557: rmdir d9/d1f/d3e/d77/d79/db1 0 2024-09-21T00:56:56.143 INFO:tasks.workunit.client.0.smithi112.stdout:8/677: dread d0/d13/d2a/f6e [0,4194304] 0 2024-09-21T00:56:56.146 INFO:tasks.workunit.client.0.smithi112.stdout:5/467: dwrite d8/d9/d13/d1c/d99/f63 [0,4194304] 0 2024-09-21T00:56:56.147 INFO:tasks.workunit.client.0.smithi112.stdout:1/417: unlink d5/fc 0 2024-09-21T00:56:56.151 INFO:tasks.workunit.client.0.smithi112.stdout:3/858: mknod d2/d8/dd/de/c126 0 2024-09-21T00:56:56.152 INFO:tasks.workunit.client.0.smithi112.stdout:7/641: dread d0/f42 [0,4194304] 0 2024-09-21T00:56:56.153 INFO:tasks.workunit.client.0.smithi112.stdout:4/628: rmdir d1/d7/d9/d1a 39 2024-09-21T00:56:56.158 INFO:tasks.workunit.client.0.smithi112.stdout:9/632: symlink d5/d3b/d5f/d13/d54/dc1/lca 0 2024-09-21T00:56:56.158 INFO:tasks.workunit.client.0.smithi112.stdout:6/558: fsync d9/d13/d26/f3d 0 2024-09-21T00:56:56.160 INFO:tasks.workunit.client.0.smithi112.stdout:1/418: chown d5/d8/d10/d2e/f44 0 1 2024-09-21T00:56:56.161 INFO:tasks.workunit.client.0.smithi112.stdout:3/859: write d2/d3e/d7b/d10d/dd7/ff2 [2586068,80529] 0 2024-09-21T00:56:56.162 INFO:tasks.workunit.client.0.smithi112.stdout:4/629: readlink d1/d7/d9/d1a/l37 0 2024-09-21T00:56:56.168 INFO:tasks.workunit.client.0.smithi112.stdout:7/642: creat d0/d2/d32/da4/db2/db4/fd4 x:0 0 0 2024-09-21T00:56:56.169 INFO:tasks.workunit.client.0.smithi112.stdout:9/633: link d5/d3b/d5f/f58 d5/d3b/d5f/fcb 0 2024-09-21T00:56:56.171 INFO:tasks.workunit.client.0.smithi112.stdout:5/468: getdents d8/d9/d13/d2a/df/d5b 0 2024-09-21T00:56:56.177 INFO:tasks.workunit.client.0.smithi112.stdout:9/634: write d5/d6/d19/d51/d8f/fb8 [3026322,26768] 0 2024-09-21T00:56:56.178 INFO:tasks.workunit.client.0.smithi112.stdout:9/635: chown d5/f16 1590230213 1 2024-09-21T00:56:56.181 INFO:tasks.workunit.client.0.smithi112.stdout:8/678: dread d0/d13/d1b/d22/d2e/d34/d7b/d80/f93 [0,4194304] 0 2024-09-21T00:56:56.182 INFO:tasks.workunit.client.0.smithi112.stdout:7/643: mknod d0/d2/d32/da4/db2/db4/cd5 0 2024-09-21T00:56:56.184 INFO:tasks.workunit.client.0.smithi112.stdout:3/860: getdents d2/d38/d3f/d53/d96 0 2024-09-21T00:56:56.187 INFO:tasks.workunit.client.0.smithi112.stdout:9/636: mknod d5/d3b/d5f/d59/ccc 0 2024-09-21T00:56:56.188 INFO:tasks.workunit.client.0.smithi112.stdout:4/630: getdents d1/d5/d1c/d1e/d4a/d5f 0 2024-09-21T00:56:56.189 INFO:tasks.workunit.client.0.smithi112.stdout:1/419: dwrite d5/d8/d13/d3e/d46/f57 [0,4194304] 0 2024-09-21T00:56:56.190 INFO:tasks.workunit.client.0.smithi112.stdout:4/631: stat d1/d5/d1c/d1e/d76/db0/lc4 0 2024-09-21T00:56:56.195 INFO:tasks.workunit.client.0.smithi112.stdout:3/861: mknod d2/d33/d8c/c127 0 2024-09-21T00:56:56.201 INFO:tasks.workunit.client.0.smithi112.stdout:1/420: dread d5/d8/d13/d3e/f5b [0,4194304] 0 2024-09-21T00:56:56.201 INFO:tasks.workunit.client.0.smithi112.stdout:7/644: write d0/d2/d38/d48/dad/fa3 [1159500,102602] 0 2024-09-21T00:56:56.202 INFO:tasks.workunit.client.0.smithi112.stdout:1/421: readlink d5/d8/d13/d3e/d46/d70/l77 0 2024-09-21T00:56:56.204 INFO:tasks.workunit.client.0.smithi112.stdout:3/862: unlink d2/d8/dd/l7d 0 2024-09-21T00:56:56.205 INFO:tasks.workunit.client.0.smithi112.stdout:1/422: read - d5/d8/dd/f58 zero size 2024-09-21T00:56:56.206 INFO:tasks.workunit.client.0.smithi112.stdout:7/645: creat d0/d2/d38/d48/dad/fd6 x:0 0 0 2024-09-21T00:56:56.210 INFO:tasks.workunit.client.0.smithi112.stdout:4/632: dwrite d1/d7/d9/d1a/f9a [4194304,4194304] 0 2024-09-21T00:56:56.211 INFO:tasks.workunit.client.0.smithi112.stdout:9/637: getdents d5 0 2024-09-21T00:56:56.212 INFO:tasks.workunit.client.0.smithi112.stdout:3/863: mkdir d2/d33/d8c/db7/d128 0 2024-09-21T00:56:56.213 INFO:tasks.workunit.client.0.smithi112.stdout:1/423: symlink d5/d34/d6a/d7f/l85 0 2024-09-21T00:56:56.214 INFO:tasks.workunit.client.0.smithi112.stdout:1/424: chown d5/d8/dd/f76 7 1 2024-09-21T00:56:56.218 INFO:tasks.workunit.client.0.smithi112.stdout:1/425: creat d5/d8/d13/d3e/d46/f86 x:0 0 0 2024-09-21T00:56:56.220 INFO:tasks.workunit.client.0.smithi112.stdout:9/638: mknod d5/d3b/ccd 0 2024-09-21T00:56:56.227 INFO:tasks.workunit.client.0.smithi112.stdout:3/864: getdents d2/d8/dd/de/d6b 0 2024-09-21T00:56:56.228 INFO:tasks.workunit.client.0.smithi112.stdout:9/639: mknod d5/d3b/d5f/d13/d54/d7d/d57/da8/cce 0 2024-09-21T00:56:56.231 INFO:tasks.workunit.client.0.smithi112.stdout:7/646: truncate d0/d2/d38/d48/f76 2137702 0 2024-09-21T00:56:56.231 INFO:tasks.workunit.client.0.smithi112.stdout:1/426: write d5/d34/f49 [3777723,118748] 0 2024-09-21T00:56:56.234 INFO:tasks.workunit.client.0.smithi112.stdout:3/865: mkdir d2/d8/dd/de/d4a/d4c/d129 0 2024-09-21T00:56:56.235 INFO:tasks.workunit.client.0.smithi112.stdout:1/427: mkdir d5/d8/d13/d87 0 2024-09-21T00:56:56.237 INFO:tasks.workunit.client.0.smithi112.stdout:3/866: unlink d2/d3e/d7b/d10d/f10a 0 2024-09-21T00:56:56.239 INFO:tasks.workunit.client.0.smithi112.stdout:1/428: unlink d5/d8/d10/d2e/l56 0 2024-09-21T00:56:56.241 INFO:tasks.workunit.client.0.smithi112.stdout:1/429: readlink d5/d8/dd/d54/l7e 0 2024-09-21T00:56:56.241 INFO:tasks.workunit.client.0.smithi112.stdout:3/867: read d2/d3e/d7b/d10d/dd7/def/ff8 [96506,35806] 0 2024-09-21T00:56:56.242 INFO:tasks.workunit.client.0.smithi112.stdout:7/647: rename d0/d2/d36/d39/d1a/f4d to d0/d2/d36/d39/db3/fd7 0 2024-09-21T00:56:56.243 INFO:tasks.workunit.client.0.smithi112.stdout:7/648: chown d0/d2/d38/d48/dad/c6f 471 1 2024-09-21T00:56:56.248 INFO:tasks.workunit.client.0.smithi112.stdout:9/640: dread d5/d6/d19/f33 [0,4194304] 0 2024-09-21T00:56:56.252 INFO:tasks.workunit.client.0.smithi112.stdout:7/649: dwrite d0/d2/d38/d48/dad/fa3 [0,4194304] 0 2024-09-21T00:56:56.255 INFO:tasks.workunit.client.0.smithi112.stdout:3/868: rename d2/l20 to d2/d8/dd/l12a 0 2024-09-21T00:56:56.259 INFO:tasks.workunit.client.0.smithi112.stdout:9/641: creat d5/d3b/d5f/d13/d6e/da0/da4/fcf x:0 0 0 2024-09-21T00:56:56.260 INFO:tasks.workunit.client.0.smithi112.stdout:7/650: rmdir d0/d2/d36/d39/d1a 39 2024-09-21T00:56:56.263 INFO:tasks.workunit.client.0.smithi112.stdout:3/869: mknod d2/d38/d3f/c12b 0 2024-09-21T00:56:56.264 INFO:tasks.workunit.client.0.smithi112.stdout:3/870: readlink d2/d8/dd/de/d4a/lf0 0 2024-09-21T00:56:56.265 INFO:tasks.workunit.client.0.smithi112.stdout:9/642: mknod d5/d62/cd0 0 2024-09-21T00:56:56.270 INFO:tasks.workunit.client.0.smithi112.stdout:9/643: dread d5/d6/d19/f33 [0,4194304] 0 2024-09-21T00:56:56.273 INFO:tasks.workunit.client.0.smithi112.stdout:3/871: chown d2/d8/dd/l12a 457159338 1 2024-09-21T00:56:56.274 INFO:tasks.workunit.client.0.smithi112.stdout:1/430: dwrite d5/d8/f12 [0,4194304] 0 2024-09-21T00:56:56.275 INFO:tasks.workunit.client.0.smithi112.stdout:1/431: readlink d5/d34/d6a/d7f/l85 0 2024-09-21T00:56:56.284 INFO:tasks.workunit.client.0.smithi112.stdout:7/651: dwrite d0/d2/d36/d39/d56/d65/d75/f84 [4194304,4194304] 0 2024-09-21T00:56:56.284 INFO:tasks.workunit.client.0.smithi112.stdout:1/432: creat d5/d34/f88 x:0 0 0 2024-09-21T00:56:56.287 INFO:tasks.workunit.client.0.smithi112.stdout:1/433: write d5/d8/d13/d3e/d46/d70/f84 [433411,74755] 0 2024-09-21T00:56:56.289 INFO:tasks.workunit.client.0.smithi112.stdout:9/644: rmdir d5/d3b/d5f/d13/d56/dbd 0 2024-09-21T00:56:56.294 INFO:tasks.workunit.client.0.smithi112.stdout:3/872: dwrite d2/d8/d28/dac/fc3 [0,4194304] 0 2024-09-21T00:56:56.301 INFO:tasks.workunit.client.0.smithi112.stdout:3/873: creat d2/d3e/d103/f12c x:0 0 0 2024-09-21T00:56:56.303 INFO:tasks.workunit.client.0.smithi112.stdout:7/652: rename d0/d2/d36/d39/d1a/la8 to d0/d2/d36/d39/ld8 0 2024-09-21T00:56:56.310 INFO:tasks.workunit.client.0.smithi112.stdout:7/653: mkdir d0/d2/d36/d39/d56/d65/d87/dd9 0 2024-09-21T00:56:56.310 INFO:tasks.workunit.client.0.smithi112.stdout:3/874: dwrite d2/d8/f11 [8388608,4194304] 0 2024-09-21T00:56:56.316 INFO:tasks.workunit.client.0.smithi112.stdout:7/654: mknod d0/d2/d36/d39/d56/d65/cda 0 2024-09-21T00:56:56.316 INFO:tasks.workunit.client.0.smithi112.stdout:3/875: creat d2/d38/d3f/d53/d96/dc9/f12d x:0 0 0 2024-09-21T00:56:56.317 INFO:tasks.workunit.client.0.smithi112.stdout:9/645: dwrite d5/d3b/d5f/d13/d56/f61 [0,4194304] 0 2024-09-21T00:56:56.325 INFO:tasks.workunit.client.0.smithi112.stdout:7/655: rmdir d0/d2/d36/d39/d56/d65/d75 39 2024-09-21T00:56:56.326 INFO:tasks.workunit.client.0.smithi112.stdout:1/434: dread d5/d8/d14/f3b [0,4194304] 0 2024-09-21T00:56:56.327 INFO:tasks.workunit.client.0.smithi112.stdout:7/656: write d0/d6e/fcd [594501,125864] 0 2024-09-21T00:56:56.329 INFO:tasks.workunit.client.0.smithi112.stdout:3/876: getdents d2/d38 0 2024-09-21T00:56:56.330 INFO:tasks.workunit.client.0.smithi112.stdout:1/435: symlink d5/d34/d6a/d7f/l89 0 2024-09-21T00:56:56.331 INFO:tasks.workunit.client.0.smithi112.stdout:9/646: dwrite d5/d6/d19/f2a [0,4194304] 0 2024-09-21T00:56:56.338 INFO:tasks.workunit.client.0.smithi112.stdout:1/436: creat d5/d8/dd/f8a x:0 0 0 2024-09-21T00:56:56.341 INFO:tasks.workunit.client.0.smithi112.stdout:7/657: dwrite d0/d2/d38/d48/dad/fa3 [0,4194304] 0 2024-09-21T00:56:56.348 INFO:tasks.workunit.client.0.smithi112.stdout:3/877: write d2/d8/dd/de/f18 [3097514,2472] 0 2024-09-21T00:56:56.351 INFO:tasks.workunit.client.0.smithi112.stdout:1/437: unlink d5/d8/c45 0 2024-09-21T00:56:56.352 INFO:tasks.workunit.client.0.smithi112.stdout:1/438: dread - d5/d8/dd/f8a zero size 2024-09-21T00:56:56.352 INFO:tasks.workunit.client.0.smithi112.stdout:7/658: symlink d0/d2/d36/d39/d1a/ldb 0 2024-09-21T00:56:56.354 INFO:tasks.workunit.client.0.smithi112.stdout:3/878: dread d2/d3e/d7b/d10d/dd7/def/ff4 [0,4194304] 0 2024-09-21T00:56:56.354 INFO:tasks.workunit.client.0.smithi112.stdout:1/439: write d5/d8/f12 [7746135,121466] 0 2024-09-21T00:56:56.356 INFO:tasks.workunit.client.0.smithi112.stdout:9/647: getdents d5/d3b/d5f/d13/d54/d7d 0 2024-09-21T00:56:56.357 INFO:tasks.workunit.client.0.smithi112.stdout:3/879: truncate d2/d3e/d7b/d10d/f124 465077 0 2024-09-21T00:56:56.357 INFO:tasks.workunit.client.0.smithi112.stdout:7/659: symlink d0/d2/d36/d39/db3/ldc 0 2024-09-21T00:56:56.360 INFO:tasks.workunit.client.0.smithi112.stdout:1/440: fsync d5/d8/d13/d3e/d46/d70/f73 0 2024-09-21T00:56:56.362 INFO:tasks.workunit.client.0.smithi112.stdout:9/648: rename d5/d3b/d5f/d13/d54/dbb to d5/db4/dd1 0 2024-09-21T00:56:56.371 INFO:tasks.workunit.client.0.smithi112.stdout:1/441: rmdir d5/d8/d10 39 2024-09-21T00:56:56.374 INFO:tasks.workunit.client.0.smithi112.stdout:9/649: truncate d5/d3b/d5f/d13/f50 791713 0 2024-09-21T00:56:56.375 INFO:tasks.workunit.client.0.smithi112.stdout:9/650: write d5/d3b/fc8 [457195,69662] 0 2024-09-21T00:56:56.378 INFO:tasks.workunit.client.0.smithi112.stdout:7/660: rmdir d0/d2/d92/d99 0 2024-09-21T00:56:56.380 INFO:tasks.workunit.client.0.smithi112.stdout:7/661: write d0/d6e/fcd [547886,92547] 0 2024-09-21T00:56:56.384 INFO:tasks.workunit.client.0.smithi112.stdout:9/651: dwrite d5/d3b/d5f/d13/d54/f90 [0,4194304] 0 2024-09-21T00:56:56.384 INFO:tasks.workunit.client.0.smithi112.stdout:7/662: mkdir d0/d2/d36/d39/d56/d86/ddd 0 2024-09-21T00:56:56.391 INFO:tasks.workunit.client.0.smithi112.stdout:9/652: symlink d5/d3b/d5f/ld2 0 2024-09-21T00:56:56.392 INFO:tasks.workunit.client.0.smithi112.stdout:7/663: dwrite d0/f95 [0,4194304] 0 2024-09-21T00:56:56.392 INFO:tasks.workunit.client.0.smithi112.stdout:9/653: chown d5/d3b/d5f/d13/l7a 4 1 2024-09-21T00:56:56.394 INFO:tasks.workunit.client.0.smithi112.stdout:7/664: read - d0/d2/d36/d39/d1a/da5/fb0 zero size 2024-09-21T00:56:56.399 INFO:tasks.workunit.client.0.smithi112.stdout:7/665: write d0/d2/d2e/f5f [2946562,8564] 0 2024-09-21T00:56:56.401 INFO:tasks.workunit.client.0.smithi112.stdout:7/666: dread - d0/d2/d38/fd3 zero size 2024-09-21T00:56:56.405 INFO:tasks.workunit.client.0.smithi112.stdout:1/442: dwrite d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:56.406 INFO:tasks.workunit.client.0.smithi112.stdout:1/443: read - d5/d8/dd/f58 zero size 2024-09-21T00:56:56.409 INFO:tasks.workunit.client.0.smithi112.stdout:1/444: dread - d5/d34/f88 zero size 2024-09-21T00:56:56.410 INFO:tasks.workunit.client.0.smithi112.stdout:7/667: dwrite d0/d2/d36/f49 [0,4194304] 0 2024-09-21T00:56:56.411 INFO:tasks.workunit.client.0.smithi112.stdout:1/445: chown d5/d8/dd/d54/c75 15 1 2024-09-21T00:56:56.412 INFO:tasks.workunit.client.0.smithi112.stdout:1/446: fdatasync d5/d8/d13/f53 0 2024-09-21T00:56:56.416 INFO:tasks.workunit.client.0.smithi112.stdout:1/447: rmdir d5/d34/d6a 39 2024-09-21T00:56:56.418 INFO:tasks.workunit.client.0.smithi112.stdout:7/668: rename d0/d2/d36/d39/d56/d65/d75/l83 to d0/d2/d36/d39/d55/lde 0 2024-09-21T00:56:56.423 INFO:tasks.workunit.client.0.smithi112.stdout:9/654: write d5/f17 [4948256,10724] 0 2024-09-21T00:56:56.425 INFO:tasks.workunit.client.0.smithi112.stdout:1/448: read d5/d8/d10/f17 [2704317,37712] 0 2024-09-21T00:56:56.427 INFO:tasks.workunit.client.0.smithi112.stdout:7/669: creat d0/d2/d36/d39/d1a/fdf x:0 0 0 2024-09-21T00:56:56.429 INFO:tasks.workunit.client.0.smithi112.stdout:7/670: write d0/d2/d36/d39/d1a/fa2 [358579,77527] 0 2024-09-21T00:56:56.433 INFO:tasks.workunit.client.0.smithi112.stdout:9/655: dwrite d5/d6/f6c [0,4194304] 0 2024-09-21T00:56:56.433 INFO:tasks.workunit.client.0.smithi112.stdout:1/449: symlink d5/l8b 0 2024-09-21T00:56:56.434 INFO:tasks.workunit.client.0.smithi112.stdout:7/671: write d0/d2/d36/d39/d1a/f44 [1608710,118090] 0 2024-09-21T00:56:56.442 INFO:tasks.workunit.client.0.smithi112.stdout:9/656: dwrite d5/f16 [4194304,4194304] 0 2024-09-21T00:56:56.443 INFO:tasks.workunit.client.0.smithi112.stdout:1/450: chown d5/d8/dd/c2c 5 1 2024-09-21T00:56:56.447 INFO:tasks.workunit.client.0.smithi112.stdout:9/657: creat d5/d3b/d5f/d13/fd3 x:0 0 0 2024-09-21T00:56:56.448 INFO:tasks.workunit.client.0.smithi112.stdout:7/672: dwrite d0/d2/d36/f49 [0,4194304] 0 2024-09-21T00:56:56.451 INFO:tasks.workunit.client.0.smithi112.stdout:7/673: fdatasync d0/d2/d36/d39/d1a/da5/fb0 0 2024-09-21T00:56:56.452 INFO:tasks.workunit.client.0.smithi112.stdout:7/674: chown d0/d2/d36/d39/d56/d86/c7b 1060784134 1 2024-09-21T00:56:56.457 INFO:tasks.workunit.client.0.smithi112.stdout:9/658: rename d5/d3b/d5f/c26 to d5/db4/cd4 0 2024-09-21T00:56:56.460 INFO:tasks.workunit.client.0.smithi112.stdout:9/659: creat d5/d3b/d5f/d13/d6e/fd5 x:0 0 0 2024-09-21T00:56:56.461 INFO:tasks.workunit.client.0.smithi112.stdout:9/660: write d5/d3b/d5f/d13/fc2 [705416,106525] 0 2024-09-21T00:56:56.464 INFO:tasks.workunit.client.0.smithi112.stdout:9/661: mkdir d5/d3b/d5f/d13/d6e/da0/da4/dd6 0 2024-09-21T00:56:56.465 INFO:tasks.workunit.client.0.smithi112.stdout:9/662: chown d5/d6/d19 13 1 2024-09-21T00:56:56.466 INFO:tasks.workunit.client.0.smithi112.stdout:9/663: chown d5/d3b/d5f/d13/d54/d7d/f2b 1162 1 2024-09-21T00:56:56.469 INFO:tasks.workunit.client.0.smithi112.stdout:9/664: truncate d5/d6/d19/f1d 2328597 0 2024-09-21T00:56:56.473 INFO:tasks.workunit.client.0.smithi112.stdout:1/451: dwrite d5/d8/d13/d3e/f5b [0,4194304] 0 2024-09-21T00:56:56.474 INFO:tasks.workunit.client.0.smithi112.stdout:1/452: chown d5/d8/d13/d3e/d46/d70 8153 1 2024-09-21T00:56:56.476 INFO:tasks.workunit.client.0.smithi112.stdout:9/665: mkdir d5/d3b/d5f/d13/d6e/da0/da4/dd6/dd7 0 2024-09-21T00:56:56.482 INFO:tasks.workunit.client.0.smithi112.stdout:9/666: symlink d5/d3b/d5f/d13/d6e/ld8 0 2024-09-21T00:56:56.485 INFO:tasks.workunit.client.0.smithi112.stdout:1/453: dwrite d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:56.486 INFO:tasks.workunit.client.0.smithi112.stdout:1/454: stat d5/d8/f35 0 2024-09-21T00:56:56.488 INFO:tasks.workunit.client.0.smithi112.stdout:9/667: mknod d5/d6/cd9 0 2024-09-21T00:56:56.489 INFO:tasks.workunit.client.0.smithi112.stdout:9/668: write d5/d6/f9b [43646,122682] 0 2024-09-21T00:56:56.494 INFO:tasks.workunit.client.0.smithi112.stdout:9/669: creat d5/d6/d19/d51/fda x:0 0 0 2024-09-21T00:56:56.495 INFO:tasks.workunit.client.0.smithi112.stdout:1/455: mknod d5/d8/d13/d87/c8c 0 2024-09-21T00:56:56.503 INFO:tasks.workunit.client.0.smithi112.stdout:1/456: creat d5/d8/d10/f8d x:0 0 0 2024-09-21T00:56:56.509 INFO:tasks.workunit.client.0.smithi112.stdout:1/457: getdents d5/d8/dd/d54 0 2024-09-21T00:56:56.511 INFO:tasks.workunit.client.0.smithi112.stdout:1/458: rmdir d5/d8/d13/d3e/d46/d70 39 2024-09-21T00:56:56.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/459: mkdir d5/d8/dd/d8e 0 2024-09-21T00:56:56.513 INFO:tasks.workunit.client.0.smithi112.stdout:1/460: readlink d5/d8/d14/l22 0 2024-09-21T00:56:56.515 INFO:tasks.workunit.client.0.smithi112.stdout:1/461: symlink d5/d8/d14/l8f 0 2024-09-21T00:56:56.515 INFO:tasks.workunit.client.0.smithi112.stdout:9/670: dread d5/d6/d19/f28 [0,4194304] 0 2024-09-21T00:56:56.518 INFO:tasks.workunit.client.0.smithi112.stdout:1/462: truncate d5/d8/dd/f78 421931 0 2024-09-21T00:56:56.519 INFO:tasks.workunit.client.0.smithi112.stdout:9/671: rename d5/d3b/d5f/d13/d54/d55/fc5 to d5/d3b/d5f/d13/d54/dc1/fdb 0 2024-09-21T00:56:56.521 INFO:tasks.workunit.client.0.smithi112.stdout:9/672: stat d5/d3b/d5f/d13/d6e/ld8 0 2024-09-21T00:56:56.526 INFO:tasks.workunit.client.0.smithi112.stdout:1/463: dwrite d5/d8/d10/f1d [4194304,4194304] 0 2024-09-21T00:56:56.534 INFO:tasks.workunit.client.0.smithi112.stdout:1/464: creat d5/d68/f90 x:0 0 0 2024-09-21T00:56:56.534 INFO:tasks.workunit.client.0.smithi112.stdout:1/465: chown d5/d8/d13 1557879042 1 2024-09-21T00:56:56.537 INFO:tasks.workunit.client.0.smithi112.stdout:9/673: dread d5/d3b/d5f/f58 [0,4194304] 0 2024-09-21T00:56:56.538 INFO:tasks.workunit.client.0.smithi112.stdout:9/674: write d5/d3b/d5f/d13/fd3 [561647,53262] 0 2024-09-21T00:56:56.540 INFO:tasks.workunit.client.0.smithi112.stdout:1/466: symlink d5/d8/d13/d3e/d46/d70/l91 0 2024-09-21T00:56:56.541 INFO:tasks.workunit.client.0.smithi112.stdout:9/675: mkdir d5/d3b/d5f/d13/d54/dc1/ddc 0 2024-09-21T00:56:56.542 INFO:tasks.workunit.client.0.smithi112.stdout:1/467: read - d5/d8/d13/d3e/d46/d70/f73 zero size 2024-09-21T00:56:56.544 INFO:tasks.workunit.client.0.smithi112.stdout:1/468: chown d5/l79 74075942 1 2024-09-21T00:56:56.547 INFO:tasks.workunit.client.0.smithi112.stdout:1/469: mkdir d5/d8/d14/d92 0 2024-09-21T00:56:56.553 INFO:tasks.workunit.client.0.smithi112.stdout:1/470: dwrite d5/d8/f12 [0,4194304] 0 2024-09-21T00:56:56.554 INFO:tasks.workunit.client.0.smithi112.stdout:1/471: chown d5/l79 22789 1 2024-09-21T00:56:56.555 INFO:tasks.workunit.client.0.smithi112.stdout:9/676: dread d5/f20 [0,4194304] 0 2024-09-21T00:56:56.559 INFO:tasks.workunit.client.0.smithi112.stdout:9/677: read - d5/d62/f89 zero size 2024-09-21T00:56:56.563 INFO:tasks.workunit.client.0.smithi112.stdout:9/678: truncate d5/d3b/d5f/d13/f50 464308 0 2024-09-21T00:56:56.571 INFO:tasks.workunit.client.0.smithi112.stdout:9/679: rename d5/d3b/d5f/d59/l73 to d5/d3b/d5f/d13/d54/d7d/ldd 0 2024-09-21T00:56:56.571 INFO:tasks.workunit.client.0.smithi112.stdout:9/680: chown d5/d6/d3f/d7f 34358018 1 2024-09-21T00:56:56.572 INFO:tasks.workunit.client.0.smithi112.stdout:9/681: write d5/d6/d19/f2a [229779,19683] 0 2024-09-21T00:56:56.575 INFO:tasks.workunit.client.0.smithi112.stdout:1/472: truncate d5/d8/f35 1031332 0 2024-09-21T00:56:56.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/682: rename d5/d3b/d5f/d13/d6e/da0/da4/dd6 to d5/d3b/d5f/db9/dde 0 2024-09-21T00:56:56.577 INFO:tasks.workunit.client.0.smithi112.stdout:9/683: read - d5/d6/d19/f7b zero size 2024-09-21T00:56:56.587 INFO:tasks.workunit.client.0.smithi112.stdout:9/684: dwrite d5/d3b/d5f/fcb [0,4194304] 0 2024-09-21T00:56:56.588 INFO:tasks.workunit.client.0.smithi112.stdout:9/685: fdatasync d5/f14 0 2024-09-21T00:56:56.590 INFO:tasks.workunit.client.0.smithi112.stdout:1/473: rename d5/d8/d10/c55 to d5/d3a/c93 0 2024-09-21T00:56:56.609 INFO:tasks.workunit.client.0.smithi112.stdout:9/686: rename d5/d3b/d5f/d13/d54/d7d/f3c to d5/d3b/d5f/d13/d54/dc1/fdf 0 2024-09-21T00:56:56.609 INFO:tasks.workunit.client.0.smithi112.stdout:1/474: rmdir d5/d8/d14/d92 0 2024-09-21T00:56:56.638 INFO:tasks.workunit.client.0.smithi112.stdout:9/687: mkdir d5/de0 0 2024-09-21T00:56:56.639 INFO:tasks.workunit.client.0.smithi112.stdout:9/688: write d5/d3b/d5f/fcb [4991682,90554] 0 2024-09-21T00:56:56.639 INFO:tasks.workunit.client.0.smithi112.stdout:1/475: fsync d5/d34/f36 0 2024-09-21T00:56:56.642 INFO:tasks.workunit.client.0.smithi112.stdout:9/689: creat d5/d3b/d5f/db9/fe1 x:0 0 0 2024-09-21T00:56:56.645 INFO:tasks.workunit.client.0.smithi112.stdout:9/690: mknod d5/d3b/d5f/d13/d6e/da0/ce2 0 2024-09-21T00:56:56.646 INFO:tasks.workunit.client.0.smithi112.stdout:9/691: chown d5/f5e 4279 1 2024-09-21T00:56:56.648 INFO:tasks.workunit.client.0.smithi112.stdout:1/476: getdents d5/d8/dd/d54/d5a 0 2024-09-21T00:56:56.652 INFO:tasks.workunit.client.0.smithi112.stdout:9/692: dwrite d5/d3b/d5f/d13/d56/f61 [0,4194304] 0 2024-09-21T00:56:56.656 INFO:tasks.workunit.client.0.smithi112.stdout:1/477: symlink d5/d8/d13/d3e/d46/l94 0 2024-09-21T00:56:56.674 INFO:tasks.workunit.client.0.smithi112.stdout:1/478: truncate d5/d8/d10/f1d 2216315 0 2024-09-21T00:56:56.676 INFO:tasks.workunit.client.0.smithi112.stdout:9/693: dwrite d5/d3b/d5f/d13/d54/f98 [0,4194304] 0 2024-09-21T00:56:56.688 INFO:tasks.workunit.client.0.smithi112.stdout:9/694: write d5/f20 [5407294,52403] 0 2024-09-21T00:56:56.691 INFO:tasks.workunit.client.0.smithi112.stdout:9/695: creat d5/d3b/d5f/d13/d54/dc1/fe3 x:0 0 0 2024-09-21T00:56:56.695 INFO:tasks.workunit.client.0.smithi112.stdout:9/696: getdents d5 0 2024-09-21T00:56:56.698 INFO:tasks.workunit.client.0.smithi112.stdout:1/479: write d5/d8/d10/d2e/f6e [4965252,108998] 0 2024-09-21T00:56:56.702 INFO:tasks.workunit.client.0.smithi112.stdout:1/480: creat d5/d8/dd/d8e/f95 x:0 0 0 2024-09-21T00:56:56.703 INFO:tasks.workunit.client.0.smithi112.stdout:9/697: dwrite d5/d6/d19/d51/d8f/fb8 [8388608,4194304] 0 2024-09-21T00:56:56.711 INFO:tasks.workunit.client.0.smithi112.stdout:9/698: dwrite d5/d6/d3f/d7f/f8a [0,4194304] 0 2024-09-21T00:56:56.712 INFO:tasks.workunit.client.0.smithi112.stdout:9/699: chown d5/d3b/d5f/d13/d6e/fd5 311809 1 2024-09-21T00:56:56.718 INFO:tasks.workunit.client.0.smithi112.stdout:9/700: mknod d5/d3b/ce4 0 2024-09-21T00:56:56.722 INFO:tasks.workunit.client.0.smithi112.stdout:1/481: dwrite d5/d34/f4d [0,4194304] 0 2024-09-21T00:56:56.727 INFO:tasks.workunit.client.0.smithi112.stdout:1/482: rename d5/d8/d13/d87/c8c to d5/d3a/d4b/c96 0 2024-09-21T00:56:56.735 INFO:tasks.workunit.client.0.smithi112.stdout:1/483: dwrite d5/d8/dd/d8e/f95 [0,4194304] 0 2024-09-21T00:56:56.740 INFO:tasks.workunit.client.0.smithi112.stdout:1/484: rename d5/d8/d13/d3e to d5/d8/dd/d97 0 2024-09-21T00:56:56.741 INFO:tasks.workunit.client.0.smithi112.stdout:9/701: dwrite d5/d3b/d5f/d13/f5d [0,4194304] 0 2024-09-21T00:56:56.749 INFO:tasks.workunit.client.0.smithi112.stdout:1/485: truncate d5/d8/dd/d54/d5a/f7b 644827 0 2024-09-21T00:56:56.753 INFO:tasks.workunit.client.0.smithi112.stdout:9/702: dwrite d5/d3b/d5f/d13/d54/f90 [4194304,4194304] 0 2024-09-21T00:56:56.753 INFO:tasks.workunit.client.0.smithi112.stdout:1/486: dread - d5/d8/dd/d97/d46/f66 zero size 2024-09-21T00:56:56.755 INFO:tasks.workunit.client.0.smithi112.stdout:9/703: truncate d5/d6/d3f/fc0 748847 0 2024-09-21T00:56:56.758 INFO:tasks.workunit.client.0.smithi112.stdout:1/487: creat d5/f98 x:0 0 0 2024-09-21T00:56:56.760 INFO:tasks.workunit.client.0.smithi112.stdout:9/704: creat d5/d3b/d5f/d13/d54/dc1/ddc/fe5 x:0 0 0 2024-09-21T00:56:56.760 INFO:tasks.workunit.client.0.smithi112.stdout:1/488: write d5/d34/f49 [1252851,57921] 0 2024-09-21T00:56:56.764 INFO:tasks.workunit.client.0.smithi112.stdout:9/705: mkdir d5/d3b/d5f/d13/d6e/da0/de6 0 2024-09-21T00:56:56.765 INFO:tasks.workunit.client.0.smithi112.stdout:1/489: dread d5/d8/dd/d97/f5b [0,4194304] 0 2024-09-21T00:56:56.770 INFO:tasks.workunit.client.0.smithi112.stdout:9/706: unlink d5/d3b/d5f/l35 0 2024-09-21T00:56:56.771 INFO:tasks.workunit.client.0.smithi112.stdout:9/707: stat d5/d6/c38 0 2024-09-21T00:56:56.776 INFO:tasks.workunit.client.0.smithi112.stdout:1/490: dread d5/d8/dd/d54/d5a/f7b [0,4194304] 0 2024-09-21T00:56:56.779 INFO:tasks.workunit.client.0.smithi112.stdout:1/491: chown d5/d8/d13/c1e 1 1 2024-09-21T00:56:56.784 INFO:tasks.workunit.client.0.smithi112.stdout:1/492: rename d5/d3a/d4b/c6f to d5/d8/dd/d97/d46/c99 0 2024-09-21T00:56:56.787 INFO:tasks.workunit.client.0.smithi112.stdout:1/493: creat d5/d8/d14/f9a x:0 0 0 2024-09-21T00:56:56.788 INFO:tasks.workunit.client.0.smithi112.stdout:1/494: chown d5/d8/f83 1 1 2024-09-21T00:56:56.794 INFO:tasks.workunit.client.0.smithi112.stdout:9/708: dwrite d5/d3b/d5f/d13/d54/f86 [0,4194304] 0 2024-09-21T00:56:56.795 INFO:tasks.workunit.client.0.smithi112.stdout:9/709: write d5/d3b/d5f/d13/f45 [3308931,36967] 0 2024-09-21T00:56:56.801 INFO:tasks.workunit.client.0.smithi112.stdout:9/710: dread d5/d3b/fc8 [0,4194304] 0 2024-09-21T00:56:56.805 INFO:tasks.workunit.client.0.smithi112.stdout:1/495: dwrite d5/d8/f1f [0,4194304] 0 2024-09-21T00:56:56.807 INFO:tasks.workunit.client.0.smithi112.stdout:1/496: read - d5/d8/d14/f9a zero size 2024-09-21T00:56:56.808 INFO:tasks.workunit.client.0.smithi112.stdout:1/497: write d5/d8/f12 [3217267,95298] 0 2024-09-21T00:56:56.809 INFO:tasks.workunit.client.0.smithi112.stdout:9/711: creat d5/d3b/d5f/d13/d54/d7d/d57/d6a/fe7 x:0 0 0 2024-09-21T00:56:56.811 INFO:tasks.workunit.client.0.smithi112.stdout:1/498: symlink d5/d8/d10/d2e/l9b 0 2024-09-21T00:56:56.812 INFO:tasks.workunit.client.0.smithi112.stdout:1/499: stat d5/d34/f49 0 2024-09-21T00:56:56.813 INFO:tasks.workunit.client.0.smithi112.stdout:9/712: truncate d5/d3b/d5f/d13/d54/d7d/d57/d6a/f93 1322741 0 2024-09-21T00:56:56.813 INFO:tasks.workunit.client.0.smithi112.stdout:9/713: stat d5/f20 0 2024-09-21T00:56:56.814 INFO:tasks.workunit.client.0.smithi112.stdout:9/714: readlink d5/d3b/d5f/d13/d6e/l72 0 2024-09-21T00:56:56.818 INFO:tasks.workunit.client.0.smithi112.stdout:9/715: creat d5/d3b/d79/fe8 x:0 0 0 2024-09-21T00:56:56.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/716: stat d5/d3b/ccd 0 2024-09-21T00:56:56.823 INFO:tasks.workunit.client.0.smithi112.stdout:9/717: dread d5/d6/d19/f2a [0,4194304] 0 2024-09-21T00:56:56.825 INFO:tasks.workunit.client.0.smithi112.stdout:9/718: write d5/d6/d19/d51/d8f/fb8 [12466596,15725] 0 2024-09-21T00:56:56.826 INFO:tasks.workunit.client.0.smithi112.stdout:9/719: chown d5/d3b/d5f/d13/d6e/da0/de6 8565778 1 2024-09-21T00:56:56.830 INFO:tasks.workunit.client.0.smithi112.stdout:9/720: rename d5/d3b/d5f/d13/d56/f7c to d5/d6/d3f/d7f/da2/fe9 0 2024-09-21T00:56:56.833 INFO:tasks.workunit.client.0.smithi112.stdout:9/721: mknod d5/d62/cea 0 2024-09-21T00:56:56.833 INFO:tasks.workunit.client.0.smithi112.stdout:1/500: truncate d5/d8/d10/f17 2149347 0 2024-09-21T00:56:56.839 INFO:tasks.workunit.client.0.smithi112.stdout:1/501: dread d5/d8/dd/f58 [0,4194304] 0 2024-09-21T00:56:56.840 INFO:tasks.workunit.client.0.smithi112.stdout:9/722: dwrite d5/d3b/d5f/d13/d54/f98 [0,4194304] 0 2024-09-21T00:56:56.841 INFO:tasks.workunit.client.0.smithi112.stdout:1/502: readlink d5/d8/d10/d2e/l9b 0 2024-09-21T00:56:56.842 INFO:tasks.workunit.client.0.smithi112.stdout:1/503: chown d5/d8/dd/d97/f5b 765890 1 2024-09-21T00:56:56.846 INFO:tasks.workunit.client.0.smithi112.stdout:1/504: link d5/d3a/c6c d5/d8/d14/c9c 0 2024-09-21T00:56:56.849 INFO:tasks.workunit.client.0.smithi112.stdout:1/505: write d5/d8/d10/d2e/f60 [864293,19385] 0 2024-09-21T00:56:56.854 INFO:tasks.workunit.client.0.smithi112.stdout:1/506: fdatasync d5/d8/dd/d97/d46/f66 0 2024-09-21T00:56:56.857 INFO:tasks.workunit.client.0.smithi112.stdout:1/507: creat d5/d8/d13/d87/f9d x:0 0 0 2024-09-21T00:56:56.861 INFO:tasks.workunit.client.0.smithi112.stdout:1/508: mknod d5/d3a/c9e 0 2024-09-21T00:56:56.862 INFO:tasks.workunit.client.0.smithi112.stdout:1/509: read - d5/d8/d14/f9a zero size 2024-09-21T00:56:56.866 INFO:tasks.workunit.client.0.smithi112.stdout:1/510: creat d5/d68/f9f x:0 0 0 2024-09-21T00:56:56.866 INFO:tasks.workunit.client.0.smithi112.stdout:9/723: dread d5/d6/d3f/d7f/da2/fe9 [0,4194304] 0 2024-09-21T00:56:56.871 INFO:tasks.workunit.client.0.smithi112.stdout:9/724: dread d5/d6/f6c [0,4194304] 0 2024-09-21T00:56:56.880 INFO:tasks.workunit.client.0.smithi112.stdout:9/725: mknod d5/db4/dd1/ceb 0 2024-09-21T00:56:56.882 INFO:tasks.workunit.client.0.smithi112.stdout:9/726: creat d5/de0/fec x:0 0 0 2024-09-21T00:56:56.882 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:56 smithi112 ceph-mon[28078]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 96 MiB/s rd, 260 MiB/s wr, 507 op/s 2024-09-21T00:56:56.885 INFO:tasks.workunit.client.0.smithi112.stdout:1/511: dread d5/d8/dd/f76 [0,4194304] 0 2024-09-21T00:56:56.886 INFO:tasks.workunit.client.0.smithi112.stdout:1/512: read d5/d8/dd/f76 [1527212,100824] 0 2024-09-21T00:56:56.887 INFO:tasks.workunit.client.0.smithi112.stdout:9/727: dread d5/d3b/d5f/d13/d56/f61 [0,4194304] 0 2024-09-21T00:56:56.891 INFO:tasks.workunit.client.0.smithi112.stdout:1/513: mknod d5/d8/d10/d2e/ca0 0 2024-09-21T00:56:56.893 INFO:tasks.workunit.client.0.smithi112.stdout:9/728: dwrite d5/f17 [0,4194304] 0 2024-09-21T00:56:56.898 INFO:tasks.workunit.client.0.smithi112.stdout:9/729: unlink d5/d3b/d5f/d13/d6e/da0/da4/fb7 0 2024-09-21T00:56:56.905 INFO:tasks.workunit.client.0.smithi112.stdout:9/730: rename d5/d6/d19/f7b to d5/d6/d3f/d7f/fed 0 2024-09-21T00:56:56.908 INFO:tasks.workunit.client.0.smithi112.stdout:9/731: creat d5/d3b/d79/d91/fee x:0 0 0 2024-09-21T00:56:56.910 INFO:tasks.workunit.client.0.smithi112.stdout:9/732: mknod d5/d3b/d79/cef 0 2024-09-21T00:56:56.915 INFO:tasks.workunit.client.0.smithi112.stdout:9/733: link d5/d62/cd0 d5/d3b/d5f/d13/d54/d7d/d57/d6a/cf0 0 2024-09-21T00:56:56.915 INFO:tasks.workunit.client.0.smithi112.stdout:9/734: stat d5/d3b/d5f/db9/fe1 0 2024-09-21T00:56:56.919 INFO:tasks.workunit.client.0.smithi112.stdout:9/735: creat d5/d3b/d5f/d13/ff1 x:0 0 0 2024-09-21T00:56:56.922 INFO:tasks.workunit.client.0.smithi112.stdout:9/736: dread d5/d6/d19/f28 [0,4194304] 0 2024-09-21T00:56:56.929 INFO:tasks.workunit.client.0.smithi112.stdout:1/514: dwrite d5/d8/dd/f4e [0,4194304] 0 2024-09-21T00:56:56.930 INFO:tasks.workunit.client.0.smithi112.stdout:1/515: chown d5/d8/d14/f3b 25971293 1 2024-09-21T00:56:56.932 INFO:tasks.workunit.client.0.smithi112.stdout:1/516: stat d5/d8/d10/l67 0 2024-09-21T00:56:56.936 INFO:tasks.workunit.client.0.smithi112.stdout:1/517: mkdir d5/d8/da1 0 2024-09-21T00:56:56.941 INFO:tasks.workunit.client.0.smithi112.stdout:1/518: creat d5/d8/dd/d97/d46/fa2 x:0 0 0 2024-09-21T00:56:56.942 INFO:tasks.workunit.client.0.smithi112.stdout:1/519: dread - d5/d34/f72 zero size 2024-09-21T00:56:56.944 INFO:tasks.workunit.client.0.smithi112.stdout:1/520: truncate d5/d8/dd/d97/d46/f86 863039 0 2024-09-21T00:56:56.945 INFO:tasks.workunit.client.0.smithi112.stdout:1/521: write d5/d8/d10/f16 [3629115,4253] 0 2024-09-21T00:56:56.950 INFO:tasks.workunit.client.0.smithi112.stdout:1/522: rmdir d5/d8/d10/d2e 39 2024-09-21T00:56:56.958 INFO:tasks.workunit.client.0.smithi112.stdout:9/737: dwrite d5/d3b/d5f/d13/d54/d7d/d57/f8b [0,4194304] 0 2024-09-21T00:56:56.964 INFO:tasks.workunit.client.0.smithi112.stdout:1/523: dwrite d5/d8/dd/d97/d46/d70/f84 [0,4194304] 0 2024-09-21T00:56:56.965 INFO:tasks.workunit.client.0.smithi112.stdout:9/738: mknod d5/d3b/d79/cf2 0 2024-09-21T00:56:56.967 INFO:tasks.workunit.client.0.smithi112.stdout:1/524: rename d5/d8/dd/cf to d5/d8/d13/d87/ca3 0 2024-09-21T00:56:56.972 INFO:tasks.workunit.client.0.smithi112.stdout:9/739: creat d5/db4/ff3 x:0 0 0 2024-09-21T00:56:56.973 INFO:tasks.workunit.client.0.smithi112.stdout:9/740: write d5/d3b/d5f/d13/fd3 [1551423,97370] 0 2024-09-21T00:56:56.974 INFO:tasks.workunit.client.0.smithi112.stdout:9/741: chown d5/f14 176729 1 2024-09-21T00:56:56.976 INFO:tasks.workunit.client.0.smithi112.stdout:9/742: write d5/d3b/d5f/d13/d6e/da0/da4/fcf [830099,92675] 0 2024-09-21T00:56:56.980 INFO:tasks.workunit.client.0.smithi112.stdout:1/525: rename d5/d8/dd/d97/d46/c99 to d5/d34/d6a/ca4 0 2024-09-21T00:56:56.981 INFO:tasks.workunit.client.0.smithi112.stdout:1/526: chown d5/d8/f12 13030 1 2024-09-21T00:56:56.989 INFO:tasks.workunit.client.0.smithi112.stdout:9/743: dwrite d5/d3b/d5f/d13/d54/d7d/f40 [4194304,4194304] 0 2024-09-21T00:56:56.990 INFO:tasks.workunit.client.0.smithi112.stdout:9/744: chown d5/d3b/d5f/d13/d54/f74 960253 1 2024-09-21T00:56:56.991 INFO:tasks.workunit.client.0.smithi112.stdout:1/527: creat d5/d8/dd/d97/fa5 x:0 0 0 2024-09-21T00:56:56.991 INFO:tasks.workunit.client.0.smithi112.stdout:9/745: stat d5/d3b/d5f/d13/d56/f95 0 2024-09-21T00:56:56.993 INFO:tasks.workunit.client.0.smithi112.stdout:1/528: chown d5/d34/d6a/d7f/c81 549354104 1 2024-09-21T00:56:56.993 INFO:tasks.workunit.client.0.smithi112.stdout:1/529: dread - d5/d68/f90 zero size 2024-09-21T00:56:56.998 INFO:tasks.workunit.client.0.smithi112.stdout:9/746: mknod d5/d3b/d79/d91/cf4 0 2024-09-21T00:56:57.004 INFO:tasks.workunit.client.0.smithi112.stdout:9/747: rename d5/d6/d19/f2a to d5/d6/d19/d51/d8f/ff5 0 2024-09-21T00:56:57.006 INFO:tasks.workunit.client.0.smithi112.stdout:9/748: mkdir d5/d3b/d79/df6 0 2024-09-21T00:56:57.008 INFO:tasks.workunit.client.0.smithi112.stdout:9/749: creat d5/d6/ff7 x:0 0 0 2024-09-21T00:56:57.012 INFO:tasks.workunit.client.0.smithi112.stdout:9/750: mknod d5/d3b/d5f/d13/d54/d55/cf8 0 2024-09-21T00:56:57.013 INFO:tasks.workunit.client.0.smithi112.stdout:9/751: write d5/d6/f76 [1441074,41495] 0 2024-09-21T00:56:57.014 INFO:tasks.workunit.client.0.smithi112.stdout:9/752: stat d5/d6/d19/d51/fda 0 2024-09-21T00:56:57.015 INFO:tasks.workunit.client.0.smithi112.stdout:1/530: chown d5/d8/d13/d87/ca3 62211 1 2024-09-21T00:56:57.017 INFO:tasks.workunit.client.0.smithi112.stdout:9/753: rmdir d5/d3b/d5f/d13/d6e 39 2024-09-21T00:56:57.019 INFO:tasks.workunit.client.0.smithi112.stdout:1/531: mkdir d5/d8/dd/d54/d5a/da6 0 2024-09-21T00:56:57.021 INFO:tasks.workunit.client.0.smithi112.stdout:9/754: readlink d5/d6/l48 0 2024-09-21T00:56:57.023 INFO:tasks.workunit.client.0.smithi112.stdout:1/532: getdents d5/d8/dd/d54/d5a/da6 0 2024-09-21T00:56:57.025 INFO:tasks.workunit.client.0.smithi112.stdout:1/533: dread d5/d8/dd/f78 [0,4194304] 0 2024-09-21T00:56:57.025 INFO:tasks.workunit.client.0.smithi112.stdout:1/534: fsync d5/d34/f36 0 2024-09-21T00:56:57.026 INFO:tasks.workunit.client.0.smithi112.stdout:1/535: write d5/d8/d10/f16 [231301,30856] 0 2024-09-21T00:56:57.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:56 smithi187 ceph-mon[34997]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 96 MiB/s rd, 260 MiB/s wr, 507 op/s 2024-09-21T00:56:57.167 INFO:tasks.workunit.client.0.smithi112.stdout:1/536: dwrite d5/d3a/f4a [0,4194304] 0 2024-09-21T00:56:57.168 INFO:tasks.workunit.client.0.smithi112.stdout:1/537: truncate d5/d34/f36 559280 0 2024-09-21T00:56:57.173 INFO:tasks.workunit.client.0.smithi112.stdout:1/538: fdatasync d5/d8/d10/d2e/f5e 0 2024-09-21T00:56:57.177 INFO:tasks.workunit.client.0.smithi112.stdout:1/539: creat d5/d8/dd/d97/d46/fa7 x:0 0 0 2024-09-21T00:56:57.178 INFO:tasks.workunit.client.0.smithi112.stdout:1/540: chown d5/d8/dd/d97/d46/l94 86315 1 2024-09-21T00:56:57.184 INFO:tasks.workunit.client.0.smithi112.stdout:1/541: dwrite d5/d68/f90 [0,4194304] 0 2024-09-21T00:56:57.187 INFO:tasks.workunit.client.0.smithi112.stdout:1/542: creat d5/d8/dd/d97/fa8 x:0 0 0 2024-09-21T00:56:57.202 INFO:tasks.workunit.client.0.smithi112.stdout:1/543: dwrite d5/d8/d10/f17 [0,4194304] 0 2024-09-21T00:56:57.205 INFO:tasks.workunit.client.0.smithi112.stdout:1/544: rmdir d5/d8/d14 39 2024-09-21T00:56:57.206 INFO:tasks.workunit.client.0.smithi112.stdout:1/545: chown d5/d34/d6a/d7f/l89 7 1 2024-09-21T00:56:57.209 INFO:tasks.workunit.client.0.smithi112.stdout:1/546: symlink d5/d8/dd/d97/d46/d70/la9 0 2024-09-21T00:56:57.210 INFO:tasks.workunit.client.0.smithi112.stdout:1/547: fsync d5/f98 0 2024-09-21T00:56:57.212 INFO:tasks.workunit.client.0.smithi112.stdout:1/548: write d5/d34/f42 [1981994,99115] 0 2024-09-21T00:56:57.213 INFO:tasks.workunit.client.0.smithi112.stdout:1/549: chown d5/d8/dd/d54/l7e 927676 1 2024-09-21T00:56:57.214 INFO:tasks.workunit.client.0.smithi112.stdout:1/550: write d5/d8/d10/f17 [1570537,126517] 0 2024-09-21T00:56:57.216 INFO:tasks.workunit.client.0.smithi112.stdout:1/551: creat d5/d8/d13/d87/faa x:0 0 0 2024-09-21T00:56:57.221 INFO:tasks.workunit.client.0.smithi112.stdout:1/552: creat d5/d8/dd/d97/fab x:0 0 0 2024-09-21T00:56:57.222 INFO:tasks.workunit.client.0.smithi112.stdout:1/553: read d5/d8/d10/d2e/f60 [657983,43772] 0 2024-09-21T00:56:57.223 INFO:tasks.workunit.client.0.smithi112.stdout:1/554: readlink d5/d8/dd/d97/d46/d70/la9 0 2024-09-21T00:56:57.231 INFO:tasks.workunit.client.0.smithi112.stdout:1/555: rename d5/d8/d13/f53 to d5/d8/dd/d97/d46/fac 0 2024-09-21T00:56:57.232 INFO:tasks.workunit.client.0.smithi112.stdout:1/556: write d5/d8/dd/f4e [4281555,71428] 0 2024-09-21T00:56:57.234 INFO:tasks.workunit.client.0.smithi112.stdout:1/557: truncate d5/d8/d10/f16 5191218 0 2024-09-21T00:56:57.237 INFO:tasks.workunit.client.0.smithi112.stdout:1/558: fdatasync d5/d8/d10/f1d 0 2024-09-21T00:56:57.239 INFO:tasks.workunit.client.0.smithi112.stdout:1/559: truncate d5/d8/dd/d97/d46/fa2 437103 0 2024-09-21T00:56:57.242 INFO:tasks.workunit.client.0.smithi112.stdout:1/560: truncate d5/d8/dd/f58 1460522 0 2024-09-21T00:56:57.242 INFO:tasks.workunit.client.0.smithi112.stdout:1/561: dread - d5/d34/f88 zero size 2024-09-21T00:56:57.248 INFO:tasks.workunit.client.0.smithi112.stdout:1/562: rename d5/d8/d13/c2f to d5/d8/dd/d8e/cad 0 2024-09-21T00:56:57.250 INFO:tasks.workunit.client.0.smithi112.stdout:1/563: unlink d5/d8/dd/d8e/f95 0 2024-09-21T00:56:57.255 INFO:tasks.workunit.client.0.smithi112.stdout:1/564: rename d5/d8/d10/f1d to d5/d3a/fae 0 2024-09-21T00:56:57.257 INFO:tasks.workunit.client.0.smithi112.stdout:1/565: symlink d5/d8/dd/d54/laf 0 2024-09-21T00:56:57.263 INFO:tasks.workunit.client.0.smithi112.stdout:1/566: dwrite d5/d8/dd/d97/d46/f57 [0,4194304] 0 2024-09-21T00:56:57.267 INFO:tasks.workunit.client.0.smithi112.stdout:1/567: dread d5/d8/dd/d97/d46/d70/f84 [0,4194304] 0 2024-09-21T00:56:57.268 INFO:tasks.workunit.client.0.smithi112.stdout:1/568: read - d5/d34/f88 zero size 2024-09-21T00:56:57.270 INFO:tasks.workunit.client.0.smithi112.stdout:1/569: mknod d5/d8/d13/d87/cb0 0 2024-09-21T00:56:57.273 INFO:tasks.workunit.client.0.smithi112.stdout:1/570: creat d5/d8/d10/d2e/fb1 x:0 0 0 2024-09-21T00:56:57.275 INFO:tasks.workunit.client.0.smithi112.stdout:1/571: creat d5/d8/dd/d97/fb2 x:0 0 0 2024-09-21T00:56:57.277 INFO:tasks.workunit.client.0.smithi112.stdout:1/572: symlink d5/d8/dd/d54/d5a/lb3 0 2024-09-21T00:56:57.278 INFO:tasks.workunit.client.0.smithi112.stdout:1/573: dread - d5/d8/dd/d97/fa8 zero size 2024-09-21T00:56:57.280 INFO:tasks.workunit.client.0.smithi112.stdout:1/574: mknod d5/d3a/d4b/cb4 0 2024-09-21T00:56:57.288 INFO:tasks.workunit.client.0.smithi112.stdout:4/633: sync 2024-09-21T00:56:57.289 INFO:tasks.workunit.client.0.smithi112.stdout:2/591: sync 2024-09-21T00:56:57.289 INFO:tasks.workunit.client.0.smithi112.stdout:0/506: sync 2024-09-21T00:56:57.290 INFO:tasks.workunit.client.0.smithi112.stdout:4/634: fdatasync d1/d7/d9/d1a/d22/fc7 0 2024-09-21T00:56:57.290 INFO:tasks.workunit.client.0.smithi112.stdout:0/507: chown d8/d1b/d2c/d2e/d4c/d64/l8f 66 1 2024-09-21T00:56:57.295 INFO:tasks.workunit.client.0.smithi112.stdout:4/635: mknod d1/d7/d30/d91/cd9 0 2024-09-21T00:56:57.296 INFO:tasks.workunit.client.0.smithi112.stdout:4/636: stat d1/d5/d1c/d1e/d76 0 2024-09-21T00:56:57.297 INFO:tasks.workunit.client.0.smithi112.stdout:1/575: write d5/d8/dd/d97/d46/d70/f73 [621315,59453] 0 2024-09-21T00:56:57.297 INFO:tasks.workunit.client.0.smithi112.stdout:4/637: chown d1/d5/c9c 58796 1 2024-09-21T00:56:57.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/576: fdatasync d5/d8/dd/f8a 0 2024-09-21T00:56:57.299 INFO:tasks.workunit.client.0.smithi112.stdout:0/508: symlink d8/d1b/d2c/d2e/d4c/d64/d96/la0 0 2024-09-21T00:56:57.303 INFO:tasks.workunit.client.0.smithi112.stdout:0/509: symlink d8/d75/d91/la1 0 2024-09-21T00:56:57.307 INFO:tasks.workunit.client.0.smithi112.stdout:4/638: getdents d1/d5/d1c/d1e/d3d 0 2024-09-21T00:56:57.308 INFO:tasks.workunit.client.0.smithi112.stdout:1/577: link d5/d3a/c93 d5/d8/dd/d54/cb5 0 2024-09-21T00:56:57.310 INFO:tasks.workunit.client.0.smithi112.stdout:1/578: rmdir d5/d8/d13/d87 39 2024-09-21T00:56:57.311 INFO:tasks.workunit.client.0.smithi112.stdout:2/592: dread d0/df/f13 [0,4194304] 0 2024-09-21T00:56:57.312 INFO:tasks.workunit.client.0.smithi112.stdout:0/510: dread d8/d11/d28/f2f [0,4194304] 0 2024-09-21T00:56:57.312 INFO:tasks.workunit.client.0.smithi112.stdout:2/593: chown d0/f48 34 1 2024-09-21T00:56:57.315 INFO:tasks.workunit.client.0.smithi112.stdout:4/639: getdents d1/d7/d9/d1a/d22/d6e 0 2024-09-21T00:56:57.321 INFO:tasks.workunit.client.0.smithi112.stdout:1/579: rename d5/d8/dd/d97/d46/f66 to d5/d8/fb6 0 2024-09-21T00:56:57.322 INFO:tasks.workunit.client.0.smithi112.stdout:4/640: creat d1/d75/dc2/fda x:0 0 0 2024-09-21T00:56:57.322 INFO:tasks.workunit.client.0.smithi112.stdout:0/511: dwrite d8/d1b/d2c/d2e/d4c/d64/f6e [0,4194304] 0 2024-09-21T00:56:57.327 INFO:tasks.workunit.client.0.smithi112.stdout:0/512: creat d8/d11/d28/fa2 x:0 0 0 2024-09-21T00:56:57.330 INFO:tasks.workunit.client.0.smithi112.stdout:1/580: dread d5/d8/d14/f25 [0,4194304] 0 2024-09-21T00:56:57.332 INFO:tasks.workunit.client.0.smithi112.stdout:4/641: link d1/d5/d1c/f65 d1/d7/fdb 0 2024-09-21T00:56:57.334 INFO:tasks.workunit.client.0.smithi112.stdout:4/642: symlink d1/d5/d1c/d1e/ldc 0 2024-09-21T00:56:57.335 INFO:tasks.workunit.client.0.smithi112.stdout:1/581: creat d5/d3a/fb7 x:0 0 0 2024-09-21T00:56:57.337 INFO:tasks.workunit.client.0.smithi112.stdout:1/582: creat d5/d8/dd/d97/d46/d70/fb8 x:0 0 0 2024-09-21T00:56:57.338 INFO:tasks.workunit.client.0.smithi112.stdout:1/583: write d5/d8/dd/f4c [4642822,27907] 0 2024-09-21T00:56:57.346 INFO:tasks.workunit.client.0.smithi112.stdout:1/584: dwrite d5/d8/dd/f8a [0,4194304] 0 2024-09-21T00:56:57.346 INFO:tasks.workunit.client.0.smithi112.stdout:0/513: write d8/fb [1303391,71664] 0 2024-09-21T00:56:57.351 INFO:tasks.workunit.client.0.smithi112.stdout:0/514: dread - d8/d11/d59/d78/f7a zero size 2024-09-21T00:56:57.351 INFO:tasks.workunit.client.0.smithi112.stdout:1/585: dread - d5/d8/d13/d87/faa zero size 2024-09-21T00:56:57.352 INFO:tasks.workunit.client.0.smithi112.stdout:1/586: dread - d5/d68/f9f zero size 2024-09-21T00:56:57.352 INFO:tasks.workunit.client.0.smithi112.stdout:0/515: chown d8/d1b/d2c/d2e/l3b 57 1 2024-09-21T00:56:57.354 INFO:tasks.workunit.client.0.smithi112.stdout:1/587: symlink d5/d8/dd/d97/lb9 0 2024-09-21T00:56:57.356 INFO:tasks.workunit.client.0.smithi112.stdout:4/643: dread d1/d2d/f8f [0,4194304] 0 2024-09-21T00:56:57.357 INFO:tasks.workunit.client.0.smithi112.stdout:0/516: mkdir d8/d1b/d2c/d2e/d4c/d64/d96/da3 0 2024-09-21T00:56:57.359 INFO:tasks.workunit.client.0.smithi112.stdout:1/588: link d5/d8/d10/d2e/f5e d5/d34/d6a/fba 0 2024-09-21T00:56:57.360 INFO:tasks.workunit.client.0.smithi112.stdout:1/589: write d5/d8/dd/d97/fa8 [873802,10269] 0 2024-09-21T00:56:57.362 INFO:tasks.workunit.client.0.smithi112.stdout:4/644: creat d1/d5/d1c/d1e/d4a/d5f/d83/fdd x:0 0 0 2024-09-21T00:56:57.365 INFO:tasks.workunit.client.0.smithi112.stdout:4/645: write d1/d7/d9/d1a/f9a [2442677,19418] 0 2024-09-21T00:56:57.372 INFO:tasks.workunit.client.0.smithi112.stdout:1/590: dwrite d5/f74 [0,4194304] 0 2024-09-21T00:56:57.380 INFO:tasks.workunit.client.0.smithi112.stdout:1/591: symlink d5/d8/dd/d97/d46/lbb 0 2024-09-21T00:56:57.381 INFO:tasks.workunit.client.0.smithi112.stdout:0/517: dwrite d8/d11/f1a [0,4194304] 0 2024-09-21T00:56:57.383 INFO:tasks.workunit.client.0.smithi112.stdout:1/592: mkdir d5/d3a/d4b/dbc 0 2024-09-21T00:56:57.384 INFO:tasks.workunit.client.0.smithi112.stdout:4/646: dwrite d1/d2d/f8f [0,4194304] 0 2024-09-21T00:56:57.387 INFO:tasks.workunit.client.0.smithi112.stdout:1/593: truncate d5/d34/d6a/fba 876425 0 2024-09-21T00:56:57.395 INFO:tasks.workunit.client.0.smithi112.stdout:4/647: dwrite d1/d2d/d34/f58 [0,4194304] 0 2024-09-21T00:56:57.397 INFO:tasks.workunit.client.0.smithi112.stdout:1/594: dwrite d5/d34/f4d [0,4194304] 0 2024-09-21T00:56:57.405 INFO:tasks.workunit.client.0.smithi112.stdout:1/595: link d5/d8/dd/d97/d46/fa2 d5/d8/da1/fbd 0 2024-09-21T00:56:57.407 INFO:tasks.workunit.client.0.smithi112.stdout:1/596: chown d5/d8/d10/d2e/f5e 794691193 1 2024-09-21T00:56:57.419 INFO:tasks.workunit.client.0.smithi112.stdout:0/518: dread d8/d11/d28/f4e [0,4194304] 0 2024-09-21T00:56:57.435 INFO:tasks.workunit.client.0.smithi112.stdout:1/597: dread d5/d8/d14/f69 [0,4194304] 0 2024-09-21T00:56:57.442 INFO:tasks.workunit.client.0.smithi112.stdout:4/648: dread d1/d5/d1c/d1e/f20 [4194304,4194304] 0 2024-09-21T00:56:57.443 INFO:tasks.workunit.client.0.smithi112.stdout:0/519: dread d8/d1b/d2c/d2e/d4c/f80 [0,4194304] 0 2024-09-21T00:56:57.448 INFO:tasks.workunit.client.0.smithi112.stdout:0/520: symlink d8/d62/d9d/la4 0 2024-09-21T00:56:57.450 INFO:tasks.workunit.client.0.smithi112.stdout:1/598: dwrite d5/d3a/fae [0,4194304] 0 2024-09-21T00:56:57.455 INFO:tasks.workunit.client.0.smithi112.stdout:1/599: rename d5/d34/f49 to d5/d8/da1/fbe 0 2024-09-21T00:56:57.458 INFO:tasks.workunit.client.0.smithi112.stdout:1/600: write d5/d8/d13/d87/f9d [461926,103534] 0 2024-09-21T00:56:57.460 INFO:tasks.workunit.client.0.smithi112.stdout:0/521: dwrite d8/d1b/f7e [0,4194304] 0 2024-09-21T00:56:57.466 INFO:tasks.workunit.client.0.smithi112.stdout:1/601: rename d5/d34/f4d to d5/d8/d14/fbf 0 2024-09-21T00:56:57.467 INFO:tasks.workunit.client.0.smithi112.stdout:4/649: dread d1/d5/d1c/f5b [0,4194304] 0 2024-09-21T00:56:57.467 INFO:tasks.workunit.client.0.smithi112.stdout:0/522: fdatasync d8/d1b/d2c/d2e/d4c/f84 0 2024-09-21T00:56:57.470 INFO:tasks.workunit.client.0.smithi112.stdout:0/523: mknod d8/d75/d91/ca5 0 2024-09-21T00:56:57.473 INFO:tasks.workunit.client.0.smithi112.stdout:4/650: rename d1/d5/d1c/d1e/d3d/c51 to d1/d2d/cde 0 2024-09-21T00:56:57.476 INFO:tasks.workunit.client.0.smithi112.stdout:0/524: rename d8/d11/d28/f87 to d8/d75/d91/fa6 0 2024-09-21T00:56:57.495 INFO:tasks.workunit.client.0.smithi112.stdout:1/602: truncate d5/d8/dd/d97/d46/d70/f84 3690671 0 2024-09-21T00:56:57.497 INFO:tasks.workunit.client.0.smithi112.stdout:1/603: mknod d5/d68/cc0 0 2024-09-21T00:56:57.501 INFO:tasks.workunit.client.0.smithi112.stdout:1/604: creat d5/d34/fc1 x:0 0 0 2024-09-21T00:56:57.504 INFO:tasks.workunit.client.0.smithi112.stdout:1/605: dread d5/d8/d13/d87/f9d [0,4194304] 0 2024-09-21T00:56:57.505 INFO:tasks.workunit.client.0.smithi112.stdout:1/606: truncate d5/d8/d13/d87/faa 633036 0 2024-09-21T00:56:57.509 INFO:tasks.workunit.client.0.smithi112.stdout:1/607: dread d5/d8/dd/f76 [0,4194304] 0 2024-09-21T00:56:57.512 INFO:tasks.workunit.client.0.smithi112.stdout:1/608: creat d5/d8/d10/fc2 x:0 0 0 2024-09-21T00:56:57.518 INFO:tasks.workunit.client.0.smithi112.stdout:1/609: rename d5/d8/dd/f76 to d5/d8/dd/d54/d5a/fc3 0 2024-09-21T00:56:57.521 INFO:tasks.workunit.client.0.smithi112.stdout:1/610: rmdir d5/d8/dd/d97/d46 39 2024-09-21T00:56:57.525 INFO:tasks.workunit.client.0.smithi112.stdout:1/611: symlink d5/d8/dd/d97/d46/d70/lc4 0 2024-09-21T00:56:57.527 INFO:tasks.workunit.client.0.smithi112.stdout:1/612: write d5/d8/dd/d97/d46/fa7 [838299,101937] 0 2024-09-21T00:56:57.528 INFO:tasks.workunit.client.0.smithi112.stdout:1/613: dread d5/d8/da1/fbd [0,4194304] 0 2024-09-21T00:56:57.531 INFO:tasks.workunit.client.0.smithi112.stdout:1/614: rename d5/d8/dd/d97/d46/lbb to d5/d8/d13/d87/lc5 0 2024-09-21T00:56:57.536 INFO:tasks.workunit.client.0.smithi112.stdout:1/615: rename d5/d8/dd/d54/d5a/da6 to d5/d8/dd/d97/dc6 0 2024-09-21T00:56:57.538 INFO:tasks.workunit.client.0.smithi112.stdout:1/616: mknod d5/d68/cc7 0 2024-09-21T00:56:57.541 INFO:tasks.workunit.client.0.smithi112.stdout:1/617: rename d5/d8/d13/c1e to d5/cc8 0 2024-09-21T00:56:57.543 INFO:tasks.workunit.client.0.smithi112.stdout:1/618: mkdir d5/d34/d6a/dc9 0 2024-09-21T00:56:57.545 INFO:tasks.workunit.client.0.smithi112.stdout:1/619: mkdir d5/d8/dd/d8e/dca 0 2024-09-21T00:56:57.546 INFO:tasks.workunit.client.0.smithi112.stdout:1/620: read d5/d34/f36 [249181,25344] 0 2024-09-21T00:56:57.552 INFO:tasks.workunit.client.0.smithi112.stdout:1/621: dwrite d5/d68/f90 [4194304,4194304] 0 2024-09-21T00:56:57.556 INFO:tasks.workunit.client.0.smithi112.stdout:1/622: dread d5/d8/f35 [0,4194304] 0 2024-09-21T00:56:57.558 INFO:tasks.workunit.client.0.smithi112.stdout:1/623: mknod d5/d8/d13/d87/ccb 0 2024-09-21T00:56:57.579 INFO:tasks.workunit.client.0.smithi112.stdout:1/624: dread d5/d8/dd/d97/d46/fac [0,4194304] 0 2024-09-21T00:56:57.581 INFO:tasks.workunit.client.0.smithi112.stdout:1/625: rmdir d5/d8/dd/d97/d46/d70 39 2024-09-21T00:56:57.601 INFO:tasks.workunit.client.0.smithi112.stdout:6/559: sync 2024-09-21T00:56:57.601 INFO:tasks.workunit.client.0.smithi112.stdout:5/469: sync 2024-09-21T00:56:57.601 INFO:tasks.workunit.client.0.smithi112.stdout:9/755: sync 2024-09-21T00:56:57.601 INFO:tasks.workunit.client.0.smithi112.stdout:8/679: sync 2024-09-21T00:56:57.601 INFO:tasks.workunit.client.0.smithi112.stdout:7/675: sync 2024-09-21T00:56:57.601 INFO:tasks.workunit.client.0.smithi112.stdout:3/880: sync 2024-09-21T00:56:57.603 INFO:tasks.workunit.client.0.smithi112.stdout:5/470: readlink d8/d9/d13/d2a/d2c/l33 0 2024-09-21T00:56:57.603 INFO:tasks.workunit.client.0.smithi112.stdout:8/680: chown d0/d13/d2a/d73/d96/la0 541563 1 2024-09-21T00:56:57.604 INFO:tasks.workunit.client.0.smithi112.stdout:5/471: chown d8/d9/d13 6399 1 2024-09-21T00:56:57.606 INFO:tasks.workunit.client.0.smithi112.stdout:9/756: creat d5/d6/d3f/ff9 x:0 0 0 2024-09-21T00:56:57.608 INFO:tasks.workunit.client.0.smithi112.stdout:6/560: truncate d9/df/d56/f7d 5184196 0 2024-09-21T00:56:57.615 INFO:tasks.workunit.client.0.smithi112.stdout:5/472: creat d8/d9/d13/d2a/df/f9c x:0 0 0 2024-09-21T00:56:57.616 INFO:tasks.workunit.client.0.smithi112.stdout:6/561: write d9/fc [3908148,64963] 0 2024-09-21T00:56:57.617 INFO:tasks.workunit.client.0.smithi112.stdout:9/757: fsync d5/d3b/fc8 0 2024-09-21T00:56:57.617 INFO:tasks.workunit.client.0.smithi112.stdout:7/676: dwrite d0/d2/d32/da4/db2/db4/fd4 [0,4194304] 0 2024-09-21T00:56:57.638 INFO:tasks.workunit.client.0.smithi112.stdout:8/681: dread d0/d13/d1b/f53 [0,4194304] 0 2024-09-21T00:56:57.639 INFO:tasks.workunit.client.0.smithi112.stdout:8/682: chown d0/c56 37997991 1 2024-09-21T00:56:57.649 INFO:tasks.workunit.client.0.smithi112.stdout:3/881: dwrite d2/d33/d8c/db7/f11e [0,4194304] 0 2024-09-21T00:56:57.705 INFO:tasks.workunit.client.0.smithi112.stdout:6/562: rename d9/d13 to d9/d1f/d47/d34/da6/da7/dcf 0 2024-09-21T00:56:57.707 INFO:tasks.workunit.client.0.smithi112.stdout:9/758: creat d5/d3b/d5f/d13/d54/d7d/d57/d6a/ffa x:0 0 0 2024-09-21T00:56:57.709 INFO:tasks.workunit.client.0.smithi112.stdout:9/759: write d5/d3b/d5f/db9/fe1 [767457,27928] 0 2024-09-21T00:56:57.712 INFO:tasks.workunit.client.0.smithi112.stdout:3/882: unlink d2/d8/dd/de/d4a/d4c/de2/l107 0 2024-09-21T00:56:57.717 INFO:tasks.workunit.client.0.smithi112.stdout:6/563: rename d9/df/d56/dbc/fbd to d9/d1f/d47/d34/da6/da7/dcf/d60/da4/fd0 0 2024-09-21T00:56:57.718 INFO:tasks.workunit.client.0.smithi112.stdout:8/683: symlink d0/d13/d1b/d22/d2e/d34/ld8 0 2024-09-21T00:56:57.724 INFO:tasks.workunit.client.0.smithi112.stdout:6/564: dwrite d9/d1f/d3e/d77/f1d [0,4194304] 0 2024-09-21T00:56:57.727 INFO:tasks.workunit.client.0.smithi112.stdout:9/760: mkdir d5/d3b/d5f/dfb 0 2024-09-21T00:56:57.735 INFO:tasks.workunit.client.0.smithi112.stdout:6/565: chown d9/df/c6b 63 1 2024-09-21T00:56:57.736 INFO:tasks.workunit.client.0.smithi112.stdout:9/761: mkdir d5/d6/d19/dfc 0 2024-09-21T00:56:57.736 INFO:tasks.workunit.client.0.smithi112.stdout:5/473: write d8/d9/d13/d2a/f38 [912201,63830] 0 2024-09-21T00:56:57.740 INFO:tasks.workunit.client.0.smithi112.stdout:9/762: symlink d5/d6/d70/lfd 0 2024-09-21T00:56:57.741 INFO:tasks.workunit.client.0.smithi112.stdout:7/677: write d0/d2/d36/d39/d56/d86/f85 [860131,124103] 0 2024-09-21T00:56:57.748 INFO:tasks.workunit.client.0.smithi112.stdout:3/883: write d2/d8/dd/f10 [2877081,81173] 0 2024-09-21T00:56:57.754 INFO:tasks.workunit.client.0.smithi112.stdout:6/566: dread d9/d1f/d47/d34/da6/da7/dcf/f17 [0,4194304] 0 2024-09-21T00:56:57.757 INFO:tasks.workunit.client.0.smithi112.stdout:5/474: getdents d8/d9/d13/d2a/d58 0 2024-09-21T00:56:57.758 INFO:tasks.workunit.client.0.smithi112.stdout:8/684: dwrite d0/d13/f29 [0,4194304] 0 2024-09-21T00:56:57.763 INFO:tasks.workunit.client.0.smithi112.stdout:6/567: mkdir d9/d1f/d3e/dd1 0 2024-09-21T00:56:57.764 INFO:tasks.workunit.client.0.smithi112.stdout:7/678: getdents d0/d2/d92 0 2024-09-21T00:56:57.766 INFO:tasks.workunit.client.0.smithi112.stdout:9/763: link d5/d3b/d5f/d13/d54/dc1/fdf d5/d3b/d5f/d13/d54/ffe 0 2024-09-21T00:56:57.770 INFO:tasks.workunit.client.0.smithi112.stdout:8/685: creat d0/d13/d1b/d22/d42/d51/fd9 x:0 0 0 2024-09-21T00:56:57.772 INFO:tasks.workunit.client.0.smithi112.stdout:7/679: dwrite d0/d2/d36/d39/d1a/fa2 [0,4194304] 0 2024-09-21T00:56:57.777 INFO:tasks.workunit.client.0.smithi112.stdout:6/568: truncate d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f69 161562 0 2024-09-21T00:56:57.778 INFO:tasks.workunit.client.0.smithi112.stdout:3/884: write d2/d33/d78/fc7 [1349694,112674] 0 2024-09-21T00:56:57.779 INFO:tasks.workunit.client.0.smithi112.stdout:9/764: symlink d5/d3b/d5f/d13/d56/lff 0 2024-09-21T00:56:57.780 INFO:tasks.workunit.client.0.smithi112.stdout:7/680: symlink d0/d2/d36/d39/d56/d65/d87/le0 0 2024-09-21T00:56:57.782 INFO:tasks.workunit.client.0.smithi112.stdout:6/569: creat d9/d1f/d3e/d77/d45/d62/fd2 x:0 0 0 2024-09-21T00:56:57.787 INFO:tasks.workunit.client.0.smithi112.stdout:7/681: creat d0/d2/d2e/dcf/dc3/fe1 x:0 0 0 2024-09-21T00:56:57.788 INFO:tasks.workunit.client.0.smithi112.stdout:7/682: chown d0/d2/d36/d39/d56/f77 1882745 1 2024-09-21T00:56:57.789 INFO:tasks.workunit.client.0.smithi112.stdout:6/570: stat d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/d70 0 2024-09-21T00:56:57.789 INFO:tasks.workunit.client.0.smithi112.stdout:7/683: chown d0/d2/d32/da4 177473590 1 2024-09-21T00:56:57.791 INFO:tasks.workunit.client.0.smithi112.stdout:3/885: link d2/d3e/d7b/d10d/dd7/ff2 d2/d8/d28/f12e 0 2024-09-21T00:56:57.795 INFO:tasks.workunit.client.0.smithi112.stdout:6/571: write d9/d1f/d47/d34/da6/da7/dcf/d60/da4/fd0 [990231,115267] 0 2024-09-21T00:56:57.800 INFO:tasks.workunit.client.0.smithi112.stdout:6/572: mkdir d9/d1f/d3e/d6f/dd3 0 2024-09-21T00:56:57.802 INFO:tasks.workunit.client.0.smithi112.stdout:6/573: chown d9/d1f/d47/d74 1727546 1 2024-09-21T00:56:57.806 INFO:tasks.workunit.client.0.smithi112.stdout:9/765: dwrite d5/d62/f89 [0,4194304] 0 2024-09-21T00:56:57.814 INFO:tasks.workunit.client.0.smithi112.stdout:7/684: dread d0/d2/d32/f5b [0,4194304] 0 2024-09-21T00:56:57.815 INFO:tasks.workunit.client.0.smithi112.stdout:3/886: dwrite d2/d8/dd/de/d4a/d4c/d7c/fb0 [0,4194304] 0 2024-09-21T00:56:57.820 INFO:tasks.workunit.client.0.smithi112.stdout:9/766: dwrite d5/f49 [0,4194304] 0 2024-09-21T00:56:57.822 INFO:tasks.workunit.client.0.smithi112.stdout:6/574: dwrite d9/d1f/d47/d34/da6/da7/dcf/f15 [0,4194304] 0 2024-09-21T00:56:57.824 INFO:tasks.workunit.client.0.smithi112.stdout:6/575: write d9/df/d56/f91 [4476055,19033] 0 2024-09-21T00:56:57.825 INFO:tasks.workunit.client.0.smithi112.stdout:6/576: stat d9/df/d56/f91 0 2024-09-21T00:56:57.829 INFO:tasks.workunit.client.0.smithi112.stdout:6/577: write d9/df/d7a/f55 [3415497,104418] 0 2024-09-21T00:56:57.831 INFO:tasks.workunit.client.0.smithi112.stdout:9/767: truncate d5/f4b 1558186 0 2024-09-21T00:56:57.833 INFO:tasks.workunit.client.0.smithi112.stdout:7/685: mknod d0/d2/d36/d39/d56/dc9/ce2 0 2024-09-21T00:56:57.834 INFO:tasks.workunit.client.0.smithi112.stdout:9/768: truncate d5/d3b/d79/d91/fee 574476 0 2024-09-21T00:56:57.838 INFO:tasks.workunit.client.0.smithi112.stdout:9/769: rename d5/d62/f89 to d5/f100 0 2024-09-21T00:56:57.839 INFO:tasks.workunit.client.0.smithi112.stdout:6/578: truncate d9/d1f/d47/d34/da6/da7/dcf/d21/fa0 1038612 0 2024-09-21T00:56:57.839 INFO:tasks.workunit.client.0.smithi112.stdout:9/770: stat d5/db4/ff3 0 2024-09-21T00:56:57.843 INFO:tasks.workunit.client.0.smithi112.stdout:6/579: rename d9/df/d7a to d9/d1f/d47/d74/d8b/daa/dd4 0 2024-09-21T00:56:57.847 INFO:tasks.workunit.client.0.smithi112.stdout:9/771: link d5/d3b/d5f/fcb d5/d3b/d5f/d13/d54/d7d/d57/da8/f101 0 2024-09-21T00:56:57.848 INFO:tasks.workunit.client.0.smithi112.stdout:6/580: fdatasync d9/d1f/d47/d34/da6/da7/dcf/d21/fa0 0 2024-09-21T00:56:57.850 INFO:tasks.workunit.client.0.smithi112.stdout:6/581: write d9/d1f/f81 [1284389,52012] 0 2024-09-21T00:56:57.852 INFO:tasks.workunit.client.0.smithi112.stdout:6/582: write d9/d1f/d3e/d77/d45/d62/fd2 [83851,24405] 0 2024-09-21T00:56:57.854 INFO:tasks.workunit.client.0.smithi112.stdout:9/772: symlink d5/d3b/d5f/d13/d54/d7d/d57/l102 0 2024-09-21T00:56:57.854 INFO:tasks.workunit.client.0.smithi112.stdout:6/583: write d9/d1f/d3e/d77/f1d [665958,123286] 0 2024-09-21T00:56:57.856 INFO:tasks.workunit.client.0.smithi112.stdout:7/686: dread d0/d2/d36/d39/db3/fd7 [0,4194304] 0 2024-09-21T00:56:57.857 INFO:tasks.workunit.client.0.smithi112.stdout:3/887: dread d2/d8/d28/dac/fdb [0,4194304] 0 2024-09-21T00:56:57.873 INFO:tasks.workunit.client.0.smithi112.stdout:2/594: sync 2024-09-21T00:56:57.875 INFO:tasks.workunit.client.0.smithi112.stdout:9/773: mkdir d5/d3b/d79/d103 0 2024-09-21T00:56:57.876 INFO:tasks.workunit.client.0.smithi112.stdout:6/584: creat d9/d1f/d47/d74/d8b/fd5 x:0 0 0 2024-09-21T00:56:57.890 INFO:tasks.workunit.client.0.smithi112.stdout:2/595: readlink d0/df/d46/d58/l9d 0 2024-09-21T00:56:57.891 INFO:tasks.workunit.client.0.smithi112.stdout:9/774: fdatasync d5/d3b/d5f/d13/d6e/da0/da4/fcf 0 2024-09-21T00:56:57.894 INFO:tasks.workunit.client.0.smithi112.stdout:6/585: mknod d9/df/d56/d33/cd6 0 2024-09-21T00:56:57.899 INFO:tasks.workunit.client.0.smithi112.stdout:9/775: dwrite d5/d3b/d5f/d13/d54/d7d/d57/d6a/f93 [0,4194304] 0 2024-09-21T00:56:57.901 INFO:tasks.workunit.client.0.smithi112.stdout:9/776: chown d5/db4/dd1 0 1 2024-09-21T00:56:57.902 INFO:tasks.workunit.client.0.smithi112.stdout:2/596: dread d0/d60/d78/f7f [0,4194304] 0 2024-09-21T00:56:57.903 INFO:tasks.workunit.client.0.smithi112.stdout:9/777: write d5/d3b/d5f/d13/f5d [2043916,43759] 0 2024-09-21T00:56:57.907 INFO:tasks.workunit.client.0.smithi112.stdout:6/586: mknod d9/cd7 0 2024-09-21T00:56:57.907 INFO:tasks.workunit.client.0.smithi112.stdout:7/687: getdents d0/d2/d38/d48/dad 0 2024-09-21T00:56:57.909 INFO:tasks.workunit.client.0.smithi112.stdout:3/888: dwrite d2/d33/d78/f7f [0,4194304] 0 2024-09-21T00:56:57.910 INFO:tasks.workunit.client.0.smithi112.stdout:2/597: unlink d0/d14/d8/d27/c8e 0 2024-09-21T00:56:57.911 INFO:tasks.workunit.client.0.smithi112.stdout:2/598: write d0/d14/f5d [627437,70001] 0 2024-09-21T00:56:57.912 INFO:tasks.workunit.client.0.smithi112.stdout:9/778: stat d5/d3b/d5f/c5c 0 2024-09-21T00:56:57.913 INFO:tasks.workunit.client.0.smithi112.stdout:9/779: stat d5/d3b/d5f/c5c 0 2024-09-21T00:56:57.914 INFO:tasks.workunit.client.0.smithi112.stdout:2/599: write d0/d14/f12 [3524749,80195] 0 2024-09-21T00:56:57.915 INFO:tasks.workunit.client.0.smithi112.stdout:7/688: creat d0/d2/d32/da4/db2/db4/dba/fe3 x:0 0 0 2024-09-21T00:56:57.918 INFO:tasks.workunit.client.0.smithi112.stdout:9/780: fdatasync d5/d3b/d5f/d13/f45 0 2024-09-21T00:56:57.919 INFO:tasks.workunit.client.0.smithi112.stdout:9/781: fdatasync d5/d3b/d5f/d13/d54/d7d/d57/d6a/fe7 0 2024-09-21T00:56:57.921 INFO:tasks.workunit.client.0.smithi112.stdout:3/889: dread d2/d8/dd/f27 [0,4194304] 0 2024-09-21T00:56:57.922 INFO:tasks.workunit.client.0.smithi112.stdout:2/600: dread d0/d14/d8/fa1 [0,4194304] 0 2024-09-21T00:56:57.923 INFO:tasks.workunit.client.0.smithi112.stdout:3/890: truncate d2/d3e/f108 214094 0 2024-09-21T00:56:57.925 INFO:tasks.workunit.client.0.smithi112.stdout:9/782: creat d5/d3b/d5f/dfb/f104 x:0 0 0 2024-09-21T00:56:57.928 INFO:tasks.workunit.client.0.smithi112.stdout:3/891: mknod d2/d8/d28/d35/d9e/c12f 0 2024-09-21T00:56:57.929 INFO:tasks.workunit.client.0.smithi112.stdout:2/601: mkdir d0/d14/dbe 0 2024-09-21T00:56:57.932 INFO:tasks.workunit.client.0.smithi112.stdout:9/783: dwrite d5/d6/d19/d51/d8f/ff5 [0,4194304] 0 2024-09-21T00:56:57.940 INFO:tasks.workunit.client.0.smithi112.stdout:9/784: dwrite d5/d3b/d5f/d13/ff1 [0,4194304] 0 2024-09-21T00:56:57.942 INFO:tasks.workunit.client.0.smithi112.stdout:9/785: stat d5/d3b/d5f/d13/d54/dc1/fdf 0 2024-09-21T00:56:57.947 INFO:tasks.workunit.client.0.smithi112.stdout:9/786: mkdir d5/d3b/d79/d103/d105 0 2024-09-21T00:56:57.948 INFO:tasks.workunit.client.0.smithi112.stdout:9/787: dread - d5/d6/d3f/ff9 zero size 2024-09-21T00:56:57.952 INFO:tasks.workunit.client.0.smithi112.stdout:9/788: rename d5/d3b/d5f/d13/d54/d7d/d57/f8b to d5/f106 0 2024-09-21T00:56:57.956 INFO:tasks.workunit.client.0.smithi112.stdout:9/789: getdents d5/d3b 0 2024-09-21T00:56:57.961 INFO:tasks.workunit.client.0.smithi112.stdout:7/689: dwrite d0/d2/d32/fb7 [0,4194304] 0 2024-09-21T00:56:57.963 INFO:tasks.workunit.client.0.smithi112.stdout:3/892: write d2/d33/d8c/f76 [727868,60536] 0 2024-09-21T00:56:57.967 INFO:tasks.workunit.client.0.smithi112.stdout:3/893: rmdir d2/d38 39 2024-09-21T00:56:57.968 INFO:tasks.workunit.client.0.smithi112.stdout:7/690: truncate d0/d2/d38/f43 1597327 0 2024-09-21T00:56:57.970 INFO:tasks.workunit.client.0.smithi112.stdout:3/894: stat d2/d38/d3f/c52 0 2024-09-21T00:56:57.971 INFO:tasks.workunit.client.0.smithi112.stdout:7/691: chown d0/d2/d2e/l59 50 1 2024-09-21T00:56:57.974 INFO:tasks.workunit.client.0.smithi112.stdout:9/790: dread d5/f16 [4194304,4194304] 0 2024-09-21T00:56:57.976 INFO:tasks.workunit.client.0.smithi112.stdout:9/791: readlink d5/d3b/d5f/ld2 0 2024-09-21T00:56:57.980 INFO:tasks.workunit.client.0.smithi112.stdout:3/895: dwrite d2/d38/d3f/d53/d96/dc9/d11c/f10f [4194304,4194304] 0 2024-09-21T00:56:57.980 INFO:tasks.workunit.client.0.smithi112.stdout:9/792: creat d5/db4/dd1/f107 x:0 0 0 2024-09-21T00:56:57.987 INFO:tasks.workunit.client.0.smithi112.stdout:9/793: mknod d5/d3b/d5f/d13/d54/d7d/d57/da8/c108 0 2024-09-21T00:56:57.990 INFO:tasks.workunit.client.0.smithi112.stdout:7/692: dread d0/d2/d36/d39/d56/d65/d75/f84 [0,4194304] 0 2024-09-21T00:56:57.993 INFO:tasks.workunit.client.0.smithi112.stdout:3/896: dwrite d2/d8/dd/de/d4a/d4c/fa0 [0,4194304] 0 2024-09-21T00:56:58.000 INFO:tasks.workunit.client.0.smithi112.stdout:7/693: mkdir d0/d2/d36/de4 0 2024-09-21T00:56:58.000 INFO:tasks.workunit.client.0.smithi112.stdout:3/897: mknod d2/d3e/d7b/d10d/dd7/def/c130 0 2024-09-21T00:56:58.009 INFO:tasks.workunit.client.0.smithi112.stdout:3/898: rmdir d2/d3e/d7b 39 2024-09-21T00:56:58.016 INFO:tasks.workunit.client.0.smithi112.stdout:3/899: creat d2/d8/d28/dac/f131 x:0 0 0 2024-09-21T00:56:58.027 INFO:tasks.workunit.client.0.smithi112.stdout:9/794: write d5/d3b/d5f/d13/d54/d7d/d57/d6a/f6b [4144421,108362] 0 2024-09-21T00:56:58.030 INFO:tasks.workunit.client.0.smithi112.stdout:9/795: read d5/d6/d19/f28 [950501,25955] 0 2024-09-21T00:56:58.031 INFO:tasks.workunit.client.0.smithi112.stdout:7/694: dread d0/fa [0,4194304] 0 2024-09-21T00:56:58.031 INFO:tasks.workunit.client.0.smithi112.stdout:9/796: write d5/db4/ff3 [789479,102795] 0 2024-09-21T00:56:58.038 INFO:tasks.workunit.client.0.smithi112.stdout:9/797: rename d5/d3b/fa3 to d5/d3b/d5f/d13/d6e/da0/de6/f109 0 2024-09-21T00:56:58.049 INFO:tasks.workunit.client.0.smithi112.stdout:7/695: truncate d0/f22 1044667 0 2024-09-21T00:56:58.052 INFO:tasks.workunit.client.0.smithi112.stdout:7/696: creat d0/d2/d38/fe5 x:0 0 0 2024-09-21T00:56:58.060 INFO:tasks.workunit.client.0.smithi112.stdout:7/697: dwrite d0/d2/d38/d48/fc5 [0,4194304] 0 2024-09-21T00:56:58.063 INFO:tasks.workunit.client.0.smithi112.stdout:7/698: dread d0/d2/d36/d39/db3/fd7 [0,4194304] 0 2024-09-21T00:56:58.064 INFO:tasks.workunit.client.0.smithi112.stdout:7/699: dread - d0/d2/d38/fe5 zero size 2024-09-21T00:56:58.066 INFO:tasks.workunit.client.0.smithi112.stdout:7/700: dread - d0/d2/d36/d39/d56/d65/f71 zero size 2024-09-21T00:56:58.067 INFO:tasks.workunit.client.0.smithi112.stdout:7/701: chown d0/f3b 336899307 1 2024-09-21T00:56:58.070 INFO:tasks.workunit.client.0.smithi112.stdout:7/702: symlink d0/d2/d36/d39/db3/le6 0 2024-09-21T00:56:58.089 INFO:tasks.workunit.client.0.smithi112.stdout:7/703: dread d0/d2/f68 [0,4194304] 0 2024-09-21T00:56:58.091 INFO:tasks.workunit.client.0.smithi112.stdout:7/704: mknod d0/d2/ce7 0 2024-09-21T00:56:58.093 INFO:tasks.workunit.client.0.smithi112.stdout:7/705: mkdir d0/d2/d36/d39/d56/d65/d75/de8 0 2024-09-21T00:56:58.105 INFO:tasks.workunit.client.0.smithi112.stdout:7/706: dwrite d0/f22 [0,4194304] 0 2024-09-21T00:56:58.106 INFO:tasks.workunit.client.0.smithi112.stdout:7/707: chown d0/f22 30243052 1 2024-09-21T00:56:58.173 INFO:tasks.workunit.client.0.smithi112.stdout:4/651: sync 2024-09-21T00:56:58.203 INFO:tasks.workunit.client.0.smithi112.stdout:4/652: write d1/d5/d1c/d1e/d4a/f7d [1541575,34485] 0 2024-09-21T00:56:58.205 INFO:tasks.workunit.client.0.smithi112.stdout:7/708: dread d0/d2/d32/da4/db2/db4/fd4 [0,4194304] 0 2024-09-21T00:56:58.206 INFO:tasks.workunit.client.0.smithi112.stdout:7/709: readlink d0/d2/d36/d39/db3/ldc 0 2024-09-21T00:56:58.210 INFO:tasks.workunit.client.0.smithi112.stdout:7/710: symlink d0/d2/d36/le9 0 2024-09-21T00:56:58.212 INFO:tasks.workunit.client.0.smithi112.stdout:4/653: mkdir d1/ddf 0 2024-09-21T00:56:58.213 INFO:tasks.workunit.client.0.smithi112.stdout:7/711: mkdir d0/d2/d38/d48/dad/dea 0 2024-09-21T00:56:58.214 INFO:tasks.workunit.client.0.smithi112.stdout:4/654: readlink d1/la 0 2024-09-21T00:56:58.223 INFO:tasks.workunit.client.0.smithi112.stdout:4/655: creat d1/d2d/d34/dd3/fe0 x:0 0 0 2024-09-21T00:56:58.223 INFO:tasks.workunit.client.0.smithi112.stdout:4/656: stat d1/d5/l18 0 2024-09-21T00:56:58.225 INFO:tasks.workunit.client.0.smithi112.stdout:4/657: symlink d1/d7/d9/d1a/d8e/le1 0 2024-09-21T00:56:58.227 INFO:tasks.workunit.client.0.smithi112.stdout:4/658: rmdir d1/d5/d1c/d1e/d4a/d5f 39 2024-09-21T00:56:58.228 INFO:tasks.workunit.client.0.smithi112.stdout:4/659: rmdir d1/d5/d1c/db3 39 2024-09-21T00:56:58.229 INFO:tasks.workunit.client.0.smithi112.stdout:4/660: write d1/d2d/d34/f58 [1380880,56739] 0 2024-09-21T00:56:58.231 INFO:tasks.workunit.client.0.smithi112.stdout:4/661: write d1/fa6 [147494,42629] 0 2024-09-21T00:56:58.235 INFO:tasks.workunit.client.0.smithi112.stdout:4/662: truncate d1/d5/d1c/d1e/d3d/fd5 369185 0 2024-09-21T00:56:58.239 INFO:tasks.workunit.client.0.smithi112.stdout:4/663: mkdir d1/d5/d1c/d1e/d4a/d5f/db1/de2 0 2024-09-21T00:56:58.247 INFO:tasks.workunit.client.0.smithi112.stdout:4/664: dwrite d1/d5/d1c/d1e/d3d/db9/fd0 [0,4194304] 0 2024-09-21T00:56:58.718 INFO:tasks.workunit.client.0.smithi112.stdout:0/525: sync 2024-09-21T00:56:58.822 INFO:tasks.workunit.client.0.smithi112.stdout:0/526: dwrite d8/d11/d28/f43 [0,4194304] 0 2024-09-21T00:56:58.826 INFO:tasks.workunit.client.0.smithi112.stdout:0/527: mkdir d8/d5f/da7 0 2024-09-21T00:56:58.827 INFO:tasks.workunit.client.0.smithi112.stdout:0/528: mkdir d8/d1b/d2c/d2e/d4c/da8 0 2024-09-21T00:56:58.833 INFO:tasks.workunit.client.0.smithi112.stdout:0/529: rename d8/d11/f22 to d8/d62/fa9 0 2024-09-21T00:56:58.833 INFO:tasks.workunit.client.0.smithi112.stdout:0/530: chown d8/d75/f79 7153 1 2024-09-21T00:56:58.835 INFO:tasks.workunit.client.0.smithi112.stdout:0/531: readlink d8/d1b/l66 0 2024-09-21T00:56:58.837 INFO:tasks.workunit.client.0.smithi112.stdout:0/532: unlink d8/d11/f13 0 2024-09-21T00:56:58.853 INFO:tasks.workunit.client.0.smithi112.stdout:0/533: dread d8/d11/d28/f68 [0,4194304] 0 2024-09-21T00:56:58.861 INFO:tasks.workunit.client.0.smithi112.stdout:0/534: dwrite d8/d1b/f44 [4194304,4194304] 0 2024-09-21T00:56:58.867 INFO:tasks.workunit.client.0.smithi112.stdout:0/535: truncate d8/d11/f1e 1342392 0 2024-09-21T00:56:58.869 INFO:tasks.workunit.client.0.smithi112.stdout:0/536: symlink d8/d1b/d2c/d2e/laa 0 2024-09-21T00:56:58.872 INFO:tasks.workunit.client.0.smithi112.stdout:0/537: dread d8/d11/f1a [0,4194304] 0 2024-09-21T00:56:58.873 INFO:tasks.workunit.client.0.smithi112.stdout:0/538: chown d8/d1b/d2c/d2e/d4c/d64 0 1 2024-09-21T00:56:58.994 INFO:tasks.workunit.client.0.smithi112.stdout:6/587: sync 2024-09-21T00:56:58.994 INFO:tasks.workunit.client.0.smithi112.stdout:3/900: sync 2024-09-21T00:56:58.994 INFO:tasks.workunit.client.0.smithi112.stdout:1/626: sync 2024-09-21T00:56:58.994 INFO:tasks.workunit.client.0.smithi112.stdout:8/686: sync 2024-09-21T00:56:58.994 INFO:tasks.workunit.client.0.smithi112.stdout:2/602: sync 2024-09-21T00:56:58.994 INFO:tasks.workunit.client.0.smithi112.stdout:5/475: sync 2024-09-21T00:56:58.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/627: chown d5/d3a 5050314 1 2024-09-21T00:56:58.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/588: dread - d9/df/f6c zero size 2024-09-21T00:56:58.996 INFO:tasks.workunit.client.0.smithi112.stdout:8/687: stat d0/d13/d1b/d22/d2e/fa1 0 2024-09-21T00:56:58.997 INFO:tasks.workunit.client.0.smithi112.stdout:5/476: dread - d8/d9/d13/d2a/df/f97 zero size 2024-09-21T00:56:58.997 INFO:tasks.workunit.client.0.smithi112.stdout:3/901: chown d2/d8/dd/de/d4a/c6f 854243 1 2024-09-21T00:56:58.999 INFO:tasks.workunit.client.0.smithi112.stdout:6/589: write d9/d1f/d47/d34/da6/da7/f75 [260191,47220] 0 2024-09-21T00:56:58.999 INFO:tasks.workunit.client.0.smithi112.stdout:3/902: write d2/d33/d8c/f76 [1075918,73738] 0 2024-09-21T00:56:59.002 INFO:tasks.workunit.client.0.smithi112.stdout:1/628: rename d5/d8/d10/d2e to d5/d8/dd/dcc 0 2024-09-21T00:56:59.004 INFO:tasks.workunit.client.0.smithi112.stdout:2/603: link d0/d14/f37 d0/d14/dbe/fbf 0 2024-09-21T00:56:59.007 INFO:tasks.workunit.client.0.smithi112.stdout:1/629: mknod d5/d8/dd/d54/d5a/ccd 0 2024-09-21T00:56:59.015 INFO:tasks.workunit.client.0.smithi112.stdout:2/604: creat d0/d14/dbe/fc0 x:0 0 0 2024-09-21T00:56:59.017 INFO:tasks.workunit.client.0.smithi112.stdout:5/477: truncate d8/d9/d13/d1c/f22 1716865 0 2024-09-21T00:56:59.020 INFO:tasks.workunit.client.0.smithi112.stdout:6/590: dread d9/d1f/d47/d34/da6/da7/f48 [0,4194304] 0 2024-09-21T00:56:59.021 INFO:tasks.workunit.client.0.smithi112.stdout:3/903: dread d2/d8/d28/d35/fcc [0,4194304] 0 2024-09-21T00:56:59.023 INFO:tasks.workunit.client.0.smithi112.stdout:1/630: link d5/d34/d6a/d7f/l85 d5/d3a/d4b/lce 0 2024-09-21T00:56:59.024 INFO:tasks.workunit.client.0.smithi112.stdout:2/605: mkdir d0/d14/d8/da2/dba/dc1 0 2024-09-21T00:56:59.028 INFO:tasks.workunit.client.0.smithi112.stdout:6/591: creat d9/d1f/d47/d74/fd8 x:0 0 0 2024-09-21T00:56:59.030 INFO:tasks.workunit.client.0.smithi112.stdout:8/688: dread d0/d13/d2a/f5e [0,4194304] 0 2024-09-21T00:56:59.032 INFO:tasks.workunit.client.0.smithi112.stdout:3/904: rename d2/d8/dd/de/d4a/d4c/d7c/fe7 to d2/d33/d8c/db7/d11b/f132 0 2024-09-21T00:56:59.032 INFO:tasks.workunit.client.0.smithi112.stdout:1/631: dwrite d5/d8/d13/d87/faa [0,4194304] 0 2024-09-21T00:56:59.034 INFO:tasks.workunit.client.0.smithi112.stdout:2/606: dwrite d0/f3c [4194304,4194304] 0 2024-09-21T00:56:59.035 INFO:tasks.workunit.client.0.smithi112.stdout:5/478: rmdir d8/d9/d13/d2a/d85 0 2024-09-21T00:56:59.043 INFO:tasks.workunit.client.0.smithi112.stdout:6/592: dwrite d9/d1f/d47/d34/da6/da7/dcf/d21/fc1 [0,4194304] 0 2024-09-21T00:56:59.057 INFO:tasks.workunit.client.0.smithi112.stdout:2/607: rename d0/d45/d8a/d62/l6b to d0/d45/d8a/d83/lc2 0 2024-09-21T00:56:59.059 INFO:tasks.workunit.client.0.smithi112.stdout:1/632: rmdir d5/d8/dd/d97/dc6 0 2024-09-21T00:56:59.060 INFO:tasks.workunit.client.0.smithi112.stdout:5/479: creat d8/f9d x:0 0 0 2024-09-21T00:56:59.060 INFO:tasks.workunit.client.0.smithi112.stdout:8/689: dread d0/d13/d1b/d22/d42/d51/f9e [0,4194304] 0 2024-09-21T00:56:59.060 INFO:tasks.workunit.client.0.smithi112.stdout:5/480: chown d8/d9/d13 969658 1 2024-09-21T00:56:59.061 INFO:tasks.workunit.client.0.smithi112.stdout:6/593: rename d9/df/d56/d33 to d9/d1f/d47/d34/da6/da7/dcf/d26/dd9 0 2024-09-21T00:56:59.063 INFO:tasks.workunit.client.0.smithi112.stdout:2/608: creat d0/d14/d8/da2/fc3 x:0 0 0 2024-09-21T00:56:59.063 INFO:tasks.workunit.client.0.smithi112.stdout:1/633: creat d5/d8/d13/d87/fcf x:0 0 0 2024-09-21T00:56:59.067 INFO:tasks.workunit.client.0.smithi112.stdout:8/690: unlink d0/d13/f89 0 2024-09-21T00:56:59.068 INFO:tasks.workunit.client.0.smithi112.stdout:3/905: truncate d2/d8/d6d/fa2 1006612 0 2024-09-21T00:56:59.069 INFO:tasks.workunit.client.0.smithi112.stdout:6/594: dwrite d9/d1f/d47/d74/d8b/fd5 [0,4194304] 0 2024-09-21T00:56:59.069 INFO:tasks.workunit.client.0.smithi112.stdout:8/691: readlink d0/d13/d1b/d22/d2e/d34/ld8 0 2024-09-21T00:56:59.070 INFO:tasks.workunit.client.0.smithi112.stdout:5/481: rename d8/d9/d13/d2a/df/c7a to d8/d9/d13/d2a/c9e 0 2024-09-21T00:56:59.070 INFO:tasks.workunit.client.0.smithi112.stdout:3/906: fdatasync d2/d33/d8c/f76 0 2024-09-21T00:56:59.072 INFO:tasks.workunit.client.0.smithi112.stdout:2/609: chown d0/d14/d8/d27/l28 47687 1 2024-09-21T00:56:59.074 INFO:tasks.workunit.client.0.smithi112.stdout:3/907: write d2/d8/dd/de/fda [945901,24023] 0 2024-09-21T00:56:59.081 INFO:tasks.workunit.client.0.smithi112.stdout:8/692: dwrite d0/d13/d9f/fca [0,4194304] 0 2024-09-21T00:56:59.081 INFO:tasks.workunit.client.0.smithi112.stdout:6/595: unlink d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/d70/l7f 0 2024-09-21T00:56:59.085 INFO:tasks.workunit.client.0.smithi112.stdout:3/908: mkdir d2/d33/dea/d133 0 2024-09-21T00:56:59.086 INFO:tasks.workunit.client.0.smithi112.stdout:3/909: chown d2/d33/ffe 17783 1 2024-09-21T00:56:59.086 INFO:tasks.workunit.client.0.smithi112.stdout:3/910: stat d2/c40 0 2024-09-21T00:56:59.089 INFO:tasks.workunit.client.0.smithi112.stdout:2/610: truncate d0/d14/d8/d27/f64 873176 0 2024-09-21T00:56:59.143 INFO:tasks.workunit.client.0.smithi112.stdout:6/596: truncate d9/d1f/d47/d34/da6/da7/dcf/d26/f3d 157885 0 2024-09-21T00:56:59.143 INFO:tasks.workunit.client.0.smithi112.stdout:1/634: fsync d5/d34/d6a/fba 0 2024-09-21T00:56:59.145 INFO:tasks.workunit.client.0.smithi112.stdout:3/911: mkdir d2/d8/d6d/d10e/d134 0 2024-09-21T00:56:59.149 INFO:tasks.workunit.client.0.smithi112.stdout:3/912: write d2/d8/dd/de/d4a/d4c/de2/f123 [269955,27628] 0 2024-09-21T00:56:59.149 INFO:tasks.workunit.client.0.smithi112.stdout:1/635: fdatasync d5/d8/f3d 0 2024-09-21T00:56:59.150 INFO:tasks.workunit.client.0.smithi112.stdout:5/482: dwrite d8/d9/d13/d2a/d2c/f2f [0,4194304] 0 2024-09-21T00:56:59.151 INFO:tasks.workunit.client.0.smithi112.stdout:3/913: chown d2/d8/d28/d9d/fc0 325421 1 2024-09-21T00:56:59.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:56:58 smithi187 ceph-mon[34997]: pgmap v32: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 71 MiB/s rd, 192 MiB/s wr, 388 op/s 2024-09-21T00:56:59.165 INFO:tasks.workunit.client.0.smithi112.stdout:1/636: dwrite d5/d8/d14/f3b [0,4194304] 0 2024-09-21T00:56:59.166 INFO:tasks.workunit.client.0.smithi112.stdout:5/483: truncate d8/d9/f60 544695 0 2024-09-21T00:56:59.167 INFO:tasks.workunit.client.0.smithi112.stdout:6/597: write d9/d1f/d3e/d77/f2a [1171784,5631] 0 2024-09-21T00:56:59.170 INFO:tasks.workunit.client.0.smithi112.stdout:2/611: dwrite d0/d14/f37 [0,4194304] 0 2024-09-21T00:56:59.170 INFO:tasks.workunit.client.0.smithi112.stdout:5/484: write d8/d9/d13/d2a/d84/d8b/f82 [586486,125200] 0 2024-09-21T00:56:59.174 INFO:tasks.workunit.client.0.smithi112.stdout:3/914: link d2/d33/d78/l112 d2/d38/d3f/d53/d96/dcf/l135 0 2024-09-21T00:56:59.177 INFO:tasks.workunit.client.0.smithi112.stdout:2/612: unlink d0/df/f1b 0 2024-09-21T00:56:59.182 INFO:tasks.workunit.client.0.smithi112.stdout:1/637: symlink d5/d8/dd/d97/d46/d70/ld0 0 2024-09-21T00:56:59.185 INFO:tasks.workunit.client.0.smithi112.stdout:1/638: write d5/d8/da1/fbe [2221108,119687] 0 2024-09-21T00:56:59.185 INFO:tasks.workunit.client.0.smithi112.stdout:6/598: creat d9/df/fda x:0 0 0 2024-09-21T00:56:59.187 INFO:tasks.workunit.client.0.smithi112.stdout:1/639: dread d5/d8/da1/fbd [0,4194304] 0 2024-09-21T00:56:59.188 INFO:tasks.workunit.client.0.smithi112.stdout:1/640: fsync d5/d8/d10/fc2 0 2024-09-21T00:56:59.190 INFO:tasks.workunit.client.0.smithi112.stdout:1/641: unlink d5/d8/dd/dcc/ca0 0 2024-09-21T00:56:59.193 INFO:tasks.workunit.client.0.smithi112.stdout:5/485: write d8/d9/f28 [2161270,60605] 0 2024-09-21T00:56:59.193 INFO:tasks.workunit.client.0.smithi112.stdout:1/642: creat d5/d3a/d4b/fd1 x:0 0 0 2024-09-21T00:56:59.194 INFO:tasks.workunit.client.0.smithi112.stdout:1/643: read - d5/d8/f83 zero size 2024-09-21T00:56:59.196 INFO:tasks.workunit.client.0.smithi112.stdout:1/644: read - d5/d34/fc1 zero size 2024-09-21T00:56:59.197 INFO:tasks.workunit.client.0.smithi112.stdout:6/599: link d9/d1f/d3e/d6f/c8d d9/df/d56/dbc/cdb 0 2024-09-21T00:56:59.205 INFO:tasks.workunit.client.0.smithi112.stdout:5/486: dwrite d8/d9/d13/d1c/f91 [0,4194304] 0 2024-09-21T00:56:59.206 INFO:tasks.workunit.client.0.smithi112.stdout:2/613: dwrite d0/f67 [0,4194304] 0 2024-09-21T00:56:59.209 INFO:tasks.workunit.client.0.smithi112.stdout:1/645: dwrite d5/d8/dd/d97/fab [0,4194304] 0 2024-09-21T00:56:59.213 INFO:tasks.workunit.client.0.smithi112.stdout:2/614: readlink d0/d60/d78/l81 0 2024-09-21T00:56:59.217 INFO:tasks.workunit.client.0.smithi112.stdout:2/615: rmdir d0/df/d46/d97 39 2024-09-21T00:56:59.220 INFO:tasks.workunit.client.0.smithi112.stdout:5/487: mkdir d8/d9/d13/d2a/d2c/d96/d9f 0 2024-09-21T00:56:59.222 INFO:tasks.workunit.client.0.smithi112.stdout:1/646: mkdir d5/d8/dd/d97/dd2 0 2024-09-21T00:56:59.227 INFO:tasks.workunit.client.0.smithi112.stdout:6/600: dwrite d9/d1f/d3e/d77/d46/f93 [4194304,4194304] 0 2024-09-21T00:56:59.229 INFO:tasks.workunit.client.0.smithi112.stdout:1/647: mknod d5/d34/d6a/cd3 0 2024-09-21T00:56:59.231 INFO:tasks.workunit.client.0.smithi112.stdout:5/488: dwrite d8/d9/d13/d1c/f91 [0,4194304] 0 2024-09-21T00:56:59.231 INFO:tasks.workunit.client.0.smithi112.stdout:2/616: mknod d0/df/d46/cc4 0 2024-09-21T00:56:59.233 INFO:tasks.workunit.client.0.smithi112.stdout:5/489: chown d8/d9/d13/f39 5683 1 2024-09-21T00:56:59.233 INFO:tasks.workunit.client.0.smithi112.stdout:2/617: chown d0/d45/f4a 2731660 1 2024-09-21T00:56:59.236 INFO:tasks.workunit.client.0.smithi112.stdout:6/601: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/ddc 0 2024-09-21T00:56:59.236 INFO:tasks.workunit.client.0.smithi112.stdout:1/648: chown d5/d3a/d4b/lce 1863891 1 2024-09-21T00:56:59.239 INFO:tasks.workunit.client.0.smithi112.stdout:1/649: readlink d5/l8b 0 2024-09-21T00:56:59.243 INFO:tasks.workunit.client.0.smithi112.stdout:5/490: dwrite d8/d9/d13/d2a/d58/f5e [0,4194304] 0 2024-09-21T00:56:59.245 INFO:tasks.workunit.client.0.smithi112.stdout:1/650: mknod d5/d8/d13/cd4 0 2024-09-21T00:56:59.246 INFO:tasks.workunit.client.0.smithi112.stdout:7/712: sync 2024-09-21T00:56:59.248 INFO:tasks.workunit.client.0.smithi112.stdout:5/491: fsync d8/d9/f25 0 2024-09-21T00:56:59.249 INFO:tasks.workunit.client.0.smithi112.stdout:5/492: readlink d8/d9/d13/l34 0 2024-09-21T00:56:59.249 INFO:tasks.workunit.client.0.smithi112.stdout:9/798: sync 2024-09-21T00:56:59.256 INFO:tasks.workunit.client.0.smithi112.stdout:5/493: mknod d8/d9/d13/d2a/d2c/ca0 0 2024-09-21T00:56:59.258 INFO:tasks.workunit.client.0.smithi112.stdout:9/799: creat d5/d6/d3f/f10a x:0 0 0 2024-09-21T00:56:59.258 INFO:tasks.workunit.client.0.smithi112.stdout:7/713: dwrite d0/d2/d36/d39/d56/d65/d87/fbd [0,4194304] 0 2024-09-21T00:56:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:56:58 smithi112 ceph-mon[28078]: pgmap v32: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 71 MiB/s rd, 192 MiB/s wr, 388 op/s 2024-09-21T00:56:59.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/494: dread d8/d9/d13/d2a/d58/f5e [0,4194304] 0 2024-09-21T00:56:59.269 INFO:tasks.workunit.client.0.smithi112.stdout:7/714: rename d0/d6e/f81 to d0/d2/d36/d39/d56/d65/d75/d9a/feb 0 2024-09-21T00:56:59.269 INFO:tasks.workunit.client.0.smithi112.stdout:9/800: dwrite d5/d6/f76 [0,4194304] 0 2024-09-21T00:56:59.271 INFO:tasks.workunit.client.0.smithi112.stdout:7/715: chown d0/d2/d32 1167 1 2024-09-21T00:56:59.272 INFO:tasks.workunit.client.0.smithi112.stdout:2/618: dread d0/d45/d8a/d62/f65 [0,4194304] 0 2024-09-21T00:56:59.274 INFO:tasks.workunit.client.0.smithi112.stdout:6/602: dwrite d9/d1f/d3e/d77/d45/f80 [0,4194304] 0 2024-09-21T00:56:59.282 INFO:tasks.workunit.client.0.smithi112.stdout:5/495: dwrite d8/d9/d13/f39 [0,4194304] 0 2024-09-21T00:56:59.282 INFO:tasks.workunit.client.0.smithi112.stdout:2/619: truncate d0/d14/d8/d27/d7a/f93 449131 0 2024-09-21T00:56:59.283 INFO:tasks.workunit.client.0.smithi112.stdout:5/496: chown d8/d9/l77 0 1 2024-09-21T00:56:59.285 INFO:tasks.workunit.client.0.smithi112.stdout:2/620: chown d0/d14/d47/d70/c72 109420 1 2024-09-21T00:56:59.289 INFO:tasks.workunit.client.0.smithi112.stdout:6/603: mkdir d9/d1f/d3e/d77/d46/d8c/ddd 0 2024-09-21T00:56:59.291 INFO:tasks.workunit.client.0.smithi112.stdout:7/716: dread d0/d2/d2e/f5f [0,4194304] 0 2024-09-21T00:56:59.293 INFO:tasks.workunit.client.0.smithi112.stdout:5/497: truncate d8/d9/f60 503813 0 2024-09-21T00:56:59.296 INFO:tasks.workunit.client.0.smithi112.stdout:9/801: dread d5/d3b/d5f/d13/d6e/da0/da4/fcf [0,4194304] 0 2024-09-21T00:56:59.296 INFO:tasks.workunit.client.0.smithi112.stdout:6/604: mkdir d9/df/d56/dde 0 2024-09-21T00:56:59.296 INFO:tasks.workunit.client.0.smithi112.stdout:7/717: read d0/d2/d2e/f58 [870569,35459] 0 2024-09-21T00:56:59.298 INFO:tasks.workunit.client.0.smithi112.stdout:5/498: rmdir d8/d9/d13/d2a/df/d5b/d75 39 2024-09-21T00:56:59.298 INFO:tasks.workunit.client.0.smithi112.stdout:7/718: fdatasync d0/d2/d32/da4/db2/db4/dba/fe3 0 2024-09-21T00:56:59.299 INFO:tasks.workunit.client.0.smithi112.stdout:9/802: rmdir d5/d3b/d5f/d13/d54 39 2024-09-21T00:56:59.305 INFO:tasks.workunit.client.0.smithi112.stdout:6/605: dwrite d9/d1f/d47/d74/d8b/daa/dd4/f55 [0,4194304] 0 2024-09-21T00:56:59.305 INFO:tasks.workunit.client.0.smithi112.stdout:9/803: dread d5/f16 [8388608,4194304] 0 2024-09-21T00:56:59.306 INFO:tasks.workunit.client.0.smithi112.stdout:5/499: mkdir d8/d9/d13/d2a/da1 0 2024-09-21T00:56:59.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/606: creat d9/d1f/d3e/d77/d45/d62/fdf x:0 0 0 2024-09-21T00:56:59.312 INFO:tasks.workunit.client.0.smithi112.stdout:2/621: dread d0/d14/d8/d27/d7a/f93 [0,4194304] 0 2024-09-21T00:56:59.314 INFO:tasks.workunit.client.0.smithi112.stdout:9/804: mknod d5/d3b/d5f/d13/d54/d7d/d57/d6a/c10b 0 2024-09-21T00:56:59.320 INFO:tasks.workunit.client.0.smithi112.stdout:2/622: mknod d0/d14/d8/d27/cc5 0 2024-09-21T00:56:59.323 INFO:tasks.workunit.client.0.smithi112.stdout:2/623: mkdir d0/d45/d8a/dc6 0 2024-09-21T00:56:59.325 INFO:tasks.workunit.client.0.smithi112.stdout:5/500: dread d8/d9/d13/d1c/d45/f5a [0,4194304] 0 2024-09-21T00:56:59.326 INFO:tasks.workunit.client.0.smithi112.stdout:5/501: chown d8/d9/l77 509796 1 2024-09-21T00:56:59.326 INFO:tasks.workunit.client.0.smithi112.stdout:7/719: dwrite d0/d2/f31 [0,4194304] 0 2024-09-21T00:56:59.334 INFO:tasks.workunit.client.0.smithi112.stdout:5/502: creat d8/d9/d13/d2a/d84/d8b/fa2 x:0 0 0 2024-09-21T00:56:59.335 INFO:tasks.workunit.client.0.smithi112.stdout:6/607: dwrite d9/d1f/d47/d74/fb4 [0,4194304] 0 2024-09-21T00:56:59.336 INFO:tasks.workunit.client.0.smithi112.stdout:5/503: write d8/f3f [612307,42798] 0 2024-09-21T00:56:59.343 INFO:tasks.workunit.client.0.smithi112.stdout:6/608: dread d9/d1f/d3e/d77/d45/f80 [0,4194304] 0 2024-09-21T00:56:59.343 INFO:tasks.workunit.client.0.smithi112.stdout:2/624: truncate d0/d14/f37 2805865 0 2024-09-21T00:56:59.348 INFO:tasks.workunit.client.0.smithi112.stdout:5/504: mknod d8/d9/d13/d1c/d45/ca3 0 2024-09-21T00:56:59.354 INFO:tasks.workunit.client.0.smithi112.stdout:7/720: rename d0/d2/d2e/dcf/l6d to d0/d2/d36/d39/d56/d65/lec 0 2024-09-21T00:56:59.354 INFO:tasks.workunit.client.0.smithi112.stdout:6/609: rename d9/d1f to d9/d1f/d3e/d6f/de0 22 2024-09-21T00:56:59.356 INFO:tasks.workunit.client.0.smithi112.stdout:5/505: rmdir d8/d9/d13/d1c 39 2024-09-21T00:56:59.360 INFO:tasks.workunit.client.0.smithi112.stdout:7/721: mkdir d0/d2/d2e/ded 0 2024-09-21T00:56:59.362 INFO:tasks.workunit.client.0.smithi112.stdout:6/610: creat d9/d1f/d47/d34/da6/da7/dcf/d21/fe1 x:0 0 0 2024-09-21T00:56:59.362 INFO:tasks.workunit.client.0.smithi112.stdout:6/611: readlink d9/d1f/lae 0 2024-09-21T00:56:59.368 INFO:tasks.workunit.client.0.smithi112.stdout:5/506: write d8/f1a [1154818,87786] 0 2024-09-21T00:56:59.369 INFO:tasks.workunit.client.0.smithi112.stdout:5/507: stat d8/d9 0 2024-09-21T00:56:59.369 INFO:tasks.workunit.client.0.smithi112.stdout:2/625: dwrite d0/d14/dbe/fbf [0,4194304] 0 2024-09-21T00:56:59.371 INFO:tasks.workunit.client.0.smithi112.stdout:7/722: mknod d0/d2/d36/de4/cee 0 2024-09-21T00:56:59.372 INFO:tasks.workunit.client.0.smithi112.stdout:6/612: link d9/df/f2e d9/d1f/d3e/d77/d45/fe2 0 2024-09-21T00:56:59.373 INFO:tasks.workunit.client.0.smithi112.stdout:5/508: chown d8/d9/d13/d2a/c9e 7 1 2024-09-21T00:56:59.375 INFO:tasks.workunit.client.0.smithi112.stdout:7/723: unlink d0/d2/d32/f5b 0 2024-09-21T00:56:59.379 INFO:tasks.workunit.client.0.smithi112.stdout:5/509: fsync d8/d9/d13/d1c/f91 0 2024-09-21T00:56:59.380 INFO:tasks.workunit.client.0.smithi112.stdout:5/510: write d8/f1a [702357,112656] 0 2024-09-21T00:56:59.380 INFO:tasks.workunit.client.0.smithi112.stdout:7/724: rename d0/d2/d92 to d0/d2/d36/d39/d56/d65/d75/d9a/def 0 2024-09-21T00:56:59.384 INFO:tasks.workunit.client.0.smithi112.stdout:7/725: unlink d0/d2/d36/d39/d1a/c3d 0 2024-09-21T00:56:59.386 INFO:tasks.workunit.client.0.smithi112.stdout:5/511: creat d8/d9/d13/d2a/df/d5b/d75/fa4 x:0 0 0 2024-09-21T00:56:59.387 INFO:tasks.workunit.client.0.smithi112.stdout:5/512: chown d8/d9/d13/d2a/l62 93 1 2024-09-21T00:56:59.392 INFO:tasks.workunit.client.0.smithi112.stdout:6/613: write d9/d1f/d47/d34/da6/fad [503913,117111] 0 2024-09-21T00:56:59.392 INFO:tasks.workunit.client.0.smithi112.stdout:5/513: mknod d8/d9/d13/d2a/df/d5b/ca5 0 2024-09-21T00:56:59.395 INFO:tasks.workunit.client.0.smithi112.stdout:7/726: creat d0/d2/ff0 x:0 0 0 2024-09-21T00:56:59.397 INFO:tasks.workunit.client.0.smithi112.stdout:2/626: dwrite d0/d45/d8a/d62/f88 [0,4194304] 0 2024-09-21T00:56:59.398 INFO:tasks.workunit.client.0.smithi112.stdout:7/727: chown d0/d2/d36/d39/d56/d65/cd2 640 1 2024-09-21T00:56:59.400 INFO:tasks.workunit.client.0.smithi112.stdout:2/627: symlink d0/d14/d22/d6d/lc7 0 2024-09-21T00:56:59.402 INFO:tasks.workunit.client.0.smithi112.stdout:2/628: readlink d0/df/d46/d58/l9d 0 2024-09-21T00:56:59.414 INFO:tasks.workunit.client.0.smithi112.stdout:5/514: write d8/d9/d13/d2a/f26 [1256370,73364] 0 2024-09-21T00:56:59.419 INFO:tasks.workunit.client.0.smithi112.stdout:6/614: dwrite d9/d1f/d3e/d77/d46/f92 [0,4194304] 0 2024-09-21T00:56:59.422 INFO:tasks.workunit.client.0.smithi112.stdout:2/629: dwrite d0/d14/d8/d27/f2a [0,4194304] 0 2024-09-21T00:56:59.426 INFO:tasks.workunit.client.0.smithi112.stdout:6/615: symlink d9/d1f/d47/d34/da6/da7/dcf/d21/d84/le3 0 2024-09-21T00:56:59.426 INFO:tasks.workunit.client.0.smithi112.stdout:2/630: mknod d0/d14/d8/da2/cc8 0 2024-09-21T00:56:59.428 INFO:tasks.workunit.client.0.smithi112.stdout:2/631: mknod d0/df/cc9 0 2024-09-21T00:56:59.430 INFO:tasks.workunit.client.0.smithi112.stdout:6/616: mkdir d9/d1f/d3e/d6f/de4 0 2024-09-21T00:56:59.432 INFO:tasks.workunit.client.0.smithi112.stdout:2/632: chown d0/d45/d8a/d83/c91 1 1 2024-09-21T00:56:59.432 INFO:tasks.workunit.client.0.smithi112.stdout:2/633: chown d0/d14/l3d 8569837 1 2024-09-21T00:56:59.435 INFO:tasks.workunit.client.0.smithi112.stdout:2/634: truncate d0/d14/d8/d27/f98 944164 0 2024-09-21T00:56:59.436 INFO:tasks.workunit.client.0.smithi112.stdout:2/635: dread - d0/d14/fb6 zero size 2024-09-21T00:56:59.436 INFO:tasks.workunit.client.0.smithi112.stdout:2/636: stat d0/d45 0 2024-09-21T00:56:59.448 INFO:tasks.workunit.client.0.smithi112.stdout:2/637: truncate d0/df/f13 234268 0 2024-09-21T00:56:59.449 INFO:tasks.workunit.client.0.smithi112.stdout:5/515: dread d8/f5f [0,4194304] 0 2024-09-21T00:56:59.452 INFO:tasks.workunit.client.0.smithi112.stdout:2/638: mknod d0/d14/d22/d95/cca 0 2024-09-21T00:56:59.454 INFO:tasks.workunit.client.0.smithi112.stdout:5/516: truncate d8/d9/f25 3856024 0 2024-09-21T00:56:59.457 INFO:tasks.workunit.client.0.smithi112.stdout:2/639: symlink d0/d14/d8/da2/lcb 0 2024-09-21T00:56:59.458 INFO:tasks.workunit.client.0.smithi112.stdout:2/640: chown d0/d14/d47/d70 117400 1 2024-09-21T00:56:59.458 INFO:tasks.workunit.client.0.smithi112.stdout:2/641: chown d0/d14/d47/d70/c90 1888824 1 2024-09-21T00:56:59.461 INFO:tasks.workunit.client.0.smithi112.stdout:2/642: read d0/fe [1469300,100777] 0 2024-09-21T00:56:59.461 INFO:tasks.workunit.client.0.smithi112.stdout:2/643: fdatasync d0/d14/f4e 0 2024-09-21T00:56:59.462 INFO:tasks.workunit.client.0.smithi112.stdout:2/644: write d0/d45/d8a/f6f [448137,6353] 0 2024-09-21T00:56:59.466 INFO:tasks.workunit.client.0.smithi112.stdout:2/645: creat d0/d14/fcc x:0 0 0 2024-09-21T00:56:59.467 INFO:tasks.workunit.client.0.smithi112.stdout:2/646: fdatasync d0/d14/d22/d6d/fb5 0 2024-09-21T00:56:59.468 INFO:tasks.workunit.client.0.smithi112.stdout:2/647: dread - d0/d45/d8a/d62/f6c zero size 2024-09-21T00:56:59.469 INFO:tasks.workunit.client.0.smithi112.stdout:2/648: readlink d0/d60/d78/lac 0 2024-09-21T00:56:59.484 INFO:tasks.workunit.client.0.smithi112.stdout:2/649: dread d0/d45/d8a/f56 [4194304,4194304] 0 2024-09-21T00:56:59.486 INFO:tasks.workunit.client.0.smithi112.stdout:2/650: truncate d0/d45/d8a/d62/f6c 30668 0 2024-09-21T00:56:59.500 INFO:tasks.workunit.client.0.smithi112.stdout:2/651: dread d0/f3c [0,4194304] 0 2024-09-21T00:56:59.614 INFO:tasks.workunit.client.0.smithi112.stdout:2/652: dwrite d0/d14/d22/d6d/fb5 [0,4194304] 0 2024-09-21T00:56:59.616 INFO:tasks.workunit.client.0.smithi112.stdout:2/653: mkdir d0/df/d46/d97/dcd 0 2024-09-21T00:56:59.618 INFO:tasks.workunit.client.0.smithi112.stdout:4/665: sync 2024-09-21T00:56:59.657 INFO:tasks.workunit.client.0.smithi112.stdout:2/654: creat d0/d45/d8a/d62/fce x:0 0 0 2024-09-21T00:56:59.671 INFO:tasks.workunit.client.0.smithi112.stdout:2/655: dread d0/d45/f4a [0,4194304] 0 2024-09-21T00:56:59.689 INFO:tasks.workunit.client.0.smithi112.stdout:4/666: dwrite d1/d5/d1c/d1e/daf/fb4 [0,4194304] 0 2024-09-21T00:56:59.689 INFO:tasks.workunit.client.0.smithi112.stdout:2/656: write d0/d45/d8a/d62/f82 [1205507,103818] 0 2024-09-21T00:56:59.694 INFO:tasks.workunit.client.0.smithi112.stdout:2/657: rmdir d0/d14 39 2024-09-21T00:56:59.698 INFO:tasks.workunit.client.0.smithi112.stdout:4/667: write d1/d7/d9/d1a/d22/d6e/fab [317051,121415] 0 2024-09-21T00:56:59.698 INFO:tasks.workunit.client.0.smithi112.stdout:2/658: write d0/df/f16 [5511973,55698] 0 2024-09-21T00:56:59.702 INFO:tasks.workunit.client.0.smithi112.stdout:2/659: mkdir d0/d45/d8a/d62/dcf 0 2024-09-21T00:56:59.708 INFO:tasks.workunit.client.0.smithi112.stdout:4/668: write d1/d7/d9/f5a [3940699,112090] 0 2024-09-21T00:56:59.709 INFO:tasks.workunit.client.0.smithi112.stdout:4/669: truncate d1/d75/dc2/fda 890035 0 2024-09-21T00:56:59.711 INFO:tasks.workunit.client.0.smithi112.stdout:2/660: truncate d0/d45/d8a/f57 1490688 0 2024-09-21T00:56:59.712 INFO:tasks.workunit.client.0.smithi112.stdout:2/661: rmdir d0/d45/d8a/d62 39 2024-09-21T00:56:59.717 INFO:tasks.workunit.client.0.smithi112.stdout:4/670: write d1/d2d/d34/fa2 [2743566,45594] 0 2024-09-21T00:56:59.718 INFO:tasks.workunit.client.0.smithi112.stdout:4/671: readlink d1/d7/d9/d1a/l37 0 2024-09-21T00:56:59.721 INFO:tasks.workunit.client.0.smithi112.stdout:2/662: truncate d0/d45/d8a/d62/f82 1525820 0 2024-09-21T00:56:59.722 INFO:tasks.workunit.client.0.smithi112.stdout:4/672: creat d1/d2d/d34/fe3 x:0 0 0 2024-09-21T00:56:59.723 INFO:tasks.workunit.client.0.smithi112.stdout:2/663: symlink d0/d14/d22/ld0 0 2024-09-21T00:56:59.727 INFO:tasks.workunit.client.0.smithi112.stdout:4/673: rename d1/d5/d1c/d1e/daf/lce to d1/d5/d1c/d1e/le4 0 2024-09-21T00:56:59.728 INFO:tasks.workunit.client.0.smithi112.stdout:4/674: chown d1/d7/fdb 58 1 2024-09-21T00:56:59.730 INFO:tasks.workunit.client.0.smithi112.stdout:2/664: dwrite d0/d14/fcc [0,4194304] 0 2024-09-21T00:56:59.733 INFO:tasks.workunit.client.0.smithi112.stdout:4/675: unlink d1/d7/d9/d1a/d22/d6e/cad 0 2024-09-21T00:56:59.736 INFO:tasks.workunit.client.0.smithi112.stdout:2/665: dwrite d0/d14/f19 [0,4194304] 0 2024-09-21T00:56:59.736 INFO:tasks.workunit.client.0.smithi112.stdout:4/676: mkdir d1/d7/d9/d1a/de5 0 2024-09-21T00:56:59.738 INFO:tasks.workunit.client.0.smithi112.stdout:2/666: write d0/d14/d8/f44 [1135499,114031] 0 2024-09-21T00:56:59.738 INFO:tasks.workunit.client.0.smithi112.stdout:4/677: rmdir d1/d2d 39 2024-09-21T00:56:59.739 INFO:tasks.workunit.client.0.smithi112.stdout:2/667: stat d0/d14/d22/d95 0 2024-09-21T00:56:59.740 INFO:tasks.workunit.client.0.smithi112.stdout:4/678: read d1/fa6 [1315803,101520] 0 2024-09-21T00:56:59.741 INFO:tasks.workunit.client.0.smithi112.stdout:4/679: chown d1/d7/d9/l3b 4319469 1 2024-09-21T00:56:59.748 INFO:tasks.workunit.client.0.smithi112.stdout:4/680: creat d1/d7/d9/d1a/fe6 x:0 0 0 2024-09-21T00:56:59.753 INFO:tasks.workunit.client.0.smithi112.stdout:4/681: rmdir d1/d5/d1c/d1e/d76 39 2024-09-21T00:56:59.755 INFO:tasks.workunit.client.0.smithi112.stdout:4/682: symlink d1/d7/d9/le7 0 2024-09-21T00:56:59.757 INFO:tasks.workunit.client.0.smithi112.stdout:4/683: mknod d1/d5/d1c/d1e/d4a/d5f/d83/ce8 0 2024-09-21T00:56:59.760 INFO:tasks.workunit.client.0.smithi112.stdout:4/684: creat d1/d2d/d34/fe9 x:0 0 0 2024-09-21T00:56:59.761 INFO:tasks.workunit.client.0.smithi112.stdout:2/668: truncate d0/d14/d8/d27/f2a 1692331 0 2024-09-21T00:56:59.763 INFO:tasks.workunit.client.0.smithi112.stdout:2/669: creat d0/d14/d47/d70/fd1 x:0 0 0 2024-09-21T00:56:59.763 INFO:tasks.workunit.client.0.smithi112.stdout:2/670: stat d0/d14/d8/d27/d7a 0 2024-09-21T00:56:59.764 INFO:tasks.workunit.client.0.smithi112.stdout:4/685: getdents d1/d75 0 2024-09-21T00:56:59.765 INFO:tasks.workunit.client.0.smithi112.stdout:2/671: mkdir d0/d14/d22/d95/dd2 0 2024-09-21T00:56:59.766 INFO:tasks.workunit.client.0.smithi112.stdout:4/686: symlink d1/d2d/d34/lea 0 2024-09-21T00:56:59.767 INFO:tasks.workunit.client.0.smithi112.stdout:2/672: mknod d0/d14/d8/da2/dba/cd3 0 2024-09-21T00:56:59.770 INFO:tasks.workunit.client.0.smithi112.stdout:2/673: creat d0/d14/d8/d27/d63/fd4 x:0 0 0 2024-09-21T00:56:59.776 INFO:tasks.workunit.client.0.smithi112.stdout:2/674: dwrite d0/d45/d8a/f55 [4194304,4194304] 0 2024-09-21T00:56:59.784 INFO:tasks.workunit.client.0.smithi112.stdout:2/675: creat d0/d14/d8/daf/fd5 x:0 0 0 2024-09-21T00:56:59.788 INFO:tasks.workunit.client.0.smithi112.stdout:2/676: getdents d0/d14/d8/d27/d63 0 2024-09-21T00:56:59.789 INFO:tasks.workunit.client.0.smithi112.stdout:4/687: dwrite d1/d5/d1c/d1e/d3d/f48 [0,4194304] 0 2024-09-21T00:56:59.794 INFO:tasks.workunit.client.0.smithi112.stdout:4/688: fdatasync d1/d5/f9b 0 2024-09-21T00:56:59.795 INFO:tasks.workunit.client.0.smithi112.stdout:2/677: mkdir d0/df/d46/d97/dcd/dd6 0 2024-09-21T00:56:59.801 INFO:tasks.workunit.client.0.smithi112.stdout:2/678: mkdir d0/d45/d8a/dd7 0 2024-09-21T00:56:59.805 INFO:tasks.workunit.client.0.smithi112.stdout:2/679: rename d0/d45/d8a/d62/f65 to d0/df/d46/d58/fd8 0 2024-09-21T00:56:59.806 INFO:tasks.workunit.client.0.smithi112.stdout:4/689: getdents d1/d5/d1c/db3 0 2024-09-21T00:56:59.807 INFO:tasks.workunit.client.0.smithi112.stdout:2/680: creat d0/df/fd9 x:0 0 0 2024-09-21T00:56:59.808 INFO:tasks.workunit.client.0.smithi112.stdout:2/681: chown d0/d45/d8a/d62/dcf 96 1 2024-09-21T00:56:59.810 INFO:tasks.workunit.client.0.smithi112.stdout:4/690: dread d1/d5/d1c/d1e/daf/fb4 [0,4194304] 0 2024-09-21T00:56:59.812 INFO:tasks.workunit.client.0.smithi112.stdout:2/682: truncate d0/f53 4536109 0 2024-09-21T00:56:59.813 INFO:tasks.workunit.client.0.smithi112.stdout:0/539: sync 2024-09-21T00:56:59.815 INFO:tasks.workunit.client.0.smithi112.stdout:2/683: rename d0/d14/d8/c17 to d0/df/d46/d97/cda 0 2024-09-21T00:56:59.818 INFO:tasks.workunit.client.0.smithi112.stdout:0/540: creat d8/d62/d9d/fab x:0 0 0 2024-09-21T00:56:59.822 INFO:tasks.workunit.client.0.smithi112.stdout:2/684: mknod d0/d14/d8/da2/dba/dc1/cdb 0 2024-09-21T00:56:59.822 INFO:tasks.workunit.client.0.smithi112.stdout:2/685: chown d0/d14/f80 5 1 2024-09-21T00:56:59.825 INFO:tasks.workunit.client.0.smithi112.stdout:2/686: mknod d0/d45/d8a/d62/dcf/cdc 0 2024-09-21T00:56:59.832 INFO:tasks.workunit.client.0.smithi112.stdout:0/541: getdents d8/d62/d9d 0 2024-09-21T00:56:59.836 INFO:tasks.workunit.client.0.smithi112.stdout:0/542: creat d8/d75/d91/d9b/fac x:0 0 0 2024-09-21T00:56:59.840 INFO:tasks.workunit.client.0.smithi112.stdout:2/687: dwrite d0/d45/d8a/d83/fa7 [0,4194304] 0 2024-09-21T00:56:59.841 INFO:tasks.workunit.client.0.smithi112.stdout:0/543: write d8/d11/f37 [2672892,41374] 0 2024-09-21T00:56:59.845 INFO:tasks.workunit.client.0.smithi112.stdout:2/688: creat d0/d14/d8/da2/dba/dc1/fdd x:0 0 0 2024-09-21T00:56:59.849 INFO:tasks.workunit.client.0.smithi112.stdout:2/689: creat d0/df/d46/d97/dcd/dd6/fde x:0 0 0 2024-09-21T00:56:59.850 INFO:tasks.workunit.client.0.smithi112.stdout:2/690: readlink d0/d60/d78/la4 0 2024-09-21T00:56:59.850 INFO:tasks.workunit.client.0.smithi112.stdout:0/544: link d8/d1b/d2c/d2e/d4c/d64/d96/la0 d8/d75/lad 0 2024-09-21T00:56:59.851 INFO:tasks.workunit.client.0.smithi112.stdout:0/545: dread - d8/d75/d9c/f9e zero size 2024-09-21T00:56:59.852 INFO:tasks.workunit.client.0.smithi112.stdout:2/691: mknod d0/d14/d8/da2/dba/dc1/cdf 0 2024-09-21T00:56:59.853 INFO:tasks.workunit.client.0.smithi112.stdout:0/546: symlink d8/d11/d59/lae 0 2024-09-21T00:56:59.857 INFO:tasks.workunit.client.0.smithi112.stdout:0/547: dread d8/d11/f1a [0,4194304] 0 2024-09-21T00:56:59.858 INFO:tasks.workunit.client.0.smithi112.stdout:2/692: creat d0/d14/fe0 x:0 0 0 2024-09-21T00:56:59.858 INFO:tasks.workunit.client.0.smithi112.stdout:0/548: fdatasync d8/d75/d91/f93 0 2024-09-21T00:56:59.859 INFO:tasks.workunit.client.0.smithi112.stdout:2/693: readlink d0/d45/d8a/d83/lc2 0 2024-09-21T00:56:59.859 INFO:tasks.workunit.client.0.smithi112.stdout:2/694: stat d0/d14/d22/d95 0 2024-09-21T00:56:59.860 INFO:tasks.workunit.client.0.smithi112.stdout:2/695: fsync d0/d60/fb7 0 2024-09-21T00:56:59.861 INFO:tasks.workunit.client.0.smithi112.stdout:0/549: chown d8/d11/d28/d54/c58 2509174 1 2024-09-21T00:56:59.862 INFO:tasks.workunit.client.0.smithi112.stdout:2/696: creat d0/d14/dbe/fe1 x:0 0 0 2024-09-21T00:56:59.863 INFO:tasks.workunit.client.0.smithi112.stdout:0/550: rmdir d8/d1b 39 2024-09-21T00:56:59.866 INFO:tasks.workunit.client.0.smithi112.stdout:2/697: rename d0/d14/d8/daf/fd5 to d0/d45/d8a/d83/fe2 0 2024-09-21T00:56:59.870 INFO:tasks.workunit.client.0.smithi112.stdout:2/698: unlink d0/d45/d8a/fad 0 2024-09-21T00:56:59.872 INFO:tasks.workunit.client.0.smithi112.stdout:2/699: mkdir d0/d14/d8/d27/d7a/de3 0 2024-09-21T00:56:59.874 INFO:tasks.workunit.client.0.smithi112.stdout:2/700: read d0/df/f16 [2463,16596] 0 2024-09-21T00:56:59.874 INFO:tasks.workunit.client.0.smithi112.stdout:2/701: readlink d0/d14/d22/d6d/lc7 0 2024-09-21T00:56:59.876 INFO:tasks.workunit.client.0.smithi112.stdout:0/551: write d8/d11/d59/f8a [364977,49206] 0 2024-09-21T00:56:59.878 INFO:tasks.workunit.client.0.smithi112.stdout:2/702: unlink d0/d45/f4a 0 2024-09-21T00:56:59.881 INFO:tasks.workunit.client.0.smithi112.stdout:2/703: rename d0/d14/fe0 to d0/d45/d8a/dd7/fe4 0 2024-09-21T00:56:59.882 INFO:tasks.workunit.client.0.smithi112.stdout:2/704: dread - d0/df/d46/d97/dcd/dd6/fde zero size 2024-09-21T00:56:59.885 INFO:tasks.workunit.client.0.smithi112.stdout:0/552: getdents d8/d1b/d2c/d2e/d4c 0 2024-09-21T00:56:59.886 INFO:tasks.workunit.client.0.smithi112.stdout:2/705: dread d0/f67 [0,4194304] 0 2024-09-21T00:56:59.978 INFO:tasks.workunit.client.0.smithi112.stdout:2/706: link d0/d14/d47/d70/c90 d0/d14/d22/d95/dd2/ce5 0 2024-09-21T00:56:59.979 INFO:tasks.workunit.client.0.smithi112.stdout:0/553: dread d8/fb [0,4194304] 0 2024-09-21T00:56:59.986 INFO:tasks.workunit.client.0.smithi112.stdout:0/554: write d8/d5f/f6f [946052,129087] 0 2024-09-21T00:56:59.989 INFO:tasks.workunit.client.0.smithi112.stdout:2/707: dwrite d0/d60/fab [0,4194304] 0 2024-09-21T00:56:59.989 INFO:tasks.workunit.client.0.smithi112.stdout:0/555: mkdir d8/d1b/d2c/daf 0 2024-09-21T00:56:59.991 INFO:tasks.workunit.client.0.smithi112.stdout:2/708: fdatasync d0/d14/d22/f7e 0 2024-09-21T00:56:59.993 INFO:tasks.workunit.client.0.smithi112.stdout:0/556: write d8/d11/d28/f43 [1987878,41972] 0 2024-09-21T00:56:59.993 INFO:tasks.workunit.client.0.smithi112.stdout:2/709: dread - d0/d45/d8a/dd7/fe4 zero size 2024-09-21T00:56:59.998 INFO:tasks.workunit.client.0.smithi112.stdout:2/710: creat d0/d14/d47/fe6 x:0 0 0 2024-09-21T00:56:59.999 INFO:tasks.workunit.client.0.smithi112.stdout:2/711: stat d0/d45/d8a/f56 0 2024-09-21T00:56:59.999 INFO:tasks.workunit.client.0.smithi112.stdout:0/557: write d8/f18 [8407919,27582] 0 2024-09-21T00:57:00.003 INFO:tasks.workunit.client.0.smithi112.stdout:2/712: symlink d0/d45/d8a/d62/dcf/le7 0 2024-09-21T00:57:00.006 INFO:tasks.workunit.client.0.smithi112.stdout:2/713: rename d0/d45/d8a/d83/fa7 to d0/d60/d78/fe8 0 2024-09-21T00:57:00.009 INFO:tasks.workunit.client.0.smithi112.stdout:2/714: truncate d0/d14/d8/d27/d7a/f93 350818 0 2024-09-21T00:57:00.011 INFO:tasks.workunit.client.0.smithi112.stdout:2/715: fsync d0/fe 0 2024-09-21T00:57:00.016 INFO:tasks.workunit.client.0.smithi112.stdout:2/716: fdatasync d0/d45/d8a/f52 0 2024-09-21T00:57:00.016 INFO:tasks.workunit.client.0.smithi112.stdout:0/558: dwrite d8/d75/f79 [0,4194304] 0 2024-09-21T00:57:00.021 INFO:tasks.workunit.client.0.smithi112.stdout:0/559: unlink d8/d75/f70 0 2024-09-21T00:57:00.023 INFO:tasks.workunit.client.0.smithi112.stdout:0/560: read d8/d11/d28/d54/f57 [1385451,24364] 0 2024-09-21T00:57:00.029 INFO:tasks.workunit.client.0.smithi112.stdout:2/717: rename d0/d45/d8a/d99/lbc to d0/le9 0 2024-09-21T00:57:00.030 INFO:tasks.workunit.client.0.smithi112.stdout:0/561: creat d8/d5f/da7/fb0 x:0 0 0 2024-09-21T00:57:00.032 INFO:tasks.workunit.client.0.smithi112.stdout:2/718: symlink d0/d14/d8/d27/d7a/lea 0 2024-09-21T00:57:00.035 INFO:tasks.workunit.client.0.smithi112.stdout:0/562: dread d8/d1b/f32 [0,4194304] 0 2024-09-21T00:57:00.036 INFO:tasks.workunit.client.0.smithi112.stdout:0/563: write d8/d11/f2d [2238063,72103] 0 2024-09-21T00:57:00.093 INFO:tasks.workunit.client.0.smithi112.stdout:8/693: sync 2024-09-21T00:57:00.096 INFO:tasks.workunit.client.0.smithi112.stdout:0/564: mknod d8/d1b/d2c/d2e/d4c/d64/cb1 0 2024-09-21T00:57:00.098 INFO:tasks.workunit.client.0.smithi112.stdout:0/565: stat d8/d75/lad 0 2024-09-21T00:57:00.100 INFO:tasks.workunit.client.0.smithi112.stdout:0/566: truncate d8/d1b/f8e 935298 0 2024-09-21T00:57:00.101 INFO:tasks.workunit.client.0.smithi112.stdout:0/567: readlink d8/d1b/l66 0 2024-09-21T00:57:00.103 INFO:tasks.workunit.client.0.smithi112.stdout:2/719: dwrite d0/df/fb2 [0,4194304] 0 2024-09-21T00:57:00.105 INFO:tasks.workunit.client.0.smithi112.stdout:2/720: fsync d0/d14/d8/d27/d63/fd4 0 2024-09-21T00:57:00.106 INFO:tasks.workunit.client.0.smithi112.stdout:2/721: stat d0/d45/d8a/d62/dcf/le7 0 2024-09-21T00:57:00.107 INFO:tasks.workunit.client.0.smithi112.stdout:0/568: getdents d8/d1b/d2c/daf 0 2024-09-21T00:57:00.110 INFO:tasks.workunit.client.0.smithi112.stdout:0/569: mkdir d8/d75/db2 0 2024-09-21T00:57:00.112 INFO:tasks.workunit.client.0.smithi112.stdout:2/722: rename d0/d60/f74 to d0/d14/d22/d95/dd2/feb 0 2024-09-21T00:57:00.115 INFO:tasks.workunit.client.0.smithi112.stdout:2/723: symlink d0/d45/d8a/dd7/lec 0 2024-09-21T00:57:00.120 INFO:tasks.workunit.client.0.smithi112.stdout:0/570: dwrite d8/d75/d91/fa6 [4194304,4194304] 0 2024-09-21T00:57:00.120 INFO:tasks.workunit.client.0.smithi112.stdout:2/724: dread d0/d60/fab [0,4194304] 0 2024-09-21T00:57:00.121 INFO:tasks.workunit.client.0.smithi112.stdout:2/725: stat d0/df/c5a 0 2024-09-21T00:57:00.124 INFO:tasks.workunit.client.0.smithi112.stdout:2/726: mknod d0/d14/d8/da2/dba/ced 0 2024-09-21T00:57:00.125 INFO:tasks.workunit.client.0.smithi112.stdout:2/727: write d0/d14/d8/f44 [1013963,13439] 0 2024-09-21T00:57:00.129 INFO:tasks.workunit.client.0.smithi112.stdout:2/728: mknod d0/d45/d8a/d62/cee 0 2024-09-21T00:57:00.131 INFO:tasks.workunit.client.0.smithi112.stdout:2/729: write d0/d14/d8/da2/dba/dc1/fdd [283373,11000] 0 2024-09-21T00:57:00.133 INFO:tasks.workunit.client.0.smithi112.stdout:0/571: link d8/d11/d28/f4e d8/d1b/d2c/d2e/fb3 0 2024-09-21T00:57:00.134 INFO:tasks.workunit.client.0.smithi112.stdout:2/730: mkdir d0/d45/d8a/d83/def 0 2024-09-21T00:57:00.134 INFO:tasks.workunit.client.0.smithi112.stdout:2/731: chown d0/d45/d8a/d62/dcf/cdc 11337275 1 2024-09-21T00:57:00.139 INFO:tasks.workunit.client.0.smithi112.stdout:2/732: getdents d0/d14 0 2024-09-21T00:57:00.140 INFO:tasks.workunit.client.0.smithi112.stdout:2/733: mkdir d0/d14/d8/d27/d63/df0 0 2024-09-21T00:57:00.143 INFO:tasks.workunit.client.0.smithi112.stdout:0/572: write d8/d62/fa9 [7201676,128363] 0 2024-09-21T00:57:00.146 INFO:tasks.workunit.client.0.smithi112.stdout:2/734: rmdir d0/d14/d8/daf 0 2024-09-21T00:57:00.146 INFO:tasks.workunit.client.0.smithi112.stdout:0/573: readlink d8/d11/l24 0 2024-09-21T00:57:00.147 INFO:tasks.workunit.client.0.smithi112.stdout:2/735: rmdir d0/d14/dbe 39 2024-09-21T00:57:00.148 INFO:tasks.workunit.client.0.smithi112.stdout:0/574: readlink d8/d11/d28/l53 0 2024-09-21T00:57:00.150 INFO:tasks.workunit.client.0.smithi112.stdout:0/575: creat d8/d1b/d2c/d2e/fb4 x:0 0 0 2024-09-21T00:57:00.152 INFO:tasks.workunit.client.0.smithi112.stdout:0/576: creat d8/d1b/d2c/d2e/d4c/d64/fb5 x:0 0 0 2024-09-21T00:57:00.154 INFO:tasks.workunit.client.0.smithi112.stdout:0/577: fsync d8/d1b/f36 0 2024-09-21T00:57:00.155 INFO:tasks.workunit.client.0.smithi112.stdout:0/578: chown d8/d75/d9c/f9e 2755949 1 2024-09-21T00:57:00.160 INFO:tasks.workunit.client.0.smithi112.stdout:0/579: mkdir d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6 0 2024-09-21T00:57:00.163 INFO:tasks.workunit.client.0.smithi112.stdout:2/736: dread d0/f53 [0,4194304] 0 2024-09-21T00:57:00.164 INFO:tasks.workunit.client.0.smithi112.stdout:0/580: creat d8/d11/d28/fb7 x:0 0 0 2024-09-21T00:57:00.166 INFO:tasks.workunit.client.0.smithi112.stdout:0/581: dread - d8/d1b/d2c/d2e/f8d zero size 2024-09-21T00:57:00.168 INFO:tasks.workunit.client.0.smithi112.stdout:2/737: rmdir d0/d14/d22/d95 39 2024-09-21T00:57:00.172 INFO:tasks.workunit.client.0.smithi112.stdout:2/738: write d0/d14/f32 [1871580,77033] 0 2024-09-21T00:57:00.172 INFO:tasks.workunit.client.0.smithi112.stdout:0/582: creat d8/d11/fb8 x:0 0 0 2024-09-21T00:57:00.173 INFO:tasks.workunit.client.0.smithi112.stdout:0/583: read d8/d5f/f6f [795591,20616] 0 2024-09-21T00:57:00.177 INFO:tasks.workunit.client.0.smithi112.stdout:0/584: creat d8/d1b/d2c/d2e/fb9 x:0 0 0 2024-09-21T00:57:00.177 INFO:tasks.workunit.client.0.smithi112.stdout:0/585: fdatasync d8/f18 0 2024-09-21T00:57:00.178 INFO:tasks.workunit.client.0.smithi112.stdout:2/739: creat d0/d14/d47/d70/ff1 x:0 0 0 2024-09-21T00:57:00.180 INFO:tasks.workunit.client.0.smithi112.stdout:0/586: fsync d8/d5f/f73 0 2024-09-21T00:57:00.181 INFO:tasks.workunit.client.0.smithi112.stdout:2/740: stat d0/df/d46/d97/cda 0 2024-09-21T00:57:00.182 INFO:tasks.workunit.client.0.smithi112.stdout:2/741: truncate d0/d14/d47/d70/ff1 382125 0 2024-09-21T00:57:00.182 INFO:tasks.workunit.client.0.smithi112.stdout:0/587: creat d8/d62/d9d/fba x:0 0 0 2024-09-21T00:57:00.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/742: chown d0/d14/d8/d27/c42 0 1 2024-09-21T00:57:00.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/588: truncate d8/d1b/d2c/d2e/d4c/f50 1725320 0 2024-09-21T00:57:00.194 INFO:tasks.workunit.client.0.smithi112.stdout:2/743: mknod d0/d14/d22/d95/cf2 0 2024-09-21T00:57:00.195 INFO:tasks.workunit.client.0.smithi112.stdout:0/589: symlink d8/d1b/d2c/d2e/lbb 0 2024-09-21T00:57:00.196 INFO:tasks.workunit.client.0.smithi112.stdout:2/744: readlink d0/d14/l21 0 2024-09-21T00:57:00.197 INFO:tasks.workunit.client.0.smithi112.stdout:0/590: truncate d8/d11/d28/fb7 471307 0 2024-09-21T00:57:00.200 INFO:tasks.workunit.client.0.smithi112.stdout:0/591: symlink d8/d1b/d2c/d2e/d4c/d6b/lbc 0 2024-09-21T00:57:00.201 INFO:tasks.workunit.client.0.smithi112.stdout:0/592: chown d8/d62/d9d/la4 1 1 2024-09-21T00:57:00.207 INFO:tasks.workunit.client.0.smithi112.stdout:0/593: mkdir d8/d62/dbd 0 2024-09-21T00:57:00.210 INFO:tasks.workunit.client.0.smithi112.stdout:2/745: dwrite d0/df/f79 [4194304,4194304] 0 2024-09-21T00:57:00.211 INFO:tasks.workunit.client.0.smithi112.stdout:0/594: dread d8/d1b/f32 [0,4194304] 0 2024-09-21T00:57:00.212 INFO:tasks.workunit.client.0.smithi112.stdout:2/746: dread - d0/d45/d8a/d62/f8d zero size 2024-09-21T00:57:00.214 INFO:tasks.workunit.client.0.smithi112.stdout:2/747: fdatasync d0/d45/d8a/f52 0 2024-09-21T00:57:00.214 INFO:tasks.workunit.client.0.smithi112.stdout:0/595: write d8/d1b/f67 [882141,29755] 0 2024-09-21T00:57:00.256 INFO:tasks.workunit.client.0.smithi112.stdout:2/748: link d0/d14/d8/l23 d0/d45/db9/lf3 0 2024-09-21T00:57:00.257 INFO:tasks.workunit.client.0.smithi112.stdout:0/596: link d8/d1b/d2c/d2e/d4c/f84 d8/d62/fbe 0 2024-09-21T00:57:00.259 INFO:tasks.workunit.client.0.smithi112.stdout:0/597: unlink d8/fa 0 2024-09-21T00:57:00.260 INFO:tasks.workunit.client.0.smithi112.stdout:2/749: mknod d0/d45/d8a/cf4 0 2024-09-21T00:57:00.261 INFO:tasks.workunit.client.0.smithi112.stdout:2/750: read d0/df/fb2 [366090,37064] 0 2024-09-21T00:57:00.267 INFO:tasks.workunit.client.0.smithi112.stdout:2/751: dread d0/d14/d8/f44 [0,4194304] 0 2024-09-21T00:57:00.271 INFO:tasks.workunit.client.0.smithi112.stdout:2/752: mkdir d0/df/d46/d58/df5 0 2024-09-21T00:57:00.274 INFO:tasks.workunit.client.0.smithi112.stdout:2/753: dread - d0/d14/d47/f9c zero size 2024-09-21T00:57:00.275 INFO:tasks.workunit.client.0.smithi112.stdout:0/598: truncate d8/d75/f79 2018743 0 2024-09-21T00:57:00.277 INFO:tasks.workunit.client.0.smithi112.stdout:2/754: write d0/f3c [1561158,24093] 0 2024-09-21T00:57:00.279 INFO:tasks.workunit.client.0.smithi112.stdout:2/755: mkdir d0/d14/d8/da2/df6 0 2024-09-21T00:57:00.281 INFO:tasks.workunit.client.0.smithi112.stdout:0/599: write d8/d5f/f73 [92599,119671] 0 2024-09-21T00:57:00.283 INFO:tasks.workunit.client.0.smithi112.stdout:2/756: mknod d0/d45/d8a/dd7/cf7 0 2024-09-21T00:57:00.289 INFO:tasks.workunit.client.0.smithi112.stdout:2/757: dwrite d0/d14/f32 [0,4194304] 0 2024-09-21T00:57:00.294 INFO:tasks.workunit.client.0.smithi112.stdout:0/600: dwrite d8/d11/d28/fb7 [0,4194304] 0 2024-09-21T00:57:00.295 INFO:tasks.workunit.client.0.smithi112.stdout:2/758: creat d0/d14/d8/d27/d63/df0/ff8 x:0 0 0 2024-09-21T00:57:00.297 INFO:tasks.workunit.client.0.smithi112.stdout:0/601: mkdir d8/d11/d28/dbf 0 2024-09-21T00:57:00.300 INFO:tasks.workunit.client.0.smithi112.stdout:0/602: symlink d8/d75/d91/d9b/lc0 0 2024-09-21T00:57:00.302 INFO:tasks.workunit.client.0.smithi112.stdout:2/759: unlink d0/d45/d8a/d62/f6c 0 2024-09-21T00:57:00.305 INFO:tasks.workunit.client.0.smithi112.stdout:0/603: unlink d8/f35 0 2024-09-21T00:57:00.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/760: mkdir d0/d45/db9/df9 0 2024-09-21T00:57:00.310 INFO:tasks.workunit.client.0.smithi112.stdout:0/604: creat d8/d75/db2/fc1 x:0 0 0 2024-09-21T00:57:00.311 INFO:tasks.workunit.client.0.smithi112.stdout:2/761: mkdir d0/df/d46/d97/dfa 0 2024-09-21T00:57:00.312 INFO:tasks.workunit.client.0.smithi112.stdout:0/605: mkdir d8/d1b/d2c/d2e/d4c/d6b/dc2 0 2024-09-21T00:57:00.314 INFO:tasks.workunit.client.0.smithi112.stdout:2/762: mkdir d0/d45/d8a/d62/dcf/dfb 0 2024-09-21T00:57:00.316 INFO:tasks.workunit.client.0.smithi112.stdout:0/606: creat d8/d1b/d2c/d2e/d4c/d6b/fc3 x:0 0 0 2024-09-21T00:57:00.317 INFO:tasks.workunit.client.0.smithi112.stdout:3/915: sync 2024-09-21T00:57:00.318 INFO:tasks.workunit.client.0.smithi112.stdout:0/607: stat d8/d11/d28/f2f 0 2024-09-21T00:57:00.318 INFO:tasks.workunit.client.0.smithi112.stdout:2/763: link d0/c20 d0/df/d46/d97/dcd/cfc 0 2024-09-21T00:57:00.320 INFO:tasks.workunit.client.0.smithi112.stdout:3/916: mkdir d2/d33/d8c/db7/d11b/d136 0 2024-09-21T00:57:00.321 INFO:tasks.workunit.client.0.smithi112.stdout:0/608: mknod d8/d75/db2/cc4 0 2024-09-21T00:57:00.323 INFO:tasks.workunit.client.0.smithi112.stdout:3/917: creat d2/d33/d8c/f137 x:0 0 0 2024-09-21T00:57:00.325 INFO:tasks.workunit.client.0.smithi112.stdout:0/609: creat d8/d5f/fc5 x:0 0 0 2024-09-21T00:57:00.329 INFO:tasks.workunit.client.0.smithi112.stdout:3/918: dwrite d2/d8/d28/dac/fc3 [0,4194304] 0 2024-09-21T00:57:00.337 INFO:tasks.workunit.client.0.smithi112.stdout:3/919: symlink d2/d8/dd/l138 0 2024-09-21T00:57:00.338 INFO:tasks.workunit.client.0.smithi112.stdout:3/920: chown d2/d38/d3f/d53/d96/dcf 98706 1 2024-09-21T00:57:00.341 INFO:tasks.workunit.client.0.smithi112.stdout:3/921: mkdir d2/d8/d6d/d139 0 2024-09-21T00:57:00.347 INFO:tasks.workunit.client.0.smithi112.stdout:2/764: write d0/d60/d78/f9b [238767,105842] 0 2024-09-21T00:57:00.348 INFO:tasks.workunit.client.0.smithi112.stdout:3/922: creat d2/d8/f13a x:0 0 0 2024-09-21T00:57:00.356 INFO:tasks.workunit.client.0.smithi112.stdout:0/610: dwrite d8/d1b/d2c/f30 [0,4194304] 0 2024-09-21T00:57:00.357 INFO:tasks.workunit.client.0.smithi112.stdout:0/611: chown d8/d11/d28/d54/f55 253400 1 2024-09-21T00:57:00.358 INFO:tasks.workunit.client.0.smithi112.stdout:3/923: write d2/d8/dd/de/fca [1050274,85688] 0 2024-09-21T00:57:00.360 INFO:tasks.workunit.client.0.smithi112.stdout:0/612: symlink d8/d5f/lc6 0 2024-09-21T00:57:00.360 INFO:tasks.workunit.client.0.smithi112.stdout:2/765: write d0/df/f13 [1274464,8155] 0 2024-09-21T00:57:00.364 INFO:tasks.workunit.client.0.smithi112.stdout:0/613: chown d8/d11/d28/f68 496 1 2024-09-21T00:57:00.365 INFO:tasks.workunit.client.0.smithi112.stdout:2/766: creat d0/d14/d8/d27/d7a/ffd x:0 0 0 2024-09-21T00:57:00.366 INFO:tasks.workunit.client.0.smithi112.stdout:0/614: dread d8/d5f/f73 [0,4194304] 0 2024-09-21T00:57:00.366 INFO:tasks.workunit.client.0.smithi112.stdout:0/615: dread - d8/d62/d9d/fba zero size 2024-09-21T00:57:00.373 INFO:tasks.workunit.client.0.smithi112.stdout:0/616: rename d8/d1b/d2c/d2e/d4c/d64/l65 to d8/lc7 0 2024-09-21T00:57:00.375 INFO:tasks.workunit.client.0.smithi112.stdout:3/924: dread d2/d33/d78/fc7 [0,4194304] 0 2024-09-21T00:57:00.378 INFO:tasks.workunit.client.0.smithi112.stdout:3/925: write d2/d8/dd/de/d4a/d4c/f11d [772679,77580] 0 2024-09-21T00:57:00.378 INFO:tasks.workunit.client.0.smithi112.stdout:2/767: truncate d0/d14/f19 3371322 0 2024-09-21T00:57:00.379 INFO:tasks.workunit.client.0.smithi112.stdout:0/617: dread d8/fd [0,4194304] 0 2024-09-21T00:57:00.381 INFO:tasks.workunit.client.0.smithi112.stdout:2/768: write d0/d14/fb6 [308166,12270] 0 2024-09-21T00:57:00.383 INFO:tasks.workunit.client.0.smithi112.stdout:3/926: dread d2/d8/dd/de/d4a/d4c/f11d [0,4194304] 0 2024-09-21T00:57:00.388 INFO:tasks.workunit.client.0.smithi112.stdout:3/927: chown d2/d8/dd/de/ca3 207717 1 2024-09-21T00:57:00.390 INFO:tasks.workunit.client.0.smithi112.stdout:3/928: write d2/d33/d8c/db7/f11e [4187787,6350] 0 2024-09-21T00:57:00.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/929: creat d2/d8/d28/d35/f13b x:0 0 0 2024-09-21T00:57:00.397 INFO:tasks.workunit.client.0.smithi112.stdout:2/769: dwrite d0/df/fb3 [0,4194304] 0 2024-09-21T00:57:00.421 INFO:tasks.workunit.client.0.smithi112.stdout:1/651: sync 2024-09-21T00:57:00.669 INFO:tasks.workunit.client.0.smithi112.stdout:2/770: dread d0/d14/d8/fa1 [0,4194304] 0 2024-09-21T00:57:00.669 INFO:tasks.workunit.client.0.smithi112.stdout:3/930: mknod d2/d8/c13c 0 2024-09-21T00:57:00.669 INFO:tasks.workunit.client.0.smithi112.stdout:0/618: dwrite d8/d1b/d2c/d2e/fb3 [0,4194304] 0 2024-09-21T00:57:00.669 INFO:tasks.workunit.client.0.smithi112.stdout:2/771: dread - d0/d45/d8a/d62/f8d zero size 2024-09-21T00:57:00.669 INFO:tasks.workunit.client.0.smithi112.stdout:3/931: write d2/d33/d8c/db7/d11b/f132 [2386840,63807] 0 2024-09-21T00:57:00.669 INFO:tasks.workunit.client.0.smithi112.stdout:2/772: fdatasync d0/d45/d8a/f9a 0 2024-09-21T00:57:00.669 INFO:tasks.workunit.client.0.smithi112.stdout:0/619: rename d8/d75/d91/d9b/lc0 to d8/d11/d28/dbf/lc8 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/652: creat d5/d8/fd5 x:0 0 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/653: chown d5/d8/dd/d97/d46/f57 0 1 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:3/932: fdatasync d2/d3e/d7b/d10d/f9a 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:3/933: stat d2/d33/f102 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:2/773: dwrite d0/d14/d8/f44 [0,4194304] 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/654: link d5/d8/d10/l2d d5/d8/ld6 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:3/934: creat d2/d8/dd/f13d x:0 0 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/655: link d5/d8/dd/dcc/fb1 d5/d8/da1/fd7 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/656: mkdir d5/d8/dd/d54/d5a/dd8 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/657: creat d5/d3a/d4b/fd9 x:0 0 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/658: dwrite d5/d3a/d4b/fd9 [0,4194304] 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/659: stat d5/d34/d6a/d7f/c81 0 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/660: chown d5/d8/d10/f17 115 1 2024-09-21T00:57:00.670 INFO:tasks.workunit.client.0.smithi112.stdout:1/661: stat d5/d8/d13/d87/cb0 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:1/662: rename d5/d8/dd/l6d to d5/d8/dd/d8e/lda 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:1/663: rename d5/d3a/f4a to d5/d8/da1/fdb 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/935: write d2/d38/d3f/d53/fd6 [1097514,115242] 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/936: mkdir d2/d13e 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/937: getdents d2/d33/d8c/db7/d11b 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/938: dread - d2/d8/f13a zero size 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/939: unlink d2/d8/c3a 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/940: mknod d2/d38/d3f/d53/d96/dc9/c13f 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/941: getdents d2/d38/d3f/d53/d96/dcf 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/942: dwrite d2/d8/d28/f74 [0,4194304] 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/943: read d2/d8/d28/d35/f46 [1441211,90161] 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/944: mkdir d2/d3e/d7b/d10d/d8a/d140 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/945: dwrite d2/d38/d3f/d53/d96/dc9/f12d [0,4194304] 0 2024-09-21T00:57:00.671 INFO:tasks.workunit.client.0.smithi112.stdout:3/946: mknod d2/d8/dd/de/d6b/c141 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/947: chown d2/d8/dd/f1f 12058346 1 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/948: symlink d2/d33/dea/d133/l142 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/949: chown d2/d33/d8c/d104 548308008 1 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/950: readlink d2/d8/d28/d35/l106 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/951: creat d2/d8/d6d/d10e/f143 x:0 0 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/952: rename d2/d33/d8c/la5 to d2/d8/dd/de/de9/l144 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/953: mkdir d2/d8/dd/de/d4a/d4c/d145 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/954: readlink d2/d8/dd/l12a 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/955: dwrite d2/d38/d3f/d53/d96/fd9 [0,4194304] 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/956: fsync d2/d8/dd/f1f 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/957: creat d2/d33/d78/f146 x:0 0 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/958: read d2/d38/d3f/f49 [1672882,51287] 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/959: creat d2/d3e/d7b/d10d/dd7/f147 x:0 0 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/960: creat d2/d33/d8c/db7/d128/f148 x:0 0 0 2024-09-21T00:57:00.672 INFO:tasks.workunit.client.0.smithi112.stdout:3/961: readlink d2/d3e/d7b/d10d/l65 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/962: mknod d2/d33/d78/c149 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/963: getdents d2/d33/dea 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/964: fsync d2/d3e/d7b/d10d/dd7/def/ff8 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/965: creat d2/d38/d3f/d53/f14a x:0 0 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/966: rename d2/d33/dea/d133 to d2/d8/d6d/d14b 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/967: chown d2/d3e/d7b/d10d/dd7/ff2 1 1 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/968: creat d2/d33/d8c/db7/f14c x:0 0 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/969: mknod d2/d33/d78/c14d 0 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/970: rmdir d2/d8/dd/de 39 2024-09-21T00:57:00.673 INFO:tasks.workunit.client.0.smithi112.stdout:3/971: rename d2/d38/d3f/d53/d96/fb5 to d2/d8/f14e 0 2024-09-21T00:57:00.759 INFO:tasks.workunit.client.0.smithi112.stdout:9/805: sync 2024-09-21T00:57:00.759 INFO:tasks.workunit.client.0.smithi112.stdout:9/806: chown d5/d3b/d5f/d59/fb1 190 1 2024-09-21T00:57:00.760 INFO:tasks.workunit.client.0.smithi112.stdout:9/807: read d5/d6/d19/f33 [2691990,15845] 0 2024-09-21T00:57:00.762 INFO:tasks.workunit.client.0.smithi112.stdout:9/808: mkdir d5/d3b/d5f/d13/d6e/da0/d10c 0 2024-09-21T00:57:00.765 INFO:tasks.workunit.client.0.smithi112.stdout:9/809: symlink d5/d3b/l10d 0 2024-09-21T00:57:00.766 INFO:tasks.workunit.client.0.smithi112.stdout:9/810: rename d5/d3b to d5/d3b/d5f/d13/d54/d7d/d57/d10e 22 2024-09-21T00:57:00.767 INFO:tasks.workunit.client.0.smithi112.stdout:9/811: creat d5/d3b/d5f/d13/d54/d55/f10f x:0 0 0 2024-09-21T00:57:00.771 INFO:tasks.workunit.client.0.smithi112.stdout:9/812: truncate d5/d3b/d5f/f24 701371 0 2024-09-21T00:57:00.772 INFO:tasks.workunit.client.0.smithi112.stdout:9/813: read - d5/d3b/d79/fe8 zero size 2024-09-21T00:57:00.773 INFO:tasks.workunit.client.0.smithi112.stdout:9/814: chown d5/db4/dd1/f107 28 1 2024-09-21T00:57:00.788 INFO:tasks.workunit.client.0.smithi112.stdout:9/815: dread d5/d3b/d5f/d13/d54/f74 [0,4194304] 0 2024-09-21T00:57:00.804 INFO:tasks.workunit.client.0.smithi112.stdout:9/816: dread d5/f100 [0,4194304] 0 2024-09-21T00:57:00.805 INFO:tasks.workunit.client.0.smithi112.stdout:9/817: stat d5/d3b/d5f/d13/d54/d7d/d57/d6a/fe7 0 2024-09-21T00:57:00.819 INFO:tasks.workunit.client.0.smithi112.stdout:9/818: dread d5/d6/d19/fc6 [0,4194304] 0 2024-09-21T00:57:00.820 INFO:tasks.workunit.client.0.smithi112.stdout:9/819: write d5/d3b/d79/fe8 [783081,98255] 0 2024-09-21T00:57:00.822 INFO:tasks.workunit.client.0.smithi112.stdout:9/820: mknod d5/d3b/d79/d103/d105/c110 0 2024-09-21T00:57:00.899 INFO:tasks.workunit.client.0.smithi112.stdout:9/821: dread d5/d3b/d5f/d13/d54/d7d/f2b [0,4194304] 0 2024-09-21T00:57:00.957 INFO:tasks.workunit.client.0.smithi112.stdout:9/822: creat d5/d3b/d79/d103/f111 x:0 0 0 2024-09-21T00:57:00.960 INFO:tasks.workunit.client.0.smithi112.stdout:9/823: mkdir d5/d3b/d5f/d13/d54/d7d/d112 0 2024-09-21T00:57:00.975 INFO:tasks.workunit.client.0.smithi112.stdout:9/824: write d5/d3b/d5f/f24 [1230044,95326] 0 2024-09-21T00:57:00.977 INFO:tasks.workunit.client.0.smithi112.stdout:9/825: chown d5/d3b/d5f/d13/d54/d7d/d57/da8/f101 30675373 1 2024-09-21T00:57:00.997 INFO:tasks.workunit.client.0.smithi112.stdout:9/826: dread d5/f106 [0,4194304] 0 2024-09-21T00:57:01.005 INFO:tasks.workunit.client.0.smithi112.stdout:4/691: sync 2024-09-21T00:57:01.005 INFO:tasks.workunit.client.0.smithi112.stdout:7/728: sync 2024-09-21T00:57:01.006 INFO:tasks.workunit.client.0.smithi112.stdout:6/617: sync 2024-09-21T00:57:01.006 INFO:tasks.workunit.client.0.smithi112.stdout:5/517: sync 2024-09-21T00:57:01.009 INFO:tasks.workunit.client.0.smithi112.stdout:6/618: dread d9/d1f/d47/d34/da6/da7/dcf/d21/fa0 [0,4194304] 0 2024-09-21T00:57:01.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:00 smithi112 ceph-mon[28078]: pgmap v33: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 63 MiB/s rd, 169 MiB/s wr, 361 op/s 2024-09-21T00:57:01.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:00 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:01.011 INFO:tasks.workunit.client.0.smithi112.stdout:7/729: dread d0/d2/f31 [0,4194304] 0 2024-09-21T00:57:01.013 INFO:tasks.workunit.client.0.smithi112.stdout:6/619: write d9/d1f/d3e/d77/d46/f93 [9018598,67230] 0 2024-09-21T00:57:01.015 INFO:tasks.workunit.client.0.smithi112.stdout:5/518: fsync d8/d9/f27 0 2024-09-21T00:57:01.018 INFO:tasks.workunit.client.0.smithi112.stdout:5/519: chown d8/d9/d13/d1c/d99/f89 55 1 2024-09-21T00:57:01.018 INFO:tasks.workunit.client.0.smithi112.stdout:7/730: mknod d0/d2/d32/da4/cf1 0 2024-09-21T00:57:01.022 INFO:tasks.workunit.client.0.smithi112.stdout:6/620: dwrite d9/fc [0,4194304] 0 2024-09-21T00:57:01.025 INFO:tasks.workunit.client.0.smithi112.stdout:9/827: truncate d5/f106 3061976 0 2024-09-21T00:57:01.027 INFO:tasks.workunit.client.0.smithi112.stdout:4/692: write d1/d5/d1c/fa4 [136467,5408] 0 2024-09-21T00:57:01.031 INFO:tasks.workunit.client.0.smithi112.stdout:7/731: mknod d0/d2/d36/d39/d56/d65/d75/cf2 0 2024-09-21T00:57:01.031 INFO:tasks.workunit.client.0.smithi112.stdout:6/621: dread - d9/d1f/d47/d74/d8e/f9d zero size 2024-09-21T00:57:01.033 INFO:tasks.workunit.client.0.smithi112.stdout:6/622: fdatasync d9/d1f/d47/d74/fd8 0 2024-09-21T00:57:01.033 INFO:tasks.workunit.client.0.smithi112.stdout:4/693: truncate d1/d7/d9/f61 784251 0 2024-09-21T00:57:01.038 INFO:tasks.workunit.client.0.smithi112.stdout:9/828: link d5/d3b/d5f/f3d d5/d62/f113 0 2024-09-21T00:57:01.044 INFO:tasks.workunit.client.0.smithi112.stdout:9/829: unlink d5/d6/d3f/d7f/f8a 0 2024-09-21T00:57:01.052 INFO:tasks.workunit.client.0.smithi112.stdout:5/520: dread d8/d9/f27 [0,4194304] 0 2024-09-21T00:57:01.053 INFO:tasks.workunit.client.0.smithi112.stdout:5/521: write d8/d9/d13/d1c/f91 [4085593,126756] 0 2024-09-21T00:57:01.056 INFO:tasks.workunit.client.0.smithi112.stdout:7/732: write d0/d2/f68 [627498,38605] 0 2024-09-21T00:57:01.058 INFO:tasks.workunit.client.0.smithi112.stdout:5/522: rmdir d8/d9/d13/d2a/df 39 2024-09-21T00:57:01.059 INFO:tasks.workunit.client.0.smithi112.stdout:6/623: truncate d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f9b 1678356 0 2024-09-21T00:57:01.061 INFO:tasks.workunit.client.0.smithi112.stdout:7/733: mknod d0/d2/d36/d39/d56/d65/d75/d9a/cf3 0 2024-09-21T00:57:01.065 INFO:tasks.workunit.client.0.smithi112.stdout:9/830: write d5/f106 [1541131,7807] 0 2024-09-21T00:57:01.072 INFO:tasks.workunit.client.0.smithi112.stdout:6/624: write d9/d1f/d47/d34/da6/da7/dcf/d31/f68 [4283033,74203] 0 2024-09-21T00:57:01.073 INFO:tasks.workunit.client.0.smithi112.stdout:6/625: stat d9/d1f/d47/d34/da6/da7/dcf/d31/f68 0 2024-09-21T00:57:01.074 INFO:tasks.workunit.client.0.smithi112.stdout:7/734: rename d0/d2/d36/d39/d56/dc9 to d0/d2/d36/d39/d56/d65/df4 0 2024-09-21T00:57:01.077 INFO:tasks.workunit.client.0.smithi112.stdout:5/523: truncate d8/d9/d13/d2a/d58/f5e 3672154 0 2024-09-21T00:57:01.078 INFO:tasks.workunit.client.0.smithi112.stdout:5/524: write d8/d9/d13/d1c/f91 [4478065,32830] 0 2024-09-21T00:57:01.079 INFO:tasks.workunit.client.0.smithi112.stdout:9/831: creat d5/d3b/d5f/f114 x:0 0 0 2024-09-21T00:57:01.080 INFO:tasks.workunit.client.0.smithi112.stdout:9/832: dread - d5/d6/d3f/f10a zero size 2024-09-21T00:57:01.081 INFO:tasks.workunit.client.0.smithi112.stdout:9/833: write d5/d3b/d5f/d13/d54/f90 [8142949,119594] 0 2024-09-21T00:57:01.081 INFO:tasks.workunit.client.0.smithi112.stdout:6/626: mknod d9/d1f/d47/d74/d8b/daa/dcd/ce5 0 2024-09-21T00:57:01.083 INFO:tasks.workunit.client.0.smithi112.stdout:7/735: mknod d0/d2/d38/cf5 0 2024-09-21T00:57:01.089 INFO:tasks.workunit.client.0.smithi112.stdout:7/736: dwrite d0/d2/d32/fb7 [0,4194304] 0 2024-09-21T00:57:01.092 INFO:tasks.workunit.client.0.smithi112.stdout:6/627: creat d9/d1f/d47/d34/da6/da7/dcf/dbe/fe6 x:0 0 0 2024-09-21T00:57:01.094 INFO:tasks.workunit.client.0.smithi112.stdout:5/525: link d8/f3f d8/d9/d13/d2a/df/d5b/d75/fa6 0 2024-09-21T00:57:01.101 INFO:tasks.workunit.client.0.smithi112.stdout:9/834: getdents d5/d3b/d5f/d13/d6e 0 2024-09-21T00:57:01.102 INFO:tasks.workunit.client.0.smithi112.stdout:9/835: chown d5/d3b/d5f/d13/d54/dc1/ddc 1245 1 2024-09-21T00:57:01.103 INFO:tasks.workunit.client.0.smithi112.stdout:7/737: write d0/d2/d36/d39/d56/d65/f71 [508781,26205] 0 2024-09-21T00:57:01.104 INFO:tasks.workunit.client.0.smithi112.stdout:6/628: symlink d9/df/dca/le7 0 2024-09-21T00:57:01.104 INFO:tasks.workunit.client.0.smithi112.stdout:5/526: mknod d8/d9/d13/ca7 0 2024-09-21T00:57:01.105 INFO:tasks.workunit.client.0.smithi112.stdout:9/836: mkdir d5/d3b/d5f/d13/d56/d115 0 2024-09-21T00:57:01.106 INFO:tasks.workunit.client.0.smithi112.stdout:5/527: chown d8/f81 126 1 2024-09-21T00:57:01.107 INFO:tasks.workunit.client.0.smithi112.stdout:7/738: rename d0/d2/d36 to d0/d2/d2e/df6 0 2024-09-21T00:57:01.108 INFO:tasks.workunit.client.0.smithi112.stdout:7/739: chown d0/d2/f64 120 1 2024-09-21T00:57:01.108 INFO:tasks.workunit.client.0.smithi112.stdout:6/629: creat d9/d1f/d3e/d77/d79/d85/fe8 x:0 0 0 2024-09-21T00:57:01.109 INFO:tasks.workunit.client.0.smithi112.stdout:9/837: mkdir d5/d3b/d79/d103/d105/d116 0 2024-09-21T00:57:01.110 INFO:tasks.workunit.client.0.smithi112.stdout:5/528: symlink d8/d9/la8 0 2024-09-21T00:57:01.111 INFO:tasks.workunit.client.0.smithi112.stdout:7/740: symlink d0/d2/d32/da4/db2/lf7 0 2024-09-21T00:57:01.114 INFO:tasks.workunit.client.0.smithi112.stdout:5/529: symlink d8/d9/d13/d2a/d84/d8b/la9 0 2024-09-21T00:57:01.115 INFO:tasks.workunit.client.0.smithi112.stdout:6/630: dwrite d9/d1f/d3e/d77/d46/f92 [0,4194304] 0 2024-09-21T00:57:01.125 INFO:tasks.workunit.client.0.smithi112.stdout:5/530: dwrite d8/d9/d13/d1c/d99/f63 [4194304,4194304] 0 2024-09-21T00:57:01.126 INFO:tasks.workunit.client.0.smithi112.stdout:6/631: link d9/d1f/d3e/d77/d45/fe2 d9/df/d56/dbc/fe9 0 2024-09-21T00:57:01.127 INFO:tasks.workunit.client.0.smithi112.stdout:7/741: dwrite d0/d2/d2e/df6/d39/d56/d65/d75/fa6 [0,4194304] 0 2024-09-21T00:57:01.130 INFO:tasks.workunit.client.0.smithi112.stdout:6/632: chown d9/d1f/d3e/d77/d46/f92 372 1 2024-09-21T00:57:01.130 INFO:tasks.workunit.client.0.smithi112.stdout:7/742: unlink d0/d2/d2e/dcf/f94 0 2024-09-21T00:57:01.131 INFO:tasks.workunit.client.0.smithi112.stdout:5/531: stat d8/d9/d13/d2a/f93 0 2024-09-21T00:57:01.136 INFO:tasks.workunit.client.0.smithi112.stdout:9/838: dwrite d5/d3b/d5f/f81 [0,4194304] 0 2024-09-21T00:57:01.138 INFO:tasks.workunit.client.0.smithi112.stdout:9/839: chown d5/d3b/d79/d103/f111 188406 1 2024-09-21T00:57:01.139 INFO:tasks.workunit.client.0.smithi112.stdout:7/743: fsync d0/d2/f69 0 2024-09-21T00:57:01.141 INFO:tasks.workunit.client.0.smithi112.stdout:5/532: creat d8/d9/d13/d2a/da1/faa x:0 0 0 2024-09-21T00:57:01.142 INFO:tasks.workunit.client.0.smithi112.stdout:6/633: dwrite d9/d1f/f81 [0,4194304] 0 2024-09-21T00:57:01.144 INFO:tasks.workunit.client.0.smithi112.stdout:6/634: fdatasync d9/fb6 0 2024-09-21T00:57:01.144 INFO:tasks.workunit.client.0.smithi112.stdout:5/533: dread - d8/d9/d13/d2a/d84/d8b/fa2 zero size 2024-09-21T00:57:01.147 INFO:tasks.workunit.client.0.smithi112.stdout:9/840: fsync d5/d6/d70/f9f 0 2024-09-21T00:57:01.155 INFO:tasks.workunit.client.0.smithi112.stdout:5/534: dread d8/d9/d13/f51 [0,4194304] 0 2024-09-21T00:57:01.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:00 smithi187 ceph-mon[34997]: pgmap v33: 65 pgs: 65 active+clean; 3.1 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 63 MiB/s rd, 169 MiB/s wr, 361 op/s 2024-09-21T00:57:01.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:00 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:01.159 INFO:tasks.workunit.client.0.smithi112.stdout:6/635: fdatasync d9/df/d56/f7d 0 2024-09-21T00:57:01.159 INFO:tasks.workunit.client.0.smithi112.stdout:7/744: dwrite d0/f42 [0,4194304] 0 2024-09-21T00:57:01.160 INFO:tasks.workunit.client.0.smithi112.stdout:9/841: dwrite d5/d3b/d5f/f81 [0,4194304] 0 2024-09-21T00:57:01.167 INFO:tasks.workunit.client.0.smithi112.stdout:5/535: dwrite d8/d9/d13/d2a/df/f9c [0,4194304] 0 2024-09-21T00:57:01.169 INFO:tasks.workunit.client.0.smithi112.stdout:0/620: sync 2024-09-21T00:57:01.169 INFO:tasks.workunit.client.0.smithi112.stdout:1/664: sync 2024-09-21T00:57:01.169 INFO:tasks.workunit.client.0.smithi112.stdout:8/694: sync 2024-09-21T00:57:01.169 INFO:tasks.workunit.client.0.smithi112.stdout:3/972: sync 2024-09-21T00:57:01.169 INFO:tasks.workunit.client.0.smithi112.stdout:2/774: sync 2024-09-21T00:57:01.169 INFO:tasks.workunit.client.0.smithi112.stdout:6/636: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/dea 0 2024-09-21T00:57:01.173 INFO:tasks.workunit.client.0.smithi112.stdout:1/665: chown d5/d8/dd/d97/d46/l94 14139 1 2024-09-21T00:57:01.176 INFO:tasks.workunit.client.0.smithi112.stdout:3/973: fsync d2/d8/d28/d35/f59 0 2024-09-21T00:57:01.177 INFO:tasks.workunit.client.0.smithi112.stdout:3/974: rename d2/d38 to d2/d38/d14f 22 2024-09-21T00:57:01.178 INFO:tasks.workunit.client.0.smithi112.stdout:3/975: dread - d2/d33/d8c/f137 zero size 2024-09-21T00:57:01.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/666: dwrite d5/d8/d13/d87/faa [0,4194304] 0 2024-09-21T00:57:01.185 INFO:tasks.workunit.client.0.smithi112.stdout:0/621: unlink d8/d11/f1a 0 2024-09-21T00:57:01.185 INFO:tasks.workunit.client.0.smithi112.stdout:1/667: stat d5/d8/dd/d54/d5a/lb3 0 2024-09-21T00:57:01.188 INFO:tasks.workunit.client.0.smithi112.stdout:6/637: symlink d9/df/leb 0 2024-09-21T00:57:01.194 INFO:tasks.workunit.client.0.smithi112.stdout:1/668: unlink d5/d8/dd/c18 0 2024-09-21T00:57:01.194 INFO:tasks.workunit.client.0.smithi112.stdout:7/745: write d0/d2/d2e/df6/f90 [274155,92326] 0 2024-09-21T00:57:01.196 INFO:tasks.workunit.client.0.smithi112.stdout:0/622: dread - d8/d1b/d2c/d2e/d4c/d64/f8c zero size 2024-09-21T00:57:01.198 INFO:tasks.workunit.client.0.smithi112.stdout:7/746: chown d0/d2/d2e/df6/d39/d56/d65/d75/d9a/lca 538 1 2024-09-21T00:57:01.204 INFO:tasks.workunit.client.0.smithi112.stdout:9/842: dwrite d5/d6/f5a [0,4194304] 0 2024-09-21T00:57:01.207 INFO:tasks.workunit.client.0.smithi112.stdout:3/976: rename d2/d33/f56 to d2/d8/f150 0 2024-09-21T00:57:01.210 INFO:tasks.workunit.client.0.smithi112.stdout:5/536: dwrite d8/d9/d13/d2a/f6d [0,4194304] 0 2024-09-21T00:57:01.216 INFO:tasks.workunit.client.0.smithi112.stdout:2/775: truncate d0/d14/f37 3548019 0 2024-09-21T00:57:01.218 INFO:tasks.workunit.client.0.smithi112.stdout:1/669: dread d5/d8/dd/dcc/f60 [0,4194304] 0 2024-09-21T00:57:01.218 INFO:tasks.workunit.client.0.smithi112.stdout:3/977: mkdir d2/d33/d8c/db7/d128/d151 0 2024-09-21T00:57:01.219 INFO:tasks.workunit.client.0.smithi112.stdout:8/695: dwrite d0/d13/d1b/d22/d42/d51/f86 [0,4194304] 0 2024-09-21T00:57:01.222 INFO:tasks.workunit.client.0.smithi112.stdout:9/843: dwrite d5/d3b/d5f/d13/d6e/fd5 [0,4194304] 0 2024-09-21T00:57:01.227 INFO:tasks.workunit.client.0.smithi112.stdout:0/623: dread d8/d1b/f74 [0,4194304] 0 2024-09-21T00:57:01.229 INFO:tasks.workunit.client.0.smithi112.stdout:2/776: dwrite d0/f3c [4194304,4194304] 0 2024-09-21T00:57:01.231 INFO:tasks.workunit.client.0.smithi112.stdout:5/537: mkdir d8/d9/d13/d2a/dab 0 2024-09-21T00:57:01.234 INFO:tasks.workunit.client.0.smithi112.stdout:9/844: readlink d5/d6/l25 0 2024-09-21T00:57:01.235 INFO:tasks.workunit.client.0.smithi112.stdout:8/696: rename d0/d13/d2a/d73/l7f to d0/d13/dab/dc6/lda 0 2024-09-21T00:57:01.238 INFO:tasks.workunit.client.0.smithi112.stdout:5/538: truncate d8/d9/d13/d2a/df/d5b/d75/fa4 979299 0 2024-09-21T00:57:01.238 INFO:tasks.workunit.client.0.smithi112.stdout:3/978: creat d2/d8/dd/de/d4a/d4c/de2/f152 x:0 0 0 2024-09-21T00:57:01.240 INFO:tasks.workunit.client.0.smithi112.stdout:2/777: mkdir d0/d45/d8a/d62/dcf/dfb/dfe 0 2024-09-21T00:57:01.241 INFO:tasks.workunit.client.0.smithi112.stdout:2/778: stat d0/d45/d8a/f6f 0 2024-09-21T00:57:01.244 INFO:tasks.workunit.client.0.smithi112.stdout:9/845: creat d5/d3b/d5f/d13/d6e/da0/f117 x:0 0 0 2024-09-21T00:57:01.247 INFO:tasks.workunit.client.0.smithi112.stdout:8/697: rename d0/f3e to d0/d13/d2a/d73/d96/fdb 0 2024-09-21T00:57:01.249 INFO:tasks.workunit.client.0.smithi112.stdout:6/638: dread d9/d1f/d3e/d77/d45/fe2 [0,4194304] 0 2024-09-21T00:57:01.254 INFO:tasks.workunit.client.0.smithi112.stdout:4/694: sync 2024-09-21T00:57:01.256 INFO:tasks.workunit.client.0.smithi112.stdout:0/624: write d8/d11/f23 [2911444,107751] 0 2024-09-21T00:57:01.257 INFO:tasks.workunit.client.0.smithi112.stdout:4/695: chown d1/d7/d9/d1a/d22/c95 2 1 2024-09-21T00:57:01.257 INFO:tasks.workunit.client.0.smithi112.stdout:7/747: dread d0/d2/d2e/df6/d39/d56/d65/d75/f84 [0,4194304] 0 2024-09-21T00:57:01.260 INFO:tasks.workunit.client.0.smithi112.stdout:9/846: truncate d5/d6/d3f/d7f/da2/fe9 3018884 0 2024-09-21T00:57:01.260 INFO:tasks.workunit.client.0.smithi112.stdout:1/670: write d5/d8/dd/d97/d46/d70/f73 [822570,22321] 0 2024-09-21T00:57:01.264 INFO:tasks.workunit.client.0.smithi112.stdout:1/671: write d5/d3a/d4b/fd1 [743560,34566] 0 2024-09-21T00:57:01.267 INFO:tasks.workunit.client.0.smithi112.stdout:0/625: dread d8/d11/d28/f68 [0,4194304] 0 2024-09-21T00:57:01.269 INFO:tasks.workunit.client.0.smithi112.stdout:8/698: mkdir d0/d13/d2a/ddc 0 2024-09-21T00:57:01.271 INFO:tasks.workunit.client.0.smithi112.stdout:9/847: dwrite d5/d3b/d79/d91/fee [0,4194304] 0 2024-09-21T00:57:01.276 INFO:tasks.workunit.client.0.smithi112.stdout:5/539: rename d8/d9/d13/d2a/c9e to d8/d9/cac 0 2024-09-21T00:57:01.276 INFO:tasks.workunit.client.0.smithi112.stdout:2/779: dwrite d0/d14/d47/d70/f96 [0,4194304] 0 2024-09-21T00:57:01.276 INFO:tasks.workunit.client.0.smithi112.stdout:1/672: chown d5/d8/dd/d54/c75 107 1 2024-09-21T00:57:01.281 INFO:tasks.workunit.client.0.smithi112.stdout:1/673: fdatasync d5/d8/d14/f9a 0 2024-09-21T00:57:01.281 INFO:tasks.workunit.client.0.smithi112.stdout:6/639: write d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f69 [19793,77920] 0 2024-09-21T00:57:01.284 INFO:tasks.workunit.client.0.smithi112.stdout:8/699: readlink d0/d13/dab/dc6/lda 0 2024-09-21T00:57:01.284 INFO:tasks.workunit.client.0.smithi112.stdout:6/640: chown d9/d1f/d47/d34/da6/da7/dcf/d21 959 1 2024-09-21T00:57:01.286 INFO:tasks.workunit.client.0.smithi112.stdout:0/626: dwrite d8/d11/d28/f4e [4194304,4194304] 0 2024-09-21T00:57:01.289 INFO:tasks.workunit.client.0.smithi112.stdout:3/979: getdents d2/d8/dd/de/d4a/d4c 0 2024-09-21T00:57:01.290 INFO:tasks.workunit.client.0.smithi112.stdout:6/641: chown d9/d1f/d47/d34/da6/da7/dcf/d31/d41 3990 1 2024-09-21T00:57:01.292 INFO:tasks.workunit.client.0.smithi112.stdout:5/540: rmdir d8/d9/d61 39 2024-09-21T00:57:01.293 INFO:tasks.workunit.client.0.smithi112.stdout:7/748: truncate d0/d2/d2e/df6/f90 3759640 0 2024-09-21T00:57:01.296 INFO:tasks.workunit.client.0.smithi112.stdout:5/541: chown d8/d9/d13/d1c/d99/c95 1220 1 2024-09-21T00:57:01.297 INFO:tasks.workunit.client.0.smithi112.stdout:1/674: dwrite d5/d68/f90 [0,4194304] 0 2024-09-21T00:57:01.297 INFO:tasks.workunit.client.0.smithi112.stdout:9/848: creat d5/d3b/d79/df6/f118 x:0 0 0 2024-09-21T00:57:01.299 INFO:tasks.workunit.client.0.smithi112.stdout:4/696: rename d1/d5/d1c/d1e/d3d/fa3 to d1/d5/d1c/d1e/d4a/d5f/feb 0 2024-09-21T00:57:01.300 INFO:tasks.workunit.client.0.smithi112.stdout:5/542: chown d8/d9/d13/d2a/d84/c9a 1324 1 2024-09-21T00:57:01.301 INFO:tasks.workunit.client.0.smithi112.stdout:4/697: fsync d1/d75/dc2/fda 0 2024-09-21T00:57:01.302 INFO:tasks.workunit.client.0.smithi112.stdout:2/780: creat d0/d45/d8a/d83/def/fff x:0 0 0 2024-09-21T00:57:01.305 INFO:tasks.workunit.client.0.smithi112.stdout:1/675: unlink d5/d8/d14/fbf 0 2024-09-21T00:57:01.308 INFO:tasks.workunit.client.0.smithi112.stdout:3/980: rename d2/l81 to d2/d33/d8c/db7/d128/l153 0 2024-09-21T00:57:01.312 INFO:tasks.workunit.client.0.smithi112.stdout:0/627: link d8/d1b/d2c/d2e/d4c/d64/f6e d8/d11/d28/dbf/fc9 0 2024-09-21T00:57:01.313 INFO:tasks.workunit.client.0.smithi112.stdout:8/700: dwrite d0/d13/d1b/f53 [4194304,4194304] 0 2024-09-21T00:57:01.318 INFO:tasks.workunit.client.0.smithi112.stdout:7/749: mkdir d0/d2/d2e/df6/d39/d56/d65/d87/dd9/df8 0 2024-09-21T00:57:01.318 INFO:tasks.workunit.client.0.smithi112.stdout:6/642: truncate d9/d1f/d47/d74/fc5 1435800 0 2024-09-21T00:57:01.319 INFO:tasks.workunit.client.0.smithi112.stdout:7/750: chown d0/d2/d32/da4/db2/db4/cd5 4881 1 2024-09-21T00:57:01.320 INFO:tasks.workunit.client.0.smithi112.stdout:6/643: write d9/fb6 [421168,73573] 0 2024-09-21T00:57:01.324 INFO:tasks.workunit.client.0.smithi112.stdout:2/781: creat d0/d14/d22/d6d/f100 x:0 0 0 2024-09-21T00:57:01.324 INFO:tasks.workunit.client.0.smithi112.stdout:5/543: creat d8/d9/d13/d1c/d99/fad x:0 0 0 2024-09-21T00:57:01.326 INFO:tasks.workunit.client.0.smithi112.stdout:1/676: creat d5/d8/d13/d87/fdc x:0 0 0 2024-09-21T00:57:01.330 INFO:tasks.workunit.client.0.smithi112.stdout:8/701: chown d0/d13/dab/dcb/ccc 133 1 2024-09-21T00:57:01.330 INFO:tasks.workunit.client.0.smithi112.stdout:8/702: read - d0/d13/d9f/fd4 zero size 2024-09-21T00:57:01.332 INFO:tasks.workunit.client.0.smithi112.stdout:7/751: write d0/fa [4502567,1450] 0 2024-09-21T00:57:01.333 INFO:tasks.workunit.client.0.smithi112.stdout:7/752: write d0/fa [4459547,18385] 0 2024-09-21T00:57:01.334 INFO:tasks.workunit.client.0.smithi112.stdout:6/644: creat d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/fec x:0 0 0 2024-09-21T00:57:01.337 INFO:tasks.workunit.client.0.smithi112.stdout:6/645: chown d9/d1f/d47 4830 1 2024-09-21T00:57:01.339 INFO:tasks.workunit.client.0.smithi112.stdout:8/703: dwrite d0/d13/f27 [0,4194304] 0 2024-09-21T00:57:01.344 INFO:tasks.workunit.client.0.smithi112.stdout:4/698: creat d1/d5/d1c/d1e/fec x:0 0 0 2024-09-21T00:57:01.344 INFO:tasks.workunit.client.0.smithi112.stdout:2/782: dwrite d0/f67 [0,4194304] 0 2024-09-21T00:57:01.347 INFO:tasks.workunit.client.0.smithi112.stdout:7/753: mkdir d0/d2/d32/da4/df9 0 2024-09-21T00:57:01.349 INFO:tasks.workunit.client.0.smithi112.stdout:7/754: fsync d0/d2/d2e/df6/d39/d55/f9d 0 2024-09-21T00:57:01.354 INFO:tasks.workunit.client.0.smithi112.stdout:6/646: readlink d9/l16 0 2024-09-21T00:57:01.356 INFO:tasks.workunit.client.0.smithi112.stdout:9/849: getdents d5/d6/d19/d51/d8f 0 2024-09-21T00:57:01.359 INFO:tasks.workunit.client.0.smithi112.stdout:3/981: rename d2/d3e/d7b/d10d/d8a to d2/d8/dd/de/d154 0 2024-09-21T00:57:01.361 INFO:tasks.workunit.client.0.smithi112.stdout:3/982: write d2/f11f [92799,57175] 0 2024-09-21T00:57:01.362 INFO:tasks.workunit.client.0.smithi112.stdout:7/755: creat d0/d2/d2e/df6/de4/ffa x:0 0 0 2024-09-21T00:57:01.363 INFO:tasks.workunit.client.0.smithi112.stdout:6/647: dwrite d9/d1f/d3e/d77/f1d [4194304,4194304] 0 2024-09-21T00:57:01.363 INFO:tasks.workunit.client.0.smithi112.stdout:9/850: symlink d5/d3b/d5f/d13/d56/l119 0 2024-09-21T00:57:01.365 INFO:tasks.workunit.client.0.smithi112.stdout:1/677: rename d5/f98 to d5/d34/d6a/fdd 0 2024-09-21T00:57:01.369 INFO:tasks.workunit.client.0.smithi112.stdout:5/544: write d8/d9/d13/d2a/df/d5b/d75/f7e [2958217,69165] 0 2024-09-21T00:57:01.370 INFO:tasks.workunit.client.0.smithi112.stdout:0/628: write d8/d1b/f32 [935472,9855] 0 2024-09-21T00:57:01.371 INFO:tasks.workunit.client.0.smithi112.stdout:8/704: creat d0/d13/d1b/d22/fdd x:0 0 0 2024-09-21T00:57:01.373 INFO:tasks.workunit.client.0.smithi112.stdout:9/851: creat d5/d3b/d79/f11a x:0 0 0 2024-09-21T00:57:01.374 INFO:tasks.workunit.client.0.smithi112.stdout:5/545: dread d8/d9/d13/d1c/f53 [0,4194304] 0 2024-09-21T00:57:01.375 INFO:tasks.workunit.client.0.smithi112.stdout:2/783: creat d0/d14/d22/f101 x:0 0 0 2024-09-21T00:57:01.376 INFO:tasks.workunit.client.0.smithi112.stdout:7/756: read d0/d2/d2e/df6/f90 [1863636,54386] 0 2024-09-21T00:57:01.378 INFO:tasks.workunit.client.0.smithi112.stdout:0/629: mknod d8/d1b/d2c/d2e/d4c/d64/cca 0 2024-09-21T00:57:01.381 INFO:tasks.workunit.client.0.smithi112.stdout:9/852: chown d5/d6/l67 201719629 1 2024-09-21T00:57:01.382 INFO:tasks.workunit.client.0.smithi112.stdout:6/648: truncate d9/d1f/d47/d34/da6/da7/f76 2341130 0 2024-09-21T00:57:01.385 INFO:tasks.workunit.client.0.smithi112.stdout:5/546: dwrite d8/d9/d13/d1c/f3c [4194304,4194304] 0 2024-09-21T00:57:01.385 INFO:tasks.workunit.client.0.smithi112.stdout:3/983: rmdir d2/d8/d115 0 2024-09-21T00:57:01.386 INFO:tasks.workunit.client.0.smithi112.stdout:9/853: dread - d5/d3b/d5f/d13/d54/d55/f10f zero size 2024-09-21T00:57:01.390 INFO:tasks.workunit.client.0.smithi112.stdout:8/705: dwrite d0/d13/d1b/d22/d2e/d34/d7b/d80/f93 [0,4194304] 0 2024-09-21T00:57:01.393 INFO:tasks.workunit.client.0.smithi112.stdout:6/649: readlink d9/d1f/d47/d74/d8b/daa/dd4/l4d 0 2024-09-21T00:57:01.393 INFO:tasks.workunit.client.0.smithi112.stdout:5/547: stat d8/d9/d13/d2a/df/d5b/ca5 0 2024-09-21T00:57:01.395 INFO:tasks.workunit.client.0.smithi112.stdout:3/984: creat d2/d3e/d7b/f155 x:0 0 0 2024-09-21T00:57:01.396 INFO:tasks.workunit.client.0.smithi112.stdout:1/678: dread d5/d8/d10/f29 [0,4194304] 0 2024-09-21T00:57:01.400 INFO:tasks.workunit.client.0.smithi112.stdout:8/706: fdatasync d0/d13/f59 0 2024-09-21T00:57:01.402 INFO:tasks.workunit.client.0.smithi112.stdout:8/707: dread - d0/d13/d1b/d22/d42/d51/fcd zero size 2024-09-21T00:57:01.405 INFO:tasks.workunit.client.0.smithi112.stdout:1/679: dwrite d5/d8/d10/f16 [4194304,4194304] 0 2024-09-21T00:57:01.405 INFO:tasks.workunit.client.0.smithi112.stdout:0/630: link d8/d62/fa9 d8/fcb 0 2024-09-21T00:57:01.407 INFO:tasks.workunit.client.0.smithi112.stdout:0/631: chown d8/d1b/d2c/d2e/d4c/d64/cb1 36715 1 2024-09-21T00:57:01.411 INFO:tasks.workunit.client.0.smithi112.stdout:9/854: dread d5/f16 [4194304,4194304] 0 2024-09-21T00:57:01.416 INFO:tasks.workunit.client.0.smithi112.stdout:6/650: mkdir d9/d1f/d3e/d6f/de4/ded 0 2024-09-21T00:57:01.420 INFO:tasks.workunit.client.0.smithi112.stdout:8/708: mknod d0/d13/d2a/d73/d96/cde 0 2024-09-21T00:57:01.420 INFO:tasks.workunit.client.0.smithi112.stdout:7/757: write d0/d2/d2e/df6/d39/d56/d65/d87/fc8 [919094,102080] 0 2024-09-21T00:57:01.421 INFO:tasks.workunit.client.0.smithi112.stdout:3/985: creat d2/d8/dd/de/d4a/d4c/d145/f156 x:0 0 0 2024-09-21T00:57:01.424 INFO:tasks.workunit.client.0.smithi112.stdout:7/758: write d0/d2/d2e/df6/d39/d56/d65/d87/fd1 [838331,101252] 0 2024-09-21T00:57:01.425 INFO:tasks.workunit.client.0.smithi112.stdout:9/855: fdatasync d5/d6/d19/d51/d8f/fb8 0 2024-09-21T00:57:01.430 INFO:tasks.workunit.client.0.smithi112.stdout:6/651: unlink d9/df/f6c 0 2024-09-21T00:57:01.431 INFO:tasks.workunit.client.0.smithi112.stdout:9/856: dwrite d5/d3b/d79/fe8 [0,4194304] 0 2024-09-21T00:57:01.433 INFO:tasks.workunit.client.0.smithi112.stdout:8/709: dread - d0/d13/d1b/d22/d2e/d34/d7b/d80/fa3 zero size 2024-09-21T00:57:01.434 INFO:tasks.workunit.client.0.smithi112.stdout:6/652: truncate d9/d1f/d3e/d77/d45/d62/fd2 208293 0 2024-09-21T00:57:01.435 INFO:tasks.workunit.client.0.smithi112.stdout:3/986: symlink d2/d8/dd/de/d154/l157 0 2024-09-21T00:57:01.440 INFO:tasks.workunit.client.0.smithi112.stdout:3/987: chown d2/d8/f150 222 1 2024-09-21T00:57:01.442 INFO:tasks.workunit.client.0.smithi112.stdout:6/653: creat d9/d1f/d47/d34/da6/da7/dcf/d26/fee x:0 0 0 2024-09-21T00:57:01.443 INFO:tasks.workunit.client.0.smithi112.stdout:7/759: creat d0/d2/d2e/ded/ffb x:0 0 0 2024-09-21T00:57:01.449 INFO:tasks.workunit.client.0.smithi112.stdout:8/710: creat d0/d13/d1b/d22/d2e/d34/dd6/fdf x:0 0 0 2024-09-21T00:57:01.450 INFO:tasks.workunit.client.0.smithi112.stdout:7/760: rmdir d0/d2/d2e/ded 39 2024-09-21T00:57:01.452 INFO:tasks.workunit.client.0.smithi112.stdout:0/632: getdents d8/d5f 0 2024-09-21T00:57:01.454 INFO:tasks.workunit.client.0.smithi112.stdout:8/711: dread d0/d13/d2a/f6e [0,4194304] 0 2024-09-21T00:57:01.455 INFO:tasks.workunit.client.0.smithi112.stdout:6/654: mknod d9/d1f/d3e/dd1/cef 0 2024-09-21T00:57:01.456 INFO:tasks.workunit.client.0.smithi112.stdout:1/680: dwrite d5/f33 [0,4194304] 0 2024-09-21T00:57:01.458 INFO:tasks.workunit.client.0.smithi112.stdout:8/712: readlink d0/d13/d1b/d22/d2e/l60 0 2024-09-21T00:57:01.459 INFO:tasks.workunit.client.0.smithi112.stdout:3/988: creat d2/d33/f158 x:0 0 0 2024-09-21T00:57:01.460 INFO:tasks.workunit.client.0.smithi112.stdout:7/761: fdatasync d0/d2/d38/d48/f76 0 2024-09-21T00:57:01.461 INFO:tasks.workunit.client.0.smithi112.stdout:9/857: dwrite d5/d3b/d5f/d13/d54/d7d/d57/fb5 [0,4194304] 0 2024-09-21T00:57:01.461 INFO:tasks.workunit.client.0.smithi112.stdout:6/655: stat d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4 0 2024-09-21T00:57:01.479 INFO:tasks.workunit.client.0.smithi112.stdout:8/713: creat d0/d13/d2a/ddc/fe0 x:0 0 0 2024-09-21T00:57:01.479 INFO:tasks.workunit.client.0.smithi112.stdout:3/989: creat d2/d8/d6d/d139/f159 x:0 0 0 2024-09-21T00:57:01.482 INFO:tasks.workunit.client.0.smithi112.stdout:6/656: mknod d9/d1f/d47/d34/da6/da7/dcf/d31/d41/d9e/cf0 0 2024-09-21T00:57:01.487 INFO:tasks.workunit.client.0.smithi112.stdout:8/714: creat d0/d13/d2a/d73/d96/dbc/fe1 x:0 0 0 2024-09-21T00:57:01.488 INFO:tasks.workunit.client.0.smithi112.stdout:9/858: dread d5/d3b/d5f/f58 [0,4194304] 0 2024-09-21T00:57:01.488 INFO:tasks.workunit.client.0.smithi112.stdout:3/990: symlink d2/d8/dd/de/d154/l15a 0 2024-09-21T00:57:01.492 INFO:tasks.workunit.client.0.smithi112.stdout:7/762: rename d0/f3b to d0/d2/d32/da4/db2/db4/ffc 0 2024-09-21T00:57:01.492 INFO:tasks.workunit.client.0.smithi112.stdout:1/681: truncate d5/d34/f42 1303774 0 2024-09-21T00:57:01.496 INFO:tasks.workunit.client.0.smithi112.stdout:3/991: creat d2/d8/d28/dac/f15b x:0 0 0 2024-09-21T00:57:01.499 INFO:tasks.workunit.client.0.smithi112.stdout:7/763: symlink d0/d2/d2e/df6/d39/d56/d65/d87/lfd 0 2024-09-21T00:57:01.503 INFO:tasks.workunit.client.0.smithi112.stdout:3/992: fdatasync d2/d3e/f47 0 2024-09-21T00:57:01.505 INFO:tasks.workunit.client.0.smithi112.stdout:9/859: link d5/d3b/d79/d91/fee d5/d3b/d5f/d13/d54/d7d/d112/f11b 0 2024-09-21T00:57:01.505 INFO:tasks.workunit.client.0.smithi112.stdout:6/657: dread d9/d1f/fb3 [0,4194304] 0 2024-09-21T00:57:01.505 INFO:tasks.workunit.client.0.smithi112.stdout:3/993: write d2/d33/d8c/db7/d128/f148 [597817,14163] 0 2024-09-21T00:57:01.510 INFO:tasks.workunit.client.0.smithi112.stdout:9/860: dread d5/f106 [0,4194304] 0 2024-09-21T00:57:01.511 INFO:tasks.workunit.client.0.smithi112.stdout:1/682: link d5/d8/d13/d87/f9d d5/d34/d6a/dc9/fde 0 2024-09-21T00:57:01.513 INFO:tasks.workunit.client.0.smithi112.stdout:8/715: creat d0/d13/d1b/d22/d42/fe2 x:0 0 0 2024-09-21T00:57:01.517 INFO:tasks.workunit.client.0.smithi112.stdout:6/658: mknod d9/d1f/d47/d74/d8b/daa/cf1 0 2024-09-21T00:57:01.518 INFO:tasks.workunit.client.0.smithi112.stdout:8/716: dread d0/d13/d1b/d22/d2e/fc0 [0,4194304] 0 2024-09-21T00:57:01.520 INFO:tasks.workunit.client.0.smithi112.stdout:8/717: write d0/d13/d1b/d22/d42/d51/f86 [4749972,99967] 0 2024-09-21T00:57:01.527 INFO:tasks.workunit.client.0.smithi112.stdout:9/861: creat d5/d3b/d5f/db9/dde/dd7/f11c x:0 0 0 2024-09-21T00:57:01.527 INFO:tasks.workunit.client.0.smithi112.stdout:3/994: write d2/d8/d28/fb3 [1208492,36970] 0 2024-09-21T00:57:01.527 INFO:tasks.workunit.client.0.smithi112.stdout:7/764: dread d0/d2/d2e/df6/d39/f35 [0,4194304] 0 2024-09-21T00:57:01.529 INFO:tasks.workunit.client.0.smithi112.stdout:3/995: fdatasync d2/d8/dd/de/fda 0 2024-09-21T00:57:01.532 INFO:tasks.workunit.client.0.smithi112.stdout:6/659: symlink d9/d1f/d3e/d6f/dd3/lf2 0 2024-09-21T00:57:01.532 INFO:tasks.workunit.client.0.smithi112.stdout:6/660: readlink d9/df/dca/le7 0 2024-09-21T00:57:01.535 INFO:tasks.workunit.client.0.smithi112.stdout:1/683: dwrite d5/d8/dd/d97/d46/d70/f71 [0,4194304] 0 2024-09-21T00:57:01.537 INFO:tasks.workunit.client.0.smithi112.stdout:8/718: mkdir d0/d13/d1b/d22/d42/de3 0 2024-09-21T00:57:01.541 INFO:tasks.workunit.client.0.smithi112.stdout:6/661: creat d9/d1f/d47/d34/ff3 x:0 0 0 2024-09-21T00:57:01.543 INFO:tasks.workunit.client.0.smithi112.stdout:6/662: write d9/df/f27 [873659,64851] 0 2024-09-21T00:57:01.544 INFO:tasks.workunit.client.0.smithi112.stdout:9/862: mknod d5/d3b/d5f/d13/d56/d115/c11d 0 2024-09-21T00:57:01.545 INFO:tasks.workunit.client.0.smithi112.stdout:9/863: stat d5/d3b/d5f/d13/d54/d7d/d57/d6a/f97 0 2024-09-21T00:57:01.548 INFO:tasks.workunit.client.0.smithi112.stdout:7/765: getdents d0/d2/d32/da4/db2/db4 0 2024-09-21T00:57:01.549 INFO:tasks.workunit.client.0.smithi112.stdout:7/766: readlink d0/d2/d2e/df6/d39/d1a/l9e 0 2024-09-21T00:57:01.549 INFO:tasks.workunit.client.0.smithi112.stdout:9/864: mkdir d5/d3b/d5f/d59/d11e 0 2024-09-21T00:57:01.550 INFO:tasks.workunit.client.0.smithi112.stdout:6/663: symlink d9/df/d56/dde/lf4 0 2024-09-21T00:57:01.550 INFO:tasks.workunit.client.0.smithi112.stdout:9/865: write d5/f16 [12835448,18162] 0 2024-09-21T00:57:01.552 INFO:tasks.workunit.client.0.smithi112.stdout:1/684: rename d5/d8/d14/f25 to d5/d8/dd/d97/d46/fdf 0 2024-09-21T00:57:01.553 INFO:tasks.workunit.client.0.smithi112.stdout:6/664: dread - d9/d1f/d47/d34/da6/da7/dcf/d60/fc6 zero size 2024-09-21T00:57:01.554 INFO:tasks.workunit.client.0.smithi112.stdout:1/685: chown d5/d8/dd/d54/laf 155799444 1 2024-09-21T00:57:01.554 INFO:tasks.workunit.client.0.smithi112.stdout:3/996: write d2/d8/dd/de/d6b/f118 [148850,109105] 0 2024-09-21T00:57:01.557 INFO:tasks.workunit.client.0.smithi112.stdout:9/866: creat d5/d3b/d5f/d13/d54/d7d/d57/da8/f11f x:0 0 0 2024-09-21T00:57:01.560 INFO:tasks.workunit.client.0.smithi112.stdout:3/997: dread d2/d38/d3f/d53/d96/fd9 [0,4194304] 0 2024-09-21T00:57:01.562 INFO:tasks.workunit.client.0.smithi112.stdout:3/998: truncate d2/d8/dd/de/fda 1900522 0 2024-09-21T00:57:01.565 INFO:tasks.workunit.client.0.smithi112.stdout:8/719: dread d0/d13/d1b/f1e [0,4194304] 0 2024-09-21T00:57:01.566 INFO:tasks.workunit.client.0.smithi112.stdout:8/720: fdatasync d0/d13/d1b/f4c 0 2024-09-21T00:57:01.567 INFO:tasks.workunit.client.0.smithi112.stdout:7/767: truncate d0/d2/d32/fb7 1953311 0 2024-09-21T00:57:01.568 INFO:tasks.workunit.client.0.smithi112.stdout:3/999: mkdir d2/d33/d8c/db7/d11b/d15c 0 2024-09-21T00:57:01.568 INFO:tasks.workunit.client.0.smithi112.stdout:1/686: write d5/d34/d6a/dc9/fde [1284117,108134] 0 2024-09-21T00:57:01.572 INFO:tasks.workunit.client.0.smithi112.stdout:8/721: creat d0/fe4 x:0 0 0 2024-09-21T00:57:01.573 INFO:tasks.workunit.client.0.smithi112.stdout:7/768: chown d0/d2/d2e/df6/d39/l29 80981 1 2024-09-21T00:57:01.574 INFO:tasks.workunit.client.0.smithi112.stdout:7/769: write d0/d2/d32/f88 [4635242,94358] 0 2024-09-21T00:57:01.574 INFO:tasks.workunit.client.0.smithi112.stdout:6/665: getdents d9/d1f/d47/d74/d8b 0 2024-09-21T00:57:01.576 INFO:tasks.workunit.client.0.smithi112.stdout:8/722: creat d0/d13/d2a/d73/fe5 x:0 0 0 2024-09-21T00:57:01.578 INFO:tasks.workunit.client.0.smithi112.stdout:1/687: mknod d5/d8/dd/ce0 0 2024-09-21T00:57:01.579 INFO:tasks.workunit.client.0.smithi112.stdout:1/688: fsync d5/d3a/fb7 0 2024-09-21T00:57:01.581 INFO:tasks.workunit.client.0.smithi112.stdout:6/666: fsync d9/d1f/fb3 0 2024-09-21T00:57:01.582 INFO:tasks.workunit.client.0.smithi112.stdout:6/667: chown d9/d1f/d3e/d77/d45/fe2 3186581 1 2024-09-21T00:57:01.588 INFO:tasks.workunit.client.0.smithi112.stdout:8/723: link d0/d13/d1b/d22/d2e/d34/d7b/d80/fd2 d0/d13/d1b/d22/d2e/d34/d7b/d80/fe6 0 2024-09-21T00:57:01.589 INFO:tasks.workunit.client.0.smithi112.stdout:6/668: mknod d9/d1f/d47/d34/da6/da7/dcf/d21/d84/cf5 0 2024-09-21T00:57:01.592 INFO:tasks.workunit.client.0.smithi112.stdout:6/669: truncate d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/fec 797896 0 2024-09-21T00:57:01.594 INFO:tasks.workunit.client.0.smithi112.stdout:7/770: dread d0/d2/d2e/df6/d39/d56/d65/d75/d9a/feb [0,4194304] 0 2024-09-21T00:57:01.595 INFO:tasks.workunit.client.0.smithi112.stdout:1/689: link d5/l79 d5/d8/da1/le1 0 2024-09-21T00:57:01.598 INFO:tasks.workunit.client.0.smithi112.stdout:8/724: symlink d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1/le7 0 2024-09-21T00:57:01.602 INFO:tasks.workunit.client.0.smithi112.stdout:1/690: dwrite d5/d8/d13/d87/fdc [0,4194304] 0 2024-09-21T00:57:01.606 INFO:tasks.workunit.client.0.smithi112.stdout:1/691: truncate d5/d8/d10/f29 1258926 0 2024-09-21T00:57:01.606 INFO:tasks.workunit.client.0.smithi112.stdout:8/725: read d0/d13/d1b/d22/d42/d51/f76 [1088848,126853] 0 2024-09-21T00:57:01.607 INFO:tasks.workunit.client.0.smithi112.stdout:8/726: chown d0/d13/d1b/d22/c97 1360914 1 2024-09-21T00:57:01.610 INFO:tasks.workunit.client.0.smithi112.stdout:8/727: mkdir d0/d66/d88/de8 0 2024-09-21T00:57:01.613 INFO:tasks.workunit.client.0.smithi112.stdout:8/728: mknod d0/d13/dab/dc6/ce9 0 2024-09-21T00:57:01.618 INFO:tasks.workunit.client.0.smithi112.stdout:8/729: mknod d0/d13/d2a/cea 0 2024-09-21T00:57:01.631 INFO:tasks.workunit.client.0.smithi112.stdout:6/670: dread d9/f12 [4194304,4194304] 0 2024-09-21T00:57:01.631 INFO:tasks.workunit.client.0.smithi112.stdout:8/730: write d0/d13/d1b/d22/d2e/fa1 [1039375,119832] 0 2024-09-21T00:57:01.668 INFO:tasks.workunit.client.0.smithi112.stdout:8/731: mknod d0/d13/d1b/d22/d61/ceb 0 2024-09-21T00:57:01.679 INFO:tasks.workunit.client.0.smithi112.stdout:6/671: write d9/d1f/d3e/d77/d45/f80 [2899846,125082] 0 2024-09-21T00:57:01.680 INFO:tasks.workunit.client.0.smithi112.stdout:6/672: read d9/d1f/d3e/d77/d45/d62/fd2 [8177,13344] 0 2024-09-21T00:57:01.683 INFO:tasks.workunit.client.0.smithi112.stdout:6/673: mkdir d9/df/d56/dbc/df6 0 2024-09-21T00:57:01.687 INFO:tasks.workunit.client.0.smithi112.stdout:8/732: dwrite d0/d13/d1b/d22/d61/f67 [0,4194304] 0 2024-09-21T00:57:01.692 INFO:tasks.workunit.client.0.smithi112.stdout:8/733: read d0/d66/d88/f95 [158324,52096] 0 2024-09-21T00:57:01.695 INFO:tasks.workunit.client.0.smithi112.stdout:8/734: getdents d0/d13/d1b 0 2024-09-21T00:57:01.697 INFO:tasks.workunit.client.0.smithi112.stdout:8/735: symlink d0/d13/lec 0 2024-09-21T00:57:01.697 INFO:tasks.workunit.client.0.smithi112.stdout:8/736: chown d0/d13/dab 53973 1 2024-09-21T00:57:01.699 INFO:tasks.workunit.client.0.smithi112.stdout:8/737: mkdir d0/d13/d1b/d22/d2e/d34/d7b/d80/ded 0 2024-09-21T00:57:01.701 INFO:tasks.workunit.client.0.smithi112.stdout:8/738: dread d0/d13/d1b/d22/d42/d51/f9d [0,4194304] 0 2024-09-21T00:57:01.702 INFO:tasks.workunit.client.0.smithi112.stdout:8/739: stat d0/d13/d1b/f1e 0 2024-09-21T00:57:01.702 INFO:tasks.workunit.client.0.smithi112.stdout:6/674: dread d9/d1f/d47/d34/da6/da7/dcf/f39 [0,4194304] 0 2024-09-21T00:57:01.704 INFO:tasks.workunit.client.0.smithi112.stdout:8/740: chown d0/d13/d2a/f39 70006 1 2024-09-21T00:57:01.707 INFO:tasks.workunit.client.0.smithi112.stdout:8/741: read d0/d13/d2a/d73/f8a [45381,108082] 0 2024-09-21T00:57:01.712 INFO:tasks.workunit.client.0.smithi112.stdout:6/675: dread d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f9b [0,4194304] 0 2024-09-21T00:57:01.712 INFO:tasks.workunit.client.0.smithi112.stdout:8/742: link d0/d13/d1b/d22/d42/d51/f9d d0/d13/fee 0 2024-09-21T00:57:01.713 INFO:tasks.workunit.client.0.smithi112.stdout:8/743: chown d0/d13/d1b/d22/f23 14459 1 2024-09-21T00:57:01.713 INFO:tasks.workunit.client.0.smithi112.stdout:6/676: fdatasync d9/f12 0 2024-09-21T00:57:01.718 INFO:tasks.workunit.client.0.smithi112.stdout:6/677: symlink d9/lf7 0 2024-09-21T00:57:01.719 INFO:tasks.workunit.client.0.smithi112.stdout:8/744: write d0/d13/d1b/d22/f23 [1316678,75473] 0 2024-09-21T00:57:01.720 INFO:tasks.workunit.client.0.smithi112.stdout:6/678: truncate d9/df/f2e 1816511 0 2024-09-21T00:57:01.722 INFO:tasks.workunit.client.0.smithi112.stdout:8/745: truncate d0/d13/d1b/d22/f23 4991585 0 2024-09-21T00:57:01.723 INFO:tasks.workunit.client.0.smithi112.stdout:6/679: creat d9/d1f/d47/d74/d8b/ff8 x:0 0 0 2024-09-21T00:57:01.723 INFO:tasks.workunit.client.0.smithi112.stdout:8/746: mknod d0/d13/d1b/cef 0 2024-09-21T00:57:01.725 INFO:tasks.workunit.client.0.smithi112.stdout:6/680: write d9/d1f/d47/d34/da6/da7/f48 [1361192,108252] 0 2024-09-21T00:57:01.728 INFO:tasks.workunit.client.0.smithi112.stdout:6/681: dread d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f9b [0,4194304] 0 2024-09-21T00:57:01.746 INFO:tasks.workunit.client.0.smithi112.stdout:6/682: dwrite d9/d1f/d3e/d77/d45/fe2 [0,4194304] 0 2024-09-21T00:57:01.752 INFO:tasks.workunit.client.0.smithi112.stdout:6/683: rename d9/d1f/d3e/d6f/dd3/lf2 to d9/d1f/d47/d74/d8b/daa/dcd/lf9 0 2024-09-21T00:57:01.754 INFO:tasks.workunit.client.0.smithi112.stdout:6/684: fsync d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f95 0 2024-09-21T00:57:01.757 INFO:tasks.workunit.client.0.smithi112.stdout:6/685: mknod d9/d1f/d47/d34/da6/da7/dcf/d31/d41/d9e/cfa 0 2024-09-21T00:57:01.761 INFO:tasks.workunit.client.0.smithi112.stdout:6/686: dread d9/df/f2e [0,4194304] 0 2024-09-21T00:57:01.767 INFO:tasks.workunit.client.0.smithi112.stdout:6/687: write d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/fb5 [618585,87767] 0 2024-09-21T00:57:01.768 INFO:tasks.workunit.client.0.smithi112.stdout:6/688: read d9/d1f/d3e/d77/d46/f92 [354572,72330] 0 2024-09-21T00:57:01.770 INFO:tasks.workunit.client.0.smithi112.stdout:6/689: mknod d9/df/d56/dde/cfb 0 2024-09-21T00:57:01.772 INFO:tasks.workunit.client.0.smithi112.stdout:6/690: rename d9/d1f/lae to d9/d1f/d3e/d77/d45/d62/lfc 0 2024-09-21T00:57:01.774 INFO:tasks.workunit.client.0.smithi112.stdout:6/691: mkdir d9/d1f/d3e/d6f/de4/dfd 0 2024-09-21T00:57:01.784 INFO:tasks.workunit.client.0.smithi112.stdout:6/692: dread d9/d1f/d47/d34/da6/da7/dcf/f17 [0,4194304] 0 2024-09-21T00:57:01.787 INFO:tasks.workunit.client.0.smithi112.stdout:6/693: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/lfe 0 2024-09-21T00:57:01.790 INFO:tasks.workunit.client.0.smithi112.stdout:6/694: unlink d9/d1f/d47/d74/d8b/daa/dcd/lf9 0 2024-09-21T00:57:01.792 INFO:tasks.workunit.client.0.smithi112.stdout:6/695: write d9/d1f/d47/d34/da6/da7/dcf/d60/fc6 [687335,17904] 0 2024-09-21T00:57:01.796 INFO:tasks.workunit.client.0.smithi112.stdout:6/696: dread d9/d1f/d47/d34/da6/da7/dcf/f17 [0,4194304] 0 2024-09-21T00:57:01.801 INFO:tasks.workunit.client.0.smithi112.stdout:6/697: write d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f78 [1585423,54960] 0 2024-09-21T00:57:01.806 INFO:tasks.workunit.client.0.smithi112.stdout:6/698: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/dea/lff 0 2024-09-21T00:57:01.807 INFO:tasks.workunit.client.0.smithi112.stdout:6/699: mknod d9/d1f/d3e/d6f/de4/c100 0 2024-09-21T00:57:01.809 INFO:tasks.workunit.client.0.smithi112.stdout:6/700: truncate d9/d1f/d47/d34/f63 1807161 0 2024-09-21T00:57:01.811 INFO:tasks.workunit.client.0.smithi112.stdout:6/701: fsync d9/d1f/d3e/d77/d45/fe2 0 2024-09-21T00:57:01.812 INFO:tasks.workunit.client.0.smithi112.stdout:6/702: read d9/df/f2e [245915,29328] 0 2024-09-21T00:57:01.813 INFO:tasks.workunit.client.0.smithi112.stdout:6/703: rmdir d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/d70 39 2024-09-21T00:57:01.814 INFO:tasks.workunit.client.0.smithi112.stdout:6/704: chown d9/d1f/d47/d74 43 1 2024-09-21T00:57:01.815 INFO:tasks.workunit.client.0.smithi112.stdout:6/705: dread - d9/d1f/d3e/d77/d45/d62/fdf zero size 2024-09-21T00:57:01.829 INFO:tasks.workunit.client.0.smithi112.stdout:6/706: dread d9/d1f/d47/d34/da6/da7/dcf/d21/fc1 [0,4194304] 0 2024-09-21T00:57:01.835 INFO:tasks.workunit.client.0.smithi112.stdout:6/707: creat d9/d1f/d47/d34/da6/da7/dcf/d60/dc3/f101 x:0 0 0 2024-09-21T00:57:01.837 INFO:tasks.workunit.client.0.smithi112.stdout:6/708: rmdir d9/d1f/d3e/d77/d46/d8c 39 2024-09-21T00:57:01.837 INFO:tasks.workunit.client.0.smithi112.stdout:6/709: chown d9/d1f/d3e/d6f/de4 71338 1 2024-09-21T00:57:01.841 INFO:tasks.workunit.client.0.smithi112.stdout:6/710: link d9/fb6 d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/f102 0 2024-09-21T00:57:01.844 INFO:tasks.workunit.client.0.smithi112.stdout:6/711: unlink d9/d1f/d3e/cc2 0 2024-09-21T00:57:01.844 INFO:tasks.workunit.client.0.smithi112.stdout:6/712: chown d9/d1f/d3e/d77/d45/fe2 140 1 2024-09-21T00:57:01.845 INFO:tasks.workunit.client.0.smithi112.stdout:6/713: chown d9/f12 19332 1 2024-09-21T00:57:01.846 INFO:tasks.workunit.client.0.smithi112.stdout:6/714: fdatasync d9/d1f/d47/d74/fb4 0 2024-09-21T00:57:01.852 INFO:tasks.workunit.client.0.smithi112.stdout:6/715: dwrite d9/d1f/f65 [0,4194304] 0 2024-09-21T00:57:01.857 INFO:tasks.workunit.client.0.smithi112.stdout:6/716: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/l103 0 2024-09-21T00:57:01.860 INFO:tasks.workunit.client.0.smithi112.stdout:6/717: write d9/d1f/d47/d74/fb4 [199107,99900] 0 2024-09-21T00:57:01.867 INFO:tasks.workunit.client.0.smithi112.stdout:6/718: dwrite d9/df/f27 [0,4194304] 0 2024-09-21T00:57:01.871 INFO:tasks.workunit.client.0.smithi112.stdout:6/719: getdents d9/d1f/d3e/d6f/de4/ded 0 2024-09-21T00:57:01.873 INFO:tasks.workunit.client.0.smithi112.stdout:6/720: chown d9/df/c22 0 1 2024-09-21T00:57:01.879 INFO:tasks.workunit.client.0.smithi112.stdout:6/721: dread d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f78 [0,4194304] 0 2024-09-21T00:57:01.888 INFO:tasks.workunit.client.0.smithi112.stdout:6/722: write d9/d1f/d47/d34/da6/da7/dcf/d26/f8a [1002908,87782] 0 2024-09-21T00:57:01.891 INFO:tasks.workunit.client.0.smithi112.stdout:6/723: creat d9/df/d56/dde/f104 x:0 0 0 2024-09-21T00:57:01.891 INFO:tasks.workunit.client.0.smithi112.stdout:6/724: fsync d9/d1f/d47/d34/da6/fad 0 2024-09-21T00:57:01.896 INFO:tasks.workunit.client.0.smithi112.stdout:6/725: fdatasync d9/df/f59 0 2024-09-21T00:57:01.902 INFO:tasks.workunit.client.0.smithi112.stdout:6/726: dwrite d9/d1f/d47/d34/da6/da7/dcf/f15 [0,4194304] 0 2024-09-21T00:57:01.904 INFO:tasks.workunit.client.0.smithi112.stdout:6/727: truncate d9/d1f/d3e/d77/d45/fe2 4686858 0 2024-09-21T00:57:01.908 INFO:tasks.workunit.client.0.smithi112.stdout:6/728: creat d9/d1f/d3e/d77/d46/d99/f105 x:0 0 0 2024-09-21T00:57:01.911 INFO:tasks.workunit.client.0.smithi112.stdout:6/729: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/ddc/l106 0 2024-09-21T00:57:01.916 INFO:tasks.workunit.client.0.smithi112.stdout:6/730: rename d9/df/f2e to d9/d1f/d47/d74/d8b/daa/dcd/f107 0 2024-09-21T00:57:01.918 INFO:tasks.workunit.client.0.smithi112.stdout:6/731: creat d9/d1f/d3e/d77/f108 x:0 0 0 2024-09-21T00:57:01.933 INFO:tasks.workunit.client.0.smithi112.stdout:6/732: dread d9/d1f/d3e/d77/f37 [0,4194304] 0 2024-09-21T00:57:01.937 INFO:tasks.workunit.client.0.smithi112.stdout:6/733: unlink d9/d1f/d3e/d77/d45/d62/lfc 0 2024-09-21T00:57:01.938 INFO:tasks.workunit.client.0.smithi112.stdout:6/734: write d9/d1f/d3e/d77/d79/d85/fe8 [514668,120653] 0 2024-09-21T00:57:01.940 INFO:tasks.workunit.client.0.smithi112.stdout:6/735: write d9/d1f/d47/d34/da6/da7/dcf/f15 [2656879,108480] 0 2024-09-21T00:57:01.941 INFO:tasks.workunit.client.0.smithi112.stdout:6/736: write d9/d1f/d47/d74/d8b/fd5 [1109291,65242] 0 2024-09-21T00:57:01.945 INFO:tasks.workunit.client.0.smithi112.stdout:6/737: rename d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/l89 to d9/d1f/d3e/d6f/l109 0 2024-09-21T00:57:01.947 INFO:tasks.workunit.client.0.smithi112.stdout:6/738: readlink d9/d1f/d47/d34/da6/lc0 0 2024-09-21T00:57:01.947 INFO:tasks.workunit.client.0.smithi112.stdout:6/739: chown d9/d1f/f81 58 1 2024-09-21T00:57:01.949 INFO:tasks.workunit.client.0.smithi112.stdout:6/740: mknod d9/d1f/d47/d74/d8b/c10a 0 2024-09-21T00:57:01.954 INFO:tasks.workunit.client.0.smithi112.stdout:6/741: dwrite d9/d1f/f81 [4194304,4194304] 0 2024-09-21T00:57:01.964 INFO:tasks.workunit.client.0.smithi112.stdout:6/742: symlink d9/d1f/d3e/d77/d79/l10b 0 2024-09-21T00:57:01.967 INFO:tasks.workunit.client.0.smithi112.stdout:6/743: mknod d9/d1f/d47/d34/da6/da7/dcf/d60/dea/c10c 0 2024-09-21T00:57:01.970 INFO:tasks.workunit.client.0.smithi112.stdout:6/744: rename d9/d1f/d3e/dd1/cef to d9/d1f/d47/d74/d8b/daa/dcd/c10d 0 2024-09-21T00:57:01.976 INFO:tasks.workunit.client.0.smithi112.stdout:6/745: dwrite d9/d1f/d3e/d77/f1d [4194304,4194304] 0 2024-09-21T00:57:01.981 INFO:tasks.workunit.client.0.smithi112.stdout:6/746: mknod d9/d1f/d47/d74/d8e/c10e 0 2024-09-21T00:57:02.018 INFO:tasks.workunit.client.0.smithi112.stdout:6/747: dread d9/d1f/d47/d74/d8b/daa/dd4/f55 [0,4194304] 0 2024-09-21T00:57:02.022 INFO:tasks.workunit.client.0.smithi112.stdout:6/748: rename d9/d1f/d47/d34/da6/da7/dcf/f17 to d9/df/d56/dbc/df6/f10f 0 2024-09-21T00:57:02.026 INFO:tasks.workunit.client.0.smithi112.stdout:6/749: symlink d9/d1f/d47/d34/da6/l110 0 2024-09-21T00:57:02.026 INFO:tasks.workunit.client.0.smithi112.stdout:6/750: chown d9/d1f/f65 2608824 1 2024-09-21T00:57:02.051 INFO:tasks.workunit.client.0.smithi112.stdout:6/751: write d9/d1f/d47/d34/f36 [2555272,90944] 0 2024-09-21T00:57:02.054 INFO:tasks.workunit.client.0.smithi112.stdout:6/752: truncate d9/d1f/fb3 1777842 0 2024-09-21T00:57:02.060 INFO:tasks.workunit.client.0.smithi112.stdout:6/753: dwrite d9/d1f/d47/d34/da6/da7/dcf/f15 [0,4194304] 0 2024-09-21T00:57:02.061 INFO:tasks.workunit.client.0.smithi112.stdout:6/754: truncate d9/d1f/d47/d34/f36 4621361 0 2024-09-21T00:57:02.061 INFO:tasks.workunit.client.0.smithi112.stdout:6/755: chown d9/d1f/d3e/lb7 0 1 2024-09-21T00:57:02.478 INFO:tasks.workunit.client.0.smithi112.stdout:4/699: sync 2024-09-21T00:57:02.480 INFO:tasks.workunit.client.0.smithi112.stdout:4/700: chown d1/d7/d9/d1a/d22/d6e/c88 520296 1 2024-09-21T00:57:02.482 INFO:tasks.workunit.client.0.smithi112.stdout:4/701: creat d1/d75/fed x:0 0 0 2024-09-21T00:57:02.483 INFO:tasks.workunit.client.0.smithi112.stdout:4/702: mknod d1/d7/d9/d1a/cee 0 2024-09-21T00:57:02.485 INFO:tasks.workunit.client.0.smithi112.stdout:4/703: unlink d1/d5/d1c/d1e/d4a/d5f/f71 0 2024-09-21T00:57:02.488 INFO:tasks.workunit.client.0.smithi112.stdout:4/704: getdents d1/d7/d9 0 2024-09-21T00:57:02.490 INFO:tasks.workunit.client.0.smithi112.stdout:4/705: mknod d1/ddf/cef 0 2024-09-21T00:57:02.490 INFO:tasks.workunit.client.0.smithi112.stdout:4/706: dread - d1/d7/d9/fcb zero size 2024-09-21T00:57:02.492 INFO:tasks.workunit.client.0.smithi112.stdout:4/707: write d1/d5/d1c/d1e/d4a/f7d [1618559,12404] 0 2024-09-21T00:57:02.494 INFO:tasks.workunit.client.0.smithi112.stdout:4/708: truncate d1/d5/d1c/d1e/d4a/d5f/d83/fdd 460069 0 2024-09-21T00:57:02.508 INFO:tasks.workunit.client.0.smithi112.stdout:4/709: dread d1/d5/d1c/d1e/daf/fb4 [0,4194304] 0 2024-09-21T00:57:02.526 INFO:tasks.workunit.client.0.smithi112.stdout:4/710: write d1/d7/d30/d91/fc5 [585025,23320] 0 2024-09-21T00:57:02.527 INFO:tasks.workunit.client.0.smithi112.stdout:4/711: fsync d1/d2d/f8f 0 2024-09-21T00:57:02.535 INFO:tasks.workunit.client.0.smithi112.stdout:4/712: write d1/d5/d1c/d1e/d3d/fa8 [67469,112880] 0 2024-09-21T00:57:02.537 INFO:tasks.workunit.client.0.smithi112.stdout:4/713: creat d1/d7/d30/d91/ff0 x:0 0 0 2024-09-21T00:57:02.538 INFO:tasks.workunit.client.0.smithi112.stdout:4/714: fsync d1/d2d/d34/fe3 0 2024-09-21T00:57:02.541 INFO:tasks.workunit.client.0.smithi112.stdout:4/715: symlink d1/d75/lf1 0 2024-09-21T00:57:02.543 INFO:tasks.workunit.client.0.smithi112.stdout:4/716: chown d1/d7/d9/cc9 15254 1 2024-09-21T00:57:02.547 INFO:tasks.workunit.client.0.smithi112.stdout:4/717: creat d1/d5/d1c/d1e/ff2 x:0 0 0 2024-09-21T00:57:02.563 INFO:tasks.workunit.client.0.smithi112.stdout:4/718: dread d1/d5/fd [0,4194304] 0 2024-09-21T00:57:02.569 INFO:tasks.workunit.client.0.smithi112.stdout:4/719: write d1/d7/d9/d1a/d22/f72 [957517,49302] 0 2024-09-21T00:57:02.574 INFO:tasks.workunit.client.0.smithi112.stdout:4/720: rmdir d1/d5/d1c/d1e/d4a/dc8 0 2024-09-21T00:57:02.578 INFO:tasks.workunit.client.0.smithi112.stdout:4/721: link d1/d7/d9/c69 d1/d2d/d34/cf3 0 2024-09-21T00:57:02.579 INFO:tasks.workunit.client.0.smithi112.stdout:4/722: symlink d1/d7/d9/d1a/lf4 0 2024-09-21T00:57:02.580 INFO:tasks.workunit.client.0.smithi112.stdout:4/723: readlink d1/d2d/d34/lea 0 2024-09-21T00:57:02.581 INFO:tasks.workunit.client.0.smithi112.stdout:4/724: stat d1/d7/d9/d1a/d22/d6e/f94 0 2024-09-21T00:57:02.584 INFO:tasks.workunit.client.0.smithi112.stdout:4/725: symlink d1/d5/d1c/d1e/d4a/d5f/d83/lf5 0 2024-09-21T00:57:02.817 INFO:tasks.workunit.client.0.smithi112.stdout:0/633: sync 2024-09-21T00:57:02.818 INFO:tasks.workunit.client.0.smithi112.stdout:2/784: sync 2024-09-21T00:57:02.818 INFO:tasks.workunit.client.0.smithi112.stdout:5/548: sync 2024-09-21T00:57:02.819 INFO:tasks.workunit.client.0.smithi112.stdout:5/549: write d8/d9/d13/d1c/f91 [501892,58578] 0 2024-09-21T00:57:02.820 INFO:tasks.workunit.client.0.smithi112.stdout:0/634: rmdir d8/d11/d28/d54 39 2024-09-21T00:57:02.820 INFO:tasks.workunit.client.0.smithi112.stdout:0/635: readlink d8/d1b/d2c/d2e/lbb 0 2024-09-21T00:57:02.821 INFO:tasks.workunit.client.0.smithi112.stdout:5/550: truncate d8/d9/d13/d2a/d84/d8b/fa2 168787 0 2024-09-21T00:57:02.822 INFO:tasks.workunit.client.0.smithi112.stdout:5/551: chown d8/d9/f27 188625021 1 2024-09-21T00:57:02.822 INFO:tasks.workunit.client.0.smithi112.stdout:2/785: truncate d0/df/fb2 4520674 0 2024-09-21T00:57:02.823 INFO:tasks.workunit.client.0.smithi112.stdout:5/552: write d8/d9/d13/d1c/d45/f5a [663510,4716] 0 2024-09-21T00:57:02.829 INFO:tasks.workunit.client.0.smithi112.stdout:5/553: symlink d8/d9/d13/d2a/d2c/d96/d9f/lae 0 2024-09-21T00:57:02.829 INFO:tasks.workunit.client.0.smithi112.stdout:2/786: dread d0/d14/f50 [0,4194304] 0 2024-09-21T00:57:02.830 INFO:tasks.workunit.client.0.smithi112.stdout:0/636: write d8/d1b/f8e [1920124,127319] 0 2024-09-21T00:57:02.832 INFO:tasks.workunit.client.0.smithi112.stdout:5/554: fsync d8/d9/f60 0 2024-09-21T00:57:02.834 INFO:tasks.workunit.client.0.smithi112.stdout:2/787: mknod d0/d14/d8/da2/daa/c102 0 2024-09-21T00:57:02.838 INFO:tasks.workunit.client.0.smithi112.stdout:2/788: creat d0/d45/d8a/d83/f103 x:0 0 0 2024-09-21T00:57:02.841 INFO:tasks.workunit.client.0.smithi112.stdout:5/555: mknod d8/d9/d13/d2a/dab/caf 0 2024-09-21T00:57:02.844 INFO:tasks.workunit.client.0.smithi112.stdout:5/556: mknod d8/d9/d13/d2a/d84/cb0 0 2024-09-21T00:57:02.846 INFO:tasks.workunit.client.0.smithi112.stdout:2/789: creat d0/d14/f104 x:0 0 0 2024-09-21T00:57:02.847 INFO:tasks.workunit.client.0.smithi112.stdout:0/637: dwrite d8/d11/d28/d54/f55 [0,4194304] 0 2024-09-21T00:57:02.858 INFO:tasks.workunit.client.0.smithi112.stdout:2/790: dwrite d0/d45/d8a/d83/fe2 [0,4194304] 0 2024-09-21T00:57:02.861 INFO:tasks.workunit.client.0.smithi112.stdout:5/557: dwrite d8/d9/f64 [4194304,4194304] 0 2024-09-21T00:57:02.864 INFO:tasks.workunit.client.0.smithi112.stdout:0/638: dwrite d8/d11/d28/d54/f98 [0,4194304] 0 2024-09-21T00:57:02.867 INFO:tasks.workunit.client.0.smithi112.stdout:5/558: mknod d8/d9/d13/d2a/d58/cb1 0 2024-09-21T00:57:02.871 INFO:tasks.workunit.client.0.smithi112.stdout:0/639: symlink d8/d1b/d2c/d2e/d4c/d64/lcc 0 2024-09-21T00:57:02.872 INFO:tasks.workunit.client.0.smithi112.stdout:2/791: dwrite d0/d45/d8a/d83/f103 [0,4194304] 0 2024-09-21T00:57:02.874 INFO:tasks.workunit.client.0.smithi112.stdout:5/559: creat d8/d9/d13/d1c/fb2 x:0 0 0 2024-09-21T00:57:02.878 INFO:tasks.workunit.client.0.smithi112.stdout:2/792: unlink d0/df/d46/d58/l9d 0 2024-09-21T00:57:02.878 INFO:tasks.workunit.client.0.smithi112.stdout:0/640: mknod d8/d75/db2/ccd 0 2024-09-21T00:57:02.879 INFO:tasks.workunit.client.0.smithi112.stdout:0/641: chown d8/d75/db2 749956 1 2024-09-21T00:57:02.906 INFO:tasks.workunit.client.0.smithi112.stdout:5/560: write d8/d9/d13/f48 [3492784,74599] 0 2024-09-21T00:57:02.907 INFO:tasks.workunit.client.0.smithi112.stdout:0/642: truncate d8/d1b/f74 3616799 0 2024-09-21T00:57:02.909 INFO:tasks.workunit.client.0.smithi112.stdout:5/561: read d8/f30 [4048425,18244] 0 2024-09-21T00:57:02.911 INFO:tasks.workunit.client.0.smithi112.stdout:2/793: dwrite d0/d14/d8/d27/f64 [0,4194304] 0 2024-09-21T00:57:02.912 INFO:tasks.workunit.client.0.smithi112.stdout:0/643: mkdir d8/d11/d59/d78/dce 0 2024-09-21T00:57:02.913 INFO:tasks.workunit.client.0.smithi112.stdout:2/794: stat d0/d60/d78/la4 0 2024-09-21T00:57:02.913 INFO:tasks.workunit.client.0.smithi112.stdout:5/562: dread d8/d9/d13/d2a/df/d5b/d75/fa4 [0,4194304] 0 2024-09-21T00:57:02.917 INFO:tasks.workunit.client.0.smithi112.stdout:0/644: fsync d8/d62/fa9 0 2024-09-21T00:57:02.920 INFO:tasks.workunit.client.0.smithi112.stdout:5/563: rename d8/d9/d13/d1c/d99/f6e to d8/d9/d13/d1c/d99/fb3 0 2024-09-21T00:57:02.922 INFO:tasks.workunit.client.0.smithi112.stdout:0/645: creat d8/d62/fcf x:0 0 0 2024-09-21T00:57:02.923 INFO:tasks.workunit.client.0.smithi112.stdout:0/646: dread - d8/d75/db2/fc1 zero size 2024-09-21T00:57:02.928 INFO:tasks.workunit.client.0.smithi112.stdout:9/867: sync 2024-09-21T00:57:02.929 INFO:tasks.workunit.client.0.smithi112.stdout:0/647: creat d8/d11/d28/fd0 x:0 0 0 2024-09-21T00:57:02.930 INFO:tasks.workunit.client.0.smithi112.stdout:9/868: dread d5/d6/d3f/f4c [0,4194304] 0 2024-09-21T00:57:02.933 INFO:tasks.workunit.client.0.smithi112.stdout:0/648: rename d8/d1b/f32 to d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6/fd1 0 2024-09-21T00:57:02.933 INFO:tasks.workunit.client.0.smithi112.stdout:0/649: stat d8/d62/dbd 0 2024-09-21T00:57:02.934 INFO:tasks.workunit.client.0.smithi112.stdout:5/564: write d8/d9/d13/d2a/df/d5b/f98 [1514122,71318] 0 2024-09-21T00:57:02.935 INFO:tasks.workunit.client.0.smithi112.stdout:9/869: dread d5/d6/d3f/fc0 [0,4194304] 0 2024-09-21T00:57:02.937 INFO:tasks.workunit.client.0.smithi112.stdout:0/650: symlink d8/d1b/d2c/d2e/d4c/da8/ld2 0 2024-09-21T00:57:02.940 INFO:tasks.workunit.client.0.smithi112.stdout:0/651: mkdir d8/d11/d28/dbf/dd3 0 2024-09-21T00:57:02.942 INFO:tasks.workunit.client.0.smithi112.stdout:5/565: dread f7 [0,4194304] 0 2024-09-21T00:57:02.942 INFO:tasks.workunit.client.0.smithi112.stdout:9/870: dwrite d5/d3b/d5f/d13/d54/d7d/d57/fb5 [0,4194304] 0 2024-09-21T00:57:02.951 INFO:tasks.workunit.client.0.smithi112.stdout:9/871: truncate d5/d3b/d5f/d13/d54/dc1/fdf 1109312 0 2024-09-21T00:57:02.952 INFO:tasks.workunit.client.0.smithi112.stdout:5/566: write d8/d9/d13/d2a/df/f7f [15012,1966] 0 2024-09-21T00:57:02.959 INFO:tasks.workunit.client.0.smithi112.stdout:0/652: dread d8/d11/d28/f4e [0,4194304] 0 2024-09-21T00:57:02.959 INFO:tasks.workunit.client.0.smithi112.stdout:5/567: dwrite d8/d9/d13/d2a/d84/d8b/f82 [0,4194304] 0 2024-09-21T00:57:02.962 INFO:tasks.workunit.client.0.smithi112.stdout:9/872: write d5/d3b/d79/d91/fee [226091,26632] 0 2024-09-21T00:57:02.968 INFO:tasks.workunit.client.0.smithi112.stdout:5/568: dwrite d8/d9/d13/f48 [0,4194304] 0 2024-09-21T00:57:02.980 INFO:tasks.workunit.client.0.smithi112.stdout:5/569: link d8/d9/d13/d2a/df/d5b/d75/fa4 d8/d9/d13/fb4 0 2024-09-21T00:57:02.981 INFO:tasks.workunit.client.0.smithi112.stdout:9/873: dread d5/d6/f9b [0,4194304] 0 2024-09-21T00:57:02.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/653: truncate d8/d1b/d2c/f30 1133676 0 2024-09-21T00:57:02.982 INFO:tasks.workunit.client.0.smithi112.stdout:0/654: chown d8/f18 5196 1 2024-09-21T00:57:02.983 INFO:tasks.workunit.client.0.smithi112.stdout:9/874: write d5/d3b/d5f/d13/d6e/da0/f117 [1012710,31942] 0 2024-09-21T00:57:02.984 INFO:tasks.workunit.client.0.smithi112.stdout:5/570: unlink d8/d9/d13/d2a/d84/d8b/la9 0 2024-09-21T00:57:02.985 INFO:tasks.workunit.client.0.smithi112.stdout:5/571: chown d8/d9/d13/d1c/d45/d8a/c90 1 1 2024-09-21T00:57:02.986 INFO:tasks.workunit.client.0.smithi112.stdout:0/655: symlink d8/d75/d91/d9b/ld4 0 2024-09-21T00:57:02.987 INFO:tasks.workunit.client.0.smithi112.stdout:9/875: symlink d5/d6/d19/d51/l120 0 2024-09-21T00:57:02.993 INFO:tasks.workunit.client.0.smithi112.stdout:5/572: dwrite d8/d9/d13/d2a/df/d5b/d75/f7e [4194304,4194304] 0 2024-09-21T00:57:02.994 INFO:tasks.workunit.client.0.smithi112.stdout:9/876: dread d5/d3b/d5f/d13/d54/d7d/d57/da8/f101 [0,4194304] 0 2024-09-21T00:57:03.002 INFO:tasks.workunit.client.0.smithi112.stdout:9/877: dwrite d5/d3b/d79/f11a [0,4194304] 0 2024-09-21T00:57:03.008 INFO:tasks.workunit.client.0.smithi112.stdout:9/878: getdents d5/d6/d19/d51 0 2024-09-21T00:57:03.011 INFO:tasks.workunit.client.0.smithi112.stdout:9/879: symlink d5/d3b/d5f/d13/d54/d55/l121 0 2024-09-21T00:57:03.014 INFO:tasks.workunit.client.0.smithi112.stdout:9/880: unlink d5/l94 0 2024-09-21T00:57:03.015 INFO:tasks.workunit.client.0.smithi112.stdout:9/881: chown d5/c71 0 1 2024-09-21T00:57:03.016 INFO:tasks.workunit.client.0.smithi112.stdout:9/882: fsync d5/d3b/d5f/d13/fd3 0 2024-09-21T00:57:03.019 INFO:tasks.workunit.client.0.smithi112.stdout:9/883: creat d5/d3b/d79/df6/f122 x:0 0 0 2024-09-21T00:57:03.021 INFO:tasks.workunit.client.0.smithi112.stdout:9/884: write d5/d3b/d5f/d13/f5d [2138288,48965] 0 2024-09-21T00:57:03.022 INFO:tasks.workunit.client.0.smithi112.stdout:0/656: dread d8/d1b/d2c/f30 [0,4194304] 0 2024-09-21T00:57:03.026 INFO:tasks.workunit.client.0.smithi112.stdout:5/573: dread d8/f3f [0,4194304] 0 2024-09-21T00:57:03.027 INFO:tasks.workunit.client.0.smithi112.stdout:0/657: mknod d8/d1b/d2c/d2e/d4c/d64/cd5 0 2024-09-21T00:57:03.031 INFO:tasks.workunit.client.0.smithi112.stdout:5/574: mkdir d8/d9/d13/d2a/df/db5 0 2024-09-21T00:57:03.031 INFO:tasks.workunit.client.0.smithi112.stdout:5/575: stat d8/f3f 0 2024-09-21T00:57:03.033 INFO:tasks.workunit.client.0.smithi112.stdout:5/576: fsync d8/d9/d13/d2a/df/f72 0 2024-09-21T00:57:03.035 INFO:tasks.workunit.client.0.smithi112.stdout:5/577: mkdir d8/d9/d13/d2a/df/d5b/d75/db6 0 2024-09-21T00:57:03.043 INFO:tasks.workunit.client.0.smithi112.stdout:5/578: link d8/d9/d13/d1c/l87 d8/d9/d13/d2a/d2c/d96/lb7 0 2024-09-21T00:57:03.045 INFO:tasks.workunit.client.0.smithi112.stdout:5/579: fsync d8/f81 0 2024-09-21T00:57:03.048 INFO:tasks.workunit.client.0.smithi112.stdout:5/580: truncate d8/d9/d13/d1c/f53 272758 0 2024-09-21T00:57:03.057 INFO:tasks.workunit.client.0.smithi112.stdout:0/658: write d8/d1b/f7e [1624880,37605] 0 2024-09-21T00:57:03.059 INFO:tasks.workunit.client.0.smithi112.stdout:9/885: dwrite d5/d6/d19/d51/fda [0,4194304] 0 2024-09-21T00:57:03.061 INFO:tasks.workunit.client.0.smithi112.stdout:0/659: read - d8/d1b/f61 zero size 2024-09-21T00:57:03.063 INFO:tasks.workunit.client.0.smithi112.stdout:9/886: mkdir d5/d3b/d5f/d59/d123 0 2024-09-21T00:57:03.069 INFO:tasks.workunit.client.0.smithi112.stdout:9/887: rename d5/d3b/d5f/d13/d54/d55/l121 to d5/d6/d19/dfc/l124 0 2024-09-21T00:57:03.072 INFO:tasks.workunit.client.0.smithi112.stdout:9/888: truncate d5/d3b/d5f/db9/dde/dd7/f11c 1005813 0 2024-09-21T00:57:03.076 INFO:tasks.workunit.client.0.smithi112.stdout:0/660: link d8/d1b/d2c/d2e/d4c/d6b/lbc d8/d62/ld6 0 2024-09-21T00:57:03.076 INFO:tasks.workunit.client.0.smithi112.stdout:9/889: write d5/d3b/d5f/d13/fc4 [2530525,28392] 0 2024-09-21T00:57:03.077 INFO:tasks.workunit.client.0.smithi112.stdout:0/661: read - d8/d75/db2/fc1 zero size 2024-09-21T00:57:03.078 INFO:tasks.workunit.client.0.smithi112.stdout:9/890: write d5/d3b/d5f/dfb/f104 [430931,21632] 0 2024-09-21T00:57:03.087 INFO:tasks.workunit.client.0.smithi112.stdout:5/581: dwrite d8/d9/d13/f86 [4194304,4194304] 0 2024-09-21T00:57:03.090 INFO:tasks.workunit.client.0.smithi112.stdout:0/662: rename d8/d75/db2 to d8/d11/d28/dbf/dd3/dd7 0 2024-09-21T00:57:03.093 INFO:tasks.workunit.client.0.smithi112.stdout:9/891: creat d5/d3b/d79/d103/d105/f125 x:0 0 0 2024-09-21T00:57:03.093 INFO:tasks.workunit.client.0.smithi112.stdout:9/892: stat d5/d6/ff7 0 2024-09-21T00:57:03.098 INFO:tasks.workunit.client.0.smithi112.stdout:5/582: creat d8/d9/d13/d2a/d84/d8b/fb8 x:0 0 0 2024-09-21T00:57:03.101 INFO:tasks.workunit.client.0.smithi112.stdout:6/756: sync 2024-09-21T00:57:03.101 INFO:tasks.workunit.client.0.smithi112.stdout:0/663: creat d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6/fd8 x:0 0 0 2024-09-21T00:57:03.103 INFO:tasks.workunit.client.0.smithi112.stdout:7/771: sync 2024-09-21T00:57:03.103 INFO:tasks.workunit.client.0.smithi112.stdout:1/692: sync 2024-09-21T00:57:03.103 INFO:tasks.workunit.client.0.smithi112.stdout:8/747: sync 2024-09-21T00:57:03.103 INFO:tasks.workunit.client.0.smithi112.stdout:4/726: sync 2024-09-21T00:57:03.104 INFO:tasks.workunit.client.0.smithi112.stdout:9/893: mknod d5/d6/c126 0 2024-09-21T00:57:03.107 INFO:tasks.workunit.client.0.smithi112.stdout:0/664: symlink d8/d75/d91/d9b/ld9 0 2024-09-21T00:57:03.112 INFO:tasks.workunit.client.0.smithi112.stdout:0/665: readlink d8/d1b/d2c/d2e/lbb 0 2024-09-21T00:57:03.112 INFO:tasks.workunit.client.0.smithi112.stdout:4/727: mkdir d1/d2d/d34/df6 0 2024-09-21T00:57:03.116 INFO:tasks.workunit.client.0.smithi112.stdout:7/772: fsync d0/d2/d2e/df6/d39/d56/f77 0 2024-09-21T00:57:03.118 INFO:tasks.workunit.client.0.smithi112.stdout:8/748: readlink d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1/le7 0 2024-09-21T00:57:03.124 INFO:tasks.workunit.client.0.smithi112.stdout:0/666: mknod d8/d11/d28/dbf/dd3/cda 0 2024-09-21T00:57:03.125 INFO:tasks.workunit.client.0.smithi112.stdout:7/773: dwrite d0/d2/d32/f88 [0,4194304] 0 2024-09-21T00:57:03.128 INFO:tasks.workunit.client.0.smithi112.stdout:8/749: creat d0/ff0 x:0 0 0 2024-09-21T00:57:03.133 INFO:tasks.workunit.client.0.smithi112.stdout:9/894: dread d5/d6/d3f/d7f/da2/fe9 [0,4194304] 0 2024-09-21T00:57:03.134 INFO:tasks.workunit.client.0.smithi112.stdout:9/895: readlink d5/d3b/d5f/d13/l64 0 2024-09-21T00:57:03.135 INFO:tasks.workunit.client.0.smithi112.stdout:0/667: creat d8/d75/d9c/fdb x:0 0 0 2024-09-21T00:57:03.137 INFO:tasks.workunit.client.0.smithi112.stdout:5/583: dwrite d8/d9/d13/d1c/f53 [0,4194304] 0 2024-09-21T00:57:03.137 INFO:tasks.workunit.client.0.smithi112.stdout:6/757: link d9/d1f/d47/d34/da6/da7/dcf/d31/d41/l67 d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/l111 0 2024-09-21T00:57:03.140 INFO:tasks.workunit.client.0.smithi112.stdout:1/693: creat d5/d8/dd/d97/fe2 x:0 0 0 2024-09-21T00:57:03.144 INFO:tasks.workunit.client.0.smithi112.stdout:8/750: symlink d0/d13/d1b/d22/d42/d51/d9a/lf1 0 2024-09-21T00:57:03.145 INFO:tasks.workunit.client.0.smithi112.stdout:9/896: dwrite d5/d3b/d79/df6/f118 [0,4194304] 0 2024-09-21T00:57:03.147 INFO:tasks.workunit.client.0.smithi112.stdout:8/751: dread d0/d13/d2a/f6e [0,4194304] 0 2024-09-21T00:57:03.147 INFO:tasks.workunit.client.0.smithi112.stdout:5/584: mknod d8/d9/d13/d2a/df/d5b/d75/cb9 0 2024-09-21T00:57:03.148 INFO:tasks.workunit.client.0.smithi112.stdout:6/758: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/d112 0 2024-09-21T00:57:03.151 INFO:tasks.workunit.client.0.smithi112.stdout:5/585: write d8/f9d [909375,10318] 0 2024-09-21T00:57:03.153 INFO:tasks.workunit.client.0.smithi112.stdout:8/752: truncate d0/d13/d1b/d22/fdd 557181 0 2024-09-21T00:57:03.157 INFO:tasks.workunit.client.0.smithi112.stdout:7/774: link d0/d2/d2e/df6/d39/l29 d0/d2/d2e/df6/d39/d56/d65/d87/lfe 0 2024-09-21T00:57:03.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:02 smithi187 ceph-mon[34997]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 81 MiB/s rd, 214 MiB/s wr, 484 op/s 2024-09-21T00:57:03.160 INFO:tasks.workunit.client.0.smithi112.stdout:9/897: unlink d5/d3b/d79/d91/lbc 0 2024-09-21T00:57:03.162 INFO:tasks.workunit.client.0.smithi112.stdout:5/586: rename d8/d9/d13/d2a/d2c/l56 to d8/d9/d13/d1c/d45/d8a/lba 0 2024-09-21T00:57:03.167 INFO:tasks.workunit.client.0.smithi112.stdout:9/898: truncate d5/f17 2068703 0 2024-09-21T00:57:03.174 INFO:tasks.workunit.client.0.smithi112.stdout:0/668: getdents d8/d1b/d2c/d2e 0 2024-09-21T00:57:03.178 INFO:tasks.workunit.client.0.smithi112.stdout:1/694: dwrite d5/d8/dd/f4e [0,4194304] 0 2024-09-21T00:57:03.179 INFO:tasks.workunit.client.0.smithi112.stdout:8/753: getdents d0/d66 0 2024-09-21T00:57:03.182 INFO:tasks.workunit.client.0.smithi112.stdout:7/775: getdents d0/d2/d2e/df6/d39/d56 0 2024-09-21T00:57:03.183 INFO:tasks.workunit.client.0.smithi112.stdout:9/899: dread d5/d6/d70/f92 [4194304,4194304] 0 2024-09-21T00:57:03.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/695: chown d5/d8/dd/d97/fb2 16678324 1 2024-09-21T00:57:03.183 INFO:tasks.workunit.client.0.smithi112.stdout:9/900: stat d5/d6/d3f/ff9 0 2024-09-21T00:57:03.186 INFO:tasks.workunit.client.0.smithi112.stdout:0/669: truncate d8/f19 5328875 0 2024-09-21T00:57:03.186 INFO:tasks.workunit.client.0.smithi112.stdout:0/670: chown d8/fcb 0 1 2024-09-21T00:57:03.187 INFO:tasks.workunit.client.0.smithi112.stdout:6/759: getdents d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/d70 0 2024-09-21T00:57:03.188 INFO:tasks.workunit.client.0.smithi112.stdout:5/587: truncate d8/d9/d13/d2a/d84/d8b/f82 1912417 0 2024-09-21T00:57:03.191 INFO:tasks.workunit.client.0.smithi112.stdout:7/776: dread - d0/d2/d38/d48/dad/f9b zero size 2024-09-21T00:57:03.193 INFO:tasks.workunit.client.0.smithi112.stdout:1/696: creat d5/d8/d13/d87/fe3 x:0 0 0 2024-09-21T00:57:03.196 INFO:tasks.workunit.client.0.smithi112.stdout:0/671: rmdir d8/d75/d91 39 2024-09-21T00:57:03.200 INFO:tasks.workunit.client.0.smithi112.stdout:5/588: creat d8/d9/d13/d2a/df/fbb x:0 0 0 2024-09-21T00:57:03.212 INFO:tasks.workunit.client.0.smithi112.stdout:8/754: dread d0/d13/d1b/f53 [4194304,4194304] 0 2024-09-21T00:57:03.212 INFO:tasks.workunit.client.0.smithi112.stdout:9/901: dwrite d5/d3b/d5f/d13/d54/d7d/f2b [0,4194304] 0 2024-09-21T00:57:03.212 INFO:tasks.workunit.client.0.smithi112.stdout:5/589: mkdir d8/d9/d13/d1c/dbc 0 2024-09-21T00:57:03.216 INFO:tasks.workunit.client.0.smithi112.stdout:1/697: mkdir d5/d34/de4 0 2024-09-21T00:57:03.219 INFO:tasks.workunit.client.0.smithi112.stdout:0/672: symlink d8/d1b/d2c/d2e/d4c/d6b/dc2/ldc 0 2024-09-21T00:57:03.221 INFO:tasks.workunit.client.0.smithi112.stdout:8/755: mkdir d0/d13/d1b/d22/d42/d51/df2 0 2024-09-21T00:57:03.222 INFO:tasks.workunit.client.0.smithi112.stdout:5/590: truncate d8/fa 5193479 0 2024-09-21T00:57:03.222 INFO:tasks.workunit.client.0.smithi112.stdout:7/777: dwrite d0/d2/d2e/df6/d39/db3/fd7 [0,4194304] 0 2024-09-21T00:57:03.223 INFO:tasks.workunit.client.0.smithi112.stdout:8/756: write d0/d13/d2a/ddc/fe0 [595130,80198] 0 2024-09-21T00:57:03.228 INFO:tasks.workunit.client.0.smithi112.stdout:1/698: unlink d5/d8/f12 0 2024-09-21T00:57:03.231 INFO:tasks.workunit.client.0.smithi112.stdout:0/673: fdatasync d8/d5f/f7d 0 2024-09-21T00:57:03.234 INFO:tasks.workunit.client.0.smithi112.stdout:7/778: mknod d0/d2/d2e/dcf/dc3/cff 0 2024-09-21T00:57:03.237 INFO:tasks.workunit.client.0.smithi112.stdout:1/699: fdatasync d5/d8/dd/d97/d46/fac 0 2024-09-21T00:57:03.237 INFO:tasks.workunit.client.0.smithi112.stdout:9/902: write d5/d3b/d5f/d13/fae [646588,23097] 0 2024-09-21T00:57:03.239 INFO:tasks.workunit.client.0.smithi112.stdout:9/903: write d5/d6/d3f/ff9 [631813,82099] 0 2024-09-21T00:57:03.243 INFO:tasks.workunit.client.0.smithi112.stdout:0/674: write d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6/fd1 [776371,128650] 0 2024-09-21T00:57:03.244 INFO:tasks.workunit.client.0.smithi112.stdout:9/904: dread d5/d3b/d5f/d13/fae [0,4194304] 0 2024-09-21T00:57:03.247 INFO:tasks.workunit.client.0.smithi112.stdout:7/779: chown d0/d2/d2e/dcf/l3e 20044930 1 2024-09-21T00:57:03.248 INFO:tasks.workunit.client.0.smithi112.stdout:8/757: dread d0/d13/d1b/f53 [0,4194304] 0 2024-09-21T00:57:03.252 INFO:tasks.workunit.client.0.smithi112.stdout:5/591: creat d8/fbd x:0 0 0 2024-09-21T00:57:03.255 INFO:tasks.workunit.client.0.smithi112.stdout:1/700: dread d5/d68/f90 [4194304,4194304] 0 2024-09-21T00:57:03.255 INFO:tasks.workunit.client.0.smithi112.stdout:7/780: symlink d0/d2/d32/l100 0 2024-09-21T00:57:03.257 INFO:tasks.workunit.client.0.smithi112.stdout:7/781: read d0/d2/f68 [3175122,102479] 0 2024-09-21T00:57:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:02 smithi112 ceph-mon[28078]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 81 MiB/s rd, 214 MiB/s wr, 484 op/s 2024-09-21T00:57:03.266 INFO:tasks.workunit.client.0.smithi112.stdout:0/675: dwrite d8/f20 [0,4194304] 0 2024-09-21T00:57:03.266 INFO:tasks.workunit.client.0.smithi112.stdout:8/758: creat d0/d13/d1b/d22/d2e/d34/d7b/d80/ded/ff3 x:0 0 0 2024-09-21T00:57:03.268 INFO:tasks.workunit.client.0.smithi112.stdout:7/782: truncate d0/d2/d38/d48/dad/fd6 36498 0 2024-09-21T00:57:03.271 INFO:tasks.workunit.client.0.smithi112.stdout:5/592: dwrite d8/d9/f27 [4194304,4194304] 0 2024-09-21T00:57:03.273 INFO:tasks.workunit.client.0.smithi112.stdout:1/701: mknod d5/d34/ce5 0 2024-09-21T00:57:03.276 INFO:tasks.workunit.client.0.smithi112.stdout:9/905: write d5/d3b/d5f/d13/d54/d7d/d57/fc7 [1204414,56608] 0 2024-09-21T00:57:03.280 INFO:tasks.workunit.client.0.smithi112.stdout:0/676: write d8/d1b/d2c/d2e/f94 [469778,103438] 0 2024-09-21T00:57:03.282 INFO:tasks.workunit.client.0.smithi112.stdout:5/593: stat d8/d9/d13/d2a/df/d5b/d75/fa4 0 2024-09-21T00:57:03.283 INFO:tasks.workunit.client.0.smithi112.stdout:9/906: mknod d5/d3b/d5f/d13/d54/dc1/ddc/c127 0 2024-09-21T00:57:03.284 INFO:tasks.workunit.client.0.smithi112.stdout:0/677: chown d8/f19 2 1 2024-09-21T00:57:03.285 INFO:tasks.workunit.client.0.smithi112.stdout:0/678: chown d8/d1b/f8e 32 1 2024-09-21T00:57:03.285 INFO:tasks.workunit.client.0.smithi112.stdout:5/594: truncate d8/d9/d13/d2a/d2c/f69 66148 0 2024-09-21T00:57:03.286 INFO:tasks.workunit.client.0.smithi112.stdout:5/595: chown d8/f3f 4401841 1 2024-09-21T00:57:03.287 INFO:tasks.workunit.client.0.smithi112.stdout:9/907: creat d5/d3b/d5f/d13/d54/dc1/f128 x:0 0 0 2024-09-21T00:57:03.289 INFO:tasks.workunit.client.0.smithi112.stdout:0/679: dread - d8/d11/d28/fa2 zero size 2024-09-21T00:57:03.290 INFO:tasks.workunit.client.0.smithi112.stdout:9/908: fsync d5/d6/d19/f80 0 2024-09-21T00:57:03.294 INFO:tasks.workunit.client.0.smithi112.stdout:0/680: creat d8/d1b/fdd x:0 0 0 2024-09-21T00:57:03.295 INFO:tasks.workunit.client.0.smithi112.stdout:7/783: write d0/d2/f64 [389389,32051] 0 2024-09-21T00:57:03.297 INFO:tasks.workunit.client.0.smithi112.stdout:7/784: chown d0/d2/d2e/df6/d39/d56/d65/d87/le0 53 1 2024-09-21T00:57:03.298 INFO:tasks.workunit.client.0.smithi112.stdout:9/909: unlink d5/d3b/d5f/c8e 0 2024-09-21T00:57:03.301 INFO:tasks.workunit.client.0.smithi112.stdout:8/759: dwrite d0/d13/d1b/d22/d42/d51/f76 [0,4194304] 0 2024-09-21T00:57:03.302 INFO:tasks.workunit.client.0.smithi112.stdout:5/596: rename d8/d9/d13/d2a/df/d5b/d75 to d8/d9/d13/d2a/df/d5b/dbe 0 2024-09-21T00:57:03.304 INFO:tasks.workunit.client.0.smithi112.stdout:0/681: creat d8/d1b/d2c/d2e/d4c/d64/d96/da3/fde x:0 0 0 2024-09-21T00:57:03.305 INFO:tasks.workunit.client.0.smithi112.stdout:2/795: sync 2024-09-21T00:57:03.307 INFO:tasks.workunit.client.0.smithi112.stdout:7/785: fsync d0/d2/d2e/df6/d39/d56/f77 0 2024-09-21T00:57:03.308 INFO:tasks.workunit.client.0.smithi112.stdout:7/786: chown d0/d2/d2e/df6/d39/d56/d65/d87/fc8 201 1 2024-09-21T00:57:03.308 INFO:tasks.workunit.client.0.smithi112.stdout:8/760: mkdir d0/d13/d9f/dc2/df4 0 2024-09-21T00:57:03.322 INFO:tasks.workunit.client.0.smithi112.stdout:5/597: dread d8/d9/d13/d1c/f54 [0,4194304] 0 2024-09-21T00:57:03.323 INFO:tasks.workunit.client.0.smithi112.stdout:0/682: creat d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6/fdf x:0 0 0 2024-09-21T00:57:03.325 INFO:tasks.workunit.client.0.smithi112.stdout:7/787: dwrite d0/d2/d2e/df6/de4/ffa [0,4194304] 0 2024-09-21T00:57:03.336 INFO:tasks.workunit.client.0.smithi112.stdout:9/910: creat d5/d3b/f129 x:0 0 0 2024-09-21T00:57:03.339 INFO:tasks.workunit.client.0.smithi112.stdout:0/683: fsync d8/d11/f37 0 2024-09-21T00:57:03.342 INFO:tasks.workunit.client.0.smithi112.stdout:0/684: dread - d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6/fdf zero size 2024-09-21T00:57:03.343 INFO:tasks.workunit.client.0.smithi112.stdout:8/761: dwrite d0/d13/d1b/d22/d2e/d34/d7b/f71 [0,4194304] 0 2024-09-21T00:57:03.344 INFO:tasks.workunit.client.0.smithi112.stdout:5/598: rename d8/d9/d13/d2a/d2c/d96/d9f/lae to d8/d9/d13/d2a/da1/lbf 0 2024-09-21T00:57:03.344 INFO:tasks.workunit.client.0.smithi112.stdout:0/685: write d8/d11/d28/fd0 [497079,55305] 0 2024-09-21T00:57:03.346 INFO:tasks.workunit.client.0.smithi112.stdout:2/796: truncate d0/d45/d8a/d62/f88 2586171 0 2024-09-21T00:57:03.346 INFO:tasks.workunit.client.0.smithi112.stdout:7/788: creat d0/d2/d2e/df6/d39/d56/d86/f101 x:0 0 0 2024-09-21T00:57:03.347 INFO:tasks.workunit.client.0.smithi112.stdout:7/789: readlink d0/d2/d2e/df6/d39/d56/d65/d87/l89 0 2024-09-21T00:57:03.354 INFO:tasks.workunit.client.0.smithi112.stdout:5/599: mkdir d8/d9/d13/d1c/d45/d8a/dc0 0 2024-09-21T00:57:03.355 INFO:tasks.workunit.client.0.smithi112.stdout:5/600: readlink d8/d9/d13/d2a/l62 0 2024-09-21T00:57:03.367 INFO:tasks.workunit.client.0.smithi112.stdout:9/911: dwrite d5/d6/d19/f28 [0,4194304] 0 2024-09-21T00:57:03.367 INFO:tasks.workunit.client.0.smithi112.stdout:9/912: chown d5/d3b/d79/df6 4782 1 2024-09-21T00:57:03.368 INFO:tasks.workunit.client.0.smithi112.stdout:0/686: rename d8/d1b/d2c/c51 to d8/d1b/d2c/d2e/ce0 0 2024-09-21T00:57:03.369 INFO:tasks.workunit.client.0.smithi112.stdout:0/687: fsync d8/d1b/f8e 0 2024-09-21T00:57:03.370 INFO:tasks.workunit.client.0.smithi112.stdout:8/762: write d0/d66/f50 [7545636,121292] 0 2024-09-21T00:57:03.370 INFO:tasks.workunit.client.0.smithi112.stdout:0/688: chown d8/d1b/d2c/d2e/d4c/d64 1583316 1 2024-09-21T00:57:03.371 INFO:tasks.workunit.client.0.smithi112.stdout:5/601: read d8/d9/d13/d1c/f22 [1197173,113757] 0 2024-09-21T00:57:03.371 INFO:tasks.workunit.client.0.smithi112.stdout:2/797: getdents d0/d45/db9/df9 0 2024-09-21T00:57:03.372 INFO:tasks.workunit.client.0.smithi112.stdout:7/790: mknod d0/d2/d32/da4/df9/c102 0 2024-09-21T00:57:03.375 INFO:tasks.workunit.client.0.smithi112.stdout:5/602: truncate d8/d9/d13/d2a/da1/faa 50437 0 2024-09-21T00:57:03.377 INFO:tasks.workunit.client.0.smithi112.stdout:5/603: readlink d8/d9/d13/d2a/df/l8f 0 2024-09-21T00:57:03.380 INFO:tasks.workunit.client.0.smithi112.stdout:2/798: dwrite d0/d14/d22/d6d/f100 [0,4194304] 0 2024-09-21T00:57:03.382 INFO:tasks.workunit.client.0.smithi112.stdout:2/799: stat d0/d14/d8/d27/c94 0 2024-09-21T00:57:03.385 INFO:tasks.workunit.client.0.smithi112.stdout:8/763: write d0/d13/d1b/d22/d2e/d34/d7b/d80/fd2 [2885826,30250] 0 2024-09-21T00:57:03.388 INFO:tasks.workunit.client.0.smithi112.stdout:2/800: creat d0/df/d46/d97/dcd/f105 x:0 0 0 2024-09-21T00:57:03.389 INFO:tasks.workunit.client.0.smithi112.stdout:9/913: dwrite d5/d3b/d5f/d13/fd3 [0,4194304] 0 2024-09-21T00:57:03.391 INFO:tasks.workunit.client.0.smithi112.stdout:7/791: creat d0/d2/d38/d48/f103 x:0 0 0 2024-09-21T00:57:03.395 INFO:tasks.workunit.client.0.smithi112.stdout:9/914: rename d5/d3b/d5f/db9/dde to d5/d6/d19/dfc/d12a 0 2024-09-21T00:57:03.397 INFO:tasks.workunit.client.0.smithi112.stdout:5/604: getdents d8/d9/d13/d2a/df/d5b/dbe 0 2024-09-21T00:57:03.398 INFO:tasks.workunit.client.0.smithi112.stdout:7/792: mkdir d0/d2/d104 0 2024-09-21T00:57:03.401 INFO:tasks.workunit.client.0.smithi112.stdout:5/605: creat d8/d9/d13/d2a/d58/fc1 x:0 0 0 2024-09-21T00:57:03.401 INFO:tasks.workunit.client.0.smithi112.stdout:8/764: link d0/d66/c54 d0/d13/d1b/cf5 0 2024-09-21T00:57:03.402 INFO:tasks.workunit.client.0.smithi112.stdout:5/606: stat d8 0 2024-09-21T00:57:03.404 INFO:tasks.workunit.client.0.smithi112.stdout:9/915: dwrite d5/d3b/d79/d103/f111 [0,4194304] 0 2024-09-21T00:57:03.405 INFO:tasks.workunit.client.0.smithi112.stdout:8/765: write d0/d13/d1b/d22/d2e/fa1 [1731360,76034] 0 2024-09-21T00:57:03.405 INFO:tasks.workunit.client.0.smithi112.stdout:7/793: creat d0/d2/d2e/df6/d39/d56/d65/f105 x:0 0 0 2024-09-21T00:57:03.409 INFO:tasks.workunit.client.0.smithi112.stdout:9/916: read d5/d3b/d5f/d13/d54/dc1/fdf [748512,52278] 0 2024-09-21T00:57:03.409 INFO:tasks.workunit.client.0.smithi112.stdout:5/607: symlink d8/d9/d61/lc2 0 2024-09-21T00:57:03.411 INFO:tasks.workunit.client.0.smithi112.stdout:9/917: read - d5/d3b/d5f/d13/d54/dc1/f128 zero size 2024-09-21T00:57:03.411 INFO:tasks.workunit.client.0.smithi112.stdout:8/766: stat d0/d13/d1b/d22/d2e/d34/d7b/d80/ca4 0 2024-09-21T00:57:03.418 INFO:tasks.workunit.client.0.smithi112.stdout:9/918: unlink d5/d6/d19/d51/l120 0 2024-09-21T00:57:03.418 INFO:tasks.workunit.client.0.smithi112.stdout:2/801: dread d0/d45/d8a/f57 [0,4194304] 0 2024-09-21T00:57:03.418 INFO:tasks.workunit.client.0.smithi112.stdout:5/608: dwrite d8/d9/d13/f51 [0,4194304] 0 2024-09-21T00:57:03.432 INFO:tasks.workunit.client.0.smithi112.stdout:8/767: getdents d0/d13/d2a/d73/d96/dbc 0 2024-09-21T00:57:03.435 INFO:tasks.workunit.client.0.smithi112.stdout:8/768: symlink d0/d13/d2a/d73/lf6 0 2024-09-21T00:57:03.436 INFO:tasks.workunit.client.0.smithi112.stdout:9/919: dread d5/d3b/d5f/d13/f5d [0,4194304] 0 2024-09-21T00:57:03.436 INFO:tasks.workunit.client.0.smithi112.stdout:7/794: dread d0/d2/d38/d48/fc5 [0,4194304] 0 2024-09-21T00:57:03.440 INFO:tasks.workunit.client.0.smithi112.stdout:8/769: creat d0/d13/d2a/d73/d96/dbc/ff7 x:0 0 0 2024-09-21T00:57:03.444 INFO:tasks.workunit.client.0.smithi112.stdout:5/609: dwrite d8/d9/d13/fb4 [0,4194304] 0 2024-09-21T00:57:03.444 INFO:tasks.workunit.client.0.smithi112.stdout:8/770: stat d0/d13/d1b/d22/d42/d51/df2 0 2024-09-21T00:57:03.447 INFO:tasks.workunit.client.0.smithi112.stdout:7/795: dwrite d0/f22 [0,4194304] 0 2024-09-21T00:57:03.449 INFO:tasks.workunit.client.0.smithi112.stdout:5/610: creat d8/d9/d13/d2a/d2c/d96/d9f/fc3 x:0 0 0 2024-09-21T00:57:03.451 INFO:tasks.workunit.client.0.smithi112.stdout:5/611: chown d8/d9/d13/d2a/df/d5b/c67 4869 1 2024-09-21T00:57:03.464 INFO:tasks.workunit.client.0.smithi112.stdout:5/612: read d8/d9/d13/d2a/df/d5b/dbe/f7e [1973585,114019] 0 2024-09-21T00:57:03.552 INFO:tasks.workunit.client.0.smithi112.stdout:7/796: symlink d0/d2/d2e/df6/d39/d56/d65/d75/d9a/l106 0 2024-09-21T00:57:03.553 INFO:tasks.workunit.client.0.smithi112.stdout:7/797: dread - d0/d2/d2e/df6/d39/d56/d65/f105 zero size 2024-09-21T00:57:03.554 INFO:tasks.workunit.client.0.smithi112.stdout:5/613: mkdir d8/d9/d13/d2a/d58/dc4 0 2024-09-21T00:57:03.555 INFO:tasks.workunit.client.0.smithi112.stdout:9/920: truncate d5/d3b/d5f/d13/d6e/da0/de6/f109 7415718 0 2024-09-21T00:57:03.557 INFO:tasks.workunit.client.0.smithi112.stdout:7/798: creat d0/d2/d32/da4/db2/db4/f107 x:0 0 0 2024-09-21T00:57:03.559 INFO:tasks.workunit.client.0.smithi112.stdout:7/799: mkdir d0/d2/d2e/df6/d39/d56/d65/d87/dd9/d108 0 2024-09-21T00:57:03.565 INFO:tasks.workunit.client.0.smithi112.stdout:9/921: write d5/f5e [1638800,112680] 0 2024-09-21T00:57:03.566 INFO:tasks.workunit.client.0.smithi112.stdout:9/922: write d5/d3b/d5f/d13/d54/f90 [2262596,11752] 0 2024-09-21T00:57:03.567 INFO:tasks.workunit.client.0.smithi112.stdout:9/923: write d5/f49 [1179099,80645] 0 2024-09-21T00:57:03.571 INFO:tasks.workunit.client.0.smithi112.stdout:9/924: creat d5/d6/d19/dfc/d12a/f12b x:0 0 0 2024-09-21T00:57:03.572 INFO:tasks.workunit.client.0.smithi112.stdout:7/800: dwrite d0/d2/f68 [0,4194304] 0 2024-09-21T00:57:03.574 INFO:tasks.workunit.client.0.smithi112.stdout:9/925: symlink d5/d3b/d79/d91/l12c 0 2024-09-21T00:57:03.582 INFO:tasks.workunit.client.0.smithi112.stdout:9/926: dwrite d5/d6/f6c [4194304,4194304] 0 2024-09-21T00:57:03.587 INFO:tasks.workunit.client.0.smithi112.stdout:9/927: dread d5/d3b/d79/df6/f118 [0,4194304] 0 2024-09-21T00:57:03.588 INFO:tasks.workunit.client.0.smithi112.stdout:7/801: truncate d0/d2/d2e/df6/d39/d56/d65/d75/d9a/feb 1247921 0 2024-09-21T00:57:03.607 INFO:tasks.workunit.client.0.smithi112.stdout:9/928: dread d5/d6/d19/f1d [0,4194304] 0 2024-09-21T00:57:03.611 INFO:tasks.workunit.client.0.smithi112.stdout:7/802: dread d0/d2/f69 [0,4194304] 0 2024-09-21T00:57:03.613 INFO:tasks.workunit.client.0.smithi112.stdout:7/803: mknod d0/d2/d32/da4/c109 0 2024-09-21T00:57:03.616 INFO:tasks.workunit.client.0.smithi112.stdout:7/804: unlink d0/f67 0 2024-09-21T00:57:03.616 INFO:tasks.workunit.client.0.smithi112.stdout:9/929: write d5/d3b/d5f/d13/d54/f98 [1842091,106374] 0 2024-09-21T00:57:03.618 INFO:tasks.workunit.client.0.smithi112.stdout:9/930: write d5/d6/d19/dfc/d12a/dd7/f11c [523281,124841] 0 2024-09-21T00:57:03.618 INFO:tasks.workunit.client.0.smithi112.stdout:9/931: chown d5/d3b/d5f/d13/d6e 301133732 1 2024-09-21T00:57:03.619 INFO:tasks.workunit.client.0.smithi112.stdout:7/805: symlink d0/d2/d2e/df6/d39/db3/l10a 0 2024-09-21T00:57:03.626 INFO:tasks.workunit.client.0.smithi112.stdout:7/806: dwrite d0/d2/d2e/df6/d39/d56/d65/d87/fc8 [0,4194304] 0 2024-09-21T00:57:03.658 INFO:tasks.workunit.client.0.smithi112.stdout:9/932: dwrite d5/d3b/d5f/d59/fb1 [0,4194304] 0 2024-09-21T00:57:03.694 INFO:tasks.workunit.client.0.smithi112.stdout:9/933: truncate d5/f14 6434903 0 2024-09-21T00:57:03.703 INFO:tasks.workunit.client.0.smithi112.stdout:4/728: sync 2024-09-21T00:57:03.753 INFO:tasks.workunit.client.0.smithi112.stdout:7/807: mknod d0/d2/d38/c10b 0 2024-09-21T00:57:03.754 INFO:tasks.workunit.client.0.smithi112.stdout:7/808: readlink d0/d2/d2e/l34 0 2024-09-21T00:57:03.755 INFO:tasks.workunit.client.0.smithi112.stdout:9/934: creat d5/d3b/d5f/f12d x:0 0 0 2024-09-21T00:57:03.756 INFO:tasks.workunit.client.0.smithi112.stdout:7/809: dread - d0/d2/d38/fd3 zero size 2024-09-21T00:57:03.757 INFO:tasks.workunit.client.0.smithi112.stdout:4/729: dwrite d1/d5/d1c/d1e/d3d/db9/fc3 [0,4194304] 0 2024-09-21T00:57:03.763 INFO:tasks.workunit.client.0.smithi112.stdout:4/730: rename d1/d75 to d1/d7/df7 0 2024-09-21T00:57:03.764 INFO:tasks.workunit.client.0.smithi112.stdout:7/810: creat d0/d2/d32/da4/db2/db4/dba/f10c x:0 0 0 2024-09-21T00:57:03.766 INFO:tasks.workunit.client.0.smithi112.stdout:4/731: readlink d1/d2d/l67 0 2024-09-21T00:57:03.767 INFO:tasks.workunit.client.0.smithi112.stdout:7/811: stat d0/d2/d2e/dcf/cc7 0 2024-09-21T00:57:03.768 INFO:tasks.workunit.client.0.smithi112.stdout:7/812: dread - d0/d2/d38/fd3 zero size 2024-09-21T00:57:03.769 INFO:tasks.workunit.client.0.smithi112.stdout:4/732: truncate d1/d5/d1c/d1e/d3d/fd5 1386523 0 2024-09-21T00:57:03.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/813: creat d0/d2/d2e/df6/d39/d56/d65/f10d x:0 0 0 2024-09-21T00:57:03.781 INFO:tasks.workunit.client.0.smithi112.stdout:7/814: mkdir d0/d2/d2e/df6/d39/db3/d10e 0 2024-09-21T00:57:03.783 INFO:tasks.workunit.client.0.smithi112.stdout:9/935: dwrite d5/db4/dd1/f107 [0,4194304] 0 2024-09-21T00:57:03.784 INFO:tasks.workunit.client.0.smithi112.stdout:7/815: symlink d0/d2/d32/da4/l10f 0 2024-09-21T00:57:03.785 INFO:tasks.workunit.client.0.smithi112.stdout:7/816: chown d0/d2/d2e 3001200 1 2024-09-21T00:57:03.785 INFO:tasks.workunit.client.0.smithi112.stdout:4/733: write d1/d5/d1c/d1e/d4a/d5f/feb [4935889,97783] 0 2024-09-21T00:57:03.793 INFO:tasks.workunit.client.0.smithi112.stdout:7/817: rmdir d0/d2/d2e/df6/d39/daf 0 2024-09-21T00:57:03.795 INFO:tasks.workunit.client.0.smithi112.stdout:7/818: rmdir d0/d2/d2e/df6/d39/d1a 39 2024-09-21T00:57:03.799 INFO:tasks.workunit.client.0.smithi112.stdout:4/734: dread d1/d5/d1c/d1e/d3d/f48 [0,4194304] 0 2024-09-21T00:57:03.804 INFO:tasks.workunit.client.0.smithi112.stdout:4/735: getdents d1/d5/d1c/d1e/d76/dba 0 2024-09-21T00:57:03.811 INFO:tasks.workunit.client.0.smithi112.stdout:4/736: link d1/d5/d1c/d1e/d76/dba/cd4 d1/cf8 0 2024-09-21T00:57:03.811 INFO:tasks.workunit.client.0.smithi112.stdout:4/737: chown d1/d7/df7 393608604 1 2024-09-21T00:57:03.813 INFO:tasks.workunit.client.0.smithi112.stdout:7/819: dread d0/d2/d2e/df6/d39/d1a/f44 [4194304,4194304] 0 2024-09-21T00:57:03.816 INFO:tasks.workunit.client.0.smithi112.stdout:7/820: symlink d0/d2/d2e/df6/d39/l110 0 2024-09-21T00:57:03.818 INFO:tasks.workunit.client.0.smithi112.stdout:4/738: write d1/fa6 [2697108,17640] 0 2024-09-21T00:57:03.822 INFO:tasks.workunit.client.0.smithi112.stdout:7/821: rmdir d0/d2/d2e/df6/d39/d56/d65/d87/dd9/df8 0 2024-09-21T00:57:03.822 INFO:tasks.workunit.client.0.smithi112.stdout:4/739: dread d1/d5/d1c/fa4 [0,4194304] 0 2024-09-21T00:57:03.825 INFO:tasks.workunit.client.0.smithi112.stdout:7/822: read d0/d2/d2e/df6/d39/d56/d65/d75/f8e [6751441,59095] 0 2024-09-21T00:57:03.825 INFO:tasks.workunit.client.0.smithi112.stdout:4/740: symlink d1/d5/d1c/d1e/d4a/d5f/lf9 0 2024-09-21T00:57:03.827 INFO:tasks.workunit.client.0.smithi112.stdout:4/741: fdatasync d1/d7/f28 0 2024-09-21T00:57:03.831 INFO:tasks.workunit.client.0.smithi112.stdout:4/742: mknod d1/d5/d1c/d1e/daf/cfa 0 2024-09-21T00:57:03.834 INFO:tasks.workunit.client.0.smithi112.stdout:7/823: write d0/d2/d2e/df6/d39/d56/d65/d75/d9a/def/fb8 [1402527,94233] 0 2024-09-21T00:57:03.836 INFO:tasks.workunit.client.0.smithi112.stdout:4/743: link d1/d5/d1c/d1e/d4a/f7d d1/d5/d1c/d1e/daf/ffb 0 2024-09-21T00:57:03.840 INFO:tasks.workunit.client.0.smithi112.stdout:7/824: link d0/d2/d2e/dcf/dc3/cff d0/d2/d32/c111 0 2024-09-21T00:57:03.841 INFO:tasks.workunit.client.0.smithi112.stdout:7/825: dread - d0/d2/d38/d48/f103 zero size 2024-09-21T00:57:03.842 INFO:tasks.workunit.client.0.smithi112.stdout:7/826: chown d0/d2/d38/d48/dad/c6f 7764 1 2024-09-21T00:57:03.842 INFO:tasks.workunit.client.0.smithi112.stdout:4/744: getdents d1/ddf 0 2024-09-21T00:57:03.849 INFO:tasks.workunit.client.0.smithi112.stdout:4/745: link d1/d5/d1c/d1e/d76/dba/cc6 d1/ddf/cfc 0 2024-09-21T00:57:03.849 INFO:tasks.workunit.client.0.smithi112.stdout:7/827: write d0/d2/d38/f43 [525414,69809] 0 2024-09-21T00:57:03.850 INFO:tasks.workunit.client.0.smithi112.stdout:7/828: readlink d0/d2/l40 0 2024-09-21T00:57:03.852 INFO:tasks.workunit.client.0.smithi112.stdout:4/746: creat d1/d5/d1c/d1e/daf/ffd x:0 0 0 2024-09-21T00:57:03.859 INFO:tasks.workunit.client.0.smithi112.stdout:4/747: write d1/f7f [298018,33304] 0 2024-09-21T00:57:03.867 INFO:tasks.workunit.client.0.smithi112.stdout:4/748: dwrite d1/d5/d1c/d1e/daf/fb4 [4194304,4194304] 0 2024-09-21T00:57:03.868 INFO:tasks.workunit.client.0.smithi112.stdout:4/749: chown d1/d2d/fd6 27 1 2024-09-21T00:57:03.883 INFO:tasks.workunit.client.0.smithi112.stdout:4/750: fsync d1/d5/d1c/d1e/daf/fb4 0 2024-09-21T00:57:03.885 INFO:tasks.workunit.client.0.smithi112.stdout:4/751: chown d1/c4 21 1 2024-09-21T00:57:03.888 INFO:tasks.workunit.client.0.smithi112.stdout:4/752: creat d1/d7/d9/d1a/d8e/ffe x:0 0 0 2024-09-21T00:57:03.889 INFO:tasks.workunit.client.0.smithi112.stdout:4/753: readlink d1/d5/lb6 0 2024-09-21T00:57:03.892 INFO:tasks.workunit.client.0.smithi112.stdout:4/754: read - d1/d5/d1c/d1e/fa7 zero size 2024-09-21T00:57:03.893 INFO:tasks.workunit.client.0.smithi112.stdout:4/755: write d1/f7f [580293,75413] 0 2024-09-21T00:57:03.916 INFO:tasks.workunit.client.0.smithi112.stdout:4/756: write d1/d5/d1c/d1e/d3d/d99/fb5 [308026,93506] 0 2024-09-21T00:57:03.916 INFO:tasks.workunit.client.0.smithi112.stdout:4/757: chown d1/d7/d9/c52 5869 1 2024-09-21T00:57:03.918 INFO:tasks.workunit.client.0.smithi112.stdout:4/758: read d1/d5/d1c/d1e/d3d/db9/fc3 [3409342,32147] 0 2024-09-21T00:57:03.921 INFO:tasks.workunit.client.0.smithi112.stdout:4/759: chown d1/l1d 1695 1 2024-09-21T00:57:03.986 INFO:tasks.workunit.client.0.smithi112.stdout:6/760: sync 2024-09-21T00:57:03.989 INFO:tasks.workunit.client.0.smithi112.stdout:6/761: truncate d9/d1f/d3e/d77/f71 977906 0 2024-09-21T00:57:03.991 INFO:tasks.workunit.client.0.smithi112.stdout:6/762: mkdir d9/d1f/d47/d74/d8b/daa/dd4/d113 0 2024-09-21T00:57:03.994 INFO:tasks.workunit.client.0.smithi112.stdout:6/763: creat d9/d1f/d47/d34/da6/da7/dcf/d60/dea/f114 x:0 0 0 2024-09-21T00:57:03.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/764: chown d9/d1f/d47/d34/da6/da7/dcf/d26/db8 36729818 1 2024-09-21T00:57:03.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/765: chown d9/d1f/d3e/l6a 14 1 2024-09-21T00:57:03.996 INFO:tasks.workunit.client.0.smithi112.stdout:6/766: stat d9/d1f/d47/d74/d8b/daa/dd4 0 2024-09-21T00:57:04.002 INFO:tasks.workunit.client.0.smithi112.stdout:6/767: dwrite d9/df/f27 [0,4194304] 0 2024-09-21T00:57:04.009 INFO:tasks.workunit.client.0.smithi112.stdout:6/768: mknod d9/d1f/d3e/d9a/c115 0 2024-09-21T00:57:04.014 INFO:tasks.workunit.client.0.smithi112.stdout:6/769: unlink d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/f102 0 2024-09-21T00:57:04.048 INFO:tasks.workunit.client.0.smithi112.stdout:6/770: dread d9/d1f/f65 [0,4194304] 0 2024-09-21T00:57:04.054 INFO:tasks.workunit.client.0.smithi112.stdout:6/771: creat d9/d1f/d47/d34/da6/da7/dcf/dbe/f116 x:0 0 0 2024-09-21T00:57:04.056 INFO:tasks.workunit.client.0.smithi112.stdout:6/772: chown d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f78 0 1 2024-09-21T00:57:04.072 INFO:tasks.workunit.client.0.smithi112.stdout:6/773: dread d9/d1f/d47/d34/da6/f5d [0,4194304] 0 2024-09-21T00:57:04.074 INFO:tasks.workunit.client.0.smithi112.stdout:6/774: fdatasync d9/d1f/d47/d34/da6/da7/dcf/dbe/f116 0 2024-09-21T00:57:04.076 INFO:tasks.workunit.client.0.smithi112.stdout:6/775: creat d9/d1f/d47/d34/da6/da7/dcf/d21/d84/f117 x:0 0 0 2024-09-21T00:57:04.081 INFO:tasks.workunit.client.0.smithi112.stdout:6/776: mknod d9/d1f/d3e/d77/d46/d8c/c118 0 2024-09-21T00:57:04.084 INFO:tasks.workunit.client.0.smithi112.stdout:6/777: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/da3/l119 0 2024-09-21T00:57:04.085 INFO:tasks.workunit.client.0.smithi112.stdout:6/778: fdatasync d9/d1f/d47/d34/da6/da7/dcf/d60/fc6 0 2024-09-21T00:57:04.088 INFO:tasks.workunit.client.0.smithi112.stdout:6/779: creat d9/d1f/d3e/d77/d45/f11a x:0 0 0 2024-09-21T00:57:04.089 INFO:tasks.workunit.client.0.smithi112.stdout:6/780: write d9/df/d56/dde/f104 [41480,8254] 0 2024-09-21T00:57:04.092 INFO:tasks.workunit.client.0.smithi112.stdout:6/781: rmdir d9/d1f/d3e/d77/d46/d99 39 2024-09-21T00:57:04.093 INFO:tasks.workunit.client.0.smithi112.stdout:6/782: chown d9/df/d56/dbc/fe9 6 1 2024-09-21T00:57:04.095 INFO:tasks.workunit.client.0.smithi112.stdout:6/783: rmdir d9/d1f/d47/d34/da6/da7 39 2024-09-21T00:57:04.099 INFO:tasks.workunit.client.0.smithi112.stdout:6/784: rename d9/d1f/d47/d34/da6/da7/dcf/d26/db8 to d9/df/d56/dbc/df6/d11b 0 2024-09-21T00:57:04.099 INFO:tasks.workunit.client.0.smithi112.stdout:1/702: sync 2024-09-21T00:57:04.099 INFO:tasks.workunit.client.0.smithi112.stdout:0/689: sync 2024-09-21T00:57:04.101 INFO:tasks.workunit.client.0.smithi112.stdout:1/703: write d5/d8/d10/fc2 [146366,106004] 0 2024-09-21T00:57:04.102 INFO:tasks.workunit.client.0.smithi112.stdout:6/785: truncate d9/d1f/d47/d34/da6/da7/dcf/d26/fee 345319 0 2024-09-21T00:57:04.102 INFO:tasks.workunit.client.0.smithi112.stdout:0/690: truncate d8/d5f/f7d 682683 0 2024-09-21T00:57:04.103 INFO:tasks.workunit.client.0.smithi112.stdout:6/786: stat d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/ddc/l106 0 2024-09-21T00:57:04.104 INFO:tasks.workunit.client.0.smithi112.stdout:6/787: dread - d9/d1f/d47/d74/d8e/f9d zero size 2024-09-21T00:57:04.114 INFO:tasks.workunit.client.0.smithi112.stdout:0/691: dread d8/d11/f2d [0,4194304] 0 2024-09-21T00:57:04.116 INFO:tasks.workunit.client.0.smithi112.stdout:0/692: truncate d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6/fd1 2250874 0 2024-09-21T00:57:04.116 INFO:tasks.workunit.client.0.smithi112.stdout:0/693: chown d8/d11 3 1 2024-09-21T00:57:04.116 INFO:tasks.workunit.client.0.smithi112.stdout:0/694: write d8/d11/d28/d54/f55 [3025914,40021] 0 2024-09-21T00:57:04.186 INFO:tasks.workunit.client.0.smithi112.stdout:6/788: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d11c 0 2024-09-21T00:57:04.188 INFO:tasks.workunit.client.0.smithi112.stdout:0/695: creat d8/d1b/d2c/d2e/d4c/d64/d96/da3/db6/fe1 x:0 0 0 2024-09-21T00:57:04.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/696: unlink d8/d5f/lc6 0 2024-09-21T00:57:04.194 INFO:tasks.workunit.client.0.smithi112.stdout:6/789: truncate d9/d1f/d47/d34/da6/fad 346238 0 2024-09-21T00:57:04.201 INFO:tasks.workunit.client.0.smithi112.stdout:6/790: mkdir d9/d1f/d3e/d77/d46/d99/d11d 0 2024-09-21T00:57:04.202 INFO:tasks.workunit.client.0.smithi112.stdout:6/791: write d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f95 [1398487,101599] 0 2024-09-21T00:57:04.203 INFO:tasks.workunit.client.0.smithi112.stdout:6/792: stat d9/d1f/d47/d34/lcb 0 2024-09-21T00:57:04.208 INFO:tasks.workunit.client.0.smithi112.stdout:6/793: rename d9/d1f/d47/d34/da6/da7/dcf/d60/da3/l119 to d9/d1f/d47/d34/da6/da7/dcf/d31/l11e 0 2024-09-21T00:57:04.209 INFO:tasks.workunit.client.0.smithi112.stdout:6/794: chown d9/d1f/d47/d74/d8b/daa/dcd/f107 30265 1 2024-09-21T00:57:04.211 INFO:tasks.workunit.client.0.smithi112.stdout:6/795: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d11f 0 2024-09-21T00:57:04.213 INFO:tasks.workunit.client.0.smithi112.stdout:6/796: mkdir d9/df/d56/dbc/df6/d120 0 2024-09-21T00:57:04.215 INFO:tasks.workunit.client.0.smithi112.stdout:6/797: truncate d9/d1f/d47/d74/d8b/daa/dd4/f7b 4335204 0 2024-09-21T00:57:04.232 INFO:tasks.workunit.client.0.smithi112.stdout:6/798: dread d9/f12 [4194304,4194304] 0 2024-09-21T00:57:04.233 INFO:tasks.workunit.client.0.smithi112.stdout:6/799: write d9/d1f/d47/d34/f36 [4734772,85022] 0 2024-09-21T00:57:04.236 INFO:tasks.workunit.client.0.smithi112.stdout:6/800: symlink d9/d1f/d47/d34/da6/da7/dcf/d21/d84/l121 0 2024-09-21T00:57:04.238 INFO:tasks.workunit.client.0.smithi112.stdout:6/801: creat d9/d1f/d3e/d77/d79/d85/f122 x:0 0 0 2024-09-21T00:57:04.240 INFO:tasks.workunit.client.0.smithi112.stdout:6/802: creat d9/d1f/d47/d34/da6/da7/dcf/dbe/f123 x:0 0 0 2024-09-21T00:57:04.245 INFO:tasks.workunit.client.0.smithi112.stdout:6/803: link d9/d1f/d47/d34/da6/da7/dcf/d31/c61 d9/df/d56/dbc/c124 0 2024-09-21T00:57:04.247 INFO:tasks.workunit.client.0.smithi112.stdout:6/804: creat d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/f125 x:0 0 0 2024-09-21T00:57:04.259 INFO:tasks.workunit.client.0.smithi112.stdout:6/805: dread d9/d1f/d47/d74/d8b/daa/dd4/f55 [0,4194304] 0 2024-09-21T00:57:04.260 INFO:tasks.workunit.client.0.smithi112.stdout:6/806: dread - d9/d1f/d47/d74/d8b/ff8 zero size 2024-09-21T00:57:04.290 INFO:tasks.workunit.client.0.smithi112.stdout:2/802: sync 2024-09-21T00:57:04.290 INFO:tasks.workunit.client.0.smithi112.stdout:2/803: stat d0/d14/d47/l85 0 2024-09-21T00:57:04.294 INFO:tasks.workunit.client.0.smithi112.stdout:2/804: getdents d0/d14/d22 0 2024-09-21T00:57:04.298 INFO:tasks.workunit.client.0.smithi112.stdout:2/805: write d0/d14/d47/f9c [710108,27880] 0 2024-09-21T00:57:04.461 INFO:tasks.workunit.client.0.smithi112.stdout:5/614: sync 2024-09-21T00:57:04.461 INFO:tasks.workunit.client.0.smithi112.stdout:8/771: sync 2024-09-21T00:57:04.462 INFO:tasks.workunit.client.0.smithi112.stdout:8/772: stat d0/d13/d2a/d73/fa2 0 2024-09-21T00:57:04.464 INFO:tasks.workunit.client.0.smithi112.stdout:5/615: rmdir d8/d9/d13/d2a/d2c 39 2024-09-21T00:57:04.464 INFO:tasks.workunit.client.0.smithi112.stdout:5/616: chown d8/d9/d13/d1c/d45 28 1 2024-09-21T00:57:04.465 INFO:tasks.workunit.client.0.smithi112.stdout:8/773: creat d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1/ff8 x:0 0 0 2024-09-21T00:57:04.466 INFO:tasks.workunit.client.0.smithi112.stdout:5/617: mknod d8/d9/d13/d2a/df/cc5 0 2024-09-21T00:57:04.466 INFO:tasks.workunit.client.0.smithi112.stdout:8/774: write d0/d13/f27 [5597511,50039] 0 2024-09-21T00:57:04.468 INFO:tasks.workunit.client.0.smithi112.stdout:5/618: unlink d8/f3f 0 2024-09-21T00:57:04.576 INFO:tasks.workunit.client.0.smithi112.stdout:9/936: sync 2024-09-21T00:57:04.576 INFO:tasks.workunit.client.0.smithi112.stdout:7/829: sync 2024-09-21T00:57:04.578 INFO:tasks.workunit.client.0.smithi112.stdout:7/830: chown d0/d2/d2e/df6/d39/d56/d65/d87/dd9/d108 13985528 1 2024-09-21T00:57:04.578 INFO:tasks.workunit.client.0.smithi112.stdout:7/831: readlink d0/d2/ld 0 2024-09-21T00:57:04.578 INFO:tasks.workunit.client.0.smithi112.stdout:9/937: mkdir d5/db4/dd1/d12e 0 2024-09-21T00:57:04.586 INFO:tasks.workunit.client.0.smithi112.stdout:9/938: dwrite d5/fb [8388608,4194304] 0 2024-09-21T00:57:04.587 INFO:tasks.workunit.client.0.smithi112.stdout:7/832: dwrite d0/d2/d32/da4/db2/db4/dba/fe3 [0,4194304] 0 2024-09-21T00:57:04.591 INFO:tasks.workunit.client.0.smithi112.stdout:9/939: creat d5/d6/d3f/d7f/f12f x:0 0 0 2024-09-21T00:57:04.596 INFO:tasks.workunit.client.0.smithi112.stdout:9/940: mkdir d5/d3b/d5f/d13/d6e/da0/d10c/d130 0 2024-09-21T00:57:04.597 INFO:tasks.workunit.client.0.smithi112.stdout:9/941: chown d5/d6/f9b 70929611 1 2024-09-21T00:57:04.598 INFO:tasks.workunit.client.0.smithi112.stdout:7/833: write d0/d2/d2e/df6/d39/d56/d86/f85 [1664144,95720] 0 2024-09-21T00:57:04.600 INFO:tasks.workunit.client.0.smithi112.stdout:9/942: unlink d5/d6/d19/fc6 0 2024-09-21T00:57:04.606 INFO:tasks.workunit.client.0.smithi112.stdout:7/834: truncate d0/d2/f68 3460611 0 2024-09-21T00:57:04.607 INFO:tasks.workunit.client.0.smithi112.stdout:7/835: stat d0/d2/d2e/df6/d39/d56/d65/cd2 0 2024-09-21T00:57:04.618 INFO:tasks.workunit.client.0.smithi112.stdout:7/836: write d0/d2/d32/fb7 [2009915,88489] 0 2024-09-21T00:57:04.621 INFO:tasks.workunit.client.0.smithi112.stdout:7/837: creat d0/d2/d2e/df6/d39/d56/d86/f112 x:0 0 0 2024-09-21T00:57:04.623 INFO:tasks.workunit.client.0.smithi112.stdout:9/943: dread d5/d3b/d5f/d13/d56/f61 [0,4194304] 0 2024-09-21T00:57:04.627 INFO:tasks.workunit.client.0.smithi112.stdout:7/838: dread d0/d2/d2e/df6/d39/d56/d65/d87/fd1 [0,4194304] 0 2024-09-21T00:57:04.627 INFO:tasks.workunit.client.0.smithi112.stdout:9/944: mknod d5/d3b/d5f/d13/d54/d7d/c131 0 2024-09-21T00:57:04.642 INFO:tasks.workunit.client.0.smithi112.stdout:7/839: dwrite d0/d2/f69 [0,4194304] 0 2024-09-21T00:57:04.643 INFO:tasks.workunit.client.0.smithi112.stdout:9/945: dwrite d5/f4b [0,4194304] 0 2024-09-21T00:57:04.644 INFO:tasks.workunit.client.0.smithi112.stdout:9/946: fsync d5/d6/d3f/ff9 0 2024-09-21T00:57:04.645 INFO:tasks.workunit.client.0.smithi112.stdout:9/947: fsync d5/d3b/d79/df6/f122 0 2024-09-21T00:57:04.662 INFO:tasks.workunit.client.0.smithi112.stdout:7/840: creat d0/d2/d2e/df6/d39/d56/d86/f113 x:0 0 0 2024-09-21T00:57:04.662 INFO:tasks.workunit.client.0.smithi112.stdout:4/760: sync 2024-09-21T00:57:04.662 INFO:tasks.workunit.client.0.smithi112.stdout:0/697: sync 2024-09-21T00:57:04.662 INFO:tasks.workunit.client.0.smithi112.stdout:1/704: sync 2024-09-21T00:57:04.662 INFO:tasks.workunit.client.0.smithi112.stdout:6/807: sync 2024-09-21T00:57:04.662 INFO:tasks.workunit.client.0.smithi112.stdout:2/806: sync 2024-09-21T00:57:04.664 INFO:tasks.workunit.client.0.smithi112.stdout:7/841: chown d0/d2/d2e/dcf/cc7 49570013 1 2024-09-21T00:57:04.664 INFO:tasks.workunit.client.0.smithi112.stdout:9/948: read d5/d3b/d5f/d13/d54/d7d/f21 [383164,83604] 0 2024-09-21T00:57:04.664 INFO:tasks.workunit.client.0.smithi112.stdout:6/808: write d9/df/d56/f91 [195685,3619] 0 2024-09-21T00:57:04.667 INFO:tasks.workunit.client.0.smithi112.stdout:2/807: mknod d0/d45/c106 0 2024-09-21T00:57:04.669 INFO:tasks.workunit.client.0.smithi112.stdout:4/761: symlink d1/d2d/lff 0 2024-09-21T00:57:04.671 INFO:tasks.workunit.client.0.smithi112.stdout:0/698: creat d8/d75/d91/d9b/fe2 x:0 0 0 2024-09-21T00:57:04.672 INFO:tasks.workunit.client.0.smithi112.stdout:0/699: stat d8/d11/d28/d54/c58 0 2024-09-21T00:57:04.673 INFO:tasks.workunit.client.0.smithi112.stdout:6/809: read d9/d1f/d47/d74/d8b/daa/dd4/f7b [4057513,88049] 0 2024-09-21T00:57:04.678 INFO:tasks.workunit.client.0.smithi112.stdout:9/949: rename d5/f5e to d5/d3b/d5f/d13/d6e/da0/da4/f132 0 2024-09-21T00:57:04.685 INFO:tasks.workunit.client.0.smithi112.stdout:2/808: symlink d0/d45/db9/df9/l107 0 2024-09-21T00:57:04.687 INFO:tasks.workunit.client.0.smithi112.stdout:0/700: rename d8/d1b/d2c/d2e/laa to d8/d1b/d2c/d2e/d4c/d64/d96/le3 0 2024-09-21T00:57:04.693 INFO:tasks.workunit.client.0.smithi112.stdout:1/705: rename d5/d8/dd/d54/d5a/dd8 to d5/d8/dd/d8e/de6 0 2024-09-21T00:57:04.695 INFO:tasks.workunit.client.0.smithi112.stdout:0/701: truncate d8/fcb 7103097 0 2024-09-21T00:57:04.695 INFO:tasks.workunit.client.0.smithi112.stdout:8/775: sync 2024-09-21T00:57:04.695 INFO:tasks.workunit.client.0.smithi112.stdout:5/619: sync 2024-09-21T00:57:04.696 INFO:tasks.workunit.client.0.smithi112.stdout:7/842: getdents d0/d2/d2e/df6/d39/d56/d65/d87/dd9 0 2024-09-21T00:57:04.697 INFO:tasks.workunit.client.0.smithi112.stdout:2/809: fsync d0/d14/f5d 0 2024-09-21T00:57:04.699 INFO:tasks.workunit.client.0.smithi112.stdout:9/950: rename d5/d6/f6c to d5/d3b/d5f/d13/d56/f133 0 2024-09-21T00:57:04.701 INFO:tasks.workunit.client.0.smithi112.stdout:5/620: read - d8/d9/d13/d1c/d99/f65 zero size 2024-09-21T00:57:04.702 INFO:tasks.workunit.client.0.smithi112.stdout:8/776: mknod d0/d13/d1b/d22/d2e/d34/d7b/cf9 0 2024-09-21T00:57:04.702 INFO:tasks.workunit.client.0.smithi112.stdout:5/621: write d8/d9/d13/d1c/d99/f63 [3970578,16359] 0 2024-09-21T00:57:04.703 INFO:tasks.workunit.client.0.smithi112.stdout:7/843: mkdir d0/d2/d2e/df6/d39/db3/d114 0 2024-09-21T00:57:04.705 INFO:tasks.workunit.client.0.smithi112.stdout:2/810: creat d0/d14/d8/d27/f108 x:0 0 0 2024-09-21T00:57:04.706 INFO:tasks.workunit.client.0.smithi112.stdout:7/844: truncate d0/d2/d2e/df6/d39/d56/d65/d87/fd1 1407015 0 2024-09-21T00:57:04.707 INFO:tasks.workunit.client.0.smithi112.stdout:1/706: fsync d5/d8/dd/d97/d46/d70/f84 0 2024-09-21T00:57:04.710 INFO:tasks.workunit.client.0.smithi112.stdout:0/702: fdatasync d8/d5f/f7d 0 2024-09-21T00:57:04.713 INFO:tasks.workunit.client.0.smithi112.stdout:2/811: dread d0/df/f13 [0,4194304] 0 2024-09-21T00:57:04.715 INFO:tasks.workunit.client.0.smithi112.stdout:7/845: mknod d0/d2/d2e/df6/d39/d56/d65/d75/d9a/def/c115 0 2024-09-21T00:57:04.717 INFO:tasks.workunit.client.0.smithi112.stdout:1/707: mkdir d5/d8/d13/d87/de7 0 2024-09-21T00:57:04.719 INFO:tasks.workunit.client.0.smithi112.stdout:4/762: write d1/d5/d1c/d1e/d3d/db9/fd0 [3303709,96940] 0 2024-09-21T00:57:04.720 INFO:tasks.workunit.client.0.smithi112.stdout:4/763: chown d1/d5/d1c/d1e/l9f 63 1 2024-09-21T00:57:04.722 INFO:tasks.workunit.client.0.smithi112.stdout:5/622: creat d8/d9/d13/d2a/d2c/fc6 x:0 0 0 2024-09-21T00:57:04.723 INFO:tasks.workunit.client.0.smithi112.stdout:5/623: chown d8/d9/d13/d2a/d2c/c44 64 1 2024-09-21T00:57:04.729 INFO:tasks.workunit.client.0.smithi112.stdout:4/764: creat d1/d7/d9/d1a/d8e/f100 x:0 0 0 2024-09-21T00:57:04.732 INFO:tasks.workunit.client.0.smithi112.stdout:1/708: dread d5/d8/dd/d97/d46/d70/f84 [0,4194304] 0 2024-09-21T00:57:04.735 INFO:tasks.workunit.client.0.smithi112.stdout:6/810: dwrite d9/fb6 [0,4194304] 0 2024-09-21T00:57:04.735 INFO:tasks.workunit.client.0.smithi112.stdout:1/709: read d5/d8/dd/d97/d46/d70/f73 [470479,23365] 0 2024-09-21T00:57:04.740 INFO:tasks.workunit.client.0.smithi112.stdout:0/703: getdents d8/d1b/d2c/d2e/d4c/d64 0 2024-09-21T00:57:04.743 INFO:tasks.workunit.client.0.smithi112.stdout:6/811: readlink d9/l30 0 2024-09-21T00:57:04.743 INFO:tasks.workunit.client.0.smithi112.stdout:7/846: dread d0/d2/d32/da4/db2/db4/fd4 [0,4194304] 0 2024-09-21T00:57:04.745 INFO:tasks.workunit.client.0.smithi112.stdout:1/710: unlink d5/d8/d13/l21 0 2024-09-21T00:57:04.748 INFO:tasks.workunit.client.0.smithi112.stdout:6/812: write d9/d1f/d47/d74/fd8 [318407,122506] 0 2024-09-21T00:57:04.748 INFO:tasks.workunit.client.0.smithi112.stdout:9/951: dwrite d5/d3b/d5f/d13/d56/f95 [0,4194304] 0 2024-09-21T00:57:04.752 INFO:tasks.workunit.client.0.smithi112.stdout:5/624: getdents d8 0 2024-09-21T00:57:04.753 INFO:tasks.workunit.client.0.smithi112.stdout:0/704: rmdir d8/d11/d28/dbf/dd3/dd7 39 2024-09-21T00:57:04.753 INFO:tasks.workunit.client.0.smithi112.stdout:8/777: write d0/d13/d1b/f70 [422242,37172] 0 2024-09-21T00:57:04.756 INFO:tasks.workunit.client.0.smithi112.stdout:4/765: dread d1/d7/d9/d1a/f78 [0,4194304] 0 2024-09-21T00:57:04.758 INFO:tasks.workunit.client.0.smithi112.stdout:4/766: readlink d1/d2d/l67 0 2024-09-21T00:57:04.760 INFO:tasks.workunit.client.0.smithi112.stdout:4/767: fdatasync d1/d5/d1c/d1e/d3d/db9/fd0 0 2024-09-21T00:57:04.761 INFO:tasks.workunit.client.0.smithi112.stdout:1/711: dread d5/d8/dd/d97/d46/d70/f84 [0,4194304] 0 2024-09-21T00:57:04.764 INFO:tasks.workunit.client.0.smithi112.stdout:8/778: rename d0/d13/d2a/d73/fa2 to d0/d13/dab/dcb/ffa 0 2024-09-21T00:57:04.771 INFO:tasks.workunit.client.0.smithi112.stdout:8/779: mknod d0/d13/d9f/dc2/cfb 0 2024-09-21T00:57:04.772 INFO:tasks.workunit.client.0.smithi112.stdout:5/625: truncate d8/d9/d13/d2a/d84/d8b/f82 2935881 0 2024-09-21T00:57:04.773 INFO:tasks.workunit.client.0.smithi112.stdout:9/952: truncate d5/f49 324879 0 2024-09-21T00:57:04.774 INFO:tasks.workunit.client.0.smithi112.stdout:4/768: mkdir d1/d2d/d101 0 2024-09-21T00:57:04.776 INFO:tasks.workunit.client.0.smithi112.stdout:6/813: dread d9/fc [0,4194304] 0 2024-09-21T00:57:04.776 INFO:tasks.workunit.client.0.smithi112.stdout:1/712: mknod d5/d8/ce8 0 2024-09-21T00:57:04.777 INFO:tasks.workunit.client.0.smithi112.stdout:4/769: chown d1/d7/d30/l87 192847199 1 2024-09-21T00:57:04.778 INFO:tasks.workunit.client.0.smithi112.stdout:0/705: dwrite d8/d1b/d2c/f30 [0,4194304] 0 2024-09-21T00:57:04.780 INFO:tasks.workunit.client.0.smithi112.stdout:0/706: chown d8/d1b/d2c/d2e/f94 1426410 1 2024-09-21T00:57:04.785 INFO:tasks.workunit.client.0.smithi112.stdout:1/713: mkdir d5/d3a/d4b/de9 0 2024-09-21T00:57:04.790 INFO:tasks.workunit.client.0.smithi112.stdout:0/707: dread d8/d11/d28/f68 [0,4194304] 0 2024-09-21T00:57:04.794 INFO:tasks.workunit.client.0.smithi112.stdout:8/780: link d0/d13/d1b/d22/d42/d51/f76 d0/d13/d2a/ddc/ffc 0 2024-09-21T00:57:04.795 INFO:tasks.workunit.client.0.smithi112.stdout:9/953: dread d5/d62/f113 [0,4194304] 0 2024-09-21T00:57:04.798 INFO:tasks.workunit.client.0.smithi112.stdout:4/770: creat d1/d7/d9/d1a/de5/f102 x:0 0 0 2024-09-21T00:57:04.799 INFO:tasks.workunit.client.0.smithi112.stdout:6/814: write d9/d1f/d47/d34/da6/da7/dcf/d60/da4/fd0 [392272,393] 0 2024-09-21T00:57:04.803 INFO:tasks.workunit.client.0.smithi112.stdout:0/708: unlink d8/d1b/d2c/d2e/d4c/d64/lcc 0 2024-09-21T00:57:04.803 INFO:tasks.workunit.client.0.smithi112.stdout:8/781: stat d0/f11 0 2024-09-21T00:57:04.804 INFO:tasks.workunit.client.0.smithi112.stdout:5/626: mknod d8/d9/d13/d2a/df/d5b/dbe/db6/cc7 0 2024-09-21T00:57:04.805 INFO:tasks.workunit.client.0.smithi112.stdout:9/954: mknod d5/db4/c134 0 2024-09-21T00:57:04.808 INFO:tasks.workunit.client.0.smithi112.stdout:4/771: fdatasync d1/d5/d1c/d1e/d4a/f7d 0 2024-09-21T00:57:04.809 INFO:tasks.workunit.client.0.smithi112.stdout:5/627: dread d8/d9/d13/fb4 [0,4194304] 0 2024-09-21T00:57:04.810 INFO:tasks.workunit.client.0.smithi112.stdout:5/628: readlink d8/d9/d13/l6f 0 2024-09-21T00:57:04.810 INFO:tasks.workunit.client.0.smithi112.stdout:6/815: creat d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f126 x:0 0 0 2024-09-21T00:57:04.810 INFO:tasks.workunit.client.0.smithi112.stdout:9/955: dread d5/d62/f113 [0,4194304] 0 2024-09-21T00:57:04.819 INFO:tasks.workunit.client.0.smithi112.stdout:1/714: link d5/d8/dd/d97/d46/fa2 d5/d8/dd/d54/fea 0 2024-09-21T00:57:04.823 INFO:tasks.workunit.client.0.smithi112.stdout:6/816: creat d9/d1f/d47/d74/d8e/f127 x:0 0 0 2024-09-21T00:57:04.823 INFO:tasks.workunit.client.0.smithi112.stdout:0/709: write d8/d1b/d2c/d2e/d4c/d6b/f77 [75849,117060] 0 2024-09-21T00:57:04.824 INFO:tasks.workunit.client.0.smithi112.stdout:9/956: creat d5/d3b/d5f/d13/d56/d115/f135 x:0 0 0 2024-09-21T00:57:04.829 INFO:tasks.workunit.client.0.smithi112.stdout:8/782: dread d0/d13/d9f/fca [0,4194304] 0 2024-09-21T00:57:04.830 INFO:tasks.workunit.client.0.smithi112.stdout:6/817: rename d9/df/d56/dbc to d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/d128 0 2024-09-21T00:57:04.833 INFO:tasks.workunit.client.0.smithi112.stdout:1/715: truncate d5/d8/d10/f29 877684 0 2024-09-21T00:57:04.834 INFO:tasks.workunit.client.0.smithi112.stdout:0/710: mknod d8/d11/d28/dbf/dd3/dd7/ce4 0 2024-09-21T00:57:04.835 INFO:tasks.workunit.client.0.smithi112.stdout:0/711: write d8/d62/d9d/fba [237514,50319] 0 2024-09-21T00:57:04.838 INFO:tasks.workunit.client.0.smithi112.stdout:6/818: creat d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/f129 x:0 0 0 2024-09-21T00:57:04.849 INFO:tasks.workunit.client.0.smithi112.stdout:9/957: link d5/d6/d3f/f4c d5/d3b/d5f/d59/d11e/f136 0 2024-09-21T00:57:04.850 INFO:tasks.workunit.client.0.smithi112.stdout:8/783: write d0/d13/d1b/d22/f7c [267196,92836] 0 2024-09-21T00:57:04.851 INFO:tasks.workunit.client.0.smithi112.stdout:6/819: fsync d9/d1f/d3e/d6f/fbf 0 2024-09-21T00:57:04.852 INFO:tasks.workunit.client.0.smithi112.stdout:5/629: link d8/d9/d13/d2a/d58/f5e d8/d9/d13/d2a/df/d5b/dbe/fc8 0 2024-09-21T00:57:04.858 INFO:tasks.workunit.client.0.smithi112.stdout:9/958: creat d5/d3b/d5f/d13/d6e/da0/d10c/f137 x:0 0 0 2024-09-21T00:57:04.861 INFO:tasks.workunit.client.0.smithi112.stdout:6/820: symlink d9/d1f/d47/d74/d8b/daa/l12a 0 2024-09-21T00:57:04.861 INFO:tasks.workunit.client.0.smithi112.stdout:5/630: symlink d8/d9/d13/d1c/d45/lc9 0 2024-09-21T00:57:04.865 INFO:tasks.workunit.client.0.smithi112.stdout:0/712: dwrite d8/d1b/d2c/d2e/d4c/d64/d96/f97 [0,4194304] 0 2024-09-21T00:57:04.866 INFO:tasks.workunit.client.0.smithi112.stdout:8/784: creat d0/d13/d1b/d22/d42/ffd x:0 0 0 2024-09-21T00:57:04.869 INFO:tasks.workunit.client.0.smithi112.stdout:9/959: dread d5/d6/d19/f28 [0,4194304] 0 2024-09-21T00:57:04.870 INFO:tasks.workunit.client.0.smithi112.stdout:5/631: mknod d8/d9/d13/d2a/df/cca 0 2024-09-21T00:57:04.871 INFO:tasks.workunit.client.0.smithi112.stdout:1/716: dwrite d5/d8/fb6 [0,4194304] 0 2024-09-21T00:57:04.873 INFO:tasks.workunit.client.0.smithi112.stdout:8/785: fsync d0/d13/d1b/d22/d42/d51/f69 0 2024-09-21T00:57:04.874 INFO:tasks.workunit.client.0.smithi112.stdout:9/960: chown d5/d3b/d5f/d13/d54/d7d/d57/d6a/cc3 2 1 2024-09-21T00:57:04.875 INFO:tasks.workunit.client.0.smithi112.stdout:8/786: chown d0/f62 3 1 2024-09-21T00:57:04.878 INFO:tasks.workunit.client.0.smithi112.stdout:6/821: dwrite d9/d1f/d3e/d77/d45/fe2 [0,4194304] 0 2024-09-21T00:57:04.882 INFO:tasks.workunit.client.0.smithi112.stdout:8/787: chown d0/d13/d1b/d22/d61/c72 22 1 2024-09-21T00:57:04.886 INFO:tasks.workunit.client.0.smithi112.stdout:9/961: unlink d5/d3b/d5f/d13/l64 0 2024-09-21T00:57:04.887 INFO:tasks.workunit.client.0.smithi112.stdout:6/822: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/d128/l12b 0 2024-09-21T00:57:04.888 INFO:tasks.workunit.client.0.smithi112.stdout:0/713: link d8/d11/d28/dbf/dd3/dd7/ccd d8/d11/d28/dbf/ce5 0 2024-09-21T00:57:04.890 INFO:tasks.workunit.client.0.smithi112.stdout:8/788: rename d0/d13/d1b/d22/d2e/d34/d7b/d80/cd1 to d0/d13/cfe 0 2024-09-21T00:57:04.891 INFO:tasks.workunit.client.0.smithi112.stdout:9/962: mknod d5/d3b/d5f/d59/c138 0 2024-09-21T00:57:04.891 INFO:tasks.workunit.client.0.smithi112.stdout:8/789: chown d0/d13/d1b/d22/c46 2 1 2024-09-21T00:57:04.892 INFO:tasks.workunit.client.0.smithi112.stdout:6/823: mknod d9/d1f/d3e/d9a/c12c 0 2024-09-21T00:57:04.893 INFO:tasks.workunit.client.0.smithi112.stdout:5/632: dread d8/d9/f28 [0,4194304] 0 2024-09-21T00:57:04.894 INFO:tasks.workunit.client.0.smithi112.stdout:0/714: mkdir d8/d1b/d2c/d2e/d4c/d64/d96/de6 0 2024-09-21T00:57:04.895 INFO:tasks.workunit.client.0.smithi112.stdout:6/824: readlink d9/d1f/d47/d74/d8b/daa/dd4/l82 0 2024-09-21T00:57:04.896 INFO:tasks.workunit.client.0.smithi112.stdout:8/790: creat d0/d13/d2a/d73/d96/fff x:0 0 0 2024-09-21T00:57:04.898 INFO:tasks.workunit.client.0.smithi112.stdout:5/633: creat d8/d9/d13/d2a/d2c/d96/fcb x:0 0 0 2024-09-21T00:57:04.899 INFO:tasks.workunit.client.0.smithi112.stdout:0/715: mknod d8/d1b/d2c/d2e/d4c/d64/ce7 0 2024-09-21T00:57:04.900 INFO:tasks.workunit.client.0.smithi112.stdout:5/634: fsync d8/d9/d13/d2a/da1/faa 0 2024-09-21T00:57:04.900 INFO:tasks.workunit.client.0.smithi112.stdout:5/635: chown d8/d9/d13/d2a/l62 1 1 2024-09-21T00:57:04.902 INFO:tasks.workunit.client.0.smithi112.stdout:6/825: creat d9/d1f/d47/d34/da6/da7/dcf/d60/f12d x:0 0 0 2024-09-21T00:57:04.902 INFO:tasks.workunit.client.0.smithi112.stdout:1/717: dread d5/d8/f3d [0,4194304] 0 2024-09-21T00:57:04.903 INFO:tasks.workunit.client.0.smithi112.stdout:8/791: fsync d0/d13/d1b/d22/d2e/d34/d7b/f8e 0 2024-09-21T00:57:04.906 INFO:tasks.workunit.client.0.smithi112.stdout:0/716: fsync d8/d11/d28/dbf/fc9 0 2024-09-21T00:57:04.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:04 smithi187 ceph-mon[34997]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 43 MiB/s rd, 104 MiB/s wr, 265 op/s 2024-09-21T00:57:04.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:04 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:04.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:04 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:04.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:04 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:57:04.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:04 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:57:04.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:04 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:04.909 INFO:tasks.workunit.client.0.smithi112.stdout:1/718: dread - d5/d8/f83 zero size 2024-09-21T00:57:04.914 INFO:tasks.workunit.client.0.smithi112.stdout:6/826: rename d9/d1f/d3e/f54 to d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f12e 0 2024-09-21T00:57:04.918 INFO:tasks.workunit.client.0.smithi112.stdout:5/636: truncate d8/d9/d13/d1c/d99/fb3 4459089 0 2024-09-21T00:57:04.918 INFO:tasks.workunit.client.0.smithi112.stdout:9/963: truncate d5/d3b/d5f/d13/d54/d7d/d57/fc7 1039674 0 2024-09-21T00:57:04.922 INFO:tasks.workunit.client.0.smithi112.stdout:8/792: rename d0/d13/d1b/d22/d42/d51 to d0/d13/dab/dc6/d100 0 2024-09-21T00:57:04.922 INFO:tasks.workunit.client.0.smithi112.stdout:8/793: readlink d0/d13/dab/dc6/d100/d9a/lf1 0 2024-09-21T00:57:04.924 INFO:tasks.workunit.client.0.smithi112.stdout:8/794: fdatasync d0/d13/d1b/d22/d2e/d34/dd6/fdf 0 2024-09-21T00:57:04.927 INFO:tasks.workunit.client.0.smithi112.stdout:9/964: read d5/d3b/d5f/d13/ff1 [958819,43135] 0 2024-09-21T00:57:04.979 INFO:tasks.workunit.client.0.smithi112.stdout:1/719: symlink d5/d8/dd/d8e/dca/leb 0 2024-09-21T00:57:04.980 INFO:tasks.workunit.client.0.smithi112.stdout:5/637: creat d8/d9/d13/d1c/d45/d8a/dc0/fcc x:0 0 0 2024-09-21T00:57:04.986 INFO:tasks.workunit.client.0.smithi112.stdout:0/717: link d8/d1b/d2c/d2e/d4c/f50 d8/d75/d9c/fe8 0 2024-09-21T00:57:04.988 INFO:tasks.workunit.client.0.smithi112.stdout:8/795: truncate d0/d13/d1b/f32 927295 0 2024-09-21T00:57:04.990 INFO:tasks.workunit.client.0.smithi112.stdout:5/638: readlink d8/d9/d13/d1c/d45/d8a/lba 0 2024-09-21T00:57:04.991 INFO:tasks.workunit.client.0.smithi112.stdout:5/639: stat d8/d9/d13/d1c/d45/l68 0 2024-09-21T00:57:04.993 INFO:tasks.workunit.client.0.smithi112.stdout:9/965: truncate d5/d3b/d5f/d59/d11e/f136 189632 0 2024-09-21T00:57:04.999 INFO:tasks.workunit.client.0.smithi112.stdout:9/966: creat d5/d3b/d5f/d13/d56/d115/f139 x:0 0 0 2024-09-21T00:57:05.002 INFO:tasks.workunit.client.0.smithi112.stdout:5/640: mkdir d8/d9/dcd 0 2024-09-21T00:57:05.004 INFO:tasks.workunit.client.0.smithi112.stdout:9/967: rmdir d5/d3b/d5f/d13/d54/dc1/ddc 39 2024-09-21T00:57:05.005 INFO:tasks.workunit.client.0.smithi112.stdout:9/968: read d5/d3b/d5f/d13/fd3 [2145557,123963] 0 2024-09-21T00:57:05.006 INFO:tasks.workunit.client.0.smithi112.stdout:5/641: mknod d8/d9/dcd/cce 0 2024-09-21T00:57:05.007 INFO:tasks.workunit.client.0.smithi112.stdout:5/642: write d8/d9/f64 [4493546,53465] 0 2024-09-21T00:57:05.008 INFO:tasks.workunit.client.0.smithi112.stdout:5/643: write d8/d9/d13/d2a/d2c/fc6 [222707,81279] 0 2024-09-21T00:57:05.009 INFO:tasks.workunit.client.0.smithi112.stdout:9/969: mkdir d5/d3b/d5f/dfb/d13a 0 2024-09-21T00:57:05.013 INFO:tasks.workunit.client.0.smithi112.stdout:5/644: mknod d8/d9/d13/d2a/d2c/d96/d9f/ccf 0 2024-09-21T00:57:05.014 INFO:tasks.workunit.client.0.smithi112.stdout:5/645: chown d8/d9/la8 1062 1 2024-09-21T00:57:05.014 INFO:tasks.workunit.client.0.smithi112.stdout:9/970: creat d5/f13b x:0 0 0 2024-09-21T00:57:05.018 INFO:tasks.workunit.client.0.smithi112.stdout:0/718: dwrite d8/d1b/f36 [4194304,4194304] 0 2024-09-21T00:57:05.020 INFO:tasks.workunit.client.0.smithi112.stdout:1/720: write d5/d8/dd/dcc/f44 [661020,26451] 0 2024-09-21T00:57:05.021 INFO:tasks.workunit.client.0.smithi112.stdout:0/719: chown d8/d11/d28/dbf/ce5 5639332 1 2024-09-21T00:57:05.022 INFO:tasks.workunit.client.0.smithi112.stdout:0/720: chown d8/d75/d91/d9b/fac 5268 1 2024-09-21T00:57:05.024 INFO:tasks.workunit.client.0.smithi112.stdout:9/971: rename d5/db4/c134 to d5/d6/d70/c13c 0 2024-09-21T00:57:05.025 INFO:tasks.workunit.client.0.smithi112.stdout:9/972: dread - d5/d3b/d5f/f114 zero size 2024-09-21T00:57:05.028 INFO:tasks.workunit.client.0.smithi112.stdout:0/721: getdents d8/d75 0 2024-09-21T00:57:05.028 INFO:tasks.workunit.client.0.smithi112.stdout:1/721: dwrite d5/d8/dd/d97/fe2 [0,4194304] 0 2024-09-21T00:57:05.030 INFO:tasks.workunit.client.0.smithi112.stdout:9/973: mkdir d5/d3b/d5f/d13/d56/d13d 0 2024-09-21T00:57:05.035 INFO:tasks.workunit.client.0.smithi112.stdout:1/722: symlink d5/d8/d14/lec 0 2024-09-21T00:57:05.037 INFO:tasks.workunit.client.0.smithi112.stdout:1/723: stat d5/d8/dd/f8a 0 2024-09-21T00:57:05.038 INFO:tasks.workunit.client.0.smithi112.stdout:9/974: mknod d5/d3b/d5f/d13/d56/d13d/c13e 0 2024-09-21T00:57:05.043 INFO:tasks.workunit.client.0.smithi112.stdout:5/646: dread d8/d9/d13/d2a/f18 [0,4194304] 0 2024-09-21T00:57:05.046 INFO:tasks.workunit.client.0.smithi112.stdout:5/647: fsync d8/d9/d13/fb4 0 2024-09-21T00:57:05.046 INFO:tasks.workunit.client.0.smithi112.stdout:5/648: chown d8/l2b 64211 1 2024-09-21T00:57:05.046 INFO:tasks.workunit.client.0.smithi112.stdout:5/649: chown d8/d9/d13/d2a/df 660995 1 2024-09-21T00:57:05.048 INFO:tasks.workunit.client.0.smithi112.stdout:2/812: sync 2024-09-21T00:57:05.049 INFO:tasks.workunit.client.0.smithi112.stdout:5/650: creat d8/d9/d13/d1c/d45/d8a/dc0/fd0 x:0 0 0 2024-09-21T00:57:05.051 INFO:tasks.workunit.client.0.smithi112.stdout:2/813: mkdir d0/d45/d8a/d62/dcf/d109 0 2024-09-21T00:57:05.052 INFO:tasks.workunit.client.0.smithi112.stdout:5/651: unlink d8/d9/d13/d2a/d2c/l4e 0 2024-09-21T00:57:05.057 INFO:tasks.workunit.client.0.smithi112.stdout:5/652: creat d8/d9/d13/d2a/fd1 x:0 0 0 2024-09-21T00:57:05.058 INFO:tasks.workunit.client.0.smithi112.stdout:5/653: dread - d8/d9/d13/d1c/d99/fad zero size 2024-09-21T00:57:05.070 INFO:tasks.workunit.client.0.smithi112.stdout:0/722: dwrite d8/d11/f81 [0,4194304] 0 2024-09-21T00:57:05.070 INFO:tasks.workunit.client.0.smithi112.stdout:1/724: write d5/d8/dd/f58 [1788085,3792] 0 2024-09-21T00:57:05.071 INFO:tasks.workunit.client.0.smithi112.stdout:2/814: dread d0/d45/d8a/f54 [0,4194304] 0 2024-09-21T00:57:05.074 INFO:tasks.workunit.client.0.smithi112.stdout:9/975: truncate d5/fb 3123314 0 2024-09-21T00:57:05.076 INFO:tasks.workunit.client.0.smithi112.stdout:0/723: unlink d8/d1b/d2c/d2e/fb9 0 2024-09-21T00:57:05.077 INFO:tasks.workunit.client.0.smithi112.stdout:0/724: chown d8/d11/d28/dbf 97941 1 2024-09-21T00:57:05.078 INFO:tasks.workunit.client.0.smithi112.stdout:0/725: write d8/d11/d28/fd0 [1073704,28462] 0 2024-09-21T00:57:05.078 INFO:tasks.workunit.client.0.smithi112.stdout:1/725: creat d5/d8/d13/d87/de7/fed x:0 0 0 2024-09-21T00:57:05.083 INFO:tasks.workunit.client.0.smithi112.stdout:1/726: mknod d5/d8/d13/d87/cee 0 2024-09-21T00:57:05.085 INFO:tasks.workunit.client.0.smithi112.stdout:9/976: unlink d5/d3b/d5f/d13/f50 0 2024-09-21T00:57:05.089 INFO:tasks.workunit.client.0.smithi112.stdout:0/726: rename d8/d11/f1e to d8/d1b/d2c/d2e/d4c/fe9 0 2024-09-21T00:57:05.091 INFO:tasks.workunit.client.0.smithi112.stdout:1/727: unlink d5/d8/d13/d87/de7/fed 0 2024-09-21T00:57:05.096 INFO:tasks.workunit.client.0.smithi112.stdout:1/728: unlink d5/d8/d14/lec 0 2024-09-21T00:57:05.099 INFO:tasks.workunit.client.0.smithi112.stdout:9/977: dwrite d5/d6/d19/f33 [4194304,4194304] 0 2024-09-21T00:57:05.099 INFO:tasks.workunit.client.0.smithi112.stdout:1/729: truncate d5/d8/dd/dcc/f44 1537158 0 2024-09-21T00:57:05.101 INFO:tasks.workunit.client.0.smithi112.stdout:5/654: truncate d8/d9/d13/f48 3694850 0 2024-09-21T00:57:05.105 INFO:tasks.workunit.client.0.smithi112.stdout:2/815: dread d0/d45/d8a/f6f [0,4194304] 0 2024-09-21T00:57:05.107 INFO:tasks.workunit.client.0.smithi112.stdout:1/730: creat d5/d3a/d4b/de9/fef x:0 0 0 2024-09-21T00:57:05.114 INFO:tasks.workunit.client.0.smithi112.stdout:1/731: dread d5/d8/dd/d97/d46/d70/f84 [0,4194304] 0 2024-09-21T00:57:05.115 INFO:tasks.workunit.client.0.smithi112.stdout:5/655: symlink d8/d9/d13/d2a/ld2 0 2024-09-21T00:57:05.118 INFO:tasks.workunit.client.0.smithi112.stdout:2/816: dwrite d0/d60/d78/fe8 [0,4194304] 0 2024-09-21T00:57:05.126 INFO:tasks.workunit.client.0.smithi112.stdout:1/732: dread d5/d8/fb6 [0,4194304] 0 2024-09-21T00:57:05.128 INFO:tasks.workunit.client.0.smithi112.stdout:2/817: symlink d0/d14/d8/l10a 0 2024-09-21T00:57:05.130 INFO:tasks.workunit.client.0.smithi112.stdout:2/818: write d0/d45/d8a/d83/f103 [3028103,4229] 0 2024-09-21T00:57:05.132 INFO:tasks.workunit.client.0.smithi112.stdout:2/819: fsync d0/d14/f50 0 2024-09-21T00:57:05.138 INFO:tasks.workunit.client.0.smithi112.stdout:1/733: symlink d5/d8/dd/d97/d46/lf0 0 2024-09-21T00:57:05.140 INFO:tasks.workunit.client.0.smithi112.stdout:2/820: mknod d0/d45/d8a/dd7/c10b 0 2024-09-21T00:57:05.145 INFO:tasks.workunit.client.0.smithi112.stdout:0/727: dwrite d8/d1b/d2c/d2e/f39 [0,4194304] 0 2024-09-21T00:57:05.147 INFO:tasks.workunit.client.0.smithi112.stdout:0/728: write d8/d11/f23 [3029899,20389] 0 2024-09-21T00:57:05.148 INFO:tasks.workunit.client.0.smithi112.stdout:2/821: dread d0/df/f13 [0,4194304] 0 2024-09-21T00:57:05.159 INFO:tasks.workunit.client.0.smithi112.stdout:2/822: rename d0/d14/d22/c2c to d0/d45/d8a/d99/c10c 0 2024-09-21T00:57:05.163 INFO:tasks.workunit.client.0.smithi112.stdout:2/823: unlink d0/d14/d22/f7e 0 2024-09-21T00:57:05.165 INFO:tasks.workunit.client.0.smithi112.stdout:2/824: readlink d0/d14/d8/da2/lcb 0 2024-09-21T00:57:05.165 INFO:tasks.workunit.client.0.smithi112.stdout:5/656: write d8/d9/d13/d1c/d99/f65 [82683,17093] 0 2024-09-21T00:57:05.167 INFO:tasks.workunit.client.0.smithi112.stdout:9/978: dwrite d5/d3b/d5f/d13/d56/f133 [0,4194304] 0 2024-09-21T00:57:05.172 INFO:tasks.workunit.client.0.smithi112.stdout:0/729: write d8/d11/d28/f68 [51945,78859] 0 2024-09-21T00:57:05.179 INFO:tasks.workunit.client.0.smithi112.stdout:0/730: rmdir d8/d11/d28/d54 39 2024-09-21T00:57:05.179 INFO:tasks.workunit.client.0.smithi112.stdout:1/734: dread d5/d8/d14/f3b [0,4194304] 0 2024-09-21T00:57:05.185 INFO:tasks.workunit.client.0.smithi112.stdout:9/979: rename d5/d3b/d79/df6/f118 to d5/d3b/d5f/d13/d54/dc1/f13f 0 2024-09-21T00:57:05.186 INFO:tasks.workunit.client.0.smithi112.stdout:1/735: unlink d5/d8/d14/f3b 0 2024-09-21T00:57:05.188 INFO:tasks.workunit.client.0.smithi112.stdout:0/731: dwrite d8/d75/d91/d9b/fac [0,4194304] 0 2024-09-21T00:57:05.189 INFO:tasks.workunit.client.0.smithi112.stdout:5/657: getdents d8/d9/d13/d2a/d84 0 2024-09-21T00:57:05.190 INFO:tasks.workunit.client.0.smithi112.stdout:1/736: mkdir d5/d8/dd/d8e/dca/df1 0 2024-09-21T00:57:05.191 INFO:tasks.workunit.client.0.smithi112.stdout:9/980: fdatasync d5/d3b/d5f/d13/f45 0 2024-09-21T00:57:05.193 INFO:tasks.workunit.client.0.smithi112.stdout:5/658: stat d8/d9/d13/d1c/d45/ca3 0 2024-09-21T00:57:05.196 INFO:tasks.workunit.client.0.smithi112.stdout:2/825: rename d0/d14/c75 to d0/d45/d8a/d99/c10d 0 2024-09-21T00:57:05.197 INFO:tasks.workunit.client.0.smithi112.stdout:0/732: rmdir d8/d1b/d2c/d2e/d4c/d64/d96 39 2024-09-21T00:57:05.197 INFO:tasks.workunit.client.0.smithi112.stdout:7/847: sync 2024-09-21T00:57:05.197 INFO:tasks.workunit.client.0.smithi112.stdout:4/772: sync 2024-09-21T00:57:05.199 INFO:tasks.workunit.client.0.smithi112.stdout:4/773: truncate d1/d5/d1c/d1e/daf/ffd 67115 0 2024-09-21T00:57:05.201 INFO:tasks.workunit.client.0.smithi112.stdout:0/733: dread d8/f5e [0,4194304] 0 2024-09-21T00:57:05.202 INFO:tasks.workunit.client.0.smithi112.stdout:0/734: chown d8/d11/d59 0 1 2024-09-21T00:57:05.204 INFO:tasks.workunit.client.0.smithi112.stdout:0/735: truncate d8/d1b/d2c/d2e/fb4 113446 0 2024-09-21T00:57:05.205 INFO:tasks.workunit.client.0.smithi112.stdout:7/848: dwrite d0/d2/d2e/df6/d39/d56/d65/d75/d9a/def/fb8 [0,4194304] 0 2024-09-21T00:57:05.208 INFO:tasks.workunit.client.0.smithi112.stdout:1/737: rename d5/d8/c5d to d5/d8/dd/d8e/dca/cf2 0 2024-09-21T00:57:05.213 INFO:tasks.workunit.client.0.smithi112.stdout:5/659: write d8/d9/d13/d2a/df/f94 [463602,63810] 0 2024-09-21T00:57:05.215 INFO:tasks.workunit.client.0.smithi112.stdout:4/774: mkdir d1/d5/d1c/d1e/d76/d103 0 2024-09-21T00:57:05.219 INFO:tasks.workunit.client.0.smithi112.stdout:5/660: rename d8/d9/d13/d2a/f26 to d8/d9/d13/d1c/dbc/fd3 0 2024-09-21T00:57:05.220 INFO:tasks.workunit.client.0.smithi112.stdout:4/775: dread d1/d5/d1c/fa4 [0,4194304] 0 2024-09-21T00:57:05.221 INFO:tasks.workunit.client.0.smithi112.stdout:4/776: readlink d1/d5/d1c/d1e/d4a/d5f/lf9 0 2024-09-21T00:57:05.222 INFO:tasks.workunit.client.0.smithi112.stdout:0/736: mkdir d8/d1b/d2c/d2e/d4c/d64/d96/da3/dea 0 2024-09-21T00:57:05.227 INFO:tasks.workunit.client.0.smithi112.stdout:4/777: dwrite d1/d7/df7/dc2/fda [0,4194304] 0 2024-09-21T00:57:05.228 INFO:tasks.workunit.client.0.smithi112.stdout:4/778: write d1/d2d/f8f [175920,50317] 0 2024-09-21T00:57:05.229 INFO:tasks.workunit.client.0.smithi112.stdout:2/826: dwrite d0/d14/f87 [0,4194304] 0 2024-09-21T00:57:05.229 INFO:tasks.workunit.client.0.smithi112.stdout:7/849: truncate d0/d2/d32/da4/db2/db4/dba/fe3 2443494 0 2024-09-21T00:57:05.232 INFO:tasks.workunit.client.0.smithi112.stdout:2/827: write d0/d14/d8/d27/d7a/ffd [162697,42669] 0 2024-09-21T00:57:05.232 INFO:tasks.workunit.client.0.smithi112.stdout:9/981: getdents d5/d3b/d79/d103 0 2024-09-21T00:57:05.238 INFO:tasks.workunit.client.0.smithi112.stdout:0/737: chown d8/fcb 512148600 1 2024-09-21T00:57:05.245 INFO:tasks.workunit.client.0.smithi112.stdout:4/779: mknod d1/d7/d9/d1a/d22/c104 0 2024-09-21T00:57:05.246 INFO:tasks.workunit.client.0.smithi112.stdout:5/661: write d8/d9/f28 [1789149,105049] 0 2024-09-21T00:57:05.247 INFO:tasks.workunit.client.0.smithi112.stdout:4/780: chown d1/d5/d1c/d1e/daf/ffd 800805 1 2024-09-21T00:57:05.247 INFO:tasks.workunit.client.0.smithi112.stdout:7/850: rename d0/d2/d38/d48/dad/c6f to d0/d2/d32/da4/db2/c116 0 2024-09-21T00:57:05.249 INFO:tasks.workunit.client.0.smithi112.stdout:7/851: dread - d0/d2/d38/d48/dad/f9b zero size 2024-09-21T00:57:05.249 INFO:tasks.workunit.client.0.smithi112.stdout:4/781: read d1/d5/d1c/d1e/d4a/d5f/d83/fdd [12356,22110] 0 2024-09-21T00:57:05.250 INFO:tasks.workunit.client.0.smithi112.stdout:9/982: creat d5/d3b/d5f/d59/f140 x:0 0 0 2024-09-21T00:57:05.253 INFO:tasks.workunit.client.0.smithi112.stdout:1/738: link d5/d8/dd/dcc/f6e d5/d8/dd/d97/d46/ff3 0 2024-09-21T00:57:05.254 INFO:tasks.workunit.client.0.smithi112.stdout:1/739: write d5/d8/d13/d87/fe3 [381618,30131] 0 2024-09-21T00:57:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:04 smithi112 ceph-mon[28078]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 43 MiB/s rd, 104 MiB/s wr, 265 op/s 2024-09-21T00:57:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:04 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:04 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:04 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:57:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:04 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T00:57:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:04 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:05.262 INFO:tasks.workunit.client.0.smithi112.stdout:7/852: symlink d0/d2/d2e/df6/d39/d56/d65/d87/l117 0 2024-09-21T00:57:05.270 INFO:tasks.workunit.client.0.smithi112.stdout:5/662: dread d8/d9/f27 [0,4194304] 0 2024-09-21T00:57:05.271 INFO:tasks.workunit.client.0.smithi112.stdout:4/782: symlink d1/d5/d1c/d1e/l105 0 2024-09-21T00:57:05.272 INFO:tasks.workunit.client.0.smithi112.stdout:1/740: mknod d5/d8/d10/cf4 0 2024-09-21T00:57:05.272 INFO:tasks.workunit.client.0.smithi112.stdout:0/738: dwrite d8/d1b/d2c/d2e/d4c/f80 [0,4194304] 0 2024-09-21T00:57:05.274 INFO:tasks.workunit.client.0.smithi112.stdout:1/741: chown d5/d3a/fae 1359126 1 2024-09-21T00:57:05.281 INFO:tasks.workunit.client.0.smithi112.stdout:1/742: dread d5/d8/f3d [0,4194304] 0 2024-09-21T00:57:05.281 INFO:tasks.workunit.client.0.smithi112.stdout:9/983: dread d5/d3b/d5f/d13/d6e/da0/de6/f109 [4194304,4194304] 0 2024-09-21T00:57:05.283 INFO:tasks.workunit.client.0.smithi112.stdout:9/984: write d5/d3b/d5f/f24 [910265,110993] 0 2024-09-21T00:57:05.283 INFO:tasks.workunit.client.0.smithi112.stdout:7/853: creat d0/f118 x:0 0 0 2024-09-21T00:57:05.286 INFO:tasks.workunit.client.0.smithi112.stdout:4/783: write d1/d5/d1c/d1e/d4a/d5f/d83/fdd [737135,73237] 0 2024-09-21T00:57:05.287 INFO:tasks.workunit.client.0.smithi112.stdout:4/784: fdatasync d1/d7/df7/fed 0 2024-09-21T00:57:05.290 INFO:tasks.workunit.client.0.smithi112.stdout:0/739: write d8/f19 [4304047,111869] 0 2024-09-21T00:57:05.291 INFO:tasks.workunit.client.0.smithi112.stdout:9/985: fsync d5/d3b/d5f/db9/fe1 0 2024-09-21T00:57:05.292 INFO:tasks.workunit.client.0.smithi112.stdout:9/986: stat d5/d3b/d5f/d13/d54/d7d/d57/da8 0 2024-09-21T00:57:05.293 INFO:tasks.workunit.client.0.smithi112.stdout:7/854: creat d0/d2/d2e/df6/d39/d55/f119 x:0 0 0 2024-09-21T00:57:05.295 INFO:tasks.workunit.client.0.smithi112.stdout:7/855: stat d0/d2/d2e/df6/d39/d56/d65 0 2024-09-21T00:57:05.295 INFO:tasks.workunit.client.0.smithi112.stdout:5/663: dread d8/d9/d13/d1c/f91 [0,4194304] 0 2024-09-21T00:57:05.296 INFO:tasks.workunit.client.0.smithi112.stdout:4/785: mkdir d1/d5/d1c/d1e/d76/d106 0 2024-09-21T00:57:05.300 INFO:tasks.workunit.client.0.smithi112.stdout:9/987: creat d5/db4/f141 x:0 0 0 2024-09-21T00:57:05.302 INFO:tasks.workunit.client.0.smithi112.stdout:7/856: dwrite d0/d2/d2e/df6/de4/ffa [0,4194304] 0 2024-09-21T00:57:05.302 INFO:tasks.workunit.client.0.smithi112.stdout:9/988: write d5/d3b/d79/f11a [558999,85403] 0 2024-09-21T00:57:05.303 INFO:tasks.workunit.client.0.smithi112.stdout:4/786: rmdir d1/d7/d30/d91 39 2024-09-21T00:57:05.307 INFO:tasks.workunit.client.0.smithi112.stdout:5/664: creat d8/d9/d13/d2a/d2c/d96/d9f/fd4 x:0 0 0 2024-09-21T00:57:05.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/740: dwrite d8/f3c [0,4194304] 0 2024-09-21T00:57:05.310 INFO:tasks.workunit.client.0.smithi112.stdout:9/989: symlink d5/d6/d19/d51/l142 0 2024-09-21T00:57:05.311 INFO:tasks.workunit.client.0.smithi112.stdout:0/741: read - d8/d1b/d2c/d2e/d4c/d64/f8c zero size 2024-09-21T00:57:05.314 INFO:tasks.workunit.client.0.smithi112.stdout:7/857: symlink d0/d2/d2e/df6/d39/d56/d86/l11a 0 2024-09-21T00:57:05.318 INFO:tasks.workunit.client.0.smithi112.stdout:5/665: symlink d8/d9/d13/d2a/d2c/ld5 0 2024-09-21T00:57:05.319 INFO:tasks.workunit.client.0.smithi112.stdout:0/742: dwrite d8/d11/d59/f8a [0,4194304] 0 2024-09-21T00:57:05.321 INFO:tasks.workunit.client.0.smithi112.stdout:0/743: readlink d8/d1b/l6c 0 2024-09-21T00:57:05.325 INFO:tasks.workunit.client.0.smithi112.stdout:7/858: symlink d0/d2/d32/da4/db2/db4/l11b 0 2024-09-21T00:57:05.325 INFO:tasks.workunit.client.0.smithi112.stdout:9/990: dread d5/d6/d19/f1d [0,4194304] 0 2024-09-21T00:57:05.326 INFO:tasks.workunit.client.0.smithi112.stdout:7/859: chown d0/d2/d2e/df6/d39/d56/d65/f10d 11586 1 2024-09-21T00:57:05.328 INFO:tasks.workunit.client.0.smithi112.stdout:0/744: mknod d8/d1b/d2c/d2e/d4c/d6b/dc2/ceb 0 2024-09-21T00:57:05.331 INFO:tasks.workunit.client.0.smithi112.stdout:4/787: getdents d1/d7/d30/d91 0 2024-09-21T00:57:05.333 INFO:tasks.workunit.client.0.smithi112.stdout:0/745: unlink d8/l85 0 2024-09-21T00:57:05.334 INFO:tasks.workunit.client.0.smithi112.stdout:0/746: fdatasync d8/d1b/d2c/d2e/d4c/f80 0 2024-09-21T00:57:05.335 INFO:tasks.workunit.client.0.smithi112.stdout:9/991: truncate d5/d3b/d5f/d13/d56/f133 377664 0 2024-09-21T00:57:05.344 INFO:tasks.workunit.client.0.smithi112.stdout:5/666: dread d8/d9/d13/d2a/df/d5b/dbe/fa6 [0,4194304] 0 2024-09-21T00:57:05.351 INFO:tasks.workunit.client.0.smithi112.stdout:0/747: truncate d8/d1b/f67 410598 0 2024-09-21T00:57:05.353 INFO:tasks.workunit.client.0.smithi112.stdout:9/992: write d5/d3b/d5f/d13/d54/d7d/d57/d6a/fe7 [809236,75242] 0 2024-09-21T00:57:05.354 INFO:tasks.workunit.client.0.smithi112.stdout:5/667: write d8/d9/d13/d1c/d99/f89 [618982,124445] 0 2024-09-21T00:57:05.357 INFO:tasks.workunit.client.0.smithi112.stdout:0/748: mkdir d8/d11/d28/dbf/dd3/dec 0 2024-09-21T00:57:05.359 INFO:tasks.workunit.client.0.smithi112.stdout:9/993: symlink d5/d3b/d5f/d13/d54/d7d/d57/da8/l143 0 2024-09-21T00:57:05.364 INFO:tasks.workunit.client.0.smithi112.stdout:0/749: getdents d8/d1b/d2c/d2e/d4c/d64/d96/de6 0 2024-09-21T00:57:05.366 INFO:tasks.workunit.client.0.smithi112.stdout:5/668: getdents d8/d9/d13/d1c/d45/d8a/dc0 0 2024-09-21T00:57:05.370 INFO:tasks.workunit.client.0.smithi112.stdout:0/750: unlink d8/d1b/d2c/d2e/d4c/d64/d96/f97 0 2024-09-21T00:57:05.370 INFO:tasks.workunit.client.0.smithi112.stdout:0/751: chown d8/d1b/d2c/d2e/d4c/d64/d96/da3 747 1 2024-09-21T00:57:05.371 INFO:tasks.workunit.client.0.smithi112.stdout:0/752: dread - d8/d1b/d2c/d2e/d4c/d64/f92 zero size 2024-09-21T00:57:05.372 INFO:tasks.workunit.client.0.smithi112.stdout:5/669: creat d8/d9/d13/d2a/df/fd6 x:0 0 0 2024-09-21T00:57:05.377 INFO:tasks.workunit.client.0.smithi112.stdout:9/994: write d5/d6/d19/f80 [1501324,116819] 0 2024-09-21T00:57:05.379 INFO:tasks.workunit.client.0.smithi112.stdout:5/670: rename d8/d9/d13/d2a/d2c/d96/fcb to d8/d9/d13/d1c/d99/fd7 0 2024-09-21T00:57:05.380 INFO:tasks.workunit.client.0.smithi112.stdout:6/827: sync 2024-09-21T00:57:05.380 INFO:tasks.workunit.client.0.smithi112.stdout:8/796: sync 2024-09-21T00:57:05.381 INFO:tasks.workunit.client.0.smithi112.stdout:8/797: chown d0/d13/d9f/dc2/ld3 484549056 1 2024-09-21T00:57:05.385 INFO:tasks.workunit.client.0.smithi112.stdout:9/995: dread d5/d6/f9b [0,4194304] 0 2024-09-21T00:57:05.387 INFO:tasks.workunit.client.0.smithi112.stdout:6/828: unlink d9/d1f/d3e/d77/d79/fa8 0 2024-09-21T00:57:05.388 INFO:tasks.workunit.client.0.smithi112.stdout:8/798: dwrite d0/d13/d9f/fd4 [0,4194304] 0 2024-09-21T00:57:05.389 INFO:tasks.workunit.client.0.smithi112.stdout:0/753: creat d8/d11/d28/d54/fed x:0 0 0 2024-09-21T00:57:05.390 INFO:tasks.workunit.client.0.smithi112.stdout:0/754: dread - d8/d1b/f61 zero size 2024-09-21T00:57:05.395 INFO:tasks.workunit.client.0.smithi112.stdout:9/996: symlink d5/d3b/d5f/dfb/l144 0 2024-09-21T00:57:05.397 INFO:tasks.workunit.client.0.smithi112.stdout:5/671: creat d8/d9/d13/d2a/fd8 x:0 0 0 2024-09-21T00:57:05.398 INFO:tasks.workunit.client.0.smithi112.stdout:5/672: stat d8/d9/d13/d1c/fb2 0 2024-09-21T00:57:05.399 INFO:tasks.workunit.client.0.smithi112.stdout:6/829: mknod d9/d1f/d3e/d77/d79/d85/c12f 0 2024-09-21T00:57:05.401 INFO:tasks.workunit.client.0.smithi112.stdout:8/799: unlink d0/d13/dab/dc6/d100/fd0 0 2024-09-21T00:57:05.404 INFO:tasks.workunit.client.0.smithi112.stdout:5/673: dwrite d8/d9/d13/fb4 [0,4194304] 0 2024-09-21T00:57:05.405 INFO:tasks.workunit.client.0.smithi112.stdout:0/755: creat d8/d1b/d2c/d2e/d4c/da8/fee x:0 0 0 2024-09-21T00:57:05.407 INFO:tasks.workunit.client.0.smithi112.stdout:9/997: rename d5/d3b/d5f/d13/c9c to d5/d3b/d5f/d13/d6e/da0/da4/c145 0 2024-09-21T00:57:05.410 INFO:tasks.workunit.client.0.smithi112.stdout:5/674: fsync d8/f8c 0 2024-09-21T00:57:05.412 INFO:tasks.workunit.client.0.smithi112.stdout:6/830: mknod d9/d1f/d3e/d6f/de4/dfd/c130 0 2024-09-21T00:57:05.418 INFO:tasks.workunit.client.0.smithi112.stdout:6/831: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d131 0 2024-09-21T00:57:05.420 INFO:tasks.workunit.client.0.smithi112.stdout:5/675: symlink d8/d9/d13/d2a/df/d5b/ld9 0 2024-09-21T00:57:05.421 INFO:tasks.workunit.client.0.smithi112.stdout:6/832: mkdir d9/df/d56/dde/d132 0 2024-09-21T00:57:05.422 INFO:tasks.workunit.client.0.smithi112.stdout:6/833: read d9/f12 [5065746,129341] 0 2024-09-21T00:57:05.424 INFO:tasks.workunit.client.0.smithi112.stdout:6/834: fdatasync d9/d1f/d47/d34/da6/da7/dcf/d21/d84/f117 0 2024-09-21T00:57:05.426 INFO:tasks.workunit.client.0.smithi112.stdout:8/800: dread d0/f3c [4194304,4194304] 0 2024-09-21T00:57:05.426 INFO:tasks.workunit.client.0.smithi112.stdout:5/676: write d8/f8c [958999,34339] 0 2024-09-21T00:57:05.428 INFO:tasks.workunit.client.0.smithi112.stdout:8/801: chown d0/ff0 1 1 2024-09-21T00:57:05.431 INFO:tasks.workunit.client.0.smithi112.stdout:0/756: dwrite d8/fcb [4194304,4194304] 0 2024-09-21T00:57:05.433 INFO:tasks.workunit.client.0.smithi112.stdout:6/835: creat d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f133 x:0 0 0 2024-09-21T00:57:05.434 INFO:tasks.workunit.client.0.smithi112.stdout:5/677: fdatasync f7 0 2024-09-21T00:57:05.434 INFO:tasks.workunit.client.0.smithi112.stdout:9/998: dwrite d5/f22 [4194304,4194304] 0 2024-09-21T00:57:05.443 INFO:tasks.workunit.client.0.smithi112.stdout:8/802: dwrite d0/d13/d1b/d22/d2e/d34/d7b/f71 [4194304,4194304] 0 2024-09-21T00:57:05.445 INFO:tasks.workunit.client.0.smithi112.stdout:8/803: readlink d0/d13/d2a/d73/d96/la0 0 2024-09-21T00:57:05.448 INFO:tasks.workunit.client.0.smithi112.stdout:9/999: dwrite d5/d3b/d5f/d13/d6e/da0/f117 [0,4194304] 0 2024-09-21T00:57:05.450 INFO:tasks.workunit.client.0.smithi112.stdout:0/757: rename d8/d1b/d2c/d2e/d4c/d64/d96 to d8/d11/d28/dbf/dd3/dec/def 0 2024-09-21T00:57:05.451 INFO:tasks.workunit.client.0.smithi112.stdout:5/678: mkdir d8/d9/d13/d2a/d84/d8b/dda 0 2024-09-21T00:57:05.452 INFO:tasks.workunit.client.0.smithi112.stdout:0/758: chown d8/d11/d59/d78/f7a 1504 1 2024-09-21T00:57:05.454 INFO:tasks.workunit.client.0.smithi112.stdout:6/836: write d9/f20 [4886201,2205] 0 2024-09-21T00:57:05.455 INFO:tasks.workunit.client.0.smithi112.stdout:5/679: write d8/d9/d13/d1c/d99/f65 [370313,48841] 0 2024-09-21T00:57:05.458 INFO:tasks.workunit.client.0.smithi112.stdout:0/759: creat d8/d62/dbd/ff0 x:0 0 0 2024-09-21T00:57:05.458 INFO:tasks.workunit.client.0.smithi112.stdout:5/680: chown d8/d9/d13/d1c/l87 249024 1 2024-09-21T00:57:05.460 INFO:tasks.workunit.client.0.smithi112.stdout:8/804: rename d0/d13/dab/dc6/d100/df2 to d0/d13/d2a/d101 0 2024-09-21T00:57:05.461 INFO:tasks.workunit.client.0.smithi112.stdout:8/805: dread - d0/d13/d2a/d73/d96/dbc/fe1 zero size 2024-09-21T00:57:05.481 INFO:tasks.workunit.client.0.smithi112.stdout:5/681: dread d8/d9/d13/f51 [0,4194304] 0 2024-09-21T00:57:05.483 INFO:tasks.workunit.client.0.smithi112.stdout:0/760: dread d8/d11/f37 [4194304,4194304] 0 2024-09-21T00:57:05.484 INFO:tasks.workunit.client.0.smithi112.stdout:8/806: dread d0/f21 [0,4194304] 0 2024-09-21T00:57:05.485 INFO:tasks.workunit.client.0.smithi112.stdout:5/682: unlink d8/d9/d13/d2a/d2c/ld5 0 2024-09-21T00:57:05.485 INFO:tasks.workunit.client.0.smithi112.stdout:0/761: fsync d8/d11/d28/dbf/dd3/dd7/fc1 0 2024-09-21T00:57:05.489 INFO:tasks.workunit.client.0.smithi112.stdout:0/762: dread - d8/d62/fbe zero size 2024-09-21T00:57:05.493 INFO:tasks.workunit.client.0.smithi112.stdout:0/763: truncate d8/d1b/d2c/d2e/d4c/d64/f90 733745 0 2024-09-21T00:57:05.503 INFO:tasks.workunit.client.0.smithi112.stdout:8/807: dwrite d0/d13/d2a/fce [0,4194304] 0 2024-09-21T00:57:05.503 INFO:tasks.workunit.client.0.smithi112.stdout:5/683: dwrite d8/f4b [0,4194304] 0 2024-09-21T00:57:05.506 INFO:tasks.workunit.client.0.smithi112.stdout:8/808: chown d0/d13/dab/dc6/d100/f76 260650 1 2024-09-21T00:57:05.507 INFO:tasks.workunit.client.0.smithi112.stdout:8/809: chown d0/d13/d2a/d73/d96 0 1 2024-09-21T00:57:05.509 INFO:tasks.workunit.client.0.smithi112.stdout:0/764: dread d8/d11/d28/d54/f55 [0,4194304] 0 2024-09-21T00:57:05.509 INFO:tasks.workunit.client.0.smithi112.stdout:8/810: chown d0/d13/d1b/d22/d2e/d34/d7b/f8e 65487 1 2024-09-21T00:57:05.514 INFO:tasks.workunit.client.0.smithi112.stdout:0/765: dread d8/d11/d59/f8a [0,4194304] 0 2024-09-21T00:57:05.514 INFO:tasks.workunit.client.0.smithi112.stdout:8/811: rmdir d0/d13/d9f/dc2 39 2024-09-21T00:57:05.515 INFO:tasks.workunit.client.0.smithi112.stdout:5/684: fsync d8/d9/d13/d2a/d2c/f69 0 2024-09-21T00:57:05.518 INFO:tasks.workunit.client.0.smithi112.stdout:0/766: symlink d8/d1b/lf1 0 2024-09-21T00:57:05.522 INFO:tasks.workunit.client.0.smithi112.stdout:5/685: mkdir d8/d9/dcd/ddb 0 2024-09-21T00:57:05.523 INFO:tasks.workunit.client.0.smithi112.stdout:5/686: fdatasync d8/d9/d13/d1c/fb2 0 2024-09-21T00:57:05.525 INFO:tasks.workunit.client.0.smithi112.stdout:0/767: creat d8/d11/d59/d78/ff2 x:0 0 0 2024-09-21T00:57:05.525 INFO:tasks.workunit.client.0.smithi112.stdout:8/812: symlink d0/d13/d1b/l102 0 2024-09-21T00:57:05.528 INFO:tasks.workunit.client.0.smithi112.stdout:0/768: truncate d8/d1b/f44 3701124 0 2024-09-21T00:57:05.530 INFO:tasks.workunit.client.0.smithi112.stdout:5/687: dwrite d8/d9/f28 [0,4194304] 0 2024-09-21T00:57:05.533 INFO:tasks.workunit.client.0.smithi112.stdout:5/688: fdatasync d8/d9/d13/d2a/df/fd6 0 2024-09-21T00:57:05.534 INFO:tasks.workunit.client.0.smithi112.stdout:5/689: chown d8/d9/d13/f48 51293075 1 2024-09-21T00:57:05.538 INFO:tasks.workunit.client.0.smithi112.stdout:5/690: rename d8/d9/d13/d1c/d99/f65 to d8/d9/d13/d2a/dab/fdc 0 2024-09-21T00:57:05.539 INFO:tasks.workunit.client.0.smithi112.stdout:5/691: dread - d8/fbd zero size 2024-09-21T00:57:05.544 INFO:tasks.workunit.client.0.smithi112.stdout:5/692: dwrite d8/f81 [0,4194304] 0 2024-09-21T00:57:05.584 INFO:tasks.workunit.client.0.smithi112.stdout:8/813: dwrite d0/d13/d1b/d22/d2e/d34/fb1 [4194304,4194304] 0 2024-09-21T00:57:05.585 INFO:tasks.workunit.client.0.smithi112.stdout:0/769: dwrite d8/d62/fbe [0,4194304] 0 2024-09-21T00:57:05.588 INFO:tasks.workunit.client.0.smithi112.stdout:5/693: write d8/d9/d13/d2a/df/f97 [371282,1417] 0 2024-09-21T00:57:05.591 INFO:tasks.workunit.client.0.smithi112.stdout:8/814: mknod d0/d13/d1b/d22/d2e/d34/dd6/c103 0 2024-09-21T00:57:05.593 INFO:tasks.workunit.client.0.smithi112.stdout:5/694: symlink d8/d9/d13/d1c/d45/ldd 0 2024-09-21T00:57:05.596 INFO:tasks.workunit.client.0.smithi112.stdout:8/815: rename d0/d13/d1b/d22/c97 to d0/d66/d88/de8/c104 0 2024-09-21T00:57:05.596 INFO:tasks.workunit.client.0.smithi112.stdout:8/816: stat d0/d13/d1b/d22/f4e 0 2024-09-21T00:57:05.598 INFO:tasks.workunit.client.0.smithi112.stdout:5/695: creat d8/d9/d13/d1c/dbc/fde x:0 0 0 2024-09-21T00:57:05.599 INFO:tasks.workunit.client.0.smithi112.stdout:0/770: getdents d8/d11/d28/dbf/dd3/dec/def/da3 0 2024-09-21T00:57:05.600 INFO:tasks.workunit.client.0.smithi112.stdout:8/817: rmdir d0/d13/d2a/d73/d96/dbc 39 2024-09-21T00:57:05.603 INFO:tasks.workunit.client.0.smithi112.stdout:0/771: unlink d8/d11/d59/f5a 0 2024-09-21T00:57:05.604 INFO:tasks.workunit.client.0.smithi112.stdout:8/818: mknod d0/d13/d1b/d22/d2e/c105 0 2024-09-21T00:57:05.605 INFO:tasks.workunit.client.0.smithi112.stdout:5/696: dwrite d8/d9/d13/f86 [8388608,4194304] 0 2024-09-21T00:57:05.608 INFO:tasks.workunit.client.0.smithi112.stdout:0/772: symlink d8/d11/d28/dbf/lf3 0 2024-09-21T00:57:05.609 INFO:tasks.workunit.client.0.smithi112.stdout:8/819: symlink d0/d13/d1b/d22/d2e/d34/dd6/l106 0 2024-09-21T00:57:05.611 INFO:tasks.workunit.client.0.smithi112.stdout:0/773: symlink d8/d75/d91/lf4 0 2024-09-21T00:57:05.613 INFO:tasks.workunit.client.0.smithi112.stdout:0/774: write d8/d11/d28/f68 [1797348,27579] 0 2024-09-21T00:57:05.613 INFO:tasks.workunit.client.0.smithi112.stdout:0/775: readlink d8/d1b/l66 0 2024-09-21T00:57:05.619 INFO:tasks.workunit.client.0.smithi112.stdout:0/776: dwrite d8/d62/fcf [0,4194304] 0 2024-09-21T00:57:05.627 INFO:tasks.workunit.client.0.smithi112.stdout:0/777: dwrite d8/d1b/d2c/d2e/d4c/d6b/fc3 [0,4194304] 0 2024-09-21T00:57:05.629 INFO:tasks.workunit.client.0.smithi112.stdout:0/778: dread - d8/d11/d28/d54/fed zero size 2024-09-21T00:57:05.630 INFO:tasks.workunit.client.0.smithi112.stdout:0/779: write d8/d1b/d2c/d2e/d4c/d6b/fc3 [1231435,30360] 0 2024-09-21T00:57:05.634 INFO:tasks.workunit.client.0.smithi112.stdout:8/820: write d0/d13/f59 [3152990,13929] 0 2024-09-21T00:57:05.638 INFO:tasks.workunit.client.0.smithi112.stdout:8/821: creat d0/d13/d2a/d73/f107 x:0 0 0 2024-09-21T00:57:05.638 INFO:tasks.workunit.client.0.smithi112.stdout:0/780: dwrite d8/d11/d28/f43 [0,4194304] 0 2024-09-21T00:57:05.647 INFO:tasks.workunit.client.0.smithi112.stdout:8/822: mkdir d0/d13/dab/dc6/d100/d9a/d108 0 2024-09-21T00:57:05.648 INFO:tasks.workunit.client.0.smithi112.stdout:8/823: read d0/f41 [346627,10321] 0 2024-09-21T00:57:05.691 INFO:tasks.workunit.client.0.smithi112.stdout:0/781: creat d8/d1b/d2c/daf/ff5 x:0 0 0 2024-09-21T00:57:05.691 INFO:tasks.workunit.client.0.smithi112.stdout:0/782: write d8/d11/d28/f68 [2648021,19107] 0 2024-09-21T00:57:05.692 INFO:tasks.workunit.client.0.smithi112.stdout:0/783: stat d8/d1b/d2c/daf/ff5 0 2024-09-21T00:57:05.693 INFO:tasks.workunit.client.0.smithi112.stdout:8/824: rename d0/d13/c7a to d0/d13/d1b/d22/d2e/d34/dd6/c109 0 2024-09-21T00:57:05.694 INFO:tasks.workunit.client.0.smithi112.stdout:0/784: write d8/d1b/d2c/d2e/f39 [4013248,89328] 0 2024-09-21T00:57:05.696 INFO:tasks.workunit.client.0.smithi112.stdout:0/785: truncate d8/d1b/d2c/d2e/f94 1452744 0 2024-09-21T00:57:05.696 INFO:tasks.workunit.client.0.smithi112.stdout:0/786: read - d8/d1b/f61 zero size 2024-09-21T00:57:05.699 INFO:tasks.workunit.client.0.smithi112.stdout:0/787: unlink d8/d1b/f61 0 2024-09-21T00:57:05.703 INFO:tasks.workunit.client.0.smithi112.stdout:8/825: dread d0/d13/d1b/f35 [0,4194304] 0 2024-09-21T00:57:05.703 INFO:tasks.workunit.client.0.smithi112.stdout:0/788: mkdir d8/d11/d28/dbf/dd3/dec/def/da3/df6 0 2024-09-21T00:57:05.704 INFO:tasks.workunit.client.0.smithi112.stdout:0/789: dread - d8/d1b/d2c/d2e/d4c/da8/fee zero size 2024-09-21T00:57:05.705 INFO:tasks.workunit.client.0.smithi112.stdout:0/790: chown d8/fd 62035953 1 2024-09-21T00:57:05.706 INFO:tasks.workunit.client.0.smithi112.stdout:8/826: rename d0/d13/d2a/cbd to d0/d13/d1b/d22/d2e/d34/dd6/c10a 0 2024-09-21T00:57:05.710 INFO:tasks.workunit.client.0.smithi112.stdout:8/827: mknod d0/d13/c10b 0 2024-09-21T00:57:05.731 INFO:tasks.workunit.client.0.smithi112.stdout:8/828: dread d0/d13/d1b/d22/d2e/d34/d7b/d80/fe6 [0,4194304] 0 2024-09-21T00:57:05.793 INFO:tasks.workunit.client.0.smithi112.stdout:1/743: sync 2024-09-21T00:57:05.794 INFO:tasks.workunit.client.0.smithi112.stdout:0/791: write d8/f5e [4951260,121134] 0 2024-09-21T00:57:05.796 INFO:tasks.workunit.client.0.smithi112.stdout:1/744: rename d5/f33 to d5/d3a/d4b/de9/ff5 0 2024-09-21T00:57:05.798 INFO:tasks.workunit.client.0.smithi112.stdout:8/829: truncate d0/d13/f59 3015780 0 2024-09-21T00:57:05.799 INFO:tasks.workunit.client.0.smithi112.stdout:0/792: creat d8/d11/d28/dbf/ff7 x:0 0 0 2024-09-21T00:57:05.801 INFO:tasks.workunit.client.0.smithi112.stdout:1/745: mkdir d5/d68/df6 0 2024-09-21T00:57:05.803 INFO:tasks.workunit.client.0.smithi112.stdout:1/746: write d5/d8/dd/d97/d46/d70/f71 [4324889,68776] 0 2024-09-21T00:57:05.804 INFO:tasks.workunit.client.0.smithi112.stdout:0/793: dread d8/d11/f2d [0,4194304] 0 2024-09-21T00:57:05.806 INFO:tasks.workunit.client.0.smithi112.stdout:0/794: write d8/d62/fbe [4583307,115733] 0 2024-09-21T00:57:05.810 INFO:tasks.workunit.client.0.smithi112.stdout:0/795: rmdir d8/d11/d28/dbf/dd3/dec 39 2024-09-21T00:57:05.812 INFO:tasks.workunit.client.0.smithi112.stdout:8/830: write d0/d13/d1b/d22/d42/fac [630412,34987] 0 2024-09-21T00:57:05.812 INFO:tasks.workunit.client.0.smithi112.stdout:1/747: dread d5/d8/dd/dcc/f60 [0,4194304] 0 2024-09-21T00:57:05.817 INFO:tasks.workunit.client.0.smithi112.stdout:8/831: dread d0/d13/dab/dc6/d100/f9d [0,4194304] 0 2024-09-21T00:57:05.817 INFO:tasks.workunit.client.0.smithi112.stdout:1/748: mknod d5/d34/d6a/d7f/cf7 0 2024-09-21T00:57:05.817 INFO:tasks.workunit.client.0.smithi112.stdout:0/796: dwrite d8/d11/f81 [0,4194304] 0 2024-09-21T00:57:05.819 INFO:tasks.workunit.client.0.smithi112.stdout:1/749: chown d5/d8/dd/d97/fab 89839 1 2024-09-21T00:57:05.820 INFO:tasks.workunit.client.0.smithi112.stdout:0/797: creat d8/d75/d9c/ff8 x:0 0 0 2024-09-21T00:57:05.822 INFO:tasks.workunit.client.0.smithi112.stdout:8/832: creat d0/d13/dab/dcb/f10c x:0 0 0 2024-09-21T00:57:05.823 INFO:tasks.workunit.client.0.smithi112.stdout:8/833: readlink d0/d13/d1b/d22/l47 0 2024-09-21T00:57:05.825 INFO:tasks.workunit.client.0.smithi112.stdout:0/798: dread d8/d11/f37 [4194304,4194304] 0 2024-09-21T00:57:05.826 INFO:tasks.workunit.client.0.smithi112.stdout:8/834: unlink d0/d13/d1b/d22/d2e/fa1 0 2024-09-21T00:57:05.826 INFO:tasks.workunit.client.0.smithi112.stdout:8/835: chown d0/d13/f27 220 1 2024-09-21T00:57:05.829 INFO:tasks.workunit.client.0.smithi112.stdout:0/799: unlink d8/d11/c52 0 2024-09-21T00:57:05.829 INFO:tasks.workunit.client.0.smithi112.stdout:0/800: dread - d8/d1b/fdd zero size 2024-09-21T00:57:05.830 INFO:tasks.workunit.client.0.smithi112.stdout:8/836: truncate d0/d13/d1b/d22/d61/fc3 762208 0 2024-09-21T00:57:05.832 INFO:tasks.workunit.client.0.smithi112.stdout:8/837: creat d0/f10d x:0 0 0 2024-09-21T00:57:05.836 INFO:tasks.workunit.client.0.smithi112.stdout:0/801: rename d8/f17 to d8/d11/d28/dbf/dd3/dec/ff9 0 2024-09-21T00:57:05.837 INFO:tasks.workunit.client.0.smithi112.stdout:0/802: readlink d8/d11/d28/d54/l8b 0 2024-09-21T00:57:05.839 INFO:tasks.workunit.client.0.smithi112.stdout:1/750: dwrite d5/d8/f1f [0,4194304] 0 2024-09-21T00:57:05.844 INFO:tasks.workunit.client.0.smithi112.stdout:1/751: fsync d5/d8/dd/d54/d5a/fc3 0 2024-09-21T00:57:05.844 INFO:tasks.workunit.client.0.smithi112.stdout:0/803: dread d8/d1b/d2c/d2e/f39 [0,4194304] 0 2024-09-21T00:57:05.846 INFO:tasks.workunit.client.0.smithi112.stdout:8/838: write d0/f3c [3493125,111699] 0 2024-09-21T00:57:05.849 INFO:tasks.workunit.client.0.smithi112.stdout:0/804: mknod d8/d11/d28/dbf/dd3/dd7/cfa 0 2024-09-21T00:57:05.853 INFO:tasks.workunit.client.0.smithi112.stdout:8/839: mknod d0/d13/dab/dc6/d100/d9a/d108/c10e 0 2024-09-21T00:57:05.854 INFO:tasks.workunit.client.0.smithi112.stdout:0/805: creat d8/d11/d28/dbf/dd3/dec/def/ffb x:0 0 0 2024-09-21T00:57:05.858 INFO:tasks.workunit.client.0.smithi112.stdout:0/806: mknod d8/d1b/d2c/d2e/d4c/da8/cfc 0 2024-09-21T00:57:05.862 INFO:tasks.workunit.client.0.smithi112.stdout:1/752: dwrite d5/d8/f83 [0,4194304] 0 2024-09-21T00:57:05.863 INFO:tasks.workunit.client.0.smithi112.stdout:8/840: write d0/d13/d2a/f48 [1809133,54854] 0 2024-09-21T00:57:05.863 INFO:tasks.workunit.client.0.smithi112.stdout:0/807: symlink d8/d11/lfd 0 2024-09-21T00:57:05.865 INFO:tasks.workunit.client.0.smithi112.stdout:0/808: chown d8/d75/d91/fa6 2792754 1 2024-09-21T00:57:05.867 INFO:tasks.workunit.client.0.smithi112.stdout:1/753: mknod d5/d3a/d4b/de9/cf8 0 2024-09-21T00:57:05.868 INFO:tasks.workunit.client.0.smithi112.stdout:1/754: write d5/d8/f1f [848757,117062] 0 2024-09-21T00:57:05.870 INFO:tasks.workunit.client.0.smithi112.stdout:1/755: chown d5/d8/d14/l22 90 1 2024-09-21T00:57:05.871 INFO:tasks.workunit.client.0.smithi112.stdout:8/841: dwrite d0/d13/d1b/d22/f23 [0,4194304] 0 2024-09-21T00:57:05.876 INFO:tasks.workunit.client.0.smithi112.stdout:8/842: creat d0/d13/dab/dc6/d100/d9a/d108/f10f x:0 0 0 2024-09-21T00:57:05.878 INFO:tasks.workunit.client.0.smithi112.stdout:1/756: rmdir d5/d8/d13/d87/de7 0 2024-09-21T00:57:05.881 INFO:tasks.workunit.client.0.smithi112.stdout:1/757: fsync d5/d34/f72 0 2024-09-21T00:57:05.882 INFO:tasks.workunit.client.0.smithi112.stdout:8/843: truncate d0/d13/d9f/dc2/fb8 2517353 0 2024-09-21T00:57:05.888 INFO:tasks.workunit.client.0.smithi112.stdout:1/758: dwrite d5/d8/dd/f58 [0,4194304] 0 2024-09-21T00:57:05.889 INFO:tasks.workunit.client.0.smithi112.stdout:2/828: sync 2024-09-21T00:57:05.889 INFO:tasks.workunit.client.0.smithi112.stdout:7/860: sync 2024-09-21T00:57:05.890 INFO:tasks.workunit.client.0.smithi112.stdout:4/788: sync 2024-09-21T00:57:05.891 INFO:tasks.workunit.client.0.smithi112.stdout:1/759: chown d5/d8/d10/fc2 1464 1 2024-09-21T00:57:05.891 INFO:tasks.workunit.client.0.smithi112.stdout:8/844: mknod d0/d13/d1b/c110 0 2024-09-21T00:57:05.892 INFO:tasks.workunit.client.0.smithi112.stdout:0/809: dwrite d8/d1b/d2c/d2e/d4c/d64/f92 [0,4194304] 0 2024-09-21T00:57:05.895 INFO:tasks.workunit.client.0.smithi112.stdout:2/829: chown d0/df/d46/l71 430 1 2024-09-21T00:57:05.897 INFO:tasks.workunit.client.0.smithi112.stdout:8/845: write d0/f10d [119246,33145] 0 2024-09-21T00:57:05.898 INFO:tasks.workunit.client.0.smithi112.stdout:1/760: fdatasync d5/d3a/d4b/fd1 0 2024-09-21T00:57:05.899 INFO:tasks.workunit.client.0.smithi112.stdout:0/810: truncate d8/d11/d59/d78/f7a 187109 0 2024-09-21T00:57:05.901 INFO:tasks.workunit.client.0.smithi112.stdout:0/811: truncate d8/d11/d59/d78/ff2 344147 0 2024-09-21T00:57:05.906 INFO:tasks.workunit.client.0.smithi112.stdout:8/846: creat d0/f111 x:0 0 0 2024-09-21T00:57:05.907 INFO:tasks.workunit.client.0.smithi112.stdout:8/847: chown d0/d13/d2a/ddc 1784 1 2024-09-21T00:57:05.911 INFO:tasks.workunit.client.0.smithi112.stdout:1/761: mkdir d5/d8/dd/d97/df9 0 2024-09-21T00:57:05.912 INFO:tasks.workunit.client.0.smithi112.stdout:1/762: write d5/d8/dd/f4e [4563098,87153] 0 2024-09-21T00:57:05.916 INFO:tasks.workunit.client.0.smithi112.stdout:1/763: getdents d5/d8/dd/dcc 0 2024-09-21T00:57:05.916 INFO:tasks.workunit.client.0.smithi112.stdout:2/830: dread d0/d60/d78/f9b [0,4194304] 0 2024-09-21T00:57:05.917 INFO:tasks.workunit.client.0.smithi112.stdout:8/848: dread d0/d13/d2a/d73/f8a [0,4194304] 0 2024-09-21T00:57:05.922 INFO:tasks.workunit.client.0.smithi112.stdout:7/861: truncate d0/d2/f31 948135 0 2024-09-21T00:57:05.923 INFO:tasks.workunit.client.0.smithi112.stdout:4/789: dwrite d1/d2d/f50 [0,4194304] 0 2024-09-21T00:57:05.924 INFO:tasks.workunit.client.0.smithi112.stdout:6/837: sync 2024-09-21T00:57:05.924 INFO:tasks.workunit.client.0.smithi112.stdout:5/697: sync 2024-09-21T00:57:05.926 INFO:tasks.workunit.client.0.smithi112.stdout:1/764: creat d5/d34/ffa x:0 0 0 2024-09-21T00:57:05.928 INFO:tasks.workunit.client.0.smithi112.stdout:2/831: write d0/df/f13 [462137,124997] 0 2024-09-21T00:57:05.929 INFO:tasks.workunit.client.0.smithi112.stdout:5/698: dread - d8/d9/d13/d1c/d45/d8a/dc0/fd0 zero size 2024-09-21T00:57:05.931 INFO:tasks.workunit.client.0.smithi112.stdout:0/812: dwrite d8/d75/d9c/f9e [0,4194304] 0 2024-09-21T00:57:05.932 INFO:tasks.workunit.client.0.smithi112.stdout:4/790: unlink d1/d7/d9/d1a/cee 0 2024-09-21T00:57:05.933 INFO:tasks.workunit.client.0.smithi112.stdout:4/791: read - d1/d7/d30/d91/ff0 zero size 2024-09-21T00:57:05.935 INFO:tasks.workunit.client.0.smithi112.stdout:7/862: unlink d0/d2/d2e/df6/d39/d55/c7c 0 2024-09-21T00:57:05.940 INFO:tasks.workunit.client.0.smithi112.stdout:6/838: mknod d9/d1f/d3e/d77/d79/d85/c134 0 2024-09-21T00:57:05.940 INFO:tasks.workunit.client.0.smithi112.stdout:7/863: write d0/d2/d2e/df6/d39/d56/d86/f85 [641772,118262] 0 2024-09-21T00:57:05.943 INFO:tasks.workunit.client.0.smithi112.stdout:0/813: dread - d8/d62/d9d/fab zero size 2024-09-21T00:57:05.943 INFO:tasks.workunit.client.0.smithi112.stdout:7/864: readlink d0/d2/d2e/lb9 0 2024-09-21T00:57:05.943 INFO:tasks.workunit.client.0.smithi112.stdout:5/699: symlink d8/d9/d13/d1c/d99/ldf 0 2024-09-21T00:57:05.945 INFO:tasks.workunit.client.0.smithi112.stdout:4/792: dwrite d1/d7/df7/fed [0,4194304] 0 2024-09-21T00:57:05.947 INFO:tasks.workunit.client.0.smithi112.stdout:0/814: write d8/d1b/d2c/d2e/d4c/f84 [5047111,89273] 0 2024-09-21T00:57:05.950 INFO:tasks.workunit.client.0.smithi112.stdout:4/793: read d1/d7/fdb [1000620,63247] 0 2024-09-21T00:57:05.951 INFO:tasks.workunit.client.0.smithi112.stdout:8/849: dread d0/d13/d2a/d73/d96/fdb [0,4194304] 0 2024-09-21T00:57:05.954 INFO:tasks.workunit.client.0.smithi112.stdout:1/765: mkdir d5/d8/dd/d8e/dca/df1/dfb 0 2024-09-21T00:57:05.961 INFO:tasks.workunit.client.0.smithi112.stdout:2/832: dwrite d0/d14/fb6 [0,4194304] 0 2024-09-21T00:57:05.968 INFO:tasks.workunit.client.0.smithi112.stdout:0/815: dread d8/f19 [0,4194304] 0 2024-09-21T00:57:05.968 INFO:tasks.workunit.client.0.smithi112.stdout:7/865: rename d0/d2/d2e/df6/d39/d56/d65/cda to d0/d2/d2e/df6/d39/d1a/da5/c11c 0 2024-09-21T00:57:05.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/839: write d9/d1f/d47/d34/da6/da7/f75 [755324,104682] 0 2024-09-21T00:57:05.969 INFO:tasks.workunit.client.0.smithi112.stdout:5/700: truncate d8/d9/d13/d2a/df/d5b/f88 660553 0 2024-09-21T00:57:05.973 INFO:tasks.workunit.client.0.smithi112.stdout:4/794: creat d1/d7/df7/dc2/f107 x:0 0 0 2024-09-21T00:57:05.976 INFO:tasks.workunit.client.0.smithi112.stdout:1/766: rename d5/d34/d6a/dc9 to d5/d8/dd/d8e/de6/dfc 0 2024-09-21T00:57:05.976 INFO:tasks.workunit.client.0.smithi112.stdout:1/767: chown d5/d68/f9f 7674 1 2024-09-21T00:57:05.977 INFO:tasks.workunit.client.0.smithi112.stdout:7/866: creat d0/d2/d2e/df6/d39/d1a/da5/f11d x:0 0 0 2024-09-21T00:57:05.978 INFO:tasks.workunit.client.0.smithi112.stdout:7/867: chown d0/d2/d2e/df6/d39/d56/d65/d87/fc8 54643 1 2024-09-21T00:57:05.979 INFO:tasks.workunit.client.0.smithi112.stdout:2/833: mknod d0/d45/d8a/d62/dcf/d109/c10e 0 2024-09-21T00:57:05.981 INFO:tasks.workunit.client.0.smithi112.stdout:5/701: creat d8/d9/d13/d2a/d84/d8b/dda/fe0 x:0 0 0 2024-09-21T00:57:05.982 INFO:tasks.workunit.client.0.smithi112.stdout:6/840: link d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f133 d9/df/d56/f135 0 2024-09-21T00:57:05.983 INFO:tasks.workunit.client.0.smithi112.stdout:7/868: read - d0/d2/d2e/ded/ffb zero size 2024-09-21T00:57:05.984 INFO:tasks.workunit.client.0.smithi112.stdout:2/834: creat d0/d14/d8/d27/f10f x:0 0 0 2024-09-21T00:57:05.989 INFO:tasks.workunit.client.0.smithi112.stdout:7/869: dread d0/d2/d2e/df6/de4/ffa [0,4194304] 0 2024-09-21T00:57:05.993 INFO:tasks.workunit.client.0.smithi112.stdout:5/702: unlink d8/d9/d13/d2a/d84/cb0 0 2024-09-21T00:57:05.994 INFO:tasks.workunit.client.0.smithi112.stdout:0/816: rename d8/d75/d91/c9a to d8/d1b/d2c/d2e/d4c/d64/cfe 0 2024-09-21T00:57:05.999 INFO:tasks.workunit.client.0.smithi112.stdout:1/768: creat d5/d8/d13/ffd x:0 0 0 2024-09-21T00:57:06.000 INFO:tasks.workunit.client.0.smithi112.stdout:1/769: dread - d5/d8/d14/f9a zero size 2024-09-21T00:57:06.000 INFO:tasks.workunit.client.0.smithi112.stdout:7/870: truncate d0/d2/d2e/f58 143775 0 2024-09-21T00:57:06.001 INFO:tasks.workunit.client.0.smithi112.stdout:1/770: chown d5/d8/d13/d87/ca3 1 1 2024-09-21T00:57:06.002 INFO:tasks.workunit.client.0.smithi112.stdout:1/771: fsync d5/d8/dd/d8e/de6/dfc/fde 0 2024-09-21T00:57:06.002 INFO:tasks.workunit.client.0.smithi112.stdout:5/703: creat d8/d9/d13/d1c/d45/fe1 x:0 0 0 2024-09-21T00:57:06.011 INFO:tasks.workunit.client.0.smithi112.stdout:1/772: symlink d5/d8/dd/d8e/dca/df1/lfe 0 2024-09-21T00:57:06.014 INFO:tasks.workunit.client.0.smithi112.stdout:0/817: mkdir d8/d11/d28/dbf/dd3/dff 0 2024-09-21T00:57:06.016 INFO:tasks.workunit.client.0.smithi112.stdout:1/773: rmdir d5/d8/da1 39 2024-09-21T00:57:06.017 INFO:tasks.workunit.client.0.smithi112.stdout:2/835: dwrite d0/d14/d47/d70/fd1 [0,4194304] 0 2024-09-21T00:57:06.019 INFO:tasks.workunit.client.0.smithi112.stdout:1/774: read d5/d8/d13/d87/fe3 [313505,37898] 0 2024-09-21T00:57:06.021 INFO:tasks.workunit.client.0.smithi112.stdout:7/871: read d0/d2/d2e/f58 [140311,125705] 0 2024-09-21T00:57:06.023 INFO:tasks.workunit.client.0.smithi112.stdout:2/836: write d0/d14/f35 [7101760,74783] 0 2024-09-21T00:57:06.023 INFO:tasks.workunit.client.0.smithi112.stdout:1/775: mkdir d5/d8/dd/d8e/de6/dff 0 2024-09-21T00:57:06.025 INFO:tasks.workunit.client.0.smithi112.stdout:1/776: dread - d5/d34/d6a/fdd zero size 2024-09-21T00:57:06.026 INFO:tasks.workunit.client.0.smithi112.stdout:6/841: truncate d9/d1f/d47/d34/da6/da7/f75 441926 0 2024-09-21T00:57:06.028 INFO:tasks.workunit.client.0.smithi112.stdout:2/837: dread - d0/d14/d8/d27/d63/fd4 zero size 2024-09-21T00:57:06.031 INFO:tasks.workunit.client.0.smithi112.stdout:0/818: dread d8/d5f/f6f [0,4194304] 0 2024-09-21T00:57:06.034 INFO:tasks.workunit.client.0.smithi112.stdout:6/842: mknod d9/df/c136 0 2024-09-21T00:57:06.036 INFO:tasks.workunit.client.0.smithi112.stdout:7/872: rmdir d0/d2/d2e/df6/d39/d56/d65/d87/dd9/d108 0 2024-09-21T00:57:06.037 INFO:tasks.workunit.client.0.smithi112.stdout:0/819: mkdir d8/d11/d59/d78/d100 0 2024-09-21T00:57:06.039 INFO:tasks.workunit.client.0.smithi112.stdout:2/838: fdatasync d0/d14/f9 0 2024-09-21T00:57:06.040 INFO:tasks.workunit.client.0.smithi112.stdout:2/839: dread - d0/d14/d22/f101 zero size 2024-09-21T00:57:06.041 INFO:tasks.workunit.client.0.smithi112.stdout:2/840: chown d0/d14/d47 58406698 1 2024-09-21T00:57:06.042 INFO:tasks.workunit.client.0.smithi112.stdout:6/843: rename d9/d1f/d3e/d77/d46 to d9/d1f/d47/d34/da6/da7/dcf/d60/d137 0 2024-09-21T00:57:06.044 INFO:tasks.workunit.client.0.smithi112.stdout:5/704: dwrite d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:57:06.045 INFO:tasks.workunit.client.0.smithi112.stdout:5/705: chown d8/d9/f60 3 1 2024-09-21T00:57:06.046 INFO:tasks.workunit.client.0.smithi112.stdout:0/820: mkdir d8/d62/d9d/d101 0 2024-09-21T00:57:06.068 INFO:tasks.workunit.client.0.smithi112.stdout:7/873: dread d0/d2/d2e/df6/d39/d1a/f6b [0,4194304] 0 2024-09-21T00:57:06.098 INFO:tasks.workunit.client.0.smithi112.stdout:5/706: symlink d8/d9/d61/le2 0 2024-09-21T00:57:06.101 INFO:tasks.workunit.client.0.smithi112.stdout:2/841: rename d0/df/c43 to d0/df/d46/d58/c110 0 2024-09-21T00:57:06.102 INFO:tasks.workunit.client.0.smithi112.stdout:2/842: write d0/d14/f87 [5011469,118122] 0 2024-09-21T00:57:06.103 INFO:tasks.workunit.client.0.smithi112.stdout:5/707: dread d8/d9/d13/d2a/df/d5b/dbe/fa6 [0,4194304] 0 2024-09-21T00:57:06.108 INFO:tasks.workunit.client.0.smithi112.stdout:2/843: symlink d0/d14/d47/l111 0 2024-09-21T00:57:06.111 INFO:tasks.workunit.client.0.smithi112.stdout:5/708: read - d8/d9/f5d zero size 2024-09-21T00:57:06.113 INFO:tasks.workunit.client.0.smithi112.stdout:2/844: creat d0/d45/db9/f112 x:0 0 0 2024-09-21T00:57:06.119 INFO:tasks.workunit.client.0.smithi112.stdout:1/777: dwrite d5/d8/dd/d97/d46/fa7 [0,4194304] 0 2024-09-21T00:57:06.122 INFO:tasks.workunit.client.0.smithi112.stdout:1/778: read d5/d8/dd/f78 [2304267,102422] 0 2024-09-21T00:57:06.127 INFO:tasks.workunit.client.0.smithi112.stdout:1/779: getdents d5/d8/d10 0 2024-09-21T00:57:06.128 INFO:tasks.workunit.client.0.smithi112.stdout:1/780: chown d5/d8/dd/dcc/c80 0 1 2024-09-21T00:57:06.129 INFO:tasks.workunit.client.0.smithi112.stdout:1/781: stat d5/c59 0 2024-09-21T00:57:06.132 INFO:tasks.workunit.client.0.smithi112.stdout:1/782: creat d5/d8/dd/d8e/de6/dfc/f100 x:0 0 0 2024-09-21T00:57:06.137 INFO:tasks.workunit.client.0.smithi112.stdout:1/783: creat d5/d8/dd/dcc/f101 x:0 0 0 2024-09-21T00:57:06.139 INFO:tasks.workunit.client.0.smithi112.stdout:0/821: dwrite d8/fd [0,4194304] 0 2024-09-21T00:57:06.141 INFO:tasks.workunit.client.0.smithi112.stdout:7/874: write d0/d2/ff0 [986862,80231] 0 2024-09-21T00:57:06.144 INFO:tasks.workunit.client.0.smithi112.stdout:1/784: fdatasync d5/d3a/d4b/de9/ff5 0 2024-09-21T00:57:06.144 INFO:tasks.workunit.client.0.smithi112.stdout:7/875: chown d0/d2/d2e/df6/d39/d56/d65/d75/d9a/def/c115 0 1 2024-09-21T00:57:06.145 INFO:tasks.workunit.client.0.smithi112.stdout:0/822: mknod d8/d5f/c102 0 2024-09-21T00:57:06.148 INFO:tasks.workunit.client.0.smithi112.stdout:6/844: dwrite d9/d1f/fb3 [0,4194304] 0 2024-09-21T00:57:06.153 INFO:tasks.workunit.client.0.smithi112.stdout:0/823: chown d8/d1b/f67 882512697 1 2024-09-21T00:57:06.153 INFO:tasks.workunit.client.0.smithi112.stdout:1/785: dread d5/d8/f83 [0,4194304] 0 2024-09-21T00:57:06.156 INFO:tasks.workunit.client.0.smithi112.stdout:6/845: rmdir d9/d1f/d3e/d9a 39 2024-09-21T00:57:06.156 INFO:tasks.workunit.client.0.smithi112.stdout:5/709: write d8/d9/d13/d2a/d84/d8b/f82 [3216924,6164] 0 2024-09-21T00:57:06.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:05 smithi187 ceph-mon[34997]: Reconfiguring ceph-exporter.smithi187 (dependencies changed)... 2024-09-21T00:57:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:05 smithi187 ceph-mon[34997]: Deploying daemon ceph-exporter.smithi187 on smithi187 2024-09-21T00:57:06.164 INFO:tasks.workunit.client.0.smithi112.stdout:2/845: dwrite d0/d14/f12 [4194304,4194304] 0 2024-09-21T00:57:06.164 INFO:tasks.workunit.client.0.smithi112.stdout:2/846: stat d0 0 2024-09-21T00:57:06.167 INFO:tasks.workunit.client.0.smithi112.stdout:7/876: rename d0/d2/d38/d48/dad/f9b to d0/f11e 0 2024-09-21T00:57:06.170 INFO:tasks.workunit.client.0.smithi112.stdout:7/877: write d0/d2/d2e/df6/d39/d56/d65/d75/fa6 [105703,11219] 0 2024-09-21T00:57:06.171 INFO:tasks.workunit.client.0.smithi112.stdout:2/847: dread d0/d14/f12 [4194304,4194304] 0 2024-09-21T00:57:06.172 INFO:tasks.workunit.client.0.smithi112.stdout:0/824: truncate d8/d1b/d2c/d2e/d4c/d64/f90 1336603 0 2024-09-21T00:57:06.173 INFO:tasks.workunit.client.0.smithi112.stdout:2/848: readlink d0/d14/d8/l10a 0 2024-09-21T00:57:06.175 INFO:tasks.workunit.client.0.smithi112.stdout:7/878: write d0/d2/d2e/df6/d39/d56/d86/f101 [745706,25537] 0 2024-09-21T00:57:06.180 INFO:tasks.workunit.client.0.smithi112.stdout:0/825: dread d8/f19 [4194304,4194304] 0 2024-09-21T00:57:06.183 INFO:tasks.workunit.client.0.smithi112.stdout:2/849: creat d0/d14/d22/d6d/f113 x:0 0 0 2024-09-21T00:57:06.185 INFO:tasks.workunit.client.0.smithi112.stdout:2/850: write d0/f67 [4462565,6553] 0 2024-09-21T00:57:06.187 INFO:tasks.workunit.client.0.smithi112.stdout:2/851: chown d0/d45/d8a/d62/dcf/le7 169 1 2024-09-21T00:57:06.187 INFO:tasks.workunit.client.0.smithi112.stdout:0/826: creat d8/d62/f103 x:0 0 0 2024-09-21T00:57:06.187 INFO:tasks.workunit.client.0.smithi112.stdout:6/846: dread d9/d1f/d47/d34/f63 [0,4194304] 0 2024-09-21T00:57:06.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/827: unlink d8/l1d 0 2024-09-21T00:57:06.197 INFO:tasks.workunit.client.0.smithi112.stdout:2/852: symlink d0/d14/d8/l114 0 2024-09-21T00:57:06.198 INFO:tasks.workunit.client.0.smithi112.stdout:6/847: dwrite d9/d1f/d47/d34/da6/da7/dcf/dbe/f123 [0,4194304] 0 2024-09-21T00:57:06.201 INFO:tasks.workunit.client.0.smithi112.stdout:2/853: symlink d0/d60/d78/l115 0 2024-09-21T00:57:06.206 INFO:tasks.workunit.client.0.smithi112.stdout:6/848: rename d9/d1f/d47/d34/da6/da7/dcf/d60/d137/d8c to d9/d1f/d47/d74/d8e/d138 0 2024-09-21T00:57:06.207 INFO:tasks.workunit.client.0.smithi112.stdout:2/854: creat d0/d14/d8/da2/daa/f116 x:0 0 0 2024-09-21T00:57:06.211 INFO:tasks.workunit.client.0.smithi112.stdout:6/849: mkdir d9/d1f/d3e/d139 0 2024-09-21T00:57:06.217 INFO:tasks.workunit.client.0.smithi112.stdout:2/855: dwrite d0/d14/d8/d27/f108 [0,4194304] 0 2024-09-21T00:57:06.220 INFO:tasks.workunit.client.0.smithi112.stdout:2/856: fdatasync d0/d45/d8a/d83/def/fff 0 2024-09-21T00:57:06.223 INFO:tasks.workunit.client.0.smithi112.stdout:7/879: dread d0/d2/f69 [0,4194304] 0 2024-09-21T00:57:06.224 INFO:tasks.workunit.client.0.smithi112.stdout:6/850: dwrite d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f9b [0,4194304] 0 2024-09-21T00:57:06.229 INFO:tasks.workunit.client.0.smithi112.stdout:2/857: rename d0/d14/d8/d27/f10f to d0/d45/d8a/d83/f117 0 2024-09-21T00:57:06.231 INFO:tasks.workunit.client.0.smithi112.stdout:6/851: mknod d9/d1f/d47/d74/d8b/daa/c13a 0 2024-09-21T00:57:06.235 INFO:tasks.workunit.client.0.smithi112.stdout:0/828: truncate d8/d1b/d2c/f30 56051 0 2024-09-21T00:57:06.236 INFO:tasks.workunit.client.0.smithi112.stdout:0/829: dread - d8/d1b/d2c/d2e/d4c/d64/f8c zero size 2024-09-21T00:57:06.237 INFO:tasks.workunit.client.0.smithi112.stdout:0/830: write d8/d62/dbd/ff0 [932223,26114] 0 2024-09-21T00:57:06.246 INFO:tasks.workunit.client.0.smithi112.stdout:0/831: dwrite d8/d11/d28/fd0 [0,4194304] 0 2024-09-21T00:57:06.247 INFO:tasks.workunit.client.0.smithi112.stdout:7/880: dread d0/d2/d2e/df6/d39/d56/d65/d75/f8e [0,4194304] 0 2024-09-21T00:57:06.250 INFO:tasks.workunit.client.0.smithi112.stdout:7/881: mkdir d0/d2/d2e/ded/d11f 0 2024-09-21T00:57:06.257 INFO:tasks.workunit.client.0.smithi112.stdout:2/858: dwrite d0/df/d46/d97/dcd/dd6/fde [0,4194304] 0 2024-09-21T00:57:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:05 smithi112 ceph-mon[28078]: Reconfiguring ceph-exporter.smithi187 (dependencies changed)... 2024-09-21T00:57:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:05 smithi112 ceph-mon[28078]: Deploying daemon ceph-exporter.smithi187 on smithi187 2024-09-21T00:57:06.261 INFO:tasks.workunit.client.0.smithi112.stdout:2/859: creat d0/df/d46/d58/f118 x:0 0 0 2024-09-21T00:57:06.262 INFO:tasks.workunit.client.0.smithi112.stdout:6/852: dwrite d9/d1f/d47/d34/da6/da7/f76 [0,4194304] 0 2024-09-21T00:57:06.266 INFO:tasks.workunit.client.0.smithi112.stdout:2/860: chown d0/d14/d8/d27/d7a/f93 41 1 2024-09-21T00:57:06.271 INFO:tasks.workunit.client.0.smithi112.stdout:0/832: dwrite d8/d1b/d2c/d2e/d4c/d64/f6e [0,4194304] 0 2024-09-21T00:57:06.271 INFO:tasks.workunit.client.0.smithi112.stdout:6/853: unlink d9/d1f/d47/d74/d8e/d138/c118 0 2024-09-21T00:57:06.275 INFO:tasks.workunit.client.0.smithi112.stdout:2/861: creat d0/d45/d8a/d99/f119 x:0 0 0 2024-09-21T00:57:06.276 INFO:tasks.workunit.client.0.smithi112.stdout:2/862: fdatasync d0/d60/d78/fe8 0 2024-09-21T00:57:06.277 INFO:tasks.workunit.client.0.smithi112.stdout:6/854: unlink d9/d1f/d47/d34/da6/da7/dcf/d60/f12d 0 2024-09-21T00:57:06.278 INFO:tasks.workunit.client.0.smithi112.stdout:8/850: sync 2024-09-21T00:57:06.280 INFO:tasks.workunit.client.0.smithi112.stdout:0/833: mknod d8/d11/d59/d78/d100/c104 0 2024-09-21T00:57:06.282 INFO:tasks.workunit.client.0.smithi112.stdout:6/855: creat d9/d1f/d47/d34/da6/da7/dcf/d21/d84/f13b x:0 0 0 2024-09-21T00:57:06.284 INFO:tasks.workunit.client.0.smithi112.stdout:8/851: stat d0/d13/d1b/f8f 0 2024-09-21T00:57:06.285 INFO:tasks.workunit.client.0.smithi112.stdout:8/852: chown d0/d13/d1b/d22/d42/fe2 3274450 1 2024-09-21T00:57:06.285 INFO:tasks.workunit.client.0.smithi112.stdout:0/834: creat d8/d11/d28/dbf/dd3/dec/def/da3/db6/f105 x:0 0 0 2024-09-21T00:57:06.296 INFO:tasks.workunit.client.0.smithi112.stdout:6/856: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/d137/d13c 0 2024-09-21T00:57:06.303 INFO:tasks.workunit.client.0.smithi112.stdout:6/857: rename d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/f9b to d9/d1f/d47/d74/d8b/daa/dd4/d113/f13d 0 2024-09-21T00:57:06.303 INFO:tasks.workunit.client.0.smithi112.stdout:2/863: dwrite d0/df/fd9 [0,4194304] 0 2024-09-21T00:57:06.305 INFO:tasks.workunit.client.0.smithi112.stdout:8/853: dread d0/d13/d1b/d22/d2e/d34/d7b/f71 [4194304,4194304] 0 2024-09-21T00:57:06.305 INFO:tasks.workunit.client.0.smithi112.stdout:0/835: getdents d8/d1b/d2c/d2e/d4c/da8 0 2024-09-21T00:57:06.309 INFO:tasks.workunit.client.0.smithi112.stdout:2/864: mknod d0/d45/d8a/d83/c11a 0 2024-09-21T00:57:06.310 INFO:tasks.workunit.client.0.smithi112.stdout:6/858: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/d13e 0 2024-09-21T00:57:06.312 INFO:tasks.workunit.client.0.smithi112.stdout:0/836: creat d8/d1b/d2c/d2e/d4c/d6b/dc2/f106 x:0 0 0 2024-09-21T00:57:06.314 INFO:tasks.workunit.client.0.smithi112.stdout:2/865: creat d0/d14/d8/d27/d63/f11b x:0 0 0 2024-09-21T00:57:06.316 INFO:tasks.workunit.client.0.smithi112.stdout:2/866: chown d0/d14/d22/f101 89261 1 2024-09-21T00:57:06.316 INFO:tasks.workunit.client.0.smithi112.stdout:6/859: rmdir d9/df/d56 39 2024-09-21T00:57:06.317 INFO:tasks.workunit.client.0.smithi112.stdout:2/867: stat d0/d14/d22/ld0 0 2024-09-21T00:57:06.320 INFO:tasks.workunit.client.0.smithi112.stdout:0/837: dwrite d8/d11/d28/dbf/dd3/dec/def/ffb [0,4194304] 0 2024-09-21T00:57:06.321 INFO:tasks.workunit.client.0.smithi112.stdout:6/860: creat d9/d1f/d3e/d9a/f13f x:0 0 0 2024-09-21T00:57:06.322 INFO:tasks.workunit.client.0.smithi112.stdout:2/868: mknod d0/d14/d8/d27/d63/c11c 0 2024-09-21T00:57:06.323 INFO:tasks.workunit.client.0.smithi112.stdout:0/838: write d8/d1b/d2c/d2e/f94 [952237,68200] 0 2024-09-21T00:57:06.328 INFO:tasks.workunit.client.0.smithi112.stdout:6/861: creat d9/d1f/d47/d34/da6/da7/dcf/d31/d41/d9e/f140 x:0 0 0 2024-09-21T00:57:06.330 INFO:tasks.workunit.client.0.smithi112.stdout:0/839: dread d8/d11/d28/f2f [0,4194304] 0 2024-09-21T00:57:06.330 INFO:tasks.workunit.client.0.smithi112.stdout:2/869: unlink d0/df/c5a 0 2024-09-21T00:57:06.331 INFO:tasks.workunit.client.0.smithi112.stdout:0/840: chown d8/d62/d9d/fab 1332753967 1 2024-09-21T00:57:06.332 INFO:tasks.workunit.client.0.smithi112.stdout:6/862: creat d9/d1f/d3e/d6f/f141 x:0 0 0 2024-09-21T00:57:06.336 INFO:tasks.workunit.client.0.smithi112.stdout:6/863: fdatasync d9/d1f/d47/d34/da6/da7/dcf/d26/f3d 0 2024-09-21T00:57:06.338 INFO:tasks.workunit.client.0.smithi112.stdout:6/864: fdatasync d9/d1f/d3e/d77/d45/f80 0 2024-09-21T00:57:06.344 INFO:tasks.workunit.client.0.smithi112.stdout:0/841: dread d8/d75/d91/d9b/fac [0,4194304] 0 2024-09-21T00:57:06.346 INFO:tasks.workunit.client.0.smithi112.stdout:2/870: dread d0/d14/d8/d27/f2a [0,4194304] 0 2024-09-21T00:57:06.348 INFO:tasks.workunit.client.0.smithi112.stdout:0/842: mknod d8/d11/d28/dbf/dd3/dec/def/da3/c107 0 2024-09-21T00:57:06.351 INFO:tasks.workunit.client.0.smithi112.stdout:0/843: dread d8/d1b/f67 [0,4194304] 0 2024-09-21T00:57:06.351 INFO:tasks.workunit.client.0.smithi112.stdout:6/865: write d9/d1f/d3e/d77/f71 [477588,14029] 0 2024-09-21T00:57:06.353 INFO:tasks.workunit.client.0.smithi112.stdout:0/844: write d8/d75/d9c/fdb [538981,65142] 0 2024-09-21T00:57:06.355 INFO:tasks.workunit.client.0.smithi112.stdout:2/871: write d0/d14/d8/d27/f3f [5043164,107597] 0 2024-09-21T00:57:06.356 INFO:tasks.workunit.client.0.smithi112.stdout:0/845: creat d8/d62/f108 x:0 0 0 2024-09-21T00:57:06.356 INFO:tasks.workunit.client.0.smithi112.stdout:2/872: truncate d0/d14/d8/fb4 1019623 0 2024-09-21T00:57:06.357 INFO:tasks.workunit.client.0.smithi112.stdout:6/866: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d11f/d142 0 2024-09-21T00:57:06.359 INFO:tasks.workunit.client.0.smithi112.stdout:2/873: mkdir d0/d14/d22/d95/d11d 0 2024-09-21T00:57:06.359 INFO:tasks.workunit.client.0.smithi112.stdout:0/846: rmdir d8/d1b/d2c/d2e/d4c/d6b/dc2 39 2024-09-21T00:57:06.361 INFO:tasks.workunit.client.0.smithi112.stdout:2/874: write d0/d45/d8a/f55 [9955549,103739] 0 2024-09-21T00:57:06.365 INFO:tasks.workunit.client.0.smithi112.stdout:0/847: chown d8/d11/d59/d78/f7a 1066 1 2024-09-21T00:57:06.366 INFO:tasks.workunit.client.0.smithi112.stdout:2/875: chown d0/d45/d8a/d99/c10c 121565671 1 2024-09-21T00:57:06.370 INFO:tasks.workunit.client.0.smithi112.stdout:2/876: rename d0/d14/d47/d70 to d0/d14/d8/da2/dba/dc1/d11e 0 2024-09-21T00:57:06.372 INFO:tasks.workunit.client.0.smithi112.stdout:2/877: creat d0/d14/d8/d27/d63/df0/f11f x:0 0 0 2024-09-21T00:57:06.373 INFO:tasks.workunit.client.0.smithi112.stdout:0/848: creat d8/d11/d28/dbf/dd3/f109 x:0 0 0 2024-09-21T00:57:06.375 INFO:tasks.workunit.client.0.smithi112.stdout:0/849: write d8/d11/f23 [37171,130909] 0 2024-09-21T00:57:06.378 INFO:tasks.workunit.client.0.smithi112.stdout:6/867: dwrite d9/df/d56/f135 [0,4194304] 0 2024-09-21T00:57:06.384 INFO:tasks.workunit.client.0.smithi112.stdout:0/850: rmdir d8/d1b/d2c/d2e/d4c/d6b/dc2 39 2024-09-21T00:57:06.386 INFO:tasks.workunit.client.0.smithi112.stdout:6/868: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/d128/df6/d11b/d143 0 2024-09-21T00:57:06.388 INFO:tasks.workunit.client.0.smithi112.stdout:6/869: write d9/d1f/d47/d34/da6/da7/dcf/d31/f68 [2941601,70310] 0 2024-09-21T00:57:06.389 INFO:tasks.workunit.client.0.smithi112.stdout:0/851: creat d8/d75/d91/f10a x:0 0 0 2024-09-21T00:57:06.389 INFO:tasks.workunit.client.0.smithi112.stdout:2/878: write d0/d14/fcc [2378415,126787] 0 2024-09-21T00:57:06.391 INFO:tasks.workunit.client.0.smithi112.stdout:6/870: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d11f/d144 0 2024-09-21T00:57:06.396 INFO:tasks.workunit.client.0.smithi112.stdout:2/879: rename d0/d14/f50 to d0/d14/d22/f120 0 2024-09-21T00:57:06.396 INFO:tasks.workunit.client.0.smithi112.stdout:6/871: truncate d9/d1f/d47/d34/da6/da7/dcf/d60/da4/fd0 2032979 0 2024-09-21T00:57:06.397 INFO:tasks.workunit.client.0.smithi112.stdout:0/852: dwrite d8/d1b/d2c/d2e/fb4 [0,4194304] 0 2024-09-21T00:57:06.403 INFO:tasks.workunit.client.0.smithi112.stdout:2/880: creat d0/df/d46/d97/dfa/f121 x:0 0 0 2024-09-21T00:57:06.407 INFO:tasks.workunit.client.0.smithi112.stdout:2/881: mkdir d0/d14/d8/da2/dba/dc1/d11e/d122 0 2024-09-21T00:57:06.408 INFO:tasks.workunit.client.0.smithi112.stdout:2/882: chown d0/d60/d78 0 1 2024-09-21T00:57:06.408 INFO:tasks.workunit.client.0.smithi112.stdout:6/872: dwrite d9/d1f/d47/d74/d8b/daa/dd4/f55 [0,4194304] 0 2024-09-21T00:57:06.419 INFO:tasks.workunit.client.0.smithi112.stdout:6/873: dread d9/d1f/d47/d34/da6/da7/f75 [0,4194304] 0 2024-09-21T00:57:06.424 INFO:tasks.workunit.client.0.smithi112.stdout:0/853: dwrite d8/d11/fb8 [0,4194304] 0 2024-09-21T00:57:06.425 INFO:tasks.workunit.client.0.smithi112.stdout:2/883: dwrite d0/f48 [0,4194304] 0 2024-09-21T00:57:06.426 INFO:tasks.workunit.client.0.smithi112.stdout:0/854: dread - d8/d1b/d2c/d2e/d4c/da8/fee zero size 2024-09-21T00:57:06.426 INFO:tasks.workunit.client.0.smithi112.stdout:6/874: mknod d9/d1f/d47/d34/da6/da7/dcf/d60/dea/c145 0 2024-09-21T00:57:06.429 INFO:tasks.workunit.client.0.smithi112.stdout:2/884: unlink d0/d14/d8/d27/fb8 0 2024-09-21T00:57:06.434 INFO:tasks.workunit.client.0.smithi112.stdout:2/885: getdents d0/d45/d8a/dd7 0 2024-09-21T00:57:06.437 INFO:tasks.workunit.client.0.smithi112.stdout:0/855: dwrite d8/d11/d28/dbf/dd3/dec/def/da3/db6/fe1 [0,4194304] 0 2024-09-21T00:57:06.440 INFO:tasks.workunit.client.0.smithi112.stdout:0/856: fdatasync d8/d11/d28/dbf/dd3/dec/ff9 0 2024-09-21T00:57:06.441 INFO:tasks.workunit.client.0.smithi112.stdout:2/886: creat d0/d45/d8a/f123 x:0 0 0 2024-09-21T00:57:06.444 INFO:tasks.workunit.client.0.smithi112.stdout:0/857: rename d8/d1b/d2c/d2e/d4c/d64/cca to d8/d75/d9c/c10b 0 2024-09-21T00:57:06.448 INFO:tasks.workunit.client.0.smithi112.stdout:6/875: dread d9/f12 [0,4194304] 0 2024-09-21T00:57:06.452 INFO:tasks.workunit.client.0.smithi112.stdout:6/876: creat d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d11f/d142/f146 x:0 0 0 2024-09-21T00:57:06.453 INFO:tasks.workunit.client.0.smithi112.stdout:6/877: dread - d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/f129 zero size 2024-09-21T00:57:06.456 INFO:tasks.workunit.client.0.smithi112.stdout:6/878: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/d128/df6/d147 0 2024-09-21T00:57:06.457 INFO:tasks.workunit.client.0.smithi112.stdout:6/879: write d9/d1f/d47/d34/da6/f5d [552936,49168] 0 2024-09-21T00:57:06.459 INFO:tasks.workunit.client.0.smithi112.stdout:6/880: creat d9/d1f/d47/d74/d8b/daa/dd4/d113/f148 x:0 0 0 2024-09-21T00:57:06.465 INFO:tasks.workunit.client.0.smithi112.stdout:6/881: read d9/d1f/d47/d34/da6/da7/dcf/f15 [892546,21082] 0 2024-09-21T00:57:06.467 INFO:tasks.workunit.client.0.smithi112.stdout:6/882: mkdir d9/d1f/d47/d74/d8e/d149 0 2024-09-21T00:57:06.467 INFO:tasks.workunit.client.0.smithi112.stdout:1/786: sync 2024-09-21T00:57:06.467 INFO:tasks.workunit.client.0.smithi112.stdout:4/795: sync 2024-09-21T00:57:06.473 INFO:tasks.workunit.client.0.smithi112.stdout:1/787: truncate d5/d8/d10/f17 4318646 0 2024-09-21T00:57:06.476 INFO:tasks.workunit.client.0.smithi112.stdout:2/887: dwrite d0/d60/d78/f9b [0,4194304] 0 2024-09-21T00:57:06.478 INFO:tasks.workunit.client.0.smithi112.stdout:0/858: dwrite d8/d5f/fc5 [0,4194304] 0 2024-09-21T00:57:06.484 INFO:tasks.workunit.client.0.smithi112.stdout:2/888: rename d0/d14/d8/f1a to d0/d45/d8a/d83/f124 0 2024-09-21T00:57:06.485 INFO:tasks.workunit.client.0.smithi112.stdout:4/796: dread d1/d5/d1c/d1e/f20 [0,4194304] 0 2024-09-21T00:57:06.487 INFO:tasks.workunit.client.0.smithi112.stdout:4/797: write d1/d7/d30/d91/ff0 [752897,7540] 0 2024-09-21T00:57:06.492 INFO:tasks.workunit.client.0.smithi112.stdout:1/788: write d5/d8/dd/d97/d46/f57 [554289,87886] 0 2024-09-21T00:57:06.495 INFO:tasks.workunit.client.0.smithi112.stdout:4/798: mkdir d1/d5/d1c/d1e/d4a/d5f/d108 0 2024-09-21T00:57:06.495 INFO:tasks.workunit.client.0.smithi112.stdout:4/799: readlink d1/d2d/d34/l49 0 2024-09-21T00:57:06.496 INFO:tasks.workunit.client.0.smithi112.stdout:1/789: creat d5/d68/f102 x:0 0 0 2024-09-21T00:57:06.497 INFO:tasks.workunit.client.0.smithi112.stdout:1/790: readlink d5/d8/d14/l22 0 2024-09-21T00:57:06.500 INFO:tasks.workunit.client.0.smithi112.stdout:1/791: rmdir d5/d8/d10 39 2024-09-21T00:57:06.502 INFO:tasks.workunit.client.0.smithi112.stdout:4/800: dwrite d1/d2d/f50 [0,4194304] 0 2024-09-21T00:57:06.506 INFO:tasks.workunit.client.0.smithi112.stdout:1/792: creat d5/d8/dd/d97/d46/f103 x:0 0 0 2024-09-21T00:57:06.510 INFO:tasks.workunit.client.0.smithi112.stdout:4/801: unlink d1/d7/df7/ccd 0 2024-09-21T00:57:06.511 INFO:tasks.workunit.client.0.smithi112.stdout:2/889: dread d0/d14/d8/da2/dba/dc1/d11e/f96 [0,4194304] 0 2024-09-21T00:57:06.511 INFO:tasks.workunit.client.0.smithi112.stdout:1/793: mknod d5/d34/d6a/d7f/c104 0 2024-09-21T00:57:06.512 INFO:tasks.workunit.client.0.smithi112.stdout:2/890: write d0/df/f16 [1840481,113882] 0 2024-09-21T00:57:06.514 INFO:tasks.workunit.client.0.smithi112.stdout:4/802: creat d1/ddf/f109 x:0 0 0 2024-09-21T00:57:06.515 INFO:tasks.workunit.client.0.smithi112.stdout:0/859: truncate d8/fcb 1975957 0 2024-09-21T00:57:06.525 INFO:tasks.workunit.client.0.smithi112.stdout:2/891: dwrite d0/d14/d8/fb4 [0,4194304] 0 2024-09-21T00:57:06.525 INFO:tasks.workunit.client.0.smithi112.stdout:0/860: symlink d8/d11/d28/dbf/dd3/dec/def/da3/dea/l10c 0 2024-09-21T00:57:06.529 INFO:tasks.workunit.client.0.smithi112.stdout:2/892: mknod d0/d14/d8/d27/d63/c125 0 2024-09-21T00:57:06.534 INFO:tasks.workunit.client.0.smithi112.stdout:1/794: write d5/d8/f3d [914660,51239] 0 2024-09-21T00:57:06.538 INFO:tasks.workunit.client.0.smithi112.stdout:1/795: creat d5/d8/dd/d8e/de6/dfc/f105 x:0 0 0 2024-09-21T00:57:06.541 INFO:tasks.workunit.client.0.smithi112.stdout:4/803: dwrite d1/d5/f9b [0,4194304] 0 2024-09-21T00:57:06.548 INFO:tasks.workunit.client.0.smithi112.stdout:4/804: mknod d1/d7/d9/d1a/d22/d6e/c10a 0 2024-09-21T00:57:06.549 INFO:tasks.workunit.client.0.smithi112.stdout:4/805: fdatasync d1/d7/df7/dc2/fda 0 2024-09-21T00:57:06.553 INFO:tasks.workunit.client.0.smithi112.stdout:1/796: write d5/d8/dd/d97/d46/fac [1776776,101396] 0 2024-09-21T00:57:06.556 INFO:tasks.workunit.client.0.smithi112.stdout:4/806: rename d1/d5/d1c/d1e/d76/db0 to d1/d7/d9/d1a/d22/d6e/d10b 0 2024-09-21T00:57:06.558 INFO:tasks.workunit.client.0.smithi112.stdout:1/797: dread - d5/d8/dd/d97/fb2 zero size 2024-09-21T00:57:06.563 INFO:tasks.workunit.client.0.smithi112.stdout:2/893: dread d0/d14/d8/d27/f3f [0,4194304] 0 2024-09-21T00:57:06.566 INFO:tasks.workunit.client.0.smithi112.stdout:4/807: write d1/d7/fdb [2207834,24106] 0 2024-09-21T00:57:06.566 INFO:tasks.workunit.client.0.smithi112.stdout:2/894: mknod d0/d14/d8/da2/dba/dc1/d11e/c126 0 2024-09-21T00:57:06.566 INFO:tasks.workunit.client.0.smithi112.stdout:1/798: link d5/d3a/d4b/de9/cf8 d5/d8/dd/d8e/de6/c106 0 2024-09-21T00:57:06.566 INFO:tasks.workunit.client.0.smithi112.stdout:4/808: write d1/ddf/f109 [20607,12799] 0 2024-09-21T00:57:06.571 INFO:tasks.workunit.client.0.smithi112.stdout:4/809: mkdir d1/d5/d1c/db3/d10c 0 2024-09-21T00:57:06.575 INFO:tasks.workunit.client.0.smithi112.stdout:4/810: truncate d1/d7/d9/d1a/d22/d6e/f9d 2566566 0 2024-09-21T00:57:06.575 INFO:tasks.workunit.client.0.smithi112.stdout:2/895: write d0/df/fb2 [2513950,117047] 0 2024-09-21T00:57:06.590 INFO:tasks.workunit.client.0.smithi112.stdout:4/811: write d1/d7/d9/d1a/d22/d6e/f9d [485122,45731] 0 2024-09-21T00:57:06.590 INFO:tasks.workunit.client.0.smithi112.stdout:2/896: dwrite d0/d14/d8/d27/d63/df0/ff8 [0,4194304] 0 2024-09-21T00:57:06.593 INFO:tasks.workunit.client.0.smithi112.stdout:2/897: mkdir d0/df/d46/d58/d127 0 2024-09-21T00:57:06.594 INFO:tasks.workunit.client.0.smithi112.stdout:2/898: chown d0/l89 93 1 2024-09-21T00:57:06.597 INFO:tasks.workunit.client.0.smithi112.stdout:4/812: creat d1/d5/d1c/db3/f10d x:0 0 0 2024-09-21T00:57:06.601 INFO:tasks.workunit.client.0.smithi112.stdout:4/813: creat d1/d5/d1c/d1e/d76/f10e x:0 0 0 2024-09-21T00:57:06.603 INFO:tasks.workunit.client.0.smithi112.stdout:2/899: dwrite d0/d14/d8/d27/f64 [0,4194304] 0 2024-09-21T00:57:06.605 INFO:tasks.workunit.client.0.smithi112.stdout:4/814: creat d1/d5/d1c/d1e/d3d/d99/f10f x:0 0 0 2024-09-21T00:57:06.607 INFO:tasks.workunit.client.0.smithi112.stdout:2/900: fdatasync d0/d14/d8/d27/f2a 0 2024-09-21T00:57:06.607 INFO:tasks.workunit.client.0.smithi112.stdout:4/815: chown d1/d5/d1c/d1e/fa7 6715681 1 2024-09-21T00:57:06.608 INFO:tasks.workunit.client.0.smithi112.stdout:2/901: stat d0/d14/d22/d95 0 2024-09-21T00:57:06.609 INFO:tasks.workunit.client.0.smithi112.stdout:2/902: fsync d0/d14/d47/f9c 0 2024-09-21T00:57:06.610 INFO:tasks.workunit.client.0.smithi112.stdout:2/903: chown d0/d45/d8a/dc6 0 1 2024-09-21T00:57:06.610 INFO:tasks.workunit.client.0.smithi112.stdout:4/816: mkdir d1/d7/d9/d1a/d22/d6e/d10b/d110 0 2024-09-21T00:57:06.611 INFO:tasks.workunit.client.0.smithi112.stdout:4/817: stat d1/d7/d9/d1a/d22/l5e 0 2024-09-21T00:57:06.613 INFO:tasks.workunit.client.0.smithi112.stdout:2/904: unlink d0/d14/d8/da2/dba/dc1/cdb 0 2024-09-21T00:57:06.614 INFO:tasks.workunit.client.0.smithi112.stdout:4/818: rmdir d1/d5/d1c/d1e/daf 39 2024-09-21T00:57:06.614 INFO:tasks.workunit.client.0.smithi112.stdout:2/905: write d0/d60/d78/f9b [4920880,80216] 0 2024-09-21T00:57:06.614 INFO:tasks.workunit.client.0.smithi112.stdout:4/819: stat d1/d5/f9b 0 2024-09-21T00:57:06.616 INFO:tasks.workunit.client.0.smithi112.stdout:4/820: chown d1/d5/d1c/d1e/d4a/d5f/d83/lf5 0 1 2024-09-21T00:57:06.618 INFO:tasks.workunit.client.0.smithi112.stdout:4/821: symlink d1/d7/df7/l111 0 2024-09-21T00:57:06.621 INFO:tasks.workunit.client.0.smithi112.stdout:4/822: dread d1/d5/d1c/d1e/daf/ffd [0,4194304] 0 2024-09-21T00:57:06.621 INFO:tasks.workunit.client.0.smithi112.stdout:4/823: stat d1/d2d/d34/df6 0 2024-09-21T00:57:06.637 INFO:tasks.workunit.client.0.smithi112.stdout:4/824: dread d1/d5/d1c/d1e/d3d/db9/fc3 [0,4194304] 0 2024-09-21T00:57:06.638 INFO:tasks.workunit.client.0.smithi112.stdout:4/825: truncate d1/d7/d9/d1a/d8e/f100 282193 0 2024-09-21T00:57:06.656 INFO:tasks.workunit.client.0.smithi112.stdout:7/882: sync 2024-09-21T00:57:06.656 INFO:tasks.workunit.client.0.smithi112.stdout:5/710: sync 2024-09-21T00:57:06.657 INFO:tasks.workunit.client.0.smithi112.stdout:4/826: dwrite d1/d5/d1c/db3/fc1 [0,4194304] 0 2024-09-21T00:57:06.658 INFO:tasks.workunit.client.0.smithi112.stdout:5/711: chown d8/fbd 82 1 2024-09-21T00:57:06.696 INFO:tasks.workunit.client.0.smithi112.stdout:7/883: symlink d0/d2/d2e/df6/d39/d56/l120 0 2024-09-21T00:57:06.697 INFO:tasks.workunit.client.0.smithi112.stdout:5/712: creat d8/d9/d13/d1c/d45/fe3 x:0 0 0 2024-09-21T00:57:06.698 INFO:tasks.workunit.client.0.smithi112.stdout:4/827: mknod d1/d2d/d34/df6/c112 0 2024-09-21T00:57:06.699 INFO:tasks.workunit.client.0.smithi112.stdout:7/884: creat d0/d2/d32/da4/df9/f121 x:0 0 0 2024-09-21T00:57:06.701 INFO:tasks.workunit.client.0.smithi112.stdout:5/713: creat d8/d9/d13/d2a/d84/d8b/fe4 x:0 0 0 2024-09-21T00:57:06.706 INFO:tasks.workunit.client.0.smithi112.stdout:7/885: symlink d0/d2/d2e/df6/d39/db3/d10e/l122 0 2024-09-21T00:57:06.708 INFO:tasks.workunit.client.0.smithi112.stdout:4/828: rename d1/ddf/f109 to d1/d5/d1c/d1e/f113 0 2024-09-21T00:57:06.709 INFO:tasks.workunit.client.0.smithi112.stdout:5/714: mkdir d8/d9/d13/de5 0 2024-09-21T00:57:06.712 INFO:tasks.workunit.client.0.smithi112.stdout:4/829: symlink d1/d7/d9/d1a/d8e/l114 0 2024-09-21T00:57:06.713 INFO:tasks.workunit.client.0.smithi112.stdout:5/715: mknod d8/d9/d13/d1c/d45/d8a/dc0/ce6 0 2024-09-21T00:57:06.714 INFO:tasks.workunit.client.0.smithi112.stdout:4/830: rename d1/d7/c59 to d1/d7/df7/dc2/c115 0 2024-09-21T00:57:06.725 INFO:tasks.workunit.client.0.smithi112.stdout:7/886: write d0/d2/d2e/f5f [3490282,120352] 0 2024-09-21T00:57:06.726 INFO:tasks.workunit.client.0.smithi112.stdout:4/831: dread d1/d7/d9/d1a/d22/d6e/f9d [0,4194304] 0 2024-09-21T00:57:06.730 INFO:tasks.workunit.client.0.smithi112.stdout:5/716: truncate d8/d9/d13/d2a/df/d5b/dbe/fa6 350995 0 2024-09-21T00:57:06.731 INFO:tasks.workunit.client.0.smithi112.stdout:5/717: write d8/d9/d13/d1c/d45/d8a/dc0/fcc [798199,122944] 0 2024-09-21T00:57:06.732 INFO:tasks.workunit.client.0.smithi112.stdout:7/887: write d0/d2/d2e/df6/f49 [1658022,88775] 0 2024-09-21T00:57:06.734 INFO:tasks.workunit.client.0.smithi112.stdout:5/718: creat d8/d9/d13/d2a/df/fe7 x:0 0 0 2024-09-21T00:57:06.736 INFO:tasks.workunit.client.0.smithi112.stdout:5/719: truncate d8/d9/d13/d1c/dbc/fde 732175 0 2024-09-21T00:57:06.736 INFO:tasks.workunit.client.0.smithi112.stdout:4/832: link d1/d7/d30/l87 d1/d5/d1c/d1e/d76/dba/l116 0 2024-09-21T00:57:06.740 INFO:tasks.workunit.client.0.smithi112.stdout:5/720: mknod d8/d9/d13/ce8 0 2024-09-21T00:57:06.743 INFO:tasks.workunit.client.0.smithi112.stdout:7/888: truncate d0/d2/d2e/df6/d39/d56/d65/d87/fbd 449924 0 2024-09-21T00:57:06.746 INFO:tasks.workunit.client.0.smithi112.stdout:5/721: unlink d8/d9/d13/d1c/d99/l8d 0 2024-09-21T00:57:06.749 INFO:tasks.workunit.client.0.smithi112.stdout:7/889: write d0/d2/d2e/df6/d39/d56/d86/f85 [1412247,73876] 0 2024-09-21T00:57:06.750 INFO:tasks.workunit.client.0.smithi112.stdout:4/833: dwrite d1/d2d/d34/dd3/fe0 [0,4194304] 0 2024-09-21T00:57:06.758 INFO:tasks.workunit.client.0.smithi112.stdout:4/834: rmdir d1/d7/df7/dc2 39 2024-09-21T00:57:06.760 INFO:tasks.workunit.client.0.smithi112.stdout:5/722: rename d8/d9/d13/d2a/df/d5b/dbe/cb9 to d8/d9/d13/d1c/d99/ce9 0 2024-09-21T00:57:06.764 INFO:tasks.workunit.client.0.smithi112.stdout:4/835: dread d1/d5/d1c/d1e/daf/ffd [0,4194304] 0 2024-09-21T00:57:06.764 INFO:tasks.workunit.client.0.smithi112.stdout:5/723: mkdir d8/d9/d13/d2a/d84/d8b/dda/dea 0 2024-09-21T00:57:06.766 INFO:tasks.workunit.client.0.smithi112.stdout:7/890: getdents d0/d2/d38/d48 0 2024-09-21T00:57:06.769 INFO:tasks.workunit.client.0.smithi112.stdout:5/724: mknod d8/d9/d13/d2a/df/d5b/dbe/ceb 0 2024-09-21T00:57:06.770 INFO:tasks.workunit.client.0.smithi112.stdout:7/891: rmdir d0/d2/d32/da4/db2/db4/dba 39 2024-09-21T00:57:06.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/892: chown d0/d2/d2e/f5f 52 1 2024-09-21T00:57:06.772 INFO:tasks.workunit.client.0.smithi112.stdout:7/893: write d0/d2/d2e/f5f [3071078,44906] 0 2024-09-21T00:57:06.775 INFO:tasks.workunit.client.0.smithi112.stdout:4/836: write d1/d5/d1c/d1e/d3d/fd5 [1420939,38653] 0 2024-09-21T00:57:06.776 INFO:tasks.workunit.client.0.smithi112.stdout:5/725: write d8/d9/d61/f7d [433535,59619] 0 2024-09-21T00:57:06.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/894: mkdir d0/d2/d2e/df6/d39/d56/d123 0 2024-09-21T00:57:06.780 INFO:tasks.workunit.client.0.smithi112.stdout:5/726: creat d8/d9/d13/d1c/d45/d8a/fec x:0 0 0 2024-09-21T00:57:06.781 INFO:tasks.workunit.client.0.smithi112.stdout:7/895: read d0/d2/d38/d48/dad/fa3 [3767744,118992] 0 2024-09-21T00:57:06.782 INFO:tasks.workunit.client.0.smithi112.stdout:5/727: truncate d8/d9/d13/f39 3090411 0 2024-09-21T00:57:06.785 INFO:tasks.workunit.client.0.smithi112.stdout:7/896: symlink d0/d2/d2e/df6/d39/d56/d86/ddd/l124 0 2024-09-21T00:57:06.789 INFO:tasks.workunit.client.0.smithi112.stdout:7/897: mknod d0/d2/d2e/df6/d39/d56/d65/d75/de8/c125 0 2024-09-21T00:57:06.789 INFO:tasks.workunit.client.0.smithi112.stdout:5/728: getdents d8/d9/d13/d2a/d58 0 2024-09-21T00:57:06.792 INFO:tasks.workunit.client.0.smithi112.stdout:5/729: truncate d8/d9/d13/d1c/d45/d8a/dc0/fd0 1047344 0 2024-09-21T00:57:06.793 INFO:tasks.workunit.client.0.smithi112.stdout:4/837: dread d1/d5/d1c/f92 [0,4194304] 0 2024-09-21T00:57:06.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/730: write d8/d9/d13/d2a/df/f97 [242885,59143] 0 2024-09-21T00:57:06.794 INFO:tasks.workunit.client.0.smithi112.stdout:5/731: chown d8/d9/l3e 176 1 2024-09-21T00:57:06.796 INFO:tasks.workunit.client.0.smithi112.stdout:4/838: symlink d1/d5/d1c/d1e/d3d/d99/l117 0 2024-09-21T00:57:06.802 INFO:tasks.workunit.client.0.smithi112.stdout:5/732: rename d8/d9/cac to d8/d9/d13/d2a/d58/ced 0 2024-09-21T00:57:06.803 INFO:tasks.workunit.client.0.smithi112.stdout:4/839: mknod d1/c118 0 2024-09-21T00:57:06.806 INFO:tasks.workunit.client.0.smithi112.stdout:7/898: write d0/d2/d2e/df6/d39/d56/d65/d87/fbd [585123,29234] 0 2024-09-21T00:57:06.807 INFO:tasks.workunit.client.0.smithi112.stdout:5/733: dread d8/d9/d13/d2a/df/d5b/f88 [0,4194304] 0 2024-09-21T00:57:06.809 INFO:tasks.workunit.client.0.smithi112.stdout:5/734: fsync d8/d9/d13/d2a/df/f94 0 2024-09-21T00:57:06.813 INFO:tasks.workunit.client.0.smithi112.stdout:4/840: dwrite d1/d7/d9/d1a/d22/d6e/f9d [0,4194304] 0 2024-09-21T00:57:06.818 INFO:tasks.workunit.client.0.smithi112.stdout:5/735: creat d8/d9/d13/d2a/df/db5/fee x:0 0 0 2024-09-21T00:57:06.820 INFO:tasks.workunit.client.0.smithi112.stdout:4/841: symlink d1/d5/d1c/d1e/d76/d103/l119 0 2024-09-21T00:57:06.821 INFO:tasks.workunit.client.0.smithi112.stdout:7/899: dwrite d0/d2/d32/f54 [0,4194304] 0 2024-09-21T00:57:06.822 INFO:tasks.workunit.client.0.smithi112.stdout:5/736: write d8/d9/d13/d2a/df/f97 [758743,121822] 0 2024-09-21T00:57:06.826 INFO:tasks.workunit.client.0.smithi112.stdout:4/842: rename d1/d2d/d34/dd3 to d1/d5/d1c/d1e/d76/d11a 0 2024-09-21T00:57:06.831 INFO:tasks.workunit.client.0.smithi112.stdout:4/843: unlink d1/d7/l53 0 2024-09-21T00:57:06.836 INFO:tasks.workunit.client.0.smithi112.stdout:4/844: chown d1/d5/d1c/d1e/d3d/db9/ccc 411977 1 2024-09-21T00:57:06.837 INFO:tasks.workunit.client.0.smithi112.stdout:7/900: rmdir d0/d2/d2e/df6/d39/d56/d123 0 2024-09-21T00:57:06.841 INFO:tasks.workunit.client.0.smithi112.stdout:4/845: truncate d1/d5/d1c/d1e/d4a/d5f/d83/fd8 167326 0 2024-09-21T00:57:06.842 INFO:tasks.workunit.client.0.smithi112.stdout:7/901: fdatasync d0/d2/d2e/df6/d39/d56/d65/d75/d9a/feb 0 2024-09-21T00:57:06.843 INFO:tasks.workunit.client.0.smithi112.stdout:8/854: sync 2024-09-21T00:57:06.844 INFO:tasks.workunit.client.0.smithi112.stdout:7/902: write d0/d2/d38/d48/f103 [849375,124179] 0 2024-09-21T00:57:06.849 INFO:tasks.workunit.client.0.smithi112.stdout:8/855: symlink d0/d13/dab/l112 0 2024-09-21T00:57:06.850 INFO:tasks.workunit.client.0.smithi112.stdout:7/903: mkdir d0/d2/d2e/df6/de4/d126 0 2024-09-21T00:57:06.854 INFO:tasks.workunit.client.0.smithi112.stdout:5/737: dwrite d8/d9/d13/d2a/df/d5b/dbe/f7e [4194304,4194304] 0 2024-09-21T00:57:06.860 INFO:tasks.workunit.client.0.smithi112.stdout:8/856: link d0/d13/d1b/d22/d2e/d34/d7b/f71 d0/d13/dab/dc6/d100/f113 0 2024-09-21T00:57:06.861 INFO:tasks.workunit.client.0.smithi112.stdout:4/846: dread d1/d7/df7/fed [0,4194304] 0 2024-09-21T00:57:06.863 INFO:tasks.workunit.client.0.smithi112.stdout:7/904: creat d0/d2/d2e/df6/d39/d1a/f127 x:0 0 0 2024-09-21T00:57:06.863 INFO:tasks.workunit.client.0.smithi112.stdout:8/857: fsync d0/d13/d1b/d22/d61/fb0 0 2024-09-21T00:57:06.869 INFO:tasks.workunit.client.0.smithi112.stdout:8/858: dwrite d0/d13/d2a/f48 [0,4194304] 0 2024-09-21T00:57:06.870 INFO:tasks.workunit.client.0.smithi112.stdout:4/847: dread d1/d5/d1c/d1e/d3d/d99/fb5 [0,4194304] 0 2024-09-21T00:57:06.873 INFO:tasks.workunit.client.0.smithi112.stdout:8/859: mkdir d0/d66/d88/de8/d114 0 2024-09-21T00:57:06.906 INFO:tasks.workunit.client.0.smithi112.stdout:5/738: dread d8/d9/d13/d2a/d2c/f2f [0,4194304] 0 2024-09-21T00:57:06.907 INFO:tasks.workunit.client.0.smithi112.stdout:8/860: mknod d0/d13/d1b/d22/d61/c115 0 2024-09-21T00:57:06.908 INFO:tasks.workunit.client.0.smithi112.stdout:5/739: mkdir d8/d9/dcd/def 0 2024-09-21T00:57:06.909 INFO:tasks.workunit.client.0.smithi112.stdout:8/861: creat d0/d13/d9f/dc2/f116 x:0 0 0 2024-09-21T00:57:06.911 INFO:tasks.workunit.client.0.smithi112.stdout:8/862: mknod d0/d13/d9f/dc2/c117 0 2024-09-21T00:57:06.933 INFO:tasks.workunit.client.0.smithi112.stdout:5/740: creat d8/d9/d13/d2a/df/d5b/ff0 x:0 0 0 2024-09-21T00:57:06.937 INFO:tasks.workunit.client.0.smithi112.stdout:8/863: rename d0/d13/d9f/dc2/ld3 to d0/d13/d2a/l118 0 2024-09-21T00:57:06.941 INFO:tasks.workunit.client.0.smithi112.stdout:8/864: unlink d0/d13/f59 0 2024-09-21T00:57:06.943 INFO:tasks.workunit.client.0.smithi112.stdout:4/848: dread d1/d5/d1c/d6c/fae [0,4194304] 0 2024-09-21T00:57:06.946 INFO:tasks.workunit.client.0.smithi112.stdout:8/865: rmdir d0/d13/d2a/d101 0 2024-09-21T00:57:06.947 INFO:tasks.workunit.client.0.smithi112.stdout:8/866: chown d0/d13/d1b/f8f 713 1 2024-09-21T00:57:06.949 INFO:tasks.workunit.client.0.smithi112.stdout:4/849: write d1/d5/d1c/fa4 [881270,77312] 0 2024-09-21T00:57:06.950 INFO:tasks.workunit.client.0.smithi112.stdout:8/867: symlink d0/d13/d1b/d22/d42/de3/l119 0 2024-09-21T00:57:06.953 INFO:tasks.workunit.client.0.smithi112.stdout:4/850: rename d1/d5/d1c/d1e/d76/dba to d1/d5/d1c/d1e/d76/d11b 0 2024-09-21T00:57:06.953 INFO:tasks.workunit.client.0.smithi112.stdout:4/851: fdatasync d1/d5/d1c/d1e/d76/d11a/fe0 0 2024-09-21T00:57:06.955 INFO:tasks.workunit.client.0.smithi112.stdout:8/868: unlink d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1/le7 0 2024-09-21T00:57:06.955 INFO:tasks.workunit.client.0.smithi112.stdout:8/869: fdatasync d0/d13/d9f/fd4 0 2024-09-21T00:57:06.957 INFO:tasks.workunit.client.0.smithi112.stdout:4/852: mknod d1/d5/d1c/d6c/c11c 0 2024-09-21T00:57:06.961 INFO:tasks.workunit.client.0.smithi112.stdout:4/853: mknod d1/d7/d9/d1a/d8e/c11d 0 2024-09-21T00:57:06.965 INFO:tasks.workunit.client.0.smithi112.stdout:4/854: creat d1/d5/d1c/d1e/d4a/d5f/d108/f11e x:0 0 0 2024-09-21T00:57:06.968 INFO:tasks.workunit.client.0.smithi112.stdout:8/870: dread d0/d13/d1b/f70 [0,4194304] 0 2024-09-21T00:57:06.968 INFO:tasks.workunit.client.0.smithi112.stdout:8/871: chown d0/d66/f50 6172925 1 2024-09-21T00:57:06.969 INFO:tasks.workunit.client.0.smithi112.stdout:4/855: mkdir d1/d5/d1c/d1e/d4a/d5f/d83/d11f 0 2024-09-21T00:57:06.971 INFO:tasks.workunit.client.0.smithi112.stdout:8/872: mknod d0/d66/d88/c11a 0 2024-09-21T00:57:06.975 INFO:tasks.workunit.client.0.smithi112.stdout:4/856: creat d1/d7/d30/f120 x:0 0 0 2024-09-21T00:57:06.977 INFO:tasks.workunit.client.0.smithi112.stdout:4/857: mkdir d1/d7/d9/d1a/d8e/d121 0 2024-09-21T00:57:06.978 INFO:tasks.workunit.client.0.smithi112.stdout:8/873: dwrite d0/d13/d1b/d22/d42/fac [0,4194304] 0 2024-09-21T00:57:06.980 INFO:tasks.workunit.client.0.smithi112.stdout:4/858: creat d1/d5/d1c/d1e/d76/d103/f122 x:0 0 0 2024-09-21T00:57:07.000 INFO:tasks.workunit.client.0.smithi112.stdout:8/874: write d0/d13/d1b/f32 [976486,124831] 0 2024-09-21T00:57:07.001 INFO:tasks.workunit.client.0.smithi112.stdout:4/859: truncate d1/d5/d1c/d1e/d3d/fd5 118278 0 2024-09-21T00:57:07.016 INFO:tasks.workunit.client.0.smithi112.stdout:8/875: dwrite d0/d13/d1b/d22/d2e/d34/d7b/d80/fa3 [0,4194304] 0 2024-09-21T00:57:07.016 INFO:tasks.workunit.client.0.smithi112.stdout:4/860: dread d1/d5/d1c/d1e/daf/ffb [0,4194304] 0 2024-09-21T00:57:07.026 INFO:tasks.workunit.client.0.smithi112.stdout:8/876: getdents d0/d66/d88/de8 0 2024-09-21T00:57:07.034 INFO:tasks.workunit.client.0.smithi112.stdout:4/861: dwrite d1/d7/d30/fd2 [0,4194304] 0 2024-09-21T00:57:07.039 INFO:tasks.workunit.client.0.smithi112.stdout:4/862: getdents d1/d7/d9/d1a/d22/d6e 0 2024-09-21T00:57:07.040 INFO:tasks.workunit.client.0.smithi112.stdout:4/863: write d1/d7/d9/d1a/d8e/ffe [470036,54801] 0 2024-09-21T00:57:07.041 INFO:tasks.workunit.client.0.smithi112.stdout:4/864: chown d1/d7/d9/d1a/d22/d6e/c9e 7938436 1 2024-09-21T00:57:07.045 INFO:tasks.workunit.client.0.smithi112.stdout:4/865: unlink d1/d2d/f8f 0 2024-09-21T00:57:07.050 INFO:tasks.workunit.client.0.smithi112.stdout:4/866: rename d1/d7/d9/l3b to d1/d7/df7/dc2/l123 0 2024-09-21T00:57:07.051 INFO:tasks.workunit.client.0.smithi112.stdout:4/867: fsync d1/d5/d1c/d1e/daf/fb4 0 2024-09-21T00:57:07.053 INFO:tasks.workunit.client.0.smithi112.stdout:4/868: creat d1/d5/d1c/d1e/d3d/d99/f124 x:0 0 0 2024-09-21T00:57:07.055 INFO:tasks.workunit.client.0.smithi112.stdout:8/877: dread d0/d13/d9f/dc2/fb8 [0,4194304] 0 2024-09-21T00:57:07.057 INFO:tasks.workunit.client.0.smithi112.stdout:4/869: mknod d1/d5/d1c/d1e/d3d/c125 0 2024-09-21T00:57:07.061 INFO:tasks.workunit.client.0.smithi112.stdout:4/870: truncate d1/d7/d9/d1a/f9a 7911427 0 2024-09-21T00:57:07.066 INFO:tasks.workunit.client.0.smithi112.stdout:4/871: creat d1/d5/d1c/d1e/d76/d106/f126 x:0 0 0 2024-09-21T00:57:07.068 INFO:tasks.workunit.client.0.smithi112.stdout:4/872: truncate d1/d7/d9/f61 862155 0 2024-09-21T00:57:07.084 INFO:tasks.workunit.client.0.smithi112.stdout:8/878: dread d0/f3c [0,4194304] 0 2024-09-21T00:57:07.084 INFO:tasks.workunit.client.0.smithi112.stdout:8/879: readlink d0/d13/d1b/d22/d2e/l60 0 2024-09-21T00:57:07.085 INFO:tasks.workunit.client.0.smithi112.stdout:8/880: write d0/d13/dab/dcb/f10c [385586,73302] 0 2024-09-21T00:57:07.086 INFO:tasks.workunit.client.0.smithi112.stdout:8/881: chown d0/d66/d88 10 1 2024-09-21T00:57:07.103 INFO:tasks.workunit.client.0.smithi112.stdout:4/873: write d1/d5/d1c/d1e/fec [389425,129444] 0 2024-09-21T00:57:07.105 INFO:tasks.workunit.client.0.smithi112.stdout:4/874: rmdir d1/d7/d9/d1a 39 2024-09-21T00:57:07.110 INFO:tasks.workunit.client.0.smithi112.stdout:8/882: write d0/d13/dab/dc6/d100/f86 [2295116,46693] 0 2024-09-21T00:57:07.116 INFO:tasks.workunit.client.0.smithi112.stdout:8/883: mknod d0/d13/dab/dc6/d100/c11b 0 2024-09-21T00:57:07.116 INFO:tasks.workunit.client.0.smithi112.stdout:4/875: mkdir d1/d7/d9/d1a/d8e/d121/d127 0 2024-09-21T00:57:07.118 INFO:tasks.workunit.client.0.smithi112.stdout:4/876: chown d1/d5/d1c/d1e/daf/ffd 13627054 1 2024-09-21T00:57:07.127 INFO:tasks.workunit.client.0.smithi112.stdout:4/877: dwrite d1/d7/df7/fed [0,4194304] 0 2024-09-21T00:57:07.129 INFO:tasks.workunit.client.0.smithi112.stdout:4/878: write d1/d5/d1c/d1e/d4a/d5f/feb [1829963,122510] 0 2024-09-21T00:57:07.130 INFO:tasks.workunit.client.0.smithi112.stdout:4/879: dread - d1/d5/d1c/d1e/d76/d106/f126 zero size 2024-09-21T00:57:07.138 INFO:tasks.workunit.client.0.smithi112.stdout:4/880: dwrite d1/d7/df7/dc2/f107 [0,4194304] 0 2024-09-21T00:57:07.139 INFO:tasks.workunit.client.0.smithi112.stdout:8/884: dwrite d0/d13/d2a/d73/f8a [0,4194304] 0 2024-09-21T00:57:07.146 INFO:tasks.workunit.client.0.smithi112.stdout:8/885: mknod d0/d13/d1b/d22/d2e/d34/d7b/d80/ded/c11c 0 2024-09-21T00:57:07.148 INFO:tasks.workunit.client.0.smithi112.stdout:8/886: read d0/d13/d1b/d22/d2e/d34/d7b/d80/fa3 [1871266,99217] 0 2024-09-21T00:57:07.148 INFO:tasks.workunit.client.0.smithi112.stdout:4/881: getdents d1/d7/d9/d1a/d8e/d121 0 2024-09-21T00:57:07.149 INFO:tasks.workunit.client.0.smithi112.stdout:4/882: fdatasync d1/d7/d9/d1a/d8e/f100 0 2024-09-21T00:57:07.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:06 smithi187 ceph-mon[34997]: pgmap v36: 65 pgs: 65 active+clean; 2.7 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 132 MiB/s wr, 380 op/s 2024-09-21T00:57:07.168 INFO:tasks.workunit.client.0.smithi112.stdout:4/883: truncate d1/d5/d1c/d1e/d4a/d5f/feb 3994911 0 2024-09-21T00:57:07.169 INFO:tasks.workunit.client.0.smithi112.stdout:4/884: fdatasync d1/d5/d1c/d1e/d3d/d99/f124 0 2024-09-21T00:57:07.172 INFO:tasks.workunit.client.0.smithi112.stdout:4/885: readlink d1/d5/d1c/d1e/d76/d11b/l116 0 2024-09-21T00:57:07.172 INFO:tasks.workunit.client.0.smithi112.stdout:4/886: chown d1/d7/cbf 55 1 2024-09-21T00:57:07.176 INFO:tasks.workunit.client.0.smithi112.stdout:4/887: truncate d1/d5/d1c/d1e/d76/d11a/fe0 1494751 0 2024-09-21T00:57:07.177 INFO:tasks.workunit.client.0.smithi112.stdout:8/887: dread d0/d13/dab/dc6/d100/f76 [0,4194304] 0 2024-09-21T00:57:07.178 INFO:tasks.workunit.client.0.smithi112.stdout:8/888: chown d0/d13/d1b/d22/d61/c72 10673966 1 2024-09-21T00:57:07.179 INFO:tasks.workunit.client.0.smithi112.stdout:4/888: chown d1/d7/d9/d1a/d22/c90 14575282 1 2024-09-21T00:57:07.180 INFO:tasks.workunit.client.0.smithi112.stdout:8/889: chown d0/d13/d2a/d73/d96/la0 3843 1 2024-09-21T00:57:07.184 INFO:tasks.workunit.client.0.smithi112.stdout:8/890: mknod d0/d13/d1b/d22/d42/c11d 0 2024-09-21T00:57:07.185 INFO:tasks.workunit.client.0.smithi112.stdout:4/889: mknod d1/d7/d9/d1a/d22/d6e/d10b/d110/c128 0 2024-09-21T00:57:07.200 INFO:tasks.workunit.client.0.smithi112.stdout:8/891: dwrite d0/f41 [0,4194304] 0 2024-09-21T00:57:07.201 INFO:tasks.workunit.client.0.smithi112.stdout:8/892: chown d0/d13/d1b/d22/d61/ceb 19 1 2024-09-21T00:57:07.205 INFO:tasks.workunit.client.0.smithi112.stdout:4/890: dread d1/d2d/d34/f58 [0,4194304] 0 2024-09-21T00:57:07.206 INFO:tasks.workunit.client.0.smithi112.stdout:8/893: dread - d0/d13/d2a/d73/d96/dbc/fbe zero size 2024-09-21T00:57:07.213 INFO:tasks.workunit.client.0.smithi112.stdout:8/894: write d0/d13/d9f/fca [1668612,121884] 0 2024-09-21T00:57:07.214 INFO:tasks.workunit.client.0.smithi112.stdout:6/883: sync 2024-09-21T00:57:07.215 INFO:tasks.workunit.client.0.smithi112.stdout:8/895: chown d0/f62 547 1 2024-09-21T00:57:07.218 INFO:tasks.workunit.client.0.smithi112.stdout:8/896: fsync d0/d13/d2a/f5e 0 2024-09-21T00:57:07.219 INFO:tasks.workunit.client.0.smithi112.stdout:4/891: dwrite d1/d5/d1c/d1e/d4a/d5f/fd7 [0,4194304] 0 2024-09-21T00:57:07.220 INFO:tasks.workunit.client.0.smithi112.stdout:4/892: stat d1/ddf 0 2024-09-21T00:57:07.221 INFO:tasks.workunit.client.0.smithi112.stdout:8/897: rmdir d0/d13/dab/dc6/d100/d9a 39 2024-09-21T00:57:07.226 INFO:tasks.workunit.client.0.smithi112.stdout:8/898: symlink d0/d13/d2a/d73/d96/l11e 0 2024-09-21T00:57:07.231 INFO:tasks.workunit.client.0.smithi112.stdout:4/893: write d1/d2d/fd6 [40795,15593] 0 2024-09-21T00:57:07.232 INFO:tasks.workunit.client.0.smithi112.stdout:8/899: getdents d0/d13/dab/dc6/d100 0 2024-09-21T00:57:07.234 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:06 smithi112 ceph-mon[28078]: pgmap v36: 65 pgs: 65 active+clean; 2.7 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 132 MiB/s wr, 380 op/s 2024-09-21T00:57:07.235 INFO:tasks.workunit.client.0.smithi112.stdout:4/894: stat d1/l86 0 2024-09-21T00:57:07.236 INFO:tasks.workunit.client.0.smithi112.stdout:8/900: unlink d0/d13/d9f/fca 0 2024-09-21T00:57:07.239 INFO:tasks.workunit.client.0.smithi112.stdout:8/901: creat d0/d13/d1b/d22/f11f x:0 0 0 2024-09-21T00:57:07.240 INFO:tasks.workunit.client.0.smithi112.stdout:4/895: dread d1/f46 [0,4194304] 0 2024-09-21T00:57:07.240 INFO:tasks.workunit.client.0.smithi112.stdout:8/902: stat d0/d13/d1b/d22/d2e/d34/fb1 0 2024-09-21T00:57:07.241 INFO:tasks.workunit.client.0.smithi112.stdout:4/896: fdatasync d1/d7/d30/fd2 0 2024-09-21T00:57:07.242 INFO:tasks.workunit.client.0.smithi112.stdout:8/903: write d0/d13/d1b/d22/f23 [3581284,85439] 0 2024-09-21T00:57:07.245 INFO:tasks.workunit.client.0.smithi112.stdout:6/884: dread d9/d1f/d47/d34/da6/f64 [0,4194304] 0 2024-09-21T00:57:07.248 INFO:tasks.workunit.client.0.smithi112.stdout:4/897: dwrite d1/d7/df7/dc2/fda [4194304,4194304] 0 2024-09-21T00:57:07.271 INFO:tasks.workunit.client.0.smithi112.stdout:1/799: sync 2024-09-21T00:57:07.271 INFO:tasks.workunit.client.0.smithi112.stdout:0/861: sync 2024-09-21T00:57:07.272 INFO:tasks.workunit.client.0.smithi112.stdout:1/800: readlink d5/d8/dd/d8e/dca/leb 0 2024-09-21T00:57:07.277 INFO:tasks.workunit.client.0.smithi112.stdout:8/904: truncate d0/d13/dab/dc6/d100/f86 3043436 0 2024-09-21T00:57:07.280 INFO:tasks.workunit.client.0.smithi112.stdout:4/898: write d1/d5/d1c/d1e/d3d/db9/fc3 [1511690,65468] 0 2024-09-21T00:57:07.281 INFO:tasks.workunit.client.0.smithi112.stdout:1/801: unlink d5/d3a/d4b/fd1 0 2024-09-21T00:57:07.286 INFO:tasks.workunit.client.0.smithi112.stdout:8/905: fsync d0/d13/dab/dc6/d100/f76 0 2024-09-21T00:57:07.286 INFO:tasks.workunit.client.0.smithi112.stdout:8/906: read - d0/d13/dab/dc6/d100/fcd zero size 2024-09-21T00:57:07.287 INFO:tasks.workunit.client.0.smithi112.stdout:0/862: truncate d8/d11/f15 2498889 0 2024-09-21T00:57:07.288 INFO:tasks.workunit.client.0.smithi112.stdout:8/907: stat d0/d13/d1b/d22/d2e 0 2024-09-21T00:57:07.289 INFO:tasks.workunit.client.0.smithi112.stdout:8/908: write d0/d13/d2a/d73/d96/dbc/ff7 [530792,122691] 0 2024-09-21T00:57:07.293 INFO:tasks.workunit.client.0.smithi112.stdout:6/885: truncate d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f133 2076429 0 2024-09-21T00:57:07.296 INFO:tasks.workunit.client.0.smithi112.stdout:8/909: creat d0/d13/d1b/d22/d2e/d34/dd6/f120 x:0 0 0 2024-09-21T00:57:07.298 INFO:tasks.workunit.client.0.smithi112.stdout:4/899: getdents d1/d5/d1c/d1e/d4a/d5f/db1/de2 0 2024-09-21T00:57:07.299 INFO:tasks.workunit.client.0.smithi112.stdout:1/802: mkdir d5/d8/dd/d97/d107 0 2024-09-21T00:57:07.302 INFO:tasks.workunit.client.0.smithi112.stdout:6/886: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/dea/d14a 0 2024-09-21T00:57:07.303 INFO:tasks.workunit.client.0.smithi112.stdout:8/910: creat d0/d13/dab/f121 x:0 0 0 2024-09-21T00:57:07.304 INFO:tasks.workunit.client.0.smithi112.stdout:6/887: write d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/f3c [2626163,19433] 0 2024-09-21T00:57:07.307 INFO:tasks.workunit.client.0.smithi112.stdout:4/900: symlink d1/d7/d9/d1a/d22/l129 0 2024-09-21T00:57:07.309 INFO:tasks.workunit.client.0.smithi112.stdout:0/863: creat d8/d11/d28/f10d x:0 0 0 2024-09-21T00:57:07.311 INFO:tasks.workunit.client.0.smithi112.stdout:8/911: mknod d0/c122 0 2024-09-21T00:57:07.312 INFO:tasks.workunit.client.0.smithi112.stdout:6/888: symlink d9/d1f/d3e/d6f/dd3/l14b 0 2024-09-21T00:57:07.317 INFO:tasks.workunit.client.0.smithi112.stdout:4/901: link d1/d7/df7/dc2/f107 d1/d5/d1c/d1e/d76/d11a/f12a 0 2024-09-21T00:57:07.320 INFO:tasks.workunit.client.0.smithi112.stdout:0/864: mkdir d8/d1b/d2c/d2e/d4c/d6b/d10e 0 2024-09-21T00:57:07.322 INFO:tasks.workunit.client.0.smithi112.stdout:0/865: write d8/d75/d9c/ff8 [255621,7598] 0 2024-09-21T00:57:07.324 INFO:tasks.workunit.client.0.smithi112.stdout:0/866: fdatasync d8/d11/f81 0 2024-09-21T00:57:07.325 INFO:tasks.workunit.client.0.smithi112.stdout:4/902: dwrite d1/d7/d30/d91/ff0 [0,4194304] 0 2024-09-21T00:57:07.328 INFO:tasks.workunit.client.0.smithi112.stdout:1/803: rename d5/d8/dd/d8e/cad to d5/d3a/c108 0 2024-09-21T00:57:07.328 INFO:tasks.workunit.client.0.smithi112.stdout:4/903: read d1/d7/d9/d1a/f78 [119238,59959] 0 2024-09-21T00:57:07.330 INFO:tasks.workunit.client.0.smithi112.stdout:8/912: write d0/d13/d9f/dc2/fb8 [2460609,52215] 0 2024-09-21T00:57:07.331 INFO:tasks.workunit.client.0.smithi112.stdout:1/804: symlink d5/d3a/d4b/de9/l109 0 2024-09-21T00:57:07.332 INFO:tasks.workunit.client.0.smithi112.stdout:6/889: dread d9/d1f/f81 [4194304,4194304] 0 2024-09-21T00:57:07.333 INFO:tasks.workunit.client.0.smithi112.stdout:4/904: mkdir d1/d2d/d34/d12b 0 2024-09-21T00:57:07.333 INFO:tasks.workunit.client.0.smithi112.stdout:1/805: stat d5/d68 0 2024-09-21T00:57:07.333 INFO:tasks.workunit.client.0.smithi112.stdout:0/867: dwrite d8/fd [0,4194304] 0 2024-09-21T00:57:07.337 INFO:tasks.workunit.client.0.smithi112.stdout:8/913: creat d0/d13/d1b/d22/d2e/d34/d7b/d80/ded/f123 x:0 0 0 2024-09-21T00:57:07.338 INFO:tasks.workunit.client.0.smithi112.stdout:4/905: dread d1/d5/d1c/d1e/d3d/d99/fb5 [0,4194304] 0 2024-09-21T00:57:07.339 INFO:tasks.workunit.client.0.smithi112.stdout:4/906: read d1/d7/df7/dc2/fda [4260785,109586] 0 2024-09-21T00:57:07.340 INFO:tasks.workunit.client.0.smithi112.stdout:0/868: unlink d8/d11/d28/d54/f57 0 2024-09-21T00:57:07.342 INFO:tasks.workunit.client.0.smithi112.stdout:4/907: truncate d1/d5/d1c/d1e/d3d/d99/f124 365788 0 2024-09-21T00:57:07.343 INFO:tasks.workunit.client.0.smithi112.stdout:1/806: rename d5/d8/d14 to d5/d8/dd/d97/dd2/d10a 0 2024-09-21T00:57:07.345 INFO:tasks.workunit.client.0.smithi112.stdout:6/890: unlink d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/c57 0 2024-09-21T00:57:07.348 INFO:tasks.workunit.client.0.smithi112.stdout:4/908: mkdir d1/d5/d1c/db3/d12c 0 2024-09-21T00:57:07.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/807: symlink d5/d8/dd/d97/dd2/d10a/l10b 0 2024-09-21T00:57:07.349 INFO:tasks.workunit.client.0.smithi112.stdout:6/891: dread d9/f12 [0,4194304] 0 2024-09-21T00:57:07.351 INFO:tasks.workunit.client.0.smithi112.stdout:6/892: readlink d9/d1f/d47/d34/da6/da7/dcf/d31/l5b 0 2024-09-21T00:57:07.352 INFO:tasks.workunit.client.0.smithi112.stdout:4/909: symlink d1/d5/d1c/d1e/d76/d11b/l12d 0 2024-09-21T00:57:07.357 INFO:tasks.workunit.client.0.smithi112.stdout:1/808: chown d5/d8/dd/dcc/c63 489001 1 2024-09-21T00:57:07.357 INFO:tasks.workunit.client.0.smithi112.stdout:6/893: dwrite d9/f20 [4194304,4194304] 0 2024-09-21T00:57:07.366 INFO:tasks.workunit.client.0.smithi112.stdout:8/914: dread d0/d66/f40 [0,4194304] 0 2024-09-21T00:57:07.366 INFO:tasks.workunit.client.0.smithi112.stdout:1/809: dwrite d5/d8/dd/f4e [0,4194304] 0 2024-09-21T00:57:07.367 INFO:tasks.workunit.client.0.smithi112.stdout:4/910: truncate d1/d7/d9/f61 1273855 0 2024-09-21T00:57:07.369 INFO:tasks.workunit.client.0.smithi112.stdout:0/869: truncate d8/d11/fb8 1882111 0 2024-09-21T00:57:07.371 INFO:tasks.workunit.client.0.smithi112.stdout:4/911: write d1/d2d/fd6 [72453,28056] 0 2024-09-21T00:57:07.374 INFO:tasks.workunit.client.0.smithi112.stdout:6/894: dwrite d9/d1f/d47/d34/da6/da7/f76 [0,4194304] 0 2024-09-21T00:57:07.378 INFO:tasks.workunit.client.0.smithi112.stdout:8/915: getdents d0/d13/d2a/ddc 0 2024-09-21T00:57:07.381 INFO:tasks.workunit.client.0.smithi112.stdout:1/810: link d5/d34/ce5 d5/d3a/c10c 0 2024-09-21T00:57:07.383 INFO:tasks.workunit.client.0.smithi112.stdout:0/870: truncate d8/d75/d9c/fe8 867389 0 2024-09-21T00:57:07.384 INFO:tasks.workunit.client.0.smithi112.stdout:8/916: stat d0/d13/dab/dc6/d100/f86 0 2024-09-21T00:57:07.387 INFO:tasks.workunit.client.0.smithi112.stdout:1/811: creat d5/d3a/d4b/de9/f10d x:0 0 0 2024-09-21T00:57:07.388 INFO:tasks.workunit.client.0.smithi112.stdout:1/812: readlink d5/d8/dd/d97/d46/d70/l77 0 2024-09-21T00:57:07.389 INFO:tasks.workunit.client.0.smithi112.stdout:8/917: symlink d0/d13/d1b/d22/d2e/l124 0 2024-09-21T00:57:07.389 INFO:tasks.workunit.client.0.smithi112.stdout:0/871: write d8/d11/d59/f8a [3904924,122825] 0 2024-09-21T00:57:07.390 INFO:tasks.workunit.client.0.smithi112.stdout:6/895: mknod d9/d1f/d47/d34/da6/da7/dcf/d60/d137/d13c/c14c 0 2024-09-21T00:57:07.392 INFO:tasks.workunit.client.0.smithi112.stdout:4/912: getdents d1/d5/d1c/d1e/d4a/d5f/d83 0 2024-09-21T00:57:07.393 INFO:tasks.workunit.client.0.smithi112.stdout:6/896: fdatasync d9/d1f/d3e/d77/f71 0 2024-09-21T00:57:07.393 INFO:tasks.workunit.client.0.smithi112.stdout:8/918: creat d0/d13/d9f/dc2/f125 x:0 0 0 2024-09-21T00:57:07.394 INFO:tasks.workunit.client.0.smithi112.stdout:0/872: mknod d8/d62/d9d/d101/c10f 0 2024-09-21T00:57:07.398 INFO:tasks.workunit.client.0.smithi112.stdout:1/813: dwrite d5/d8/dd/dcc/f101 [0,4194304] 0 2024-09-21T00:57:07.398 INFO:tasks.workunit.client.0.smithi112.stdout:8/919: fdatasync d0/d13/d1b/d22/d2e/d34/d7b/f71 0 2024-09-21T00:57:07.401 INFO:tasks.workunit.client.0.smithi112.stdout:4/913: truncate d1/d5/d1c/d1e/f20 509181 0 2024-09-21T00:57:07.401 INFO:tasks.workunit.client.0.smithi112.stdout:1/814: chown d5/d3a/c9e 65564080 1 2024-09-21T00:57:07.403 INFO:tasks.workunit.client.0.smithi112.stdout:8/920: write d0/d13/d2a/d73/d96/dbc/fe1 [84565,125484] 0 2024-09-21T00:57:07.404 INFO:tasks.workunit.client.0.smithi112.stdout:1/815: write d5/d3a/d4b/de9/fef [1035510,15822] 0 2024-09-21T00:57:07.407 INFO:tasks.workunit.client.0.smithi112.stdout:4/914: creat d1/d5/d1c/d1e/d4a/d5f/d83/f12e x:0 0 0 2024-09-21T00:57:07.445 INFO:tasks.workunit.client.0.smithi112.stdout:4/915: truncate d1/d5/d1c/d1e/d3d/fa8 4138844 0 2024-09-21T00:57:07.448 INFO:tasks.workunit.client.0.smithi112.stdout:1/816: dwrite d5/d8/dd/d97/fa8 [0,4194304] 0 2024-09-21T00:57:07.451 INFO:tasks.workunit.client.0.smithi112.stdout:4/916: dread d1/d7/d30/fd2 [0,4194304] 0 2024-09-21T00:57:07.453 INFO:tasks.workunit.client.0.smithi112.stdout:1/817: symlink d5/d8/dd/d97/d46/l10e 0 2024-09-21T00:57:07.465 INFO:tasks.workunit.client.0.smithi112.stdout:1/818: write d5/d3a/fae [3383596,9949] 0 2024-09-21T00:57:07.468 INFO:tasks.workunit.client.0.smithi112.stdout:1/819: read - d5/d8/dd/d97/fa5 zero size 2024-09-21T00:57:07.469 INFO:tasks.workunit.client.0.smithi112.stdout:1/820: chown d5/d8/f83 24 1 2024-09-21T00:57:07.470 INFO:tasks.workunit.client.0.smithi112.stdout:4/917: dwrite d1/d7/d30/f44 [0,4194304] 0 2024-09-21T00:57:07.474 INFO:tasks.workunit.client.0.smithi112.stdout:4/918: creat d1/d5/d1c/d1e/d76/d103/f12f x:0 0 0 2024-09-21T00:57:07.475 INFO:tasks.workunit.client.0.smithi112.stdout:4/919: readlink d1/d7/d30/l87 0 2024-09-21T00:57:07.475 INFO:tasks.workunit.client.0.smithi112.stdout:4/920: chown d1 33 1 2024-09-21T00:57:07.476 INFO:tasks.workunit.client.0.smithi112.stdout:1/821: mknod d5/d34/de4/c10f 0 2024-09-21T00:57:07.480 INFO:tasks.workunit.client.0.smithi112.stdout:1/822: creat d5/d8/dd/d54/f110 x:0 0 0 2024-09-21T00:57:07.483 INFO:tasks.workunit.client.0.smithi112.stdout:1/823: mkdir d5/d8/dd/d8e/de6/d111 0 2024-09-21T00:57:07.485 INFO:tasks.workunit.client.0.smithi112.stdout:1/824: fsync d5/d34/fc1 0 2024-09-21T00:57:07.489 INFO:tasks.workunit.client.0.smithi112.stdout:1/825: dread d5/d8/dd/d54/fea [0,4194304] 0 2024-09-21T00:57:07.496 INFO:tasks.workunit.client.0.smithi112.stdout:4/921: dread d1/d5/d1c/d1e/d4a/d5f/feb [0,4194304] 0 2024-09-21T00:57:07.497 INFO:tasks.workunit.client.0.smithi112.stdout:1/826: write d5/d8/dd/d97/f5b [611600,91300] 0 2024-09-21T00:57:07.509 INFO:tasks.workunit.client.0.smithi112.stdout:4/922: dread d1/d2d/d34/fa2 [0,4194304] 0 2024-09-21T00:57:07.511 INFO:tasks.workunit.client.0.smithi112.stdout:4/923: chown d1/d7/d9/d1a/d22/d6e/fab 5494 1 2024-09-21T00:57:07.544 INFO:tasks.workunit.client.0.smithi112.stdout:2/906: sync 2024-09-21T00:57:07.561 INFO:tasks.workunit.client.0.smithi112.stdout:1/827: mknod d5/d8/c112 0 2024-09-21T00:57:07.561 INFO:tasks.workunit.client.0.smithi112.stdout:4/924: symlink d1/d5/d1c/d1e/daf/l130 0 2024-09-21T00:57:07.563 INFO:tasks.workunit.client.0.smithi112.stdout:2/907: rename d0/d14/d8/d27/d7a/l9f to d0/d45/d8a/d62/l128 0 2024-09-21T00:57:07.565 INFO:tasks.workunit.client.0.smithi112.stdout:1/828: fsync d5/d8/dd/d54/d5a/fc3 0 2024-09-21T00:57:07.568 INFO:tasks.workunit.client.0.smithi112.stdout:2/908: rename d0/d14/d47/ca0 to d0/df/d46/d97/dfa/c129 0 2024-09-21T00:57:07.575 INFO:tasks.workunit.client.0.smithi112.stdout:2/909: creat d0/d45/d8a/d83/def/f12a x:0 0 0 2024-09-21T00:57:07.576 INFO:tasks.workunit.client.0.smithi112.stdout:2/910: fdatasync d0/d14/d8/fb4 0 2024-09-21T00:57:07.578 INFO:tasks.workunit.client.0.smithi112.stdout:2/911: chown d0/d14/d22/c5f 17090 1 2024-09-21T00:57:07.579 INFO:tasks.workunit.client.0.smithi112.stdout:4/925: dwrite d1/d7/d9/fcb [0,4194304] 0 2024-09-21T00:57:07.580 INFO:tasks.workunit.client.0.smithi112.stdout:1/829: dread d5/d8/dd/d97/d46/d70/f71 [0,4194304] 0 2024-09-21T00:57:07.581 INFO:tasks.workunit.client.0.smithi112.stdout:1/830: stat d5/d3a/fae 0 2024-09-21T00:57:07.584 INFO:tasks.workunit.client.0.smithi112.stdout:4/926: read d1/d7/df7/dc2/fda [1685927,41415] 0 2024-09-21T00:57:07.585 INFO:tasks.workunit.client.0.smithi112.stdout:4/927: readlink d1/d7/d30/l36 0 2024-09-21T00:57:07.587 INFO:tasks.workunit.client.0.smithi112.stdout:1/831: mknod d5/d8/dd/d8e/de6/c113 0 2024-09-21T00:57:07.588 INFO:tasks.workunit.client.0.smithi112.stdout:4/928: unlink d1/d5/d1c/d6c/fae 0 2024-09-21T00:57:07.589 INFO:tasks.workunit.client.0.smithi112.stdout:4/929: dread - d1/d5/d1c/d1e/d3d/d99/f10f zero size 2024-09-21T00:57:07.591 INFO:tasks.workunit.client.0.smithi112.stdout:4/930: dread d1/d5/d1c/d1e/f113 [0,4194304] 0 2024-09-21T00:57:07.592 INFO:tasks.workunit.client.0.smithi112.stdout:4/931: truncate d1/d2d/f50 4701185 0 2024-09-21T00:57:07.594 INFO:tasks.workunit.client.0.smithi112.stdout:1/832: write d5/d8/dd/d97/d46/d70/f73 [949333,30272] 0 2024-09-21T00:57:07.598 INFO:tasks.workunit.client.0.smithi112.stdout:4/932: truncate d1/d7/d9/d1a/d22/fc7 672422 0 2024-09-21T00:57:07.598 INFO:tasks.workunit.client.0.smithi112.stdout:2/912: dread d0/d14/f32 [0,4194304] 0 2024-09-21T00:57:07.601 INFO:tasks.workunit.client.0.smithi112.stdout:2/913: mkdir d0/d45/d12b 0 2024-09-21T00:57:07.604 INFO:tasks.workunit.client.0.smithi112.stdout:4/933: chown d1/d7/d9/d1a/f9a 1282 1 2024-09-21T00:57:07.605 INFO:tasks.workunit.client.0.smithi112.stdout:2/914: dread d0/d14/d47/f9c [0,4194304] 0 2024-09-21T00:57:07.605 INFO:tasks.workunit.client.0.smithi112.stdout:4/934: fsync d1/d5/d1c/db3/f10d 0 2024-09-21T00:57:07.608 INFO:tasks.workunit.client.0.smithi112.stdout:1/833: truncate d5/d8/dd/d97/d46/d70/f73 267247 0 2024-09-21T00:57:07.609 INFO:tasks.workunit.client.0.smithi112.stdout:4/935: symlink d1/d7/d9/d1a/d22/l131 0 2024-09-21T00:57:07.609 INFO:tasks.workunit.client.0.smithi112.stdout:1/834: readlink d5/d8/dd/d97/d46/d70/lc4 0 2024-09-21T00:57:07.610 INFO:tasks.workunit.client.0.smithi112.stdout:4/936: chown d1/d7/l57 13201 1 2024-09-21T00:57:07.615 INFO:tasks.workunit.client.0.smithi112.stdout:4/937: mknod d1/d7/c132 0 2024-09-21T00:57:07.616 INFO:tasks.workunit.client.0.smithi112.stdout:2/915: write d0/d14/d8/d27/d63/fd4 [575847,76495] 0 2024-09-21T00:57:07.619 INFO:tasks.workunit.client.0.smithi112.stdout:2/916: symlink d0/d45/d8a/d83/l12c 0 2024-09-21T00:57:07.620 INFO:tasks.workunit.client.0.smithi112.stdout:1/835: rename d5/d8/dd/d54/d5a/fc3 to d5/d8/dd/f114 0 2024-09-21T00:57:07.621 INFO:tasks.workunit.client.0.smithi112.stdout:1/836: readlink d5/l8b 0 2024-09-21T00:57:07.622 INFO:tasks.workunit.client.0.smithi112.stdout:4/938: write d1/d5/d1c/d1e/d4a/d5f/d83/fd8 [565525,23758] 0 2024-09-21T00:57:07.623 INFO:tasks.workunit.client.0.smithi112.stdout:4/939: chown d1/d5/d1c/db3/f10d 223814661 1 2024-09-21T00:57:07.625 INFO:tasks.workunit.client.0.smithi112.stdout:2/917: creat d0/d45/d12b/f12d x:0 0 0 2024-09-21T00:57:07.625 INFO:tasks.workunit.client.0.smithi112.stdout:4/940: dread - d1/d5/d1c/d1e/d76/d103/f12f zero size 2024-09-21T00:57:07.627 INFO:tasks.workunit.client.0.smithi112.stdout:7/905: sync 2024-09-21T00:57:07.627 INFO:tasks.workunit.client.0.smithi112.stdout:5/741: sync 2024-09-21T00:57:07.628 INFO:tasks.workunit.client.0.smithi112.stdout:5/742: chown d8/d9/d13/d1c/f91 117556465 1 2024-09-21T00:57:07.629 INFO:tasks.workunit.client.0.smithi112.stdout:7/906: fsync d0/d2/d2e/df6/d39/d56/d65/d87/fc8 0 2024-09-21T00:57:07.630 INFO:tasks.workunit.client.0.smithi112.stdout:2/918: mknod d0/db1/c12e 0 2024-09-21T00:57:07.633 INFO:tasks.workunit.client.0.smithi112.stdout:5/743: write d8/d9/d13/d2a/df/fbb [152941,29672] 0 2024-09-21T00:57:07.634 INFO:tasks.workunit.client.0.smithi112.stdout:7/907: write d0/d2/d2e/df6/d39/d1a/f127 [93574,11457] 0 2024-09-21T00:57:07.636 INFO:tasks.workunit.client.0.smithi112.stdout:4/941: getdents d1/d7/d30 0 2024-09-21T00:57:07.637 INFO:tasks.workunit.client.0.smithi112.stdout:2/919: mknod d0/d14/d8/d27/d63/c12f 0 2024-09-21T00:57:07.638 INFO:tasks.workunit.client.0.smithi112.stdout:1/837: dwrite d5/d34/f72 [0,4194304] 0 2024-09-21T00:57:07.638 INFO:tasks.workunit.client.0.smithi112.stdout:7/908: chown d0/d2/d2e/df6/d39/d56/d65/ca7 1797335 1 2024-09-21T00:57:07.642 INFO:tasks.workunit.client.0.smithi112.stdout:2/920: fsync d0/d14/d47/fe6 0 2024-09-21T00:57:07.643 INFO:tasks.workunit.client.0.smithi112.stdout:7/909: fsync d0/f95 0 2024-09-21T00:57:07.646 INFO:tasks.workunit.client.0.smithi112.stdout:4/942: creat d1/d5/d1c/d1e/d76/d11b/f133 x:0 0 0 2024-09-21T00:57:07.648 INFO:tasks.workunit.client.0.smithi112.stdout:5/744: unlink d8/d9/d13/f39 0 2024-09-21T00:57:07.652 INFO:tasks.workunit.client.0.smithi112.stdout:2/921: mkdir d0/db1/d130 0 2024-09-21T00:57:07.656 INFO:tasks.workunit.client.0.smithi112.stdout:4/943: fsync d1/d5/d1c/d1e/f113 0 2024-09-21T00:57:07.657 INFO:tasks.workunit.client.0.smithi112.stdout:2/922: stat d0/d14/f9 0 2024-09-21T00:57:07.658 INFO:tasks.workunit.client.0.smithi112.stdout:1/838: write d5/d68/f9f [49118,41435] 0 2024-09-21T00:57:07.660 INFO:tasks.workunit.client.0.smithi112.stdout:5/745: dwrite d8/d9/d13/d1c/d99/f89 [0,4194304] 0 2024-09-21T00:57:07.673 INFO:tasks.workunit.client.0.smithi112.stdout:2/923: symlink d0/d45/d8a/d62/dcf/l131 0 2024-09-21T00:57:07.674 INFO:tasks.workunit.client.0.smithi112.stdout:1/839: mkdir d5/d8/dd/d97/d46/d70/d115 0 2024-09-21T00:57:07.676 INFO:tasks.workunit.client.0.smithi112.stdout:4/944: rename d1/d5/d1c/d1e/d3d/db9/fd0 to d1/d5/d1c/d1e/d4a/d5f/d83/d11f/f134 0 2024-09-21T00:57:07.676 INFO:tasks.workunit.client.0.smithi112.stdout:7/910: link d0/d2/d2e/df6/d39/d1a/f44 d0/d2/d2e/df6/d39/db3/d10e/f128 0 2024-09-21T00:57:07.678 INFO:tasks.workunit.client.0.smithi112.stdout:1/840: creat d5/d68/f116 x:0 0 0 2024-09-21T00:57:07.680 INFO:tasks.workunit.client.0.smithi112.stdout:1/841: truncate d5/d8/d13/ffd 125163 0 2024-09-21T00:57:07.680 INFO:tasks.workunit.client.0.smithi112.stdout:4/945: creat d1/d2d/d34/f135 x:0 0 0 2024-09-21T00:57:07.680 INFO:tasks.workunit.client.0.smithi112.stdout:7/911: dread d0/d2/d32/f54 [0,4194304] 0 2024-09-21T00:57:07.681 INFO:tasks.workunit.client.0.smithi112.stdout:2/924: creat d0/df/d46/d58/df5/f132 x:0 0 0 2024-09-21T00:57:07.682 INFO:tasks.workunit.client.0.smithi112.stdout:2/925: dread - d0/d14/f104 zero size 2024-09-21T00:57:07.682 INFO:tasks.workunit.client.0.smithi112.stdout:4/946: read d1/fa6 [3675638,103096] 0 2024-09-21T00:57:07.685 INFO:tasks.workunit.client.0.smithi112.stdout:1/842: creat d5/d8/dd/d8e/de6/f117 x:0 0 0 2024-09-21T00:57:07.687 INFO:tasks.workunit.client.0.smithi112.stdout:7/912: creat d0/d2/d38/d48/f129 x:0 0 0 2024-09-21T00:57:07.690 INFO:tasks.workunit.client.0.smithi112.stdout:5/746: rename d8/d9/d13/d1c/d99/c70 to d8/d9/cf1 0 2024-09-21T00:57:07.692 INFO:tasks.workunit.client.0.smithi112.stdout:4/947: creat d1/d5/d1c/d1e/d76/d103/f136 x:0 0 0 2024-09-21T00:57:07.693 INFO:tasks.workunit.client.0.smithi112.stdout:7/913: dwrite d0/d2/d2e/df6/d39/d56/d86/f101 [0,4194304] 0 2024-09-21T00:57:07.695 INFO:tasks.workunit.client.0.smithi112.stdout:2/926: rmdir d0/d45/d8a 39 2024-09-21T00:57:07.697 INFO:tasks.workunit.client.0.smithi112.stdout:5/747: rename d8/d9/f27 to d8/d9/d13/d2a/d84/d8b/dda/dea/ff2 0 2024-09-21T00:57:07.698 INFO:tasks.workunit.client.0.smithi112.stdout:7/914: stat d0/d2/d2e/dcf/c2d 0 2024-09-21T00:57:07.699 INFO:tasks.workunit.client.0.smithi112.stdout:7/915: write d0/d2/d32/da4/df9/f121 [742672,29196] 0 2024-09-21T00:57:07.700 INFO:tasks.workunit.client.0.smithi112.stdout:4/948: symlink d1/d5/d1c/d1e/l137 0 2024-09-21T00:57:07.701 INFO:tasks.workunit.client.0.smithi112.stdout:5/748: creat d8/d9/d13/d1c/d99/ff3 x:0 0 0 2024-09-21T00:57:07.702 INFO:tasks.workunit.client.0.smithi112.stdout:6/897: sync 2024-09-21T00:57:07.702 INFO:tasks.workunit.client.0.smithi112.stdout:5/749: chown d8/d9/d13/d2a/dab/caf 347 1 2024-09-21T00:57:07.704 INFO:tasks.workunit.client.0.smithi112.stdout:5/750: dread - d8/d9/f5d zero size 2024-09-21T00:57:07.704 INFO:tasks.workunit.client.0.smithi112.stdout:7/916: mkdir d0/d2/d32/d12a 0 2024-09-21T00:57:07.705 INFO:tasks.workunit.client.0.smithi112.stdout:4/949: mknod d1/d5/d1c/d1e/d3d/d99/c138 0 2024-09-21T00:57:07.705 INFO:tasks.workunit.client.0.smithi112.stdout:5/751: write d8/d9/d13/d2a/fd1 [1003875,93368] 0 2024-09-21T00:57:07.706 INFO:tasks.workunit.client.0.smithi112.stdout:2/927: link d0/f5 d0/d14/d8/d27/d7a/de3/f133 0 2024-09-21T00:57:07.707 INFO:tasks.workunit.client.0.smithi112.stdout:5/752: stat d8/d9/d13/d1c/d99/fd7 0 2024-09-21T00:57:07.710 INFO:tasks.workunit.client.0.smithi112.stdout:5/753: dread - d8/d9/d13/d2a/d84/d8b/fb8 zero size 2024-09-21T00:57:07.714 INFO:tasks.workunit.client.0.smithi112.stdout:5/754: dread - d8/d9/d13/d2a/d58/fc1 zero size 2024-09-21T00:57:07.717 INFO:tasks.workunit.client.0.smithi112.stdout:7/917: truncate d0/d2/d2e/df6/d39/d56/d65/d87/fc0 265122 0 2024-09-21T00:57:07.720 INFO:tasks.workunit.client.0.smithi112.stdout:6/898: link d9/lf7 d9/d1f/d3e/d6f/de4/l14d 0 2024-09-21T00:57:07.724 INFO:tasks.workunit.client.0.smithi112.stdout:5/755: write d8/d9/d13/d2a/df/fd6 [2491,105090] 0 2024-09-21T00:57:07.724 INFO:tasks.workunit.client.0.smithi112.stdout:7/918: symlink d0/d2/d2e/df6/d39/d56/d65/df4/l12b 0 2024-09-21T00:57:07.732 INFO:tasks.workunit.client.0.smithi112.stdout:5/756: fsync d8/d9/d13/d2a/d2c/f69 0 2024-09-21T00:57:07.733 INFO:tasks.workunit.client.0.smithi112.stdout:2/928: dread d0/d14/fb6 [0,4194304] 0 2024-09-21T00:57:07.734 INFO:tasks.workunit.client.0.smithi112.stdout:2/929: fdatasync d0/df/fb2 0 2024-09-21T00:57:07.734 INFO:tasks.workunit.client.0.smithi112.stdout:6/899: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/d128/df6/d147/d14e 0 2024-09-21T00:57:07.740 INFO:tasks.workunit.client.0.smithi112.stdout:5/757: mknod d8/d9/d13/d2a/da1/cf4 0 2024-09-21T00:57:07.743 INFO:tasks.workunit.client.0.smithi112.stdout:2/930: rename d0/d14/d22/d6d/f113 to d0/d14/d8/f134 0 2024-09-21T00:57:07.744 INFO:tasks.workunit.client.0.smithi112.stdout:2/931: readlink d0/d14/d8/l114 0 2024-09-21T00:57:07.744 INFO:tasks.workunit.client.0.smithi112.stdout:6/900: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/dea/l14f 0 2024-09-21T00:57:07.747 INFO:tasks.workunit.client.0.smithi112.stdout:5/758: rename d8/f1a to d8/d9/d13/d1c/d99/ff5 0 2024-09-21T00:57:07.750 INFO:tasks.workunit.client.0.smithi112.stdout:8/921: sync 2024-09-21T00:57:07.750 INFO:tasks.workunit.client.0.smithi112.stdout:0/873: sync 2024-09-21T00:57:07.752 INFO:tasks.workunit.client.0.smithi112.stdout:0/874: truncate d8/d75/d91/f10a 990091 0 2024-09-21T00:57:07.754 INFO:tasks.workunit.client.0.smithi112.stdout:0/875: write d8/d11/d28/f68 [2192838,115014] 0 2024-09-21T00:57:07.754 INFO:tasks.workunit.client.0.smithi112.stdout:8/922: creat d0/d13/dab/dc6/f126 x:0 0 0 2024-09-21T00:57:07.756 INFO:tasks.workunit.client.0.smithi112.stdout:7/919: write d0/d2/d38/d48/f103 [1173308,27653] 0 2024-09-21T00:57:07.759 INFO:tasks.workunit.client.0.smithi112.stdout:8/923: fsync d0/d13/d2a/f45 0 2024-09-21T00:57:07.760 INFO:tasks.workunit.client.0.smithi112.stdout:8/924: chown d0/fb 1971380 1 2024-09-21T00:57:07.761 INFO:tasks.workunit.client.0.smithi112.stdout:1/843: write d5/d3a/fb7 [526980,126788] 0 2024-09-21T00:57:07.761 INFO:tasks.workunit.client.0.smithi112.stdout:8/925: fdatasync d0/d13/d2a/fce 0 2024-09-21T00:57:07.764 INFO:tasks.workunit.client.0.smithi112.stdout:0/876: creat d8/d11/d28/dbf/dd3/dff/f110 x:0 0 0 2024-09-21T00:57:07.766 INFO:tasks.workunit.client.0.smithi112.stdout:0/877: dread d8/d1b/d2c/f34 [0,4194304] 0 2024-09-21T00:57:07.767 INFO:tasks.workunit.client.0.smithi112.stdout:0/878: fdatasync d8/d11/d28/dbf/ff7 0 2024-09-21T00:57:07.768 INFO:tasks.workunit.client.0.smithi112.stdout:1/844: dread - d5/d34/f88 zero size 2024-09-21T00:57:07.769 INFO:tasks.workunit.client.0.smithi112.stdout:8/926: mknod d0/d13/d1b/d22/d2e/d34/d7b/d80/c127 0 2024-09-21T00:57:07.769 INFO:tasks.workunit.client.0.smithi112.stdout:8/927: chown d0/d66/d88/c11a 5736743 1 2024-09-21T00:57:07.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/920: creat d0/d2/d2e/df6/d39/d56/f12c x:0 0 0 2024-09-21T00:57:07.771 INFO:tasks.workunit.client.0.smithi112.stdout:7/921: chown d0/d6e/fcd 3 1 2024-09-21T00:57:07.773 INFO:tasks.workunit.client.0.smithi112.stdout:0/879: creat d8/d11/d59/f111 x:0 0 0 2024-09-21T00:57:07.774 INFO:tasks.workunit.client.0.smithi112.stdout:1/845: fdatasync d5/d8/d10/fc2 0 2024-09-21T00:57:07.778 INFO:tasks.workunit.client.0.smithi112.stdout:4/950: dwrite d1/d5/d1c/d1e/d4a/d5f/db1/fca [0,4194304] 0 2024-09-21T00:57:07.778 INFO:tasks.workunit.client.0.smithi112.stdout:7/922: mknod d0/d2/d2e/df6/d39/d56/d86/ddd/c12d 0 2024-09-21T00:57:07.780 INFO:tasks.workunit.client.0.smithi112.stdout:0/880: fsync d8/d1b/d2c/d2e/d4c/d64/f8c 0 2024-09-21T00:57:07.790 INFO:tasks.workunit.client.0.smithi112.stdout:4/951: symlink d1/d7/d30/l139 0 2024-09-21T00:57:07.795 INFO:tasks.workunit.client.0.smithi112.stdout:6/901: write d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/fb5 [228980,123591] 0 2024-09-21T00:57:07.801 INFO:tasks.workunit.client.0.smithi112.stdout:2/932: dwrite d0/d45/d8a/d83/fbb [0,4194304] 0 2024-09-21T00:57:07.808 INFO:tasks.workunit.client.0.smithi112.stdout:2/933: rename d0/d45/d8a/d62/dcf/le7 to d0/d14/d22/d95/dd2/l135 0 2024-09-21T00:57:07.809 INFO:tasks.workunit.client.0.smithi112.stdout:2/934: chown d0/d45/d8a/f55 346943 1 2024-09-21T00:57:07.810 INFO:tasks.workunit.client.0.smithi112.stdout:8/928: truncate d0/d13/d1b/d22/f23 3901107 0 2024-09-21T00:57:07.814 INFO:tasks.workunit.client.0.smithi112.stdout:2/935: rename d0/df to d0/d14/d8/da2/daa/d136 0 2024-09-21T00:57:07.815 INFO:tasks.workunit.client.0.smithi112.stdout:2/936: readlink d0/d14/d8/da2/lb0 0 2024-09-21T00:57:07.816 INFO:tasks.workunit.client.0.smithi112.stdout:7/923: dwrite d0/d2/f7a [0,4194304] 0 2024-09-21T00:57:07.817 INFO:tasks.workunit.client.0.smithi112.stdout:0/881: write d8/f18 [8741590,94956] 0 2024-09-21T00:57:07.818 INFO:tasks.workunit.client.0.smithi112.stdout:1/846: write d5/d8/dd/d97/d46/fdf [696175,21489] 0 2024-09-21T00:57:07.819 INFO:tasks.workunit.client.0.smithi112.stdout:4/952: write d1/d5/d1c/db3/fbd [1224529,111917] 0 2024-09-21T00:57:07.823 INFO:tasks.workunit.client.0.smithi112.stdout:2/937: rename d0/d14/d8/f44 to d0/d14/d22/d95/d11d/f137 0 2024-09-21T00:57:07.825 INFO:tasks.workunit.client.0.smithi112.stdout:8/929: getdents d0/d13/dab 0 2024-09-21T00:57:07.827 INFO:tasks.workunit.client.0.smithi112.stdout:6/902: write d9/d1f/d47/d34/da6/fad [811341,8969] 0 2024-09-21T00:57:07.837 INFO:tasks.workunit.client.0.smithi112.stdout:7/924: creat d0/d2/d2e/df6/d39/db3/d114/f12e x:0 0 0 2024-09-21T00:57:07.839 INFO:tasks.workunit.client.0.smithi112.stdout:0/882: creat d8/d11/d59/d78/dce/f112 x:0 0 0 2024-09-21T00:57:07.840 INFO:tasks.workunit.client.0.smithi112.stdout:4/953: write d1/d5/d1c/d1e/fa7 [577391,43529] 0 2024-09-21T00:57:07.841 INFO:tasks.workunit.client.0.smithi112.stdout:8/930: mkdir d0/d13/d9f/d128 0 2024-09-21T00:57:07.843 INFO:tasks.workunit.client.0.smithi112.stdout:6/903: write d9/d1f/d47/d34/f63 [1584181,13453] 0 2024-09-21T00:57:07.843 INFO:tasks.workunit.client.0.smithi112.stdout:0/883: fdatasync d8/d11/d28/dbf/dd3/dec/def/da3/db6/fd1 0 2024-09-21T00:57:07.846 INFO:tasks.workunit.client.0.smithi112.stdout:1/847: dwrite d5/f74 [0,4194304] 0 2024-09-21T00:57:07.848 INFO:tasks.workunit.client.0.smithi112.stdout:8/931: mkdir d0/d13/d129 0 2024-09-21T00:57:07.849 INFO:tasks.workunit.client.0.smithi112.stdout:6/904: dread d9/d1f/d3e/d77/f71 [0,4194304] 0 2024-09-21T00:57:07.852 INFO:tasks.workunit.client.0.smithi112.stdout:4/954: unlink d1/d7/d9/d1a/d22/d6e/d10b/lc4 0 2024-09-21T00:57:07.852 INFO:tasks.workunit.client.0.smithi112.stdout:6/905: write d9/d1f/d47/d34/da6/da7/dcf/d31/f68 [1181353,96835] 0 2024-09-21T00:57:07.854 INFO:tasks.workunit.client.0.smithi112.stdout:4/955: write d1/d7/d9/d1a/d8e/f100 [405923,92367] 0 2024-09-21T00:57:07.856 INFO:tasks.workunit.client.0.smithi112.stdout:2/938: getdents d0/d45/d8a/d62/dcf/d109 0 2024-09-21T00:57:07.857 INFO:tasks.workunit.client.0.smithi112.stdout:8/932: fsync d0/d66/f40 0 2024-09-21T00:57:07.865 INFO:tasks.workunit.client.0.smithi112.stdout:4/956: dread - d1/d5/d1c/d1e/fb2 zero size 2024-09-21T00:57:07.866 INFO:tasks.workunit.client.0.smithi112.stdout:1/848: creat d5/d3a/d4b/dbc/f118 x:0 0 0 2024-09-21T00:57:07.867 INFO:tasks.workunit.client.0.smithi112.stdout:1/849: chown d5/d34/d6a/d7f/cf7 1089065749 1 2024-09-21T00:57:07.868 INFO:tasks.workunit.client.0.smithi112.stdout:1/850: stat d5/f74 0 2024-09-21T00:57:07.869 INFO:tasks.workunit.client.0.smithi112.stdout:2/939: truncate d0/f53 502724 0 2024-09-21T00:57:07.872 INFO:tasks.workunit.client.0.smithi112.stdout:8/933: mkdir d0/d13/d1b/d22/d2e/d34/d7b/d12a 0 2024-09-21T00:57:07.872 INFO:tasks.workunit.client.0.smithi112.stdout:2/940: chown d0/d14/d8/da2/daa/d136/d46/d58/d127 74 1 2024-09-21T00:57:07.874 INFO:tasks.workunit.client.0.smithi112.stdout:7/925: getdents d0/d2/d2e/df6/d39/d56/d86 0 2024-09-21T00:57:07.876 INFO:tasks.workunit.client.0.smithi112.stdout:8/934: rmdir d0/d66/d88 39 2024-09-21T00:57:07.877 INFO:tasks.workunit.client.0.smithi112.stdout:2/941: write d0/f3c [4083017,128148] 0 2024-09-21T00:57:07.879 INFO:tasks.workunit.client.0.smithi112.stdout:1/851: dwrite d5/d8/dd/d97/d46/fac [0,4194304] 0 2024-09-21T00:57:07.880 INFO:tasks.workunit.client.0.smithi112.stdout:8/935: readlink d0/d13/d1b/ld5 0 2024-09-21T00:57:07.883 INFO:tasks.workunit.client.0.smithi112.stdout:0/884: dwrite d8/d1b/d2c/d2e/d4c/fe9 [0,4194304] 0 2024-09-21T00:57:07.886 INFO:tasks.workunit.client.0.smithi112.stdout:7/926: truncate d0/d2/d2e/f58 922579 0 2024-09-21T00:57:07.888 INFO:tasks.workunit.client.0.smithi112.stdout:6/906: dwrite d9/d1f/d47/d34/da6/da7/dcf/d60/d137/f92 [4194304,4194304] 0 2024-09-21T00:57:07.891 INFO:tasks.workunit.client.0.smithi112.stdout:1/852: fsync d5/d8/dd/d97/d46/d70/f84 0 2024-09-21T00:57:07.894 INFO:tasks.workunit.client.0.smithi112.stdout:8/936: truncate d0/d13/f29 2326347 0 2024-09-21T00:57:07.895 INFO:tasks.workunit.client.0.smithi112.stdout:7/927: chown d0/d2/d32/c111 2 1 2024-09-21T00:57:07.895 INFO:tasks.workunit.client.0.smithi112.stdout:7/928: stat d0/d2/d2e/df6/f90 0 2024-09-21T00:57:07.896 INFO:tasks.workunit.client.0.smithi112.stdout:7/929: stat d0/d2/d2e/df6/d39/d56/d65/fb1 0 2024-09-21T00:57:07.902 INFO:tasks.workunit.client.0.smithi112.stdout:0/885: symlink d8/d1b/d2c/d2e/d4c/da8/l113 0 2024-09-21T00:57:07.904 INFO:tasks.workunit.client.0.smithi112.stdout:0/886: stat d8/d11/d28/dbf/dd3/dec/def/da3/db6/fdf 0 2024-09-21T00:57:07.908 INFO:tasks.workunit.client.0.smithi112.stdout:0/887: read d8/f5e [2829733,30962] 0 2024-09-21T00:57:07.911 INFO:tasks.workunit.client.0.smithi112.stdout:1/853: creat d5/d8/dd/d8e/de6/d111/f119 x:0 0 0 2024-09-21T00:57:07.912 INFO:tasks.workunit.client.0.smithi112.stdout:2/942: dwrite d0/d45/d8a/d62/f8d [0,4194304] 0 2024-09-21T00:57:07.914 INFO:tasks.workunit.client.0.smithi112.stdout:6/907: dread d9/d1f/d47/d74/d8b/daa/dd4/d113/f13d [0,4194304] 0 2024-09-21T00:57:07.916 INFO:tasks.workunit.client.0.smithi112.stdout:0/888: rename d8/d62/f103 to d8/d62/d9d/f114 0 2024-09-21T00:57:07.919 INFO:tasks.workunit.client.0.smithi112.stdout:2/943: creat d0/d45/d8a/d83/def/f138 x:0 0 0 2024-09-21T00:57:07.927 INFO:tasks.workunit.client.0.smithi112.stdout:6/908: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d131/l150 0 2024-09-21T00:57:07.931 INFO:tasks.workunit.client.0.smithi112.stdout:1/854: link d5/d34/d6a/ca4 d5/d34/de4/c11a 0 2024-09-21T00:57:07.932 INFO:tasks.workunit.client.0.smithi112.stdout:7/930: dread d0/f95 [0,4194304] 0 2024-09-21T00:57:07.933 INFO:tasks.workunit.client.0.smithi112.stdout:2/944: mknod d0/d14/d8/da2/daa/d136/d46/d58/d127/c139 0 2024-09-21T00:57:07.935 INFO:tasks.workunit.client.0.smithi112.stdout:6/909: mkdir d9/d1f/d3e/d77/d79/d151 0 2024-09-21T00:57:07.937 INFO:tasks.workunit.client.0.smithi112.stdout:0/889: link d8/d1b/d2c/d2e/d4c/d6b/fc3 d8/d11/d28/dbf/dd3/f115 0 2024-09-21T00:57:07.939 INFO:tasks.workunit.client.0.smithi112.stdout:0/890: write d8/fd [4128223,20726] 0 2024-09-21T00:57:07.939 INFO:tasks.workunit.client.0.smithi112.stdout:8/937: dwrite d0/d13/d2a/d73/d96/fdb [0,4194304] 0 2024-09-21T00:57:07.942 INFO:tasks.workunit.client.0.smithi112.stdout:7/931: symlink d0/d2/d32/l12f 0 2024-09-21T00:57:07.948 INFO:tasks.workunit.client.0.smithi112.stdout:8/938: creat d0/d13/d9f/dc2/f12b x:0 0 0 2024-09-21T00:57:07.951 INFO:tasks.workunit.client.0.smithi112.stdout:0/891: mkdir d8/d75/d91/d9b/d116 0 2024-09-21T00:57:07.955 INFO:tasks.workunit.client.0.smithi112.stdout:6/910: creat d9/d1f/d47/d74/d8e/d138/ddd/f152 x:0 0 0 2024-09-21T00:57:07.956 INFO:tasks.workunit.client.0.smithi112.stdout:6/911: chown d9/d1f/d47/d34/da6/da7/dcf/d31/d41/d9e/cfa 24 1 2024-09-21T00:57:07.958 INFO:tasks.workunit.client.0.smithi112.stdout:8/939: truncate d0/d13/dab/dc6/d100/f9e 1242025 0 2024-09-21T00:57:07.963 INFO:tasks.workunit.client.0.smithi112.stdout:0/892: rename d8/d62/d9d/f114 to d8/d11/d28/dbf/dd3/dec/def/da3/db6/f117 0 2024-09-21T00:57:07.964 INFO:tasks.workunit.client.0.smithi112.stdout:7/932: creat d0/d2/d2e/df6/de4/d126/f130 x:0 0 0 2024-09-21T00:57:07.966 INFO:tasks.workunit.client.0.smithi112.stdout:8/940: truncate d0/d13/dab/fc7 83858 0 2024-09-21T00:57:07.967 INFO:tasks.workunit.client.0.smithi112.stdout:2/945: dwrite d0/d14/d8/da2/dba/dc1/d11e/ff1 [0,4194304] 0 2024-09-21T00:57:07.968 INFO:tasks.workunit.client.0.smithi112.stdout:2/946: readlink d0/d60/d78/l81 0 2024-09-21T00:57:07.968 INFO:tasks.workunit.client.0.smithi112.stdout:1/855: link d5/d8/dd/dcc/l5f d5/d8/dd/d97/dd2/l11b 0 2024-09-21T00:57:07.971 INFO:tasks.workunit.client.0.smithi112.stdout:1/856: truncate d5/d8/dd/d8e/de6/d111/f119 484399 0 2024-09-21T00:57:07.973 INFO:tasks.workunit.client.0.smithi112.stdout:6/912: creat d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/d112/f153 x:0 0 0 2024-09-21T00:57:07.976 INFO:tasks.workunit.client.0.smithi112.stdout:0/893: write d8/d11/d28/dbf/dd3/dec/def/da3/db6/f117 [951714,67727] 0 2024-09-21T00:57:07.981 INFO:tasks.workunit.client.0.smithi112.stdout:1/857: symlink d5/d8/dd/d8e/de6/d111/l11c 0 2024-09-21T00:57:07.983 INFO:tasks.workunit.client.0.smithi112.stdout:7/933: mknod d0/d2/d2e/c131 0 2024-09-21T00:57:07.985 INFO:tasks.workunit.client.0.smithi112.stdout:6/913: symlink d9/d1f/d3e/d6f/l154 0 2024-09-21T00:57:07.986 INFO:tasks.workunit.client.0.smithi112.stdout:6/914: stat d9/d1f/d47/d34/f36 0 2024-09-21T00:57:07.986 INFO:tasks.workunit.client.0.smithi112.stdout:1/858: dread d5/d8/d10/fc2 [0,4194304] 0 2024-09-21T00:57:07.993 INFO:tasks.workunit.client.0.smithi112.stdout:7/934: creat d0/d2/d2e/df6/d39/d56/d86/ddd/f132 x:0 0 0 2024-09-21T00:57:07.994 INFO:tasks.workunit.client.0.smithi112.stdout:1/859: fdatasync d5/d8/d13/d87/faa 0 2024-09-21T00:57:07.995 INFO:tasks.workunit.client.0.smithi112.stdout:6/915: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/d155 0 2024-09-21T00:57:07.998 INFO:tasks.workunit.client.0.smithi112.stdout:2/947: dwrite d0/d14/d8/da2/daa/d136/f79 [0,4194304] 0 2024-09-21T00:57:08.008 INFO:tasks.workunit.client.0.smithi112.stdout:0/894: truncate d8/d11/f81 3629759 0 2024-09-21T00:57:08.016 INFO:tasks.workunit.client.0.smithi112.stdout:0/895: dwrite d8/d11/d28/dbf/dd3/dd7/fc1 [0,4194304] 0 2024-09-21T00:57:08.017 INFO:tasks.workunit.client.0.smithi112.stdout:7/935: rename d0/d2/d32/c111 to d0/d2/d2e/df6/d39/db3/c133 0 2024-09-21T00:57:08.017 INFO:tasks.workunit.client.0.smithi112.stdout:0/896: readlink d8/d75/d91/d9b/ld9 0 2024-09-21T00:57:08.020 INFO:tasks.workunit.client.0.smithi112.stdout:6/916: mkdir d9/d1f/d3e/d9a/d156 0 2024-09-21T00:57:08.021 INFO:tasks.workunit.client.0.smithi112.stdout:0/897: read d8/d62/d9d/fba [199060,93306] 0 2024-09-21T00:57:08.022 INFO:tasks.workunit.client.0.smithi112.stdout:0/898: fsync d8/d1b/d2c/d2e/fb4 0 2024-09-21T00:57:08.022 INFO:tasks.workunit.client.0.smithi112.stdout:2/948: mkdir d0/d45/d8a/dd7/d13a 0 2024-09-21T00:57:08.026 INFO:tasks.workunit.client.0.smithi112.stdout:8/941: truncate d0/d13/d9f/dc2/fb4 273069 0 2024-09-21T00:57:08.037 INFO:tasks.workunit.client.0.smithi112.stdout:0/899: fdatasync d8/f5e 0 2024-09-21T00:57:08.042 INFO:tasks.workunit.client.0.smithi112.stdout:2/949: fsync d0/d60/fb7 0 2024-09-21T00:57:08.044 INFO:tasks.workunit.client.0.smithi112.stdout:5/759: sync 2024-09-21T00:57:08.046 INFO:tasks.workunit.client.0.smithi112.stdout:8/942: read d0/f1a [2030519,42939] 0 2024-09-21T00:57:08.046 INFO:tasks.workunit.client.0.smithi112.stdout:6/917: dread d9/df/d56/f135 [0,4194304] 0 2024-09-21T00:57:08.046 INFO:tasks.workunit.client.0.smithi112.stdout:7/936: truncate d0/d2/f68 478054 0 2024-09-21T00:57:08.047 INFO:tasks.workunit.client.0.smithi112.stdout:0/900: dwrite d8/d11/d28/dbf/dd3/dec/ff9 [0,4194304] 0 2024-09-21T00:57:08.048 INFO:tasks.workunit.client.0.smithi112.stdout:8/943: stat d0/d13/dab/dc6/d100/f76 0 2024-09-21T00:57:08.049 INFO:tasks.workunit.client.0.smithi112.stdout:7/937: chown d0/d2/f7a 0 1 2024-09-21T00:57:08.054 INFO:tasks.workunit.client.0.smithi112.stdout:7/938: write d0/d2/f64 [1149536,26464] 0 2024-09-21T00:57:08.058 INFO:tasks.workunit.client.0.smithi112.stdout:2/950: creat d0/d45/d8a/d99/f13b x:0 0 0 2024-09-21T00:57:08.061 INFO:tasks.workunit.client.0.smithi112.stdout:8/944: dwrite d0/d13/d1b/d22/d2e/d34/d7b/d80/ded/ff3 [0,4194304] 0 2024-09-21T00:57:08.065 INFO:tasks.workunit.client.0.smithi112.stdout:0/901: creat d8/d11/d28/dbf/dd3/dec/f118 x:0 0 0 2024-09-21T00:57:08.065 INFO:tasks.workunit.client.0.smithi112.stdout:1/860: write d5/d8/dd/dcc/f6e [2721242,48714] 0 2024-09-21T00:57:08.066 INFO:tasks.workunit.client.0.smithi112.stdout:0/902: write d8/f5e [2405885,112459] 0 2024-09-21T00:57:08.075 INFO:tasks.workunit.client.0.smithi112.stdout:2/951: creat d0/d45/d8a/d62/dcf/dfb/f13c x:0 0 0 2024-09-21T00:57:08.079 INFO:tasks.workunit.client.0.smithi112.stdout:0/903: rmdir d8/d11/d28/dbf/dd3/dec/def 39 2024-09-21T00:57:08.080 INFO:tasks.workunit.client.0.smithi112.stdout:5/760: dwrite d8/d9/d13/d2a/d2c/d96/d9f/fd4 [0,4194304] 0 2024-09-21T00:57:08.084 INFO:tasks.workunit.client.0.smithi112.stdout:8/945: mknod d0/d66/d88/c12c 0 2024-09-21T00:57:08.087 INFO:tasks.workunit.client.0.smithi112.stdout:4/957: sync 2024-09-21T00:57:08.089 INFO:tasks.workunit.client.0.smithi112.stdout:4/958: dread - d1/d2d/d34/f135 zero size 2024-09-21T00:57:08.091 INFO:tasks.workunit.client.0.smithi112.stdout:0/904: fdatasync d8/d1b/d2c/d2e/d4c/d64/fb5 0 2024-09-21T00:57:08.093 INFO:tasks.workunit.client.0.smithi112.stdout:8/946: dwrite d0/d13/d1b/d22/d2e/fc0 [4194304,4194304] 0 2024-09-21T00:57:08.102 INFO:tasks.workunit.client.0.smithi112.stdout:0/905: mknod d8/d75/d9c/c119 0 2024-09-21T00:57:08.103 INFO:tasks.workunit.client.0.smithi112.stdout:0/906: fdatasync d8/f3c 0 2024-09-21T00:57:08.104 INFO:tasks.workunit.client.0.smithi112.stdout:2/952: rename d0/d14/d8/f8c to d0/d14/f13d 0 2024-09-21T00:57:08.105 INFO:tasks.workunit.client.0.smithi112.stdout:2/953: write d0/d14/d8/d27/d7a/ffd [1051924,109368] 0 2024-09-21T00:57:08.107 INFO:tasks.workunit.client.0.smithi112.stdout:6/918: link d9/d1f/d47/d34/da6/da7/dcf/d31/l11e d9/d1f/d47/d34/da6/da7/dcf/d21/d4c/l157 0 2024-09-21T00:57:08.108 INFO:tasks.workunit.client.0.smithi112.stdout:1/861: getdents d5/d8/dd/d97/dd2/d10a 0 2024-09-21T00:57:08.113 INFO:tasks.workunit.client.0.smithi112.stdout:4/959: rename d1/d2d/d34 to d1/d5/d1c/db3/d12c/d13a 0 2024-09-21T00:57:08.114 INFO:tasks.workunit.client.0.smithi112.stdout:4/960: readlink d1/d5/d1c/d1e/d3d/db9/lbe 0 2024-09-21T00:57:08.115 INFO:tasks.workunit.client.0.smithi112.stdout:2/954: readlink d0/d14/d8/l23 0 2024-09-21T00:57:08.115 INFO:tasks.workunit.client.0.smithi112.stdout:2/955: read d0/d14/fb6 [1021228,45589] 0 2024-09-21T00:57:08.116 INFO:tasks.workunit.client.0.smithi112.stdout:5/761: getdents d8/d9/d13/d2a/df/db5 0 2024-09-21T00:57:08.117 INFO:tasks.workunit.client.0.smithi112.stdout:7/939: write d0/d2/d2e/df6/d39/d1a/da5/fb0 [719970,119715] 0 2024-09-21T00:57:08.120 INFO:tasks.workunit.client.0.smithi112.stdout:6/919: rename d9/d1f/d47/d34/da6/da7/f76 to d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d131/f158 0 2024-09-21T00:57:08.159 INFO:tasks.workunit.client.0.smithi112.stdout:2/956: rename d0/fe to d0/d14/d22/d6d/f13e 0 2024-09-21T00:57:08.161 INFO:tasks.workunit.client.0.smithi112.stdout:0/907: write d8/d1b/d2c/d2e/d4c/d64/fb5 [488416,128603] 0 2024-09-21T00:57:08.163 INFO:tasks.workunit.client.0.smithi112.stdout:7/940: dwrite d0/d2/f7a [4194304,4194304] 0 2024-09-21T00:57:08.164 INFO:tasks.workunit.client.0.smithi112.stdout:8/947: write d0/d13/dab/dc6/d100/fd9 [958141,130524] 0 2024-09-21T00:57:08.169 INFO:tasks.workunit.client.0.smithi112.stdout:6/920: chown d9/d1f/d47/d34/da6/da7/dcf/d60/d13e 270023 1 2024-09-21T00:57:08.174 INFO:tasks.workunit.client.0.smithi112.stdout:0/908: write d8/d1b/d2c/d2e/d4c/f80 [2053824,116443] 0 2024-09-21T00:57:08.174 INFO:tasks.workunit.client.0.smithi112.stdout:8/948: write d0/d13/d1b/d22/d42/ffd [696016,88702] 0 2024-09-21T00:57:08.175 INFO:tasks.workunit.client.0.smithi112.stdout:2/957: stat d0/d14/d8/da2/daa/d136/d46/d97/dcd/cfc 0 2024-09-21T00:57:08.176 INFO:tasks.workunit.client.0.smithi112.stdout:1/862: dwrite d5/d8/dd/dcc/fb1 [0,4194304] 0 2024-09-21T00:57:08.179 INFO:tasks.workunit.client.0.smithi112.stdout:1/863: dread - d5/d8/dd/d97/d46/f103 zero size 2024-09-21T00:57:08.181 INFO:tasks.workunit.client.0.smithi112.stdout:5/762: dread d8/d9/d13/d2a/d84/d8b/f50 [0,4194304] 0 2024-09-21T00:57:08.182 INFO:tasks.workunit.client.0.smithi112.stdout:6/921: creat d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/f159 x:0 0 0 2024-09-21T00:57:08.184 INFO:tasks.workunit.client.0.smithi112.stdout:2/958: mkdir d0/d14/d8/d27/d63/df0/d13f 0 2024-09-21T00:57:08.187 INFO:tasks.workunit.client.0.smithi112.stdout:1/864: mknod d5/d8/dd/d8e/de6/dfc/c11d 0 2024-09-21T00:57:08.188 INFO:tasks.workunit.client.0.smithi112.stdout:7/941: write d0/d2/d2e/f58 [1270502,51620] 0 2024-09-21T00:57:08.190 INFO:tasks.workunit.client.0.smithi112.stdout:2/959: dread d0/d60/fab [0,4194304] 0 2024-09-21T00:57:08.190 INFO:tasks.workunit.client.0.smithi112.stdout:7/942: read d0/d2/f7a [3695379,55560] 0 2024-09-21T00:57:08.191 INFO:tasks.workunit.client.0.smithi112.stdout:0/909: write d8/d5f/f73 [999162,30981] 0 2024-09-21T00:57:08.194 INFO:tasks.workunit.client.0.smithi112.stdout:5/763: unlink d8/c20 0 2024-09-21T00:57:08.194 INFO:tasks.workunit.client.0.smithi112.stdout:1/865: rmdir d5/d8/dd/d97/d46/d70 39 2024-09-21T00:57:08.198 INFO:tasks.workunit.client.0.smithi112.stdout:6/922: symlink d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d11f/d144/l15a 0 2024-09-21T00:57:08.199 INFO:tasks.workunit.client.0.smithi112.stdout:8/949: truncate d0/f3c 1574565 0 2024-09-21T00:57:08.202 INFO:tasks.workunit.client.0.smithi112.stdout:0/910: readlink d8/d11/d28/dbf/dd3/dec/def/la0 0 2024-09-21T00:57:08.202 INFO:tasks.workunit.client.0.smithi112.stdout:0/911: chown d8/d1b/fdd 56 1 2024-09-21T00:57:08.202 INFO:tasks.workunit.client.0.smithi112.stdout:6/923: truncate d9/d1f/d47/d34/da6/da7/dcf/d31/d41/d9e/f140 516170 0 2024-09-21T00:57:08.205 INFO:tasks.workunit.client.0.smithi112.stdout:5/764: mkdir d8/d9/d13/d1c/dbc/df6 0 2024-09-21T00:57:08.207 INFO:tasks.workunit.client.0.smithi112.stdout:2/960: symlink d0/d14/l140 0 2024-09-21T00:57:08.209 INFO:tasks.workunit.client.0.smithi112.stdout:2/961: chown d0/d14/d8/d27/d63/df0/f11f 57694587 1 2024-09-21T00:57:08.210 INFO:tasks.workunit.client.0.smithi112.stdout:2/962: stat d0/d45/d8a/f123 0 2024-09-21T00:57:08.211 INFO:tasks.workunit.client.0.smithi112.stdout:1/866: creat d5/d8/da1/f11e x:0 0 0 2024-09-21T00:57:08.216 INFO:tasks.workunit.client.0.smithi112.stdout:5/765: symlink d8/d9/d13/d2a/d84/d8b/dda/lf7 0 2024-09-21T00:57:08.218 INFO:tasks.workunit.client.0.smithi112.stdout:0/912: dread d8/d11/d28/f4e [4194304,4194304] 0 2024-09-21T00:57:08.220 INFO:tasks.workunit.client.0.smithi112.stdout:0/913: dread - d8/d62/d9d/fab zero size 2024-09-21T00:57:08.220 INFO:tasks.workunit.client.0.smithi112.stdout:1/867: symlink d5/d8/dd/d8e/l11f 0 2024-09-21T00:57:08.222 INFO:tasks.workunit.client.0.smithi112.stdout:7/943: link d0/d2/d2e/df6/d39/d56/l120 d0/d2/d2e/df6/d39/d56/l134 0 2024-09-21T00:57:08.223 INFO:tasks.workunit.client.0.smithi112.stdout:6/924: write d9/d1f/d47/d34/da6/da7/dcf/d26/f8a [1664034,44926] 0 2024-09-21T00:57:08.225 INFO:tasks.workunit.client.0.smithi112.stdout:8/950: dwrite d0/d13/f29 [0,4194304] 0 2024-09-21T00:57:08.226 INFO:tasks.workunit.client.0.smithi112.stdout:5/766: creat d8/d9/d13/d2a/df/d5b/dbe/db6/ff8 x:0 0 0 2024-09-21T00:57:08.228 INFO:tasks.workunit.client.0.smithi112.stdout:0/914: rmdir d8/d1b/d2c/d2e 39 2024-09-21T00:57:08.230 INFO:tasks.workunit.client.0.smithi112.stdout:0/915: chown d8/d11/d28/dbf/dd3/dec/def/da3/db6/f105 440 1 2024-09-21T00:57:08.232 INFO:tasks.workunit.client.0.smithi112.stdout:7/944: symlink d0/d2/d2e/df6/d39/d56/d65/d87/dd9/l135 0 2024-09-21T00:57:08.234 INFO:tasks.workunit.client.0.smithi112.stdout:2/963: creat d0/f141 x:0 0 0 2024-09-21T00:57:08.235 INFO:tasks.workunit.client.0.smithi112.stdout:8/951: symlink d0/d13/d1b/d22/d2e/d34/d7b/l12d 0 2024-09-21T00:57:08.235 INFO:tasks.workunit.client.0.smithi112.stdout:2/964: dread - d0/d45/d8a/dd7/fe4 zero size 2024-09-21T00:57:08.238 INFO:tasks.workunit.client.0.smithi112.stdout:0/916: fdatasync d8/d1b/d2c/d2e/d4c/d6b/f77 0 2024-09-21T00:57:08.239 INFO:tasks.workunit.client.0.smithi112.stdout:0/917: write d8/d11/d59/f8a [3046151,57119] 0 2024-09-21T00:57:08.242 INFO:tasks.workunit.client.0.smithi112.stdout:1/868: write d5/d8/dd/d97/fa5 [476438,85298] 0 2024-09-21T00:57:08.243 INFO:tasks.workunit.client.0.smithi112.stdout:5/767: link d8/d9/d13/d1c/d45/fe3 d8/d9/d13/d1c/d45/d8a/ff9 0 2024-09-21T00:57:08.245 INFO:tasks.workunit.client.0.smithi112.stdout:2/965: symlink d0/d14/d8/da2/daa/d136/d46/d58/l142 0 2024-09-21T00:57:08.247 INFO:tasks.workunit.client.0.smithi112.stdout:6/925: creat d9/d1f/d3e/f15b x:0 0 0 2024-09-21T00:57:08.249 INFO:tasks.workunit.client.0.smithi112.stdout:6/926: fdatasync d9/d1f/d47/d34/da6/da7/dcf/d31/d41/f95 0 2024-09-21T00:57:08.250 INFO:tasks.workunit.client.0.smithi112.stdout:8/952: symlink d0/d13/d2a/l12e 0 2024-09-21T00:57:08.251 INFO:tasks.workunit.client.0.smithi112.stdout:5/768: symlink d8/d9/d13/d2a/d84/d8b/dda/lfa 0 2024-09-21T00:57:08.251 INFO:tasks.workunit.client.0.smithi112.stdout:6/927: write d9/d1f/d47/d74/d8e/f127 [569325,61414] 0 2024-09-21T00:57:08.252 INFO:tasks.workunit.client.0.smithi112.stdout:5/769: chown d8/d9/d13/d2a/df 1540402 1 2024-09-21T00:57:08.253 INFO:tasks.workunit.client.0.smithi112.stdout:2/966: dread - d0/d14/d47/fe6 zero size 2024-09-21T00:57:08.253 INFO:tasks.workunit.client.0.smithi112.stdout:6/928: readlink d9/d1f/d47/d34/da6/da7/dcf/d21/l3a 0 2024-09-21T00:57:08.254 INFO:tasks.workunit.client.0.smithi112.stdout:2/967: readlink d0/d14/d8/l114 0 2024-09-21T00:57:08.255 INFO:tasks.workunit.client.0.smithi112.stdout:6/929: chown d9/d1f/d47/d74/d8b/cbb 121 1 2024-09-21T00:57:08.256 INFO:tasks.workunit.client.0.smithi112.stdout:2/968: write d0/d14/f87 [806232,32628] 0 2024-09-21T00:57:08.261 INFO:tasks.workunit.client.0.smithi112.stdout:8/953: unlink d0/d13/d1b/d22/d2e/l5a 0 2024-09-21T00:57:08.263 INFO:tasks.workunit.client.0.smithi112.stdout:7/945: getdents d0/d2/d2e/df6/d39/d56/d65/d87 0 2024-09-21T00:57:08.263 INFO:tasks.workunit.client.0.smithi112.stdout:6/930: dread d9/d1f/d3e/d77/d45/f80 [0,4194304] 0 2024-09-21T00:57:08.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/770: dwrite d8/d9/d13/d2a/d2c/d96/d9f/fc3 [0,4194304] 0 2024-09-21T00:57:08.265 INFO:tasks.workunit.client.0.smithi112.stdout:8/954: chown d0/d13/d1b/d22/d61/f67 15281533 1 2024-09-21T00:57:08.268 INFO:tasks.workunit.client.0.smithi112.stdout:2/969: symlink d0/d14/d8/d27/l143 0 2024-09-21T00:57:08.269 INFO:tasks.workunit.client.0.smithi112.stdout:1/869: creat d5/d8/dd/dcc/f120 x:0 0 0 2024-09-21T00:57:08.269 INFO:tasks.workunit.client.0.smithi112.stdout:2/970: stat d0/d14/d8/da2/daa/d136/d46/d58/d127 0 2024-09-21T00:57:08.270 INFO:tasks.workunit.client.0.smithi112.stdout:1/870: readlink d5/d34/d6a/d7f/l85 0 2024-09-21T00:57:08.276 INFO:tasks.workunit.client.0.smithi112.stdout:7/946: mknod d0/d2/d32/da4/df9/c136 0 2024-09-21T00:57:08.279 INFO:tasks.workunit.client.0.smithi112.stdout:8/955: creat d0/d13/d1b/d22/d2e/f12f x:0 0 0 2024-09-21T00:57:08.282 INFO:tasks.workunit.client.0.smithi112.stdout:0/918: dwrite d8/d11/fb8 [0,4194304] 0 2024-09-21T00:57:08.285 INFO:tasks.workunit.client.0.smithi112.stdout:0/919: write d8/d1b/d2c/d2e/d4c/f84 [4057620,91675] 0 2024-09-21T00:57:08.286 INFO:tasks.workunit.client.0.smithi112.stdout:0/920: stat d8/d1b/l71 0 2024-09-21T00:57:08.287 INFO:tasks.workunit.client.0.smithi112.stdout:6/931: write d9/d1f/f35 [837331,107747] 0 2024-09-21T00:57:08.289 INFO:tasks.workunit.client.0.smithi112.stdout:5/771: write d8/d9/d13/d2a/d2c/f2f [3864688,68842] 0 2024-09-21T00:57:08.294 INFO:tasks.workunit.client.0.smithi112.stdout:7/947: rename d0/d2/d38/d48/fc5 to d0/d2/d32/da4/df9/f137 0 2024-09-21T00:57:08.295 INFO:tasks.workunit.client.0.smithi112.stdout:8/956: write d0/d13/dab/dc6/d100/f86 [1097991,24501] 0 2024-09-21T00:57:08.297 INFO:tasks.workunit.client.0.smithi112.stdout:1/871: dwrite d5/d8/dd/d54/fea [0,4194304] 0 2024-09-21T00:57:08.299 INFO:tasks.workunit.client.0.smithi112.stdout:5/772: creat d8/d9/d13/d2a/d84/d8b/dda/dea/ffb x:0 0 0 2024-09-21T00:57:08.299 INFO:tasks.workunit.client.0.smithi112.stdout:5/773: readlink d8/d9/d13/l6f 0 2024-09-21T00:57:08.301 INFO:tasks.workunit.client.0.smithi112.stdout:0/921: rename d8/d1b/d2c/d2e/d4c/f50 to d8/d75/f11a 0 2024-09-21T00:57:08.314 INFO:tasks.workunit.client.0.smithi112.stdout:1/872: dwrite d5/d8/da1/fdb [0,4194304] 0 2024-09-21T00:57:08.317 INFO:tasks.workunit.client.0.smithi112.stdout:6/932: link d9/df/d56/f7d d9/d1f/d3e/d139/f15c 0 2024-09-21T00:57:08.317 INFO:tasks.workunit.client.0.smithi112.stdout:0/922: chown d8/d11/l21 104 1 2024-09-21T00:57:08.323 INFO:tasks.workunit.client.0.smithi112.stdout:8/957: getdents d0/d66/d88/de8/d114 0 2024-09-21T00:57:08.323 INFO:tasks.workunit.client.0.smithi112.stdout:8/958: dread - d0/d13/d1b/d22/d2e/f12f zero size 2024-09-21T00:57:08.325 INFO:tasks.workunit.client.0.smithi112.stdout:6/933: creat d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/f15d x:0 0 0 2024-09-21T00:57:08.328 INFO:tasks.workunit.client.0.smithi112.stdout:1/873: dwrite d5/d8/dd/d97/d46/fac [0,4194304] 0 2024-09-21T00:57:08.330 INFO:tasks.workunit.client.0.smithi112.stdout:0/923: link d8/d11/f37 d8/d1b/d2c/d2e/d4c/d6b/f11b 0 2024-09-21T00:57:08.331 INFO:tasks.workunit.client.0.smithi112.stdout:7/948: truncate d0/d2/d38/d48/dad/fa3 4030339 0 2024-09-21T00:57:08.332 INFO:tasks.workunit.client.0.smithi112.stdout:0/924: write d8/d5f/fc5 [981249,50199] 0 2024-09-21T00:57:08.334 INFO:tasks.workunit.client.0.smithi112.stdout:1/874: chown d5/d8/dd/d97/fb2 30937 1 2024-09-21T00:57:08.335 INFO:tasks.workunit.client.0.smithi112.stdout:6/934: mkdir d9/d1f/d47/d74/d8b/daa/d15e 0 2024-09-21T00:57:08.336 INFO:tasks.workunit.client.0.smithi112.stdout:7/949: chown d0/d2/d2e/df6/d39/d56/d86/c7b 7177 1 2024-09-21T00:57:08.336 INFO:tasks.workunit.client.0.smithi112.stdout:6/935: readlink d9/d1f/d47/d74/d8e/laf 0 2024-09-21T00:57:08.337 INFO:tasks.workunit.client.0.smithi112.stdout:8/959: rename d0/d13/d2a/f5e to d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1/f130 0 2024-09-21T00:57:08.339 INFO:tasks.workunit.client.0.smithi112.stdout:6/936: write d9/d1f/d3e/d9a/f13f [235238,123717] 0 2024-09-21T00:57:08.342 INFO:tasks.workunit.client.0.smithi112.stdout:0/925: creat d8/d11/d28/dbf/dd3/dff/f11c x:0 0 0 2024-09-21T00:57:08.343 INFO:tasks.workunit.client.0.smithi112.stdout:7/950: creat d0/d2/d32/da4/df9/f138 x:0 0 0 2024-09-21T00:57:08.344 INFO:tasks.workunit.client.0.smithi112.stdout:5/774: dread d8/d9/d13/d2a/d84/d8b/f42 [0,4194304] 0 2024-09-21T00:57:08.347 INFO:tasks.workunit.client.0.smithi112.stdout:1/875: mkdir d5/d3a/d121 0 2024-09-21T00:57:08.350 INFO:tasks.workunit.client.0.smithi112.stdout:8/960: symlink d0/d66/d88/de8/d114/l131 0 2024-09-21T00:57:08.352 INFO:tasks.workunit.client.0.smithi112.stdout:0/926: dwrite d8/d11/d28/dbf/dd3/dec/def/ffb [0,4194304] 0 2024-09-21T00:57:08.356 INFO:tasks.workunit.client.0.smithi112.stdout:1/876: symlink d5/d8/dd/d8e/l122 0 2024-09-21T00:57:08.358 INFO:tasks.workunit.client.0.smithi112.stdout:6/937: write d9/d1f/d47/d74/d8b/fd5 [987664,41042] 0 2024-09-21T00:57:08.360 INFO:tasks.workunit.client.0.smithi112.stdout:7/951: symlink d0/d2/d38/l139 0 2024-09-21T00:57:08.361 INFO:tasks.workunit.client.0.smithi112.stdout:8/961: mknod d0/d13/d2a/d73/d96/dbc/c132 0 2024-09-21T00:57:08.362 INFO:tasks.workunit.client.0.smithi112.stdout:0/927: rmdir d8/d11/d28/dbf/dd3/dec/def 39 2024-09-21T00:57:08.364 INFO:tasks.workunit.client.0.smithi112.stdout:7/952: chown d0/d2/d2e/df6/d39/d55/c7f 0 1 2024-09-21T00:57:08.364 INFO:tasks.workunit.client.0.smithi112.stdout:6/938: write d9/d1f/d47/d34/da6/da7/dcf/d60/dea/f114 [564923,128084] 0 2024-09-21T00:57:08.367 INFO:tasks.workunit.client.0.smithi112.stdout:8/962: mkdir d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1/d133 0 2024-09-21T00:57:08.369 INFO:tasks.workunit.client.0.smithi112.stdout:1/877: dwrite d5/d8/dd/d97/d46/fac [0,4194304] 0 2024-09-21T00:57:08.370 INFO:tasks.workunit.client.0.smithi112.stdout:5/775: link d8/d9/d13/d2a/df/c6c d8/d9/d13/d2a/d84/d8b/dda/cfc 0 2024-09-21T00:57:08.372 INFO:tasks.workunit.client.0.smithi112.stdout:5/776: stat d8/d9/d13/d2a/l52 0 2024-09-21T00:57:08.374 INFO:tasks.workunit.client.0.smithi112.stdout:6/939: truncate d9/d1f/d3e/d77/f37 3398365 0 2024-09-21T00:57:08.374 INFO:tasks.workunit.client.0.smithi112.stdout:1/878: write d5/d8/dd/d97/d46/ff3 [1531981,22123] 0 2024-09-21T00:57:08.376 INFO:tasks.workunit.client.0.smithi112.stdout:7/953: truncate d0/d2/f68 1021106 0 2024-09-21T00:57:08.376 INFO:tasks.workunit.client.0.smithi112.stdout:5/777: stat d8/f30 0 2024-09-21T00:57:08.376 INFO:tasks.workunit.client.0.smithi112.stdout:1/879: fdatasync d5/d3a/fb7 0 2024-09-21T00:57:08.377 INFO:tasks.workunit.client.0.smithi112.stdout:0/928: creat d8/d1b/d2c/f11d x:0 0 0 2024-09-21T00:57:08.379 INFO:tasks.workunit.client.0.smithi112.stdout:8/963: getdents d0/d13/d1b/d22/d2e/d34/d7b/d80/dc1/d133 0 2024-09-21T00:57:08.379 INFO:tasks.workunit.client.0.smithi112.stdout:0/929: write d8/d11/f23 [3716136,35524] 0 2024-09-21T00:57:08.380 INFO:tasks.workunit.client.0.smithi112.stdout:6/940: symlink d9/d1f/d47/d74/l15f 0 2024-09-21T00:57:08.380 INFO:tasks.workunit.client.0.smithi112.stdout:5/778: dread - d8/d9/d13/d2a/df/fe7 zero size 2024-09-21T00:57:08.382 INFO:tasks.workunit.client.0.smithi112.stdout:1/880: write d5/d8/dd/d97/d46/fa2 [2363136,78800] 0 2024-09-21T00:57:08.389 INFO:tasks.workunit.client.0.smithi112.stdout:8/964: creat d0/d13/d2a/ddc/f134 x:0 0 0 2024-09-21T00:57:08.390 INFO:tasks.workunit.client.0.smithi112.stdout:7/954: dwrite d0/d2/d32/fb7 [0,4194304] 0 2024-09-21T00:57:08.391 INFO:tasks.workunit.client.0.smithi112.stdout:5/779: truncate d8/d9/f60 1121628 0 2024-09-21T00:57:08.396 INFO:tasks.workunit.client.0.smithi112.stdout:7/955: chown d0/d2/d2e/dcf/l3e 7330 1 2024-09-21T00:57:08.397 INFO:tasks.workunit.client.0.smithi112.stdout:6/941: dread d9/d1f/d47/d34/da6/da7/dcf/d26/f8a [0,4194304] 0 2024-09-21T00:57:08.401 INFO:tasks.workunit.client.0.smithi112.stdout:6/942: stat d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/d155 0 2024-09-21T00:57:08.402 INFO:tasks.workunit.client.0.smithi112.stdout:5/780: dwrite d8/d9/d13/d2a/df/f7f [0,4194304] 0 2024-09-21T00:57:08.404 INFO:tasks.workunit.client.0.smithi112.stdout:5/781: write d8/d9/d13/d2a/d2c/fc6 [135583,69222] 0 2024-09-21T00:57:08.405 INFO:tasks.workunit.client.0.smithi112.stdout:8/965: creat d0/d13/d9f/f135 x:0 0 0 2024-09-21T00:57:08.412 INFO:tasks.workunit.client.0.smithi112.stdout:6/943: dwrite d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/fb5 [0,4194304] 0 2024-09-21T00:57:08.414 INFO:tasks.workunit.client.0.smithi112.stdout:0/930: dread d8/fcb [0,4194304] 0 2024-09-21T00:57:08.421 INFO:tasks.workunit.client.0.smithi112.stdout:0/931: truncate d8/d1b/f4b 4769687 0 2024-09-21T00:57:08.423 INFO:tasks.workunit.client.0.smithi112.stdout:5/782: link d8/d9/d13/ca7 d8/d9/d13/d1c/d45/cfd 0 2024-09-21T00:57:08.423 INFO:tasks.workunit.client.0.smithi112.stdout:8/966: dwrite d0/d13/d1b/f70 [0,4194304] 0 2024-09-21T00:57:08.426 INFO:tasks.workunit.client.0.smithi112.stdout:1/881: truncate d5/d8/dd/d8e/de6/d111/f119 352263 0 2024-09-21T00:57:08.427 INFO:tasks.workunit.client.0.smithi112.stdout:6/944: link d9/d1f/c50 d9/df/d56/dde/c160 0 2024-09-21T00:57:08.429 INFO:tasks.workunit.client.0.smithi112.stdout:6/945: chown d9/d1f/d3e/d6f/de4/dfd/c130 60 1 2024-09-21T00:57:08.429 INFO:tasks.workunit.client.0.smithi112.stdout:8/967: unlink d0/d13/d2a/cea 0 2024-09-21T00:57:08.435 INFO:tasks.workunit.client.0.smithi112.stdout:6/946: dread d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/fb5 [0,4194304] 0 2024-09-21T00:57:08.438 INFO:tasks.workunit.client.0.smithi112.stdout:0/932: mknod d8/d75/d91/d9b/c11e 0 2024-09-21T00:57:08.441 INFO:tasks.workunit.client.0.smithi112.stdout:8/968: mknod d0/d13/d2a/c136 0 2024-09-21T00:57:08.441 INFO:tasks.workunit.client.0.smithi112.stdout:1/882: dread d5/d8/dd/dcc/f60 [0,4194304] 0 2024-09-21T00:57:08.447 INFO:tasks.workunit.client.0.smithi112.stdout:0/933: rmdir d8/d11 39 2024-09-21T00:57:08.448 INFO:tasks.workunit.client.0.smithi112.stdout:5/783: getdents d8 0 2024-09-21T00:57:08.451 INFO:tasks.workunit.client.0.smithi112.stdout:8/969: fdatasync d0/d13/d2a/f4d 0 2024-09-21T00:57:08.453 INFO:tasks.workunit.client.0.smithi112.stdout:6/947: mkdir d9/df/d161 0 2024-09-21T00:57:08.455 INFO:tasks.workunit.client.0.smithi112.stdout:1/883: dread d5/d8/dd/d97/d46/d70/f71 [0,4194304] 0 2024-09-21T00:57:08.457 INFO:tasks.workunit.client.0.smithi112.stdout:1/884: read d5/d8/dd/dcc/fb1 [608950,100120] 0 2024-09-21T00:57:08.458 INFO:tasks.workunit.client.0.smithi112.stdout:5/784: write d8/d9/d13/f51 [3900470,75855] 0 2024-09-21T00:57:08.459 INFO:tasks.workunit.client.0.smithi112.stdout:1/885: chown d5/d8/dd/d8e/dca/leb 4393805 1 2024-09-21T00:57:08.460 INFO:tasks.workunit.client.0.smithi112.stdout:8/970: mknod d0/d13/d2a/d73/c137 0 2024-09-21T00:57:08.463 INFO:tasks.workunit.client.0.smithi112.stdout:6/948: creat d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d131/f162 x:0 0 0 2024-09-21T00:57:08.465 INFO:tasks.workunit.client.0.smithi112.stdout:0/934: dwrite d8/d11/d28/dbf/dd3/dff/f11c [0,4194304] 0 2024-09-21T00:57:08.468 INFO:tasks.workunit.client.0.smithi112.stdout:0/935: readlink d8/d11/d59/lae 0 2024-09-21T00:57:08.468 INFO:tasks.workunit.client.0.smithi112.stdout:6/949: chown d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/f15d 2033 1 2024-09-21T00:57:08.472 INFO:tasks.workunit.client.0.smithi112.stdout:5/785: dwrite d8/d9/d13/d2a/d84/d8b/dda/fe0 [0,4194304] 0 2024-09-21T00:57:08.472 INFO:tasks.workunit.client.0.smithi112.stdout:1/886: truncate d5/d8/dd/f8a 205549 0 2024-09-21T00:57:08.474 INFO:tasks.workunit.client.0.smithi112.stdout:8/971: mkdir d0/d13/d1b/d22/d2e/d34/d7b/d80/ded/d138 0 2024-09-21T00:57:08.478 INFO:tasks.workunit.client.0.smithi112.stdout:6/950: write d9/d1f/d47/d34/da6/da7/dcf/d26/f8a [2532446,107376] 0 2024-09-21T00:57:08.480 INFO:tasks.workunit.client.0.smithi112.stdout:1/887: creat d5/d8/d13/d87/f123 x:0 0 0 2024-09-21T00:57:08.480 INFO:tasks.workunit.client.0.smithi112.stdout:0/936: dwrite d8/d11/d28/dbf/dd3/f109 [0,4194304] 0 2024-09-21T00:57:08.488 INFO:tasks.workunit.client.0.smithi112.stdout:5/786: getdents d8/d9/d13/d2a/df 0 2024-09-21T00:57:08.491 INFO:tasks.workunit.client.0.smithi112.stdout:1/888: mknod d5/d8/dd/d8e/c124 0 2024-09-21T00:57:08.493 INFO:tasks.workunit.client.0.smithi112.stdout:0/937: creat d8/d11/d28/dbf/dd3/dec/def/da3/f11f x:0 0 0 2024-09-21T00:57:08.498 INFO:tasks.workunit.client.0.smithi112.stdout:1/889: mkdir d5/d8/dd/d8e/dca/d125 0 2024-09-21T00:57:08.502 INFO:tasks.workunit.client.0.smithi112.stdout:6/951: rename d9/df/fda to d9/d1f/d47/d34/da6/da7/dcf/d31/f163 0 2024-09-21T00:57:08.503 INFO:tasks.workunit.client.0.smithi112.stdout:8/972: dread d0/d13/d2a/d73/f83 [0,4194304] 0 2024-09-21T00:57:08.504 INFO:tasks.workunit.client.0.smithi112.stdout:8/973: stat d0/d13/d2a/cc9 0 2024-09-21T00:57:08.506 INFO:tasks.workunit.client.0.smithi112.stdout:5/787: link d8/d9/d13/d2a/df/l8f d8/d9/d13/d2a/d84/d8b/lfe 0 2024-09-21T00:57:08.512 INFO:tasks.workunit.client.0.smithi112.stdout:8/974: fsync d0/d13/d2a/d73/fd7 0 2024-09-21T00:57:08.516 INFO:tasks.workunit.client.0.smithi112.stdout:5/788: fdatasync d8/d9/d13/d2a/d84/d8b/dda/dea/ff2 0 2024-09-21T00:57:08.520 INFO:tasks.workunit.client.0.smithi112.stdout:1/890: write d5/d8/d13/d87/fcf [671910,100405] 0 2024-09-21T00:57:08.521 INFO:tasks.workunit.client.0.smithi112.stdout:5/789: chown d8/d9/d13/d2a/d58/f5e 1 1 2024-09-21T00:57:08.582 INFO:tasks.workunit.client.0.smithi112.stdout:5/790: dread - d8/fbd zero size 2024-09-21T00:57:08.582 INFO:tasks.workunit.client.0.smithi112.stdout:6/952: write d9/d1f/d47/d34/da6/da7/dcf/d21/fc1 [1599571,2509] 0 2024-09-21T00:57:08.582 INFO:tasks.workunit.client.0.smithi112.stdout:8/975: dread d0/d13/d1b/d22/f24 [0,4194304] 0 2024-09-21T00:57:08.583 INFO:tasks.workunit.client.0.smithi112.stdout:1/891: stat d5/d8/dd/d97/d46/d70/d115 0 2024-09-21T00:57:08.583 INFO:tasks.workunit.client.0.smithi112.stdout:0/938: dread d8/d1b/d2c/d2e/d4c/d64/f92 [0,4194304] 0 2024-09-21T00:57:08.587 INFO:tasks.workunit.client.0.smithi112.stdout:5/791: symlink d8/d9/d13/d2a/d2c/d96/lff 0 2024-09-21T00:57:08.587 INFO:tasks.workunit.client.0.smithi112.stdout:5/792: write d8/f9d [1551021,93089] 0 2024-09-21T00:57:08.627 INFO:tasks.workunit.client.0.smithi112.stdout:1/892: mknod d5/d8/da1/c126 0 2024-09-21T00:57:08.628 INFO:tasks.workunit.client.0.smithi112.stdout:5/793: readlink d8/d9/d13/d2a/d84/d8b/l46 0 2024-09-21T00:57:08.628 INFO:tasks.workunit.client.0.smithi112.stdout:6/953: write d9/df/f59 [167669,129491] 0 2024-09-21T00:57:08.628 INFO:tasks.workunit.client.0.smithi112.stdout:1/893: dread - d5/d34/ffa zero size 2024-09-21T00:57:08.630 INFO:tasks.workunit.client.0.smithi112.stdout:8/976: creat d0/d13/d1b/d22/d2e/d34/d7b/d80/f139 x:0 0 0 2024-09-21T00:57:08.630 INFO:tasks.workunit.client.0.smithi112.stdout:0/939: rmdir d8/d1b/d2c/d2e 39 2024-09-21T00:57:08.653 INFO:tasks.workunit.client.0.smithi112.stdout:8/977: dread d0/d66/f50 [4194304,4194304] 0 2024-09-21T00:57:08.681 INFO:tasks.workunit.client.0.smithi112.stdout:5/794: rename d8/d9/d13/d2a/df/db5/fee to d8/d9/d13/d2a/d58/dc4/f100 0 2024-09-21T00:57:08.761 INFO:tasks.workunit.client.0.smithi112.stdout:1/894: mknod d5/d8/dd/c127 0 2024-09-21T00:57:08.764 INFO:tasks.workunit.client.0.smithi112.stdout:6/954: mkdir d9/d1f/d47/d34/da6/da7/dcf/d60/d137/d164 0 2024-09-21T00:57:08.770 INFO:tasks.workunit.client.0.smithi112.stdout:5/795: symlink d8/d9/dcd/ddb/l101 0 2024-09-21T00:57:08.771 INFO:tasks.workunit.client.0.smithi112.stdout:1/895: creat d5/d3a/d121/f128 x:0 0 0 2024-09-21T00:57:08.772 INFO:tasks.workunit.client.0.smithi112.stdout:5/796: mknod d8/d9/d13/d2a/d2c/d96/d9f/c102 0 2024-09-21T00:57:08.774 INFO:tasks.workunit.client.0.smithi112.stdout:1/896: rename d5/d8/dd/d54/laf to d5/d8/d13/d87/l129 0 2024-09-21T00:57:08.775 INFO:tasks.workunit.client.0.smithi112.stdout:5/797: chown d8/d9/d13/d2a/d84/d8b/dda/cfc 3 1 2024-09-21T00:57:08.776 INFO:tasks.workunit.client.0.smithi112.stdout:1/897: symlink d5/d8/dd/d8e/de6/d111/l12a 0 2024-09-21T00:57:08.778 INFO:tasks.workunit.client.0.smithi112.stdout:1/898: read - d5/d8/dd/d97/d46/d70/fb8 zero size 2024-09-21T00:57:08.781 INFO:tasks.workunit.client.0.smithi112.stdout:5/798: dread f7 [0,4194304] 0 2024-09-21T00:57:08.788 INFO:tasks.workunit.client.0.smithi112.stdout:5/799: getdents d8/d9/d13/d2a/d58/dc4 0 2024-09-21T00:57:08.790 INFO:tasks.workunit.client.0.smithi112.stdout:5/800: write d8/d9/d13/d2a/fd1 [1191273,29455] 0 2024-09-21T00:57:08.793 INFO:tasks.workunit.client.0.smithi112.stdout:0/940: dwrite d8/d11/d28/f2f [0,4194304] 0 2024-09-21T00:57:08.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/801: write d8/d9/d13/d2a/df/d5b/f98 [2500014,29350] 0 2024-09-21T00:57:08.795 INFO:tasks.workunit.client.0.smithi112.stdout:5/802: chown d8/d9/d13/d2a/ld2 2071 1 2024-09-21T00:57:08.797 INFO:tasks.workunit.client.0.smithi112.stdout:0/941: read d8/f18 [725584,6548] 0 2024-09-21T00:57:08.799 INFO:tasks.workunit.client.0.smithi112.stdout:5/803: creat d8/d9/d13/d2a/df/d5b/dbe/f103 x:0 0 0 2024-09-21T00:57:08.799 INFO:tasks.workunit.client.0.smithi112.stdout:5/804: stat d8/f9d 0 2024-09-21T00:57:08.802 INFO:tasks.workunit.client.0.smithi112.stdout:5/805: symlink d8/d9/d13/d2a/d84/d8b/dda/l104 0 2024-09-21T00:57:08.803 INFO:tasks.workunit.client.0.smithi112.stdout:5/806: readlink d8/d9/d13/l3a 0 2024-09-21T00:57:08.805 INFO:tasks.workunit.client.0.smithi112.stdout:0/942: dwrite d8/d11/d28/d54/f55 [0,4194304] 0 2024-09-21T00:57:08.809 INFO:tasks.workunit.client.0.smithi112.stdout:0/943: mknod d8/d11/d28/d54/c120 0 2024-09-21T00:57:08.812 INFO:tasks.workunit.client.0.smithi112.stdout:5/807: rename d8/d9/d13/d2a/l52 to d8/d9/d13/d2a/df/d5b/dbe/l105 0 2024-09-21T00:57:08.814 INFO:tasks.workunit.client.0.smithi112.stdout:5/808: chown d8/d9/d13/d2a/f38 34 1 2024-09-21T00:57:08.817 INFO:tasks.workunit.client.0.smithi112.stdout:0/944: dwrite d8/d75/d91/f10a [0,4194304] 0 2024-09-21T00:57:08.824 INFO:tasks.workunit.client.0.smithi112.stdout:0/945: rename d8/d1b/d2c/d2e/lbb to d8/l121 0 2024-09-21T00:57:08.824 INFO:tasks.workunit.client.0.smithi112.stdout:0/946: fdatasync d8/d11/d28/fd0 0 2024-09-21T00:57:08.825 INFO:tasks.workunit.client.0.smithi112.stdout:0/947: chown d8/d11/f23 1 1 2024-09-21T00:57:08.828 INFO:tasks.workunit.client.0.smithi112.stdout:0/948: symlink d8/d75/l122 0 2024-09-21T00:57:08.837 INFO:tasks.workunit.client.0.smithi112.stdout:6/955: write d9/d1f/d3e/d6f/fbf [2034186,77452] 0 2024-09-21T00:57:08.838 INFO:tasks.workunit.client.0.smithi112.stdout:6/956: chown d9/d1f/d47/d34/da6/da7/dcf/d60/d137/d164 457 1 2024-09-21T00:57:08.840 INFO:tasks.workunit.client.0.smithi112.stdout:6/957: stat d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d11f/d142/f146 0 2024-09-21T00:57:08.842 INFO:tasks.workunit.client.0.smithi112.stdout:5/809: dread d8/d9/d13/d1c/dbc/fd3 [0,4194304] 0 2024-09-21T00:57:08.843 INFO:tasks.workunit.client.0.smithi112.stdout:6/958: mknod d9/d1f/d47/d34/da6/da7/dcf/d60/da3/c165 0 2024-09-21T00:57:08.846 INFO:tasks.workunit.client.0.smithi112.stdout:6/959: creat d9/d1f/d47/d34/da6/da7/dcf/d60/dc3/f166 x:0 0 0 2024-09-21T00:57:08.848 INFO:tasks.workunit.client.0.smithi112.stdout:1/899: write d5/d8/d13/d87/faa [861122,48033] 0 2024-09-21T00:57:08.848 INFO:tasks.workunit.client.0.smithi112.stdout:6/960: write d9/d1f/d47/d74/d8b/daa/dd4/d113/f148 [38694,30623] 0 2024-09-21T00:57:08.850 INFO:tasks.workunit.client.0.smithi112.stdout:5/810: link d8/d9/d13/d2a/df/c6c d8/d9/d13/d2a/d58/c106 0 2024-09-21T00:57:08.856 INFO:tasks.workunit.client.0.smithi112.stdout:6/961: creat d9/d1f/d3e/d6f/de4/ded/f167 x:0 0 0 2024-09-21T00:57:08.870 INFO:tasks.workunit.client.0.smithi112.stdout:6/962: link d9/d1f/d47/d34/da6/da7/dcf/d31/l11e d9/d1f/d3e/d6f/de4/ded/l168 0 2024-09-21T00:57:08.873 INFO:tasks.workunit.client.0.smithi112.stdout:6/963: mknod d9/d1f/d3e/d6f/de4/c169 0 2024-09-21T00:57:08.875 INFO:tasks.workunit.client.0.smithi112.stdout:0/949: dwrite d8/d1b/d2c/f30 [0,4194304] 0 2024-09-21T00:57:08.879 INFO:tasks.workunit.client.0.smithi112.stdout:6/964: read d9/d1f/d3e/d77/f37 [939521,65704] 0 2024-09-21T00:57:08.882 INFO:tasks.workunit.client.0.smithi112.stdout:1/900: write d5/d68/f90 [6499864,83823] 0 2024-09-21T00:57:08.882 INFO:tasks.workunit.client.0.smithi112.stdout:6/965: chown d9/d1f/d47/d74/d8e/laf 357365 1 2024-09-21T00:57:08.882 INFO:tasks.workunit.client.0.smithi112.stdout:0/950: stat d8/d11/d28/dbf/dd3/dec/def/le3 0 2024-09-21T00:57:08.884 INFO:tasks.workunit.client.0.smithi112.stdout:5/811: write d8/d9/d13/d1c/d99/fb3 [1527502,54118] 0 2024-09-21T00:57:08.885 INFO:tasks.workunit.client.0.smithi112.stdout:6/966: stat d9/d1f/d3e/d6f/l109 0 2024-09-21T00:57:08.885 INFO:tasks.workunit.client.0.smithi112.stdout:5/812: fdatasync d8/d9/d13/d2a/df/f94 0 2024-09-21T00:57:08.888 INFO:tasks.workunit.client.0.smithi112.stdout:0/951: unlink d8/d11/d28/dbf/dd3/dec/def/da3/db6/f105 0 2024-09-21T00:57:08.892 INFO:tasks.workunit.client.0.smithi112.stdout:5/813: mknod d8/d9/d13/d2a/d84/d8b/dda/dea/c107 0 2024-09-21T00:57:08.893 INFO:tasks.workunit.client.0.smithi112.stdout:5/814: write d8/d9/d13/f51 [4074536,107334] 0 2024-09-21T00:57:08.895 INFO:tasks.workunit.client.0.smithi112.stdout:6/967: rename d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/f15d to d9/d1f/d47/d74/d8e/d138/ddd/f16a 0 2024-09-21T00:57:08.896 INFO:tasks.workunit.client.0.smithi112.stdout:6/968: stat d9/d1f/f35 0 2024-09-21T00:57:08.898 INFO:tasks.workunit.client.0.smithi112.stdout:1/901: getdents d5/d34 0 2024-09-21T00:57:08.899 INFO:tasks.workunit.client.0.smithi112.stdout:1/902: write d5/d8/dd/d54/f110 [102908,128464] 0 2024-09-21T00:57:08.900 INFO:tasks.workunit.client.0.smithi112.stdout:5/815: rename d8/d9/d13/d2a/df/d5b/dbe/fc8 to d8/d9/d13/d1c/d99/f108 0 2024-09-21T00:57:08.901 INFO:tasks.workunit.client.0.smithi112.stdout:6/969: rmdir d9/d1f/d47/d34/da6/da7/dcf/d60/dc3 39 2024-09-21T00:57:08.901 INFO:tasks.workunit.client.0.smithi112.stdout:5/816: dread - d8/d9/d13/d1c/d45/fe3 zero size 2024-09-21T00:57:08.904 INFO:tasks.workunit.client.0.smithi112.stdout:1/903: unlink d5/d8/dd/d97/d46/d70/lc4 0 2024-09-21T00:57:08.905 INFO:tasks.workunit.client.0.smithi112.stdout:1/904: chown d5/d34/d6a/d7f/c104 188640156 1 2024-09-21T00:57:08.906 INFO:tasks.workunit.client.0.smithi112.stdout:0/952: creat d8/d11/d28/dbf/dd3/dec/f123 x:0 0 0 2024-09-21T00:57:08.909 INFO:tasks.workunit.client.0.smithi112.stdout:5/817: mkdir d8/d9/d13/d1c/dbc/d109 0 2024-09-21T00:57:08.910 INFO:tasks.workunit.client.0.smithi112.stdout:5/818: chown d8/c43 7374 1 2024-09-21T00:57:08.911 INFO:tasks.workunit.client.0.smithi112.stdout:1/905: creat d5/d8/dd/d8e/f12b x:0 0 0 2024-09-21T00:57:08.913 INFO:tasks.workunit.client.0.smithi112.stdout:6/970: dread d9/d1f/d3e/d77/f37 [0,4194304] 0 2024-09-21T00:57:08.914 INFO:tasks.workunit.client.0.smithi112.stdout:6/971: stat d9/d1f/d47/d34/da6/da7/dcf/d60/d137/c58 0 2024-09-21T00:57:08.915 INFO:tasks.workunit.client.0.smithi112.stdout:6/972: chown d9/d1f/d47/d74/d8b/daa/cf1 773 1 2024-09-21T00:57:08.916 INFO:tasks.workunit.client.0.smithi112.stdout:4/961: sync 2024-09-21T00:57:08.916 INFO:tasks.workunit.client.0.smithi112.stdout:5/819: creat d8/d9/d13/d2a/d2c/d96/f10a x:0 0 0 2024-09-21T00:57:08.918 INFO:tasks.workunit.client.0.smithi112.stdout:1/906: symlink d5/d68/l12c 0 2024-09-21T00:57:08.921 INFO:tasks.workunit.client.0.smithi112.stdout:4/962: creat d1/d5/f13b x:0 0 0 2024-09-21T00:57:08.924 INFO:tasks.workunit.client.0.smithi112.stdout:0/953: write d8/d5f/f6f [841451,71346] 0 2024-09-21T00:57:08.924 INFO:tasks.workunit.client.0.smithi112.stdout:1/907: mknod d5/d8/dd/d97/dd2/d10a/c12d 0 2024-09-21T00:57:08.927 INFO:tasks.workunit.client.0.smithi112.stdout:5/820: mkdir d8/d9/d13/d1c/dbc/d109/d10b 0 2024-09-21T00:57:08.928 INFO:tasks.workunit.client.0.smithi112.stdout:6/973: getdents d9/d1f/d47/d34/da6/da7/dcf/d60/dea/d14a 0 2024-09-21T00:57:08.929 INFO:tasks.workunit.client.0.smithi112.stdout:1/908: mkdir d5/d8/dd/d97/d46/d70/d12e 0 2024-09-21T00:57:08.931 INFO:tasks.workunit.client.0.smithi112.stdout:0/954: rename d8/d1b/d2c/d2e/d4c/d64/cb1 to d8/d75/d91/d9b/c124 0 2024-09-21T00:57:08.934 INFO:tasks.workunit.client.0.smithi112.stdout:5/821: rmdir d8/d9/d13/d1c/dbc 39 2024-09-21T00:57:08.936 INFO:tasks.workunit.client.0.smithi112.stdout:1/909: dwrite d5/d8/dd/d97/fa5 [0,4194304] 0 2024-09-21T00:57:08.945 INFO:tasks.workunit.client.0.smithi112.stdout:0/955: dwrite d8/d1b/d2c/d2e/fb3 [4194304,4194304] 0 2024-09-21T00:57:08.951 INFO:tasks.workunit.client.0.smithi112.stdout:6/974: creat d9/d1f/d47/d34/da6/da7/dcf/d60/f16b x:0 0 0 2024-09-21T00:57:08.954 INFO:tasks.workunit.client.0.smithi112.stdout:4/963: write d1/d5/d1c/fa0 [1889613,127020] 0 2024-09-21T00:57:08.954 INFO:tasks.workunit.client.0.smithi112.stdout:1/910: getdents d5/d68/df6 0 2024-09-21T00:57:08.955 INFO:tasks.workunit.client.0.smithi112.stdout:4/964: chown d1/d5/d1c/d1e/d76/d11a 27 1 2024-09-21T00:57:08.956 INFO:tasks.workunit.client.0.smithi112.stdout:1/911: chown d5/d3a/d4b/lce 0 1 2024-09-21T00:57:08.957 INFO:tasks.workunit.client.0.smithi112.stdout:4/965: write d1/d5/d1c/d1e/d4a/f7d [540410,119780] 0 2024-09-21T00:57:08.957 INFO:tasks.workunit.client.0.smithi112.stdout:6/975: symlink d9/d1f/d47/d74/l16c 0 2024-09-21T00:57:08.958 INFO:tasks.workunit.client.0.smithi112.stdout:0/956: symlink d8/d11/d28/dbf/dd3/dec/def/da3/df6/l125 0 2024-09-21T00:57:08.959 INFO:tasks.workunit.client.0.smithi112.stdout:0/957: fsync d8/f3c 0 2024-09-21T00:57:08.968 INFO:tasks.workunit.client.0.smithi112.stdout:5/822: dwrite d8/d9/d13/d2a/d58/f5e [0,4194304] 0 2024-09-21T00:57:08.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/976: mkdir d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/d16d 0 2024-09-21T00:57:08.969 INFO:tasks.workunit.client.0.smithi112.stdout:6/977: stat d9/df/d56/l40 0 2024-09-21T00:57:08.970 INFO:tasks.workunit.client.0.smithi112.stdout:5/823: write d8/f4b [4648658,41217] 0 2024-09-21T00:57:08.972 INFO:tasks.workunit.client.0.smithi112.stdout:0/958: creat d8/d11/d28/dbf/dd3/dec/def/da3/dea/f126 x:0 0 0 2024-09-21T00:57:08.977 INFO:tasks.workunit.client.0.smithi112.stdout:5/824: creat d8/d9/d13/d2a/da1/f10c x:0 0 0 2024-09-21T00:57:08.978 INFO:tasks.workunit.client.0.smithi112.stdout:5/825: stat d8/d9/d13/d2a/d2c/d96/f10a 0 2024-09-21T00:57:08.980 INFO:tasks.workunit.client.0.smithi112.stdout:0/959: mknod d8/d11/d28/dbf/c127 0 2024-09-21T00:57:08.983 INFO:tasks.workunit.client.0.smithi112.stdout:6/978: unlink d9/d1f/d47/d34/da6/da7/dcf/d31/d41/l67 0 2024-09-21T00:57:08.985 INFO:tasks.workunit.client.0.smithi112.stdout:1/912: rename d5/d8/dd/f114 to d5/d8/dd/d97/f12f 0 2024-09-21T00:57:08.987 INFO:tasks.workunit.client.0.smithi112.stdout:5/826: chown d8/d9/d13/d2a/df/d5b/dbe/l7b 188 1 2024-09-21T00:57:08.987 INFO:tasks.workunit.client.0.smithi112.stdout:6/979: mkdir d9/d1f/d47/d74/d8b/daa/dcd/d16e 0 2024-09-21T00:57:08.990 INFO:tasks.workunit.client.0.smithi112.stdout:5/827: read d8/d9/d13/d2a/d84/d8b/dda/dea/ff2 [5580889,39918] 0 2024-09-21T00:57:08.990 INFO:tasks.workunit.client.0.smithi112.stdout:4/966: dwrite d1/d5/d1c/f5b [0,4194304] 0 2024-09-21T00:57:08.991 INFO:tasks.workunit.client.0.smithi112.stdout:0/960: rename d8/d11/d28/d54 to d8/d75/d91/d9b/d116/d128 0 2024-09-21T00:57:08.992 INFO:tasks.workunit.client.0.smithi112.stdout:4/967: fsync d1/d5/f13b 0 2024-09-21T00:57:08.992 INFO:tasks.workunit.client.0.smithi112.stdout:1/913: unlink d5/d3a/d4b/dbc/f118 0 2024-09-21T00:57:08.993 INFO:tasks.workunit.client.0.smithi112.stdout:0/961: fdatasync d8/d11/d59/d78/dce/f112 0 2024-09-21T00:57:09.002 INFO:tasks.workunit.client.0.smithi112.stdout:1/914: dwrite d5/d8/da1/f11e [0,4194304] 0 2024-09-21T00:57:09.005 INFO:tasks.workunit.client.0.smithi112.stdout:6/980: link d9/d1f/d47/d34/da6/lc0 d9/d1f/d47/d34/da6/da7/dcf/d60/da4/db0/dc4/l16f 0 2024-09-21T00:57:09.099 INFO:tasks.workunit.client.0.smithi112.stdout:2/971: sync 2024-09-21T00:57:09.101 INFO:tasks.workunit.client.0.smithi112.stdout:0/962: link d8/d75/f11a d8/d11/d59/f129 0 2024-09-21T00:57:09.103 INFO:tasks.workunit.client.0.smithi112.stdout:1/915: write d5/d8/dd/d97/d46/d70/f71 [2061219,105092] 0 2024-09-21T00:57:09.104 INFO:tasks.workunit.client.0.smithi112.stdout:1/916: fdatasync d5/d8/d13/d87/fcf 0 2024-09-21T00:57:09.105 INFO:tasks.workunit.client.0.smithi112.stdout:1/917: stat d5/d8/dd/d97/d46/l10e 0 2024-09-21T00:57:09.108 INFO:tasks.workunit.client.0.smithi112.stdout:6/981: dread d9/d1f/d47/d74/fc5 [0,4194304] 0 2024-09-21T00:57:09.109 INFO:tasks.workunit.client.0.smithi112.stdout:2/972: unlink d0/d14/d8/da2/daa/d136/f79 0 2024-09-21T00:57:09.122 INFO:tasks.workunit.client.0.smithi112.stdout:5/828: truncate d8/d9/d13/f51 75432 0 2024-09-21T00:57:09.127 INFO:tasks.workunit.client.0.smithi112.stdout:4/968: link d1/d7/d30/l87 d1/d7/d9/d1a/l13c 0 2024-09-21T00:57:09.132 INFO:tasks.workunit.client.0.smithi112.stdout:2/973: dread d0/d14/d22/d95/dd2/feb [0,4194304] 0 2024-09-21T00:57:09.137 INFO:tasks.workunit.client.0.smithi112.stdout:4/969: mkdir d1/d7/d9/d1a/d13d 0 2024-09-21T00:57:09.138 INFO:tasks.workunit.client.0.smithi112.stdout:1/918: write d5/d8/dd/dcc/fb1 [4798026,111063] 0 2024-09-21T00:57:09.139 INFO:tasks.workunit.client.0.smithi112.stdout:2/974: dwrite d0/d45/d8a/d83/fbb [0,4194304] 0 2024-09-21T00:57:09.142 INFO:tasks.workunit.client.0.smithi112.stdout:4/970: creat d1/d5/d1c/db3/f13e x:0 0 0 2024-09-21T00:57:09.142 INFO:tasks.workunit.client.0.smithi112.stdout:1/919: chown d5/d3a/d4b/c65 124967524 1 2024-09-21T00:57:09.145 INFO:tasks.workunit.client.0.smithi112.stdout:4/971: rmdir d1/d5/d1c/db3/d12c/d13a 39 2024-09-21T00:57:09.148 INFO:tasks.workunit.client.0.smithi112.stdout:1/920: rename d5/d8/dd/d97/d46/lf0 to d5/d68/df6/l130 0 2024-09-21T00:57:09.149 INFO:tasks.workunit.client.0.smithi112.stdout:4/972: symlink d1/d5/d1c/d1e/daf/l13f 0 2024-09-21T00:57:09.151 INFO:tasks.workunit.client.0.smithi112.stdout:1/921: chown d5/d8/dd/dcc/l5f 14078135 1 2024-09-21T00:57:09.153 INFO:tasks.workunit.client.0.smithi112.stdout:4/973: creat d1/ddf/f140 x:0 0 0 2024-09-21T00:57:09.153 INFO:tasks.workunit.client.0.smithi112.stdout:0/963: dwrite d8/d11/f81 [0,4194304] 0 2024-09-21T00:57:09.153 INFO:tasks.workunit.client.0.smithi112.stdout:1/922: symlink d5/d3a/d4b/l131 0 2024-09-21T00:57:09.155 INFO:tasks.workunit.client.0.smithi112.stdout:1/923: write d5/d68/f102 [306875,2518] 0 2024-09-21T00:57:09.155 INFO:tasks.workunit.client.0.smithi112.stdout:4/974: chown d1/d5/d1c/d1e/ff2 6147102 1 2024-09-21T00:57:09.156 INFO:tasks.workunit.client.0.smithi112.stdout:0/964: chown d8/d11/d28/dbf/dd3/dd7/fc1 289708117 1 2024-09-21T00:57:09.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:08 smithi187 ceph-mon[34997]: pgmap v37: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 42 MiB/s rd, 90 MiB/s wr, 296 op/s 2024-09-21T00:57:09.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:08 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:09.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:08 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:09.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:08 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:57:09.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:08 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:09.159 INFO:tasks.workunit.client.0.smithi112.stdout:6/982: truncate d9/d1f/d47/d74/d8b/daa/dd4/f7b 595950 0 2024-09-21T00:57:09.160 INFO:tasks.workunit.client.0.smithi112.stdout:6/983: dread - d9/d1f/d3e/d6f/f141 zero size 2024-09-21T00:57:09.160 INFO:tasks.workunit.client.0.smithi112.stdout:1/924: mkdir d5/d3a/d132 0 2024-09-21T00:57:09.163 INFO:tasks.workunit.client.0.smithi112.stdout:6/984: readlink d9/d1f/d47/d34/da6/da7/dcf/d31/d41/l44 0 2024-09-21T00:57:09.163 INFO:tasks.workunit.client.0.smithi112.stdout:2/975: dread d0/d14/d8/da2/daa/d136/fb3 [0,4194304] 0 2024-09-21T00:57:09.164 INFO:tasks.workunit.client.0.smithi112.stdout:0/965: creat d8/d1b/d2c/d2e/d4c/d6b/dc2/f12a x:0 0 0 2024-09-21T00:57:09.166 INFO:tasks.workunit.client.0.smithi112.stdout:1/925: mknod d5/d8/dd/d8e/de6/d111/c133 0 2024-09-21T00:57:09.170 INFO:tasks.workunit.client.0.smithi112.stdout:6/985: unlink d9/d1f/d47/d34/da6/da7/dcf/d31/l88 0 2024-09-21T00:57:09.172 INFO:tasks.workunit.client.0.smithi112.stdout:1/926: unlink d5/d8/dd/dcc/f60 0 2024-09-21T00:57:09.173 INFO:tasks.workunit.client.0.smithi112.stdout:5/829: write d8/d9/f25 [3885110,8425] 0 2024-09-21T00:57:09.174 INFO:tasks.workunit.client.0.smithi112.stdout:5/830: stat d8/d9/d13/d1c/d45/ldd 0 2024-09-21T00:57:09.174 INFO:tasks.workunit.client.0.smithi112.stdout:1/927: dread d5/d8/d10/fc2 [0,4194304] 0 2024-09-21T00:57:09.175 INFO:tasks.workunit.client.0.smithi112.stdout:0/966: truncate d8/d1b/f44 2303998 0 2024-09-21T00:57:09.177 INFO:tasks.workunit.client.0.smithi112.stdout:5/831: truncate d8/d9/d13/d1c/d45/fe1 491370 0 2024-09-21T00:57:09.177 INFO:tasks.workunit.client.0.smithi112.stdout:6/986: unlink d9/d1f/d3e/d77/d45/f80 0 2024-09-21T00:57:09.178 INFO:tasks.workunit.client.0.smithi112.stdout:1/928: symlink d5/d8/d13/d87/l134 0 2024-09-21T00:57:09.182 INFO:tasks.workunit.client.0.smithi112.stdout:0/967: dwrite d8/fd [0,4194304] 0 2024-09-21T00:57:09.182 INFO:tasks.workunit.client.0.smithi112.stdout:5/832: creat d8/d9/d13/d2a/d84/d8b/f10d x:0 0 0 2024-09-21T00:57:09.183 INFO:tasks.workunit.client.0.smithi112.stdout:1/929: rmdir d5/d68 39 2024-09-21T00:57:09.183 INFO:tasks.workunit.client.0.smithi112.stdout:0/968: dread - d8/d1b/d2c/d2e/d4c/da8/fee zero size 2024-09-21T00:57:09.184 INFO:tasks.workunit.client.0.smithi112.stdout:6/987: creat d9/d1f/d3e/d77/d45/f170 x:0 0 0 2024-09-21T00:57:09.187 INFO:tasks.workunit.client.0.smithi112.stdout:0/969: dread d8/fcb [0,4194304] 0 2024-09-21T00:57:09.189 INFO:tasks.workunit.client.0.smithi112.stdout:5/833: mknod d8/d9/d13/d1c/dbc/d109/c10e 0 2024-09-21T00:57:09.192 INFO:tasks.workunit.client.0.smithi112.stdout:6/988: rename d9/d1f/d47/d34/da6/da7/dcf/d26/f8a to d9/d1f/d47/d34/da6/da7/dcf/d26/dd9/d16d/f171 0 2024-09-21T00:57:09.194 INFO:tasks.workunit.client.0.smithi112.stdout:5/834: mkdir d8/d9/d13/d1c/d45/d8a/dc0/d10f 0 2024-09-21T00:57:09.196 INFO:tasks.workunit.client.0.smithi112.stdout:0/970: creat d8/d11/d28/dbf/dd3/f12b x:0 0 0 2024-09-21T00:57:09.197 INFO:tasks.workunit.client.0.smithi112.stdout:6/989: fdatasync d9/d1f/d47/d34/da6/da7/dcf/d60/dc3/f166 0 2024-09-21T00:57:09.198 INFO:tasks.workunit.client.0.smithi112.stdout:0/971: truncate d8/d5f/f73 1817970 0 2024-09-21T00:57:09.199 INFO:tasks.workunit.client.0.smithi112.stdout:6/990: chown d9/d1f/d47/d34/lcb 746671 1 2024-09-21T00:57:09.200 INFO:tasks.workunit.client.0.smithi112.stdout:0/972: creat d8/d5f/da7/f12c x:0 0 0 2024-09-21T00:57:09.201 INFO:tasks.workunit.client.0.smithi112.stdout:0/973: fdatasync d8/d1b/d2c/d2e/d4c/d64/fb5 0 2024-09-21T00:57:09.203 INFO:tasks.workunit.client.0.smithi112.stdout:0/974: chown d8/d1b/d2c/d2e/d4c/da8/cfc 579 1 2024-09-21T00:57:09.204 INFO:tasks.workunit.client.0.smithi112.stdout:0/975: dread - d8/d11/d28/dbf/dd3/dec/def/da3/dea/f126 zero size 2024-09-21T00:57:09.206 INFO:tasks.workunit.client.0.smithi112.stdout:0/976: fsync d8/d11/d28/dbf/dd3/dff/f11c 0 2024-09-21T00:57:09.208 INFO:tasks.workunit.client.0.smithi112.stdout:0/977: chown d8/d75/d91/d9b/d116/d128/l8b 0 1 2024-09-21T00:57:09.212 INFO:tasks.workunit.client.0.smithi112.stdout:4/975: dwrite d1/d7/d9/d1a/f9a [0,4194304] 0 2024-09-21T00:57:09.217 INFO:tasks.workunit.client.0.smithi112.stdout:0/978: link d8/d11/d28/dbf/ff7 d8/d1b/d2c/daf/f12d 0 2024-09-21T00:57:09.219 INFO:tasks.workunit.client.0.smithi112.stdout:4/976: rename d1/d5/d1c/fa4 to d1/d7/d9/d1a/f141 0 2024-09-21T00:57:09.221 INFO:tasks.workunit.client.0.smithi112.stdout:4/977: stat d1/d5/d1c/d1e 0 2024-09-21T00:57:09.223 INFO:tasks.workunit.client.0.smithi112.stdout:2/976: dwrite d0/d14/d8/d27/d7a/f93 [0,4194304] 0 2024-09-21T00:57:09.230 INFO:tasks.workunit.client.0.smithi112.stdout:4/978: symlink d1/d7/d9/d1a/de5/l142 0 2024-09-21T00:57:09.232 INFO:tasks.workunit.client.0.smithi112.stdout:2/977: write d0/d14/d8/f134 [1023251,89100] 0 2024-09-21T00:57:09.236 INFO:tasks.workunit.client.0.smithi112.stdout:0/979: creat d8/d1b/d2c/d2e/d4c/d6b/d10e/f12e x:0 0 0 2024-09-21T00:57:09.239 INFO:tasks.workunit.client.0.smithi112.stdout:4/979: dread - d1/d5/d1c/d1e/ff2 zero size 2024-09-21T00:57:09.241 INFO:tasks.workunit.client.0.smithi112.stdout:2/978: mkdir d0/d14/d8/da2/daa/d136/d46/d97/d144 0 2024-09-21T00:57:09.244 INFO:tasks.workunit.client.0.smithi112.stdout:0/980: fsync d8/d1b/f8e 0 2024-09-21T00:57:09.247 INFO:tasks.workunit.client.0.smithi112.stdout:4/980: creat d1/d7/d9/d1a/d22/d6e/d10b/d110/f143 x:0 0 0 2024-09-21T00:57:09.249 INFO:tasks.workunit.client.0.smithi112.stdout:6/991: read d9/d1f/d47/d34/da6/f64 [1658240,75161] 0 2024-09-21T00:57:09.258 INFO:tasks.workunit.client.0.smithi112.stdout:2/979: rename d0/f53 to d0/d14/d47/f145 0 2024-09-21T00:57:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:08 smithi112 ceph-mon[28078]: pgmap v37: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 42 MiB/s rd, 90 MiB/s wr, 296 op/s 2024-09-21T00:57:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:08 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:08 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:08 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:57:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:08 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:09.261 INFO:tasks.workunit.client.0.smithi112.stdout:0/981: mkdir d8/d1b/d2c/d2e/d4c/d6b/d12f 0 2024-09-21T00:57:09.270 INFO:tasks.workunit.client.0.smithi112.stdout:0/982: rename d8/d11/d28/f4e to d8/d1b/f130 0 2024-09-21T00:57:09.272 INFO:tasks.workunit.client.0.smithi112.stdout:1/930: dwrite d5/d8/dd/f4c [4194304,4194304] 0 2024-09-21T00:57:09.272 INFO:tasks.workunit.client.0.smithi112.stdout:4/981: link d1/d5/fd d1/d7/d30/f144 0 2024-09-21T00:57:09.274 INFO:tasks.workunit.client.0.smithi112.stdout:0/983: write d8/d11/d28/dbf/dd3/f109 [1263765,59636] 0 2024-09-21T00:57:09.274 INFO:tasks.workunit.client.0.smithi112.stdout:0/984: chown d8/d5f 60 1 2024-09-21T00:57:09.276 INFO:tasks.workunit.client.0.smithi112.stdout:4/982: unlink d1/fa6 0 2024-09-21T00:57:09.277 INFO:tasks.workunit.client.0.smithi112.stdout:1/931: symlink d5/d8/d13/d87/l135 0 2024-09-21T00:57:09.282 INFO:tasks.workunit.client.0.smithi112.stdout:1/932: symlink d5/d8/dd/d8e/dca/df1/dfb/l136 0 2024-09-21T00:57:09.284 INFO:tasks.workunit.client.0.smithi112.stdout:4/983: dwrite d1/d7/fdb [0,4194304] 0 2024-09-21T00:57:09.288 INFO:tasks.workunit.client.0.smithi112.stdout:4/984: dread - d1/d5/f13b zero size 2024-09-21T00:57:09.289 INFO:tasks.workunit.client.0.smithi112.stdout:1/933: read d5/d3a/d4b/de9/ff5 [2592869,29613] 0 2024-09-21T00:57:09.290 INFO:tasks.workunit.client.0.smithi112.stdout:5/835: dwrite d8/f30 [0,4194304] 0 2024-09-21T00:57:09.291 INFO:tasks.workunit.client.0.smithi112.stdout:5/836: stat d8/d9/d13/d2a/f18 0 2024-09-21T00:57:09.292 INFO:tasks.workunit.client.0.smithi112.stdout:1/934: dread d5/d8/d13/ffd [0,4194304] 0 2024-09-21T00:57:09.292 INFO:tasks.workunit.client.0.smithi112.stdout:4/985: unlink d1/d5/f74 0 2024-09-21T00:57:09.293 INFO:tasks.workunit.client.0.smithi112.stdout:4/986: fdatasync d1/d7/d9/fcb 0 2024-09-21T00:57:09.295 INFO:tasks.workunit.client.0.smithi112.stdout:1/935: chown d5/d3a/c10c 0 1 2024-09-21T00:57:09.298 INFO:tasks.workunit.client.0.smithi112.stdout:1/936: read d5/d8/dd/dcc/f101 [2916683,95892] 0 2024-09-21T00:57:09.301 INFO:tasks.workunit.client.0.smithi112.stdout:4/987: fdatasync d1/d7/d9/d1a/f78 0 2024-09-21T00:57:09.307 INFO:tasks.workunit.client.0.smithi112.stdout:5/837: dwrite d8/d9/d13/d1c/d99/fd7 [0,4194304] 0 2024-09-21T00:57:09.307 INFO:tasks.workunit.client.0.smithi112.stdout:6/992: chown d9/d1f/d47/d34/da6/da7/dcf/d60/da3/d131/f158 2050366 1 2024-09-21T00:57:09.310 INFO:tasks.workunit.client.0.smithi112.stdout:1/937: symlink d5/d8/dd/d97/d46/d70/l137 0 2024-09-21T00:57:09.310 INFO:tasks.workunit.client.0.smithi112.stdout:5/838: stat d8/d9/d13/d2a/d84/l8e 0 2024-09-21T00:57:09.311 INFO:tasks.workunit.client.0.smithi112.stdout:6/993: write d9/d1f/d47/d74/fd8 [228794,113008] 0 2024-09-21T00:57:09.313 INFO:tasks.workunit.client.0.smithi112.stdout:4/988: dwrite d1/d7/fdb [0,4194304] 0 2024-09-21T00:57:09.314 INFO:tasks.workunit.client.0.smithi112.stdout:2/980: write d0/d45/d8a/d62/fce [1031983,123642] 0 2024-09-21T00:57:09.321 INFO:tasks.workunit.client.0.smithi112.stdout:0/985: dread d8/d5f/fc5 [0,4194304] 0 2024-09-21T00:57:09.327 INFO:tasks.workunit.client.0.smithi112.stdout:1/938: dwrite d5/d8/d13/d87/f9d [0,4194304] 0 2024-09-21T00:57:09.327 INFO:tasks.workunit.client.0.smithi112.stdout:4/989: write d1/d5/d1c/d1e/d4a/d5f/d83/d11f/f134 [2628745,23770] 0 2024-09-21T00:57:09.328 INFO:tasks.workunit.client.0.smithi112.stdout:6/994: dwrite d9/d1f/d3e/d77/d79/d85/f122 [0,4194304] 0 2024-09-21T00:57:09.329 INFO:tasks.workunit.client.0.smithi112.stdout:5/839: symlink d8/d9/d13/d1c/dbc/df6/l110 0 2024-09-21T00:57:09.332 INFO:tasks.workunit.client.0.smithi112.stdout:6/995: truncate d9/d1f/d47/d74/fd8 729489 0 2024-09-21T00:57:09.332 INFO:tasks.workunit.client.0.smithi112.stdout:5/840: rename d8/d9/d13/d2a to d8/d9/d13/d2a/df/d111 22 2024-09-21T00:57:09.333 INFO:tasks.workunit.client.0.smithi112.stdout:2/981: creat d0/d14/dbe/f146 x:0 0 0 2024-09-21T00:57:09.339 INFO:tasks.workunit.client.0.smithi112.stdout:1/939: creat d5/d68/f138 x:0 0 0 2024-09-21T00:57:09.340 INFO:tasks.workunit.client.0.smithi112.stdout:5/841: creat d8/d9/d13/d2a/df/f112 x:0 0 0 2024-09-21T00:57:09.344 INFO:tasks.workunit.client.0.smithi112.stdout:6/996: creat d9/d1f/d47/d34/da6/da7/dcf/d21/f172 x:0 0 0 2024-09-21T00:57:09.347 INFO:tasks.workunit.client.0.smithi112.stdout:1/940: symlink d5/d8/dd/d8e/dca/df1/dfb/l139 0 2024-09-21T00:57:09.348 INFO:tasks.workunit.client.0.smithi112.stdout:0/986: getdents d8/d1b/d2c/d2e/d4c/d6b 0 2024-09-21T00:57:09.348 INFO:tasks.workunit.client.0.smithi112.stdout:1/941: chown d5/d8/dd/d97/d46/fa2 2 1 2024-09-21T00:57:09.349 INFO:tasks.workunit.client.0.smithi112.stdout:1/942: chown d5/d34/d6a/fba 40442536 1 2024-09-21T00:57:09.350 INFO:tasks.workunit.client.0.smithi112.stdout:5/842: mknod d8/d9/d13/d2a/d84/c113 0 2024-09-21T00:57:09.351 INFO:tasks.workunit.client.0.smithi112.stdout:2/982: fsync d0/d14/d8/d27/d7a/de3/f133 0 2024-09-21T00:57:09.352 INFO:tasks.workunit.client.0.smithi112.stdout:2/983: fsync d0/d14/d8/d27/f108 0 2024-09-21T00:57:09.353 INFO:tasks.workunit.client.0.smithi112.stdout:4/990: getdents d1/d7/d9/d1a 0 2024-09-21T00:57:09.354 INFO:tasks.workunit.client.0.smithi112.stdout:4/991: stat d1/d5/d1c/db3/f13e 0 2024-09-21T00:57:09.355 INFO:tasks.workunit.client.0.smithi112.stdout:4/992: stat d1/d7/d9/d1a/d8e/ffe 0 2024-09-21T00:57:09.364 INFO:tasks.workunit.client.0.smithi112.stdout:2/984: mkdir d0/d14/d8/da2/daa/d136/d147 0 2024-09-21T00:57:09.364 INFO:tasks.workunit.client.0.smithi112.stdout:6/997: write d9/d1f/d3e/d77/f37 [3542534,8650] 0 2024-09-21T00:57:09.368 INFO:tasks.workunit.client.0.smithi112.stdout:1/943: mknod d5/d8/dd/d97/d46/d70/d12e/c13a 0 2024-09-21T00:57:09.370 INFO:tasks.workunit.client.0.smithi112.stdout:5/843: link d8/d9/d13/d2a/d58/dc4/f100 d8/d9/d13/d1c/d45/f114 0 2024-09-21T00:57:09.371 INFO:tasks.workunit.client.0.smithi112.stdout:5/844: chown d8/d9/d13/d2a/da1 33070 1 2024-09-21T00:57:09.372 INFO:tasks.workunit.client.0.smithi112.stdout:4/993: mkdir d1/d5/d1c/d1e/d3d/d145 0 2024-09-21T00:57:09.372 INFO:tasks.workunit.client.0.smithi112.stdout:0/987: link d8/d1b/fdd d8/d1b/d2c/f131 0 2024-09-21T00:57:09.374 INFO:tasks.workunit.client.0.smithi112.stdout:1/944: unlink d5/d3a/d4b/de9/l109 0 2024-09-21T00:57:09.376 INFO:tasks.workunit.client.0.smithi112.stdout:5/845: creat d8/d9/d13/d1c/d45/d8a/f115 x:0 0 0 2024-09-21T00:57:09.378 INFO:tasks.workunit.client.0.smithi112.stdout:2/985: dread d0/d45/d8a/f6f [0,4194304] 0 2024-09-21T00:57:09.379 INFO:tasks.workunit.client.0.smithi112.stdout:0/988: rename d8/d11/d28/dbf/lf3 to d8/d1b/d2c/d2e/d4c/l132 0 2024-09-21T00:57:09.379 INFO:tasks.workunit.client.0.smithi112.stdout:2/986: chown d0/d45/db9 22037609 1 2024-09-21T00:57:09.380 INFO:tasks.workunit.client.0.smithi112.stdout:4/994: mknod d1/d7/df7/c146 0 2024-09-21T00:57:09.385 INFO:tasks.workunit.client.0.smithi112.stdout:5/846: creat d8/d9/d13/d1c/d99/f116 x:0 0 0 2024-09-21T00:57:09.386 INFO:tasks.workunit.client.0.smithi112.stdout:5/847: dread - d8/d9/f5d zero size 2024-09-21T00:57:09.387 INFO:tasks.workunit.client.0.smithi112.stdout:2/987: fsync d0/d14/dbe/fe1 0 2024-09-21T00:57:09.475 INFO:tasks.workunit.client.0.smithi112.stdout:7/956: sync 2024-09-21T00:57:09.542 INFO:tasks.workunit.client.0.smithi112.stdout:5/848: rename d8/d9/dcd/ddb/l101 to d8/d9/d13/d2a/d2c/l117 0 2024-09-21T00:57:09.543 INFO:tasks.workunit.client.0.smithi112.stdout:1/945: link d5/d8/d13/d87/cee d5/d8/dd/d97/d46/d70/c13b 0 2024-09-21T00:57:09.543 INFO:tasks.workunit.client.0.smithi112.stdout:4/995: chown d1/d5/d1c/db3/d12c/d13a/cf3 29760 1 2024-09-21T00:57:09.545 INFO:tasks.workunit.client.0.smithi112.stdout:6/998: dwrite d9/f12 [4194304,4194304] 0 2024-09-21T00:57:09.546 INFO:tasks.workunit.client.0.smithi112.stdout:5/849: write d8/d9/d13/d1c/dbc/fde [1288032,31485] 0 2024-09-21T00:57:09.546 INFO:tasks.workunit.client.0.smithi112.stdout:2/988: link d0/d60/d78/l7c d0/d14/d47/l148 0 2024-09-21T00:57:09.550 INFO:tasks.workunit.client.0.smithi112.stdout:2/989: write d0/d45/d8a/d99/f119 [193465,41674] 0 2024-09-21T00:57:09.552 INFO:tasks.workunit.client.0.smithi112.stdout:7/957: dwrite d0/d2/d32/fb7 [0,4194304] 0 2024-09-21T00:57:09.558 INFO:tasks.workunit.client.0.smithi112.stdout:2/990: dwrite d0/d14/d8/fb4 [0,4194304] 0 2024-09-21T00:57:09.652 INFO:tasks.workunit.client.0.smithi112.stdout:1/946: creat d5/d8/dd/d54/f13c x:0 0 0 2024-09-21T00:57:09.654 INFO:tasks.workunit.client.0.smithi112.stdout:6/999: read d9/df/d56/dde/f104 [30087,5408] 0 2024-09-21T00:57:09.654 INFO:tasks.workunit.client.0.smithi112.stdout:5/850: chown d8/d9/d13/d2a/df/d5b/dbe/fa6 236432 1 2024-09-21T00:57:09.655 INFO:tasks.workunit.client.0.smithi112.stdout:4/996: truncate d1/d7/d9/d1a/f78 987452 0 2024-09-21T00:57:09.657 INFO:tasks.workunit.client.0.smithi112.stdout:7/958: unlink d0/d2/d2e/df6/d39/d56/d65/d87/lc6 0 2024-09-21T00:57:09.659 INFO:tasks.workunit.client.0.smithi112.stdout:1/947: creat d5/d8/dd/d54/f13d x:0 0 0 2024-09-21T00:57:09.667 INFO:tasks.workunit.client.0.smithi112.stdout:5/851: creat d8/d9/dcd/ddb/f118 x:0 0 0 2024-09-21T00:57:09.667 INFO:tasks.workunit.client.0.smithi112.stdout:4/997: fsync d1/d7/d9/d1a/d22/d6e/f94 0 2024-09-21T00:57:09.669 INFO:tasks.workunit.client.0.smithi112.stdout:7/959: truncate d0/fa 1730520 0 2024-09-21T00:57:09.672 INFO:tasks.workunit.client.0.smithi112.stdout:1/948: symlink d5/d8/dd/d54/d5a/l13e 0 2024-09-21T00:57:09.708 INFO:tasks.workunit.client.0.smithi112.stdout:7/960: mknod d0/d2/d2e/df6/d39/d56/d65/d87/dd9/c13a 0 2024-09-21T00:57:09.708 INFO:tasks.workunit.client.0.smithi112.stdout:7/961: stat d0/d2/d2e/f5f 0 2024-09-21T00:57:09.709 INFO:tasks.workunit.client.0.smithi112.stdout:2/991: rename d0/d14/d22/d6d/l92 to d0/d14/l149 0 2024-09-21T00:57:09.714 INFO:tasks.workunit.client.0.smithi112.stdout:5/852: mkdir d8/d9/d13/d1c/d119 0 2024-09-21T00:57:09.790 INFO:tasks.workunit.client.0.smithi112.stdout:7/962: creat d0/d2/d2e/df6/d39/d1a/da5/f13b x:0 0 0 2024-09-21T00:57:09.790 INFO:tasks.workunit.client.0.smithi112.stdout:2/992: creat d0/d14/d8/da2/daa/d136/d46/d58/df5/f14a x:0 0 0 2024-09-21T00:57:09.792 INFO:tasks.workunit.client.0.smithi112.stdout:1/949: link d5/d8/d10/f29 d5/d68/f13f 0 2024-09-21T00:57:09.793 INFO:tasks.workunit.client.0.smithi112.stdout:5/853: creat d8/d9/d13/d2a/df/d5b/dbe/db6/f11a x:0 0 0 2024-09-21T00:57:09.794 INFO:tasks.workunit.client.0.smithi112.stdout:2/993: mknod d0/d14/d8/da2/daa/d136/d46/d58/df5/c14b 0 2024-09-21T00:57:09.796 INFO:tasks.workunit.client.0.smithi112.stdout:7/963: creat d0/d2/d104/f13c x:0 0 0 2024-09-21T00:57:09.798 INFO:tasks.workunit.client.0.smithi112.stdout:1/950: unlink d5/d34/d6a/ca4 0 2024-09-21T00:57:09.801 INFO:tasks.workunit.client.0.smithi112.stdout:5/854: dwrite d8/d9/d13/d2a/d84/d8b/f10d [0,4194304] 0 2024-09-21T00:57:09.803 INFO:tasks.workunit.client.0.smithi112.stdout:2/994: truncate d0/d14/d8/da2/daa/d136/d46/f68 1432980 0 2024-09-21T00:57:09.805 INFO:tasks.workunit.client.0.smithi112.stdout:2/995: read - d0/d45/d8a/f123 zero size 2024-09-21T00:57:09.808 INFO:tasks.workunit.client.0.smithi112.stdout:5/855: creat d8/d9/d13/d1c/dbc/d109/d10b/f11b x:0 0 0 2024-09-21T00:57:09.809 INFO:tasks.workunit.client.0.smithi112.stdout:7/964: write d0/d2/d2e/df6/d39/f35 [4553122,28942] 0 2024-09-21T00:57:09.813 INFO:tasks.workunit.client.0.smithi112.stdout:2/996: mkdir d0/d14/d8/da2/daa/d136/d46/d14c 0 2024-09-21T00:57:09.814 INFO:tasks.workunit.client.0.smithi112.stdout:5/856: truncate d8/d9/d13/d1c/f54 529880 0 2024-09-21T00:57:09.815 INFO:tasks.workunit.client.0.smithi112.stdout:1/951: dwrite d5/d34/fc1 [0,4194304] 0 2024-09-21T00:57:09.817 INFO:tasks.workunit.client.0.smithi112.stdout:2/997: unlink d0/d14/d22/c5c 0 2024-09-21T00:57:09.818 INFO:tasks.workunit.client.0.smithi112.stdout:1/952: truncate d5/d8/dd/d97/dd2/d10a/f9a 503284 0 2024-09-21T00:57:09.819 INFO:tasks.workunit.client.0.smithi112.stdout:7/965: link d0/l74 d0/d2/d2e/df6/d39/d56/l13d 0 2024-09-21T00:57:09.821 INFO:tasks.workunit.client.0.smithi112.stdout:2/998: fdatasync d0/d14/d8/da2/dba/dc1/fdd 0 2024-09-21T00:57:09.822 INFO:tasks.workunit.client.0.smithi112.stdout:1/953: mknod d5/d8/dd/d8e/de6/d111/c140 0 2024-09-21T00:57:09.826 INFO:tasks.workunit.client.0.smithi112.stdout:2/999: read d0/d14/d22/d6d/f13e [3741563,105487] 0 2024-09-21T00:57:09.829 INFO:tasks.workunit.client.0.smithi112.stdout:1/954: creat d5/d8/dd/d54/f141 x:0 0 0 2024-09-21T00:57:09.834 INFO:tasks.workunit.client.0.smithi112.stdout:1/955: read d5/d68/f13f [585329,104629] 0 2024-09-21T00:57:09.835 INFO:tasks.workunit.client.0.smithi112.stdout:1/956: chown d5/d8/dd/d97/d46/fac 0 1 2024-09-21T00:57:09.838 INFO:tasks.workunit.client.0.smithi112.stdout:5/857: dread d8/d9/f28 [0,4194304] 0 2024-09-21T00:57:09.839 INFO:tasks.workunit.client.0.smithi112.stdout:1/957: dread d5/d68/f102 [0,4194304] 0 2024-09-21T00:57:09.841 INFO:tasks.workunit.client.0.smithi112.stdout:7/966: dread d0/d2/d32/da4/db2/db4/dba/fe3 [0,4194304] 0 2024-09-21T00:57:09.845 INFO:tasks.workunit.client.0.smithi112.stdout:1/958: rename d5/d8/dd/l7c to d5/d8/dd/d8e/de6/d111/l142 0 2024-09-21T00:57:09.846 INFO:tasks.workunit.client.0.smithi112.stdout:1/959: dread d5/d68/f102 [0,4194304] 0 2024-09-21T00:57:09.846 INFO:tasks.workunit.client.0.smithi112.stdout:7/967: mkdir d0/d2/d2e/df6/d39/d56/d65/d75/de8/d13e 0 2024-09-21T00:57:09.852 INFO:tasks.workunit.client.0.smithi112.stdout:1/960: rename d5/d8/d13/d87/cb0 to d5/d3a/d4b/c143 0 2024-09-21T00:57:09.853 INFO:tasks.workunit.client.0.smithi112.stdout:7/968: fdatasync d0/d2/d38/d48/dad/fd6 0 2024-09-21T00:57:09.854 INFO:tasks.workunit.client.0.smithi112.stdout:1/961: chown d5/d3a/d121/f128 59576152 1 2024-09-21T00:57:09.855 INFO:tasks.workunit.client.0.smithi112.stdout:5/858: dwrite d8/d9/d13/f51 [0,4194304] 0 2024-09-21T00:57:09.864 INFO:tasks.workunit.client.0.smithi112.stdout:5/859: unlink d8/d9/d13/d2a/df/d5b/dbe/l105 0 2024-09-21T00:57:09.864 INFO:tasks.workunit.client.0.smithi112.stdout:7/969: dread d0/d2/f64 [0,4194304] 0 2024-09-21T00:57:09.873 INFO:tasks.workunit.client.0.smithi112.stdout:7/970: link d0/d2/d2e/df6/le9 d0/d2/d2e/df6/d39/d56/d65/d75/de8/l13f 0 2024-09-21T00:57:09.876 INFO:tasks.workunit.client.0.smithi112.stdout:1/962: truncate d5/d8/dd/d97/fa8 3046458 0 2024-09-21T00:57:09.877 INFO:tasks.workunit.client.0.smithi112.stdout:1/963: write d5/d8/f1f [1959751,51787] 0 2024-09-21T00:57:09.878 INFO:tasks.workunit.client.0.smithi112.stdout:5/860: write d8/d9/d13/d2a/d84/d8b/fa2 [595724,67828] 0 2024-09-21T00:57:09.885 INFO:tasks.workunit.client.0.smithi112.stdout:5/861: dwrite d8/d9/d13/d2a/df/d5b/dbe/f7e [0,4194304] 0 2024-09-21T00:57:09.885 INFO:tasks.workunit.client.0.smithi112.stdout:7/971: write d0/d2/d38/d48/dad/fd6 [747927,43793] 0 2024-09-21T00:57:09.889 INFO:tasks.workunit.client.0.smithi112.stdout:1/964: getdents d5 0 2024-09-21T00:57:09.889 INFO:tasks.workunit.client.0.smithi112.stdout:5/862: dread - d8/d9/d13/d1c/d45/d8a/ff9 zero size 2024-09-21T00:57:09.890 INFO:tasks.workunit.client.0.smithi112.stdout:7/972: dread - d0/d2/d2e/df6/d39/d56/d65/f105 zero size 2024-09-21T00:57:09.895 INFO:tasks.workunit.client.0.smithi112.stdout:1/965: getdents d5/d8/dd/d97 0 2024-09-21T00:57:09.896 INFO:tasks.workunit.client.0.smithi112.stdout:1/966: write d5/d8/dd/f4e [3499185,113008] 0 2024-09-21T00:57:09.902 INFO:tasks.workunit.client.0.smithi112.stdout:1/967: mkdir d5/d8/dd/d8e/dca/d125/d144 0 2024-09-21T00:57:09.904 INFO:tasks.workunit.client.0.smithi112.stdout:5/863: truncate d8/d9/d13/fb4 3624658 0 2024-09-21T00:57:09.905 INFO:tasks.workunit.client.0.smithi112.stdout:7/973: write d0/d2/d2e/f93 [91785,64450] 0 2024-09-21T00:57:09.909 INFO:tasks.workunit.client.0.smithi112.stdout:1/968: mkdir d5/d8/dd/d8e/de6/dff/d145 0 2024-09-21T00:57:09.910 INFO:tasks.workunit.client.0.smithi112.stdout:7/974: read - d0/d2/d38/fe5 zero size 2024-09-21T00:57:09.910 INFO:tasks.workunit.client.0.smithi112.stdout:1/969: chown d5/d8/dd/d8e/dca/d125 2 1 2024-09-21T00:57:09.912 INFO:tasks.workunit.client.0.smithi112.stdout:7/975: rmdir d0/d2 39 2024-09-21T00:57:09.912 INFO:tasks.workunit.client.0.smithi112.stdout:7/976: chown d0/d6e/fcd 1976403644 1 2024-09-21T00:57:09.913 INFO:tasks.workunit.client.0.smithi112.stdout:1/970: creat d5/d8/dd/d54/f146 x:0 0 0 2024-09-21T00:57:09.914 INFO:tasks.workunit.client.0.smithi112.stdout:1/971: read d5/d8/dd/d97/dd2/d10a/f9a [454575,41470] 0 2024-09-21T00:57:09.915 INFO:tasks.workunit.client.0.smithi112.stdout:5/864: creat d8/d9/d13/d2a/f11c x:0 0 0 2024-09-21T00:57:09.919 INFO:tasks.workunit.client.0.smithi112.stdout:1/972: dread d5/d8/da1/f11e [0,4194304] 0 2024-09-21T00:57:09.923 INFO:tasks.workunit.client.0.smithi112.stdout:5/865: rmdir d8/d9/d13/d1c/d45/d8a 39 2024-09-21T00:57:09.935 INFO:tasks.workunit.client.0.smithi112.stdout:5/866: creat d8/d9/d13/d1c/dbc/f11d x:0 0 0 2024-09-21T00:57:09.937 INFO:tasks.workunit.client.0.smithi112.stdout:7/977: dwrite d0/d6e/fcd [0,4194304] 0 2024-09-21T00:57:09.938 INFO:tasks.workunit.client.0.smithi112.stdout:1/973: dwrite d5/d34/d6a/fdd [0,4194304] 0 2024-09-21T00:57:09.940 INFO:tasks.workunit.client.0.smithi112.stdout:5/867: dread d8/d9/d13/d2a/df/d5b/f88 [0,4194304] 0 2024-09-21T00:57:09.945 INFO:tasks.workunit.client.0.smithi112.stdout:1/974: mknod d5/d68/df6/c147 0 2024-09-21T00:57:09.954 INFO:tasks.workunit.client.0.smithi112.stdout:1/975: mkdir d5/d8/dd/d97/df9/d148 0 2024-09-21T00:57:09.955 INFO:tasks.workunit.client.0.smithi112.stdout:7/978: creat d0/d2/d2e/df6/d39/d1a/f140 x:0 0 0 2024-09-21T00:57:09.959 INFO:tasks.workunit.client.0.smithi112.stdout:7/979: mkdir d0/d2/d2e/df6/d39/d56/d65/df4/d141 0 2024-09-21T00:57:09.981 INFO:tasks.workunit.client.0.smithi112.stdout:5/868: dread d8/d9/d13/d2a/d2c/d96/d9f/fc3 [0,4194304] 0 2024-09-21T00:57:09.982 INFO:tasks.workunit.client.0.smithi112.stdout:5/869: fsync d8/d9/d13/d2a/df/d5b/dbe/db6/ff8 0 2024-09-21T00:57:09.984 INFO:tasks.workunit.client.0.smithi112.stdout:1/976: write d5/d34/f42 [1037012,79711] 0 2024-09-21T00:57:09.987 INFO:tasks.workunit.client.0.smithi112.stdout:5/870: rename d8/d9/d13/d1c/d99/ff3 to d8/d9/d13/d2a/d2c/d96/f11e 0 2024-09-21T00:57:09.987 INFO:tasks.workunit.client.0.smithi112.stdout:1/977: mknod d5/d8/dd/d97/d46/d70/d12e/c149 0 2024-09-21T00:57:09.989 INFO:tasks.workunit.client.0.smithi112.stdout:1/978: readlink d5/d8/dd/d54/l7e 0 2024-09-21T00:57:09.989 INFO:tasks.workunit.client.0.smithi112.stdout:7/980: dwrite d0/d2/d2e/df6/d39/db3/d10e/f128 [0,4194304] 0 2024-09-21T00:57:09.992 INFO:tasks.workunit.client.0.smithi112.stdout:1/979: creat d5/d34/d6a/f14a x:0 0 0 2024-09-21T00:57:09.995 INFO:tasks.workunit.client.0.smithi112.stdout:1/980: stat d5/d8/dd/d8e/dca/df1/dfb/l136 0 2024-09-21T00:57:09.995 INFO:tasks.workunit.client.0.smithi112.stdout:5/871: dread d8/d9/d13/d2a/df/d5b/dbe/fa6 [0,4194304] 0 2024-09-21T00:57:09.999 INFO:tasks.workunit.client.0.smithi112.stdout:7/981: dwrite d0/d2/d2e/ded/ffb [0,4194304] 0 2024-09-21T00:57:10.005 INFO:tasks.workunit.client.0.smithi112.stdout:1/981: dwrite d5/d8/da1/fbd [0,4194304] 0 2024-09-21T00:57:10.006 INFO:tasks.workunit.client.0.smithi112.stdout:7/982: mkdir d0/d2/d2e/df6/de4/d142 0 2024-09-21T00:57:10.009 INFO:tasks.workunit.client.0.smithi112.stdout:8/978: sync 2024-09-21T00:57:10.011 INFO:tasks.workunit.client.0.smithi112.stdout:8/979: dread - d0/d13/d2a/d73/f107 zero size 2024-09-21T00:57:10.012 INFO:tasks.workunit.client.0.smithi112.stdout:1/982: unlink d5/d8/c6b 0 2024-09-21T00:57:10.013 INFO:tasks.workunit.client.0.smithi112.stdout:8/980: chown d0/d66/d88/c11a 291 1 2024-09-21T00:57:10.015 INFO:tasks.workunit.client.0.smithi112.stdout:8/981: chown d0/d13/dab/dc6/d100 12 1 2024-09-21T00:57:10.016 INFO:tasks.workunit.client.0.smithi112.stdout:7/983: dwrite d0/d2/d2e/df6/d39/d56/d65/d87/fbd [0,4194304] 0 2024-09-21T00:57:10.025 INFO:tasks.workunit.client.0.smithi112.stdout:4/998: sync 2024-09-21T00:57:10.026 INFO:tasks.workunit.client.0.smithi112.stdout:0/989: sync 2024-09-21T00:57:10.026 INFO:tasks.workunit.client.0.smithi112.stdout:8/982: creat d0/d13/d129/f13a x:0 0 0 2024-09-21T00:57:10.027 INFO:tasks.workunit.client.0.smithi112.stdout:0/990: write d8/d5f/f6f [5400,4966] 0 2024-09-21T00:57:10.030 INFO:tasks.workunit.client.0.smithi112.stdout:5/872: dread d8/d9/d13/d1c/f22 [0,4194304] 0 2024-09-21T00:57:10.031 INFO:tasks.workunit.client.0.smithi112.stdout:0/991: dread d8/d1b/d2c/f34 [0,4194304] 0 2024-09-21T00:57:10.031 INFO:tasks.workunit.client.0.smithi112.stdout:0/992: chown d8/d62 46747554 1 2024-09-21T00:57:10.032 INFO:tasks.workunit.client.0.smithi112.stdout:4/999: link d1/d7/d9/d1a/d22/d6e/c88 d1/d2d/d101/c147 0 2024-09-21T00:57:10.033 INFO:tasks.workunit.client.0.smithi112.stdout:0/993: fsync d8/d11/d28/dbf/dd3/f115 0 2024-09-21T00:57:10.035 INFO:tasks.workunit.client.0.smithi112.stdout:5/873: creat d8/d9/f11f x:0 0 0 2024-09-21T00:57:10.035 INFO:tasks.workunit.client.0.smithi112.stdout:0/994: mknod d8/d11/d28/dbf/dd3/dff/c133 0 2024-09-21T00:57:10.037 INFO:tasks.workunit.client.0.smithi112.stdout:0/995: mkdir d8/d11/d28/d134 0 2024-09-21T00:57:10.038 INFO:tasks.workunit.client.0.smithi112.stdout:8/983: dread d0/d13/d1b/f35 [0,4194304] 0 2024-09-21T00:57:10.039 INFO:tasks.workunit.client.0.smithi112.stdout:5/874: creat d8/d9/d13/d2a/df/d5b/f120 x:0 0 0 2024-09-21T00:57:10.043 INFO:tasks.workunit.client.0.smithi112.stdout:5/875: link d8/d9/d13/d2a/d84/d8b/dda/dea/c107 d8/d9/d13/d1c/d45/d8a/dc0/d10f/c121 0 2024-09-21T00:57:10.045 INFO:tasks.workunit.client.0.smithi112.stdout:5/876: mknod d8/d9/dcd/c122 0 2024-09-21T00:57:10.047 INFO:tasks.workunit.client.0.smithi112.stdout:5/877: symlink d8/d9/d13/d2a/d84/d8b/dda/dea/l123 0 2024-09-21T00:57:10.047 INFO:tasks.workunit.client.0.smithi112.stdout:5/878: write d8/d9/d13/d1c/d99/f63 [7226013,41174] 0 2024-09-21T00:57:10.056 INFO:tasks.workunit.client.0.smithi112.stdout:1/983: write d5/d8/dd/d8e/de6/d111/f119 [1249776,35161] 0 2024-09-21T00:57:10.057 INFO:tasks.workunit.client.0.smithi112.stdout:1/984: chown d5/d8/dd/d97/dd2/d10a/l10b 186 1 2024-09-21T00:57:10.063 INFO:tasks.workunit.client.0.smithi112.stdout:7/984: dwrite d0/d2/f68 [0,4194304] 0 2024-09-21T00:57:10.064 INFO:tasks.workunit.client.0.smithi112.stdout:1/985: dwrite d5/d8/dd/f4e [0,4194304] 0 2024-09-21T00:57:10.070 INFO:tasks.workunit.client.0.smithi112.stdout:7/985: dread - d0/f11e zero size 2024-09-21T00:57:10.074 INFO:tasks.workunit.client.0.smithi112.stdout:8/984: dwrite d0/f21 [8388608,4194304] 0 2024-09-21T00:57:10.074 INFO:tasks.workunit.client.0.smithi112.stdout:0/996: dwrite d8/d75/d91/d9b/d116/d128/f98 [0,4194304] 0 2024-09-21T00:57:10.080 INFO:tasks.workunit.client.0.smithi112.stdout:5/879: truncate d8/d9/d13/d2a/df/fbb 61764 0 2024-09-21T00:57:10.080 INFO:tasks.workunit.client.0.smithi112.stdout:8/985: rmdir d0/d13/d9f 39 2024-09-21T00:57:10.082 INFO:tasks.workunit.client.0.smithi112.stdout:8/986: chown d0/d13/d1b/d22/d61/c72 17089 1 2024-09-21T00:57:10.088 INFO:tasks.workunit.client.0.smithi112.stdout:7/986: write d0/d2/d38/fd3 [629011,91937] 0 2024-09-21T00:57:10.099 INFO:tasks.workunit.client.0.smithi112.stdout:0/997: write d8/d5f/f7d [873814,21364] 0 2024-09-21T00:57:10.099 INFO:tasks.workunit.client.0.smithi112.stdout:5/880: write d8/d9/d13/d1c/d45/d8a/ff9 [189286,74475] 0 2024-09-21T00:57:10.101 INFO:tasks.workunit.client.0.smithi112.stdout:5/881: readlink d8/d9/d13/d1c/d45/ldd 0 2024-09-21T00:57:10.107 INFO:tasks.workunit.client.0.smithi112.stdout:8/987: dwrite d0/d66/f6f [0,4194304] 0 2024-09-21T00:57:10.109 INFO:tasks.workunit.client.0.smithi112.stdout:7/987: rename d0/d2/d2e/df6/d39/d56/d65/f71 to d0/d2/d2e/ded/d11f/f143 0 2024-09-21T00:57:10.115 INFO:tasks.workunit.client.0.smithi112.stdout:7/988: mkdir d0/d2/d2e/dcf/dc3/d144 0 2024-09-21T00:57:10.117 INFO:tasks.workunit.client.0.smithi112.stdout:5/882: link d8/d9/f28 d8/d9/d13/d2a/d2c/d96/f124 0 2024-09-21T00:57:10.120 INFO:tasks.workunit.client.0.smithi112.stdout:7/989: creat d0/d2/d2e/df6/d39/d56/d65/d75/d9a/def/f145 x:0 0 0 2024-09-21T00:57:10.131 INFO:tasks.workunit.client.0.smithi112.stdout:8/988: dwrite d0/d13/dab/dc6/d100/f9e [0,4194304] 0 2024-09-21T00:57:10.132 INFO:tasks.workunit.client.0.smithi112.stdout:8/989: dread - d0/d13/d2a/d73/f107 zero size 2024-09-21T00:57:10.135 INFO:tasks.workunit.client.0.smithi112.stdout:8/990: chown d0/d13/d1b/d22/d2e/d34/dd6/f120 15938 1 2024-09-21T00:57:10.136 INFO:tasks.workunit.client.0.smithi112.stdout:5/883: dwrite d8/d9/d13/fb4 [0,4194304] 0 2024-09-21T00:57:10.139 INFO:tasks.workunit.client.0.smithi112.stdout:7/990: dread d0/d2/f31 [0,4194304] 0 2024-09-21T00:57:10.139 INFO:tasks.workunit.client.0.smithi112.stdout:8/991: chown d0/d13/d1b/d22/d2e/d34/lcf 219108 1 2024-09-21T00:57:10.142 INFO:tasks.workunit.client.0.smithi112.stdout:5/884: creat d8/d9/d13/de5/f125 x:0 0 0 2024-09-21T00:57:10.145 INFO:tasks.workunit.client.0.smithi112.stdout:7/991: creat d0/d2/d38/d48/f146 x:0 0 0 2024-09-21T00:57:10.150 INFO:tasks.workunit.client.0.smithi112.stdout:7/992: rename d0/d2/d2e/dcf/caa to d0/d2/d2e/df6/d39/d56/d65/df4/c147 0 2024-09-21T00:57:10.151 INFO:tasks.workunit.client.0.smithi112.stdout:7/993: stat d0/d2/d2e/df6/d39/d56/d65/df4/ce2 0 2024-09-21T00:57:10.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:09 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:57:10.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:09 smithi187 ceph-mon[34997]: Upgrade: Need to upgrade myself (mgr.smithi187.hpbgni) 2024-09-21T00:57:10.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:09 smithi187 ceph-mon[34997]: Upgrade: Need to upgrade myself (mgr.smithi187.hpbgni) 2024-09-21T00:57:10.178 INFO:tasks.workunit.client.0.smithi112.stdout:5/885: dread d8/d9/d13/d1c/d99/fb3 [0,4194304] 0 2024-09-21T00:57:10.179 INFO:tasks.workunit.client.0.smithi112.stdout:5/886: write d8/d9/f64 [6117769,112381] 0 2024-09-21T00:57:10.182 INFO:tasks.workunit.client.0.smithi112.stdout:5/887: creat d8/d9/d13/de5/f126 x:0 0 0 2024-09-21T00:57:10.186 INFO:tasks.workunit.client.0.smithi112.stdout:5/888: unlink d8/d9/d13/d2a/d84/c9a 0 2024-09-21T00:57:10.188 INFO:tasks.workunit.client.0.smithi112.stdout:5/889: chown d8/d9/d61/f7d 1481687 1 2024-09-21T00:57:10.189 INFO:tasks.workunit.client.0.smithi112.stdout:5/890: stat d8/d9/d13/d1c/d45 0 2024-09-21T00:57:10.191 INFO:tasks.workunit.client.0.smithi112.stdout:5/891: fsync d8/d9/d13/d2a/df/d5b/dbe/f7e 0 2024-09-21T00:57:10.191 INFO:tasks.workunit.client.0.smithi112.stdout:7/994: dwrite d0/d2/d2e/df6/f90 [0,4194304] 0 2024-09-21T00:57:10.192 INFO:tasks.workunit.client.0.smithi112.stdout:5/892: readlink d8/d9/d13/d1c/d45/ldd 0 2024-09-21T00:57:10.192 INFO:tasks.workunit.client.0.smithi112.stdout:7/995: readlink d0/d2/d32/l100 0 2024-09-21T00:57:10.193 INFO:tasks.workunit.client.0.smithi112.stdout:7/996: chown d0/d2/f7a 148524091 1 2024-09-21T00:57:10.202 INFO:tasks.workunit.client.0.smithi112.stdout:5/893: write d8/d9/f5d [699832,107747] 0 2024-09-21T00:57:10.205 INFO:tasks.workunit.client.0.smithi112.stdout:5/894: creat d8/d9/d13/d2a/d84/d8b/f127 x:0 0 0 2024-09-21T00:57:10.207 INFO:tasks.workunit.client.0.smithi112.stdout:7/997: dwrite d0/d2/d2e/ded/d11f/f143 [0,4194304] 0 2024-09-21T00:57:10.210 INFO:tasks.workunit.client.0.smithi112.stdout:7/998: write d0/d2/d2e/df6/de4/d126/f130 [25980,30988] 0 2024-09-21T00:57:10.215 INFO:tasks.workunit.client.0.smithi112.stdout:7/999: getdents d0/d2/d2e 0 2024-09-21T00:57:10.242 INFO:tasks.workunit.client.0.smithi112.stdout:5/895: dread d8/d9/d13/d1c/f53 [0,4194304] 0 2024-09-21T00:57:10.248 INFO:tasks.workunit.client.0.smithi112.stdout:5/896: dwrite d8/d9/d13/d2a/d84/d8b/fa2 [0,4194304] 0 2024-09-21T00:57:10.251 INFO:tasks.workunit.client.0.smithi112.stdout:5/897: fsync d8/d9/d13/d2a/d2c/f69 0 2024-09-21T00:57:10.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:09 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:57:10.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:09 smithi112 ceph-mon[28078]: Upgrade: Need to upgrade myself (mgr.smithi187.hpbgni) 2024-09-21T00:57:10.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:09 smithi112 ceph-mon[28078]: Upgrade: Need to upgrade myself (mgr.smithi187.hpbgni) 2024-09-21T00:57:10.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/898: truncate d8/d9/d13/d1c/f91 966448 0 2024-09-21T00:57:10.267 INFO:tasks.workunit.client.0.smithi112.stdout:5/899: mkdir d8/d9/d128 0 2024-09-21T00:57:10.268 INFO:tasks.workunit.client.0.smithi112.stdout:5/900: truncate d8/d9/d13/d2a/df/f112 265546 0 2024-09-21T00:57:10.269 INFO:tasks.workunit.client.0.smithi112.stdout:5/901: write d8/d9/d13/d1c/d45/d8a/f115 [721733,126993] 0 2024-09-21T00:57:10.274 INFO:tasks.workunit.client.0.smithi112.stdout:5/902: link d8/d9/d13/d1c/d99/c95 d8/d9/d13/d1c/d45/d8a/dc0/c129 0 2024-09-21T00:57:10.279 INFO:tasks.workunit.client.0.smithi112.stdout:5/903: creat d8/d9/d13/d2a/f12a x:0 0 0 2024-09-21T00:57:10.279 INFO:tasks.workunit.client.0.smithi112.stdout:5/904: stat d8/d9/d13/d2a/d84/d8b/dda/dea 0 2024-09-21T00:57:10.604 INFO:tasks.workunit.client.0.smithi112.stdout:1/986: sync 2024-09-21T00:57:10.604 INFO:tasks.workunit.client.0.smithi112.stdout:1/987: write d5/d8/dd/d97/fe2 [655589,59795] 0 2024-09-21T00:57:10.606 INFO:tasks.workunit.client.0.smithi112.stdout:1/988: mkdir d5/d3a/d121/d14b 0 2024-09-21T00:57:10.608 INFO:tasks.workunit.client.0.smithi112.stdout:1/989: mknod d5/d8/c14c 0 2024-09-21T00:57:10.614 INFO:tasks.workunit.client.0.smithi112.stdout:1/990: dwrite d5/d34/ffa [0,4194304] 0 2024-09-21T00:57:10.619 INFO:tasks.workunit.client.0.smithi112.stdout:1/991: mknod d5/d8/dd/d8e/de6/dfc/c14d 0 2024-09-21T00:57:10.621 INFO:tasks.workunit.client.0.smithi112.stdout:1/992: creat d5/d68/df6/f14e x:0 0 0 2024-09-21T00:57:10.622 INFO:tasks.workunit.client.0.smithi112.stdout:1/993: write d5/d68/f138 [406367,103619] 0 2024-09-21T00:57:10.624 INFO:tasks.workunit.client.0.smithi112.stdout:1/994: creat d5/d8/dd/d8e/f14f x:0 0 0 2024-09-21T00:57:10.628 INFO:tasks.workunit.client.0.smithi112.stdout:1/995: link d5/d8/da1/fdb d5/d8/dd/d8e/de6/dff/f150 0 2024-09-21T00:57:10.630 INFO:tasks.workunit.client.0.smithi112.stdout:1/996: truncate d5/d8/d13/d87/fdc 5114514 0 2024-09-21T00:57:10.631 INFO:tasks.workunit.client.0.smithi112.stdout:1/997: stat d5/d8/dd/d8e/dca/leb 0 2024-09-21T00:57:10.646 INFO:tasks.workunit.client.0.smithi112.stdout:1/998: dwrite d5/d8/d10/f8d [0,4194304] 0 2024-09-21T00:57:10.651 INFO:tasks.workunit.client.0.smithi112.stdout:1/999: symlink d5/d8/dd/d97/l151 0 2024-09-21T00:57:10.674 INFO:tasks.workunit.client.0.smithi112.stdout:8/992: sync 2024-09-21T00:57:10.674 INFO:tasks.workunit.client.0.smithi112.stdout:0/998: sync 2024-09-21T00:57:10.675 INFO:tasks.workunit.client.0.smithi112.stdout:8/993: fsync d0/d13/dab/dc6/d100/f9e 0 2024-09-21T00:57:10.676 INFO:tasks.workunit.client.0.smithi112.stdout:8/994: write d0/d66/f6f [1429412,97383] 0 2024-09-21T00:57:10.701 INFO:tasks.workunit.client.0.smithi112.stdout:0/999: rmdir d8/d1b/d2c/d2e 39 2024-09-21T00:57:10.703 INFO:tasks.workunit.client.0.smithi112.stdout:8/995: mknod d0/d13/d1b/d22/d42/c13b 0 2024-09-21T00:57:10.833 INFO:tasks.workunit.client.0.smithi112.stdout:5/905: sync 2024-09-21T00:57:10.834 INFO:tasks.workunit.client.0.smithi112.stdout:5/906: truncate d8/d9/d13/d2a/d84/d8b/f127 706388 0 2024-09-21T00:57:10.836 INFO:tasks.workunit.client.0.smithi112.stdout:5/907: unlink d8/d9/f9b 0 2024-09-21T00:57:10.838 INFO:tasks.workunit.client.0.smithi112.stdout:5/908: creat d8/d9/d128/f12b x:0 0 0 2024-09-21T00:57:10.839 INFO:tasks.workunit.client.0.smithi112.stdout:5/909: readlink d8/d9/d13/d1c/d45/ldd 0 2024-09-21T00:57:10.846 INFO:tasks.workunit.client.0.smithi112.stdout:5/910: unlink d8/d9/d13/d2a/df/d5b/dbe/fa4 0 2024-09-21T00:57:10.853 INFO:tasks.workunit.client.0.smithi112.stdout:8/996: sync 2024-09-21T00:57:10.858 INFO:tasks.workunit.client.0.smithi112.stdout:5/911: getdents d8/d9/d13/d1c/dbc/d109 0 2024-09-21T00:57:10.867 INFO:tasks.workunit.client.0.smithi112.stdout:8/997: truncate d0/d13/d1b/d22/d42/f78 4827946 0 2024-09-21T00:57:10.868 INFO:tasks.workunit.client.0.smithi112.stdout:5/912: dread - d8/d9/d13/de5/f125 zero size 2024-09-21T00:57:10.871 INFO:tasks.workunit.client.0.smithi112.stdout:5/913: write d8/d9/d13/d1c/dbc/fde [2133677,81688] 0 2024-09-21T00:57:10.871 INFO:tasks.workunit.client.0.smithi112.stdout:8/998: creat d0/d13/d1b/d22/f13c x:0 0 0 2024-09-21T00:57:10.876 INFO:tasks.workunit.client.0.smithi112.stdout:5/914: rename d8/f9d to d8/d9/d13/d1c/f12c 0 2024-09-21T00:57:10.889 INFO:tasks.workunit.client.0.smithi112.stdout:8/999: dread d0/d13/d1b/d22/d2e/d34/d7b/f71 [0,4194304] 0 2024-09-21T00:57:10.896 INFO:tasks.workunit.client.0.smithi112.stdout:5/915: rename d8/d9/d13/d2a/da1/cf4 to d8/d9/d13/d2a/df/d5b/dbe/c12d 0 2024-09-21T00:57:10.897 INFO:tasks.workunit.client.0.smithi112.stdout:5/916: fdatasync d8/d9/d13/d1c/d45/d8a/f115 0 2024-09-21T00:57:10.907 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T00:57:10.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-21T00:57:11.103 INFO:tasks.workunit.client.0.smithi112.stdout:5/917: sync 2024-09-21T00:57:11.104 INFO:tasks.workunit.client.0.smithi112.stdout:5/918: rmdir d8/d9/d61 39 2024-09-21T00:57:11.105 INFO:tasks.workunit.client.0.smithi112.stdout:5/919: read d8/d9/d13/d1c/d45/d8a/dc0/fd0 [34692,55466] 0 2024-09-21T00:57:11.115 INFO:tasks.workunit.client.0.smithi112.stdout:5/920: symlink d8/d9/l12e 0 2024-09-21T00:57:11.122 INFO:tasks.workunit.client.0.smithi112.stdout:5/921: dwrite d8/d9/d13/d1c/d45/fe1 [0,4194304] 0 2024-09-21T00:57:11.140 INFO:tasks.workunit.client.0.smithi112.stdout:5/922: write d8/d9/d13/d2a/f18 [2494541,13244] 0 2024-09-21T00:57:11.145 INFO:tasks.workunit.client.0.smithi112.stdout:5/923: mknod d8/d9/d13/d2a/df/d5b/dbe/db6/c12f 0 2024-09-21T00:57:11.150 INFO:tasks.workunit.client.0.smithi112.stdout:5/924: rename d8/d9/l3e to d8/d9/d13/d2a/dab/l130 0 2024-09-21T00:57:11.155 INFO:tasks.workunit.client.0.smithi112.stdout:5/925: write d8/d9/d13/d2a/d84/d8b/f127 [1410781,39566] 0 2024-09-21T00:57:11.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:10 smithi187 ceph-mon[34997]: pgmap v38: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 81 MiB/s wr, 249 op/s 2024-09-21T00:57:11.164 INFO:tasks.workunit.client.0.smithi112.stdout:5/926: dwrite d8/d9/d13/d2a/d2c/d96/f11e [0,4194304] 0 2024-09-21T00:57:11.167 INFO:tasks.workunit.client.0.smithi112.stdout:5/927: write d8/d9/d13/d2a/d58/f5e [5214614,78596] 0 2024-09-21T00:57:11.187 INFO:tasks.workunit.client.0.smithi112.stdout:5/928: dwrite d8/fa [0,4194304] 0 2024-09-21T00:57:11.190 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:10 smithi112 ceph-mon[28078]: pgmap v38: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 81 MiB/s wr, 249 op/s 2024-09-21T00:57:11.204 INFO:tasks.workunit.client.0.smithi112.stdout:5/929: dread d8/d9/d13/f86 [4194304,4194304] 0 2024-09-21T00:57:11.207 INFO:tasks.workunit.client.0.smithi112.stdout:5/930: mkdir d8/d9/dcd/ddb/d131 0 2024-09-21T00:57:11.207 INFO:tasks.workunit.client.0.smithi112.stdout:5/931: stat d8/d9/d13/d2a/df/fd6 0 2024-09-21T00:57:11.211 INFO:tasks.workunit.client.0.smithi112.stdout:5/932: creat d8/d9/d13/d2a/d84/d8b/dda/dea/f132 x:0 0 0 2024-09-21T00:57:11.214 INFO:tasks.workunit.client.0.smithi112.stdout:5/933: unlink d8/d9/d13/d2a/d84/d8b/dda/dea/f132 0 2024-09-21T00:57:11.214 INFO:tasks.workunit.client.0.smithi112.stdout:5/934: readlink d8/d9/la8 0 2024-09-21T00:57:11.221 INFO:tasks.workunit.client.0.smithi112.stdout:5/935: dwrite d8/d9/d13/d2a/f11c [0,4194304] 0 2024-09-21T00:57:11.227 INFO:tasks.workunit.client.0.smithi112.stdout:5/936: mknod d8/d9/d61/c133 0 2024-09-21T00:57:11.228 INFO:tasks.workunit.client.0.smithi112.stdout:5/937: symlink d8/d9/d13/de5/l134 0 2024-09-21T00:57:11.230 INFO:tasks.workunit.client.0.smithi112.stdout:5/938: dread - d8/fbd zero size 2024-09-21T00:57:11.231 INFO:tasks.workunit.client.0.smithi112.stdout:5/939: dread - d8/d9/d13/d2a/fd8 zero size 2024-09-21T00:57:11.245 INFO:tasks.workunit.client.0.smithi112.stdout:5/940: dwrite d8/d9/d13/d2a/df/fbb [0,4194304] 0 2024-09-21T00:57:11.250 INFO:tasks.workunit.client.0.smithi112.stdout:5/941: write d8/f5f [7615301,39296] 0 2024-09-21T00:57:11.252 INFO:tasks.workunit.client.0.smithi112.stdout:5/942: fdatasync d8/d9/d13/f86 0 2024-09-21T00:57:11.254 INFO:tasks.workunit.client.0.smithi112.stdout:5/943: write d8/d9/d13/d2a/d84/d8b/dda/dea/ffb [815605,98472] 0 2024-09-21T00:57:11.259 INFO:tasks.workunit.client.0.smithi112.stdout:5/944: getdents d8/d9/d13/d1c 0 2024-09-21T00:57:11.262 INFO:tasks.workunit.client.0.smithi112.stdout:5/945: fsync d8/d9/d13/d1c/fb2 0 2024-09-21T00:57:11.264 INFO:tasks.workunit.client.0.smithi112.stdout:5/946: chown d8/d9/d13/d1c/d45/d8a/dc0/c129 12572889 1 2024-09-21T00:57:11.271 INFO:tasks.workunit.client.0.smithi112.stdout:5/947: dwrite d8/d9/d13/d2a/d84/d8b/f10d [0,4194304] 0 2024-09-21T00:57:11.274 INFO:tasks.workunit.client.0.smithi112.stdout:5/948: mkdir d8/d9/d13/d2a/d58/dc4/d135 0 2024-09-21T00:57:11.275 INFO:tasks.workunit.client.0.smithi112.stdout:5/949: read d8/fa [3110687,70293] 0 2024-09-21T00:57:11.278 INFO:tasks.workunit.client.0.smithi112.stdout:5/950: rename d8/d9/d13/d1c/d99/fad to d8/d9/d13/d2a/df/db5/f136 0 2024-09-21T00:57:11.284 INFO:tasks.workunit.client.0.smithi112.stdout:5/951: dwrite d8/d9/d13/de5/f126 [0,4194304] 0 2024-09-21T00:57:11.756 INFO:tasks.workunit.client.0.smithi112.stdout:5/952: sync 2024-09-21T00:57:11.757 INFO:tasks.workunit.client.0.smithi112.stdout:5/953: write d8/d9/d13/f51 [79526,30460] 0 2024-09-21T00:57:11.761 INFO:tasks.workunit.client.0.smithi112.stdout:5/954: rename d8/d9/d13/d1c/d45/ldd to d8/d9/d13/d1c/d45/d8a/dc0/l137 0 2024-09-21T00:57:11.762 INFO:tasks.workunit.client.0.smithi112.stdout:5/955: write d8/d9/d13/d2a/df/fe7 [1012004,106519] 0 2024-09-21T00:57:11.765 INFO:tasks.workunit.client.0.smithi112.stdout:5/956: mknod d8/d9/d13/d1c/dbc/d109/d10b/c138 0 2024-09-21T00:57:11.769 INFO:tasks.workunit.client.0.smithi112.stdout:5/957: rename d8/d9/d13/d1c/d45/d8a/f115 to d8/d9/d13/f139 0 2024-09-21T00:57:11.773 INFO:tasks.workunit.client.0.smithi112.stdout:5/958: getdents d8/d9/d13/d2a/d2c/d96/d9f 0 2024-09-21T00:57:11.774 INFO:tasks.workunit.client.0.smithi112.stdout:5/959: dread - d8/d9/d13/d2a/da1/f10c zero size 2024-09-21T00:57:11.776 INFO:tasks.workunit.client.0.smithi112.stdout:5/960: mkdir d8/d9/dcd/def/d13a 0 2024-09-21T00:57:11.778 INFO:tasks.workunit.client.0.smithi112.stdout:5/961: creat d8/d9/d13/d1c/dbc/df6/f13b x:0 0 0 2024-09-21T00:57:11.780 INFO:tasks.workunit.client.0.smithi112.stdout:5/962: mkdir d8/d9/d13/d2a/df/db5/d13c 0 2024-09-21T00:57:11.781 INFO:tasks.workunit.client.0.smithi112.stdout:5/963: write d8/d9/d13/d2a/df/d5b/dbe/f103 [629811,4116] 0 2024-09-21T00:57:11.784 INFO:tasks.workunit.client.0.smithi112.stdout:5/964: mknod d8/d9/d13/d2a/dab/c13d 0 2024-09-21T00:57:11.785 INFO:tasks.workunit.client.0.smithi112.stdout:5/965: fdatasync d8/d9/d13/d2a/d84/d8b/fe4 0 2024-09-21T00:57:11.791 INFO:tasks.workunit.client.0.smithi112.stdout:5/966: dwrite d8/d9/d13/d1c/d45/d8a/dc0/fcc [0,4194304] 0 2024-09-21T00:57:11.792 INFO:tasks.workunit.client.0.smithi112.stdout:5/967: write d8/d9/d13/de5/f126 [4308593,104790] 0 2024-09-21T00:57:11.801 INFO:tasks.workunit.client.0.smithi112.stdout:5/968: write d8/d9/d13/d2a/f6d [95263,108858] 0 2024-09-21T00:57:11.812 INFO:tasks.workunit.client.0.smithi112.stdout:5/969: truncate d8/d9/d13/d2a/d84/d8b/f10d 2729711 0 2024-09-21T00:57:11.814 INFO:tasks.workunit.client.0.smithi112.stdout:5/970: chown d8/d9/d13/d2a/da1/lbf 171 1 2024-09-21T00:57:11.817 INFO:tasks.workunit.client.0.smithi112.stdout:5/971: creat d8/d9/d13/d2a/df/d5b/f13e x:0 0 0 2024-09-21T00:57:11.826 INFO:tasks.workunit.client.0.smithi112.stdout:5/972: truncate d8/d9/d13/d2a/d58/f5e 18088 0 2024-09-21T00:57:11.827 INFO:tasks.workunit.client.0.smithi112.stdout:5/973: mknod d8/d9/d13/d2a/d84/d8b/dda/c13f 0 2024-09-21T00:57:11.830 INFO:tasks.workunit.client.0.smithi112.stdout:5/974: getdents d8/d9/d13/d2a/d2c/d96/d9f 0 2024-09-21T00:57:11.836 INFO:tasks.workunit.client.0.smithi112.stdout:5/975: write d8/d9/d13/d1c/d45/d8a/dc0/fd0 [1006034,20158] 0 2024-09-21T00:57:12.109 INFO:tasks.workunit.client.0.smithi112.stdout:5/976: sync 2024-09-21T00:57:12.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.139+0000 7f8289fa7640 1 -- 172.21.15.112:0/3696118987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8284073290 msgr2=0x7f8284073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.139+0000 7f8289fa7640 1 --2- 172.21.15.112:0/3696118987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8284073290 0x7f8284073690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8278009880 tx=0x7f827802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.140+0000 7f8289fa7640 1 -- 172.21.15.112:0/3696118987 shutdown_connections 2024-09-21T00:57:12.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.140+0000 7f8289fa7640 1 --2- 172.21.15.112:0/3696118987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82841091f0 0x7f8284109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.140+0000 7f8289fa7640 1 --2- 172.21.15.112:0/3696118987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8284073290 0x7f8284073690 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.140+0000 7f8289fa7640 1 -- 172.21.15.112:0/3696118987 >> 172.21.15.112:0/3696118987 conn(0x7f828406ea00 msgr2=0x7f8284070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:12.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.141+0000 7f8289fa7640 1 -- 172.21.15.112:0/3696118987 shutdown_connections 2024-09-21T00:57:12.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.141+0000 7f8289fa7640 1 -- 172.21.15.112:0/3696118987 wait complete. 2024-09-21T00:57:12.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.141+0000 7f8289fa7640 1 Processor -- start 2024-09-21T00:57:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.142+0000 7f8289fa7640 1 -- start start 2024-09-21T00:57:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.142+0000 7f8289fa7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8284073290 0x7f82841a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.142+0000 7f8289fa7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82841091f0 0x7f82841a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.142+0000 7f8289fa7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8284119640 con 0x7f82841091f0 2024-09-21T00:57:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.142+0000 7f8289fa7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f82841194c0 con 0x7f8284073290 2024-09-21T00:57:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.142+0000 7f82837fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8284073290 0x7f82841a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.143+0000 7f82837fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8284073290 0x7f82841a6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:51110/0 (socket says 172.21.15.112:51110) 2024-09-21T00:57:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.143+0000 7f82837fe640 1 -- 172.21.15.112:0/2192352195 learned_addr learned my addr 172.21.15.112:0/2192352195 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.143+0000 7f82837fe640 1 -- 172.21.15.112:0/2192352195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82841091f0 msgr2=0x7f82841a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.143+0000 7f82837fe640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82841091f0 0x7f82841a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.143+0000 7f82837fe640 1 -- 172.21.15.112:0/2192352195 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82841a6ee0 con 0x7f8284073290 2024-09-21T00:57:12.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.143+0000 7f82837fe640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8284073290 0x7f82841a6320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f827802aa90 tx=0x7f82780048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.144+0000 7f8280ff9640 1 -- 172.21.15.112:0/2192352195 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f827803f070 con 0x7f8284073290 2024-09-21T00:57:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.144+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82841ab8c0 con 0x7f8284073290 2024-09-21T00:57:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.144+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82841abed0 con 0x7f8284073290 2024-09-21T00:57:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.144+0000 7f8280ff9640 1 -- 172.21.15.112:0/2192352195 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8278004c70 con 0x7f8284073290 2024-09-21T00:57:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.144+0000 7f8280ff9640 1 -- 172.21.15.112:0/2192352195 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8278035030 con 0x7f8284073290 2024-09-21T00:57:12.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.146+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82700052c0 con 0x7f8284073290 2024-09-21T00:57:12.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.147+0000 7f8280ff9640 1 -- 172.21.15.112:0/2192352195 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f8278042070 con 0x7f8284073290 2024-09-21T00:57:12.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.148+0000 7f8280ff9640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f826c074ad0 0x7f826c076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.148+0000 7f8280ff9640 1 -- 172.21.15.112:0/2192352195 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7f82780b6f40 con 0x7f8284073290 2024-09-21T00:57:12.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.148+0000 7f8282ffd640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f826c074ad0 0x7f826c076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.149+0000 7f8282ffd640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f826c074ad0 0x7f826c076f90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82841a77d0 tx=0x7f827c009250 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:12.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.158+0000 7f8280ff9640 1 -- 172.21.15.112:0/2192352195 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f82780824f0 con 0x7f8284073290 2024-09-21T00:57:12.307 INFO:tasks.workunit.client.0.smithi112.stdout:5/977: sync 2024-09-21T00:57:12.308 INFO:tasks.workunit.client.0.smithi112.stdout:5/978: read d8/d9/f5d [530495,83668] 0 2024-09-21T00:57:12.311 INFO:tasks.workunit.client.0.smithi112.stdout:5/979: creat d8/d9/d13/d2a/d2c/f140 x:0 0 0 2024-09-21T00:57:12.312 INFO:tasks.workunit.client.0.smithi112.stdout:5/980: symlink d8/d9/dcd/l141 0 2024-09-21T00:57:12.314 INFO:tasks.workunit.client.0.smithi112.stdout:5/981: mkdir d8/d9/d13/d2a/df/d142 0 2024-09-21T00:57:12.315 INFO:tasks.workunit.client.0.smithi112.stdout:5/982: symlink d8/d9/d13/de5/l143 0 2024-09-21T00:57:12.325 INFO:tasks.workunit.client.0.smithi112.stdout:5/983: write f7 [1269183,101047] 0 2024-09-21T00:57:12.332 INFO:tasks.workunit.client.0.smithi112.stdout:5/984: truncate d8/d9/d13/d2a/d84/d8b/f50 3961010 0 2024-09-21T00:57:12.335 INFO:tasks.workunit.client.0.smithi112.stdout:5/985: rename d8/d9/d13/d2a/d2c/c44 to d8/d9/d13/d2a/d58/c144 0 2024-09-21T00:57:12.339 INFO:tasks.workunit.client.0.smithi112.stdout:5/986: creat d8/d9/d13/d2a/d58/dc4/d135/f145 x:0 0 0 2024-09-21T00:57:12.343 INFO:tasks.workunit.client.0.smithi112.stdout:5/987: getdents d8/d9/d13/d2a/d2c/d96/d9f 0 2024-09-21T00:57:12.347 INFO:tasks.workunit.client.0.smithi112.stdout:5/988: unlink d8/d9/d13/d2a/df/db5/f136 0 2024-09-21T00:57:12.349 INFO:tasks.workunit.client.0.smithi112.stdout:5/989: creat d8/d9/d13/d2a/df/d5b/dbe/db6/f146 x:0 0 0 2024-09-21T00:57:12.351 INFO:tasks.workunit.client.0.smithi112.stdout:5/990: symlink d8/d9/d13/d1c/l147 0 2024-09-21T00:57:12.352 INFO:tasks.workunit.client.0.smithi112.stdout:5/991: mknod d8/d9/d13/d2a/da1/c148 0 2024-09-21T00:57:12.356 INFO:tasks.workunit.client.0.smithi112.stdout:5/992: creat d8/d9/d13/d2a/df/d142/f149 x:0 0 0 2024-09-21T00:57:12.358 INFO:tasks.workunit.client.0.smithi112.stdout:5/993: truncate d8/d9/d13/d2a/df/d5b/dbe/f103 1158518 0 2024-09-21T00:57:12.366 INFO:tasks.workunit.client.0.smithi112.stdout:5/994: dread d8/d9/d13/d1c/d99/fb3 [0,4194304] 0 2024-09-21T00:57:12.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.393+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8270000bf0 con 0x7f826c074ad0 2024-09-21T00:57:12.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.395+0000 7f8280ff9640 1 -- 172.21.15.112:0/2192352195 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f8270000bf0 con 0x7f826c074ad0 2024-09-21T00:57:12.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f826c074ad0 msgr2=0x7f826c076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f826c074ad0 0x7f826c076f90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82841a77d0 tx=0x7f827c009250 comp rx=0 tx=0).stop 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8284073290 msgr2=0x7f82841a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8284073290 0x7f82841a6320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f827802aa90 tx=0x7f82780048f0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 shutdown_connections 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f826c074ad0 0x7f826c076f90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82841091f0 0x7f82841a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 --2- 172.21.15.112:0/2192352195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8284073290 0x7f82841a6320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 >> 172.21.15.112:0/2192352195 conn(0x7f828406ea00 msgr2=0x7f828410c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 shutdown_connections 2024-09-21T00:57:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.397+0000 7f8289fa7640 1 -- 172.21.15.112:0/2192352195 wait complete. 2024-09-21T00:57:12.406 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:57:12.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.483+0000 7f1cbce37640 1 -- 172.21.15.112:0/870475558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 msgr2=0x7f1cb8101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.483+0000 7f1cbce37640 1 --2- 172.21.15.112:0/870475558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 0x7f1cb8101ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009880 tx=0x7f1cac02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.484+0000 7f1cbce37640 1 -- 172.21.15.112:0/870475558 shutdown_connections 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.484+0000 7f1cbce37640 1 --2- 172.21.15.112:0/870475558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 0x7f1cb8101ec0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.484+0000 7f1cbce37640 1 --2- 172.21.15.112:0/870475558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 0x7f1cb8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.484+0000 7f1cbce37640 1 -- 172.21.15.112:0/870475558 >> 172.21.15.112:0/870475558 conn(0x7f1cb80fbff0 msgr2=0x7f1cb80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.484+0000 7f1cbce37640 1 -- 172.21.15.112:0/870475558 shutdown_connections 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.484+0000 7f1cbce37640 1 -- 172.21.15.112:0/870475558 wait complete. 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.484+0000 7f1cbce37640 1 Processor -- start 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cbce37640 1 -- start start 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cbce37640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 0x7f1cb806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cbce37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 0x7f1cb819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cbce37640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb8109680 con 0x7f1cb8101a40 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cbce37640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb8109500 con 0x7f1cb8100840 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 0x7f1cb819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 0x7f1cb806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 0x7f1cb806a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:51140/0 (socket says 172.21.15.112:51140) 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb659c640 1 -- 172.21.15.112:0/2001152834 learned_addr learned my addr 172.21.15.112:0/2001152834 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 0x7f1cb819e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55890/0 (socket says 172.21.15.112:55890) 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb659c640 1 -- 172.21.15.112:0/2001152834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 msgr2=0x7f1cb819e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb659c640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 0x7f1cb819e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb659c640 1 -- 172.21.15.112:0/2001152834 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb819eb30 con 0x7f1cb8100840 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.485+0000 7f1cb659c640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 0x7f1cb806a620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800e970 tx=0x7f1ca800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.486+0000 7f1ca77fe640 1 -- 172.21.15.112:0/2001152834 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ca800cac0 con 0x7f1cb8100840 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.486+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb819ed00 con 0x7f1cb8100840 2024-09-21T00:57:12.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.486+0000 7f1ca77fe640 1 -- 172.21.15.112:0/2001152834 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ca800cc60 con 0x7f1cb8100840 2024-09-21T00:57:12.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.486+0000 7f1ca77fe640 1 -- 172.21.15.112:0/2001152834 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ca8003e20 con 0x7f1cb8100840 2024-09-21T00:57:12.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.486+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb819f1b0 con 0x7f1cb8100840 2024-09-21T00:57:12.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.487+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb8100c40 con 0x7f1cb8100840 2024-09-21T00:57:12.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.487+0000 7f1ca77fe640 1 -- 172.21.15.112:0/2001152834 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f1ca8003fc0 con 0x7f1cb8100840 2024-09-21T00:57:12.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.488+0000 7f1ca77fe640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f1ca0074a80 0x7f1ca0076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.488+0000 7f1ca77fe640 1 -- 172.21.15.112:0/2001152834 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7f1ca8096910 con 0x7f1cb8100840 2024-09-21T00:57:12.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.488+0000 7f1cb5d9b640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f1ca0074a80 0x7f1ca0076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.489+0000 7f1cb5d9b640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f1ca0074a80 0x7f1ca0076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1cac000c00 tx=0x7f1cac005a20 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:12.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.493+0000 7f1ca77fe640 1 -- 172.21.15.112:0/2001152834 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1ca8061dd0 con 0x7f1cb8100840 2024-09-21T00:57:12.558 INFO:tasks.workunit.client.0.smithi112.stdout:5/995: sync 2024-09-21T00:57:12.559 INFO:tasks.workunit.client.0.smithi112.stdout:5/996: readlink d8/d9/d13/d2a/d2c/d96/lff 0 2024-09-21T00:57:12.565 INFO:tasks.workunit.client.0.smithi112.stdout:5/997: rename d8/d9/d13/d1c/c6a to d8/d9/dcd/c14a 0 2024-09-21T00:57:12.573 INFO:tasks.workunit.client.0.smithi112.stdout:5/998: truncate d8/d9/d13/d1c/dbc/df6/f13b 661358 0 2024-09-21T00:57:12.578 INFO:tasks.workunit.client.0.smithi112.stdout:5/999: link d8/d9/d13/d2a/d84/d8b/fa2 d8/d9/d13/d1c/dbc/df6/f14b 0 2024-09-21T00:57:12.582 INFO:tasks.workunit.client.0.smithi112.stderr:+ rm -rf -- ./tmp.3izx1crvHW 2024-09-21T00:57:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.718+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1cb8062630 con 0x7f1ca0074a80 2024-09-21T00:57:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.720+0000 7f1ca77fe640 1 -- 172.21.15.112:0/2001152834 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f1cb8062630 con 0x7f1ca0074a80 2024-09-21T00:57:12.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f1ca0074a80 msgr2=0x7f1ca0076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f1ca0074a80 0x7f1ca0076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1cac000c00 tx=0x7f1cac005a20 comp rx=0 tx=0).stop 2024-09-21T00:57:12.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 msgr2=0x7f1cb806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 0x7f1cb806a620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800e970 tx=0x7f1ca800ee30 comp rx=0 tx=0).stop 2024-09-21T00:57:12.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 shutdown_connections 2024-09-21T00:57:12.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f1ca0074a80 0x7f1ca0076f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cb8101a40 0x7f1cb819e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 --2- 172.21.15.112:0/2001152834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cb8100840 0x7f1cb806a620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 >> 172.21.15.112:0/2001152834 conn(0x7f1cb80fbff0 msgr2=0x7f1cb8104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:12.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 shutdown_connections 2024-09-21T00:57:12.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.722+0000 7f1cbce37640 1 -- 172.21.15.112:0/2001152834 wait complete. 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.824+0000 7f3c4d153640 1 -- 172.21.15.112:0/3726461962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48100840 msgr2=0x7f3c48100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.824+0000 7f3c4d153640 1 --2- 172.21.15.112:0/3726461962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48100840 0x7f3c48100c40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009880 tx=0x7f3c3802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.824+0000 7f3c4d153640 1 -- 172.21.15.112:0/3726461962 shutdown_connections 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.824+0000 7f3c4d153640 1 --2- 172.21.15.112:0/3726461962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c48101a40 0x7f3c48101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.824+0000 7f3c4d153640 1 --2- 172.21.15.112:0/3726461962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48100840 0x7f3c48100c40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.825+0000 7f3c4d153640 1 -- 172.21.15.112:0/3726461962 >> 172.21.15.112:0/3726461962 conn(0x7f3c480fbff0 msgr2=0x7f3c480fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.825+0000 7f3c4d153640 1 -- 172.21.15.112:0/3726461962 shutdown_connections 2024-09-21T00:57:12.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.825+0000 7f3c4d153640 1 -- 172.21.15.112:0/3726461962 wait complete. 2024-09-21T00:57:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.825+0000 7f3c4d153640 1 Processor -- start 2024-09-21T00:57:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4d153640 1 -- start start 2024-09-21T00:57:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4d153640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c48100840 0x7f3c4806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4d153640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48101a40 0x7f3c4819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4d153640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48109680 con 0x7f3c48101a40 2024-09-21T00:57:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4d153640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48109500 con 0x7f3c48100840 2024-09-21T00:57:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48101a40 0x7f3c4819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48101a40 0x7f3c4819c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55900/0 (socket says 172.21.15.112:55900) 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c4659c640 1 -- 172.21.15.112:0/810206511 learned_addr learned my addr 172.21.15.112:0/810206511 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.826+0000 7f3c46d9d640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c48100840 0x7f3c4806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c46d9d640 1 -- 172.21.15.112:0/810206511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48101a40 msgr2=0x7f3c4819c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c46d9d640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48101a40 0x7f3c4819c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c46d9d640 1 -- 172.21.15.112:0/810206511 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4819c7b0 con 0x7f3c48100840 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c46d9d640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c48100840 0x7f3c4806a620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c3802a9c0 tx=0x7f3c380045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c2ffff640 1 -- 172.21.15.112:0/810206511 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c3803f070 con 0x7f3c48100840 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c2ffff640 1 -- 172.21.15.112:0/810206511 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c380049d0 con 0x7f3c48100840 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c2ffff640 1 -- 172.21.15.112:0/810206511 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c38035030 con 0x7f3c48100840 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.827+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4819ca40 con 0x7f3c48100840 2024-09-21T00:57:12.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.828+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4819cf70 con 0x7f3c48100840 2024-09-21T00:57:12.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.829+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c48100c40 con 0x7f3c48100840 2024-09-21T00:57:12.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.830+0000 7f3c2ffff640 1 -- 172.21.15.112:0/810206511 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f3c38042070 con 0x7f3c48100840 2024-09-21T00:57:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.830+0000 7f3c2ffff640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3c30074a30 0x7f3c30076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.831+0000 7f3c2ffff640 1 -- 172.21.15.112:0/810206511 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7f3c380b6e10 con 0x7f3c48100840 2024-09-21T00:57:12.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.831+0000 7f3c4659c640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3c30074a30 0x7f3c30076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:12.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.831+0000 7f3c4659c640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3c30074a30 0x7f3c30076ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c4806a3a0 tx=0x7f3c3c005f90 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:12.835+0000 7f3c2ffff640 1 -- 172.21.15.112:0/810206511 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3c38082250 con 0x7f3c48100840 2024-09-21T00:57:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:12 smithi112 ceph-mon[28078]: pgmap v39: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 136 MiB/s wr, 404 op/s 2024-09-21T00:57:13.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.107+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3c48062630 con 0x7f3c30074a30 2024-09-21T00:57:13.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.117+0000 7f3c2ffff640 1 -- 172.21.15.112:0/810206511 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3c48062630 con 0x7f3c30074a30 2024-09-21T00:57:13.117 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (7m) 52s ago 8m 25.4M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 starting - - - - 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 starting - - - - 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (8m) 52s ago 8m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (7m) 66s ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 52s ago 8m 79.4M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (3m) 52s ago 3m 153M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (3m) 52s ago 3m 13.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (3m) 66s ago 3m 16.3M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (3m) 66s ago 3m 14.1M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:9283,8765,8443 running (9m) 52s ago 9m 297M - 19.1.1-373-g4e45e6b4 164465d2334a c587f79e18b3 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (91s) 66s ago 7m 564M - 19.3.0-5120-g18432218 ddce307e1f32 9ab97a4dd8af 2024-09-21T00:57:13.118 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (9m) 52s ago 9m 53.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (7m) 66s ago 7m 39.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 52s ago 8m 15.6M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (7m) 66s ago 7m 16.5M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (6m) 52s ago 6m 72.7M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (6m) 52s ago 6m 101M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (5m) 52s ago 5m 73.6M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (5m) 66s ago 5m 80.7M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (4m) 66s ago 4m 72.1M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (4m) 66s ago 4m 86.5M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:57:13.119 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 starting - - - - 2024-09-21T00:57:13.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.120+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3c30074a30 msgr2=0x7f3c30076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.120+0000 7f3c4d153640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3c30074a30 0x7f3c30076ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c4806a3a0 tx=0x7f3c3c005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:13.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.120+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c48100840 msgr2=0x7f3c4806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.120+0000 7f3c4d153640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c48100840 0x7f3c4806a620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c3802a9c0 tx=0x7f3c380045e0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.121+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 shutdown_connections 2024-09-21T00:57:13.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.121+0000 7f3c4d153640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7f3c30074a30 0x7f3c30076ef0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.121+0000 7f3c4d153640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c48101a40 0x7f3c4819c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.121+0000 7f3c4d153640 1 --2- 172.21.15.112:0/810206511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c48100840 0x7f3c4806a620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.121+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 >> 172.21.15.112:0/810206511 conn(0x7f3c480fbff0 msgr2=0x7f3c48104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:13.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.121+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 shutdown_connections 2024-09-21T00:57:13.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.121+0000 7f3c4d153640 1 -- 172.21.15.112:0/810206511 wait complete. 2024-09-21T00:57:13.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:12 smithi187 ceph-mon[34997]: pgmap v39: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 136 MiB/s wr, 404 op/s 2024-09-21T00:57:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 -- 172.21.15.112:0/2703485284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c100840 msgr2=0x7fd00c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 --2- 172.21.15.112:0/2703485284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c100840 0x7fd00c100c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009880 tx=0x7fcffc02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 -- 172.21.15.112:0/2703485284 shutdown_connections 2024-09-21T00:57:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 --2- 172.21.15.112:0/2703485284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c101a40 0x7fd00c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 --2- 172.21.15.112:0/2703485284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c100840 0x7fd00c100c40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 -- 172.21.15.112:0/2703485284 >> 172.21.15.112:0/2703485284 conn(0x7fd00c0fbff0 msgr2=0x7fd00c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 -- 172.21.15.112:0/2703485284 shutdown_connections 2024-09-21T00:57:13.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.229+0000 7fd01152c640 1 -- 172.21.15.112:0/2703485284 wait complete. 2024-09-21T00:57:13.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd01152c640 1 Processor -- start 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd01152c640 1 -- start start 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd01152c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c100840 0x7fd00c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd01152c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c101a40 0x7fd00c19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd01152c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c109680 con 0x7fd00c101a40 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd01152c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c109500 con 0x7fd00c100840 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd00a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c101a40 0x7fd00c19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd00a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c101a40 0x7fd00c19c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55916/0 (socket says 172.21.15.112:55916) 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd00a7fc640 1 -- 172.21.15.112:0/3243339585 learned_addr learned my addr 172.21.15.112:0/3243339585 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.230+0000 7fd00affd640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c100840 0x7fd00c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fd00a7fc640 1 -- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c100840 msgr2=0x7fd00c06a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fd00a7fc640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c100840 0x7fd00c06a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fd00a7fc640 1 -- 172.21.15.112:0/3243339585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c19c7e0 con 0x7fd00c101a40 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fd00affd640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c100840 0x7fd00c06a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fd00a7fc640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c101a40 0x7fd00c19c220 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd00000e970 tx=0x7fd00000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fcff3fff640 1 -- 172.21.15.112:0/3243339585 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd00000cac0 con 0x7fd00c101a40 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00c19cad0 con 0x7fd00c101a40 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fcff3fff640 1 -- 172.21.15.112:0/3243339585 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0000054e0 con 0x7fd00c101a40 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.231+0000 7fcff3fff640 1 -- 172.21.15.112:0/3243339585 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd000010430 con 0x7fd00c101a40 2024-09-21T00:57:13.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.232+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00c19d060 con 0x7fd00c101a40 2024-09-21T00:57:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.233+0000 7fcff3fff640 1 -- 172.21.15.112:0/3243339585 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fd000004ec0 con 0x7fd00c101a40 2024-09-21T00:57:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.233+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00c100c40 con 0x7fd00c101a40 2024-09-21T00:57:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.233+0000 7fcff3fff640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcff4074a30 0x7fcff4076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.234+0000 7fcff3fff640 1 -- 172.21.15.112:0/3243339585 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fd0000963b0 con 0x7fd00c101a40 2024-09-21T00:57:13.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.234+0000 7fd00affd640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcff4074a30 0x7fcff4076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.234+0000 7fd00affd640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcff4074a30 0x7fcff4076ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009230 tx=0x7fcffc0058d0 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:13.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.238+0000 7fcff3fff640 1 -- 172.21.15.112:0/3243339585 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd0000617c0 con 0x7fd00c101a40 2024-09-21T00:57:13.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.668+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd00c062df0 con 0x7fd00c101a40 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.669+0000 7fcff3fff640 1 -- 172.21.15.112:0/3243339585 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fd000066670 con 0x7fd00c101a40 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:57:13.670 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:57:13.671 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:57:13.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcff4074a30 msgr2=0x7fcff4076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcff4074a30 0x7fcff4076ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009230 tx=0x7fcffc0058d0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c101a40 msgr2=0x7fd00c19c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c101a40 0x7fd00c19c220 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd00000e970 tx=0x7fd00000ed70 comp rx=0 tx=0).stop 2024-09-21T00:57:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 shutdown_connections 2024-09-21T00:57:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fcff4074a30 0x7fcff4076ef0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd00c101a40 0x7fd00c19c220 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 --2- 172.21.15.112:0/3243339585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c100840 0x7fd00c06a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.672+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 >> 172.21.15.112:0/3243339585 conn(0x7fd00c0fbff0 msgr2=0x7fd00c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:13.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.673+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 shutdown_connections 2024-09-21T00:57:13.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.673+0000 7fd01152c640 1 -- 172.21.15.112:0/3243339585 wait complete. 2024-09-21T00:57:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 -- 172.21.15.112:0/3112036992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa344101e10 msgr2=0x7fa344102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 --2- 172.21.15.112:0/3112036992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa344101e10 0x7fa344102210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa334009880 tx=0x7fa33402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 -- 172.21.15.112:0/3112036992 shutdown_connections 2024-09-21T00:57:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 --2- 172.21.15.112:0/3112036992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3441027e0 0x7fa3440ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 --2- 172.21.15.112:0/3112036992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa344101e10 0x7fa344102210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 -- 172.21.15.112:0/3112036992 >> 172.21.15.112:0/3112036992 conn(0x7fa3440fb750 msgr2=0x7fa3440fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 -- 172.21.15.112:0/3112036992 shutdown_connections 2024-09-21T00:57:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.785+0000 7fa34982c640 1 -- 172.21.15.112:0/3112036992 wait complete. 2024-09-21T00:57:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.786+0000 7fa34982c640 1 Processor -- start 2024-09-21T00:57:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.786+0000 7fa34982c640 1 -- start start 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa34982c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa344101e10 0x7fa3441996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa34982c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3441027e0 0x7fa344199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa34982c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa34410c980 con 0x7fa344101e10 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa34982c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa34410c800 con 0x7fa3441027e0 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa3427fc640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3441027e0 0x7fa344199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa3427fc640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3441027e0 0x7fa344199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:51196/0 (socket says 172.21.15.112:51196) 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa3427fc640 1 -- 172.21.15.112:0/3723274480 learned_addr learned my addr 172.21.15.112:0/3723274480 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa342ffd640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa344101e10 0x7fa3441996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa3427fc640 1 -- 172.21.15.112:0/3723274480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa344101e10 msgr2=0x7fa3441996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa3427fc640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa344101e10 0x7fa3441996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa3427fc640 1 -- 172.21.15.112:0/3723274480 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34419a270 con 0x7fa3441027e0 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa342ffd640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa344101e10 0x7fa3441996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa3427fc640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3441027e0 0x7fa344199bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa33800e920 tx=0x7fa33800ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.787+0000 7fa34882a640 1 -- 172.21.15.112:0/3723274480 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa33800cb80 con 0x7fa3441027e0 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.788+0000 7fa34882a640 1 -- 172.21.15.112:0/3723274480 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa33800cd20 con 0x7fa3441027e0 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.788+0000 7fa34882a640 1 -- 172.21.15.112:0/3723274480 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3380049d0 con 0x7fa3441027e0 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.788+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34419ecb0 con 0x7fa3441027e0 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.788+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa34419f1e0 con 0x7fa3441027e0 2024-09-21T00:57:13.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.789+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa344102210 con 0x7fa3441027e0 2024-09-21T00:57:13.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.790+0000 7fa34882a640 1 -- 172.21.15.112:0/3723274480 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fa338004020 con 0x7fa3441027e0 2024-09-21T00:57:13.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.790+0000 7fa34882a640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fa32c074a80 0x7fa32c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.791+0000 7fa34882a640 1 -- 172.21.15.112:0/3723274480 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5812+0+0 (secure 0 0 0) 0x7fa338096490 con 0x7fa3441027e0 2024-09-21T00:57:13.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.791+0000 7fa342ffd640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fa32c074a80 0x7fa32c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.791+0000 7fa342ffd640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fa32c074a80 0x7fa32c076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa334000c00 tx=0x7fa3340058d0 comp rx=0 tx=0).ready entity=mgr.24397 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:13.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:13.796+0000 7fa34882a640 1 -- 172.21.15.112:0/3723274480 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa3380619a0 con 0x7fa3441027e0 2024-09-21T00:57:14.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.050+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 --> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa3440626f0 con 0x7fa32c074a80 2024-09-21T00:57:14.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.052+0000 7fa34882a640 1 -- 172.21.15.112:0/3723274480 <== mgr.24397 v2:172.21.15.187:6828/2068672275 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fa3440626f0 con 0x7fa32c074a80 2024-09-21T00:57:14.053 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:57:14.053 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:57:14.053 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:57:14.053 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:57:14.053 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-21T00:57:14.053 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T00:57:14.054 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T00:57:14.054 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:57:14.054 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:57:14.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fa32c074a80 msgr2=0x7fa32c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fa32c074a80 0x7fa32c076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa334000c00 tx=0x7fa3340058d0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3441027e0 msgr2=0x7fa344199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:14.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3441027e0 0x7fa344199bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa33800e920 tx=0x7fa33800ede0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 shutdown_connections 2024-09-21T00:57:14.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:6828/2068672275,v1:172.21.15.187:6829/2068672275] conn(0x7fa32c074a80 0x7fa32c076f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3441027e0 0x7fa344199bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 --2- 172.21.15.112:0/3723274480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa344101e10 0x7fa3441996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:14.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 >> 172.21.15.112:0/3723274480 conn(0x7fa3440fb750 msgr2=0x7fa344109350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:14.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 shutdown_connections 2024-09-21T00:57:14.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:14.054+0000 7fa34982c640 1 -- 172.21.15.112:0/3723274480 wait complete. 2024-09-21T00:57:14.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:14.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.fzmyfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:57:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.fzmyfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:57:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:57:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:13 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3243339585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:57:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.fzmyfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:57:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.fzmyfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:57:14.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:57:14.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:14.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:13 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3243339585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:57:15.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:14 smithi187 ceph-mon[34997]: pgmap v40: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 91 MiB/s wr, 282 op/s 2024-09-21T00:57:15.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:14 smithi187 ceph-mon[34997]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:15.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:14 smithi187 ceph-mon[34997]: Upgrade: Updating mgr.smithi112.fzmyfw 2024-09-21T00:57:15.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:14 smithi187 ceph-mon[34997]: Deploying daemon mgr.smithi112.fzmyfw on smithi112 2024-09-21T00:57:15.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:14 smithi187 ceph-mon[34997]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:14 smithi112 ceph-mon[28078]: pgmap v40: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 91 MiB/s wr, 282 op/s 2024-09-21T00:57:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:14 smithi112 ceph-mon[28078]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:14 smithi112 ceph-mon[28078]: Upgrade: Updating mgr.smithi112.fzmyfw 2024-09-21T00:57:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:14 smithi112 ceph-mon[28078]: Deploying daemon mgr.smithi112.fzmyfw on smithi112 2024-09-21T00:57:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:14 smithi112 ceph-mon[28078]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:16.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:15 smithi112 ceph-mon[28078]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 99 MiB/s wr, 351 op/s 2024-09-21T00:57:16.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:15 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:16.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:15 smithi187 ceph-mon[34997]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 99 MiB/s wr, 351 op/s 2024-09-21T00:57:16.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:15 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:18 smithi112 ceph-mon[28078]: pgmap v42: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 29 MiB/s rd, 70 MiB/s wr, 236 op/s 2024-09-21T00:57:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:18 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:18 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:18 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:18.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:18 smithi187 ceph-mon[34997]: pgmap v42: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 29 MiB/s rd, 70 MiB/s wr, 236 op/s 2024-09-21T00:57:18.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:18 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:18.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:18 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:18.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:18 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:20.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:20 smithi187 ceph-mon[34997]: pgmap v43: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 63 MiB/s wr, 224 op/s 2024-09-21T00:57:20.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:20 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:20.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:20 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:20.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:20 smithi112 ceph-mon[28078]: pgmap v43: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 63 MiB/s wr, 224 op/s 2024-09-21T00:57:20.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:20 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:20.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:20 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:22.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:22 smithi187 ceph-mon[34997]: pgmap v44: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 26 MiB/s rd, 64 MiB/s wr, 278 op/s 2024-09-21T00:57:22.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:22 smithi112 ceph-mon[28078]: pgmap v44: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 26 MiB/s rd, 64 MiB/s wr, 278 op/s 2024-09-21T00:57:24.131 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:24.131 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:24.131 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:24.132 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:23 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:24.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:24.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:24.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:24.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:23 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:25.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:24 smithi187 ceph-mon[34997]: pgmap v45: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 2.1 MiB/s rd, 8.5 MiB/s wr, 122 op/s 2024-09-21T00:57:25.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:24 smithi187 ceph-mon[34997]: Standby manager daemon smithi112.fzmyfw restarted 2024-09-21T00:57:25.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:24 smithi187 ceph-mon[34997]: Standby manager daemon smithi112.fzmyfw started 2024-09-21T00:57:25.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:24 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/crt"}]: dispatch 2024-09-21T00:57:25.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:24 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:57:25.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:24 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/key"}]: dispatch 2024-09-21T00:57:25.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:24 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:57:25.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:24 smithi112 ceph-mon[28078]: pgmap v45: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 2.1 MiB/s rd, 8.5 MiB/s wr, 122 op/s 2024-09-21T00:57:25.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:24 smithi112 ceph-mon[28078]: Standby manager daemon smithi112.fzmyfw restarted 2024-09-21T00:57:25.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:24 smithi112 ceph-mon[28078]: Standby manager daemon smithi112.fzmyfw started 2024-09-21T00:57:25.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:24 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/crt"}]: dispatch 2024-09-21T00:57:25.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:24 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:57:25.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:24 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.fzmyfw/key"}]: dispatch 2024-09-21T00:57:25.217 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:24 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:57:26.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:25 smithi187 ceph-mon[34997]: mgrmap e26: smithi187.hpbgni(active, since 85s), standbys: smithi112.fzmyfw 2024-09-21T00:57:26.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:25 smithi187 ceph-mon[34997]: pgmap v46: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 2.1 MiB/s rd, 9.2 MiB/s wr, 169 op/s 2024-09-21T00:57:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:25 smithi112 ceph-mon[28078]: mgrmap e26: smithi187.hpbgni(active, since 85s), standbys: smithi112.fzmyfw 2024-09-21T00:57:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:25 smithi112 ceph-mon[28078]: pgmap v46: 65 pgs: 65 active+clean; 1.2 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 2.1 MiB/s rd, 9.2 MiB/s wr, 169 op/s 2024-09-21T00:57:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:57:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:28.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr fail", "who": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr fail", "who": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: Activating manager daemon smithi112.fzmyfw 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd='[{"prefix": "mgr fail", "who": "smithi187.hpbgni"}]': finished 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: mgrmap e27: smithi112.fzmyfw(active, starting, since 0.0119243s) 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:57:28.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: Manager daemon smithi112.fzmyfw is now available 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:57:28.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:28 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 172.21.15.187:0/1202883404' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr fail", "who": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "mgr fail", "who": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:57:28.521 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: Activating manager daemon smithi112.fzmyfw 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24397 ' entity='mgr.smithi187.hpbgni' cmd='[{"prefix": "mgr fail", "who": "smithi187.hpbgni"}]': finished 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: mgrmap e27: smithi112.fzmyfw(active, starting, since 0.0119243s) 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata", "id": "smithi187"}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi112.fzmyfw", "id": "smithi112.fzmyfw"}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T00:57:28.522 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: Manager daemon smithi112.fzmyfw is now available 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/mirror_snapshot_schedule"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:57:28.523 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:28 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.fzmyfw/trash_purge_schedule"}]: dispatch 2024-09-21T00:57:29.607 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:29 smithi112 ceph-mon[28078]: mgrmap e28: smithi112.fzmyfw(active, since 1.01472s) 2024-09-21T00:57:29.608 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:29 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:57:29.608 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:29 smithi112 ceph-mon[28078]: pgmap v3: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:29.859 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:29 smithi187 ceph-mon[34997]: mgrmap e28: smithi112.fzmyfw(active, since 1.01472s) 2024-09-21T00:57:29.860 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:29 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T00:57:29.860 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:29 smithi187 ceph-mon[34997]: pgmap v3: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:30.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:30 smithi187 ceph-mon[34997]: [21/Sep/2024:00:57:29] ENGINE Bus STARTING 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:30 smithi187 ceph-mon[34997]: [21/Sep/2024:00:57:29] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:30 smithi187 ceph-mon[34997]: [21/Sep/2024:00:57:29] ENGINE Error in HTTPServer.serve 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Traceback (most recent call last): 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._run(expiration_interval) 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: s = self.context.wrap_socket( 2024-09-21T00:57:30.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: return self.sslsocket_class._create( 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self.do_handshake() 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: self._sslobj.do_handshake() 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:30 smithi187 ceph-mon[34997]: [21/Sep/2024:00:57:29] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:30 smithi187 ceph-mon[34997]: [21/Sep/2024:00:57:29] ENGINE Bus STARTED 2024-09-21T00:57:30.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:30 smithi187 ceph-mon[34997]: pgmap v4: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:30 smithi112 ceph-mon[28078]: [21/Sep/2024:00:57:29] ENGINE Bus STARTING 2024-09-21T00:57:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:30 smithi112 ceph-mon[28078]: [21/Sep/2024:00:57:29] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T00:57:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:30 smithi112 ceph-mon[28078]: [21/Sep/2024:00:57:29] ENGINE Error in HTTPServer.serve 2024-09-21T00:57:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T00:57:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:57:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T00:57:31.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:57:31.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:30 smithi112 ceph-mon[28078]: [21/Sep/2024:00:57:29] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T00:57:31.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:30 smithi112 ceph-mon[28078]: [21/Sep/2024:00:57:29] ENGINE Bus STARTED 2024-09-21T00:57:31.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:30 smithi112 ceph-mon[28078]: pgmap v4: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:31.836 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T00:57:31.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T00:57:31.841 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:31 smithi112 ceph-mon[28078]: mgrmap e29: smithi112.fzmyfw(active, since 3s) 2024-09-21T00:57:31.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:31 smithi187 ceph-mon[34997]: mgrmap e29: smithi112.fzmyfw(active, since 3s) 2024-09-21T00:57:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:32 smithi112 ceph-mon[28078]: pgmap v5: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:32 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:32 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:32 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:33.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:32 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:33.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:32 smithi187 ceph-mon[34997]: pgmap v5: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:33.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:32 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:33.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:32 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:33.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:32 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:33.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:32 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:34.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:33 smithi187 ceph-mon[34997]: mgrmap e30: smithi112.fzmyfw(active, since 5s) 2024-09-21T00:57:34.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:33 smithi187 ceph-mon[34997]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:57:34.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:33 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:57:34.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:33 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:57:34.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:33 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:57:34.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:33 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:57:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:33 smithi112 ceph-mon[28078]: mgrmap e30: smithi112.fzmyfw(active, since 5s) 2024-09-21T00:57:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:33 smithi112 ceph-mon[28078]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:57:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:33 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:57:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:33 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:57:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:33 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:57:34.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:33 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/2688409000' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:57:35.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:34 smithi187 ceph-mon[34997]: pgmap v6: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:34 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi187.hpbgni", "id": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:57:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:34 smithi187 ceph-mon[34997]: mgrmap e31: smithi112.fzmyfw(active, since 6s), standbys: smithi187.hpbgni 2024-09-21T00:57:35.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:34 smithi112 ceph-mon[28078]: pgmap v6: 65 pgs: 65 active+clean; 882 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-09-21T00:57:35.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:34 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr metadata", "who": "smithi187.hpbgni", "id": "smithi187.hpbgni"}]: dispatch 2024-09-21T00:57:35.166 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:34 smithi112 ceph-mon[28078]: mgrmap e31: smithi112.fzmyfw(active, since 6s), standbys: smithi187.hpbgni 2024-09-21T00:57:37.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:36 smithi187 ceph-mon[34997]: pgmap v7: 65 pgs: 65 active+clean; 439 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.3 MiB/s wr, 91 op/s 2024-09-21T00:57:37.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:36 smithi112 ceph-mon[28078]: pgmap v7: 65 pgs: 65 active+clean; 439 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.3 MiB/s wr, 91 op/s 2024-09-21T00:57:39.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:38 smithi187 ceph-mon[34997]: pgmap v8: 65 pgs: 65 active+clean; 439 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-21T00:57:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:38 smithi112 ceph-mon[28078]: pgmap v8: 65 pgs: 65 active+clean; 439 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-21T00:57:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:40 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:40 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:40 smithi112 ceph-mon[28078]: pgmap v9: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-09-21T00:57:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:40 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:40 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:40.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:40 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:40 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:40 smithi187 ceph-mon[34997]: pgmap v9: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-09-21T00:57:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:40 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:40 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:42.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:42 smithi112 ceph-mon[28078]: pgmap v10: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 107 op/s 2024-09-21T00:57:42.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:42 smithi187 ceph-mon[34997]: pgmap v10: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 107 op/s 2024-09-21T00:57:43.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:43 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:44.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:43 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:44.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.146+0000 7f12070e5640 1 -- 172.21.15.112:0/2273275955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200101a40 msgr2=0x7f1200101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.146+0000 7f12070e5640 1 --2- 172.21.15.112:0/2273275955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200101a40 0x7f1200101ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009880 tx=0x7f11ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.146+0000 7f12070e5640 1 -- 172.21.15.112:0/2273275955 shutdown_connections 2024-09-21T00:57:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.146+0000 7f12070e5640 1 --2- 172.21.15.112:0/2273275955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200101a40 0x7f1200101ec0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.146+0000 7f12070e5640 1 --2- 172.21.15.112:0/2273275955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1200100840 0x7f1200100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.146+0000 7f12070e5640 1 -- 172.21.15.112:0/2273275955 >> 172.21.15.112:0/2273275955 conn(0x7f12000fbff0 msgr2=0x7f12000fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.147+0000 7f12070e5640 1 -- 172.21.15.112:0/2273275955 shutdown_connections 2024-09-21T00:57:44.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.147+0000 7f12070e5640 1 -- 172.21.15.112:0/2273275955 wait complete. 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.147+0000 7f12070e5640 1 Processor -- start 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.147+0000 7f12070e5640 1 -- start start 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f12070e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200100840 0x7f1200196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f12070e5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1200101a40 0x7f12001968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f12070e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1200109680 con 0x7f1200100840 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f12070e5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1200109500 con 0x7f1200101a40 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f1204e81640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200100840 0x7f1200196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f11fffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1200101a40 0x7f12001968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f1204e81640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200100840 0x7f1200196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55906/0 (socket says 172.21.15.112:55906) 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f1204e81640 1 -- 172.21.15.112:0/3946049202 learned_addr learned my addr 172.21.15.112:0/3946049202 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f11fffff640 1 -- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200100840 msgr2=0x7f1200196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f11fffff640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200100840 0x7f1200196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f11fffff640 1 -- 172.21.15.112:0/3946049202 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1200196f50 con 0x7f1200101a40 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f1204e81640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200100840 0x7f1200196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.148+0000 7f11fffff640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1200101a40 0x7f12001968d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11ec006010 tx=0x7f11ec0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.149+0000 7f11fdffb640 1 -- 172.21.15.112:0/3946049202 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11ec03f070 con 0x7f1200101a40 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.149+0000 7f11fdffb640 1 -- 172.21.15.112:0/3946049202 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11ec004a50 con 0x7f1200101a40 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.149+0000 7f11fdffb640 1 -- 172.21.15.112:0/3946049202 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11ec035030 con 0x7f1200101a40 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.149+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120019b930 con 0x7f1200101a40 2024-09-21T00:57:44.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.149+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120019bec0 con 0x7f1200101a40 2024-09-21T00:57:44.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.150+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1200100c40 con 0x7f1200101a40 2024-09-21T00:57:44.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.151+0000 7f11fdffb640 1 -- 172.21.15.112:0/3946049202 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f11ec042070 con 0x7f1200101a40 2024-09-21T00:57:44.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.152+0000 7f11fdffb640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f11f007b0b0 0x7f11f007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.152+0000 7f11fdffb640 1 -- 172.21.15.112:0/3946049202 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f11ec0bef00 con 0x7f1200101a40 2024-09-21T00:57:44.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.152+0000 7f1204e81640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f11f007b0b0 0x7f11f007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.152+0000 7f1204e81640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f11f007b0b0 0x7f11f007d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11f4005fd0 tx=0x7f11f400b410 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.156+0000 7f11fdffb640 1 -- 172.21.15.112:0/3946049202 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f11ec004c00 con 0x7f1200101a40 2024-09-21T00:57:44.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.386+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1200062740 con 0x7f11f007b0b0 2024-09-21T00:57:44.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.387+0000 7f11fdffb640 1 -- 172.21.15.112:0/3946049202 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f1200062740 con 0x7f11f007b0b0 2024-09-21T00:57:44.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f11f007b0b0 msgr2=0x7f11f007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f11f007b0b0 0x7f11f007d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11f4005fd0 tx=0x7f11f400b410 comp rx=0 tx=0).stop 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1200101a40 msgr2=0x7f12001968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1200101a40 0x7f12001968d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11ec006010 tx=0x7f11ec0045e0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 shutdown_connections 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f11f007b0b0 0x7f11f007d570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1200101a40 0x7f12001968d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 --2- 172.21.15.112:0/3946049202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1200100840 0x7f1200196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 >> 172.21.15.112:0/3946049202 conn(0x7f12000fbff0 msgr2=0x7f1200104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 shutdown_connections 2024-09-21T00:57:44.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.390+0000 7f12070e5640 1 -- 172.21.15.112:0/3946049202 wait complete. 2024-09-21T00:57:44.403 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 -- 172.21.15.112:0/889092543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868102430 msgr2=0x7f5868104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 --2- 172.21.15.112:0/889092543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868102430 0x7f5868104820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5858009880 tx=0x7f585802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 -- 172.21.15.112:0/889092543 shutdown_connections 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 --2- 172.21.15.112:0/889092543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5868104d60 0x7f5868107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 --2- 172.21.15.112:0/889092543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868102430 0x7f5868104820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 -- 172.21.15.112:0/889092543 >> 172.21.15.112:0/889092543 conn(0x7f58680fbff0 msgr2=0x7f58680fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 -- 172.21.15.112:0/889092543 shutdown_connections 2024-09-21T00:57:44.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 -- 172.21.15.112:0/889092543 wait complete. 2024-09-21T00:57:44.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.493+0000 7f586dca3640 1 Processor -- start 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f586dca3640 1 -- start start 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f586dca3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5868102430 0x7f5868101d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f586dca3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868104d60 0x7f58681003e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f5866ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868104d60 0x7f58681003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f586dca3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f586810a7a0 con 0x7f5868104d60 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f586dca3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f586810a620 con 0x7f5868102430 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f5866ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868104d60 0x7f58681003e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55924/0 (socket says 172.21.15.112:55924) 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f5866ffd640 1 -- 172.21.15.112:0/1843965221 learned_addr learned my addr 172.21.15.112:0/1843965221 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.494+0000 7f58677fe640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5868102430 0x7f5868101d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f5866ffd640 1 -- 172.21.15.112:0/1843965221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5868102430 msgr2=0x7f5868101d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f5866ffd640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5868102430 0x7f5868101d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f5866ffd640 1 -- 172.21.15.112:0/1843965221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5868100920 con 0x7f5868104d60 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f5866ffd640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868104d60 0x7f58681003e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f585c00b3d0 tx=0x7f585c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f5864ff9640 1 -- 172.21.15.112:0/1843965221 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f585c015020 con 0x7f5868104d60 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f5864ff9640 1 -- 172.21.15.112:0/1843965221 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f585c011af0 con 0x7f5868104d60 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f5864ff9640 1 -- 172.21.15.112:0/1843965221 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f585c010d30 con 0x7f5868104d60 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5868100c10 con 0x7f5868104d60 2024-09-21T00:57:44.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.495+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5868101220 con 0x7f5868104d60 2024-09-21T00:57:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.496+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5868102810 con 0x7f5868104d60 2024-09-21T00:57:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.497+0000 7f5864ff9640 1 -- 172.21.15.112:0/1843965221 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f585c018020 con 0x7f5868104d60 2024-09-21T00:57:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.497+0000 7f5864ff9640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f585007b0b0 0x7f585007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.498+0000 7f5864ff9640 1 -- 172.21.15.112:0/1843965221 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f585c09db30 con 0x7f5868104d60 2024-09-21T00:57:44.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.498+0000 7f58677fe640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f585007b0b0 0x7f585007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.498+0000 7f58677fe640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f585007b0b0 0x7f585007d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5858005ab0 tx=0x7f5858005a20 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.504+0000 7f5864ff9640 1 -- 172.21.15.112:0/1843965221 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f585c01f020 con 0x7f5868104d60 2024-09-21T00:57:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:44 smithi112 ceph-mon[28078]: pgmap v11: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 107 op/s 2024-09-21T00:57:44.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.817+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f586819f5e0 con 0x7f585007b0b0 2024-09-21T00:57:44.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.818+0000 7f5864ff9640 1 -- 172.21.15.112:0/1843965221 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f586819f5e0 con 0x7f585007b0b0 2024-09-21T00:57:44.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.820+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f585007b0b0 msgr2=0x7f585007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.820+0000 7f586dca3640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f585007b0b0 0x7f585007d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5858005ab0 tx=0x7f5858005a20 comp rx=0 tx=0).stop 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.820+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868104d60 msgr2=0x7f58681003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868104d60 0x7f58681003e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f585c00b3d0 tx=0x7f585c00b890 comp rx=0 tx=0).stop 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 shutdown_connections 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f585007b0b0 0x7f585007d570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5868104d60 0x7f58681003e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 --2- 172.21.15.112:0/1843965221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5868102430 0x7f5868101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 >> 172.21.15.112:0/1843965221 conn(0x7f58680fbff0 msgr2=0x7f58680fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 shutdown_connections 2024-09-21T00:57:44.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.821+0000 7f586dca3640 1 -- 172.21.15.112:0/1843965221 wait complete. 2024-09-21T00:57:44.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:44 smithi187 ceph-mon[34997]: pgmap v11: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 107 op/s 2024-09-21T00:57:44.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.912+0000 7ffb8f2df640 1 -- 172.21.15.112:0/3895919371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88100840 msgr2=0x7ffb88100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.912+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/3895919371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88100840 0x7ffb88100c40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009880 tx=0x7ffb8402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.912+0000 7ffb8f2df640 1 -- 172.21.15.112:0/3895919371 shutdown_connections 2024-09-21T00:57:44.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.912+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/3895919371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb88101a40 0x7ffb88101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.912+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/3895919371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88100840 0x7ffb88100c40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.912+0000 7ffb8f2df640 1 -- 172.21.15.112:0/3895919371 >> 172.21.15.112:0/3895919371 conn(0x7ffb880fbff0 msgr2=0x7ffb880fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 -- 172.21.15.112:0/3895919371 shutdown_connections 2024-09-21T00:57:44.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 -- 172.21.15.112:0/3895919371 wait complete. 2024-09-21T00:57:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 Processor -- start 2024-09-21T00:57:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 -- start start 2024-09-21T00:57:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb88100840 0x7ffb881963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88101a40 0x7ffb88196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88109680 con 0x7ffb88101a40 2024-09-21T00:57:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.913+0000 7ffb8f2df640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88109500 con 0x7ffb88100840 2024-09-21T00:57:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8c87a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88101a40 0x7ffb88196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8c87a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88101a40 0x7ffb88196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55952/0 (socket says 172.21.15.112:55952) 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8c87a640 1 -- 172.21.15.112:0/603633900 learned_addr learned my addr 172.21.15.112:0/603633900 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8d07b640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb88100840 0x7ffb881963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8c87a640 1 -- 172.21.15.112:0/603633900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb88100840 msgr2=0x7ffb881963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8c87a640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb88100840 0x7ffb881963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8c87a640 1 -- 172.21.15.112:0/603633900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb88196f80 con 0x7ffb88101a40 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8d07b640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb88100840 0x7ffb881963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8c87a640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88101a40 0x7ffb88196900 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800eb00 tx=0x7ffb7800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb7e7fc640 1 -- 172.21.15.112:0/603633900 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb7800bbb0 con 0x7ffb88101a40 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb7e7fc640 1 -- 172.21.15.112:0/603633900 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb7800bd50 con 0x7ffb88101a40 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb88069b90 con 0x7ffb88101a40 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb7e7fc640 1 -- 172.21.15.112:0/603633900 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb78017410 con 0x7ffb88101a40 2024-09-21T00:57:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.914+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8806a120 con 0x7ffb88101a40 2024-09-21T00:57:44.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.916+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb88100c40 con 0x7ffb88101a40 2024-09-21T00:57:44.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.916+0000 7ffb7e7fc640 1 -- 172.21.15.112:0/603633900 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7ffb780046c0 con 0x7ffb88101a40 2024-09-21T00:57:44.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.917+0000 7ffb7e7fc640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ffb7407b0b0 0x7ffb7407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.917+0000 7ffb7e7fc640 1 -- 172.21.15.112:0/603633900 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7ffb78014070 con 0x7ffb88101a40 2024-09-21T00:57:44.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.917+0000 7ffb8d07b640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ffb7407b0b0 0x7ffb7407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.918+0000 7ffb8d07b640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ffb7407b0b0 0x7ffb7407d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb84000c00 tx=0x7ffb84005a20 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:44.922+0000 7ffb7e7fc640 1 -- 172.21.15.112:0/603633900 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ffb7806b2a0 con 0x7ffb88101a40 2024-09-21T00:57:45.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.182+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ffb8806a430 con 0x7ffb7407b0b0 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.195+0000 7ffb7e7fc640 1 -- 172.21.15.112:0/603633900 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ffb8806a430 con 0x7ffb7407b0b0 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (7m) 5s ago 9m 25.1M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (79s) 5s ago 9m 8358k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (37s) 13s ago 8m 7990k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (9m) 5s ago 9m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (8m) 13s ago 8m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (7m) 5s ago 8m 76.4M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (3m) 5s ago 3m 245M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (3m) 5s ago 3m 14.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (3m) 13s ago 3m 18.1M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:57:45.196 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (3m) 13s ago 3m 15.9M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (28s) 5s ago 10m 556M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (2m) 13s ago 8m 196M - 19.3.0-5120-g18432218 ddce307e1f32 9ab97a4dd8af 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (10m) 5s ago 10m 58.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (8m) 13s ago 8m 44.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (9m) 5s ago 9m 15.5M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (8m) 13s ago 8m 16.7M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (7m) 5s ago 7m 173M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (6m) 5s ago 6m 190M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (6m) 5s ago 6m 149M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (5m) 13s ago 5m 213M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (5m) 13s ago 5m 177M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (4m) 13s ago 4m 176M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:57:45.197 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (46s) 5s ago 8m 44.8M - 2.43.0 a07b618ecd1d 0cab6bb45645 2024-09-21T00:57:45.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ffb7407b0b0 msgr2=0x7ffb7407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ffb7407b0b0 0x7ffb7407d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb84000c00 tx=0x7ffb84005a20 comp rx=0 tx=0).stop 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88101a40 msgr2=0x7ffb88196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88101a40 0x7ffb88196900 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800eb00 tx=0x7ffb7800ef00 comp rx=0 tx=0).stop 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 shutdown_connections 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ffb7407b0b0 0x7ffb7407d570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb88101a40 0x7ffb88196900 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 --2- 172.21.15.112:0/603633900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb88100840 0x7ffb881963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.197+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 >> 172.21.15.112:0/603633900 conn(0x7ffb880fbff0 msgr2=0x7ffb88104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.198+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 shutdown_connections 2024-09-21T00:57:45.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.198+0000 7ffb8f2df640 1 -- 172.21.15.112:0/603633900 wait complete. 2024-09-21T00:57:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 -- 172.21.15.112:0/118319824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 msgr2=0x7fc988101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 --2- 172.21.15.112:0/118319824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988101ec0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc978009880 tx=0x7fc97802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 -- 172.21.15.112:0/118319824 shutdown_connections 2024-09-21T00:57:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 --2- 172.21.15.112:0/118319824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988101ec0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 --2- 172.21.15.112:0/118319824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc988100840 0x7fc988100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 -- 172.21.15.112:0/118319824 >> 172.21.15.112:0/118319824 conn(0x7fc9880fbff0 msgr2=0x7fc9880fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 -- 172.21.15.112:0/118319824 shutdown_connections 2024-09-21T00:57:45.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.293+0000 7fc9903ae640 1 -- 172.21.15.112:0/118319824 wait complete. 2024-09-21T00:57:45.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc9903ae640 1 Processor -- start 2024-09-21T00:57:45.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc9903ae640 1 -- start start 2024-09-21T00:57:45.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc9903ae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc988100840 0x7fc988197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc9903ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc9903ae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc988109700 con 0x7fc988101a40 2024-09-21T00:57:45.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc9903ae640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc988109580 con 0x7fc988100840 2024-09-21T00:57:45.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc98d949640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc98d949640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55962/0 (socket says 172.21.15.112:55962) 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc98d949640 1 -- 172.21.15.112:0/4251962444 learned_addr learned my addr 172.21.15.112:0/4251962444 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.294+0000 7fc98e14a640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc988100840 0x7fc988197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc98d949640 1 -- 172.21.15.112:0/4251962444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc988100840 msgr2=0x7fc988197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc98d949640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc988100840 0x7fc988197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc98d949640 1 -- 172.21.15.112:0/4251962444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc988198130 con 0x7fc988101a40 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc98e14a640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc988100840 0x7fc988197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc98d949640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988197ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc978009230 tx=0x7fc9780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc97f7fe640 1 -- 172.21.15.112:0/4251962444 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc97803f070 con 0x7fc988101a40 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98819cb10 con 0x7fc988101a40 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc97f7fe640 1 -- 172.21.15.112:0/4251962444 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9780044d0 con 0x7fc988101a40 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc97f7fe640 1 -- 172.21.15.112:0/4251962444 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc978035030 con 0x7fc988101a40 2024-09-21T00:57:45.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.295+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98819d120 con 0x7fc988101a40 2024-09-21T00:57:45.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.297+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc988100c20 con 0x7fc988101a40 2024-09-21T00:57:45.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.297+0000 7fc97f7fe640 1 -- 172.21.15.112:0/4251962444 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fc978042070 con 0x7fc988101a40 2024-09-21T00:57:45.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.298+0000 7fc97f7fe640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc97407b0a0 0x7fc97407d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.298+0000 7fc97f7fe640 1 -- 172.21.15.112:0/4251962444 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fc9780bedf0 con 0x7fc988101a40 2024-09-21T00:57:45.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.298+0000 7fc98e14a640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc97407b0a0 0x7fc97407d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.299+0000 7fc98e14a640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc97407b0a0 0x7fc97407d560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9881018a0 tx=0x7fc984009110 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.303+0000 7fc97f7fe640 1 -- 172.21.15.112:0/4251962444 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc97808a250 con 0x7fc988101a40 2024-09-21T00:57:45.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.653+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc98819d350 con 0x7fc988101a40 2024-09-21T00:57:45.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.653+0000 7fc97f7fe640 1 -- 172.21.15.112:0/4251962444 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fc97808f100 con 0x7fc988101a40 2024-09-21T00:57:45.654 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:57:45.654 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:57:45.655 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T00:57:45.656 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:57:45.656 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:57:45.656 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:57:45.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.658+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc97407b0a0 msgr2=0x7fc97407d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.658+0000 7fc9903ae640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc97407b0a0 0x7fc97407d560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9881018a0 tx=0x7fc984009110 comp rx=0 tx=0).stop 2024-09-21T00:57:45.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.658+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 msgr2=0x7fc988197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.658+0000 7fc9903ae640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988197ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc978009230 tx=0x7fc9780048f0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.659+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 shutdown_connections 2024-09-21T00:57:45.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.659+0000 7fc9903ae640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc97407b0a0 0x7fc97407d560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.659+0000 7fc9903ae640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc988101a40 0x7fc988197ab0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.659+0000 7fc9903ae640 1 --2- 172.21.15.112:0/4251962444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc988100840 0x7fc988197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.659+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 >> 172.21.15.112:0/4251962444 conn(0x7fc9880fbff0 msgr2=0x7fc9880fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.661+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 shutdown_connections 2024-09-21T00:57:45.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.661+0000 7fc9903ae640 1 -- 172.21.15.112:0/4251962444 wait complete. 2024-09-21T00:57:45.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 -- 172.21.15.112:0/1846184804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 msgr2=0x7fbab4107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 --2- 172.21.15.112:0/1846184804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4107190 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009880 tx=0x7fbaa002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 -- 172.21.15.112:0/1846184804 shutdown_connections 2024-09-21T00:57:45.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 --2- 172.21.15.112:0/1846184804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4107190 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 --2- 172.21.15.112:0/1846184804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab4102470 0x7fbab4104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 -- 172.21.15.112:0/1846184804 >> 172.21.15.112:0/1846184804 conn(0x7fbab40fc010 msgr2=0x7fbab40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 -- 172.21.15.112:0/1846184804 shutdown_connections 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 -- 172.21.15.112:0/1846184804 wait complete. 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.758+0000 7fbabadc8640 1 Processor -- start 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbabadc8640 1 -- start start 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbabadc8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab4102470 0x7fbab4197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbabadc8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbabadc8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbab410a7c0 con 0x7fbab4104da0 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbabadc8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbab410a640 con 0x7fbab4102470 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55966/0 (socket says 172.21.15.112:55966) 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab3fff640 1 -- 172.21.15.112:0/2318251029 learned_addr learned my addr 172.21.15.112:0/2318251029 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab8b64640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab4102470 0x7fbab4197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab3fff640 1 -- 172.21.15.112:0/2318251029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab4102470 msgr2=0x7fbab4197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab3fff640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab4102470 0x7fbab4197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab3fff640 1 -- 172.21.15.112:0/2318251029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab41980d0 con 0x7fbab4104da0 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.759+0000 7fbab3fff640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4197a50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0006010 tx=0x7fbaa00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.760+0000 7fbab1ffb640 1 -- 172.21.15.112:0/2318251029 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaa003f070 con 0x7fbab4104da0 2024-09-21T00:57:45.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.760+0000 7fbab1ffb640 1 -- 172.21.15.112:0/2318251029 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbaa00044d0 con 0x7fbab4104da0 2024-09-21T00:57:45.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.760+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab419cb10 con 0x7fbab4104da0 2024-09-21T00:57:45.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.760+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab419d120 con 0x7fbab4104da0 2024-09-21T00:57:45.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.760+0000 7fbab1ffb640 1 -- 172.21.15.112:0/2318251029 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaa0049060 con 0x7fbab4104da0 2024-09-21T00:57:45.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.761+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab4102850 con 0x7fbab4104da0 2024-09-21T00:57:45.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.761+0000 7fbab1ffb640 1 -- 172.21.15.112:0/2318251029 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fbaa0042070 con 0x7fbab4104da0 2024-09-21T00:57:45.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.762+0000 7fbab1ffb640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbaa407b050 0x7fbaa407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.762+0000 7fbab1ffb640 1 -- 172.21.15.112:0/2318251029 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fbaa00bec70 con 0x7fbab4104da0 2024-09-21T00:57:45.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.762+0000 7fbab8b64640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbaa407b050 0x7fbaa407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.763+0000 7fbab8b64640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbaa407b050 0x7fbaa407d510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009990 tx=0x7fbaa8009110 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:45.766+0000 7fbab1ffb640 1 -- 172.21.15.112:0/2318251029 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fbaa0089ff0 con 0x7fbab4104da0 2024-09-21T00:57:45.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:45 smithi187 ceph-mon[34997]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:45.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:45 smithi187 ceph-mon[34997]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:45.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:45 smithi187 ceph-mon[34997]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:46.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:45 smithi112 ceph-mon[28078]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:46.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:45 smithi112 ceph-mon[28078]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:46.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:45 smithi112 ceph-mon[28078]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:46.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.020+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbab4105800 con 0x7fbaa407b050 2024-09-21T00:57:46.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.021+0000 7fbab1ffb640 1 -- 172.21.15.112:0/2318251029 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fbab4105800 con 0x7fbaa407b050 2024-09-21T00:57:46.022 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:57:46.022 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:57:46.022 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:57:46.022 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:57:46.023 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T00:57:46.023 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-21T00:57:46.023 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T00:57:46.023 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T00:57:46.023 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "", 2024-09-21T00:57:46.023 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:57:46.023 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:57:46.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbaa407b050 msgr2=0x7fbaa407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbaa407b050 0x7fbaa407d510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009990 tx=0x7fbaa8009110 comp rx=0 tx=0).stop 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 msgr2=0x7fbab4197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4197a50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0006010 tx=0x7fbaa00048f0 comp rx=0 tx=0).stop 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 shutdown_connections 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbaa407b050 0x7fbaa407d510 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbab4104da0 0x7fbab4197a50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 --2- 172.21.15.112:0/2318251029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab4102470 0x7fbab4197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 >> 172.21.15.112:0/2318251029 conn(0x7fbab40fc010 msgr2=0x7fbab40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 shutdown_connections 2024-09-21T00:57:46.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:57:46.024+0000 7fbabadc8640 1 -- 172.21.15.112:0/2318251029 wait complete. 2024-09-21T00:57:46.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:46 smithi187 ceph-mon[34997]: pgmap v12: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 62 KiB/s rd, 2.4 MiB/s wr, 142 op/s 2024-09-21T00:57:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:46 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4251962444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:57:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:46 smithi187 ceph-mon[34997]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:46 smithi112 ceph-mon[28078]: pgmap v12: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 62 KiB/s rd, 2.4 MiB/s wr, 142 op/s 2024-09-21T00:57:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:46 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4251962444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:57:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:46 smithi112 ceph-mon[28078]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:48.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:48 smithi187 ceph-mon[34997]: pgmap v13: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 89 op/s 2024-09-21T00:57:49.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:48 smithi112 ceph-mon[28078]: pgmap v13: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 89 op/s 2024-09-21T00:57:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:50 smithi187 ceph-mon[34997]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 128 op/s 2024-09-21T00:57:51.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:50 smithi112 ceph-mon[28078]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 128 op/s 2024-09-21T00:57:52.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:52 smithi187 ceph-mon[34997]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-21T00:57:52.956 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:52 smithi112 ceph-mon[28078]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-21T00:57:54.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:54 smithi187 ceph-mon[34997]: pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-21T00:57:54.993 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:54 smithi112 ceph-mon[28078]: pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-21T00:57:56.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:56 smithi187 ceph-mon[34997]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 116 op/s 2024-09-21T00:57:56.927 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:56 smithi112 ceph-mon[28078]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 116 op/s 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:57:58.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-21T00:57:58.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:58 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 80 op/s 2024-09-21T00:57:58.684 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Updating smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: Reconfiguring prometheus.smithi112 (dependencies changed)... 2024-09-21T00:57:58.685 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:58 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:57:59.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:57:59 smithi187 ceph-mon[34997]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-21T00:57:59.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:57:59 smithi112 ceph-mon[28078]: Reconfiguring daemon prometheus.smithi112 on smithi112 2024-09-21T00:58:00.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:00 smithi112 ceph-mon[28078]: pgmap v19: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 133 op/s 2024-09-21T00:58:00.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:00 smithi187 ceph-mon[34997]: pgmap v19: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 133 op/s 2024-09-21T00:58:02.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:02 smithi187 ceph-mon[34997]: pgmap v20: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-21T00:58:03.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:02 smithi112 ceph-mon[28078]: pgmap v20: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-21T00:58:04.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:04 smithi187 ceph-mon[34997]: pgmap v21: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-21T00:58:05.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:04 smithi112 ceph-mon[28078]: pgmap v21: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-21T00:58:06.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:06 smithi187 ceph-mon[34997]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.6 MiB/s wr, 426 op/s 2024-09-21T00:58:07.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:06 smithi112 ceph-mon[28078]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.6 MiB/s wr, 426 op/s 2024-09-21T00:58:08.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:08 smithi187 ceph-mon[34997]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.9 MiB/s wr, 384 op/s 2024-09-21T00:58:09.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:08 smithi112 ceph-mon[28078]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.9 MiB/s wr, 384 op/s 2024-09-21T00:58:10.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:10 smithi187 ceph-mon[34997]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 517 op/s 2024-09-21T00:58:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:10 smithi112 ceph-mon[28078]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 517 op/s 2024-09-21T00:58:12.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:12 smithi187 ceph-mon[34997]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.9 MiB/s wr, 464 op/s 2024-09-21T00:58:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:12 smithi112 ceph-mon[28078]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.9 MiB/s wr, 464 op/s 2024-09-21T00:58:13.895 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:13 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:58:14.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:13 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:58:14.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:14 smithi187 ceph-mon[34997]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.9 MiB/s wr, 464 op/s 2024-09-21T00:58:15.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:14 smithi112 ceph-mon[28078]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.9 MiB/s wr, 464 op/s 2024-09-21T00:58:16.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.151+0000 7f6561991640 1 -- 172.21.15.112:0/160773227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c1023d0 msgr2=0x7f655c1047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.151+0000 7f6561991640 1 --2- 172.21.15.112:0/160773227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c1023d0 0x7f655c1047c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f654c0098b0 tx=0x7f654c02a4d0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.151+0000 7f6561991640 1 -- 172.21.15.112:0/160773227 shutdown_connections 2024-09-21T00:58:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.151+0000 7f6561991640 1 --2- 172.21.15.112:0/160773227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c104d00 0x7f655c1070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.151+0000 7f6561991640 1 --2- 172.21.15.112:0/160773227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c1023d0 0x7f655c1047c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.151+0000 7f6561991640 1 -- 172.21.15.112:0/160773227 >> 172.21.15.112:0/160773227 conn(0x7f655c0fbff0 msgr2=0x7f655c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.152+0000 7f6561991640 1 -- 172.21.15.112:0/160773227 shutdown_connections 2024-09-21T00:58:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.152+0000 7f6561991640 1 -- 172.21.15.112:0/160773227 wait complete. 2024-09-21T00:58:16.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.152+0000 7f6561991640 1 Processor -- start 2024-09-21T00:58:16.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f6561991640 1 -- start start 2024-09-21T00:58:16.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f6561991640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c1023d0 0x7f655c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f6561991640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c104d00 0x7f655c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f6561991640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f655c10a7a0 con 0x7f655c104d00 2024-09-21T00:58:16.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f6561991640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f655c10a620 con 0x7f655c1023d0 2024-09-21T00:58:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f655affd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c1023d0 0x7f655c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f655affd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c1023d0 0x7f655c1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:49798/0 (socket says 172.21.15.112:49798) 2024-09-21T00:58:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f655affd640 1 -- 172.21.15.112:0/3074374090 learned_addr learned my addr 172.21.15.112:0/3074374090 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f655a7fc640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c104d00 0x7f655c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f655affd640 1 -- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c104d00 msgr2=0x7f655c199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f655affd640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c104d00 0x7f655c199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.153+0000 7f655affd640 1 -- 172.21.15.112:0/3074374090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655c19a2b0 con 0x7f655c1023d0 2024-09-21T00:58:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.154+0000 7f655affd640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c1023d0 0x7f655c1996f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f654c0099d0 tx=0x7f654c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.154+0000 7f656098f640 1 -- 172.21.15.112:0/3074374090 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f654c03f070 con 0x7f655c1023d0 2024-09-21T00:58:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.154+0000 7f656098f640 1 -- 172.21.15.112:0/3074374090 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f654c0049d0 con 0x7f655c1023d0 2024-09-21T00:58:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.154+0000 7f656098f640 1 -- 172.21.15.112:0/3074374090 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f654c035030 con 0x7f655c1023d0 2024-09-21T00:58:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.154+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655c06bc70 con 0x7f655c1023d0 2024-09-21T00:58:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.154+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655c06c200 con 0x7f655c1023d0 2024-09-21T00:58:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.155+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655c1027b0 con 0x7f655c1023d0 2024-09-21T00:58:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.156+0000 7f656098f640 1 -- 172.21.15.112:0/3074374090 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f654c042070 con 0x7f655c1023d0 2024-09-21T00:58:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.156+0000 7f656098f640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f654407b050 0x7f654407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.157+0000 7f656098f640 1 -- 172.21.15.112:0/3074374090 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f654c0bedb0 con 0x7f655c1023d0 2024-09-21T00:58:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.157+0000 7f655a7fc640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f654407b050 0x7f654407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.157+0000 7f655a7fc640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f654407b050 0x7f654407d510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f65500095f0 tx=0x7f6550005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.162+0000 7f656098f640 1 -- 172.21.15.112:0/3074374090 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f654c08a130 con 0x7f655c1023d0 2024-09-21T00:58:16.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.427+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f655c062630 con 0x7f654407b050 2024-09-21T00:58:16.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.429+0000 7f656098f640 1 -- 172.21.15.112:0/3074374090 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f655c062630 con 0x7f654407b050 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f654407b050 msgr2=0x7f654407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f654407b050 0x7f654407d510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f65500095f0 tx=0x7f6550005f90 comp rx=0 tx=0).stop 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c1023d0 msgr2=0x7f655c1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c1023d0 0x7f655c1996f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f654c0099d0 tx=0x7f654c0045e0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 shutdown_connections 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f654407b050 0x7f654407d510 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f655c104d00 0x7f655c199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 --2- 172.21.15.112:0/3074374090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655c1023d0 0x7f655c1996f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 >> 172.21.15.112:0/3074374090 conn(0x7f655c0fbff0 msgr2=0x7f655c1019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 shutdown_connections 2024-09-21T00:58:16.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.431+0000 7f6561991640 1 -- 172.21.15.112:0/3074374090 wait complete. 2024-09-21T00:58:16.444 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 -- 172.21.15.112:0/2257678265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 msgr2=0x7f9348094870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 --2- 172.21.15.112:0/2257678265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348094870 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9340009880 tx=0x7f934002a4b0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 -- 172.21.15.112:0/2257678265 shutdown_connections 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 --2- 172.21.15.112:0/2257678265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348094870 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 --2- 172.21.15.112:0/2257678265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9348093680 0x7f9348093a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 -- 172.21.15.112:0/2257678265 >> 172.21.15.112:0/2257678265 conn(0x7f934808f1b0 msgr2=0x7f9348091610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 -- 172.21.15.112:0/2257678265 shutdown_connections 2024-09-21T00:58:16.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.557+0000 7f934f59e640 1 -- 172.21.15.112:0/2257678265 wait complete. 2024-09-21T00:58:16.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.558+0000 7f934f59e640 1 Processor -- start 2024-09-21T00:58:16.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.558+0000 7f934f59e640 1 -- start start 2024-09-21T00:58:16.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.558+0000 7f934f59e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9348093680 0x7f93481314e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.558+0000 7f934f59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348131a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.558+0000 7f934f59e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f93480a47e0 con 0x7f93480943f0 2024-09-21T00:58:16.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.558+0000 7f934f59e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f93480a4660 con 0x7f9348093680 2024-09-21T00:58:16.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.559+0000 7f934dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348131a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.559+0000 7f934dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348131a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43082/0 (socket says 172.21.15.112:43082) 2024-09-21T00:58:16.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.559+0000 7f934dd9b640 1 -- 172.21.15.112:0/2801213484 learned_addr learned my addr 172.21.15.112:0/2801213484 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:16.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.559+0000 7f934e59c640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9348093680 0x7f93481314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.559+0000 7f934dd9b640 1 -- 172.21.15.112:0/2801213484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9348093680 msgr2=0x7f93481314e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.559+0000 7f934dd9b640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9348093680 0x7f93481314e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.559+0000 7f934dd9b640 1 -- 172.21.15.112:0/2801213484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93481320a0 con 0x7f93480943f0 2024-09-21T00:58:16.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.560+0000 7f934dd9b640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348131a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f934002a9d0 tx=0x7f93400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:16.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.560+0000 7f933f7fe640 1 -- 172.21.15.112:0/2801213484 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f934003f070 con 0x7f93480943f0 2024-09-21T00:58:16.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.560+0000 7f934f59e640 1 -- 172.21.15.112:0/2801213484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9348147a90 con 0x7f93480943f0 2024-09-21T00:58:16.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.560+0000 7f933f7fe640 1 -- 172.21.15.112:0/2801213484 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9340004a50 con 0x7f93480943f0 2024-09-21T00:58:16.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.560+0000 7f933f7fe640 1 -- 172.21.15.112:0/2801213484 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9340035030 con 0x7f93480943f0 2024-09-21T00:58:16.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.560+0000 7f934f59e640 1 -- 172.21.15.112:0/2801213484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9348148020 con 0x7f93480943f0 2024-09-21T00:58:16.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.562+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9348093a80 con 0x7f93480943f0 2024-09-21T00:58:16.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.564+0000 7f933f7fe640 1 -- 172.21.15.112:0/2801213484 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f9340042070 con 0x7f93480943f0 2024-09-21T00:58:16.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.565+0000 7f933f7fe640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f933807b0a0 0x7f933807d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.565+0000 7f934e59c640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f933807b0a0 0x7f933807d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.565+0000 7f933f7fe640 1 -- 172.21.15.112:0/2801213484 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f93400bef70 con 0x7f93480943f0 2024-09-21T00:58:16.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.566+0000 7f934e59c640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f933807b0a0 0x7f933807d560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f934400bbe0 tx=0x7f934400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:16.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.574+0000 7f933f7fe640 1 -- 172.21.15.112:0/2801213484 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f934008a470 con 0x7f93480943f0 2024-09-21T00:58:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:16 smithi112 ceph-mon[28078]: pgmap v27: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.5 MiB/s wr, 597 op/s 2024-09-21T00:58:16.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.874+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9348002e30 con 0x7f933807b0a0 2024-09-21T00:58:16.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.876+0000 7f933f7fe640 1 -- 172.21.15.112:0/2801213484 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f9348002e30 con 0x7f933807b0a0 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f933807b0a0 msgr2=0x7f933807d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f933807b0a0 0x7f933807d560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f934400bbe0 tx=0x7f934400b390 comp rx=0 tx=0).stop 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 msgr2=0x7f9348131a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348131a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f934002a9d0 tx=0x7f93400045e0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 shutdown_connections 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f933807b0a0 0x7f933807d560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93480943f0 0x7f9348131a20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 --2- 172.21.15.112:0/2801213484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9348093680 0x7f93481314e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 >> 172.21.15.112:0/2801213484 conn(0x7f934808f1b0 msgr2=0x7f9348097900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:16.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 shutdown_connections 2024-09-21T00:58:16.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.879+0000 7f933d7fa640 1 -- 172.21.15.112:0/2801213484 wait complete. 2024-09-21T00:58:16.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:16 smithi187 ceph-mon[34997]: pgmap v27: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.5 MiB/s wr, 597 op/s 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 -- 172.21.15.112:0/350740939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 msgr2=0x7f01fc101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 --2- 172.21.15.112:0/350740939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 0x7f01fc101ec0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009880 tx=0x7f01f002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 -- 172.21.15.112:0/350740939 shutdown_connections 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 --2- 172.21.15.112:0/350740939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 0x7f01fc101ec0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 --2- 172.21.15.112:0/350740939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 0x7f01fc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 -- 172.21.15.112:0/350740939 >> 172.21.15.112:0/350740939 conn(0x7f01fc0fbff0 msgr2=0x7f01fc0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 -- 172.21.15.112:0/350740939 shutdown_connections 2024-09-21T00:58:16.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.971+0000 7f0201299640 1 -- 172.21.15.112:0/350740939 wait complete. 2024-09-21T00:58:16.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.972+0000 7f0201299640 1 Processor -- start 2024-09-21T00:58:16.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.972+0000 7f0201299640 1 -- start start 2024-09-21T00:58:16.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f0201299640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 0x7f01fc06a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f0201299640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 0x7f01fc19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f0201299640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc109680 con 0x7f01fc101a40 2024-09-21T00:58:16.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f0201299640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc109500 con 0x7f01fc100840 2024-09-21T00:58:16.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f01faffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 0x7f01fc06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f01fa7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 0x7f01fc19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f01faffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 0x7f01fc06a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:49846/0 (socket says 172.21.15.112:49846) 2024-09-21T00:58:16.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f01faffd640 1 -- 172.21.15.112:0/3669776517 learned_addr learned my addr 172.21.15.112:0/3669776517 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:16.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f01faffd640 1 -- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 msgr2=0x7f01fc19c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:16.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f01faffd640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 0x7f01fc19c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:16.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.973+0000 7f01faffd640 1 -- 172.21.15.112:0/3669776517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc19c7d0 con 0x7f01fc100840 2024-09-21T00:58:16.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.974+0000 7f01faffd640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 0x7f01fc06a660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00e940 tx=0x7f01ec00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:16.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.974+0000 7f01e3fff640 1 -- 172.21.15.112:0/3669776517 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01ec00cac0 con 0x7f01fc100840 2024-09-21T00:58:16.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.974+0000 7f01e3fff640 1 -- 172.21.15.112:0/3669776517 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01ec00cc60 con 0x7f01fc100840 2024-09-21T00:58:16.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.974+0000 7f01e3fff640 1 -- 172.21.15.112:0/3669776517 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01ec003e30 con 0x7f01fc100840 2024-09-21T00:58:16.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.974+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc19cac0 con 0x7f01fc100840 2024-09-21T00:58:16.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.974+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc19d020 con 0x7f01fc100840 2024-09-21T00:58:16.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.976+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc100c40 con 0x7f01fc100840 2024-09-21T00:58:16.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.976+0000 7f01e3fff640 1 -- 172.21.15.112:0/3669776517 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f01ec004000 con 0x7f01fc100840 2024-09-21T00:58:16.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.977+0000 7f01e3fff640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f01e407b0b0 0x7f01e407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:16.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.977+0000 7f01e3fff640 1 -- 172.21.15.112:0/3669776517 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f01ec09e790 con 0x7f01fc100840 2024-09-21T00:58:16.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.977+0000 7f01fa7fc640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f01e407b0b0 0x7f01e407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:16.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.977+0000 7f01fa7fc640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f01e407b0b0 0x7f01e407d570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000c00 tx=0x7f01f00058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:16.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:16.982+0000 7f01e3fff640 1 -- 172.21.15.112:0/3669776517 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f01ec069b60 con 0x7f01fc100840 2024-09-21T00:58:17.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.303+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f01fc062630 con 0x7f01e407b0b0 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.318+0000 7f01e3fff640 1 -- 172.21.15.112:0/3669776517 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f01fc062630 con 0x7f01e407b0b0 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (8m) 38s ago 9m 25.1M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (111s) 38s ago 9m 8358k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (69s) 45s ago 9m 7990k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (9m) 38s ago 9m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (9m) 45s ago 8m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (8m) 38s ago 9m 76.4M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (4m) 38s ago 4m 245M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:58:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (4m) 38s ago 4m 14.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (4m) 45s ago 4m 18.1M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (4m) 45s ago 4m 15.9M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (60s) 38s ago 10m 556M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (2m) 45s ago 8m 196M - 19.3.0-5120-g18432218 ddce307e1f32 9ab97a4dd8af 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (10m) 38s ago 11m 58.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (8m) 45s ago 8m 44.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (9m) 38s ago 9m 15.5M - 1.5.0 0da6a335fe13 bddaeae67ff4 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (8m) 45s ago 8m 16.7M - 1.5.0 0da6a335fe13 557a8d9dbf82 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (7m) 38s ago 7m 173M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (7m) 38s ago 7m 190M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (6m) 38s ago 6m 149M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:58:17.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (6m) 45s ago 6m 213M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:58:17.322 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (5m) 45s ago 5m 177M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:58:17.322 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (5m) 45s ago 5m 176M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:58:17.322 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 starting - - - - 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f01e407b0b0 msgr2=0x7f01e407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f01e407b0b0 0x7f01e407d570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01f0000c00 tx=0x7f01f00058d0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 msgr2=0x7f01fc06a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 0x7f01fc06a660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00e940 tx=0x7f01ec00ee00 comp rx=0 tx=0).stop 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 shutdown_connections 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f01e407b0b0 0x7f01e407d570 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01fc101a40 0x7f01fc19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 --2- 172.21.15.112:0/3669776517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01fc100840 0x7f01fc06a660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 >> 172.21.15.112:0/3669776517 conn(0x7f01fc0fbff0 msgr2=0x7f01fc104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 shutdown_connections 2024-09-21T00:58:17.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.321+0000 7f0201299640 1 -- 172.21.15.112:0/3669776517 wait complete. 2024-09-21T00:58:17.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 -- 172.21.15.112:0/3624178133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 msgr2=0x7fbbe8104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 --2- 172.21.15.112:0/3624178133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8104820 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009880 tx=0x7fbbd802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 -- 172.21.15.112:0/3624178133 shutdown_connections 2024-09-21T00:58:17.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 --2- 172.21.15.112:0/3624178133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe8104d60 0x7fbbe8107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 --2- 172.21.15.112:0/3624178133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8104820 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 -- 172.21.15.112:0/3624178133 >> 172.21.15.112:0/3624178133 conn(0x7fbbe80fbff0 msgr2=0x7fbbe80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 -- 172.21.15.112:0/3624178133 shutdown_connections 2024-09-21T00:58:17.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.414+0000 7fbbed405640 1 -- 172.21.15.112:0/3624178133 wait complete. 2024-09-21T00:58:17.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.415+0000 7fbbed405640 1 Processor -- start 2024-09-21T00:58:17.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.415+0000 7fbbed405640 1 -- start start 2024-09-21T00:58:17.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.415+0000 7fbbed405640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.415+0000 7fbbed405640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe8104d60 0x7fbbe81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.415+0000 7fbbed405640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe810a750 con 0x7fbbe8102430 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbed405640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe810a5d0 con 0x7fbbe8104d60 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43116/0 (socket says 172.21.15.112:43116) 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe6ffd640 1 -- 172.21.15.112:0/642493777 learned_addr learned my addr 172.21.15.112:0/642493777 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe67fc640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe8104d60 0x7fbbe81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe6ffd640 1 -- 172.21.15.112:0/642493777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe8104d60 msgr2=0x7fbbe81979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe6ffd640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe8104d60 0x7fbbe81979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe6ffd640 1 -- 172.21.15.112:0/642493777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe8198030 con 0x7fbbe8102430 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe67fc640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe8104d60 0x7fbbe81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.416+0000 7fbbe6ffd640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8197470 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8006010 tx=0x7fbbd8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.417+0000 7fbbcffff640 1 -- 172.21.15.112:0/642493777 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbd803f070 con 0x7fbbe8102430 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.417+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe819ca70 con 0x7fbbe8102430 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.417+0000 7fbbcffff640 1 -- 172.21.15.112:0/642493777 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbbd80049d0 con 0x7fbbe8102430 2024-09-21T00:58:17.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.417+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe819d000 con 0x7fbbe8102430 2024-09-21T00:58:17.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.417+0000 7fbbcffff640 1 -- 172.21.15.112:0/642493777 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbd8035030 con 0x7fbbe8102430 2024-09-21T00:58:17.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.418+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe8102810 con 0x7fbbe8102430 2024-09-21T00:58:17.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.419+0000 7fbbcffff640 1 -- 172.21.15.112:0/642493777 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7fbbd8042070 con 0x7fbbe8102430 2024-09-21T00:58:17.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.419+0000 7fbbcffff640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbbd007b050 0x7fbbd007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.420+0000 7fbbcffff640 1 -- 172.21.15.112:0/642493777 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fbbd80bedc0 con 0x7fbbe8102430 2024-09-21T00:58:17.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.420+0000 7fbbe67fc640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbbd007b050 0x7fbbd007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.420+0000 7fbbe67fc640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbbd007b050 0x7fbbd007d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8198920 tx=0x7fbbdc005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.428+0000 7fbbcffff640 1 -- 172.21.15.112:0/642493777 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fbbd808a1a0 con 0x7fbbe8102430 2024-09-21T00:58:17.635 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:17 smithi112 ceph-mon[28078]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:17.635 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:17 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:17.635 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:17 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:17.635 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:17 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:58:17.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.771+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbbe819d4b0 con 0x7fbbe8102430 2024-09-21T00:58:17.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.772+0000 7fbbcffff640 1 -- 172.21.15.112:0/642493777 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fbbe819d4b0 con 0x7fbbe8102430 2024-09-21T00:58:17.773 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:58:17.773 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:58:17.773 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:58:17.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:58:17.774 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbbd007b050 msgr2=0x7fbbd007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbbd007b050 0x7fbbd007d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8198920 tx=0x7fbbdc005f90 comp rx=0 tx=0).stop 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 msgr2=0x7fbbe8197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8197470 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8006010 tx=0x7fbbd8004570 comp rx=0 tx=0).stop 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 shutdown_connections 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbbd007b050 0x7fbbd007d510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe8104d60 0x7fbbe81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 --2- 172.21.15.112:0/642493777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbe8102430 0x7fbbe8197470 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 >> 172.21.15.112:0/642493777 conn(0x7fbbe80fbff0 msgr2=0x7fbbe80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 shutdown_connections 2024-09-21T00:58:17.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.774+0000 7fbbed405640 1 -- 172.21.15.112:0/642493777 wait complete. 2024-09-21T00:58:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.867+0000 7f9281a33640 1 -- 172.21.15.112:0/105458108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c100a90 msgr2=0x7f927c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.867+0000 7f9281a33640 1 --2- 172.21.15.112:0/105458108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c100a90 0x7f927c100f10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9270009880 tx=0x7f927002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.868+0000 7f9281a33640 1 -- 172.21.15.112:0/105458108 shutdown_connections 2024-09-21T00:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.868+0000 7f9281a33640 1 --2- 172.21.15.112:0/105458108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c100a90 0x7f927c100f10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.868+0000 7f9281a33640 1 --2- 172.21.15.112:0/105458108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f927c101ec0 0x7f927c1022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.868+0000 7f9281a33640 1 -- 172.21.15.112:0/105458108 >> 172.21.15.112:0/105458108 conn(0x7f927c0fb750 msgr2=0x7f927c0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.868+0000 7f9281a33640 1 -- 172.21.15.112:0/105458108 shutdown_connections 2024-09-21T00:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.868+0000 7f9281a33640 1 -- 172.21.15.112:0/105458108 wait complete. 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.868+0000 7f9281a33640 1 Processor -- start 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f9281a33640 1 -- start start 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f9281a33640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f927c100a90 0x7f927c100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f9281a33640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c101ec0 0x7f927c19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f9281a33640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f927c109740 con 0x7f927c101ec0 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f9281a33640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f927c1095c0 con 0x7f927c100a90 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c101ec0 0x7f927c19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927affd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f927c100a90 0x7f927c100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c101ec0 0x7f927c19c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43140/0 (socket says 172.21.15.112:43140) 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927a7fc640 1 -- 172.21.15.112:0/4118472679 learned_addr learned my addr 172.21.15.112:0/4118472679 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927a7fc640 1 -- 172.21.15.112:0/4118472679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f927c100a90 msgr2=0x7f927c100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927a7fc640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f927c100a90 0x7f927c100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927a7fc640 1 -- 172.21.15.112:0/4118472679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c19c7f0 con 0x7f927c101ec0 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.869+0000 7f927affd640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f927c100a90 0x7f927c100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.870+0000 7f927a7fc640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c101ec0 0x7f927c19c230 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9270006010 tx=0x7f92700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.870+0000 7f9280a31640 1 -- 172.21.15.112:0/4118472679 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f927003f070 con 0x7f927c101ec0 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.870+0000 7f9280a31640 1 -- 172.21.15.112:0/4118472679 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f92700049d0 con 0x7f927c101ec0 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.870+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c19ca80 con 0x7f927c101ec0 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.870+0000 7f9280a31640 1 -- 172.21.15.112:0/4118472679 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9270035030 con 0x7f927c101ec0 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.870+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c19cfb0 con 0x7f927c101ec0 2024-09-21T00:58:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.871+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927c100f10 con 0x7f927c101ec0 2024-09-21T00:58:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.872+0000 7f9280a31640 1 -- 172.21.15.112:0/4118472679 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 31) ==== 103424+0+0 (secure 0 0 0) 0x7f9270042070 con 0x7f927c101ec0 2024-09-21T00:58:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.873+0000 7f9280a31640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f926407b050 0x7f926407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.873+0000 7f9280a31640 1 -- 172.21.15.112:0/4118472679 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f92700bee80 con 0x7f927c101ec0 2024-09-21T00:58:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.873+0000 7f927affd640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f926407b050 0x7f926407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.874+0000 7f927affd640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f926407b050 0x7f926407d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f926c009fc0 tx=0x7f926c005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:17.879+0000 7f9280a31640 1 -- 172.21.15.112:0/4118472679 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f927008a130 con 0x7f927c101ec0 2024-09-21T00:58:17.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:17 smithi187 ceph-mon[34997]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:17.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:17 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:17.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:17 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:17.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:17 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:58:17.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:17 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:58:17.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:17 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:17.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:17 smithi187 ceph-mon[34997]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:17 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:58:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:17 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:17 smithi112 ceph-mon[28078]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:18.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.205+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f927c0626f0 con 0x7f926407b050 2024-09-21T00:58:18.209 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:58:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:58:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:58:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:58:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T00:58:18.209 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-21T00:58:18.210 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T00:58:18.210 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T00:58:18.210 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T00:58:18.210 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:58:18.210 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:58:18.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.206+0000 7f9280a31640 1 -- 172.21.15.112:0/4118472679 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f927c0626f0 con 0x7f926407b050 2024-09-21T00:58:18.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f926407b050 msgr2=0x7f926407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:18.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f926407b050 0x7f926407d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f926c009fc0 tx=0x7f926c005f90 comp rx=0 tx=0).stop 2024-09-21T00:58:18.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c101ec0 msgr2=0x7f927c19c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c101ec0 0x7f927c19c230 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9270006010 tx=0x7f92700045e0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 shutdown_connections 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f926407b050 0x7f926407d510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c101ec0 0x7f927c19c230 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 --2- 172.21.15.112:0/4118472679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f927c100a90 0x7f927c100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 >> 172.21.15.112:0/4118472679 conn(0x7f927c0fb750 msgr2=0x7f927c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 shutdown_connections 2024-09-21T00:58:18.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:18.209+0000 7f9281a33640 1 -- 172.21.15.112:0/4118472679 wait complete. 2024-09-21T00:58:18.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:18.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: pgmap v28: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 265 op/s 2024-09-21T00:58:18.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/642493777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:18.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:18.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:58:18.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:58:18.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:58:18.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:18 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: pgmap v28: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 265 op/s 2024-09-21T00:58:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/642493777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:58:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi187.hpbgni", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T00:58:19.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T00:58:19.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:18 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:19.126 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-21T00:58:19.126 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-21T00:58:19.466 DEBUG:teuthology.parallel:result is None 2024-09-21T00:58:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:19 smithi112 ceph-mon[28078]: Upgrade: Updating mgr.smithi187.hpbgni 2024-09-21T00:58:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:19 smithi112 ceph-mon[28078]: Deploying daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:58:19.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:19 smithi187 ceph-mon[34997]: Upgrade: Updating mgr.smithi187.hpbgni 2024-09-21T00:58:19.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:19 smithi187 ceph-mon[34997]: Deploying daemon mgr.smithi187.hpbgni on smithi187 2024-09-21T00:58:20.876 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:20 smithi187 ceph-mon[34997]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 362 op/s 2024-09-21T00:58:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:20 smithi112 ceph-mon[28078]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 362 op/s 2024-09-21T00:58:22.805 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:22 smithi187 ceph-mon[34997]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-09-21T00:58:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:22 smithi112 ceph-mon[28078]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-09-21T00:58:24.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:23 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:23 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:23 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:24.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:23 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:23 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:23 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:23 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:23 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:24.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:23 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:23 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:24.975 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:24 smithi187 ceph-mon[34997]: pgmap v31: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 236 op/s 2024-09-21T00:58:25.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:24 smithi112 ceph-mon[28078]: pgmap v31: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 236 op/s 2024-09-21T00:58:27.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:26 smithi112 ceph-mon[28078]: pgmap v32: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 291 op/s 2024-09-21T00:58:27.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:26 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:27.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:26 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:27.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:26 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:27.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:26 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:27.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:26 smithi187 ceph-mon[34997]: pgmap v32: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 291 op/s 2024-09-21T00:58:27.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:26 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:27.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:26 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:27.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:26 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:27.347 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:26 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: pgmap v33: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: Standby manager daemon smithi187.hpbgni restarted 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:58:29.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:28 smithi112 ceph-mon[28078]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:58:29.299 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-21T00:58:29.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: pgmap v33: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: Standby manager daemon smithi187.hpbgni restarted 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: Standby manager daemon smithi187.hpbgni started 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/crt"}]: dispatch 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi187.hpbgni/key"}]: dispatch 2024-09-21T00:58:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:28 smithi187 ceph-mon[34997]: from='mgr.? 172.21.15.187:0/1552159325' entity='mgr.smithi187.hpbgni' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T00:58:29.582 DEBUG:teuthology.parallel:result is None 2024-09-21T00:58:29.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T00:58:29.615 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T00:58:29.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T00:58:29.650 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T00:58:29.651 DEBUG:teuthology.parallel:result is None 2024-09-21T00:58:30.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:29 smithi187 ceph-mon[34997]: mgrmap e32: smithi112.fzmyfw(active, since 61s), standbys: smithi187.hpbgni 2024-09-21T00:58:30.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:29 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:30.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:29 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:29 smithi112 ceph-mon[28078]: mgrmap e32: smithi112.fzmyfw(active, since 61s), standbys: smithi187.hpbgni 2024-09-21T00:58:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:29 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:29 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: pgmap v34: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 235 op/s 2024-09-21T00:58:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.fzmyfw"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.fzmyfw"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.fzmyfw"}]': finished 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi187.hpbgni"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi187.hpbgni"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi187.hpbgni"}]': finished 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: pgmap v34: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 235 op/s 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.fzmyfw"}]: dispatch 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.fzmyfw"}]: dispatch 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.fzmyfw"}]': finished 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi187.hpbgni"}]: dispatch 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi187.hpbgni"}]: dispatch 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi187.hpbgni"}]': finished 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:31.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:31.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:31 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all mgr 2024-09-21T00:58:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:31 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all rgw 2024-09-21T00:58:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:31 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T00:58:32.239 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:31 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T00:58:32.239 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:31 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all iscsi 2024-09-21T00:58:32.239 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:31 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all nfs 2024-09-21T00:58:32.239 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:31 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all nvmeof 2024-09-21T00:58:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:31 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all mgr 2024-09-21T00:58:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:31 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all rgw 2024-09-21T00:58:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:31 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T00:58:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:31 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T00:58:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:31 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all iscsi 2024-09-21T00:58:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:31 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all nfs 2024-09-21T00:58:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:31 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all nvmeof 2024-09-21T00:58:33.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:32 smithi112 ceph-mon[28078]: pgmap v35: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 139 op/s 2024-09-21T00:58:33.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:32 smithi187 ceph-mon[34997]: pgmap v35: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 139 op/s 2024-09-21T00:58:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:33 smithi112 ceph-mon[28078]: Upgrade: Updating node-exporter.smithi112 (1/2) 2024-09-21T00:58:34.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:33 smithi112 ceph-mon[28078]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-21T00:58:34.280 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:33 smithi187 ceph-mon[34997]: Upgrade: Updating node-exporter.smithi112 (1/2) 2024-09-21T00:58:34.280 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:33 smithi187 ceph-mon[34997]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-21T00:58:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:34 smithi112 ceph-mon[28078]: pgmap v36: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 163 op/s 2024-09-21T00:58:35.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:34 smithi187 ceph-mon[34997]: pgmap v36: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 163 op/s 2024-09-21T00:58:37.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:36 smithi112 ceph-mon[28078]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.2 MiB/s wr, 173 op/s 2024-09-21T00:58:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:36 smithi187 ceph-mon[34997]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.2 MiB/s wr, 173 op/s 2024-09-21T00:58:39.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:38 smithi187 ceph-mon[34997]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 653 KiB/s wr, 117 op/s 2024-09-21T00:58:39.072 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:38 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:39.072 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:38 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:38 smithi112 ceph-mon[28078]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 653 KiB/s wr, 117 op/s 2024-09-21T00:58:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:38 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:38 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:40.118 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:39 smithi187 ceph-mon[34997]: Upgrade: Updating node-exporter.smithi187 (2/2) 2024-09-21T00:58:40.119 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:39 smithi187 ceph-mon[34997]: Deploying daemon node-exporter.smithi187 on smithi187 2024-09-21T00:58:40.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:39 smithi112 ceph-mon[28078]: Upgrade: Updating node-exporter.smithi187 (2/2) 2024-09-21T00:58:40.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:39 smithi112 ceph-mon[28078]: Deploying daemon node-exporter.smithi187 on smithi187 2024-09-21T00:58:41.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:40 smithi187 ceph-mon[34997]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 653 KiB/s wr, 117 op/s 2024-09-21T00:58:41.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:40 smithi112 ceph-mon[28078]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 653 KiB/s wr, 117 op/s 2024-09-21T00:58:43.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:42 smithi187 ceph-mon[34997]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 147 KiB/s wr, 40 op/s 2024-09-21T00:58:43.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:42 smithi112 ceph-mon[28078]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 147 KiB/s wr, 40 op/s 2024-09-21T00:58:44.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:43 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:58:44.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:43 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:44.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:43 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:44.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:43 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:43 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:58:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:43 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:43 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:43 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:44.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:44 smithi187 ceph-mon[34997]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 147 KiB/s wr, 40 op/s 2024-09-21T00:58:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:44 smithi112 ceph-mon[28078]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 147 KiB/s wr, 40 op/s 2024-09-21T00:58:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:46 smithi112 ceph-mon[28078]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 69 KiB/s wr, 16 op/s 2024-09-21T00:58:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:46 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:46 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:47.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:46 smithi187 ceph-mon[34997]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 69 KiB/s wr, 16 op/s 2024-09-21T00:58:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:46 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:46 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:48.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- 172.21.15.112:0/307868781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 msgr2=0x7f70b8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 --2- 172.21.15.112:0/307868781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8100c60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009880 tx=0x7f70ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- 172.21.15.112:0/307868781 shutdown_connections 2024-09-21T00:58:48.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 --2- 172.21.15.112:0/307868781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70b8101a60 0x7f70b8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 --2- 172.21.15.112:0/307868781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8100c60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- 172.21.15.112:0/307868781 >> 172.21.15.112:0/307868781 conn(0x7f70b80fbff0 msgr2=0x7f70b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:48.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- 172.21.15.112:0/307868781 shutdown_connections 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- 172.21.15.112:0/307868781 wait complete. 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 Processor -- start 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- start start 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70b8101a60 0x7f70b81968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70b8109680 con 0x7f70b8100860 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.297+0000 7f70bf171640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f70b8109500 con 0x7f70b8101a60 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bcf0d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bcf0d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49308/0 (socket says 172.21.15.112:49308) 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bcf0d640 1 -- 172.21.15.112:0/1895847131 learned_addr learned my addr 172.21.15.112:0/1895847131 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70b7fff640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70b8101a60 0x7f70b81968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bcf0d640 1 -- 172.21.15.112:0/1895847131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70b8101a60 msgr2=0x7f70b81968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bcf0d640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70b8101a60 0x7f70b81968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bcf0d640 1 -- 172.21.15.112:0/1895847131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b8196f30 con 0x7f70b8100860 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70b7fff640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70b8101a60 0x7f70b81968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bcf0d640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8196370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70ac006010 tx=0x7f70ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70b5ffb640 1 -- 172.21.15.112:0/1895847131 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70ac03f070 con 0x7f70b8100860 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70b5ffb640 1 -- 172.21.15.112:0/1895847131 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70ac0044d0 con 0x7f70b8100860 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b819b910 con 0x7f70b8100860 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70b5ffb640 1 -- 172.21.15.112:0/1895847131 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70ac035030 con 0x7f70b8100860 2024-09-21T00:58:48.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.298+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b819bea0 con 0x7f70b8100860 2024-09-21T00:58:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.299+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b8100c60 con 0x7f70b8100860 2024-09-21T00:58:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.300+0000 7f70b5ffb640 1 -- 172.21.15.112:0/1895847131 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7f70ac042070 con 0x7f70b8100860 2024-09-21T00:58:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.301+0000 7f70b5ffb640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f70a807b0b0 0x7f70a807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.301+0000 7f70b5ffb640 1 -- 172.21.15.112:0/1895847131 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f70ac0bee90 con 0x7f70b8100860 2024-09-21T00:58:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.301+0000 7f70b7fff640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f70a807b0b0 0x7f70a807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.301+0000 7f70b7fff640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f70a807b0b0 0x7f70a807d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f70b8197820 tx=0x7f70a4005ec0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.305+0000 7f70b5ffb640 1 -- 172.21.15.112:0/1895847131 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f70ac08a2f0 con 0x7f70b8100860 2024-09-21T00:58:48.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:48 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:48.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:48 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:48.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:48 smithi112 ceph-mon[28078]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-21T00:58:48.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.511+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f70b8105ff0 con 0x7f70a807b0b0 2024-09-21T00:58:48.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.512+0000 7f70b5ffb640 1 -- 172.21.15.112:0/1895847131 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f70b8105ff0 con 0x7f70a807b0b0 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f70a807b0b0 msgr2=0x7f70a807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f70a807b0b0 0x7f70a807d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f70b8197820 tx=0x7f70a4005ec0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 msgr2=0x7f70b8196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8196370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70ac006010 tx=0x7f70ac0048f0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 shutdown_connections 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f70a807b0b0 0x7f70a807d570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70b8101a60 0x7f70b81968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 --2- 172.21.15.112:0/1895847131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70b8100860 0x7f70b8196370 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 >> 172.21.15.112:0/1895847131 conn(0x7f70b80fbff0 msgr2=0x7f70b80fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 shutdown_connections 2024-09-21T00:58:48.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.515+0000 7f70bf171640 1 -- 172.21.15.112:0/1895847131 wait complete. 2024-09-21T00:58:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:58:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.610+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/1391340909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 msgr2=0x7f7b78100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.610+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/1391340909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b78100c80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009880 tx=0x7f7b6c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.610+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/1391340909 shutdown_connections 2024-09-21T00:58:48.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.610+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/1391340909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b78101a80 0x7f7b78101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.610+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/1391340909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b78100c80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.610+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/1391340909 >> 172.21.15.112:0/1391340909 conn(0x7f7b780fc010 msgr2=0x7f7b780fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:48.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/1391340909 shutdown_connections 2024-09-21T00:58:48.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/1391340909 wait complete. 2024-09-21T00:58:48.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 Processor -- start 2024-09-21T00:58:48.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 -- start start 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b781047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b78101a80 0x7f7b78102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7b781096a0 con 0x7f7b78100880 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ef2b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78109520 con 0x7f7b78101a80 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ccc7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b781047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ccc7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b781047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49322/0 (socket says 172.21.15.112:49322) 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.611+0000 7f7b7ccc7640 1 -- 172.21.15.112:0/2779796191 learned_addr learned my addr 172.21.15.112:0/2779796191 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b77fff640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b78101a80 0x7f7b78102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b7ccc7640 1 -- 172.21.15.112:0/2779796191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b78101a80 msgr2=0x7f7b78102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b7ccc7640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b78101a80 0x7f7b78102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b7ccc7640 1 -- 172.21.15.112:0/2779796191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b781033a0 con 0x7f7b78100880 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b7ccc7640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b781047a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c006010 tx=0x7f7b6c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b75ffb640 1 -- 172.21.15.112:0/2779796191 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b6c03f070 con 0x7f7b78100880 2024-09-21T00:58:48.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b75ffb640 1 -- 172.21.15.112:0/2779796191 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b6c004a50 con 0x7f7b78100880 2024-09-21T00:58:48.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b75ffb640 1 -- 172.21.15.112:0/2779796191 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b6c035030 con 0x7f7b78100880 2024-09-21T00:58:48.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.612+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b78103630 con 0x7f7b78100880 2024-09-21T00:58:48.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.613+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b78103b60 con 0x7f7b78100880 2024-09-21T00:58:48.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.614+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b78100c80 con 0x7f7b78100880 2024-09-21T00:58:48.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.615+0000 7f7b75ffb640 1 -- 172.21.15.112:0/2779796191 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7f7b6c042070 con 0x7f7b78100880 2024-09-21T00:58:48.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.615+0000 7f7b75ffb640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7b6807b100 0x7f7b6807d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.616+0000 7f7b75ffb640 1 -- 172.21.15.112:0/2779796191 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f7b6c0bee20 con 0x7f7b78100880 2024-09-21T00:58:48.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.616+0000 7f7b77fff640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7b6807b100 0x7f7b6807d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.616+0000 7f7b77fff640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7b6807b100 0x7f7b6807d5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b64005fd0 tx=0x7f7b64005850 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:48.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.621+0000 7f7b75ffb640 1 -- 172.21.15.112:0/2779796191 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7b6c004c00 con 0x7f7b78100880 2024-09-21T00:58:48.655 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:48 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:48.655 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:48 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:48.655 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:48 smithi187 ceph-mon[34997]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-21T00:58:48.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.824+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7b7806ab10 con 0x7f7b6807b100 2024-09-21T00:58:48.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.825+0000 7f7b75ffb640 1 -- 172.21.15.112:0/2779796191 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f7b7806ab10 con 0x7f7b6807b100 2024-09-21T00:58:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.827+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7b6807b100 msgr2=0x7f7b6807d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.827+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7b6807b100 0x7f7b6807d5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b64005fd0 tx=0x7f7b64005850 comp rx=0 tx=0).stop 2024-09-21T00:58:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.827+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 msgr2=0x7f7b781047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.827+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b781047a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c006010 tx=0x7f7b6c0045e0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.828+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 shutdown_connections 2024-09-21T00:58:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.828+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7b6807b100 0x7f7b6807d5c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.828+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b78101a80 0x7f7b78102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.828+0000 7f7b7ef2b640 1 --2- 172.21.15.112:0/2779796191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b78100880 0x7f7b781047a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.828+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 >> 172.21.15.112:0/2779796191 conn(0x7f7b780fc010 msgr2=0x7f7b7806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.828+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 shutdown_connections 2024-09-21T00:58:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.828+0000 7f7b7ef2b640 1 -- 172.21.15.112:0/2779796191 wait complete. 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.917+0000 7f424fd6b640 1 -- 172.21.15.112:0/298976039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248102470 msgr2=0x7f4248104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.917+0000 7f424fd6b640 1 --2- 172.21.15.112:0/298976039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248102470 0x7f4248104860 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4244009880 tx=0x7f424402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 -- 172.21.15.112:0/298976039 shutdown_connections 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 --2- 172.21.15.112:0/298976039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248104da0 0x7f4248107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 --2- 172.21.15.112:0/298976039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248102470 0x7f4248104860 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 -- 172.21.15.112:0/298976039 >> 172.21.15.112:0/298976039 conn(0x7f42480fbff0 msgr2=0x7f42480fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 -- 172.21.15.112:0/298976039 shutdown_connections 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 -- 172.21.15.112:0/298976039 wait complete. 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 Processor -- start 2024-09-21T00:58:48.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.918+0000 7f424fd6b640 1 -- start start 2024-09-21T00:58:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424fd6b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248102470 0x7f4248197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424fd6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248104da0 0x7f42481979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424fd6b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f424810a790 con 0x7f4248104da0 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424fd6b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f424810a610 con 0x7f4248102470 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424d306640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248104da0 0x7f42481979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424db07640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248102470 0x7f4248197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424db07640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248102470 0x7f4248197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:57288/0 (socket says 172.21.15.112:57288) 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424db07640 1 -- 172.21.15.112:0/1500479706 learned_addr learned my addr 172.21.15.112:0/1500479706 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424db07640 1 -- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248104da0 msgr2=0x7f42481979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424db07640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248104da0 0x7f42481979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424db07640 1 -- 172.21.15.112:0/1500479706 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4248198050 con 0x7f4248102470 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424d306640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248104da0 0x7f42481979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.919+0000 7f424db07640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248102470 0x7f4248197490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4244009230 tx=0x7f42440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.920+0000 7f423effd640 1 -- 172.21.15.112:0/1500479706 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f424403f070 con 0x7f4248102470 2024-09-21T00:58:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.920+0000 7f423effd640 1 -- 172.21.15.112:0/1500479706 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4244004b80 con 0x7f4248102470 2024-09-21T00:58:48.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.920+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424819ca30 con 0x7f4248102470 2024-09-21T00:58:48.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.921+0000 7f423effd640 1 -- 172.21.15.112:0/1500479706 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4244035030 con 0x7f4248102470 2024-09-21T00:58:48.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.921+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f424819cfc0 con 0x7f4248102470 2024-09-21T00:58:48.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.922+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4248102850 con 0x7f4248102470 2024-09-21T00:58:48.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.922+0000 7f423effd640 1 -- 172.21.15.112:0/1500479706 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7f4244042070 con 0x7f4248102470 2024-09-21T00:58:48.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.922+0000 7f423effd640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f423407b0a0 0x7f423407d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:48.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.923+0000 7f423effd640 1 -- 172.21.15.112:0/1500479706 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f42440be4d0 con 0x7f4248102470 2024-09-21T00:58:48.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.923+0000 7f424d306640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f423407b0a0 0x7f423407d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:48.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.923+0000 7f424d306640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f423407b0a0 0x7f423407d560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4248198940 tx=0x7f423800b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:48.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:48.927+0000 7f423effd640 1 -- 172.21.15.112:0/1500479706 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4244089930 con 0x7f4248102470 2024-09-21T00:58:49.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.120+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4248105820 con 0x7f423407b0a0 2024-09-21T00:58:49.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.130+0000 7f423effd640 1 -- 172.21.15.112:0/1500479706 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4248105820 con 0x7f423407b0a0 2024-09-21T00:58:49.132 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:58:49.132 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (8m) 0s ago 10m 25.1M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (2m) 0s ago 10m 8514k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (101s) 2s ago 9m 8082k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (10m) 0s ago 10m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (9m) 2s ago 9m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (8m) 0s ago 10m 77.7M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (4m) 0s ago 4m 151M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (4m) 0s ago 4m 14.9M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (4m) 2s ago 4m 18.7M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (4m) 2s ago 4m 16.6M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (92s) 0s ago 11m 577M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (26s) 2s ago 9m 519M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (11m) 0s ago 11m 64.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (9m) 2s ago 9m 50.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (11s) 0s ago 10m 8061k - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T00:58:49.133 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (5s) 2s ago 9m 3456k - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (8m) 0s ago 8m 203M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (7m) 0s ago 7m 220M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (7m) 0s ago 7m 175M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (6m) 2s ago 6m 251M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (6m) 2s ago 6m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (5m) 2s ago 5m 189M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (33s) 0s ago 9m 51.7M - 2.43.0 a07b618ecd1d d9e7547b282e 2024-09-21T00:58:49.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f423407b0a0 msgr2=0x7f423407d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f423407b0a0 0x7f423407d560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4248198940 tx=0x7f423800b390 comp rx=0 tx=0).stop 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248102470 msgr2=0x7f4248197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248102470 0x7f4248197490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4244009230 tx=0x7f42440046c0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 shutdown_connections 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f423407b0a0 0x7f423407d560 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4248104da0 0x7f42481979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 --2- 172.21.15.112:0/1500479706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4248102470 0x7f4248197490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 >> 172.21.15.112:0/1500479706 conn(0x7f42480fbff0 msgr2=0x7f42480fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 shutdown_connections 2024-09-21T00:58:49.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.133+0000 7f424fd6b640 1 -- 172.21.15.112:0/1500479706 wait complete. 2024-09-21T00:58:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.216+0000 7fa8375b6640 1 -- 172.21.15.112:0/3273720677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8301023d0 msgr2=0x7fa8301047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.216+0000 7fa8375b6640 1 --2- 172.21.15.112:0/3273720677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8301023d0 0x7fa8301047c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098b0 tx=0x7fa82c02a4d0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.216+0000 7fa8375b6640 1 -- 172.21.15.112:0/3273720677 shutdown_connections 2024-09-21T00:58:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.216+0000 7fa8375b6640 1 --2- 172.21.15.112:0/3273720677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa830104d00 0x7fa8301070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.216+0000 7fa8375b6640 1 --2- 172.21.15.112:0/3273720677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8301023d0 0x7fa8301047c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.216+0000 7fa8375b6640 1 -- 172.21.15.112:0/3273720677 >> 172.21.15.112:0/3273720677 conn(0x7fa8300fbff0 msgr2=0x7fa8300fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.217+0000 7fa8375b6640 1 -- 172.21.15.112:0/3273720677 shutdown_connections 2024-09-21T00:58:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.217+0000 7fa8375b6640 1 -- 172.21.15.112:0/3273720677 wait complete. 2024-09-21T00:58:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.217+0000 7fa8375b6640 1 Processor -- start 2024-09-21T00:58:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.217+0000 7fa8375b6640 1 -- start start 2024-09-21T00:58:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa8375b6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8301023d0 0x7fa830197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa8375b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830104d00 0x7fa830197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa8375b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa83010a7c0 con 0x7fa830104d00 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa8375b6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa83010a640 con 0x7fa8301023d0 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa834b51640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830104d00 0x7fa830197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa835352640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8301023d0 0x7fa830197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa834b51640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830104d00 0x7fa830197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49370/0 (socket says 172.21.15.112:49370) 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa834b51640 1 -- 172.21.15.112:0/1472411488 learned_addr learned my addr 172.21.15.112:0/1472411488 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa834b51640 1 -- 172.21.15.112:0/1472411488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8301023d0 msgr2=0x7fa830197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa834b51640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8301023d0 0x7fa830197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa834b51640 1 -- 172.21.15.112:0/1472411488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8301980e0 con 0x7fa830104d00 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.218+0000 7fa834b51640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830104d00 0x7fa830197a60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e970 tx=0x7fa82000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.219+0000 7fa8267fc640 1 -- 172.21.15.112:0/1472411488 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa82000cac0 con 0x7fa830104d00 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.219+0000 7fa8267fc640 1 -- 172.21.15.112:0/1472411488 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8200054e0 con 0x7fa830104d00 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.219+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83019cb20 con 0x7fa830104d00 2024-09-21T00:58:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.219+0000 7fa8267fc640 1 -- 172.21.15.112:0/1472411488 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa820010430 con 0x7fa830104d00 2024-09-21T00:58:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.219+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83019d0b0 con 0x7fa830104d00 2024-09-21T00:58:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.220+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8301027b0 con 0x7fa830104d00 2024-09-21T00:58:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.220+0000 7fa8267fc640 1 -- 172.21.15.112:0/1472411488 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7fa820004ec0 con 0x7fa830104d00 2024-09-21T00:58:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.221+0000 7fa8267fc640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa81c07b050 0x7fa81c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.221+0000 7fa8267fc640 1 -- 172.21.15.112:0/1472411488 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fa82009e9b0 con 0x7fa830104d00 2024-09-21T00:58:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.221+0000 7fa835352640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa81c07b050 0x7fa81c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.222+0000 7fa835352640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa81c07b050 0x7fa81c07d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa82c006010 tx=0x7fa82c0058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.226+0000 7fa8267fc640 1 -- 172.21.15.112:0/1472411488 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa820069cf0 con 0x7fa830104d00 2024-09-21T00:58:49.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.494+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa83019d4a0 con 0x7fa830104d00 2024-09-21T00:58:49.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.495+0000 7fa8267fc640 1 -- 172.21.15.112:0/1472411488 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fa82006eba0 con 0x7fa830104d00 2024-09-21T00:58:49.496 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:58:49.496 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:58:49.496 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:58:49.497 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:58:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa81c07b050 msgr2=0x7fa81c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa81c07b050 0x7fa81c07d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa82c006010 tx=0x7fa82c0058d0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830104d00 msgr2=0x7fa830197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830104d00 0x7fa830197a60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e970 tx=0x7fa82000ee30 comp rx=0 tx=0).stop 2024-09-21T00:58:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 shutdown_connections 2024-09-21T00:58:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa81c07b050 0x7fa81c07d510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830104d00 0x7fa830197a60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 --2- 172.21.15.112:0/1472411488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8301023d0 0x7fa830197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.497+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 >> 172.21.15.112:0/1472411488 conn(0x7fa8300fbff0 msgr2=0x7fa8300fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:49.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.498+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 shutdown_connections 2024-09-21T00:58:49.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.498+0000 7fa8375b6640 1 -- 172.21.15.112:0/1472411488 wait complete. 2024-09-21T00:58:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- 172.21.15.112:0/2134545284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 msgr2=0x7f658c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 --2- 172.21.15.112:0/2134545284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c100c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f657c009880 tx=0x7f657c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- 172.21.15.112:0/2134545284 shutdown_connections 2024-09-21T00:58:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 --2- 172.21.15.112:0/2134545284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f658c101a40 0x7f658c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 --2- 172.21.15.112:0/2134545284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c100c40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- 172.21.15.112:0/2134545284 >> 172.21.15.112:0/2134545284 conn(0x7f658c0fbff0 msgr2=0x7f658c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- 172.21.15.112:0/2134545284 shutdown_connections 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- 172.21.15.112:0/2134545284 wait complete. 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 Processor -- start 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- start start 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f658c101a40 0x7f658c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f658c109660 con 0x7f658c100840 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.587+0000 7f659202b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f658c1094e0 con 0x7f658c101a40 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f658b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f658b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49390/0 (socket says 172.21.15.112:49390) 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f658b7fe640 1 -- 172.21.15.112:0/1551833697 learned_addr learned my addr 172.21.15.112:0/1551833697 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f6583fff640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f658c101a40 0x7f658c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:49.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f658b7fe640 1 -- 172.21.15.112:0/1551833697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f658c101a40 msgr2=0x7f658c197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f658b7fe640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f658c101a40 0x7f658c197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f658b7fe640 1 -- 172.21.15.112:0/1551833697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c1980a0 con 0x7f658c100840 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f658b7fe640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c1974e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f657c006010 tx=0x7f657c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f65897fa640 1 -- 172.21.15.112:0/1551833697 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f657c03f070 con 0x7f658c100840 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f65897fa640 1 -- 172.21.15.112:0/1551833697 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f657c004a50 con 0x7f658c100840 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c19ca80 con 0x7f658c100840 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f65897fa640 1 -- 172.21.15.112:0/1551833697 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f657c035030 con 0x7f658c100840 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.588+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c19d010 con 0x7f658c100840 2024-09-21T00:58:49.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.589+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c100c40 con 0x7f658c100840 2024-09-21T00:58:49.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.590+0000 7f65897fa640 1 -- 172.21.15.112:0/1551833697 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 32) ==== 103424+0+0 (secure 0 0 0) 0x7f657c042070 con 0x7f658c100840 2024-09-21T00:58:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.590+0000 7f65897fa640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f657807b050 0x7f657807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.591+0000 7f65897fa640 1 -- 172.21.15.112:0/1551833697 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f657c0beda0 con 0x7f658c100840 2024-09-21T00:58:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.591+0000 7f6583fff640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f657807b050 0x7f657807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:49.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.591+0000 7f6583fff640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f657807b050 0x7f657807d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f658c198990 tx=0x7f657400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:49.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.595+0000 7f65897fa640 1 -- 172.21.15.112:0/1551833697 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f657c004c00 con 0x7f658c100840 2024-09-21T00:58:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:49.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:49 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1472411488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:49.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.797+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f658c06a2f0 con 0x7f657807b050 2024-09-21T00:58:49.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.800+0000 7f65897fa640 1 -- 172.21.15.112:0/1551833697 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f658c06a2f0 con 0x7f657807b050 2024-09-21T00:58:49.801 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:58:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:58:49.802 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f657807b050 msgr2=0x7f657807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f657807b050 0x7f657807d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f658c198990 tx=0x7f657400b390 comp rx=0 tx=0).stop 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 msgr2=0x7f658c1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c1974e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f657c006010 tx=0x7f657c0045e0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 shutdown_connections 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f657807b050 0x7f657807d510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f658c101a40 0x7f658c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 --2- 172.21.15.112:0/1551833697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f658c100840 0x7f658c1974e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:49.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 >> 172.21.15.112:0/1551833697 conn(0x7f658c0fbff0 msgr2=0x7f658c069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:49.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 shutdown_connections 2024-09-21T00:58:49.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:58:49.802+0000 7f659202b640 1 -- 172.21.15.112:0/1551833697 wait complete. 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:49.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:49 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1472411488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:50 smithi187 ceph-mon[34997]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-21T00:58:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:50 smithi187 ceph-mon[34997]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:50 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:50.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:50 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:50.981 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:50 smithi112 ceph-mon[28078]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-21T00:58:50.982 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:50 smithi112 ceph-mon[28078]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:50.982 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:50 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:50.982 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:50 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:52 smithi112 ceph-mon[28078]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:53.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:52 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:53.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:52 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:53.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:52 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:53.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:52 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:58:53.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:52 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:52 smithi187 ceph-mon[34997]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:52 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:52 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:52 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:58:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:52 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:58:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:52 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:58:54.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:53 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:53 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:58:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:54 smithi187 ceph-mon[34997]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:54.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:54 smithi187 ceph-mon[34997]: Upgrade: Updating prometheus.smithi112 2024-09-21T00:58:55.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:54 smithi112 ceph-mon[28078]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:55.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:54 smithi112 ceph-mon[28078]: Upgrade: Updating prometheus.smithi112 2024-09-21T00:58:56.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:55 smithi112 ceph-mon[28078]: Deploying daemon prometheus.smithi112 on smithi112 2024-09-21T00:58:56.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:55 smithi187 ceph-mon[34997]: Deploying daemon prometheus.smithi112 on smithi112 2024-09-21T00:58:57.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:56 smithi112 ceph-mon[28078]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:57.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:56 smithi187 ceph-mon[34997]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:59.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:58 smithi112 ceph-mon[28078]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:59.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:58:58 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:58:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:58 smithi187 ceph-mon[34997]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:58:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:58:58 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:00.970 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:00 smithi187 ceph-mon[34997]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:01.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:00 smithi112 ceph-mon[28078]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:02.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:01 smithi112 ceph-mon[28078]: mgrmap e33: smithi112.fzmyfw(active, since 93s), standbys: smithi187.hpbgni 2024-09-21T00:59:02.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:01 smithi187 ceph-mon[34997]: mgrmap e33: smithi112.fzmyfw(active, since 93s), standbys: smithi187.hpbgni 2024-09-21T00:59:03.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:02 smithi112 ceph-mon[28078]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:03.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:02 smithi187 ceph-mon[34997]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:04.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:04 smithi112 ceph-mon[28078]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:04 smithi187 ceph-mon[34997]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:07.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:06 smithi112 ceph-mon[28078]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:07.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:06 smithi187 ceph-mon[34997]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:09.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:08 smithi112 ceph-mon[28078]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:09.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:08 smithi187 ceph-mon[34997]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:10.988 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:10 smithi112 ceph-mon[28078]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:10.988 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:10 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:10.988 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:10 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:10.988 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:10 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:10.988 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:10 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:11.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:10 smithi187 ceph-mon[34997]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T00:59:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:10 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:10 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:10 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:10 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:11.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:11 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:12.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:11 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:12.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:12 smithi112 ceph-mon[28078]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:13.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:12 smithi187 ceph-mon[34997]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:13.988 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:13 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:13 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:14.976 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:14 smithi112 ceph-mon[28078]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:15.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:14 smithi187 ceph-mon[34997]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:16.623 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:16 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:16.623 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:16 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:16.623 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:16 smithi112 ceph-mon[28078]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:16.623 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:16 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:16.623 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:16 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:16 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:16 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:16 smithi187 ceph-mon[34997]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:16 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:16 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:18.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:18 smithi187 ceph-mon[34997]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:18.942 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:18 smithi112 ceph-mon[28078]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:19.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 -- 172.21.15.112:0/2814344897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934104d40 msgr2=0x7f0934107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:19.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 --2- 172.21.15.112:0/2814344897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934104d40 0x7f0934107130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f09280098b0 tx=0x7f092802a4d0 comp rx=0 tx=0).stop 2024-09-21T00:59:19.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 -- 172.21.15.112:0/2814344897 shutdown_connections 2024-09-21T00:59:19.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 --2- 172.21.15.112:0/2814344897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934104d40 0x7f0934107130 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:19.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 --2- 172.21.15.112:0/2814344897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0934102410 0x7f0934104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:19.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 -- 172.21.15.112:0/2814344897 >> 172.21.15.112:0/2814344897 conn(0x7f09340fc010 msgr2=0x7f09340fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:19.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 -- 172.21.15.112:0/2814344897 shutdown_connections 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.888+0000 7f093a41d640 1 -- 172.21.15.112:0/2814344897 wait complete. 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f093a41d640 1 Processor -- start 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f093a41d640 1 -- start start 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f093a41d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934102410 0x7f0934101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f093a41d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0934104d40 0x7f09341003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f093a41d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f093410a7d0 con 0x7f0934102410 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f093a41d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f093410a650 con 0x7f0934104d40 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f0933fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934102410 0x7f0934101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f0933fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934102410 0x7f0934101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49480/0 (socket says 172.21.15.112:49480) 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.889+0000 7f0933fff640 1 -- 172.21.15.112:0/1333136436 learned_addr learned my addr 172.21.15.112:0/1333136436 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f09337fe640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0934104d40 0x7f09341003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f0933fff640 1 -- 172.21.15.112:0/1333136436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0934104d40 msgr2=0x7f09341003c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:19.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f0933fff640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0934104d40 0x7f09341003c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f0933fff640 1 -- 172.21.15.112:0/1333136436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0934100900 con 0x7f0934102410 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f09337fe640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0934104d40 0x7f09341003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f0933fff640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934102410 0x7f0934101d00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f092400d6f0 tx=0x7f092400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f09317fa640 1 -- 172.21.15.112:0/1333136436 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0924017070 con 0x7f0934102410 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f09317fa640 1 -- 172.21.15.112:0/1333136436 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f092400de00 con 0x7f0934102410 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f09317fa640 1 -- 172.21.15.112:0/1333136436 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0924004bb0 con 0x7f0934102410 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0934100bf0 con 0x7f0934102410 2024-09-21T00:59:19.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.890+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0934101180 con 0x7f0934102410 2024-09-21T00:59:19.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.891+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09341027f0 con 0x7f0934102410 2024-09-21T00:59:19.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.892+0000 7f09317fa640 1 -- 172.21.15.112:0/1333136436 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0924004e60 con 0x7f0934102410 2024-09-21T00:59:19.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.892+0000 7f09317fa640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f091c07af30 0x7f091c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:19.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.893+0000 7f09337fe640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f091c07af30 0x7f091c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:19.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.893+0000 7f09317fa640 1 -- 172.21.15.112:0/1333136436 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f092409dcf0 con 0x7f0934102410 2024-09-21T00:59:19.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.893+0000 7f09337fe640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f091c07af30 0x7f091c07d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0928000c00 tx=0x7f0928009650 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:19.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:19.897+0000 7f09317fa640 1 -- 172.21.15.112:0/1333136436 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0924069250 con 0x7f0934102410 2024-09-21T00:59:20.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.094+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0934105600 con 0x7f091c07af30 2024-09-21T00:59:20.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.095+0000 7f09317fa640 1 -- 172.21.15.112:0/1333136436 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f0934105600 con 0x7f091c07af30 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f091c07af30 msgr2=0x7f091c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f091c07af30 0x7f091c07d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0928000c00 tx=0x7f0928009650 comp rx=0 tx=0).stop 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934102410 msgr2=0x7f0934101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934102410 0x7f0934101d00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f092400d6f0 tx=0x7f092400dbb0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 shutdown_connections 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f091c07af30 0x7f091c07d3f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0934104d40 0x7f09341003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 --2- 172.21.15.112:0/1333136436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0934102410 0x7f0934101d00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 >> 172.21.15.112:0/1333136436 conn(0x7f09340fc010 msgr2=0x7f09340fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:20.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 shutdown_connections 2024-09-21T00:59:20.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.097+0000 7f093a41d640 1 -- 172.21.15.112:0/1333136436 wait complete. 2024-09-21T00:59:20.107 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 -- 172.21.15.112:0/1920810459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac103930 msgr2=0x7f9aac0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/1920810459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac103930 0x7f9aac0ff9e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009880 tx=0x7f9a9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 -- 172.21.15.112:0/1920810459 shutdown_connections 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/1920810459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac103930 0x7f9aac0ff9e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/1920810459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9aac102f60 0x7f9aac103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 -- 172.21.15.112:0/1920810459 >> 172.21.15.112:0/1920810459 conn(0x7f9aac0fb750 msgr2=0x7f9aac0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 -- 172.21.15.112:0/1920810459 shutdown_connections 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.183+0000 7f9ab47c9640 1 -- 172.21.15.112:0/1920810459 wait complete. 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab47c9640 1 Processor -- start 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab47c9640 1 -- start start 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab47c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac102f60 0x7f9aac197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab47c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9aac103930 0x7f9aac197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab47c9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10a770 con 0x7f9aac102f60 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab47c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10a5f0 con 0x7f9aac103930 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab2565640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac102f60 0x7f9aac197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab2565640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac102f60 0x7f9aac197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49506/0 (socket says 172.21.15.112:49506) 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab2565640 1 -- 172.21.15.112:0/2560297529 learned_addr learned my addr 172.21.15.112:0/2560297529 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab1d64640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9aac103930 0x7f9aac197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab2565640 1 -- 172.21.15.112:0/2560297529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9aac103930 msgr2=0x7f9aac197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab2565640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9aac103930 0x7f9aac197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.184+0000 7f9ab2565640 1 -- 172.21.15.112:0/2560297529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac198100 con 0x7f9aac102f60 2024-09-21T00:59:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.185+0000 7f9ab2565640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac102f60 0x7f9aac197540 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800d6f0 tx=0x7f9aa800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.185+0000 7f9aa37fe640 1 -- 172.21.15.112:0/2560297529 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aa8017070 con 0x7f9aac102f60 2024-09-21T00:59:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.185+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac19cad0 con 0x7f9aac102f60 2024-09-21T00:59:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.185+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac19d030 con 0x7f9aac102f60 2024-09-21T00:59:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.185+0000 7f9aa37fe640 1 -- 172.21.15.112:0/2560297529 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9aa800de00 con 0x7f9aac102f60 2024-09-21T00:59:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.185+0000 7f9aa37fe640 1 -- 172.21.15.112:0/2560297529 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aa8003bc0 con 0x7f9aac102f60 2024-09-21T00:59:20.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.186+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac10af50 con 0x7f9aac102f60 2024-09-21T00:59:20.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.186+0000 7f9aa37fe640 1 -- 172.21.15.112:0/2560297529 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9aa8003e70 con 0x7f9aac102f60 2024-09-21T00:59:20.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.187+0000 7f9aa37fe640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9a9807af30 0x7f9a9807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.187+0000 7f9aa37fe640 1 -- 172.21.15.112:0/2560297529 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f9aa809db00 con 0x7f9aac102f60 2024-09-21T00:59:20.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.187+0000 7f9ab1d64640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9a9807af30 0x7f9a9807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.188+0000 7f9ab1d64640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9a9807af30 0x7f9a9807d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009230 tx=0x7f9a9c0058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:20.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.192+0000 7f9aa37fe640 1 -- 172.21.15.112:0/2560297529 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9aa8069100 con 0x7f9aac102f60 2024-09-21T00:59:20.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.395+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9aac062630 con 0x7f9a9807af30 2024-09-21T00:59:20.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.396+0000 7f9aa37fe640 1 -- 172.21.15.112:0/2560297529 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f9aac062630 con 0x7f9a9807af30 2024-09-21T00:59:20.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9a9807af30 msgr2=0x7f9a9807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9a9807af30 0x7f9a9807d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009230 tx=0x7f9a9c0058d0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac102f60 msgr2=0x7f9aac197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac102f60 0x7f9aac197540 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800d6f0 tx=0x7f9aa800dbb0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 shutdown_connections 2024-09-21T00:59:20.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9a9807af30 0x7f9a9807d3f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9aac103930 0x7f9aac197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 --2- 172.21.15.112:0/2560297529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9aac102f60 0x7f9aac197540 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 >> 172.21.15.112:0/2560297529 conn(0x7f9aac0fb750 msgr2=0x7f9aac106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:20.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 shutdown_connections 2024-09-21T00:59:20.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.398+0000 7f9ab47c9640 1 -- 172.21.15.112:0/2560297529 wait complete. 2024-09-21T00:59:20.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 -- 172.21.15.112:0/1369016538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 msgr2=0x7f64441070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 --2- 172.21.15.112:0/1369016538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f64441070f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f64380098b0 tx=0x7f643802a4d0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 -- 172.21.15.112:0/1369016538 shutdown_connections 2024-09-21T00:59:20.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 --2- 172.21.15.112:0/1369016538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f64441070f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 --2- 172.21.15.112:0/1369016538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64441023d0 0x7f64441047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 -- 172.21.15.112:0/1369016538 >> 172.21.15.112:0/1369016538 conn(0x7f64440fbff0 msgr2=0x7f64440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:20.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 -- 172.21.15.112:0/1369016538 shutdown_connections 2024-09-21T00:59:20.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 -- 172.21.15.112:0/1369016538 wait complete. 2024-09-21T00:59:20.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.484+0000 7f64493ad640 1 Processor -- start 2024-09-21T00:59:20.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64493ad640 1 -- start start 2024-09-21T00:59:20.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64493ad640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64441023d0 0x7f6444197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64493ad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f6444197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64493ad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f644410a770 con 0x7f6444104d00 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64493ad640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f644410a5f0 con 0x7f64441023d0 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64427fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f6444197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64427fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f6444197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49534/0 (socket says 172.21.15.112:49534) 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64427fc640 1 -- 172.21.15.112:0/835510191 learned_addr learned my addr 172.21.15.112:0/835510191 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f6442ffd640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64441023d0 0x7f6444197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64427fc640 1 -- 172.21.15.112:0/835510191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64441023d0 msgr2=0x7f6444197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64427fc640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64441023d0 0x7f6444197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64427fc640 1 -- 172.21.15.112:0/835510191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6444198040 con 0x7f6444104d00 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.485+0000 7f64427fc640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f6444197a50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6438009230 tx=0x7f64380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.486+0000 7f642bfff640 1 -- 172.21.15.112:0/835510191 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f643803f070 con 0x7f6444104d00 2024-09-21T00:59:20.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.486+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644419ca50 con 0x7f6444104d00 2024-09-21T00:59:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.486+0000 7f642bfff640 1 -- 172.21.15.112:0/835510191 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64380044d0 con 0x7f6444104d00 2024-09-21T00:59:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.486+0000 7f642bfff640 1 -- 172.21.15.112:0/835510191 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6438035030 con 0x7f6444104d00 2024-09-21T00:59:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.486+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644419cf50 con 0x7f6444104d00 2024-09-21T00:59:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.487+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64441027b0 con 0x7f6444104d00 2024-09-21T00:59:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.487+0000 7f642bfff640 1 -- 172.21.15.112:0/835510191 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6438042070 con 0x7f6444104d00 2024-09-21T00:59:20.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.488+0000 7f642bfff640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f642c07af30 0x7f642c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.488+0000 7f642bfff640 1 -- 172.21.15.112:0/835510191 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f64380bec90 con 0x7f6444104d00 2024-09-21T00:59:20.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.488+0000 7f6442ffd640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f642c07af30 0x7f642c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.488+0000 7f6442ffd640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f642c07af30 0x7f642c07d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6434005e10 tx=0x7f6434005da0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:20.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.492+0000 7f642bfff640 1 -- 172.21.15.112:0/835510191 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f643808a290 con 0x7f6444104d00 2024-09-21T00:59:20.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.685+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f64441057c0 con 0x7f642c07af30 2024-09-21T00:59:20.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:20.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:20.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:20 smithi112 ceph-mon[28078]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.695+0000 7f642bfff640 1 -- 172.21.15.112:0/835510191 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f64441057c0 con 0x7f642c07af30 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (9m) 5s ago 10m 25.1M - 0.25.0 c8568f914cd2 b365b64bff41 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (2m) 5s ago 10m 8556k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (2m) 33s ago 10m 8082k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (10m) 5s ago 10m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (10m) 33s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:59:20.696 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (9m) 5s ago 10m 77.8M - 9.4.12 2bacad6d85d8 2810e46f1291 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (5m) 5s ago 5m 151M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (5m) 5s ago 5m 15.1M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (5m) 33s ago 5m 18.7M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (5m) 33s ago 5m 16.6M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (2m) 5s ago 11m 579M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (58s) 33s ago 9m 519M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (12m) 5s ago 12m 61.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (9m) 33s ago 9m 50.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (43s) 5s ago 10m 8158k - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (37s) 33s ago 9m 3456k - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (8m) 5s ago 8m 205M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (8m) 5s ago 8m 222M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (7m) 5s ago 7m 177M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (7m) 33s ago 7m 251M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (6m) 33s ago 6m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:59:20.697 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (6m) 33s ago 6m 189M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:59:20.698 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (12s) 5s ago 10m 37.4M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T00:59:20.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f642c07af30 msgr2=0x7f642c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f642c07af30 0x7f642c07d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6434005e10 tx=0x7f6434005da0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 msgr2=0x7f6444197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f6444197a50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6438009230 tx=0x7f64380048f0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 shutdown_connections 2024-09-21T00:59:20.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f642c07af30 0x7f642c07d3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6444104d00 0x7f6444197a50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 --2- 172.21.15.112:0/835510191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64441023d0 0x7f6444197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.697+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 >> 172.21.15.112:0/835510191 conn(0x7f64440fbff0 msgr2=0x7f64440fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:20.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.698+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 shutdown_connections 2024-09-21T00:59:20.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.698+0000 7f64493ad640 1 -- 172.21.15.112:0/835510191 wait complete. 2024-09-21T00:59:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/695744446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 msgr2=0x7ff7e4100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/695744446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100fb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009880 tx=0x7ff7e002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/695744446 shutdown_connections 2024-09-21T00:59:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/695744446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100fb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/695744446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7e4101df0 0x7ff7e41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/695744446 >> 172.21.15.112:0/695744446 conn(0x7ff7e40fb750 msgr2=0x7ff7e40fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/695744446 shutdown_connections 2024-09-21T00:59:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/695744446 wait complete. 2024-09-21T00:59:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 Processor -- start 2024-09-21T00:59:20.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 -- start start 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.783+0000 7ff7ebbf3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7ebbf3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7e4101df0 0x7ff7e419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7ebbf3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4109680 con 0x7ff7e4100b30 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7ebbf3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4109500 con 0x7ff7e4101df0 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e998f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e998f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49540/0 (socket says 172.21.15.112:49540) 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e998f640 1 -- 172.21.15.112:0/1517756384 learned_addr learned my addr 172.21.15.112:0/1517756384 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e918e640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7e4101df0 0x7ff7e419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e998f640 1 -- 172.21.15.112:0/1517756384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7e4101df0 msgr2=0x7ff7e419c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e998f640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7e4101df0 0x7ff7e419c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e998f640 1 -- 172.21.15.112:0/1517756384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e419c710 con 0x7ff7e4100b30 2024-09-21T00:59:20.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7e998f640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100550 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00cc30 tx=0x7ff7dc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:20.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7daffd640 1 -- 172.21.15.112:0/1517756384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7dc00ae50 con 0x7ff7e4100b30 2024-09-21T00:59:20.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7daffd640 1 -- 172.21.15.112:0/1517756384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7dc003e30 con 0x7ff7e4100b30 2024-09-21T00:59:20.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e419ca00 con 0x7ff7e4100b30 2024-09-21T00:59:20.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7daffd640 1 -- 172.21.15.112:0/1517756384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7dc00f680 con 0x7ff7e4100b30 2024-09-21T00:59:20.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.784+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e419cf60 con 0x7ff7e4100b30 2024-09-21T00:59:20.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.785+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e4100fb0 con 0x7ff7e4100b30 2024-09-21T00:59:20.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.786+0000 7ff7daffd640 1 -- 172.21.15.112:0/1517756384 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff7dc003fe0 con 0x7ff7e4100b30 2024-09-21T00:59:20.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.787+0000 7ff7daffd640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff7cc07b0e0 0x7ff7cc07d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:20.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.787+0000 7ff7daffd640 1 -- 172.21.15.112:0/1517756384 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7ff7dc09e2a0 con 0x7ff7e4100b30 2024-09-21T00:59:20.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.787+0000 7ff7e918e640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff7cc07b0e0 0x7ff7cc07d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:20.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.787+0000 7ff7e918e640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff7cc07b0e0 0x7ff7cc07d5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0000c00 tx=0x7ff7e00058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:20.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:20.791+0000 7ff7daffd640 1 -- 172.21.15.112:0/1517756384 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff7dc014070 con 0x7ff7e4100b30 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:20.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:20.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:20 smithi187 ceph-mon[34997]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:21.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.054+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff7e4190490 con 0x7ff7e4100b30 2024-09-21T00:59:21.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.054+0000 7ff7daffd640 1 -- 172.21.15.112:0/1517756384 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7ff7dc0698a0 con 0x7ff7e4100b30 2024-09-21T00:59:21.055 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:59:21.055 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:59:21.055 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:59:21.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:21.055 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:59:21.056 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:59:21.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff7cc07b0e0 msgr2=0x7ff7cc07d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff7cc07b0e0 0x7ff7cc07d5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0000c00 tx=0x7ff7e00058d0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 msgr2=0x7ff7e4100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100550 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00cc30 tx=0x7ff7dc00a620 comp rx=0 tx=0).stop 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 shutdown_connections 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff7cc07b0e0 0x7ff7cc07d5a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7e4101df0 0x7ff7e419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 --2- 172.21.15.112:0/1517756384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7e4100b30 0x7ff7e4100550 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 >> 172.21.15.112:0/1517756384 conn(0x7ff7e40fb750 msgr2=0x7ff7e4105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 shutdown_connections 2024-09-21T00:59:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.057+0000 7ff7ebbf3640 1 -- 172.21.15.112:0/1517756384 wait complete. 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 -- 172.21.15.112:0/3782379789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4102b80 msgr2=0x7fdca4103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/3782379789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4102b80 0x7fdca4103000 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009880 tx=0x7fdc9402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 -- 172.21.15.112:0/3782379789 shutdown_connections 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/3782379789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4102b80 0x7fdca4103000 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/3782379789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca4101980 0x7fdca4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 -- 172.21.15.112:0/3782379789 >> 172.21.15.112:0/3782379789 conn(0x7fdca40fd110 msgr2=0x7fdca40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 -- 172.21.15.112:0/3782379789 shutdown_connections 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 -- 172.21.15.112:0/3782379789 wait complete. 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 Processor -- start 2024-09-21T00:59:21.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.144+0000 7fdcac3d7640 1 -- start start 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcac3d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4101980 0x7fdca41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcac3d7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca4102b80 0x7fdca4197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcac3d7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdca410a840 con 0x7fdca4101980 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcac3d7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdca410a6c0 con 0x7fdca4102b80 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcaa173640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4101980 0x7fdca41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcaa173640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4101980 0x7fdca41974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49558/0 (socket says 172.21.15.112:49558) 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcaa173640 1 -- 172.21.15.112:0/185723456 learned_addr learned my addr 172.21.15.112:0/185723456 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdca9972640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca4102b80 0x7fdca4197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcaa173640 1 -- 172.21.15.112:0/185723456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca4102b80 msgr2=0x7fdca4197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcaa173640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca4102b80 0x7fdca4197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcaa173640 1 -- 172.21.15.112:0/185723456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca41980a0 con 0x7fdca4101980 2024-09-21T00:59:21.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcaa173640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4101980 0x7fdca41974e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdca000b9c0 tx=0x7fdca000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:21.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdc9b7fe640 1 -- 172.21.15.112:0/185723456 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdca0019070 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca419cae0 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdc9b7fe640 1 -- 172.21.15.112:0/185723456 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdca000cde0 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.145+0000 7fdc9b7fe640 1 -- 172.21.15.112:0/185723456 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdca0012570 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.146+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca419d040 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.147+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca410b020 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.147+0000 7fdc9b7fe640 1 -- 172.21.15.112:0/185723456 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fdca001c070 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.148+0000 7fdc9b7fe640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdc9007af30 0x7fdc9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.148+0000 7fdc9b7fe640 1 -- 172.21.15.112:0/185723456 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fdca009d7f0 con 0x7fdca4101980 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.148+0000 7fdca9972640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdc9007af30 0x7fdc9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:21.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.148+0000 7fdca9972640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdc9007af30 0x7fdc9007d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc94000c00 tx=0x7fdc940058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:21.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.152+0000 7fdc9b7fe640 1 -- 172.21.15.112:0/185723456 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fdca0068df0 con 0x7fdca4101980 2024-09-21T00:59:21.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.377+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdca4062630 con 0x7fdc9007af30 2024-09-21T00:59:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.379+0000 7fdc9b7fe640 1 -- 172.21.15.112:0/185723456 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7fdca4062630 con 0x7fdc9007af30 2024-09-21T00:59:21.379 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:59:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:59:21.380 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdc9007af30 msgr2=0x7fdc9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdc9007af30 0x7fdc9007d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc94000c00 tx=0x7fdc940058d0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4101980 msgr2=0x7fdca41974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4101980 0x7fdca41974e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdca000b9c0 tx=0x7fdca000be80 comp rx=0 tx=0).stop 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 shutdown_connections 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdc9007af30 0x7fdc9007d3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca4102b80 0x7fdca4197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 --2- 172.21.15.112:0/185723456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdca4101980 0x7fdca41974e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 >> 172.21.15.112:0/185723456 conn(0x7fdca40fd110 msgr2=0x7fdca4105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 shutdown_connections 2024-09-21T00:59:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:21.381+0000 7fdcac3d7640 1 -- 172.21.15.112:0/185723456 wait complete. 2024-09-21T00:59:21.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:21 smithi112 ceph-mon[28078]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:21.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:21 smithi112 ceph-mon[28078]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:21.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:21 smithi112 ceph-mon[28078]: Upgrade: Updating alertmanager.smithi112 2024-09-21T00:59:21.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:21 smithi112 ceph-mon[28078]: Deploying daemon alertmanager.smithi112 on smithi112 2024-09-21T00:59:21.690 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:21 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1517756384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:21.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:21 smithi187 ceph-mon[34997]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:21 smithi187 ceph-mon[34997]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:21 smithi187 ceph-mon[34997]: Upgrade: Updating alertmanager.smithi112 2024-09-21T00:59:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:21 smithi187 ceph-mon[34997]: Deploying daemon alertmanager.smithi112 on smithi112 2024-09-21T00:59:21.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:21 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1517756384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:22.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:22 smithi112 ceph-mon[28078]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:22.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:22 smithi112 ceph-mon[28078]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:22.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:22 smithi187 ceph-mon[34997]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:22.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:22 smithi187 ceph-mon[34997]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:24.853 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:24 smithi112 ceph-mon[28078]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:24.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:24 smithi187 ceph-mon[34997]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:26.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:26 smithi187 ceph-mon[34997]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:26.928 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:26 smithi112 ceph-mon[28078]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:28.897 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:28 smithi187 ceph-mon[34997]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:28.897 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:28.998 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:28 smithi112 ceph-mon[28078]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:28.998 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:30 smithi112 ceph-mon[28078]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:30 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:30 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:31.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:30 smithi187 ceph-mon[34997]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:30 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:30 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:33.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:33 smithi112 ceph-mon[28078]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:33.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:33 smithi187 ceph-mon[34997]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:35 smithi112 ceph-mon[28078]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:35 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:35 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:35.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:35 smithi187 ceph-mon[34997]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:35.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:35 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:35.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:35 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:36.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:36 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:36.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:36 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:36.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:36 smithi187 ceph-mon[34997]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:36.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:36 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:36.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:36 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:36.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:36 smithi112 ceph-mon[28078]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:38.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:38 smithi187 ceph-mon[34997]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:39.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:38 smithi112 ceph-mon[28078]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:39.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:39.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:39 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T00:59:40.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:40.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:39 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:41.002 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:40 smithi112 ceph-mon[28078]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:41.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:40 smithi187 ceph-mon[34997]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:41 smithi112 ceph-mon[28078]: Upgrade: Updating grafana.smithi112 2024-09-21T00:59:42.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:41 smithi112 ceph-mon[28078]: Deploying daemon grafana.smithi112 on smithi112 2024-09-21T00:59:42.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:41 smithi187 ceph-mon[34997]: Upgrade: Updating grafana.smithi112 2024-09-21T00:59:42.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:41 smithi187 ceph-mon[34997]: Deploying daemon grafana.smithi112 on smithi112 2024-09-21T00:59:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:42 smithi112 ceph-mon[28078]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:43.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:42 smithi187 ceph-mon[34997]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:44.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:43 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:44.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:43 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:45.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:44 smithi112 ceph-mon[28078]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:45.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:44 smithi187 ceph-mon[34997]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:47.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:46 smithi112 ceph-mon[28078]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:46 smithi187 ceph-mon[34997]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:48.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:48 smithi112 ceph-mon[28078]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:48.961 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:48 smithi187 ceph-mon[34997]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:50.887 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:50 smithi112 ceph-mon[28078]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:50 smithi187 ceph-mon[34997]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:51.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 -- 172.21.15.112:0/3991808028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4102b80 msgr2=0x7fa0b4103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/3991808028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4102b80 0x7fa0b4103000 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009880 tx=0x7fa0a002a4a0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 -- 172.21.15.112:0/3991808028 shutdown_connections 2024-09-21T00:59:51.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/3991808028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4102b80 0x7fa0b4103000 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/3991808028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b4101980 0x7fa0b4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 -- 172.21.15.112:0/3991808028 >> 172.21.15.112:0/3991808028 conn(0x7fa0b40fd110 msgr2=0x7fa0b40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 -- 172.21.15.112:0/3991808028 shutdown_connections 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.474+0000 7fa0bae3d640 1 -- 172.21.15.112:0/3991808028 wait complete. 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0bae3d640 1 Processor -- start 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0bae3d640 1 -- start start 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0bae3d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4101980 0x7fa0b41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0bae3d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b4102b80 0x7fa0b4197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0bae3d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b410a840 con 0x7fa0b4101980 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0bae3d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b410a6c0 con 0x7fa0b4102b80 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0b8bd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4101980 0x7fa0b41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0b8bd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4101980 0x7fa0b41974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51642/0 (socket says 172.21.15.112:51642) 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.475+0000 7fa0b8bd9640 1 -- 172.21.15.112:0/1200842163 learned_addr learned my addr 172.21.15.112:0/1200842163 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b3fff640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b4102b80 0x7fa0b4197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b8bd9640 1 -- 172.21.15.112:0/1200842163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b4102b80 msgr2=0x7fa0b4197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b8bd9640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b4102b80 0x7fa0b4197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b8bd9640 1 -- 172.21.15.112:0/1200842163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b41980a0 con 0x7fa0b4101980 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b8bd9640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4101980 0x7fa0b41974e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800b3d0 tx=0x7fa0a800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b1ffb640 1 -- 172.21.15.112:0/1200842163 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0a8015020 con 0x7fa0b4101980 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b1ffb640 1 -- 172.21.15.112:0/1200842163 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0a8011af0 con 0x7fa0b4101980 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b419cae0 con 0x7fa0b4101980 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0b1ffb640 1 -- 172.21.15.112:0/1200842163 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0a8010da0 con 0x7fa0b4101980 2024-09-21T00:59:51.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.476+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b419d070 con 0x7fa0b4101980 2024-09-21T00:59:51.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.477+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b4101d80 con 0x7fa0b4101980 2024-09-21T00:59:51.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.478+0000 7fa0b1ffb640 1 -- 172.21.15.112:0/1200842163 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa0a8018020 con 0x7fa0b4101980 2024-09-21T00:59:51.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.478+0000 7fa0b1ffb640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa0a407af30 0x7fa0a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.478+0000 7fa0b1ffb640 1 -- 172.21.15.112:0/1200842163 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fa0a809dab0 con 0x7fa0b4101980 2024-09-21T00:59:51.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.478+0000 7fa0b3fff640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa0a407af30 0x7fa0a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.479+0000 7fa0b3fff640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa0a407af30 0x7fa0a407d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4198990 tx=0x7fa0a0005a20 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.483+0000 7fa0b1ffb640 1 -- 172.21.15.112:0/1200842163 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa0a801f020 con 0x7fa0b4101980 2024-09-21T00:59:51.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.684+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa0b4062740 con 0x7fa0a407af30 2024-09-21T00:59:51.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.686+0000 7fa0b1ffb640 1 -- 172.21.15.112:0/1200842163 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fa0b4062740 con 0x7fa0a407af30 2024-09-21T00:59:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.688+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa0a407af30 msgr2=0x7fa0a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.688+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa0a407af30 0x7fa0a407d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4198990 tx=0x7fa0a0005a20 comp rx=0 tx=0).stop 2024-09-21T00:59:51.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.688+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4101980 msgr2=0x7fa0b41974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.688+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4101980 0x7fa0b41974e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800b3d0 tx=0x7fa0a800b890 comp rx=0 tx=0).stop 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.689+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 shutdown_connections 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.689+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa0a407af30 0x7fa0a407d3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.689+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b4102b80 0x7fa0b4197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.689+0000 7fa0bae3d640 1 --2- 172.21.15.112:0/1200842163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b4101980 0x7fa0b41974e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.689+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 >> 172.21.15.112:0/1200842163 conn(0x7fa0b40fd110 msgr2=0x7fa0b4105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.689+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 shutdown_connections 2024-09-21T00:59:51.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.689+0000 7fa0bae3d640 1 -- 172.21.15.112:0/1200842163 wait complete. 2024-09-21T00:59:51.698 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T00:59:51.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 -- 172.21.15.112:0/21470224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b101023d0 msgr2=0x7f6b101047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 --2- 172.21.15.112:0/21470224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b101023d0 0x7f6b101047c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6b000098b0 tx=0x7f6b0002a4d0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 -- 172.21.15.112:0/21470224 shutdown_connections 2024-09-21T00:59:51.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 --2- 172.21.15.112:0/21470224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b10104d00 0x7f6b101070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 --2- 172.21.15.112:0/21470224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b101023d0 0x7f6b101047c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 -- 172.21.15.112:0/21470224 >> 172.21.15.112:0/21470224 conn(0x7f6b100fbff0 msgr2=0x7f6b100fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 -- 172.21.15.112:0/21470224 shutdown_connections 2024-09-21T00:59:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 -- 172.21.15.112:0/21470224 wait complete. 2024-09-21T00:59:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 Processor -- start 2024-09-21T00:59:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.773+0000 7f6b16954640 1 -- start start 2024-09-21T00:59:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b16954640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b101023d0 0x7f6b10197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b16954640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b10104d00 0x7f6b10197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b16954640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1010a7a0 con 0x7f6b10104d00 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b16954640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1010a620 con 0x7f6b101023d0 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b10104d00 0x7f6b10197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b10104d00 0x7f6b10197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51666/0 (socket says 172.21.15.112:51666) 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0f7fe640 1 -- 172.21.15.112:0/4176093401 learned_addr learned my addr 172.21.15.112:0/4176093401 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0f7fe640 1 -- 172.21.15.112:0/4176093401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b101023d0 msgr2=0x7f6b10197500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0f7fe640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b101023d0 0x7f6b10197500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0f7fe640 1 -- 172.21.15.112:0/4176093401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b101980c0 con 0x7f6b10104d00 2024-09-21T00:59:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0f7fe640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b10104d00 0x7f6b10197a40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6b04005fd0 tx=0x7f6b0400dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0d7fa640 1 -- 172.21.15.112:0/4176093401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b04017070 con 0x7f6b10104d00 2024-09-21T00:59:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0d7fa640 1 -- 172.21.15.112:0/4176093401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b04004020 con 0x7f6b10104d00 2024-09-21T00:59:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1019cb00 con 0x7f6b10104d00 2024-09-21T00:59:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b0d7fa640 1 -- 172.21.15.112:0/4176093401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b04003b30 con 0x7f6b10104d00 2024-09-21T00:59:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.774+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1019d090 con 0x7f6b10104d00 2024-09-21T00:59:51.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.775+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b101027b0 con 0x7f6b10104d00 2024-09-21T00:59:51.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.776+0000 7f6b0d7fa640 1 -- 172.21.15.112:0/4176093401 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6b040041d0 con 0x7f6b10104d00 2024-09-21T00:59:51.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.777+0000 7f6b0d7fa640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6af807af30 0x7f6af807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.777+0000 7f6b0d7fa640 1 -- 172.21.15.112:0/4176093401 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f6b0409df40 con 0x7f6b10104d00 2024-09-21T00:59:51.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.777+0000 7f6b0ffff640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6af807af30 0x7f6af807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.777+0000 7f6b0ffff640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6af807af30 0x7f6af807d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b0002a9f0 tx=0x7f6b00000bc0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.781+0000 7f6b0d7fa640 1 -- 172.21.15.112:0/4176093401 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6b04020030 con 0x7f6b10104d00 2024-09-21T00:59:51.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.991+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b101056e0 con 0x7f6af807af30 2024-09-21T00:59:51.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.992+0000 7f6b0d7fa640 1 -- 172.21.15.112:0/4176093401 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f6b101056e0 con 0x7f6af807af30 2024-09-21T00:59:51.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6af807af30 msgr2=0x7f6af807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6af807af30 0x7f6af807d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b0002a9f0 tx=0x7f6b00000bc0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b10104d00 msgr2=0x7f6b10197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b10104d00 0x7f6b10197a40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6b04005fd0 tx=0x7f6b0400dd60 comp rx=0 tx=0).stop 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 shutdown_connections 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6af807af30 0x7f6af807d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b10104d00 0x7f6b10197a40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 --2- 172.21.15.112:0/4176093401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b101023d0 0x7f6b10197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 >> 172.21.15.112:0/4176093401 conn(0x7f6b100fbff0 msgr2=0x7f6b100fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 shutdown_connections 2024-09-21T00:59:51.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:51.995+0000 7f6b16954640 1 -- 172.21.15.112:0/4176093401 wait complete. 2024-09-21T00:59:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.081+0000 7f090bc5d640 1 -- 172.21.15.112:0/2961211521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904102b60 msgr2=0x7f0904102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.081+0000 7f090bc5d640 1 --2- 172.21.15.112:0/2961211521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904102b60 0x7f0904102fe0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009880 tx=0x7f08f402a4a0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.081+0000 7f090bc5d640 1 -- 172.21.15.112:0/2961211521 shutdown_connections 2024-09-21T00:59:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.081+0000 7f090bc5d640 1 --2- 172.21.15.112:0/2961211521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904102b60 0x7f0904102fe0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.081+0000 7f090bc5d640 1 --2- 172.21.15.112:0/2961211521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0904101960 0x7f0904101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.081+0000 7f090bc5d640 1 -- 172.21.15.112:0/2961211521 >> 172.21.15.112:0/2961211521 conn(0x7f09040fd0f0 msgr2=0x7f09040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.082+0000 7f090bc5d640 1 -- 172.21.15.112:0/2961211521 shutdown_connections 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.082+0000 7f090bc5d640 1 -- 172.21.15.112:0/2961211521 wait complete. 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.082+0000 7f090bc5d640 1 Processor -- start 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.082+0000 7f090bc5d640 1 -- start start 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f090bc5d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904101960 0x7f0904075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f090bc5d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0904102b60 0x7f09040745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f090bc5d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f090410a7a0 con 0x7f0904101960 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f090bc5d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f090410a620 con 0x7f0904102b60 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09099f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904101960 0x7f0904075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09099f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904101960 0x7f0904075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54690/0 (socket says 172.21.15.112:54690) 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09099f9640 1 -- 172.21.15.112:0/1791806444 learned_addr learned my addr 172.21.15.112:0/1791806444 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09091f8640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0904102b60 0x7f09040745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09099f9640 1 -- 172.21.15.112:0/1791806444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0904102b60 msgr2=0x7f09040745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09099f9640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0904102b60 0x7f09040745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09099f9640 1 -- 172.21.15.112:0/1791806444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0904074b20 con 0x7f0904101960 2024-09-21T00:59:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.083+0000 7f09099f9640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904101960 0x7f0904075f20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f090000d8d0 tx=0x7f090000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.084+0000 7f08faffd640 1 -- 172.21.15.112:0/1791806444 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0900017070 con 0x7f0904101960 2024-09-21T00:59:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.084+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0904074e10 con 0x7f0904101960 2024-09-21T00:59:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.084+0000 7f08faffd640 1 -- 172.21.15.112:0/1791806444 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f090000be10 con 0x7f0904101960 2024-09-21T00:59:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.084+0000 7f08faffd640 1 -- 172.21.15.112:0/1791806444 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f090000f3c0 con 0x7f0904101960 2024-09-21T00:59:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.084+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0904075370 con 0x7f0904101960 2024-09-21T00:59:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.085+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0904101d60 con 0x7f0904101960 2024-09-21T00:59:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.085+0000 7f08faffd640 1 -- 172.21.15.112:0/1791806444 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f090001a070 con 0x7f0904101960 2024-09-21T00:59:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.086+0000 7f08faffd640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08f007af30 0x7f08f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.086+0000 7f08faffd640 1 -- 172.21.15.112:0/1791806444 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f090009dc10 con 0x7f0904101960 2024-09-21T00:59:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.086+0000 7f09091f8640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08f007af30 0x7f08f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.087+0000 7f09091f8640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08f007af30 0x7f08f007d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08f4000c00 tx=0x7f08f40058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.091+0000 7f08faffd640 1 -- 172.21.15.112:0/1791806444 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f09000691b0 con 0x7f0904101960 2024-09-21T00:59:52.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.302+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f09040626f0 con 0x7f08f007af30 2024-09-21T00:59:52.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.314+0000 7f08faffd640 1 -- 172.21.15.112:0/1791806444 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f09040626f0 con 0x7f08f007af30 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (22s) 17s ago 11m 17.5M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (3m) 17s ago 11m 8572k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (2m) 65s ago 10m 8082k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (11m) 17s ago 11m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (10m) 65s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 starting - - - - 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (5m) 17s ago 5m 151M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (5m) 17s ago 5m 15.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (5m) 65s ago 5m 18.7M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (5m) 65s ago 5m 16.6M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (2m) 17s ago 12m 580M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T00:59:52.315 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (89s) 65s ago 10m 519M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (12m) 17s ago 12m 61.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (10m) 65s ago 10m 50.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (75s) 17s ago 11m 9554k - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (69s) 65s ago 10m 3456k - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (9m) 17s ago 9m 205M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (8m) 17s ago 8m 221M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (8m) 17s ago 8m 175M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (7m) 65s ago 7m 251M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (7m) 65s ago 7m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (6m) 65s ago 6m 189M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T00:59:52.316 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (44s) 17s ago 10m 44.0M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T00:59:52.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08f007af30 msgr2=0x7f08f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08f007af30 0x7f08f007d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08f4000c00 tx=0x7f08f40058d0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904101960 msgr2=0x7f0904075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904101960 0x7f0904075f20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f090000d8d0 tx=0x7f090000dd90 comp rx=0 tx=0).stop 2024-09-21T00:59:52.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 shutdown_connections 2024-09-21T00:59:52.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08f007af30 0x7f08f007d3f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0904102b60 0x7f09040745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 --2- 172.21.15.112:0/1791806444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0904101960 0x7f0904075f20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 >> 172.21.15.112:0/1791806444 conn(0x7f09040fd0f0 msgr2=0x7f0904106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 shutdown_connections 2024-09-21T00:59:52.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.317+0000 7f090bc5d640 1 -- 172.21.15.112:0/1791806444 wait complete. 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/2890989808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 msgr2=0x7f3dd8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/2890989808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8101d70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009880 tx=0x7f3dc802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/2890989808 shutdown_connections 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/2890989808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3dd8102b70 0x7f3dd8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/2890989808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8101d70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/2890989808 >> 172.21.15.112:0/2890989808 conn(0x7f3dd80fd100 msgr2=0x7f3dd80ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/2890989808 shutdown_connections 2024-09-21T00:59:52.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.413+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/2890989808 wait complete. 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3ddcbb0640 1 Processor -- start 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3ddcbb0640 1 -- start start 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3ddcbb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3ddcbb0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3dd8102b70 0x7f3dd81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3ddcbb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd810a790 con 0x7f3dd8101970 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3ddcbb0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd810a610 con 0x7f3dd8102b70 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3dd659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3dd659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54696/0 (socket says 172.21.15.112:54696) 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3dd659c640 1 -- 172.21.15.112:0/3919558388 learned_addr learned my addr 172.21.15.112:0/3919558388 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.414+0000 7f3dd5d9b640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3dd8102b70 0x7f3dd81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3dd659c640 1 -- 172.21.15.112:0/3919558388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3dd8102b70 msgr2=0x7f3dd81979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3dd659c640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3dd8102b70 0x7f3dd81979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3dd659c640 1 -- 172.21.15.112:0/3919558388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd8198030 con 0x7f3dd8101970 2024-09-21T00:59:52.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3dd659c640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8197470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009230 tx=0x7f3dc80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3dc77fe640 1 -- 172.21.15.112:0/3919558388 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3dc803f070 con 0x7f3dd8101970 2024-09-21T00:59:52.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd819ca10 con 0x7f3dd8101970 2024-09-21T00:59:52.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3dc77fe640 1 -- 172.21.15.112:0/3919558388 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3dc8004a50 con 0x7f3dd8101970 2024-09-21T00:59:52.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd819cfa0 con 0x7f3dd8101970 2024-09-21T00:59:52.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.415+0000 7f3dc77fe640 1 -- 172.21.15.112:0/3919558388 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3dc8049060 con 0x7f3dd8101970 2024-09-21T00:59:52.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.416+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd8101d70 con 0x7f3dd8101970 2024-09-21T00:59:52.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.418+0000 7f3dc77fe640 1 -- 172.21.15.112:0/3919558388 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3dc8042070 con 0x7f3dd8101970 2024-09-21T00:59:52.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.418+0000 7f3dc77fe640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3dc007af90 0x7f3dc007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.419+0000 7f3dc77fe640 1 -- 172.21.15.112:0/3919558388 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f3dc80bee00 con 0x7f3dd8101970 2024-09-21T00:59:52.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.419+0000 7f3dd5d9b640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3dc007af90 0x7f3dc007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.419+0000 7f3dd5d9b640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3dc007af90 0x7f3dc007d450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8198920 tx=0x7f3dcc00b410 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.423+0000 7f3dc77fe640 1 -- 172.21.15.112:0/3919558388 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3dc808a3e0 con 0x7f3dd8101970 2024-09-21T00:59:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.679+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3dd802d860 con 0x7f3dd8101970 2024-09-21T00:59:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.679+0000 7f3dc77fe640 1 -- 172.21.15.112:0/3919558388 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f3dd802d860 con 0x7f3dd8101970 2024-09-21T00:59:52.680 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:59:52.680 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T00:59:52.681 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T00:59:52.682 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T00:59:52.682 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:59:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.681+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3dc007af90 msgr2=0x7f3dc007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.681+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3dc007af90 0x7f3dc007d450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8198920 tx=0x7f3dcc00b410 comp rx=0 tx=0).stop 2024-09-21T00:59:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.681+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 msgr2=0x7f3dd8197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.681+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8197470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009230 tx=0x7f3dc80045c0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.682+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 shutdown_connections 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.682+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3dc007af90 0x7f3dc007d450 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.682+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3dd8102b70 0x7f3dd81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.682+0000 7f3ddcbb0640 1 --2- 172.21.15.112:0/3919558388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd8101970 0x7f3dd8197470 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.682+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 >> 172.21.15.112:0/3919558388 conn(0x7f3dd80fd100 msgr2=0x7f3dd8106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.682+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 shutdown_connections 2024-09-21T00:59:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.682+0000 7f3ddcbb0640 1 -- 172.21.15.112:0/3919558388 wait complete. 2024-09-21T00:59:52.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 -- 172.21.15.112:0/1260810863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658102430 msgr2=0x7f0658104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 --2- 172.21.15.112:0/1260810863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658102430 0x7f0658104820 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0648009880 tx=0x7f064802a4a0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 -- 172.21.15.112:0/1260810863 shutdown_connections 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 --2- 172.21.15.112:0/1260810863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0658104d60 0x7f0658107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 --2- 172.21.15.112:0/1260810863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658102430 0x7f0658104820 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 -- 172.21.15.112:0/1260810863 >> 172.21.15.112:0/1260810863 conn(0x7f06580fbff0 msgr2=0x7f06580fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 -- 172.21.15.112:0/1260810863 shutdown_connections 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.767+0000 7f065ca76640 1 -- 172.21.15.112:0/1260810863 wait complete. 2024-09-21T00:59:52.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.768+0000 7f065ca76640 1 Processor -- start 2024-09-21T00:59:52.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.768+0000 7f065ca76640 1 -- start start 2024-09-21T00:59:52.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.768+0000 7f065ca76640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0658102430 0x7f0658197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f065ca76640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658104d60 0x7f06581979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f065ca76640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f065810a750 con 0x7f0658104d60 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f065ca76640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f065810a5d0 con 0x7f0658102430 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658104d60 0x7f06581979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658104d60 0x7f06581979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54724/0 (socket says 172.21.15.112:54724) 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064dd9b640 1 -- 172.21.15.112:0/2207089628 learned_addr learned my addr 172.21.15.112:0/2207089628 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f065659c640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0658102430 0x7f0658197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064dd9b640 1 -- 172.21.15.112:0/2207089628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0658102430 msgr2=0x7f0658197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064dd9b640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0658102430 0x7f0658197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064dd9b640 1 -- 172.21.15.112:0/2207089628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0658198030 con 0x7f0658104d60 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064dd9b640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658104d60 0x7f06581979b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f064000e970 tx=0x7f064000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064ffff640 1 -- 172.21.15.112:0/2207089628 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f064000cac0 con 0x7f0658104d60 2024-09-21T00:59:52.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064ffff640 1 -- 172.21.15.112:0/2207089628 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06400054e0 con 0x7f0658104d60 2024-09-21T00:59:52.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065819ca70 con 0x7f0658104d60 2024-09-21T00:59:52.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f064ffff640 1 -- 172.21.15.112:0/2207089628 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0640010430 con 0x7f0658104d60 2024-09-21T00:59:52.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.769+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065819d000 con 0x7f0658104d60 2024-09-21T00:59:52.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.770+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0658102810 con 0x7f0658104d60 2024-09-21T00:59:52.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.771+0000 7f064ffff640 1 -- 172.21.15.112:0/2207089628 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0640004ec0 con 0x7f0658104d60 2024-09-21T00:59:52.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.772+0000 7f064ffff640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f064407af30 0x7f064407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:52.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.772+0000 7f065659c640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f064407af30 0x7f064407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:52.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.772+0000 7f064ffff640 1 -- 172.21.15.112:0/2207089628 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f064009e6e0 con 0x7f0658104d60 2024-09-21T00:59:52.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.772+0000 7f065659c640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f064407af30 0x7f064407d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0648000c00 tx=0x7f06480058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:52.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.776+0000 7f064ffff640 1 -- 172.21.15.112:0/2207089628 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0640069ce0 con 0x7f0658104d60 2024-09-21T00:59:52.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.972+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0658105700 con 0x7f064407af30 2024-09-21T00:59:52.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.974+0000 7f064ffff640 1 -- 172.21.15.112:0/2207089628 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f0658105700 con 0x7f064407af30 2024-09-21T00:59:52.974 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading grafana daemons", 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T00:59:52.975 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T00:59:52.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f064407af30 msgr2=0x7f064407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f064407af30 0x7f064407d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0648000c00 tx=0x7f06480058d0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658104d60 msgr2=0x7f06581979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658104d60 0x7f06581979b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f064000e970 tx=0x7f064000ee30 comp rx=0 tx=0).stop 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 shutdown_connections 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f064407af30 0x7f064407d3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0658104d60 0x7f06581979b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 --2- 172.21.15.112:0/2207089628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0658102430 0x7f0658197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 >> 172.21.15.112:0/2207089628 conn(0x7f06580fbff0 msgr2=0x7f06580fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 shutdown_connections 2024-09-21T00:59:52.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T00:59:52.976+0000 7f065ca76640 1 -- 172.21.15.112:0/2207089628 wait complete. 2024-09-21T00:59:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:52 smithi112 ceph-mon[28078]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:52 smithi112 ceph-mon[28078]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:52 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:52 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:52 smithi112 ceph-mon[28078]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:52 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:53.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:52 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3919558388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:52 smithi187 ceph-mon[34997]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:52 smithi187 ceph-mon[34997]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:52 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:52 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:52 smithi187 ceph-mon[34997]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:52 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T00:59:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:52 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3919558388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T00:59:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:53 smithi112 ceph-mon[28078]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:53 smithi112 ceph-mon[28078]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:53 smithi187 ceph-mon[34997]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:53 smithi187 ceph-mon[34997]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:59:55.251 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:54 smithi112 ceph-mon[28078]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:54 smithi187 ceph-mon[34997]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:57.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:56 smithi112 ceph-mon[28078]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:57.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:56 smithi187 ceph-mon[34997]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:59.237 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:58 smithi112 ceph-mon[28078]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:59.237 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:59.237 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:59.237 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:58 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:59.237 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:59.237 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 00:59:58 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:59.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:58 smithi187 ceph-mon[34997]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T00:59:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:58 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T00:59:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T00:59:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 00:59:58 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:01.257 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:00 smithi112 ceph-mon[28078]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:01.257 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:00 smithi112 ceph-mon[28078]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:01.258 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:00 smithi112 ceph-mon[28078]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:01.258 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:00 smithi112 ceph-mon[28078]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:00:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:00 smithi187 ceph-mon[34997]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:00 smithi187 ceph-mon[34997]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:00 smithi187 ceph-mon[34997]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:00 smithi187 ceph-mon[34997]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T01:00:03.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: Upgrade: Finalizing container_image settings 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T01:00:03.013 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T01:00:03.014 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: Upgrade: Complete! 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:03.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:02 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:03.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:03.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:03.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T01:00:03.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T01:00:03.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:03.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.162 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.163 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.163 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:03.163 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: Upgrade: Finalizing container_image settings 2024-09-21T01:00:03.163 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.163 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T01:00:03.163 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T01:00:03.163 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T01:00:03.165 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.165 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.165 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T01:00:03.165 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T01:00:03.165 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T01:00:03.165 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T01:00:03.166 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T01:00:03.166 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T01:00:03.166 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T01:00:03.166 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T01:00:03.166 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T01:00:03.166 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T01:00:03.167 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T01:00:03.167 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T01:00:03.167 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T01:00:03.167 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.167 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.167 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T01:00:03.168 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T01:00:03.168 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T01:00:03.168 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T01:00:03.168 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T01:00:03.168 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T01:00:03.168 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T01:00:03.168 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T01:00:03.169 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T01:00:03.169 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T01:00:03.169 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T01:00:03.169 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.169 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.169 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.171 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.171 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.171 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T01:00:03.171 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: Upgrade: Complete! 2024-09-21T01:00:03.171 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T01:00:03.171 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T01:00:03.171 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T01:00:03.172 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:03.172 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:03.172 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:03.172 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:03.172 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:03.172 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:03.173 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:03.173 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:02 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:04 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:04 smithi187 ceph-mon[34997]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:04.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:04 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:04.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:04 smithi112 ceph-mon[28078]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:06.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:06 smithi112 ceph-mon[28078]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:06.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:06 smithi187 ceph-mon[34997]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:08.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:08 smithi187 ceph-mon[34997]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:09.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:08 smithi112 ceph-mon[28078]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:10.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:10 smithi187 ceph-mon[34997]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:10 smithi112 ceph-mon[28078]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:12.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:12 smithi187 ceph-mon[34997]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:12 smithi112 ceph-mon[28078]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:13.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:13 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:00:14.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:13 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:00:14.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:14 smithi187 ceph-mon[34997]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:15.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:14 smithi112 ceph-mon[28078]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:16.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:16 smithi187 ceph-mon[34997]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:17.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:16 smithi112 ceph-mon[28078]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:18.977 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:18 smithi187 ceph-mon[34997]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:18 smithi112 ceph-mon[28078]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:20.928 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:20 smithi187 ceph-mon[34997]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:20 smithi112 ceph-mon[28078]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:22 smithi112 ceph-mon[28078]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/129581610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 msgr2=0x7f2bb4104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/129581610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4104800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00098b0 tx=0x7f2bb002a4d0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/129581610 shutdown_connections 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/129581610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bb4104d40 0x7f2bb4107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/129581610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4104800 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/129581610 >> 172.21.15.112:0/129581610 conn(0x7f2bb40fc010 msgr2=0x7f2bb40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/129581610 shutdown_connections 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/129581610 wait complete. 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 Processor -- start 2024-09-21T01:00:23.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.072+0000 7f2bbb8ea640 1 -- start start 2024-09-21T01:00:23.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bbb8ea640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:23.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bbb8ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bb4104d40 0x7f2bb4197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:23.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bbb8ea640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb410a800 con 0x7f2bb4102410 2024-09-21T01:00:23.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bbb8ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb410a680 con 0x7f2bb4104d40 2024-09-21T01:00:23.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb9686640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:23.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb9686640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51914/0 (socket says 172.21.15.112:51914) 2024-09-21T01:00:23.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb9686640 1 -- 172.21.15.112:0/3475805192 learned_addr learned my addr 172.21.15.112:0/3475805192 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb8e85640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bb4104d40 0x7f2bb4197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb9686640 1 -- 172.21.15.112:0/3475805192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bb4104d40 msgr2=0x7f2bb4197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb9686640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bb4104d40 0x7f2bb4197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb9686640 1 -- 172.21.15.112:0/3475805192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb41980c0 con 0x7f2bb4102410 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bb9686640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4197500 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00099d0 tx=0x7f2bb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2baa7fc640 1 -- 172.21.15.112:0/3475805192 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bb003f070 con 0x7f2bb4102410 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2baa7fc640 1 -- 172.21.15.112:0/3475805192 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bb0004a40 con 0x7f2bb4102410 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2baa7fc640 1 -- 172.21.15.112:0/3475805192 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bb0035030 con 0x7f2bb4102410 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.073+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb419caa0 con 0x7f2bb4102410 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.074+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb419d030 con 0x7f2bb4102410 2024-09-21T01:00:23.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.074+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb41027f0 con 0x7f2bb4102410 2024-09-21T01:00:23.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.075+0000 7f2baa7fc640 1 -- 172.21.15.112:0/3475805192 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2bb0042070 con 0x7f2bb4102410 2024-09-21T01:00:23.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.076+0000 7f2baa7fc640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2ba007af80 0x7f2ba007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:23.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.076+0000 7f2baa7fc640 1 -- 172.21.15.112:0/3475805192 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f2bb00beaa0 con 0x7f2bb4102410 2024-09-21T01:00:23.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.076+0000 7f2bb8e85640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2ba007af80 0x7f2ba007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:23.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.077+0000 7f2bb8e85640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2ba007af80 0x7f2ba007d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bb41989b0 tx=0x7f2ba400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:23.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.081+0000 7f2baa7fc640 1 -- 172.21.15.112:0/3475805192 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2bb008a120 con 0x7f2bb4102410 2024-09-21T01:00:23.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:22 smithi187 ceph-mon[34997]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:23.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.272+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2bb41057a0 con 0x7f2ba007af80 2024-09-21T01:00:23.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.274+0000 7f2baa7fc640 1 -- 172.21.15.112:0/3475805192 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f2bb41057a0 con 0x7f2ba007af80 2024-09-21T01:00:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2ba007af80 msgr2=0x7f2ba007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2ba007af80 0x7f2ba007d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bb41989b0 tx=0x7f2ba400b390 comp rx=0 tx=0).stop 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 msgr2=0x7f2bb4197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4197500 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00099d0 tx=0x7f2bb00046c0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 shutdown_connections 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2ba007af80 0x7f2ba007d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bb4104d40 0x7f2bb4197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 --2- 172.21.15.112:0/3475805192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bb4102410 0x7f2bb4197500 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 >> 172.21.15.112:0/3475805192 conn(0x7f2bb40fc010 msgr2=0x7f2bb40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 shutdown_connections 2024-09-21T01:00:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:23.276+0000 7f2bbb8ea640 1 -- 172.21.15.112:0/3475805192 wait complete. 2024-09-21T01:00:24.083 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-21T01:00:24.378 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:24.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:24 smithi112 ceph-mon[28078]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:24.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:24 smithi112 ceph-mon[28078]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:24.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 -- 172.21.15.112:0/2167991094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 msgr2=0x7f85ec100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:24.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/2167991094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec100c80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009880 tx=0x7f85e802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:24.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 -- 172.21.15.112:0/2167991094 shutdown_connections 2024-09-21T01:00:24.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/2167991094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec100c80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:24.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/2167991094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec106820 0x7f85ec106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 -- 172.21.15.112:0/2167991094 >> 172.21.15.112:0/2167991094 conn(0x7f85ec0fc520 msgr2=0x7f85ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 -- 172.21.15.112:0/2167991094 shutdown_connections 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.860+0000 7f85f3c3b640 1 -- 172.21.15.112:0/2167991094 wait complete. 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f3c3b640 1 Processor -- start 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f3c3b640 1 -- start start 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f3c3b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f3c3b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec106820 0x7f85ec19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f3c3b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10dcd0 con 0x7f85ec100820 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f3c3b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec10db50 con 0x7f85ec106820 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f19d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f19d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec19c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51932/0 (socket says 172.21.15.112:51932) 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f19d7640 1 -- 172.21.15.112:0/3624873061 learned_addr learned my addr 172.21.15.112:0/3624873061 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:24.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f11d6640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec106820 0x7f85ec19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f19d7640 1 -- 172.21.15.112:0/3624873061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec106820 msgr2=0x7f85ec19cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f19d7640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec106820 0x7f85ec19cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f19d7640 1 -- 172.21.15.112:0/3624873061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec1966b0 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.861+0000 7f85f11d6640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec106820 0x7f85ec19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.862+0000 7f85f19d7640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec19c5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f85e000d8d0 tx=0x7f85e000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.862+0000 7f85deffd640 1 -- 172.21.15.112:0/3624873061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e0017070 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.862+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec1969a0 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.862+0000 7f85deffd640 1 -- 172.21.15.112:0/3624873061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85e0010460 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.862+0000 7f85deffd640 1 -- 172.21.15.112:0/3624873061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e000f5f0 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.862+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec196f00 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.863+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ec101f60 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.863+0000 7f85deffd640 1 -- 172.21.15.112:0/3624873061 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f85e0009a30 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.864+0000 7f85deffd640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.864+0000 7f85deffd640 1 -- 172.21.15.112:0/3624873061 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f85e009df40 con 0x7f85ec100820 2024-09-21T01:00:24.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.864+0000 7f85f11d6640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:24.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.865+0000 7f85f11d6640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85d807af30 0x7f85d807d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006010 tx=0x7f85e80095f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:24.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:24.869+0000 7f85deffd640 1 -- 172.21.15.112:0/3624873061 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f85e00694e0 con 0x7f85ec100820 2024-09-21T01:00:25.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.112+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f85ec108db0 con 0x7f85ec100820 2024-09-21T01:00:25.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.112+0000 7f85deffd640 1 -- 172.21.15.112:0/3624873061 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f85e006e390 con 0x7f85ec100820 2024-09-21T01:00:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85d807af30 msgr2=0x7f85d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85d807af30 0x7f85d807d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006010 tx=0x7f85e80095f0 comp rx=0 tx=0).stop 2024-09-21T01:00:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 msgr2=0x7f85ec19c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec19c5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f85e000d8d0 tx=0x7f85e000dd90 comp rx=0 tx=0).stop 2024-09-21T01:00:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 shutdown_connections 2024-09-21T01:00:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:25.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec106820 0x7f85ec19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:25.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 --2- 172.21.15.112:0/3624873061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85ec100820 0x7f85ec19c5e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:25.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.114+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 >> 172.21.15.112:0/3624873061 conn(0x7f85ec0fc520 msgr2=0x7f85ec0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:25.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.115+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 shutdown_connections 2024-09-21T01:00:25.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:25.115+0000 7f85f3c3b640 1 -- 172.21.15.112:0/3624873061 wait complete. 2024-09-21T01:00:25.124 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:00:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:24 smithi187 ceph-mon[34997]: from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:24 smithi187 ceph-mon[34997]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:25.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-21T01:00:26.005 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:25 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/3624873061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:26.009 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:26.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:25 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/3624873061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:26.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 -- 172.21.15.112:0/3515638407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 msgr2=0x7f55d8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 --2- 172.21.15.112:0/3515638407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d8101d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009880 tx=0x7f55c002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 -- 172.21.15.112:0/3515638407 shutdown_connections 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 --2- 172.21.15.112:0/3515638407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d8101d90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 --2- 172.21.15.112:0/3515638407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55d8107930 0x7f55d8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 -- 172.21.15.112:0/3515638407 >> 172.21.15.112:0/3515638407 conn(0x7f55d80fd630 msgr2=0x7f55d80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 -- 172.21.15.112:0/3515638407 shutdown_connections 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 -- 172.21.15.112:0/3515638407 wait complete. 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 Processor -- start 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.477+0000 7f55de51a640 1 -- start start 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55de51a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55de51a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55d8107930 0x7f55d819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55de51a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f55d810ee60 con 0x7f55d8101930 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55de51a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f55d810ece0 con 0x7f55d8107930 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51958/0 (socket says 172.21.15.112:51958) 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d7fff640 1 -- 172.21.15.112:0/2661178259 learned_addr learned my addr 172.21.15.112:0/2661178259 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d77fe640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55d8107930 0x7f55d819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d7fff640 1 -- 172.21.15.112:0/2661178259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55d8107930 msgr2=0x7f55d819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d7fff640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55d8107930 0x7f55d819dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d7fff640 1 -- 172.21.15.112:0/2661178259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d8197870 con 0x7f55d8101930 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d77fe640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55d8107930 0x7f55d819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d7fff640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d819d6b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b420 tx=0x7f55c800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d57fa640 1 -- 172.21.15.112:0/2661178259 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55c8011630 con 0x7f55d8101930 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55d57fa640 1 -- 172.21.15.112:0/2661178259 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55c8016070 con 0x7f55d8101930 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.478+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d8197b60 con 0x7f55d8101930 2024-09-21T01:00:26.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.479+0000 7f55d57fa640 1 -- 172.21.15.112:0/2661178259 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55c8010d40 con 0x7f55d8101930 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.479+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d81980c0 con 0x7f55d8101930 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.479+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d8103070 con 0x7f55d8101930 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.480+0000 7f55d57fa640 1 -- 172.21.15.112:0/2661178259 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f55c801b460 con 0x7f55d8101930 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.481+0000 7f55d57fa640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f55c407af30 0x7f55c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.481+0000 7f55d57fa640 1 -- 172.21.15.112:0/2661178259 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f55c809d740 con 0x7f55d8101930 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.481+0000 7f55d77fe640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f55c407af30 0x7f55c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.481+0000 7f55d77fe640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f55c407af30 0x7f55c407d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55d8199060 tx=0x7f55c0031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:26.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.485+0000 7f55d57fa640 1 -- 172.21.15.112:0/2661178259 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f55c8021250 con 0x7f55d8101930 2024-09-21T01:00:26.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.734+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f55d8198da0 con 0x7f55d8101930 2024-09-21T01:00:26.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.735+0000 7f55d57fa640 1 -- 172.21.15.112:0/2661178259 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f55c8068d40 con 0x7f55d8101930 2024-09-21T01:00:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f55c407af30 msgr2=0x7f55c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:26.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f55c407af30 0x7f55c407d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55d8199060 tx=0x7f55c0031400 comp rx=0 tx=0).stop 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 msgr2=0x7f55d819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d819d6b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b420 tx=0x7f55c800b8e0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 shutdown_connections 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f55c407af30 0x7f55c407d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55d8107930 0x7f55d819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 --2- 172.21.15.112:0/2661178259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55d8101930 0x7f55d819d6b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 >> 172.21.15.112:0/2661178259 conn(0x7f55d80fd630 msgr2=0x7f55d80fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 shutdown_connections 2024-09-21T01:00:26.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:26.737+0000 7f55de51a640 1 -- 172.21.15.112:0/2661178259 wait complete. 2024-09-21T01:00:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)" 2024-09-21T01:00:27.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:26 smithi112 ceph-mon[28078]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:27.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:26 smithi187 ceph-mon[34997]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:27.413 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-21T01:00:27.663 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:27.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:27 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2661178259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:28.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 -- 172.21.15.112:0/2129715433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c106820 msgr2=0x7f6a2c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:28.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 --2- 172.21.15.112:0/2129715433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c106820 0x7f6a2c106c00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009880 tx=0x7f6a2802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:28.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 -- 172.21.15.112:0/2129715433 shutdown_connections 2024-09-21T01:00:28.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 --2- 172.21.15.112:0/2129715433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a2c100820 0x7f6a2c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:28.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 --2- 172.21.15.112:0/2129715433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c106820 0x7f6a2c106c00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:28.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 -- 172.21.15.112:0/2129715433 >> 172.21.15.112:0/2129715433 conn(0x7f6a2c0fc520 msgr2=0x7f6a2c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:28.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 -- 172.21.15.112:0/2129715433 shutdown_connections 2024-09-21T01:00:28.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.151+0000 7f6a34295640 1 -- 172.21.15.112:0/2129715433 wait complete. 2024-09-21T01:00:28.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a34295640 1 Processor -- start 2024-09-21T01:00:28.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a34295640 1 -- start start 2024-09-21T01:00:28.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a34295640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c100820 0x7f6a2c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:28.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a34295640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a2c106820 0x7f6a2c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a34295640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c10dcf0 con 0x7f6a2c100820 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a34295640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c10db70 con 0x7f6a2c106820 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a32031640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c100820 0x7f6a2c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a32031640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c100820 0x7f6a2c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51970/0 (socket says 172.21.15.112:51970) 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a32031640 1 -- 172.21.15.112:0/1388267543 learned_addr learned my addr 172.21.15.112:0/1388267543 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.152+0000 7f6a31830640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a2c106820 0x7f6a2c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a32031640 1 -- 172.21.15.112:0/1388267543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a2c106820 msgr2=0x7f6a2c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a32031640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a2c106820 0x7f6a2c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a32031640 1 -- 172.21.15.112:0/1388267543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c199380 con 0x7f6a2c100820 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a32031640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c100820 0x7f6a2c198840 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6a28031460 tx=0x7f6a28004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a237fe640 1 -- 172.21.15.112:0/1388267543 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a2803f070 con 0x7f6a2c100820 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c199610 con 0x7f6a2c100820 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a237fe640 1 -- 172.21.15.112:0/1388267543 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a280035f0 con 0x7f6a2c100820 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a237fe640 1 -- 172.21.15.112:0/1388267543 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a28035030 con 0x7f6a2c100820 2024-09-21T01:00:28.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.153+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c1a1bc0 con 0x7f6a2c100820 2024-09-21T01:00:28.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.154+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c101f60 con 0x7f6a2c100820 2024-09-21T01:00:28.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.155+0000 7f6a237fe640 1 -- 172.21.15.112:0/1388267543 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6a28042070 con 0x7f6a2c100820 2024-09-21T01:00:28.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.155+0000 7f6a237fe640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6a1807af30 0x7f6a1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:28.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.155+0000 7f6a237fe640 1 -- 172.21.15.112:0/1388267543 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f6a280be900 con 0x7f6a2c100820 2024-09-21T01:00:28.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.156+0000 7f6a31830640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6a1807af30 0x7f6a1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:28.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.156+0000 7f6a31830640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6a1807af30 0x7f6a1807d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c06ae50 tx=0x7f6a1c005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:28.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:27 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2661178259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:28.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.160+0000 7f6a237fe640 1 -- 172.21.15.112:0/1388267543 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6a28089f00 con 0x7f6a2c100820 2024-09-21T01:00:28.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.411+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6a2c108d90 con 0x7f6a2c100820 2024-09-21T01:00:28.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.411+0000 7f6a237fe640 1 -- 172.21.15.112:0/1388267543 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f6a2808edb0 con 0x7f6a2c100820 2024-09-21T01:00:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6a1807af30 msgr2=0x7f6a1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6a1807af30 0x7f6a1807d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c06ae50 tx=0x7f6a1c005f90 comp rx=0 tx=0).stop 2024-09-21T01:00:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c100820 msgr2=0x7f6a2c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c100820 0x7f6a2c198840 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6a28031460 tx=0x7f6a28004530 comp rx=0 tx=0).stop 2024-09-21T01:00:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 shutdown_connections 2024-09-21T01:00:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6a1807af30 0x7f6a1807d3f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a2c106820 0x7f6a2c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:28.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 --2- 172.21.15.112:0/1388267543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a2c100820 0x7f6a2c198840 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:28.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 >> 172.21.15.112:0/1388267543 conn(0x7f6a2c0fc520 msgr2=0x7f6a2c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:28.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 shutdown_connections 2024-09-21T01:00:28.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:28.413+0000 7f6a34295640 1 -- 172.21.15.112:0/1388267543 wait complete. 2024-09-21T01:00:28.422 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:00:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:28 smithi112 ceph-mon[28078]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:28 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:00:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:28 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/1388267543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:29.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-21T01:00:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:28 smithi187 ceph-mon[34997]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:28 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:00:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:28 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/1388267543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:29.332 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:29.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 -- 172.21.15.112:0/1210512168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798101930 msgr2=0x7f0798101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 --2- 172.21.15.112:0/1210512168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798101930 0x7f0798101d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0780009880 tx=0x7f078002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 -- 172.21.15.112:0/1210512168 shutdown_connections 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 --2- 172.21.15.112:0/1210512168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798101930 0x7f0798101d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 --2- 172.21.15.112:0/1210512168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0798107930 0x7f0798107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 -- 172.21.15.112:0/1210512168 >> 172.21.15.112:0/1210512168 conn(0x7f07980fd630 msgr2=0x7f07980ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 -- 172.21.15.112:0/1210512168 shutdown_connections 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 -- 172.21.15.112:0/1210512168 wait complete. 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 Processor -- start 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.812+0000 7f079cbb5640 1 -- start start 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f079cbb5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0798101930 0x7f07980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f079cbb5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798107930 0x7f0798074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f079cbb5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f079810ede0 con 0x7f0798107930 2024-09-21T01:00:29.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f079cbb5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f079810ec60 con 0x7f0798101930 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f0795d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798107930 0x7f0798074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f0795d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798107930 0x7f0798074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51980/0 (socket says 172.21.15.112:51980) 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f0795d9b640 1 -- 172.21.15.112:0/3452438836 learned_addr learned my addr 172.21.15.112:0/3452438836 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f079659c640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0798101930 0x7f07980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f0795d9b640 1 -- 172.21.15.112:0/3452438836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0798101930 msgr2=0x7f07980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f0795d9b640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0798101930 0x7f07980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f0795d9b640 1 -- 172.21.15.112:0/3452438836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0798074f70 con 0x7f0798107930 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f0795d9b640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798107930 0x7f0798074a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0780031460 tx=0x7f07800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f078f7fe640 1 -- 172.21.15.112:0/3452438836 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f078003f070 con 0x7f0798107930 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0798075200 con 0x7f0798107930 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f078f7fe640 1 -- 172.21.15.112:0/3452438836 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0780004cf0 con 0x7f0798107930 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f078f7fe640 1 -- 172.21.15.112:0/3452438836 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0780035030 con 0x7f0798107930 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.813+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07981a3e10 con 0x7f0798107930 2024-09-21T01:00:29.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.814+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0798103070 con 0x7f0798107930 2024-09-21T01:00:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.815+0000 7f078f7fe640 1 -- 172.21.15.112:0/3452438836 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0780042070 con 0x7f0798107930 2024-09-21T01:00:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.816+0000 7f078f7fe640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f078407af30 0x7f078407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.816+0000 7f078f7fe640 1 -- 172.21.15.112:0/3452438836 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f07800bea10 con 0x7f0798107930 2024-09-21T01:00:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.816+0000 7f079659c640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f078407af30 0x7f078407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.816+0000 7f079659c640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f078407af30 0x7f078407d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07880058c0 tx=0x7f078800a2d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:29.820+0000 7f078f7fe640 1 -- 172.21.15.112:0/3452438836 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f078008a010 con 0x7f0798107930 2024-09-21T01:00:30.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:30.011+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "target": ["mon-mgr", ""]}) -- 0x7f0798062630 con 0x7f078407af30 2024-09-21T01:00:30.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:30 smithi112 ceph-mon[28078]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:30.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:30 smithi112 ceph-mon[28078]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:31.082 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:30 smithi187 ceph-mon[34997]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:31.083 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:30 smithi187 ceph-mon[34997]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:31.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.737+0000 7f078f7fe640 1 -- 172.21.15.112:0/3452438836 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f0798062630 con 0x7f078407af30 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f078407af30 msgr2=0x7f078407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f078407af30 0x7f078407d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07880058c0 tx=0x7f078800a2d0 comp rx=0 tx=0).stop 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798107930 msgr2=0x7f0798074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798107930 0x7f0798074a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0780031460 tx=0x7f07800048f0 comp rx=0 tx=0).stop 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 shutdown_connections 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f078407af30 0x7f078407d3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0798107930 0x7f0798074a30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 --2- 172.21.15.112:0/3452438836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0798101930 0x7f07980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:31.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 >> 172.21.15.112:0/3452438836 conn(0x7f07980fd630 msgr2=0x7f07980fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:31.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 shutdown_connections 2024-09-21T01:00:31.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:31.740+0000 7f079cbb5640 1 -- 172.21.15.112:0/3452438836 wait complete. 2024-09-21T01:00:31.750 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:00:32.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph orch ps' 2024-09-21T01:00:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:32 smithi112 ceph-mon[28078]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 -- 172.21.15.112:0/219100510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 msgr2=0x7f4a5010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 --2- 172.21.15.112:0/219100510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5010b950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4a440098b0 tx=0x7f4a4402a560 comp rx=0 tx=0).stop 2024-09-21T01:00:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 -- 172.21.15.112:0/219100510 shutdown_connections 2024-09-21T01:00:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 --2- 172.21.15.112:0/219100510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5010b950 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 --2- 172.21.15.112:0/219100510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50102b40 0x7f4a50102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 -- 172.21.15.112:0/219100510 >> 172.21.15.112:0/219100510 conn(0x7f4a500fc520 msgr2=0x7f4a500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 -- 172.21.15.112:0/219100510 shutdown_connections 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.115+0000 7f4a54d45640 1 -- 172.21.15.112:0/219100510 wait complete. 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a54d45640 1 Processor -- start 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a54d45640 1 -- start start 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a54d45640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50102b40 0x7f4a5019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a54d45640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a54d45640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5010edf0 con 0x7f4a50103460 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a54d45640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5010ec70 con 0x7f4a50102b40 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41376/0 (socket says 172.21.15.112:41376) 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4dd9b640 1 -- 172.21.15.112:0/4070754716 learned_addr learned my addr 172.21.15.112:0/4070754716 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4e59c640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50102b40 0x7f4a5019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4dd9b640 1 -- 172.21.15.112:0/4070754716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50102b40 msgr2=0x7f4a5019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4dd9b640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50102b40 0x7f4a5019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4dd9b640 1 -- 172.21.15.112:0/4070754716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a50197820 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.116+0000 7f4a4dd9b640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5019dbe0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4a44031460 tx=0x7f4a440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.117+0000 7f4a3f7fe640 1 -- 172.21.15.112:0/4070754716 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a4403f070 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.117+0000 7f4a3f7fe640 1 -- 172.21.15.112:0/4070754716 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a440044d0 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.117+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a50197ab0 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.117+0000 7f4a3f7fe640 1 -- 172.21.15.112:0/4070754716 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a44035030 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.117+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a50197fe0 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.118+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5006ab80 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.118+0000 7f4a3f7fe640 1 -- 172.21.15.112:0/4070754716 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4a44042070 con 0x7f4a50103460 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.119+0000 7f4a3f7fe640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4a3807af30 0x7f4a3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.119+0000 7f4a3f7fe640 1 -- 172.21.15.112:0/4070754716 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f4a440be980 con 0x7f4a50103460 2024-09-21T01:00:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.119+0000 7f4a4e59c640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4a3807af30 0x7f4a3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.119+0000 7f4a4e59c640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4a3807af30 0x7f4a3807d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a400058c0 tx=0x7f4a4000a2d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.123+0000 7f4a3f7fe640 1 -- 172.21.15.112:0/4070754716 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4a44004cf0 con 0x7f4a50103460 2024-09-21T01:00:33.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:32 smithi187 ceph-mon[34997]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:33.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.309+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4a50198290 con 0x7f4a3807af30 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.319+0000 7f4a3f7fe640 1 -- 172.21.15.112:0/4070754716 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4a50198290 con 0x7f4a3807af30 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (63s) 35s ago 11m 19.7M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (4m) 35s ago 12m 8606k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (3m) 106s ago 11m 8082k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (12m) 35s ago 12m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (11m) 106s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T01:00:33.320 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (41s) 35s ago 11m 48.1M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (6m) 35s ago 6m 151M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (6m) 35s ago 6m 15.4M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (6m) 106s ago 6m 18.7M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (6m) 106s ago 6m 16.6M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (3m) 35s ago 13m 588M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (2m) 106s ago 11m 519M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (13m) 35s ago 13m 62.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (11m) 106s ago 11m 50.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (116s) 35s ago 12m 9210k - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (110s) 106s ago 11m 3456k - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (9m) 35s ago 9m 204M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (9m) 35s ago 9m 222M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (8m) 35s ago 8m 176M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (8m) 106s ago 8m 251M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T01:00:33.321 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (8m) 106s ago 8m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:00:33.322 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (7m) 106s ago 7m 189M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:00:33.322 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (85s) 35s ago 11m 45.0M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:00:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4a3807af30 msgr2=0x7f4a3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4a3807af30 0x7f4a3807d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a400058c0 tx=0x7f4a4000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 msgr2=0x7f4a5019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5019dbe0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4a44031460 tx=0x7f4a440048f0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 shutdown_connections 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4a3807af30 0x7f4a3807d3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a50103460 0x7f4a5019dbe0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 --2- 172.21.15.112:0/4070754716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50102b40 0x7f4a5019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 >> 172.21.15.112:0/4070754716 conn(0x7f4a500fc520 msgr2=0x7f4a50103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 shutdown_connections 2024-09-21T01:00:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:33.322+0000 7f4a54d45640 1 -- 172.21.15.112:0/4070754716 wait complete. 2024-09-21T01:00:33.997 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T01:00:33.998 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T01:00:33.998 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-21T01:00:34.243 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- 172.21.15.112:0/2974027012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc107930 msgr2=0x7fabbc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 --2- 172.21.15.112:0/2974027012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc107930 0x7fabbc107d10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fabac009c20 tx=0x7fabac02a970 comp rx=0 tx=0).stop 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- 172.21.15.112:0/2974027012 shutdown_connections 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 --2- 172.21.15.112:0/2974027012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc101930 0x7fabbc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 --2- 172.21.15.112:0/2974027012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc107930 0x7fabbc107d10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- 172.21.15.112:0/2974027012 >> 172.21.15.112:0/2974027012 conn(0x7fabbc0fd630 msgr2=0x7fabbc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- 172.21.15.112:0/2974027012 shutdown_connections 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- 172.21.15.112:0/2974027012 wait complete. 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 Processor -- start 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- start start 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc101930 0x7fabbc19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc107930 0x7fabbc19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc10ee60 con 0x7fabbc101930 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.740+0000 7fabc37ee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc10ece0 con 0x7fabbc107930 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc158a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc101930 0x7fabbc19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc158a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc101930 0x7fabbc19d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41400/0 (socket says 172.21.15.112:41400) 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc158a640 1 -- 172.21.15.112:0/756292178 learned_addr learned my addr 172.21.15.112:0/756292178 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc158a640 1 -- 172.21.15.112:0/756292178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc107930 msgr2=0x7fabbc19dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc158a640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc107930 0x7fabbc19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc158a640 1 -- 172.21.15.112:0/756292178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc1978d0 con 0x7fabbc101930 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc158a640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc101930 0x7fabbc19d710 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fabac005cc0 tx=0x7fabac02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabba7fc640 1 -- 172.21.15.112:0/756292178 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabac047070 con 0x7fabbc101930 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabba7fc640 1 -- 172.21.15.112:0/756292178 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fabac02f7e0 con 0x7fabbc101930 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabba7fc640 1 -- 172.21.15.112:0/756292178 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabac034070 con 0x7fabbc101930 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabbc197b60 con 0x7fabbc101930 2024-09-21T01:00:34.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.741+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabbc198090 con 0x7fabbc101930 2024-09-21T01:00:34.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.742+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabbc103070 con 0x7fabbc101930 2024-09-21T01:00:34.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.743+0000 7fabba7fc640 1 -- 172.21.15.112:0/756292178 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fabac04a070 con 0x7fabbc101930 2024-09-21T01:00:34.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.743+0000 7fabba7fc640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faba407af30 0x7faba407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:34.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.743+0000 7fabba7fc640 1 -- 172.21.15.112:0/756292178 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fabac0beee0 con 0x7fabbc101930 2024-09-21T01:00:34.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.743+0000 7fabc0d89640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faba407af30 0x7faba407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:34.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.744+0000 7fabc0d89640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faba407af30 0x7faba407d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0ffcf0 tx=0x7fabb0006c90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:34.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.748+0000 7fabba7fc640 1 -- 172.21.15.112:0/756292178 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fabac03f070 con 0x7fabbc101930 2024-09-21T01:00:34.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.925+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7fabbc198e00 con 0x7fabbc101930 2024-09-21T01:00:34.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:34 smithi112 ceph-mon[28078]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:34.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:34 smithi112 ceph-mon[28078]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:34.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.929+0000 7fabba7fc640 1 -- 172.21.15.112:0/756292178 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v65)=0 v65) ==== 125+0+0 (secure 0 0 0) 0x7fabac08a4e0 con 0x7fabbc101930 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faba407af30 msgr2=0x7faba407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faba407af30 0x7faba407d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0ffcf0 tx=0x7fabb0006c90 comp rx=0 tx=0).stop 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc101930 msgr2=0x7fabbc19d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc101930 0x7fabbc19d710 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fabac005cc0 tx=0x7fabac02f5f0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 shutdown_connections 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faba407af30 0x7faba407d3f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc107930 0x7fabbc19dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 --2- 172.21.15.112:0/756292178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabbc101930 0x7fabbc19d710 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 >> 172.21.15.112:0/756292178 conn(0x7fabbc0fd630 msgr2=0x7fabbc0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 shutdown_connections 2024-09-21T01:00:34.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:34.931+0000 7fabc37ee640 1 -- 172.21.15.112:0/756292178 wait complete. 2024-09-21T01:00:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:34 smithi187 ceph-mon[34997]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:34 smithi187 ceph-mon[34997]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:35.563 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T01:00:35.564 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T01:00:35.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T01:00:35.812 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:35 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/756292178' entity='client.admin' 2024-09-21T01:00:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:35 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:35 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:35 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:35 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:35 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T01:00:36.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:35 smithi112 ceph-mon[28078]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 -- 172.21.15.112:0/304032302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8106820 msgr2=0x7fdec8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 --2- 172.21.15.112:0/304032302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8106820 0x7fdec8106c00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009880 tx=0x7fdeb802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 -- 172.21.15.112:0/304032302 shutdown_connections 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 --2- 172.21.15.112:0/304032302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec8100820 0x7fdec8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 --2- 172.21.15.112:0/304032302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8106820 0x7fdec8106c00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 -- 172.21.15.112:0/304032302 >> 172.21.15.112:0/304032302 conn(0x7fdec80fc520 msgr2=0x7fdec80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 -- 172.21.15.112:0/304032302 shutdown_connections 2024-09-21T01:00:36.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.272+0000 7fdece8fb640 1 -- 172.21.15.112:0/304032302 wait complete. 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdece8fb640 1 Processor -- start 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdece8fb640 1 -- start start 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdece8fb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8100820 0x7fdec8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdece8fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec8106820 0x7fdec8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdece8fb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdec810dd50 con 0x7fdec8100820 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdece8fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdec810dbd0 con 0x7fdec8106820 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8100820 0x7fdec8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8100820 0x7fdec8198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41420/0 (socket says 172.21.15.112:41420) 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.273+0000 7fdec7fff640 1 -- 172.21.15.112:0/3768409295 learned_addr learned my addr 172.21.15.112:0/3768409295 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdec7fff640 1 -- 172.21.15.112:0/3768409295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec8106820 msgr2=0x7fdec8198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdec7fff640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec8106820 0x7fdec8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdec7fff640 1 -- 172.21.15.112:0/3768409295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec81993a0 con 0x7fdec8100820 2024-09-21T01:00:36.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdec7fff640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8100820 0x7fdec8198860 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8031460 tx=0x7fdeb80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdec5ffb640 1 -- 172.21.15.112:0/3768409295 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeb803f070 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec8199630 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdec5ffb640 1 -- 172.21.15.112:0/3768409295 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdeb8004cf0 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdec5ffb640 1 -- 172.21.15.112:0/3768409295 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeb8035030 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.274+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec81a1be0 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.275+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec8101f60 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.276+0000 7fdec5ffb640 1 -- 172.21.15.112:0/3768409295 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fdeb8042070 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.276+0000 7fdec5ffb640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdeb407af30 0x7fdeb407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.276+0000 7fdec5ffb640 1 -- 172.21.15.112:0/3768409295 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fdeb80bf1a0 con 0x7fdec8100820 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.276+0000 7fdebffff640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdeb407af30 0x7fdeb407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.277+0000 7fdebffff640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdeb407af30 0x7fdeb407d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdec806ae50 tx=0x7fdeb0006c90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:36.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.281+0000 7fdec5ffb640 1 -- 172.21.15.112:0/3768409295 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fdeb808a820 con 0x7fdec8100820 2024-09-21T01:00:36.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:35 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/756292178' entity='client.admin' 2024-09-21T01:00:36.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:35 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:36.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:35 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:36.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:35 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:36.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:35 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:36.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:35 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T01:00:36.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:35 smithi187 ceph-mon[34997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T01:00:36.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.458+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fdec8108d90 con 0x7fdec8100820 2024-09-21T01:00:36.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.458+0000 7fdec5ffb640 1 -- 172.21.15.112:0/3768409295 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v65)=0 v65) ==== 155+0+0 (secure 0 0 0) 0x7fdeb808f6d0 con 0x7fdec8100820 2024-09-21T01:00:36.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdeb407af30 msgr2=0x7fdeb407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:36.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdeb407af30 0x7fdeb407d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdec806ae50 tx=0x7fdeb0006c90 comp rx=0 tx=0).stop 2024-09-21T01:00:36.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8100820 msgr2=0x7fdec8198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:36.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8100820 0x7fdec8198860 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8031460 tx=0x7fdeb80048f0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 shutdown_connections 2024-09-21T01:00:36.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdeb407af30 0x7fdeb407d3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec8106820 0x7fdec8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 --2- 172.21.15.112:0/3768409295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdec8100820 0x7fdec8198860 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:36.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 >> 172.21.15.112:0/3768409295 conn(0x7fdec80fc520 msgr2=0x7fdec80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:36.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.460+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 shutdown_connections 2024-09-21T01:00:36.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:36.461+0000 7fdece8fb640 1 -- 172.21.15.112:0/3768409295 wait complete. 2024-09-21T01:00:37.126 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:36 smithi112 ceph-mon[28078]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:37.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T01:00:37.401 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:37.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:36 smithi187 ceph-mon[34997]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:37.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3998486391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 msgr2=0x7f8ed4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:37.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3998486391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed4107d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009880 tx=0x7f8ec402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:37.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3998486391 shutdown_connections 2024-09-21T01:00:37.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3998486391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed4101930 0x7f8ed4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3998486391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed4107d10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3998486391 >> 172.21.15.112:0/3998486391 conn(0x7f8ed40fd630 msgr2=0x7f8ed40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3998486391 shutdown_connections 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.872+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3998486391 wait complete. 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.873+0000 7f8ed8b64640 1 Processor -- start 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.873+0000 7f8ed8b64640 1 -- start start 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.873+0000 7f8ed8b64640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed4101930 0x7f8ed419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.873+0000 7f8ed8b64640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.873+0000 7f8ed8b64640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed410ede0 con 0x7f8ed4107930 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.873+0000 7f8ed8b64640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed410ec60 con 0x7f8ed4101930 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.873+0000 7f8ed1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41428/0 (socket says 172.21.15.112:41428) 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed1d9b640 1 -- 172.21.15.112:0/3691885244 learned_addr learned my addr 172.21.15.112:0/3691885244 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed259c640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed4101930 0x7f8ed419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed1d9b640 1 -- 172.21.15.112:0/3691885244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed4101930 msgr2=0x7f8ed419f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed1d9b640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed4101930 0x7f8ed419f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed1d9b640 1 -- 172.21.15.112:0/3691885244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed41a03d0 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed259c640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed4101930 0x7f8ed419f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed1d9b640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed419fd20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c8a0 tx=0x7f8ebc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ecb7fe640 1 -- 172.21.15.112:0/3691885244 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ebc0079b0 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ecb7fe640 1 -- 172.21.15.112:0/3691885244 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ebc007b50 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed4199ac0 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ecb7fe640 1 -- 172.21.15.112:0/3691885244 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ebc018700 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.874+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed419a020 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.875+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed4103070 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.876+0000 7f8ecb7fe640 1 -- 172.21.15.112:0/3691885244 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8ebc007d00 con 0x7f8ed4107930 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.876+0000 7f8ecb7fe640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ec007af30 0x7f8ec007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.876+0000 7f8ecb7fe640 1 -- 172.21.15.112:0/3691885244 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f8ebc09e310 con 0x7f8ed4107930 2024-09-21T01:00:37.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.876+0000 7f8ed259c640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ec007af30 0x7f8ec007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:37.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.877+0000 7f8ed259c640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ec007af30 0x7f8ec007d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4006010 tx=0x7f8ec4004220 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:37.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:37.881+0000 7f8ecb7fe640 1 -- 172.21.15.112:0/3691885244 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8ebc014030 con 0x7f8ed4107930 2024-09-21T01:00:38.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.058+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f8ed419a330 con 0x7f8ed4107930 2024-09-21T01:00:38.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.058+0000 7f8ecb7fe640 1 -- 172.21.15.112:0/3691885244 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v65)=0 v65) ==== 163+0+0 (secure 0 0 0) 0x7f8ebc069910 con 0x7f8ed4107930 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ec007af30 msgr2=0x7f8ec007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ec007af30 0x7f8ec007d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4006010 tx=0x7f8ec4004220 comp rx=0 tx=0).stop 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 msgr2=0x7f8ed419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed419fd20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c8a0 tx=0x7f8ebc00cd60 comp rx=0 tx=0).stop 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 shutdown_connections 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ec007af30 0x7f8ec007d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed4107930 0x7f8ed419fd20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 --2- 172.21.15.112:0/3691885244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed4101930 0x7f8ed419f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 >> 172.21.15.112:0/3691885244 conn(0x7f8ed40fd630 msgr2=0x7f8ed40fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 shutdown_connections 2024-09-21T01:00:38.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:38.061+0000 7f8ed8b64640 1 -- 172.21.15.112:0/3691885244 wait complete. 2024-09-21T01:00:38.712 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T01:00:38.959 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:39.222 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:38 smithi112 ceph-mon[28078]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:39.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:38 smithi187 ceph-mon[34997]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:39.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 -- 172.21.15.112:0/3664760812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 msgr2=0x7fe870106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 --2- 172.21.15.112:0/3664760812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe870106c00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe860009880 tx=0x7fe86002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 -- 172.21.15.112:0/3664760812 shutdown_connections 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 --2- 172.21.15.112:0/3664760812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe870100820 0x7fe870100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 --2- 172.21.15.112:0/3664760812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe870106c00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 -- 172.21.15.112:0/3664760812 >> 172.21.15.112:0/3664760812 conn(0x7fe8700fc520 msgr2=0x7fe8700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 -- 172.21.15.112:0/3664760812 shutdown_connections 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.453+0000 7fe8773d5640 1 -- 172.21.15.112:0/3664760812 wait complete. 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe8773d5640 1 Processor -- start 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe8773d5640 1 -- start start 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe8773d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe870100820 0x7fe87019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe8773d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe87019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe8773d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe87010dcd0 con 0x7fe870106820 2024-09-21T01:00:39.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe8773d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe87010db50 con 0x7fe870100820 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe874970640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe87019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe874970640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe87019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41460/0 (socket says 172.21.15.112:41460) 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe874970640 1 -- 172.21.15.112:0/1685585182 learned_addr learned my addr 172.21.15.112:0/1685585182 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe875171640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe870100820 0x7fe87019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe874970640 1 -- 172.21.15.112:0/1685585182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe870100820 msgr2=0x7fe87019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe874970640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe870100820 0x7fe87019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe874970640 1 -- 172.21.15.112:0/1685585182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe870197840 con 0x7fe870106820 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.454+0000 7fe874970640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe87019dc00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c8a0 tx=0x7fe86c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.455+0000 7fe8667fc640 1 -- 172.21.15.112:0/1685585182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe86c0079b0 con 0x7fe870106820 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.455+0000 7fe8667fc640 1 -- 172.21.15.112:0/1685585182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe86c007b50 con 0x7fe870106820 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.455+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe870197b30 con 0x7fe870106820 2024-09-21T01:00:39.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.455+0000 7fe8667fc640 1 -- 172.21.15.112:0/1685585182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe86c018700 con 0x7fe870106820 2024-09-21T01:00:39.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.455+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8701980c0 con 0x7fe870106820 2024-09-21T01:00:39.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.456+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe870101f60 con 0x7fe870106820 2024-09-21T01:00:39.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.456+0000 7fe8667fc640 1 -- 172.21.15.112:0/1685585182 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe86c007d00 con 0x7fe870106820 2024-09-21T01:00:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.457+0000 7fe8667fc640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe85c07af80 0x7fe85c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.457+0000 7fe8667fc640 1 -- 172.21.15.112:0/1685585182 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fe86c09e250 con 0x7fe870106820 2024-09-21T01:00:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.457+0000 7fe875171640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe85c07af80 0x7fe85c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.457+0000 7fe875171640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe85c07af80 0x7fe85c07d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe860031460 tx=0x7fe860009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.461+0000 7fe8667fc640 1 -- 172.21.15.112:0/1685585182 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe86c014030 con 0x7fe870106820 2024-09-21T01:00:39.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.638+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7fe8701983d0 con 0x7fe870106820 2024-09-21T01:00:39.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.639+0000 7fe8667fc640 1 -- 172.21.15.112:0/1685585182 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v65)=0 v65) ==== 135+0+0 (secure 0 0 0) 0x7fe86c0698d0 con 0x7fe870106820 2024-09-21T01:00:39.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe85c07af80 msgr2=0x7fe85c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe85c07af80 0x7fe85c07d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe860031460 tx=0x7fe860009560 comp rx=0 tx=0).stop 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 msgr2=0x7fe87019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe87019dc00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c8a0 tx=0x7fe86c00cd60 comp rx=0 tx=0).stop 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 shutdown_connections 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe85c07af80 0x7fe85c07d440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe870106820 0x7fe87019dc00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 --2- 172.21.15.112:0/1685585182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe870100820 0x7fe87019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 >> 172.21.15.112:0/1685585182 conn(0x7fe8700fc520 msgr2=0x7fe87006a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 shutdown_connections 2024-09-21T01:00:39.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:39.641+0000 7fe8773d5640 1 -- 172.21.15.112:0/1685585182 wait complete. 2024-09-21T01:00:40.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T01:00:40.512 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:40.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3707235202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 msgr2=0x7ff134100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3707235202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134100c80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff124009880 tx=0x7ff12402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3707235202 shutdown_connections 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3707235202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134100c80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3707235202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff134106820 0x7ff134106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3707235202 >> 172.21.15.112:0/3707235202 conn(0x7ff1340fc520 msgr2=0x7ff1340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3707235202 shutdown_connections 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.979+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3707235202 wait complete. 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13c4d1640 1 Processor -- start 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13c4d1640 1 -- start start 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13c4d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13c4d1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff134106820 0x7ff134196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13c4d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff13410dd50 con 0x7ff134100820 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13c4d1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff13410dbd0 con 0x7ff134106820 2024-09-21T01:00:40.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13a26d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13a26d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41466/0 (socket says 172.21.15.112:41466) 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13a26d640 1 -- 172.21.15.112:0/3887120838 learned_addr learned my addr 172.21.15.112:0/3887120838 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff139a6c640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff134106820 0x7ff134196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13a26d640 1 -- 172.21.15.112:0/3887120838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff134106820 msgr2=0x7ff134196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13a26d640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff134106820 0x7ff134196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.980+0000 7ff13a26d640 1 -- 172.21.15.112:0/3887120838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1341970e0 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.981+0000 7ff13a26d640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134196660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b420 tx=0x7ff13000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.981+0000 7ff12b7fe640 1 -- 172.21.15.112:0/3887120838 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff130011630 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.981+0000 7ff12b7fe640 1 -- 172.21.15.112:0/3887120838 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff130016070 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.981+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1341973d0 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.981+0000 7ff12b7fe640 1 -- 172.21.15.112:0/3887120838 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff130010d40 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.981+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1341a3ea0 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.982+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff134101f60 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.982+0000 7ff12b7fe640 1 -- 172.21.15.112:0/3887120838 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff13001b460 con 0x7ff134100820 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.983+0000 7ff12b7fe640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff12007af30 0x7ff12007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:40.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.983+0000 7ff139a6c640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff12007af30 0x7ff12007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:40.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.983+0000 7ff12b7fe640 1 -- 172.21.15.112:0/3887120838 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7ff13009d7b0 con 0x7ff134100820 2024-09-21T01:00:40.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.984+0000 7ff139a6c640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff12007af30 0x7ff12007d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1341987c0 tx=0x7ff124031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:40.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:40.988+0000 7ff12b7fe640 1 -- 172.21.15.112:0/3887120838 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff130021250 con 0x7ff134100820 2024-09-21T01:00:41.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.181+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "target": ["mon-mgr", ""]}) -- 0x7ff134062630 con 0x7ff12007af30 2024-09-21T01:00:41.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:40 smithi112 ceph-mon[28078]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:41.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.188+0000 7ff12b7fe640 1 -- 172.21.15.112:0/3887120838 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7ff134062630 con 0x7ff12007af30 2024-09-21T01:00:41.189 INFO:teuthology.orchestra.run.smithi112.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff12007af30 msgr2=0x7ff12007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff12007af30 0x7ff12007d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1341987c0 tx=0x7ff124031400 comp rx=0 tx=0).stop 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 msgr2=0x7ff134196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134196660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b420 tx=0x7ff13000b8e0 comp rx=0 tx=0).stop 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 shutdown_connections 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff12007af30 0x7ff12007d3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff134106820 0x7ff134196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 --2- 172.21.15.112:0/3887120838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff134100820 0x7ff134196660 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 >> 172.21.15.112:0/3887120838 conn(0x7ff1340fc520 msgr2=0x7ff1340fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:41.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 shutdown_connections 2024-09-21T01:00:41.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:41.191+0000 7ff13c4d1640 1 -- 172.21.15.112:0/3887120838 wait complete. 2024-09-21T01:00:41.238 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:40 smithi187 ceph-mon[34997]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:41.822 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T01:00:41.823 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T01:00:41.823 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:00:42.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:42 smithi112 ceph-mon[28078]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:42.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:42 smithi112 ceph-mon[28078]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:42.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:42 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:42.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:42 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:42.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:42 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:42.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:42 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:42.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:42 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:42 smithi187 ceph-mon[34997]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:42 smithi187 ceph-mon[34997]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:42 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:42 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:42 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:42 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:00:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:42 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:42.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 -- 172.21.15.112:0/2812066352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 msgr2=0x7ff748105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 --2- 172.21.15.112:0/2812066352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff748105bd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009880 tx=0x7ff73c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 -- 172.21.15.112:0/2812066352 shutdown_connections 2024-09-21T01:00:42.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 --2- 172.21.15.112:0/2812066352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff748100fc0 0x7ff748101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 --2- 172.21.15.112:0/2812066352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff748105bd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 -- 172.21.15.112:0/2812066352 >> 172.21.15.112:0/2812066352 conn(0x7ff7480fbc60 msgr2=0x7ff7480fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 -- 172.21.15.112:0/2812066352 shutdown_connections 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.707+0000 7ff74f243640 1 -- 172.21.15.112:0/2812066352 wait complete. 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff74f243640 1 Processor -- start 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff74f243640 1 -- start start 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff74f243640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff748100fc0 0x7ff7480fc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff74f243640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff7480fc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff74f243640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff74810dcc0 con 0x7ff7481057f0 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff74f243640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff74810db40 con 0x7ff748100fc0 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff747fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff7480fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff747fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff7480fc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56796/0 (socket says 172.21.15.112:56796) 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff747fff640 1 -- 172.21.15.112:0/1342420325 learned_addr learned my addr 172.21.15.112:0/1342420325 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff747fff640 1 -- 172.21.15.112:0/1342420325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff748100fc0 msgr2=0x7ff7480fc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff747fff640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff748100fc0 0x7ff7480fc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.708+0000 7ff747fff640 1 -- 172.21.15.112:0/1342420325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7480fce50 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.709+0000 7ff747fff640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff7480fc910 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff73400c8a0 tx=0x7ff73400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.709+0000 7ff745ffb640 1 -- 172.21.15.112:0/1342420325 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7340079b0 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.709+0000 7ff745ffb640 1 -- 172.21.15.112:0/1342420325 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff734007b50 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.709+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7480fd140 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.709+0000 7ff745ffb640 1 -- 172.21.15.112:0/1342420325 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff734018700 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.709+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481a3db0 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.710+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff748101420 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.711+0000 7ff745ffb640 1 -- 172.21.15.112:0/1342420325 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff734007d00 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.711+0000 7ff745ffb640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff73807af80 0x7ff73807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.711+0000 7ff745ffb640 1 -- 172.21.15.112:0/1342420325 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7ff73409e250 con 0x7ff7481057f0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.711+0000 7ff74cfdf640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff73807af80 0x7ff73807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.712+0000 7ff74cfdf640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff73807af80 0x7ff73807d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0096c0 tx=0x7ff73c000bc0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.716+0000 7ff745ffb640 1 -- 172.21.15.112:0/1342420325 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff734014030 con 0x7ff7481057f0 2024-09-21T01:00:42.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.913+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff748062630 con 0x7ff73807af80 2024-09-21T01:00:42.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.914+0000 7ff745ffb640 1 -- 172.21.15.112:0/1342420325 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7ff748062630 con 0x7ff73807af80 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff73807af80 msgr2=0x7ff73807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff73807af80 0x7ff73807d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0096c0 tx=0x7ff73c000bc0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 msgr2=0x7ff7480fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff7480fc910 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff73400c8a0 tx=0x7ff73400cd60 comp rx=0 tx=0).stop 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 shutdown_connections 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff73807af80 0x7ff73807d440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7481057f0 0x7ff7480fc910 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 --2- 172.21.15.112:0/1342420325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff748100fc0 0x7ff7480fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 >> 172.21.15.112:0/1342420325 conn(0x7ff7480fbc60 msgr2=0x7ff748100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 shutdown_connections 2024-09-21T01:00:42.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.916+0000 7ff74f243640 1 -- 172.21.15.112:0/1342420325 wait complete. 2024-09-21T01:00:42.926 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:00:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 -- 172.21.15.112:0/3474405861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70102ae0 msgr2=0x7f1b70102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3474405861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70102ae0 0x7f1b70102ec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009880 tx=0x7f1b6002a530 comp rx=0 tx=0).stop 2024-09-21T01:00:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 -- 172.21.15.112:0/3474405861 shutdown_connections 2024-09-21T01:00:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3474405861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b70103400 0x7f1b7010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3474405861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70102ae0 0x7f1b70102ec0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 -- 172.21.15.112:0/3474405861 >> 172.21.15.112:0/3474405861 conn(0x7f1b700fc520 msgr2=0x7f1b700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 -- 172.21.15.112:0/3474405861 shutdown_connections 2024-09-21T01:00:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:42.999+0000 7f1b75e31640 1 -- 172.21.15.112:0/3474405861 wait complete. 2024-09-21T01:00:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.000+0000 7f1b75e31640 1 Processor -- start 2024-09-21T01:00:43.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.000+0000 7f1b75e31640 1 -- start start 2024-09-21T01:00:43.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.000+0000 7f1b75e31640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b70102ae0 0x7f1b7019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.000+0000 7f1b75e31640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70103400 0x7f1b7019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.000+0000 7f1b75e31640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7010ee70 con 0x7f1b70103400 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.000+0000 7f1b75e31640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7010ecf0 con 0x7f1b70102ae0 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70103400 0x7f1b7019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70103400 0x7f1b7019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56822/0 (socket says 172.21.15.112:56822) 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6effd640 1 -- 172.21.15.112:0/3801906914 learned_addr learned my addr 172.21.15.112:0/3801906914 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6f7fe640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b70102ae0 0x7f1b7019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6effd640 1 -- 172.21.15.112:0/3801906914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b70102ae0 msgr2=0x7f1b7019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6effd640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b70102ae0 0x7f1b7019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6effd640 1 -- 172.21.15.112:0/3801906914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b70197860 con 0x7f1b70103400 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.001+0000 7f1b6effd640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70103400 0x7f1b7019dbe0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400b370 tx=0x7f1b6400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.002+0000 7f1b6cff9640 1 -- 172.21.15.112:0/3801906914 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b64015020 con 0x7f1b70103400 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.002+0000 7f1b6cff9640 1 -- 172.21.15.112:0/3801906914 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b64011af0 con 0x7f1b70103400 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.002+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b70197af0 con 0x7f1b70103400 2024-09-21T01:00:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.002+0000 7f1b6cff9640 1 -- 172.21.15.112:0/3801906914 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b64010d60 con 0x7f1b70103400 2024-09-21T01:00:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.002+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b70198080 con 0x7f1b70103400 2024-09-21T01:00:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.003+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7006abe0 con 0x7f1b70103400 2024-09-21T01:00:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.004+0000 7f1b6cff9640 1 -- 172.21.15.112:0/3801906914 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1b64018020 con 0x7f1b70103400 2024-09-21T01:00:43.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.004+0000 7f1b6cff9640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b5807af80 0x7f1b5807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.005+0000 7f1b6cff9640 1 -- 172.21.15.112:0/3801906914 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f1b6409d8c0 con 0x7f1b70103400 2024-09-21T01:00:43.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.005+0000 7f1b6f7fe640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b5807af80 0x7f1b5807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.005+0000 7f1b6f7fe640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b5807af80 0x7f1b5807d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b60031460 tx=0x7f1b60009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.009+0000 7f1b6cff9640 1 -- 172.21.15.112:0/3801906914 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1b6401f020 con 0x7f1b70103400 2024-09-21T01:00:43.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.214+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b70198d90 con 0x7f1b5807af80 2024-09-21T01:00:43.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.215+0000 7f1b6cff9640 1 -- 172.21.15.112:0/3801906914 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f1b70198d90 con 0x7f1b5807af80 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.217+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b5807af80 msgr2=0x7f1b5807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.217+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b5807af80 0x7f1b5807d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b60031460 tx=0x7f1b60009560 comp rx=0 tx=0).stop 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.217+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70103400 msgr2=0x7f1b7019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.217+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70103400 0x7f1b7019dbe0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400b370 tx=0x7f1b6400b830 comp rx=0 tx=0).stop 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.217+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 shutdown_connections 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.217+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b5807af80 0x7f1b5807d440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.218+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b70103400 0x7f1b7019dbe0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.218+0000 7f1b75e31640 1 --2- 172.21.15.112:0/3801906914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b70102ae0 0x7f1b7019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.218+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 >> 172.21.15.112:0/3801906914 conn(0x7f1b700fc520 msgr2=0x7f1b70108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:43.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.218+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 shutdown_connections 2024-09-21T01:00:43.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.218+0000 7f1b75e31640 1 -- 172.21.15.112:0/3801906914 wait complete. 2024-09-21T01:00:43.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 -- 172.21.15.112:0/1761556532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 msgr2=0x7efd7c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 --2- 172.21.15.112:0/1761556532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c101d70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efd70009880 tx=0x7efd7002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 -- 172.21.15.112:0/1761556532 shutdown_connections 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 --2- 172.21.15.112:0/1761556532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c101d70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 --2- 172.21.15.112:0/1761556532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd7c107910 0x7efd7c107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 -- 172.21.15.112:0/1761556532 >> 172.21.15.112:0/1761556532 conn(0x7efd7c0fd5f0 msgr2=0x7efd7c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 -- 172.21.15.112:0/1761556532 shutdown_connections 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.300+0000 7efd821f0640 1 -- 172.21.15.112:0/1761556532 wait complete. 2024-09-21T01:00:43.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.301+0000 7efd821f0640 1 Processor -- start 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.301+0000 7efd821f0640 1 -- start start 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd821f0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd821f0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd7c107910 0x7efd7c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd821f0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c10ede0 con 0x7efd7c101910 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd821f0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c10ec60 con 0x7efd7c107910 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56848/0 (socket says 172.21.15.112:56848) 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7b7fe640 1 -- 172.21.15.112:0/2370298334 learned_addr learned my addr 172.21.15.112:0/2370298334 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:43.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7affd640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd7c107910 0x7efd7c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7b7fe640 1 -- 172.21.15.112:0/2370298334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd7c107910 msgr2=0x7efd7c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7b7fe640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd7c107910 0x7efd7c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7b7fe640 1 -- 172.21.15.112:0/2370298334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c1977f0 con 0x7efd7c101910 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.302+0000 7efd7affd640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd7c107910 0x7efd7c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.303+0000 7efd7b7fe640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c19d670 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00d6f0 tx=0x7efd6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.303+0000 7efd78ff9640 1 -- 172.21.15.112:0/2370298334 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd6c017070 con 0x7efd7c101910 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.303+0000 7efd78ff9640 1 -- 172.21.15.112:0/2370298334 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd6c00de00 con 0x7efd7c101910 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.303+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c197ae0 con 0x7efd7c101910 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.303+0000 7efd78ff9640 1 -- 172.21.15.112:0/2370298334 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd6c004bb0 con 0x7efd7c101910 2024-09-21T01:00:43.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.303+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c198040 con 0x7efd7c101910 2024-09-21T01:00:43.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.304+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7c103050 con 0x7efd7c101910 2024-09-21T01:00:43.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.305+0000 7efd78ff9640 1 -- 172.21.15.112:0/2370298334 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efd6c009a30 con 0x7efd7c101910 2024-09-21T01:00:43.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.305+0000 7efd78ff9640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efd6407af80 0x7efd6407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.305+0000 7efd78ff9640 1 -- 172.21.15.112:0/2370298334 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7efd6c09dac0 con 0x7efd7c101910 2024-09-21T01:00:43.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.305+0000 7efd7affd640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efd6407af80 0x7efd6407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.306+0000 7efd7affd640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efd6407af80 0x7efd6407d440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd7c198b40 tx=0x7efd70031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.314+0000 7efd78ff9640 1 -- 172.21.15.112:0/2370298334 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7efd6c069140 con 0x7efd7c101910 2024-09-21T01:00:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:43 smithi112 ceph-mon[28078]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:43 smithi112 ceph-mon[28078]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:43.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.510+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efd7c1983b0 con 0x7efd6407af80 2024-09-21T01:00:43.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.520+0000 7efd78ff9640 1 -- 172.21.15.112:0/2370298334 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7efd7c1983b0 con 0x7efd6407af80 2024-09-21T01:00:43.521 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:00:43.521 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (74s) 45s ago 12m 19.7M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:00:43.521 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (4m) 45s ago 12m 8606k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:00:43.521 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (3m) 116s ago 11m 8082k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:00:43.521 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (12m) 45s ago 12m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T01:00:43.521 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (11m) 116s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T01:00:43.522 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (52s) 45s ago 11m 48.1M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:00:43.522 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (6m) 45s ago 6m 151M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:00:43.522 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (6m) 45s ago 6m 15.4M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:00:43.522 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (6m) 116s ago 6m 18.7M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:00:43.522 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (6m) 116s ago 6m 16.6M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:00:43.522 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (3m) 45s ago 13m 588M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (2m) 116s ago 11m 519M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (13m) 45s ago 13m 62.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 6595fa98b1e4 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (11m) 116s ago 11m 50.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 09a6c459af74 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (2m) 45s ago 12m 9210k - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (2m) 116s ago 11m 3456k - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (10m) 45s ago 10m 204M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (9m) 45s ago 9m 222M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (9m) 45s ago 9m 176M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (8m) 116s ago 8m 251M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (8m) 116s ago 8m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (7m) 116s ago 7m 189M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:00:43.523 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (95s) 45s ago 11m 45.0M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:00:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efd6407af80 msgr2=0x7efd6407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efd6407af80 0x7efd6407d440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd7c198b40 tx=0x7efd70031400 comp rx=0 tx=0).stop 2024-09-21T01:00:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 msgr2=0x7efd7c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c19d670 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00d6f0 tx=0x7efd6c00dbb0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 shutdown_connections 2024-09-21T01:00:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efd6407af80 0x7efd6407d440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd7c107910 0x7efd7c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 --2- 172.21.15.112:0/2370298334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd7c101910 0x7efd7c19d670 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 >> 172.21.15.112:0/2370298334 conn(0x7efd7c0fd5f0 msgr2=0x7efd7c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:43.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 shutdown_connections 2024-09-21T01:00:43.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.522+0000 7efd821f0640 1 -- 172.21.15.112:0/2370298334 wait complete. 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 -- 172.21.15.112:0/111816570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154106820 msgr2=0x7f8154106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 --2- 172.21.15.112:0/111816570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154106820 0x7f8154106c00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8144009880 tx=0x7f814402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 -- 172.21.15.112:0/111816570 shutdown_connections 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 --2- 172.21.15.112:0/111816570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8154100820 0x7f8154100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 --2- 172.21.15.112:0/111816570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154106820 0x7f8154106c00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 -- 172.21.15.112:0/111816570 >> 172.21.15.112:0/111816570 conn(0x7f81540fc520 msgr2=0x7f81540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 -- 172.21.15.112:0/111816570 shutdown_connections 2024-09-21T01:00:43.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.604+0000 7f815a07c640 1 -- 172.21.15.112:0/111816570 wait complete. 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f815a07c640 1 Processor -- start 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f815a07c640 1 -- start start 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f815a07c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154100820 0x7f81541987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f815a07c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8154106820 0x7f8154198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f815a07c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f815410dcd0 con 0x7f8154100820 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f815a07c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f815410db50 con 0x7f8154106820 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f81537fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154100820 0x7f81541987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f81537fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154100820 0x7f81541987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56858/0 (socket says 172.21.15.112:56858) 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f81537fe640 1 -- 172.21.15.112:0/4011416905 learned_addr learned my addr 172.21.15.112:0/4011416905 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f8152ffd640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8154106820 0x7f8154198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f81537fe640 1 -- 172.21.15.112:0/4011416905 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8154106820 msgr2=0x7f8154198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f81537fe640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8154106820 0x7f8154198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.605+0000 7f81537fe640 1 -- 172.21.15.112:0/4011416905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8154199320 con 0x7f8154100820 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.606+0000 7f81537fe640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154100820 0x7f81541987e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8144031460 tx=0x7f81440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.606+0000 7f8150ff9640 1 -- 172.21.15.112:0/4011416905 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f814403f070 con 0x7f8154100820 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.606+0000 7f8150ff9640 1 -- 172.21.15.112:0/4011416905 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81440035f0 con 0x7f8154100820 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.606+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81541995b0 con 0x7f8154100820 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.606+0000 7f8150ff9640 1 -- 172.21.15.112:0/4011416905 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8144035030 con 0x7f8154100820 2024-09-21T01:00:43.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.606+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81541a1b60 con 0x7f8154100820 2024-09-21T01:00:43.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.607+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8154101f60 con 0x7f8154100820 2024-09-21T01:00:43.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.607+0000 7f8150ff9640 1 -- 172.21.15.112:0/4011416905 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8144042070 con 0x7f8154100820 2024-09-21T01:00:43.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.608+0000 7f8150ff9640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f813c07af80 0x7f813c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.608+0000 7f8150ff9640 1 -- 172.21.15.112:0/4011416905 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f81440be860 con 0x7f8154100820 2024-09-21T01:00:43.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.608+0000 7f8152ffd640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f813c07af80 0x7f813c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.608+0000 7f8152ffd640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f813c07af80 0x7f813c07d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f815406ae50 tx=0x7f814800b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.613+0000 7f8150ff9640 1 -- 172.21.15.112:0/4011416905 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8144089ee0 con 0x7f8154100820 2024-09-21T01:00:43.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:43 smithi187 ceph-mon[34997]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:00:43.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:43 smithi187 ceph-mon[34997]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:43.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.867+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8154103a30 con 0x7f8154100820 2024-09-21T01:00:43.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.868+0000 7f8150ff9640 1 -- 172.21.15.112:0/4011416905 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f814408ed90 con 0x7f8154100820 2024-09-21T01:00:43.868 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:00:43.868 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:00:43.868 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:00:43.869 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:00:43.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f813c07af80 msgr2=0x7f813c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f813c07af80 0x7f813c07d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f815406ae50 tx=0x7f814800b390 comp rx=0 tx=0).stop 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154100820 msgr2=0x7f81541987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154100820 0x7f81541987e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8144031460 tx=0x7f81440045e0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 shutdown_connections 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f813c07af80 0x7f813c07d440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8154106820 0x7f8154198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 --2- 172.21.15.112:0/4011416905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8154100820 0x7f81541987e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 >> 172.21.15.112:0/4011416905 conn(0x7f81540fc520 msgr2=0x7f81540fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 shutdown_connections 2024-09-21T01:00:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.870+0000 7f815a07c640 1 -- 172.21.15.112:0/4011416905 wait complete. 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 -- 172.21.15.112:0/3268345497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4107920 msgr2=0x7f84c4107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 --2- 172.21.15.112:0/3268345497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4107920 0x7f84c4107d00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009880 tx=0x7f84b402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 -- 172.21.15.112:0/3268345497 shutdown_connections 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 --2- 172.21.15.112:0/3268345497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c4101920 0x7f84c4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 --2- 172.21.15.112:0/3268345497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4107920 0x7f84c4107d00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 -- 172.21.15.112:0/3268345497 >> 172.21.15.112:0/3268345497 conn(0x7f84c40fd620 msgr2=0x7f84c40ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 -- 172.21.15.112:0/3268345497 shutdown_connections 2024-09-21T01:00:43.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.957+0000 7f84c8c19640 1 -- 172.21.15.112:0/3268345497 wait complete. 2024-09-21T01:00:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c8c19640 1 Processor -- start 2024-09-21T01:00:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c8c19640 1 -- start start 2024-09-21T01:00:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c8c19640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4101920 0x7f84c419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c8c19640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c4107920 0x7f84c419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c8c19640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84c410ee50 con 0x7f84c4101920 2024-09-21T01:00:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c8c19640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f84c410ecd0 con 0x7f84c4107920 2024-09-21T01:00:43.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4101920 0x7f84c419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4101920 0x7f84c419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56870/0 (socket says 172.21.15.112:56870) 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.958+0000 7f84c259c640 1 -- 172.21.15.112:0/2658814838 learned_addr learned my addr 172.21.15.112:0/2658814838 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84c1d9b640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c4107920 0x7f84c419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84c259c640 1 -- 172.21.15.112:0/2658814838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c4107920 msgr2=0x7f84c419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84c259c640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c4107920 0x7f84c419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84c259c640 1 -- 172.21.15.112:0/2658814838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c4197840 con 0x7f84c4101920 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84c259c640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4101920 0x7f84c419d6c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f84b4031460 tx=0x7f84b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84b37fe640 1 -- 172.21.15.112:0/2658814838 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84b403f070 con 0x7f84c4101920 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c4197ad0 con 0x7f84c4101920 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84b37fe640 1 -- 172.21.15.112:0/2658814838 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84b4004cf0 con 0x7f84c4101920 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84b37fe640 1 -- 172.21.15.112:0/2658814838 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84b4035030 con 0x7f84c4101920 2024-09-21T01:00:43.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.959+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c4198000 con 0x7f84c4101920 2024-09-21T01:00:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.960+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c4103060 con 0x7f84c4101920 2024-09-21T01:00:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.961+0000 7f84b37fe640 1 -- 172.21.15.112:0/2658814838 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f84b4042070 con 0x7f84c4101920 2024-09-21T01:00:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.961+0000 7f84b37fe640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f84ac07af30 0x7f84ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.962+0000 7f84b37fe640 1 -- 172.21.15.112:0/2658814838 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f84b40beb00 con 0x7f84c4101920 2024-09-21T01:00:43.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.962+0000 7f84c1d9b640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f84ac07af30 0x7f84ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:43.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.962+0000 7f84c1d9b640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f84ac07af30 0x7f84ac07d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84c40ffbc0 tx=0x7f84b8008040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:43.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:43.970+0000 7f84b37fe640 1 -- 172.21.15.112:0/2658814838 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f84b408a100 con 0x7f84c4101920 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.270+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f84c4109e90 con 0x7f84c4101920 2024-09-21T01:00:44.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.271+0000 7f84b37fe640 1 -- 172.21.15.112:0/2658814838 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7f84b408efb0 con 0x7f84c4101920 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:00:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:00:44.273 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:00:44.274 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:00:44.275 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:44.275 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:44.275 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:00:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f84ac07af30 msgr2=0x7f84ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f84ac07af30 0x7f84ac07d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84c40ffbc0 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4101920 msgr2=0x7f84c419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4101920 0x7f84c419d6c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f84b4031460 tx=0x7f84b40048f0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 shutdown_connections 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f84ac07af30 0x7f84ac07d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c4107920 0x7f84c419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 --2- 172.21.15.112:0/2658814838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c4101920 0x7f84c419d6c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 >> 172.21.15.112:0/2658814838 conn(0x7f84c40fd620 msgr2=0x7f84c40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 shutdown_connections 2024-09-21T01:00:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.273+0000 7f84c8c19640 1 -- 172.21.15.112:0/2658814838 wait complete. 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 -- 172.21.15.112:0/299292340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 msgr2=0x7fe854101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 --2- 172.21.15.112:0/299292340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe854101b90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe848009880 tx=0x7fe84802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 -- 172.21.15.112:0/299292340 shutdown_connections 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 --2- 172.21.15.112:0/299292340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe854101b90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 --2- 172.21.15.112:0/299292340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe854107840 0x7fe854107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 -- 172.21.15.112:0/299292340 >> 172.21.15.112:0/299292340 conn(0x7fe8540fd430 msgr2=0x7fe8540ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 -- 172.21.15.112:0/299292340 shutdown_connections 2024-09-21T01:00:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 -- 172.21.15.112:0/299292340 wait complete. 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.357+0000 7fe858da2640 1 Processor -- start 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe858da2640 1 -- start start 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe858da2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe8540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe858da2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe854107840 0x7fe854074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe858da2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe85410ed70 con 0x7fe854101730 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe858da2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe85410ebf0 con 0x7fe854107840 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe8537fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe8540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe8537fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe8540744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56882/0 (socket says 172.21.15.112:56882) 2024-09-21T01:00:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe8537fe640 1 -- 172.21.15.112:0/1347881927 learned_addr learned my addr 172.21.15.112:0/1347881927 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe852ffd640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe854107840 0x7fe854074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe8537fe640 1 -- 172.21.15.112:0/1347881927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe854107840 msgr2=0x7fe854074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe8537fe640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe854107840 0x7fe854074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe8537fe640 1 -- 172.21.15.112:0/1347881927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe854074f70 con 0x7fe854101730 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.358+0000 7fe852ffd640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe854107840 0x7fe854074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.359+0000 7fe8537fe640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe8540744f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe84400b420 tx=0x7fe84400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.359+0000 7fe850ff9640 1 -- 172.21.15.112:0/1347881927 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe844011630 con 0x7fe854101730 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.359+0000 7fe850ff9640 1 -- 172.21.15.112:0/1347881927 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe844016070 con 0x7fe854101730 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.359+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe854075260 con 0x7fe854101730 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.359+0000 7fe850ff9640 1 -- 172.21.15.112:0/1347881927 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe844010d40 con 0x7fe854101730 2024-09-21T01:00:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.359+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8541a3de0 con 0x7fe854101730 2024-09-21T01:00:44.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.360+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe854101b90 con 0x7fe854101730 2024-09-21T01:00:44.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.360+0000 7fe850ff9640 1 -- 172.21.15.112:0/1347881927 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe84401b460 con 0x7fe854101730 2024-09-21T01:00:44.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.361+0000 7fe850ff9640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe83c07af30 0x7fe83c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.361+0000 7fe850ff9640 1 -- 172.21.15.112:0/1347881927 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7fe84409d7b0 con 0x7fe854101730 2024-09-21T01:00:44.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.361+0000 7fe852ffd640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe83c07af30 0x7fe83c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.361+0000 7fe852ffd640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe83c07af30 0x7fe83c07d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe854075f80 tx=0x7fe848031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.365+0000 7fe850ff9640 1 -- 172.21.15.112:0/1347881927 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe844021250 con 0x7fe854101730 2024-09-21T01:00:44.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:44.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='client.14968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:44.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:00:44.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4011416905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:44.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:44.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:44.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:44.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:44.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:44 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T01:00:44.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.565+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe854102e70 con 0x7fe83c07af30 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.566+0000 7fe850ff9640 1 -- 172.21.15.112:0/1347881927 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7fe854102e70 con 0x7fe83c07af30 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "2/23 daemons upgraded", 2024-09-21T01:00:44.567 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T01:00:44.568 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:00:44.568 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:00:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe83c07af30 msgr2=0x7fe83c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe83c07af30 0x7fe83c07d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe854075f80 tx=0x7fe848031400 comp rx=0 tx=0).stop 2024-09-21T01:00:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 msgr2=0x7fe8540744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe8540744f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe84400b420 tx=0x7fe84400b8e0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 shutdown_connections 2024-09-21T01:00:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe83c07af30 0x7fe83c07d3f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe854107840 0x7fe854074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 --2- 172.21.15.112:0/1347881927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe854101730 0x7fe8540744f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.568+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 >> 172.21.15.112:0/1347881927 conn(0x7fe8540fd430 msgr2=0x7fe8540fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.569+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 shutdown_connections 2024-09-21T01:00:44.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.569+0000 7fe858da2640 1 -- 172.21.15.112:0/1347881927 wait complete. 2024-09-21T01:00:44.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 -- 172.21.15.112:0/3659967221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81067e0 msgr2=0x7f7de8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 --2- 172.21.15.112:0/3659967221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81067e0 0x7f7de8106bc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009880 tx=0x7f7dd802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 -- 172.21.15.112:0/3659967221 shutdown_connections 2024-09-21T01:00:44.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 --2- 172.21.15.112:0/3659967221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de81007e0 0x7f7de8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 --2- 172.21.15.112:0/3659967221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81067e0 0x7f7de8106bc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 -- 172.21.15.112:0/3659967221 >> 172.21.15.112:0/3659967221 conn(0x7f7de80fc4c0 msgr2=0x7f7de80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 -- 172.21.15.112:0/3659967221 shutdown_connections 2024-09-21T01:00:44.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.653+0000 7f7dee254640 1 -- 172.21.15.112:0/3659967221 wait complete. 2024-09-21T01:00:44.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.654+0000 7f7dee254640 1 Processor -- start 2024-09-21T01:00:44.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.654+0000 7f7dee254640 1 -- start start 2024-09-21T01:00:44.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7dee254640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81007e0 0x7f7de81987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7dee254640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de81067e0 0x7f7de8198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7dee254640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7de810dc90 con 0x7f7de81007e0 2024-09-21T01:00:44.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7dee254640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7de810db10 con 0x7f7de81067e0 2024-09-21T01:00:44.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81007e0 0x7f7de81987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81007e0 0x7f7de81987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56898/0 (socket says 172.21.15.112:56898) 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de77fe640 1 -- 172.21.15.112:0/4107890439 learned_addr learned my addr 172.21.15.112:0/4107890439 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de6ffd640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de81067e0 0x7f7de8198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de77fe640 1 -- 172.21.15.112:0/4107890439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de81067e0 msgr2=0x7f7de8198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de77fe640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de81067e0 0x7f7de8198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de77fe640 1 -- 172.21.15.112:0/4107890439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de8199300 con 0x7f7de81007e0 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.655+0000 7f7de77fe640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81007e0 0x7f7de81987c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8031460 tx=0x7f7dd80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.656+0000 7f7de4ff9640 1 -- 172.21.15.112:0/4107890439 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7dd803f070 con 0x7f7de81007e0 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.656+0000 7f7de4ff9640 1 -- 172.21.15.112:0/4107890439 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7dd80035f0 con 0x7f7de81007e0 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.656+0000 7f7de4ff9640 1 -- 172.21.15.112:0/4107890439 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7dd8035030 con 0x7f7de81007e0 2024-09-21T01:00:44.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.656+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de8199590 con 0x7f7de81007e0 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='client.14968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4011416905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:44 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T01:00:44.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.656+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de81a1b40 con 0x7f7de81007e0 2024-09-21T01:00:44.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.657+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de8101f20 con 0x7f7de81007e0 2024-09-21T01:00:44.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.658+0000 7f7de4ff9640 1 -- 172.21.15.112:0/4107890439 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7dd8042070 con 0x7f7de81007e0 2024-09-21T01:00:44.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.658+0000 7f7de4ff9640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7dd007af80 0x7f7dd007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:44.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.659+0000 7f7de4ff9640 1 -- 172.21.15.112:0/4107890439 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f7dd80be900 con 0x7f7de81007e0 2024-09-21T01:00:44.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.659+0000 7f7de6ffd640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7dd007af80 0x7f7dd007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:44.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.659+0000 7f7de6ffd640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7dd007af80 0x7f7dd007d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7de806a680 tx=0x7f7ddc00b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:44.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.663+0000 7f7de4ff9640 1 -- 172.21.15.112:0/4107890439 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7dd8089ee0 con 0x7f7de81007e0 2024-09-21T01:00:44.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.925+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7de8100c40 con 0x7f7de81007e0 2024-09-21T01:00:44.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.925+0000 7f7de4ff9640 1 -- 172.21.15.112:0/4107890439 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f7dd808ed90 con 0x7f7de81007e0 2024-09-21T01:00:44.928 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:44.928 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:44.928 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:00:44.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.927+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7dd007af80 msgr2=0x7f7dd007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.927+0000 7f7dee254640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7dd007af80 0x7f7dd007d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7de806a680 tx=0x7f7ddc00b390 comp rx=0 tx=0).stop 2024-09-21T01:00:44.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.927+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81007e0 msgr2=0x7f7de81987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.927+0000 7f7dee254640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81007e0 0x7f7de81987c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8031460 tx=0x7f7dd80045e0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.928+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 shutdown_connections 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.928+0000 7f7dee254640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7dd007af80 0x7f7dd007d440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.928+0000 7f7dee254640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de81067e0 0x7f7de8198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.928+0000 7f7dee254640 1 --2- 172.21.15.112:0/4107890439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7de81007e0 0x7f7de81987c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.928+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 >> 172.21.15.112:0/4107890439 conn(0x7f7de80fc4c0 msgr2=0x7f7de80fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.928+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 shutdown_connections 2024-09-21T01:00:44.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:00:44.928+0000 7f7dee254640 1 -- 172.21.15.112:0/4107890439 wait complete. 2024-09-21T01:00:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:45 smithi112 ceph-mon[28078]: from='client.14972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:45 smithi112 ceph-mon[28078]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:45 smithi112 ceph-mon[28078]: Upgrade: Target is version 19.3.0-5120-g18432218 (squid) 2024-09-21T01:00:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:45 smithi112 ceph-mon[28078]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, digests ['quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262'] 2024-09-21T01:00:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:45 smithi112 ceph-mon[28078]: Upgrade: Setting container_image for all mgr 2024-09-21T01:00:45.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:45 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/2658814838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T01:00:45.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:45 smithi112 ceph-mon[28078]: from='client.? 172.21.15.112:0/4107890439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T01:00:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:45 smithi187 ceph-mon[34997]: from='client.14972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:45 smithi187 ceph-mon[34997]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:45 smithi187 ceph-mon[34997]: Upgrade: Target is version 19.3.0-5120-g18432218 (squid) 2024-09-21T01:00:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:45 smithi187 ceph-mon[34997]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, digests ['quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262'] 2024-09-21T01:00:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:45 smithi187 ceph-mon[34997]: Upgrade: Setting container_image for all mgr 2024-09-21T01:00:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:45 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/2658814838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T01:00:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:45 smithi187 ceph-mon[34997]: from='client.? 172.21.15.112:0/4107890439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T01:00:46.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:46 smithi112 ceph-mon[28078]: from='client.14984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:46.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:46 smithi112 ceph-mon[28078]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:46.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:46 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T01:00:46.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:46 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T01:00:46.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:46 smithi112 ceph-mon[28078]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:46.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:46 smithi187 ceph-mon[34997]: from='client.14984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:00:46.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:46 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:46.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:46 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T01:00:46.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:46 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T01:00:46.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:46 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:00:47.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:46 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:00:47.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:47 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[28074]: 2024-09-21T01:00:47.166+0000 7f0ba0aad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:00:47.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:47 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[28074]: 2024-09-21T01:00:47.166+0000 7f0ba0aad640 -1 mon.smithi112@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T01:00:47.611 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:47 smithi112 podman[109530]: 2024-09-21 01:00:47.269471323 +0000 UTC m=+0.200582084 container died 6595fa98b1e45845b1524802f9ef7e0716908b105b1817fca096b7e197f76b2b (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T01:00:47.903 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:47 smithi112 podman[109530]: 2024-09-21 01:00:47.693279866 +0000 UTC m=+0.624390628 container cleanup 6595fa98b1e45845b1524802f9ef7e0716908b105b1817fca096b7e197f76b2b (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T01:00:47.903 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:47 smithi112 bash[109530]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112 2024-09-21T01:00:48.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:47 smithi112 podman[109542]: 2024-09-21 01:00:47.903005012 +0000 UTC m=+0.636505777 container remove 6595fa98b1e45845b1524802f9ef7e0716908b105b1817fca096b7e197f76b2b (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:00:48.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service: Deactivated successfully. 2024-09-21T01:00:48.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:00:48.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service: Consumed 13.182s CPU time. 2024-09-21T01:00:48.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 systemd[1]: Starting Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:00:48.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 podman[109668]: 2024-09-21 01:00:48.442135729 +0000 UTC m=+0.015900788 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:00:48.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 podman[109668]: 2024-09-21 01:00:48.570695762 +0000 UTC m=+0.144460808 container create 090f017cf4b96c73d545a51208d3a3fa82fe7eb2b647ec6aae815bd40f5f0cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 podman[109668]: 2024-09-21 01:00:48.815438598 +0000 UTC m=+0.389203644 container init 090f017cf4b96c73d545a51208d3a3fa82fe7eb2b647ec6aae815bd40f5f0cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 podman[109668]: 2024-09-21 01:00:48.818702452 +0000 UTC m=+0.392467499 container start 090f017cf4b96c73d545a51208d3a3fa82fe7eb2b647ec6aae815bd40f5f0cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: pidfile_write: ignore empty --pid-file 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: load: jerasure load: lrc 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Git sha 0 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:00:49.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: DB SUMMARY 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: DB Session ID: IL9A3NMD2X5XE2FDNLYA 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1507 Bytes 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 1, files: 000032.sst 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000030.log size: 2430499 ; 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.env: 0x55a0ffa66d60 2024-09-21T01:00:49.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:00:49.263 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.info_log: 0x55a104c89580 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.statistics: (nil) 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.use_fsync: 0 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:00:49.264 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.db_log_dir: 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.wal_dir: 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:00:49.265 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.write_buffer_manager: 0x55a104c8dd60 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.unordered_write: 0 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:00:49.266 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.row_cache: None 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.wal_filter: None 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.wal_compression: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:00:49.267 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:00:49.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_open_files: -1 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Compression algorithms supported: 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kZSTD supported: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:00:49.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000015 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.merge_operator: 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_filter: None 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:00:49.270 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a104c891a0) 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 4 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x55a100c4d610 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-09-21T01:00:49.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: bloomfilter 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-09-21T01:00:49.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 5 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_auto_readahead_size: 262144 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: prepopulate_block_cache: 0 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression: NoCompression 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:00:49.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.num_levels: 7 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:00:49.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:00:49.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:00:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:00:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.ttl: 2592000 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:00:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12044, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b7456f3d-c943-41f6-ad4f-916c24447490 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880448856212, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880448865294, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2123249, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12045, "largest_seqno": 13772, "table_properties": {"data_size": 2115096, "index_size": 5123, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1989, "raw_key_size": 18018, "raw_average_key_size": 23, "raw_value_size": 2098612, "raw_average_value_size": 2711, "num_data_blocks": 234, "num_entries": 774, "num_filter_entries": 774, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726880448, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b7456f3d-c943-41f6-ad4f-916c24447490", "db_session_id": "IL9A3NMD2X5XE2FDNLYA", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880448865447, "job": 1, "event": "recovery_finished"} 2024-09-21T01:00:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a104caca80 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: DB pointer 0x55a105a52000 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:00:49.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 1/0 2.02 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 518.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L6 1/0 7.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 2/0 9.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 518.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 518.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 518.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 147.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 147.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache BinnedLRUCache@0x55a100c4d610#2 capacity: 512.00 MB usage: 8.12 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.04 KB,0.00038892%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:00:49.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: starting mon.smithi112 rank 0 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???) e2 preinit fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???).mds e15 new map 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???).mds e15 print_map 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e15 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: 1 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Filesystem 'cephfs' (1) 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: fs_name cephfs 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: epoch 15 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:00:49.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: tableserver 0 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: root 0 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_timeout 60 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_autoclose 300 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_file_size 1099511627776 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_xattr_size 65536 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: required_client_features {} 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure 0 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure_osd_epoch 44 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_mds 1 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: in 0 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: up {0=14598} 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: failed 2024-09-21T01:00:49.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: damaged 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: stopped 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_pools [3] 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_pool 2 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: inline_data enabled 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: balancer 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: bal_rank_mask -1 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: standby_count_wanted 1 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: qdb_cluster leader: 14598 members: 14598 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Standby daemons: 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:49.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 ceph-mon[109687]: mon.smithi112@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 bash[109668]: 090f017cf4b96c73d545a51208d3a3fa82fe7eb2b647ec6aae815bd40f5f0cdd 2024-09-21T01:00:49.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:48 smithi112 systemd[1]: Started Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:00:50.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: mon.smithi112 calling monitor election 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: mon.smithi112 is new leader, mons smithi112,smithi187 in quorum (ranks 0,1) 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: monmap epoch 2 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: last_changed 2024-09-21T00:49:29.446962+0000 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: created 2024-09-21T00:47:12.183691+0000 2024-09-21T01:00:50.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: min_mon_release 19 (squid) 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: election_strategy: 1 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.smithi187 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: mgrmap e33: smithi112.fzmyfw(active, since 3m), standbys: smithi187.hpbgni 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='' 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:50.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:50 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: mon.smithi112 calling monitor election 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: mon.smithi112 is new leader, mons smithi112,smithi187 in quorum (ranks 0,1) 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: monmap epoch 2 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: last_changed 2024-09-21T00:49:29.446962+0000 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: created 2024-09-21T00:47:12.183691+0000 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: min_mon_release 19 (squid) 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: election_strategy: 1 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.smithi187 2024-09-21T01:00:50.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: mgrmap e33: smithi112.fzmyfw(active, since 3m), standbys: smithi187.hpbgni 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='' 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:50.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:50 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:00:52.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:52 smithi187 ceph-mon[34997]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:52 smithi112 ceph-mon[109687]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:54.848 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:54 smithi112 ceph-mon[109687]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:54.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:54 smithi187 ceph-mon[34997]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:56 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:56 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:56 smithi112 ceph-mon[109687]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:56.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:56 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:56.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:56 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:56.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:56 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:56.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:56 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:56.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:56 smithi187 ceph-mon[34997]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:56.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:56 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:56.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:56 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:00:58.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:58 smithi187 ceph-mon[34997]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:58.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:00:58 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:00:59.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:58 smithi112 ceph-mon[109687]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:00:59.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:00:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T01:01:00.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:00 smithi187 ceph-mon[34997]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:01:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T01:01:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T01:01:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T01:01:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T01:01:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:00 smithi112 ceph-mon[109687]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:01 smithi187 ceph-mon[34997]: Upgrade: Updating mon.smithi187 2024-09-21T01:01:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:01 smithi187 ceph-mon[34997]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:01 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T01:01:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:01 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T01:01:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:01 smithi187 ceph-mon[34997]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:01:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:01 smithi187 ceph-mon[34997]: Deploying daemon mon.smithi187 on smithi187 2024-09-21T01:01:02.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:01 smithi112 ceph-mon[109687]: Upgrade: Updating mon.smithi187 2024-09-21T01:01:02.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:01 smithi112 ceph-mon[109687]: from='mgr.24473 ' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T01:01:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T01:01:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T01:01:02.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:01 smithi112 ceph-mon[109687]: Deploying daemon mon.smithi187 on smithi187 2024-09-21T01:01:02.793 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:02 smithi187 systemd[1]: Stopping Ceph mon.smithi187 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:01:03.110 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:02 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187[34993]: 2024-09-21T01:01:02.791+0000 7f49d946e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi187 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:01:03.110 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:02 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187[34993]: 2024-09-21T01:01:02.791+0000 7f49d946e640 -1 mon.smithi187@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T01:01:03.110 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:02 smithi187 podman[78418]: 2024-09-21 01:01:02.823110593 +0000 UTC m=+0.143312814 container died 09a6c459af745c143cf8435dc1e4ca8d6aa49b683526ace5627b66abb672bd8b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, CEPH_POINT_RELEASE=, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:01:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:03 smithi187 podman[78418]: 2024-09-21 01:01:03.20890129 +0000 UTC m=+0.529103516 container cleanup 09a6c459af745c143cf8435dc1e4ca8d6aa49b683526ace5627b66abb672bd8b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:01:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:03 smithi187 bash[78418]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187 2024-09-21T01:01:03.853 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:03 smithi187 podman[78429]: 2024-09-21 01:01:03.460198543 +0000 UTC m=+0.636531242 container remove 09a6c459af745c143cf8435dc1e4ca8d6aa49b683526ace5627b66abb672bd8b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:01:03.853 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:03 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi187.service: Deactivated successfully. 2024-09-21T01:01:03.853 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:03 smithi187 systemd[1]: Stopped Ceph mon.smithi187 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:01:03.853 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:03 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi187.service: Consumed 7.537s CPU time. 2024-09-21T01:01:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:03 smithi187 systemd[1]: Starting Ceph mon.smithi187 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:01:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 podman[78564]: 2024-09-21 01:01:03.964379997 +0000 UTC m=+0.016248840 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:01:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 podman[78564]: 2024-09-21 01:01:04.077876285 +0000 UTC m=+0.129745115 container create e3fc2a18eab40476aec885a3acbd5eaf005dc5b9d85f00040b1d9cdc2193d838 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:01:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 podman[78564]: 2024-09-21 01:01:04.31368592 +0000 UTC m=+0.365554761 container init e3fc2a18eab40476aec885a3acbd5eaf005dc5b9d85f00040b1d9cdc2193d838 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T01:01:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 podman[78564]: 2024-09-21 01:01:04.31682996 +0000 UTC m=+0.368698790 container start e3fc2a18eab40476aec885a3acbd5eaf005dc5b9d85f00040b1d9cdc2193d838 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:01:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: pidfile_write: ignore empty --pid-file 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: load: jerasure load: lrc 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Git sha 0 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: DB SUMMARY 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: DB Session ID: 29XRZQV7226D7W50KE1X 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1400 Bytes 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi187/store.db dir, Total Num: 1, files: 000027.sst 2024-09-21T01:01:04.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi187/store.db: 000025.log size: 4216391 ; 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.env: 0x55b513509d60 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.info_log: 0x55b5185ad580 2024-09-21T01:01:04.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:01:04.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.statistics: (nil) 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.use_fsync: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:01:04.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.db_log_dir: 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.wal_dir: 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.write_buffer_manager: 0x55b5185b1d60 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:01:04.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.unordered_write: 0 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.row_cache: None 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.wal_filter: None 2024-09-21T01:01:04.665 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.wal_compression: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:01:04.666 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:01:04.667 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_open_files: -1 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Compression algorithms supported: 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kZSTD supported: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:01:04.668 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi187/store.db/MANIFEST-000010 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.merge_operator: 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_filter: None 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b5185ad1a0) 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:01:04.669 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: index_type: 0 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: data_block_index_type: 0 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: index_shortening: 1 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: checksum: 4 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: no_block_cache: 0 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache: 0x55b514571610 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache_options: 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: capacity : 536870912 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: num_shard_bits : 4 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: strict_capacity_limit : 0 2024-09-21T01:01:04.670 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_cache_compressed: (nil) 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: persistent_cache: (nil) 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_size: 4096 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_size_deviation: 10 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_restart_interval: 16 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: index_block_restart_interval: 1 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: metadata_block_size: 4096 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: partition_filters: 0 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: use_delta_encoding: 1 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: filter_policy: bloomfilter 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: whole_key_filtering: 1 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: verify_compression: 0 2024-09-21T01:01:04.671 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: format_version: 5 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: enable_index_compression: 1 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: block_align: 0 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: max_auto_readahead_size: 262144 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: prepopulate_block_cache: 0 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression: NoCompression 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.num_levels: 7 2024-09-21T01:01:04.672 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:01:04.673 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:01:04.674 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:01:04.675 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:01:04.676 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.ttl: 2592000 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:01:04.677 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi187/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12234, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b3c6305f-4e4e-49c1-ab98-004a8587f297 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880464353246, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880464365044, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2436082, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12239, "largest_seqno": 14422, "table_properties": {"data_size": 2426962, "index_size": 5834, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2245, "raw_key_size": 20475, "raw_average_key_size": 23, "raw_value_size": 2408215, "raw_average_value_size": 2742, "num_data_blocks": 266, "num_entries": 878, "num_filter_entries": 878, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726880464, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b3c6305f-4e4e-49c1-ab98-004a8587f297", "db_session_id": "29XRZQV7226D7W50KE1X", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880464365165, "job": 1, "event": "recovery_finished"} 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi187/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:01:04.678 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b5185d0a80 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: DB pointer 0x55b519376000 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** DB Stats ** 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** Compaction Stats [default] ** 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:01:04.679 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: L0 1/0 2.32 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 558.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: L6 1/0 7.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Sum 2/0 9.65 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 558.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 558.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** Compaction Stats [default] ** 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 558.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:01:04.680 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Cumulative compaction: 0.00 GB write, 161.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Interval compaction: 0.00 GB write, 161.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Block cache BinnedLRUCache@0x55b514571610#2 capacity: 512.00 MB usage: 8.37 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.29 KB,0.000436604%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: starting mon.smithi187 rank 1 at public addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] at bind addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi187 fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???) e2 preinit fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???).mds e15 new map 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???).mds e15 print_map 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: e15 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:01:04.681 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: legacy client fscid: 1 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Filesystem 'cephfs' (1) 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: fs_name cephfs 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: epoch 15 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: tableserver 0 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: root 0 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: session_timeout 60 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: session_autoclose 300 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: max_file_size 1099511627776 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: max_xattr_size 65536 2024-09-21T01:01:04.682 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: required_client_features {} 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: last_failure 0 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: last_failure_osd_epoch 44 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: max_mds 1 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: in 0 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: up {0=14598} 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: failed 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: damaged 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: stopped 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: data_pools [3] 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: metadata_pool 2 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: inline_data enabled 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: balancer 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: bal_rank_mask -1 2024-09-21T01:01:04.683 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: standby_count_wanted 1 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: qdb_cluster leader: 14598 members: 14598 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: [mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: Standby daemons: 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: [mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: [mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout: [mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 ceph-mon[78584]: mon.smithi187@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 bash[78564]: e3fc2a18eab40476aec885a3acbd5eaf005dc5b9d85f00040b1d9cdc2193d838 2024-09-21T01:01:04.684 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:04 smithi187 systemd[1]: Started Ceph mon.smithi187 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:01:05.925 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:05 smithi187 ceph-mon[78584]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:05.925 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mon metadata", "id": "smithi112"} : dispatch 2024-09-21T01:01:05.926 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mon metadata", "id": "smithi187"} : dispatch 2024-09-21T01:01:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:05 smithi112 ceph-mon[109687]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mon metadata", "id": "smithi112"} : dispatch 2024-09-21T01:01:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mon metadata", "id": "smithi187"} : dispatch 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: mon.smithi187 calling monitor election 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: mon.smithi112 calling monitor election 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: mon.smithi112 is new leader, mons smithi112,smithi187 in quorum (ranks 0,1) 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: monmap epoch 2 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:01:07.254 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: last_changed 2024-09-21T00:49:29.446962+0000 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: created 2024-09-21T00:47:12.183691+0000 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: min_mon_release 19 (squid) 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: election_strategy: 1 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.smithi187 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: mgrmap e33: smithi112.fzmyfw(active, since 3m), standbys: smithi187.hpbgni 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:07.255 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T01:01:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T01:01:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: mon.smithi187 calling monitor election 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: mon.smithi112 calling monitor election 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: mon.smithi112 is new leader, mons smithi112,smithi187 in quorum (ranks 0,1) 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: monmap epoch 2 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: last_changed 2024-09-21T00:49:29.446962+0000 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: created 2024-09-21T00:47:12.183691+0000 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: min_mon_release 19 (squid) 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: election_strategy: 1 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.smithi187 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: mgrmap e33: smithi112.fzmyfw(active, since 3m), standbys: smithi187.hpbgni 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:01:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:01:07.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:01:07.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:07.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:07.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:09.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:08 smithi112 ceph-mon[109687]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:09.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:09.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:09.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:08 smithi187 ceph-mon[78584]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:09.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:09.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:10.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:10.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:10 smithi187 ceph-mon[78584]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:10.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:10 smithi112 ceph-mon[109687]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:12 smithi187 ceph-mon[78584]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:12 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:12 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:12 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:12 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:12 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:12 smithi112 ceph-mon[109687]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:12 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:12 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:12 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:12 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:12 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all mon 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"} : dispatch 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-09-21T01:01:13.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi187"} : dispatch 2024-09-21T01:01:13.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi187"}]': finished 2024-09-21T01:01:13.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all mon 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"} : dispatch 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi187"} : dispatch 2024-09-21T01:01:13.996 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi187"}]': finished 2024-09-21T01:01:13.997 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 -- 172.21.15.112:0/673309832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 msgr2=0x7f925010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 --2- 172.21.15.112:0/673309832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925010b8f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f924c009880 tx=0x7f924c02a530 comp rx=0 tx=0).stop 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 -- 172.21.15.112:0/673309832 shutdown_connections 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 --2- 172.21.15.112:0/673309832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925010b8f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 --2- 172.21.15.112:0/673309832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9250102ae0 0x7f9250102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 -- 172.21.15.112:0/673309832 >> 172.21.15.112:0/673309832 conn(0x7f92500fc520 msgr2=0x7f92500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 -- 172.21.15.112:0/673309832 shutdown_connections 2024-09-21T01:01:15.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.014+0000 7f9257721640 1 -- 172.21.15.112:0/673309832 wait complete. 2024-09-21T01:01:15.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.015+0000 7f9257721640 1 Processor -- start 2024-09-21T01:01:15.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.015+0000 7f9257721640 1 -- start start 2024-09-21T01:01:15.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.015+0000 7f9257721640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9250102ae0 0x7f925019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.015+0000 7f9257721640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.015+0000 7f9257721640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f925010ee70 con 0x7f9250103400 2024-09-21T01:01:15.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.015+0000 7f9257721640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f925010ecf0 con 0x7f9250102ae0 2024-09-21T01:01:15.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9254cbc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9254cbc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47710/0 (socket says 172.21.15.112:47710) 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9254cbc640 1 -- 172.21.15.112:0/4124217326 learned_addr learned my addr 172.21.15.112:0/4124217326 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f92554bd640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9250102ae0 0x7f925019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9254cbc640 1 -- 172.21.15.112:0/4124217326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9250102ae0 msgr2=0x7f925019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9254cbc640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9250102ae0 0x7f925019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9254cbc640 1 -- 172.21.15.112:0/4124217326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9250197880 con 0x7f9250103400 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9254cbc640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925019dc00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f924c031460 tx=0x7f924c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f92467fc640 1 -- 172.21.15.112:0/4124217326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f924c03f070 con 0x7f9250103400 2024-09-21T01:01:15.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f92467fc640 1 -- 172.21.15.112:0/4124217326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f924c004ac0 con 0x7f9250103400 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9250197b10 con 0x7f9250103400 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f92467fc640 1 -- 172.21.15.112:0/4124217326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f924c035030 con 0x7f9250103400 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.016+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9250198040 con 0x7f9250103400 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.017+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925006abe0 con 0x7f9250103400 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.018+0000 7f92467fc640 1 -- 172.21.15.112:0/4124217326 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f924c042070 con 0x7f9250103400 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.019+0000 7f92467fc640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f923c07af30 0x7f923c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.019+0000 7f92467fc640 1 -- 172.21.15.112:0/4124217326 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f924c0beab0 con 0x7f9250103400 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.019+0000 7f92554bd640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f923c07af30 0x7f923c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.019+0000 7f92554bd640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f923c07af30 0x7f923c07d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92501989c0 tx=0x7f9240008040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.024+0000 7f92467fc640 1 -- 172.21.15.112:0/4124217326 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f924c08a0b0 con 0x7f9250103400 2024-09-21T01:01:15.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.219+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9250198db0 con 0x7f923c07af30 2024-09-21T01:01:15.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.220+0000 7f92467fc640 1 -- 172.21.15.112:0/4124217326 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f9250198db0 con 0x7f923c07af30 2024-09-21T01:01:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.222+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f923c07af30 msgr2=0x7f923c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.222+0000 7f9257721640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f923c07af30 0x7f923c07d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92501989c0 tx=0x7f9240008040 comp rx=0 tx=0).stop 2024-09-21T01:01:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.222+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 msgr2=0x7f925019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.222+0000 7f9257721640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925019dc00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f924c031460 tx=0x7f924c0046c0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.223+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 shutdown_connections 2024-09-21T01:01:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.223+0000 7f9257721640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f923c07af30 0x7f923c07d3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.223+0000 7f9257721640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9250103400 0x7f925019dc00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.223+0000 7f9257721640 1 --2- 172.21.15.112:0/4124217326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9250102ae0 0x7f925019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.223+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 >> 172.21.15.112:0/4124217326 conn(0x7f92500fc520 msgr2=0x7f9250108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.223+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 shutdown_connections 2024-09-21T01:01:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.223+0000 7f9257721640 1 -- 172.21.15.112:0/4124217326 wait complete. 2024-09-21T01:01:15.232 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:01:15.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 -- 172.21.15.112:0/2384680541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 msgr2=0x7f0c64100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/2384680541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c64100c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009880 tx=0x7f0c5802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 -- 172.21.15.112:0/2384680541 shutdown_connections 2024-09-21T01:01:15.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/2384680541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c64100c40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/2384680541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c641067e0 0x7f0c64106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 -- 172.21.15.112:0/2384680541 >> 172.21.15.112:0/2384680541 conn(0x7f0c640fc4c0 msgr2=0x7f0c640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:15.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 -- 172.21.15.112:0/2384680541 shutdown_connections 2024-09-21T01:01:15.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 -- 172.21.15.112:0/2384680541 wait complete. 2024-09-21T01:01:15.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:15 smithi112 ceph-mon[109687]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:15.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:15 smithi112 ceph-mon[109687]: Upgrade: Updating crash.smithi112 (1/2) 2024-09-21T01:01:15.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:15 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:15.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:15 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T01:01:15.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:15 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:15.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:15 smithi112 ceph-mon[109687]: Deploying daemon crash.smithi112 on smithi112 2024-09-21T01:01:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.305+0000 7f0c69bd5640 1 Processor -- start 2024-09-21T01:01:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c69bd5640 1 -- start start 2024-09-21T01:01:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c69bd5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c640fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c69bd5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c641067e0 0x7f0c640fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c69bd5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6410dcb0 con 0x7f0c641007e0 2024-09-21T01:01:15.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c69bd5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6410db30 con 0x7f0c641067e0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c637fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c640fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c637fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c640fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47728/0 (socket says 172.21.15.112:47728) 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c637fe640 1 -- 172.21.15.112:0/387516252 learned_addr learned my addr 172.21.15.112:0/387516252 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c62ffd640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c641067e0 0x7f0c640fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c637fe640 1 -- 172.21.15.112:0/387516252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c641067e0 msgr2=0x7f0c640fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c637fe640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c641067e0 0x7f0c640fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c637fe640 1 -- 172.21.15.112:0/387516252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c640fd690 con 0x7f0c641007e0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.306+0000 7f0c637fe640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c640fcc10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400c8f0 tx=0x7f0c5400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.307+0000 7f0c60ff9640 1 -- 172.21.15.112:0/387516252 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c540079b0 con 0x7f0c641007e0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.307+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c640fd980 con 0x7f0c641007e0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.307+0000 7f0c60ff9640 1 -- 172.21.15.112:0/387516252 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c540054e0 con 0x7f0c641007e0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.307+0000 7f0c60ff9640 1 -- 172.21.15.112:0/387516252 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c54004dd0 con 0x7f0c641007e0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.307+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c641a3eb0 con 0x7f0c641007e0 2024-09-21T01:01:15.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.308+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c64101f20 con 0x7f0c641007e0 2024-09-21T01:01:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.308+0000 7f0c60ff9640 1 -- 172.21.15.112:0/387516252 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0c54005020 con 0x7f0c641007e0 2024-09-21T01:01:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.309+0000 7f0c60ff9640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0c4c07aed0 0x7f0c4c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.309+0000 7f0c60ff9640 1 -- 172.21.15.112:0/387516252 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f0c5409df90 con 0x7f0c641007e0 2024-09-21T01:01:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.309+0000 7f0c62ffd640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0c4c07aed0 0x7f0c4c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.309+0000 7f0c62ffd640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0c4c07aed0 0x7f0c4c07d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c640fe6a0 tx=0x7f0c58031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.314+0000 7f0c60ff9640 1 -- 172.21.15.112:0/387516252 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c54014030 con 0x7f0c641007e0 2024-09-21T01:01:15.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:15 smithi187 ceph-mon[78584]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:15.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:15 smithi187 ceph-mon[78584]: Upgrade: Updating crash.smithi112 (1/2) 2024-09-21T01:01:15.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:15 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:15.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:15 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T01:01:15.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:15 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:15.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:15 smithi187 ceph-mon[78584]: Deploying daemon crash.smithi112 on smithi112 2024-09-21T01:01:15.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.526+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0c64062630 con 0x7f0c4c07aed0 2024-09-21T01:01:15.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.527+0000 7f0c60ff9640 1 -- 172.21.15.112:0/387516252 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f0c64062630 con 0x7f0c4c07aed0 2024-09-21T01:01:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0c4c07aed0 msgr2=0x7f0c4c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0c4c07aed0 0x7f0c4c07d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c640fe6a0 tx=0x7f0c58031400 comp rx=0 tx=0).stop 2024-09-21T01:01:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 msgr2=0x7f0c640fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c640fcc10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400c8f0 tx=0x7f0c5400cdb0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 shutdown_connections 2024-09-21T01:01:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0c4c07aed0 0x7f0c4c07d390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c641067e0 0x7f0c640fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 --2- 172.21.15.112:0/387516252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c641007e0 0x7f0c640fcc10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.529+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 >> 172.21.15.112:0/387516252 conn(0x7f0c640fc4c0 msgr2=0x7f0c64069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.530+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 shutdown_connections 2024-09-21T01:01:15.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.530+0000 7f0c69bd5640 1 -- 172.21.15.112:0/387516252 wait complete. 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/3691813317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100890 msgr2=0x7f4bcc100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/3691813317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100890 0x7f4bcc100c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009c20 tx=0x7f4bc402aa00 comp rx=0 tx=0).stop 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/3691813317 shutdown_connections 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/3691813317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc1011b0 0x7f4bcc105680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/3691813317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc100890 0x7f4bcc100c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/3691813317 >> 172.21.15.112:0/3691813317 conn(0x7f4bcc0fc4c0 msgr2=0x7f4bcc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/3691813317 shutdown_connections 2024-09-21T01:01:15.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.619+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/3691813317 wait complete. 2024-09-21T01:01:15.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.620+0000 7f4bd0fa4640 1 Processor -- start 2024-09-21T01:01:15.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.620+0000 7f4bd0fa4640 1 -- start start 2024-09-21T01:01:15.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bd0fa4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc100890 0x7f4bcc19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bd0fa4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1011b0 0x7f4bcc19e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bd0fa4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc1153b0 con 0x7f4bcc1011b0 2024-09-21T01:01:15.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bd0fa4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc115230 con 0x7f4bcc100890 2024-09-21T01:01:15.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bc9d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1011b0 0x7f4bcc19e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bc9d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1011b0 0x7f4bcc19e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47740/0 (socket says 172.21.15.112:47740) 2024-09-21T01:01:15.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bc9d9b640 1 -- 172.21.15.112:0/2598833783 learned_addr learned my addr 172.21.15.112:0/2598833783 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bca59c640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc100890 0x7f4bcc19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bc9d9b640 1 -- 172.21.15.112:0/2598833783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc100890 msgr2=0x7f4bcc19df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bc9d9b640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc100890 0x7f4bcc19df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.621+0000 7f4bc9d9b640 1 -- 172.21.15.112:0/2598833783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc1a2840 con 0x7f4bcc1011b0 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.622+0000 7f4bc9d9b640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1011b0 0x7f4bcc19e4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00d8d0 tx=0x7f4bbc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.622+0000 7f4bbb7fe640 1 -- 172.21.15.112:0/2598833783 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc017030 con 0x7f4bcc1011b0 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.622+0000 7f4bbb7fe640 1 -- 172.21.15.112:0/2598833783 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bbc00be10 con 0x7f4bcc1011b0 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.622+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc1a2b30 con 0x7f4bcc1011b0 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.622+0000 7f4bbb7fe640 1 -- 172.21.15.112:0/2598833783 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc005580 con 0x7f4bcc1011b0 2024-09-21T01:01:15.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.622+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc1a30c0 con 0x7f4bcc1011b0 2024-09-21T01:01:15.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.623+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bcc06a410 con 0x7f4bcc1011b0 2024-09-21T01:01:15.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.624+0000 7f4bbb7fe640 1 -- 172.21.15.112:0/2598833783 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4bbc004020 con 0x7f4bcc1011b0 2024-09-21T01:01:15.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.624+0000 7f4bbb7fe640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4bb407af40 0x7f4bb407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.624+0000 7f4bca59c640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4bb407af40 0x7f4bb407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.625+0000 7f4bbb7fe640 1 -- 172.21.15.112:0/2598833783 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f4bbc018070 con 0x7f4bcc1011b0 2024-09-21T01:01:15.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.625+0000 7f4bca59c640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4bb407af40 0x7f4bb407d400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009430 tx=0x7f4bc403a040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.630+0000 7f4bbb7fe640 1 -- 172.21.15.112:0/2598833783 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4bbc0692d0 con 0x7f4bcc1011b0 2024-09-21T01:01:15.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.830+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4bcc1a33e0 con 0x7f4bb407af40 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.839+0000 7f4bbb7fe640 1 -- 172.21.15.112:0/2598833783 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4bcc1a33e0 con 0x7f4bb407af40 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (106s) 20s ago 12m 19.7M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (4m) 20s ago 12m 8682k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (4m) 7s ago 12m 8288k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (12m) 20s ago 12m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ed5b18e61755 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (11m) 7s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 3667e483e812 2024-09-21T01:01:15.840 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (84s) 20s ago 12m 77.9M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (7m) 20s ago 7m 151M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (7m) 20s ago 7m 16.3M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (7m) 7s ago 7m 19.9M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (7m) 7s ago 7m 18.1M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (3m) 20s ago 13m 590M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (2m) 7s ago 11m 522M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (27s) 20s ago 14m 90.9M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (11s) 7s ago 11m 87.8M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (2m) 20s ago 12m 9403k - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (2m) 7s ago 11m 11.8M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (10m) 20s ago 10m 205M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 5b2cb1078936 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (10m) 20s ago 10m 221M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (9m) 20s ago 9m 176M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (9m) 7s ago 9m 254M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (8m) 7s ago 8m 206M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:01:15.841 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (8m) 7s ago 8m 191M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:01:15.842 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (2m) 20s ago 12m 49.4M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:01:15.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.841+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4bb407af40 msgr2=0x7f4bb407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.841+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4bb407af40 0x7f4bb407d400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009430 tx=0x7f4bc403a040 comp rx=0 tx=0).stop 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.841+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1011b0 msgr2=0x7f4bcc19e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.841+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1011b0 0x7f4bcc19e4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00d8d0 tx=0x7f4bbc00dd90 comp rx=0 tx=0).stop 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.842+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 shutdown_connections 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.842+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4bb407af40 0x7f4bb407d400 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.842+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bcc1011b0 0x7f4bcc19e4b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.842+0000 7f4bd0fa4640 1 --2- 172.21.15.112:0/2598833783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc100890 0x7f4bcc19df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.842+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 >> 172.21.15.112:0/2598833783 conn(0x7f4bcc0fc4c0 msgr2=0x7f4bcc112ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.842+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 shutdown_connections 2024-09-21T01:01:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.842+0000 7f4bd0fa4640 1 -- 172.21.15.112:0/2598833783 wait complete. 2024-09-21T01:01:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 -- 172.21.15.112:0/374770767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 msgr2=0x7f41f4101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 --2- 172.21.15.112:0/374770767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f4101d50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009880 tx=0x7f41dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 -- 172.21.15.112:0/374770767 shutdown_connections 2024-09-21T01:01:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 --2- 172.21.15.112:0/374770767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f4101d50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 --2- 172.21.15.112:0/374770767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41f41078f0 0x7f41f4107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 -- 172.21.15.112:0/374770767 >> 172.21.15.112:0/374770767 conn(0x7f41f40fd630 msgr2=0x7f41f40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 -- 172.21.15.112:0/374770767 shutdown_connections 2024-09-21T01:01:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.927+0000 7f41fa710640 1 -- 172.21.15.112:0/374770767 wait complete. 2024-09-21T01:01:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41fa710640 1 Processor -- start 2024-09-21T01:01:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41fa710640 1 -- start start 2024-09-21T01:01:15.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41fa710640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41fa710640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41f41078f0 0x7f41f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41fa710640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f41f410eda0 con 0x7f41f41018f0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41fa710640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f41f410ec20 con 0x7f41f41078f0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47748/0 (socket says 172.21.15.112:47748) 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41f3fff640 1 -- 172.21.15.112:0/1796705471 learned_addr learned my addr 172.21.15.112:0/1796705471 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41ebfff640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41f41078f0 0x7f41f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41f3fff640 1 -- 172.21.15.112:0/1796705471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41f41078f0 msgr2=0x7f41f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41f3fff640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41f41078f0 0x7f41f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.928+0000 7f41f3fff640 1 -- 172.21.15.112:0/1796705471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f4074f70 con 0x7f41f41018f0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.929+0000 7f41f3fff640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f40744f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f41e400d8d0 tx=0x7f41e400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.929+0000 7f41f1ffb640 1 -- 172.21.15.112:0/1796705471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41e4017030 con 0x7f41f41018f0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.929+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f4075260 con 0x7f41f41018f0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.929+0000 7f41f1ffb640 1 -- 172.21.15.112:0/1796705471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41e4004020 con 0x7f41f41018f0 2024-09-21T01:01:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.929+0000 7f41f1ffb640 1 -- 172.21.15.112:0/1796705471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41e40047a0 con 0x7f41f41018f0 2024-09-21T01:01:15.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.929+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f41a3e30 con 0x7f41f41018f0 2024-09-21T01:01:15.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.930+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f4103030 con 0x7f41f41018f0 2024-09-21T01:01:15.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.930+0000 7f41f1ffb640 1 -- 172.21.15.112:0/1796705471 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f41e40041d0 con 0x7f41f41018f0 2024-09-21T01:01:15.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.931+0000 7f41f1ffb640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e007af30 0x7f41e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:15.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.931+0000 7f41f1ffb640 1 -- 172.21.15.112:0/1796705471 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f41e4018070 con 0x7f41f41018f0 2024-09-21T01:01:15.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.931+0000 7f41ebfff640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e007af30 0x7f41e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:15.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.932+0000 7f41ebfff640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e007af30 0x7f41e007d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41f4075f80 tx=0x7f41dc031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:15.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:15.936+0000 7f41f1ffb640 1 -- 172.21.15.112:0/1796705471 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41e4069430 con 0x7f41f41018f0 2024-09-21T01:01:16.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:16 smithi112 ceph-mon[109687]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:16.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.188+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f41f4109e80 con 0x7f41f41018f0 2024-09-21T01:01:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.189+0000 7f41f1ffb640 1 -- 172.21.15.112:0/1796705471 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f41e406e2e0 con 0x7f41f41018f0 2024-09-21T01:01:16.190 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:01:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:01:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:01:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:16.190 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 10, 2024-09-21T01:01:16.191 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 4 2024-09-21T01:01:16.192 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:01:16.192 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e007af30 msgr2=0x7f41e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e007af30 0x7f41e007d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41f4075f80 tx=0x7f41dc031400 comp rx=0 tx=0).stop 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 msgr2=0x7f41f40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f40744f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f41e400d8d0 tx=0x7f41e400dd90 comp rx=0 tx=0).stop 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 shutdown_connections 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e007af30 0x7f41e007d3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41f41078f0 0x7f41f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 --2- 172.21.15.112:0/1796705471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41f41018f0 0x7f41f40744f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 >> 172.21.15.112:0/1796705471 conn(0x7f41f40fd630 msgr2=0x7f41f40fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 shutdown_connections 2024-09-21T01:01:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.191+0000 7f41fa710640 1 -- 172.21.15.112:0/1796705471 wait complete. 2024-09-21T01:01:16.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 -- 172.21.15.112:0/2783943281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 msgr2=0x7f67e01005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 --2- 172.21.15.112:0/2783943281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e01005c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009880 tx=0x7f67d002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 -- 172.21.15.112:0/2783943281 shutdown_connections 2024-09-21T01:01:16.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 --2- 172.21.15.112:0/2783943281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67e0100b90 0x7f67e0104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 --2- 172.21.15.112:0/2783943281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e01005c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 -- 172.21.15.112:0/2783943281 >> 172.21.15.112:0/2783943281 conn(0x7f67e00fbc40 msgr2=0x7f67e00fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 -- 172.21.15.112:0/2783943281 shutdown_connections 2024-09-21T01:01:16.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.274+0000 7f67e54d4640 1 -- 172.21.15.112:0/2783943281 wait complete. 2024-09-21T01:01:16.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67e54d4640 1 Processor -- start 2024-09-21T01:01:16.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67e54d4640 1 -- start start 2024-09-21T01:01:16.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67e54d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67e54d4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67e0100b90 0x7f67e019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67e54d4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f67e010d4c0 con 0x7f67e01001e0 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67e54d4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f67e010d340 con 0x7f67e0100b90 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67deffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67deffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47762/0 (socket says 172.21.15.112:47762) 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67deffd640 1 -- 172.21.15.112:0/3271617622 learned_addr learned my addr 172.21.15.112:0/3271617622 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.275+0000 7f67de7fc640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67e0100b90 0x7f67e019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67deffd640 1 -- 172.21.15.112:0/3271617622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67e0100b90 msgr2=0x7f67e019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67deffd640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67e0100b90 0x7f67e019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67deffd640 1 -- 172.21.15.112:0/3271617622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e0197880 con 0x7f67e01001e0 2024-09-21T01:01:16.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67deffd640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e019d6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67d0031460 tx=0x7f67d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67c7fff640 1 -- 172.21.15.112:0/3271617622 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67d003f070 con 0x7f67e01001e0 2024-09-21T01:01:16.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67c7fff640 1 -- 172.21.15.112:0/3271617622 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67d0004cf0 con 0x7f67e01001e0 2024-09-21T01:01:16.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e0197b10 con 0x7f67e01001e0 2024-09-21T01:01:16.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67c7fff640 1 -- 172.21.15.112:0/3271617622 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67d0035030 con 0x7f67e01001e0 2024-09-21T01:01:16.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.276+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e0198040 con 0x7f67e01001e0 2024-09-21T01:01:16.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.277+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e01016c0 con 0x7f67e01001e0 2024-09-21T01:01:16.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.278+0000 7f67c7fff640 1 -- 172.21.15.112:0/3271617622 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f67d0042070 con 0x7f67e01001e0 2024-09-21T01:01:16.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.278+0000 7f67c7fff640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c807af30 0x7f67c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.278+0000 7f67c7fff640 1 -- 172.21.15.112:0/3271617622 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f67d00bea90 con 0x7f67e01001e0 2024-09-21T01:01:16.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.278+0000 7f67de7fc640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c807af30 0x7f67c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.279+0000 7f67de7fc640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c807af30 0x7f67c807d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67e00fdc40 tx=0x7f67d4009110 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.283+0000 7f67c7fff640 1 -- 172.21.15.112:0/3271617622 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67d008a090 con 0x7f67e01001e0 2024-09-21T01:01:16.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:16 smithi187 ceph-mon[78584]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.505+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f67e0198db0 con 0x7f67e01001e0 2024-09-21T01:01:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.506+0000 7f67c7fff640 1 -- 172.21.15.112:0/3271617622 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7f67d008ef40 con 0x7f67e01001e0 2024-09-21T01:01:16.507 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:01:16.507 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:01:16.507 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:01:16.507 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:01:16.508 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:01:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:16.511 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:01:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:16.511 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:16.511 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:16.511 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c807af30 msgr2=0x7f67c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c807af30 0x7f67c807d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67e00fdc40 tx=0x7f67d4009110 comp rx=0 tx=0).stop 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 msgr2=0x7f67e019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e019d6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67d0031460 tx=0x7f67d00048f0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 shutdown_connections 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c807af30 0x7f67c807d3f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67e0100b90 0x7f67e019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 --2- 172.21.15.112:0/3271617622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67e01001e0 0x7f67e019d6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 >> 172.21.15.112:0/3271617622 conn(0x7f67e00fbc40 msgr2=0x7f67e0103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 shutdown_connections 2024-09-21T01:01:16.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.508+0000 7f67e54d4640 1 -- 172.21.15.112:0/3271617622 wait complete. 2024-09-21T01:01:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.594+0000 7f0b92619640 1 -- 172.21.15.112:0/3176358285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c106a20 msgr2=0x7f0b8c106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.594+0000 7f0b92619640 1 --2- 172.21.15.112:0/3176358285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c106a20 0x7f0b8c106e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009880 tx=0x7f0b7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.595+0000 7f0b92619640 1 -- 172.21.15.112:0/3176358285 shutdown_connections 2024-09-21T01:01:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.595+0000 7f0b92619640 1 --2- 172.21.15.112:0/3176358285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8c100f40 0x7f0b8c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.595+0000 7f0b92619640 1 --2- 172.21.15.112:0/3176358285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c106a20 0x7f0b8c106e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.595+0000 7f0b92619640 1 -- 172.21.15.112:0/3176358285 >> 172.21.15.112:0/3176358285 conn(0x7f0b8c0fbc40 msgr2=0x7f0b8c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.595+0000 7f0b92619640 1 -- 172.21.15.112:0/3176358285 shutdown_connections 2024-09-21T01:01:16.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.595+0000 7f0b92619640 1 -- 172.21.15.112:0/3176358285 wait complete. 2024-09-21T01:01:16.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b92619640 1 Processor -- start 2024-09-21T01:01:16.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b92619640 1 -- start start 2024-09-21T01:01:16.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b92619640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c100f40 0x7f0b8c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b92619640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8c106a20 0x7f0b8c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b92619640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c10df50 con 0x7f0b8c100f40 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b92619640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8c10ddd0 con 0x7f0b8c106a20 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c100f40 0x7f0b8c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c100f40 0x7f0b8c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47780/0 (socket says 172.21.15.112:47780) 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.596+0000 7f0b8bfff640 1 -- 172.21.15.112:0/3936504040 learned_addr learned my addr 172.21.15.112:0/3936504040 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b8b7fe640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8c106a20 0x7f0b8c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b8bfff640 1 -- 172.21.15.112:0/3936504040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8c106a20 msgr2=0x7f0b8c198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b8bfff640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8c106a20 0x7f0b8c198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b8bfff640 1 -- 172.21.15.112:0/3936504040 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8c1995c0 con 0x7f0b8c100f40 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b8bfff640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c100f40 0x7f0b8c198a80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c031460 tx=0x7f0b7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b897fa640 1 -- 172.21.15.112:0/3936504040 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b7c03f070 con 0x7f0b8c100f40 2024-09-21T01:01:16.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8c199850 con 0x7f0b8c100f40 2024-09-21T01:01:16.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b897fa640 1 -- 172.21.15.112:0/3936504040 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b7c004cf0 con 0x7f0b8c100f40 2024-09-21T01:01:16.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b897fa640 1 -- 172.21.15.112:0/3936504040 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b7c035030 con 0x7f0b8c100f40 2024-09-21T01:01:16.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.597+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b8c1a1e00 con 0x7f0b8c100f40 2024-09-21T01:01:16.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.599+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8c102160 con 0x7f0b8c100f40 2024-09-21T01:01:16.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.599+0000 7f0b897fa640 1 -- 172.21.15.112:0/3936504040 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0b7c042070 con 0x7f0b8c100f40 2024-09-21T01:01:16.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.600+0000 7f0b897fa640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0b7807af80 0x7f0b7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.600+0000 7f0b897fa640 1 -- 172.21.15.112:0/3936504040 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f0b7c0be9e0 con 0x7f0b8c100f40 2024-09-21T01:01:16.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.600+0000 7f0b8b7fe640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0b7807af80 0x7f0b7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.601+0000 7f0b8b7fe640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0b7807af80 0x7f0b7807d440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c100980 tx=0x7f0b74008040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.605+0000 7f0b897fa640 1 -- 172.21.15.112:0/3936504040 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b7c08a060 con 0x7f0b8c100f40 2024-09-21T01:01:16.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.821+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0b8c06a0e0 con 0x7f0b7807af80 2024-09-21T01:01:16.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.822+0000 7f0b897fa640 1 -- 172.21.15.112:0/3936504040 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f0b8c06a0e0 con 0x7f0b7807af80 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "4/23 daemons upgraded", 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading crash daemons", 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:01:16.823 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:01:16.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0b7807af80 msgr2=0x7f0b7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0b7807af80 0x7f0b7807d440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c100980 tx=0x7f0b74008040 comp rx=0 tx=0).stop 2024-09-21T01:01:16.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c100f40 msgr2=0x7f0b8c198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c100f40 0x7f0b8c198a80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c031460 tx=0x7f0b7c0048f0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 shutdown_connections 2024-09-21T01:01:16.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0b7807af80 0x7f0b7807d440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8c106a20 0x7f0b8c198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 --2- 172.21.15.112:0/3936504040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b8c100f40 0x7f0b8c198a80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 >> 172.21.15.112:0/3936504040 conn(0x7f0b8c0fbc40 msgr2=0x7f0b8c0fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 shutdown_connections 2024-09-21T01:01:16.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.824+0000 7f0b92619640 1 -- 172.21.15.112:0/3936504040 wait complete. 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.914+0000 7f3c958b4640 1 -- 172.21.15.112:0/3300388402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c901033c0 msgr2=0x7f3c9010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.914+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3300388402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c901033c0 0x7f3c9010b8b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009880 tx=0x7f3c7802a530 comp rx=0 tx=0).stop 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 -- 172.21.15.112:0/3300388402 shutdown_connections 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3300388402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c901033c0 0x7f3c9010b8b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3300388402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c90102aa0 0x7f3c90102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 -- 172.21.15.112:0/3300388402 >> 172.21.15.112:0/3300388402 conn(0x7f3c900fc4c0 msgr2=0x7f3c900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 -- 172.21.15.112:0/3300388402 shutdown_connections 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 -- 172.21.15.112:0/3300388402 wait complete. 2024-09-21T01:01:16.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 Processor -- start 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.915+0000 7f3c958b4640 1 -- start start 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c958b4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c90102aa0 0x7f3c9019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c958b4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c901033c0 0x7f3c9019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c958b4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9010edd0 con 0x7f3c90102aa0 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c958b4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9010ec50 con 0x7f3c901033c0 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c90102aa0 0x7f3c9019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c90102aa0 0x7f3c9019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47798/0 (socket says 172.21.15.112:47798) 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8effd640 1 -- 172.21.15.112:0/3417361872 learned_addr learned my addr 172.21.15.112:0/3417361872 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8e7fc640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c901033c0 0x7f3c9019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8effd640 1 -- 172.21.15.112:0/3417361872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c901033c0 msgr2=0x7f3c9019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8effd640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c901033c0 0x7f3c9019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8effd640 1 -- 172.21.15.112:0/3417361872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c90197800 con 0x7f3c90102aa0 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.916+0000 7f3c8effd640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c90102aa0 0x7f3c9019d680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000e970 tx=0x7f3c8000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.917+0000 7f3c948b2640 1 -- 172.21.15.112:0/3417361872 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c8000cac0 con 0x7f3c90102aa0 2024-09-21T01:01:16.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.917+0000 7f3c948b2640 1 -- 172.21.15.112:0/3417361872 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c800054e0 con 0x7f3c90102aa0 2024-09-21T01:01:16.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.917+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c90197af0 con 0x7f3c90102aa0 2024-09-21T01:01:16.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.917+0000 7f3c948b2640 1 -- 172.21.15.112:0/3417361872 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c80010430 con 0x7f3c90102aa0 2024-09-21T01:01:16.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.917+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c90198050 con 0x7f3c90102aa0 2024-09-21T01:01:16.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.918+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9006a410 con 0x7f3c90102aa0 2024-09-21T01:01:16.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.918+0000 7f3c948b2640 1 -- 172.21.15.112:0/3417361872 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3c80004f00 con 0x7f3c90102aa0 2024-09-21T01:01:16.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.919+0000 7f3c948b2640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:16.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.919+0000 7f3c948b2640 1 -- 172.21.15.112:0/3417361872 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6156+0+0 (secure 0 0 0) 0x7f3c8009e6a0 con 0x7f3c90102aa0 2024-09-21T01:01:16.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.919+0000 7f3c8e7fc640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:16.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.920+0000 7f3c8e7fc640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c90198b50 tx=0x7f3c78031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:16.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:16.924+0000 7f3c948b2640 1 -- 172.21.15.112:0/3417361872 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c80069ca0 con 0x7f3c90102aa0 2024-09-21T01:01:17.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:17 smithi112 ceph-mon[109687]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:17.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:17 smithi112 ceph-mon[109687]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:17.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:17 smithi112 ceph-mon[109687]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:17.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:17 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1796705471' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:17.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:17 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3271617622' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:01:17.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.237+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3c90105f40 con 0x7f3c90102aa0 2024-09-21T01:01:17.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.238+0000 7f3c948b2640 1 -- 172.21.15.112:0/3417361872 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f3c8006eb50 con 0x7f3c90102aa0 2024-09-21T01:01:17.239 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:01:17.239 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:01:17.239 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3c7c07af30 msgr2=0x7f3c7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c90198b50 tx=0x7f3c78031400 comp rx=0 tx=0).stop 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c90102aa0 msgr2=0x7f3c9019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c90102aa0 0x7f3c9019d680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000e970 tx=0x7f3c8000ed70 comp rx=0 tx=0).stop 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 shutdown_connections 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c901033c0 0x7f3c9019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:17.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 --2- 172.21.15.112:0/3417361872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c90102aa0 0x7f3c9019d680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:17.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 >> 172.21.15.112:0/3417361872 conn(0x7f3c900fc4c0 msgr2=0x7f3c90108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:17.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 shutdown_connections 2024-09-21T01:01:17.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:17.240+0000 7f3c958b4640 1 -- 172.21.15.112:0/3417361872 wait complete. 2024-09-21T01:01:17.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:17 smithi187 ceph-mon[78584]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:17.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:17 smithi187 ceph-mon[78584]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:17.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:17 smithi187 ceph-mon[78584]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:17.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:17 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1796705471' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:17.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:17 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3271617622' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:01:18.369 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:18 smithi187 ceph-mon[78584]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:18.369 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:18 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3417361872' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:01:18.369 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:18 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:18.369 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:18 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:18 smithi112 ceph-mon[109687]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:18 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3417361872' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:01:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:18 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:18.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:18 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:19.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:19 smithi112 ceph-mon[109687]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:19.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:19 smithi187 ceph-mon[78584]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:20.388 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:20 smithi187 ceph-mon[78584]: Upgrade: Updating crash.smithi187 (2/2) 2024-09-21T01:01:20.388 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:20.388 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T01:01:20.388 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:20.388 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:20 smithi187 ceph-mon[78584]: Deploying daemon crash.smithi187 on smithi187 2024-09-21T01:01:20.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:20 smithi112 ceph-mon[109687]: Upgrade: Updating crash.smithi187 (2/2) 2024-09-21T01:01:20.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:20.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi187", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T01:01:20.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:20.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:20 smithi112 ceph-mon[109687]: Deploying daemon crash.smithi187 on smithi187 2024-09-21T01:01:21.202 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:21 smithi187 ceph-mon[78584]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:21.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:21 smithi112 ceph-mon[109687]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:23.391 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:23 smithi187 ceph-mon[78584]: pgmap v120: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:23.391 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:23.391 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:23.391 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:23.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:23 smithi112 ceph-mon[109687]: pgmap v120: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:23.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:23.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:23.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:25.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:25 smithi187 ceph-mon[78584]: pgmap v121: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:25.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:25 smithi112 ceph-mon[109687]: pgmap v121: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:26.539 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:26 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:26.539 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:26 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:26.539 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:26 smithi187 ceph-mon[78584]: pgmap v122: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:26.539 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:26 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:26.539 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:26 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:26 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:26 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:26 smithi112 ceph-mon[109687]: pgmap v122: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:26.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:26 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:26.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:26 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.989 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:28 smithi112 ceph-mon[109687]: pgmap v123: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:28.989 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.989 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.989 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:01:28.989 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.989 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.990 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:28 smithi187 ceph-mon[78584]: pgmap v123: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:28.990 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.990 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.990 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:01:28.990 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:28.990 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:30.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:30.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:30.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:31 smithi112 ceph-mon[109687]: pgmap v124: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:31 smithi187 ceph-mon[78584]: pgmap v124: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:32.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: pgmap v125: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:32.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:32.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:32.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all crash 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"} : dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi187"} : dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi187"}]': finished 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T01:01:32.763 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:32 smithi112 ceph-mon[109687]: Upgrade: osd.0 is safe to restart 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: pgmap v125: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:32.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all crash 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"} : dispatch 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi187"} : dispatch 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi187"}]': finished 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T01:01:32.910 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:32 smithi187 ceph-mon[78584]: Upgrade: osd.0 is safe to restart 2024-09-21T01:01:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:34 smithi112 ceph-mon[109687]: Upgrade: Updating osd.0 2024-09-21T01:01:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:34 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:34 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:01:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:34 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:34.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:34 smithi112 ceph-mon[109687]: Deploying daemon osd.0 on smithi112 2024-09-21T01:01:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:34 smithi187 ceph-mon[78584]: Upgrade: Updating osd.0 2024-09-21T01:01:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:34 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:34 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:01:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:34 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:34 smithi187 ceph-mon[78584]: Deploying daemon osd.0 on smithi112 2024-09-21T01:01:35.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:35 smithi112 ceph-mon[109687]: pgmap v126: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:35.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:35 smithi187 ceph-mon[78584]: pgmap v126: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:36.446 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:36 smithi112 systemd[1]: Stopping Ceph osd.0 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:01:36.760 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:36 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[50229]: 2024-09-21T01:01:36.444+0000 7fb6bcbb3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:01:36.760 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:36 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[50229]: 2024-09-21T01:01:36.444+0000 7fb6bcbb3640 -1 osd.0 46 *** Got signal Terminated *** 2024-09-21T01:01:36.760 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:36 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[50229]: 2024-09-21T01:01:36.444+0000 7fb6bcbb3640 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:01:37.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:37 smithi112 ceph-mon[109687]: pgmap v127: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:37.371 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:37 smithi112 ceph-mon[109687]: osd.0 marked itself down and dead 2024-09-21T01:01:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:37 smithi187 ceph-mon[78584]: pgmap v127: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:37 smithi187 ceph-mon[78584]: osd.0 marked itself down and dead 2024-09-21T01:01:37.972 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:37 smithi112 podman[118150]: 2024-09-21 01:01:37.651205711 +0000 UTC m=+1.324534815 container died 5b2cb10789363245aed5e37dce8bc083c50e39569d20330a4a8910cd22172463 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:01:38.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:38 smithi112 ceph-mon[109687]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:01:38.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:38 smithi112 ceph-mon[109687]: osdmap e47: 6 total, 5 up, 6 in 2024-09-21T01:01:38.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:38 smithi112 podman[118150]: 2024-09-21 01:01:38.069845367 +0000 UTC m=+1.743174460 container cleanup 5b2cb10789363245aed5e37dce8bc083c50e39569d20330a4a8910cd22172463 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T01:01:38.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:38 smithi112 bash[118150]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0 2024-09-21T01:01:38.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:38 smithi187 ceph-mon[78584]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:01:38.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:38 smithi187 ceph-mon[78584]: osdmap e47: 6 total, 5 up, 6 in 2024-09-21T01:01:38.760 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:38 smithi112 podman[118165]: 2024-09-21 01:01:38.34709498 +0000 UTC m=+0.692279409 container remove 5b2cb10789363245aed5e37dce8bc083c50e39569d20330a4a8910cd22172463 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T01:01:39.092 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:38 smithi112 podman[118255]: 2024-09-21 01:01:38.740971365 +0000 UTC m=+0.016301583 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:01:39.092 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:38 smithi112 podman[118255]: 2024-09-21 01:01:38.856345889 +0000 UTC m=+0.131676150 container create 69d0c82e623e0d0a38b8a6210262aee0c0fead0a82f3c98690bb3bc0334fb875 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:01:39.092 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 podman[118255]: 2024-09-21 01:01:39.092307434 +0000 UTC m=+0.367637656 container init 69d0c82e623e0d0a38b8a6210262aee0c0fead0a82f3c98690bb3bc0334fb875 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:01:39.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:39 smithi112 ceph-mon[109687]: pgmap v129: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:39.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:39 smithi112 ceph-mon[109687]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T01:01:39.511 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 podman[118255]: 2024-09-21 01:01:39.095610789 +0000 UTC m=+0.370941016 container start 69d0c82e623e0d0a38b8a6210262aee0c0fead0a82f3c98690bb3bc0334fb875 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T01:01:39.511 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 podman[118255]: 2024-09-21 01:01:39.200574561 +0000 UTC m=+0.475904790 container attach 69d0c82e623e0d0a38b8a6210262aee0c0fead0a82f3c98690bb3bc0334fb875 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T01:01:39.511 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 podman[118255]: 2024-09-21 01:01:39.280134042 +0000 UTC m=+0.555464260 container died 69d0c82e623e0d0a38b8a6210262aee0c0fead0a82f3c98690bb3bc0334fb875 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T01:01:39.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:39 smithi187 ceph-mon[78584]: pgmap v129: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:39.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:39 smithi187 ceph-mon[78584]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T01:01:40.250 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 podman[118278]: 2024-09-21 01:01:39.904544332 +0000 UTC m=+0.615224542 container remove 69d0c82e623e0d0a38b8a6210262aee0c0fead0a82f3c98690bb3bc0334fb875 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T01:01:40.250 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T01:01:40.251 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 systemd[1]: Stopped Ceph osd.0 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:01:40.251 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:39 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.0.service: Consumed 49.873s CPU time. 2024-09-21T01:01:40.251 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 systemd[1]: Starting Ceph osd.0 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:01:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:40 smithi112 ceph-mon[109687]: pgmap v131: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:40 smithi112 ceph-mon[109687]: Health check failed: Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T01:01:40.510 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 podman[118379]: 2024-09-21 01:01:40.263593487 +0000 UTC m=+0.016604987 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:01:40.510 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 podman[118379]: 2024-09-21 01:01:40.389005312 +0000 UTC m=+0.142016833 container create e0f6680c73f28838ab49200785183f51a379b7740d0053a3e8d82b05f1c14f2e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:01:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:40 smithi187 ceph-mon[78584]: pgmap v131: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:40.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:40 smithi187 ceph-mon[78584]: Health check failed: Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T01:01:40.773 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 podman[118379]: 2024-09-21 01:01:40.641706474 +0000 UTC m=+0.394717967 container init e0f6680c73f28838ab49200785183f51a379b7740d0053a3e8d82b05f1c14f2e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:01:40.773 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 podman[118379]: 2024-09-21 01:01:40.645047769 +0000 UTC m=+0.398059255 container start e0f6680c73f28838ab49200785183f51a379b7740d0053a3e8d82b05f1c14f2e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T01:01:40.773 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 podman[118379]: 2024-09-21 01:01:40.741935931 +0000 UTC m=+0.494947434 container attach e0f6680c73f28838ab49200785183f51a379b7740d0053a3e8d82b05f1c14f2e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T01:01:41.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:01:41.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 bash[118379]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:01:41.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:01:41.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:40 smithi112 bash[118379]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:01:41.917 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T01:01:41.917 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 bash[118379]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T01:01:41.917 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T01:01:41.917 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 bash[118379]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T01:01:42.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T01:01:42.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 bash[118379]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T01:01:42.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T01:01:42.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 bash[118379]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T01:01:42.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T01:01:42.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 bash[118379]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T01:01:42.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T01:01:42.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 bash[118379]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T01:01:42.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate[118394]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-21T01:01:42.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 bash[118379]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-21T01:01:42.261 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:41 smithi112 podman[118379]: 2024-09-21 01:01:41.944722176 +0000 UTC m=+1.697733664 container died e0f6680c73f28838ab49200785183f51a379b7740d0053a3e8d82b05f1c14f2e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T01:01:42.972 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:42 smithi112 ceph-mon[109687]: pgmap v132: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:42.973 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:42 smithi112 podman[118529]: 2024-09-21 01:01:42.645967346 +0000 UTC m=+0.695082248 container remove e0f6680c73f28838ab49200785183f51a379b7740d0053a3e8d82b05f1c14f2e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-activate, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:01:42.973 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:42 smithi112 podman[118589]: 2024-09-21 01:01:42.763381348 +0000 UTC m=+0.016208508 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:01:42.973 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:42 smithi112 podman[118589]: 2024-09-21 01:01:42.863495739 +0000 UTC m=+0.116322877 container create 4e028816cafdd854e0889e3dc7a7cb70a67c0ea5fffd509e629c4d4266574be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-21T01:01:43.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:42 smithi187 ceph-mon[78584]: pgmap v132: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:43.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:43 smithi112 podman[118589]: 2024-09-21 01:01:43.074076717 +0000 UTC m=+0.326903854 container init 4e028816cafdd854e0889e3dc7a7cb70a67c0ea5fffd509e629c4d4266574be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:01:43.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:43 smithi112 podman[118589]: 2024-09-21 01:01:43.077241759 +0000 UTC m=+0.330068906 container start 4e028816cafdd854e0889e3dc7a7cb70a67c0ea5fffd509e629c4d4266574be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T01:01:43.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:43 smithi112 ceph-osd[118609]: -- 172.21.15.112:0/2595686986 <== mon.0 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5642911721e0 con 0x5642903fad00 2024-09-21T01:01:43.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:43 smithi112 bash[118589]: 4e028816cafdd854e0889e3dc7a7cb70a67c0ea5fffd509e629c4d4266574be3 2024-09-21T01:01:43.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:43 smithi112 systemd[1]: Started Ceph osd.0 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:01:44.498 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:44.498 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:44.498 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:44.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:44.499 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:01:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:01:45.010 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:44 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[118605]: 2024-09-21T01:01:44.965+0000 7f229f024640 -1 Falling back to public interface 2024-09-21T01:01:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:45 smithi112 ceph-mon[109687]: pgmap v133: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:45 smithi187 ceph-mon[78584]: pgmap v133: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:47.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 -- 172.21.15.112:0/3497807384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 msgr2=0x7f2b24106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 --2- 172.21.15.112:0/3497807384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b24106c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009880 tx=0x7f2b1402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 -- 172.21.15.112:0/3497807384 shutdown_connections 2024-09-21T01:01:47.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 --2- 172.21.15.112:0/3497807384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b24100820 0x7f2b24100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 --2- 172.21.15.112:0/3497807384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b24106c00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 -- 172.21.15.112:0/3497807384 >> 172.21.15.112:0/3497807384 conn(0x7f2b240fc520 msgr2=0x7f2b240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:47.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 -- 172.21.15.112:0/3497807384 shutdown_connections 2024-09-21T01:01:47.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.325+0000 7f2b2a278640 1 -- 172.21.15.112:0/3497807384 wait complete. 2024-09-21T01:01:47.327 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:47 smithi112 ceph-mon[109687]: pgmap v134: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.326+0000 7f2b2a278640 1 Processor -- start 2024-09-21T01:01:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.326+0000 7f2b2a278640 1 -- start start 2024-09-21T01:01:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.326+0000 7f2b2a278640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b24100820 0x7f2b2419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.326+0000 7f2b2a278640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b2419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.326+0000 7f2b2a278640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410dcd0 con 0x7f2b24106820 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.326+0000 7f2b2a278640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410db50 con 0x7f2b24100820 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b2419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b2419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47870/0 (socket says 172.21.15.112:47870) 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b237fe640 1 -- 172.21.15.112:0/2831765858 learned_addr learned my addr 172.21.15.112:0/2831765858 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b23fff640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b24100820 0x7f2b2419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b237fe640 1 -- 172.21.15.112:0/2831765858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b24100820 msgr2=0x7f2b2419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b237fe640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b24100820 0x7f2b2419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b237fe640 1 -- 172.21.15.112:0/2831765858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b24197880 con 0x7f2b24106820 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b237fe640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b2419dc00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800e970 tx=0x7f2b1800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b217fa640 1 -- 172.21.15.112:0/2831765858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b1800cac0 con 0x7f2b24106820 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b24197b70 con 0x7f2b24106820 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b217fa640 1 -- 172.21.15.112:0/2831765858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b1800cc60 con 0x7f2b24106820 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b217fa640 1 -- 172.21.15.112:0/2831765858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b18018720 con 0x7f2b24106820 2024-09-21T01:01:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.327+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b24198100 con 0x7f2b24106820 2024-09-21T01:01:47.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.328+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b24101f60 con 0x7f2b24106820 2024-09-21T01:01:47.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.329+0000 7f2b217fa640 1 -- 172.21.15.112:0/2831765858 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2b18010430 con 0x7f2b24106820 2024-09-21T01:01:47.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.330+0000 7f2b217fa640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2b0c07af30 0x7f2b0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.330+0000 7f2b217fa640 1 -- 172.21.15.112:0/2831765858 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f2b1809e620 con 0x7f2b24106820 2024-09-21T01:01:47.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.330+0000 7f2b23fff640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2b0c07af30 0x7f2b0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.331+0000 7f2b23fff640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2b0c07af30 0x7f2b0c07d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b14000c00 tx=0x7f2b14031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:47.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.336+0000 7f2b217fa640 1 -- 172.21.15.112:0/2831765858 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b18069c20 con 0x7f2b24106820 2024-09-21T01:01:47.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.545+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2b24198e20 con 0x7f2b0c07af30 2024-09-21T01:01:47.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.546+0000 7f2b217fa640 1 -- 172.21.15.112:0/2831765858 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2b24198e20 con 0x7f2b0c07af30 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2b0c07af30 msgr2=0x7f2b0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2b0c07af30 0x7f2b0c07d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b14000c00 tx=0x7f2b14031400 comp rx=0 tx=0).stop 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 msgr2=0x7f2b2419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b2419dc00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800e970 tx=0x7f2b1800ee30 comp rx=0 tx=0).stop 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 shutdown_connections 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2b0c07af30 0x7f2b0c07d3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24106820 0x7f2b2419dc00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 --2- 172.21.15.112:0/2831765858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b24100820 0x7f2b2419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.548+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 >> 172.21.15.112:0/2831765858 conn(0x7f2b240fc520 msgr2=0x7f2b2406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:47.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.549+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 shutdown_connections 2024-09-21T01:01:47.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.549+0000 7f2b2a278640 1 -- 172.21.15.112:0/2831765858 wait complete. 2024-09-21T01:01:47.558 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:01:47.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 -- 172.21.15.112:0/898781500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 msgr2=0x7f2a4c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 --2- 172.21.15.112:0/898781500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c100c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009880 tx=0x7f2a3402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 -- 172.21.15.112:0/898781500 shutdown_connections 2024-09-21T01:01:47.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 --2- 172.21.15.112:0/898781500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c100c40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 --2- 172.21.15.112:0/898781500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c1067e0 0x7f2a4c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 -- 172.21.15.112:0/898781500 >> 172.21.15.112:0/898781500 conn(0x7f2a4c0fc4c0 msgr2=0x7f2a4c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:47.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 -- 172.21.15.112:0/898781500 shutdown_connections 2024-09-21T01:01:47.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.633+0000 7f2a50e56640 1 -- 172.21.15.112:0/898781500 wait complete. 2024-09-21T01:01:47.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.634+0000 7f2a50e56640 1 Processor -- start 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.634+0000 7f2a50e56640 1 -- start start 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.634+0000 7f2a50e56640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a50e56640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c1067e0 0x7f2a4c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a50e56640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c10dc90 con 0x7f2a4c1007e0 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a50e56640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c10db10 con 0x7f2a4c1067e0 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a4a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a4a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47888/0 (socket says 172.21.15.112:47888) 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a4a59c640 1 -- 172.21.15.112:0/718079965 learned_addr learned my addr 172.21.15.112:0/718079965 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a41d9b640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c1067e0 0x7f2a4c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a4a59c640 1 -- 172.21.15.112:0/718079965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c1067e0 msgr2=0x7f2a4c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a4a59c640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c1067e0 0x7f2a4c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a4a59c640 1 -- 172.21.15.112:0/718079965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c1999b0 con 0x7f2a4c1007e0 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a41d9b640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c1067e0 0x7f2a4c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a4a59c640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c19f7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00d8d0 tx=0x7f2a3c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a43fff640 1 -- 172.21.15.112:0/718079965 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a3c017070 con 0x7f2a4c1007e0 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c199ca0 con 0x7f2a4c1007e0 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a43fff640 1 -- 172.21.15.112:0/718079965 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a3c010460 con 0x7f2a4c1007e0 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a43fff640 1 -- 172.21.15.112:0/718079965 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a3c00f5f0 con 0x7f2a4c1007e0 2024-09-21T01:01:47.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.635+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c19a200 con 0x7f2a4c1007e0 2024-09-21T01:01:47.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.636+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c101f20 con 0x7f2a4c1007e0 2024-09-21T01:01:47.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.637+0000 7f2a43fff640 1 -- 172.21.15.112:0/718079965 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2a3c009a30 con 0x7f2a4c1007e0 2024-09-21T01:01:47.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.638+0000 7f2a43fff640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2a3807af30 0x7f2a3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.638+0000 7f2a43fff640 1 -- 172.21.15.112:0/718079965 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f2a3c09dea0 con 0x7f2a4c1007e0 2024-09-21T01:01:47.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.638+0000 7f2a41d9b640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2a3807af30 0x7f2a3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.639+0000 7f2a41d9b640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2a3807af30 0x7f2a3807d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c19b1a0 tx=0x7f2a34031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:47.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.643+0000 7f2a43fff640 1 -- 172.21.15.112:0/718079965 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a3c0694a0 con 0x7f2a4c1007e0 2024-09-21T01:01:47.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:47 smithi187 ceph-mon[78584]: pgmap v134: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:47.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.849+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2a4c19a4b0 con 0x7f2a3807af30 2024-09-21T01:01:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.850+0000 7f2a43fff640 1 -- 172.21.15.112:0/718079965 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2a4c19a4b0 con 0x7f2a3807af30 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2a3807af30 msgr2=0x7f2a3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2a3807af30 0x7f2a3807d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c19b1a0 tx=0x7f2a34031400 comp rx=0 tx=0).stop 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 msgr2=0x7f2a4c19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c19f7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00d8d0 tx=0x7f2a3c00dd90 comp rx=0 tx=0).stop 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 shutdown_connections 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2a3807af30 0x7f2a3807d3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c1067e0 0x7f2a4c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 --2- 172.21.15.112:0/718079965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4c1007e0 0x7f2a4c19f7f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 >> 172.21.15.112:0/718079965 conn(0x7f2a4c0fc4c0 msgr2=0x7f2a4c0fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 shutdown_connections 2024-09-21T01:01:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.853+0000 7f2a50e56640 1 -- 172.21.15.112:0/718079965 wait complete. 2024-09-21T01:01:47.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.940+0000 7f060acde640 1 -- 172.21.15.112:0/2824323413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041007e0 msgr2=0x7f0604100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.940+0000 7f060acde640 1 --2- 172.21.15.112:0/2824323413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041007e0 0x7f0604100c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009880 tx=0x7f05f002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 -- 172.21.15.112:0/2824323413 shutdown_connections 2024-09-21T01:01:47.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 --2- 172.21.15.112:0/2824323413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041007e0 0x7f0604100c40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 --2- 172.21.15.112:0/2824323413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06041067e0 0x7f0604106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 -- 172.21.15.112:0/2824323413 >> 172.21.15.112:0/2824323413 conn(0x7f06040fc4c0 msgr2=0x7f06040fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:47.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 -- 172.21.15.112:0/2824323413 shutdown_connections 2024-09-21T01:01:47.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 -- 172.21.15.112:0/2824323413 wait complete. 2024-09-21T01:01:47.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 Processor -- start 2024-09-21T01:01:47.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.941+0000 7f060acde640 1 -- start start 2024-09-21T01:01:47.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f060acde640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06041007e0 0x7f06041987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f060acde640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041067e0 0x7f0604198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f060acde640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f060410dcb0 con 0x7f06041067e0 2024-09-21T01:01:47.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f060acde640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f060410db30 con 0x7f06041007e0 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0603fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041067e0 0x7f0604198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0603fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041067e0 0x7f0604198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47916/0 (socket says 172.21.15.112:47916) 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0603fff640 1 -- 172.21.15.112:0/2996978864 learned_addr learned my addr 172.21.15.112:0/2996978864 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0608a7a640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06041007e0 0x7f06041987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0603fff640 1 -- 172.21.15.112:0/2996978864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06041007e0 msgr2=0x7f06041987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0603fff640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06041007e0 0x7f06041987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0603fff640 1 -- 172.21.15.112:0/2996978864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0604199330 con 0x7f06041067e0 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.942+0000 7f0603fff640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041067e0 0x7f0604198ce0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05f0031460 tx=0x7f05f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.943+0000 7f0601ffb640 1 -- 172.21.15.112:0/2996978864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05f003f070 con 0x7f06041067e0 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.943+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06041995c0 con 0x7f06041067e0 2024-09-21T01:01:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.943+0000 7f0601ffb640 1 -- 172.21.15.112:0/2996978864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05f00035f0 con 0x7f06041067e0 2024-09-21T01:01:47.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.943+0000 7f0601ffb640 1 -- 172.21.15.112:0/2996978864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05f0035030 con 0x7f06041067e0 2024-09-21T01:01:47.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.943+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06041a1b70 con 0x7f06041067e0 2024-09-21T01:01:47.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.944+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0604101f20 con 0x7f06041067e0 2024-09-21T01:01:47.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.945+0000 7f0601ffb640 1 -- 172.21.15.112:0/2996978864 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f05f0042070 con 0x7f06041067e0 2024-09-21T01:01:47.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.945+0000 7f0601ffb640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f05f407af30 0x7f05f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:47.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.946+0000 7f0601ffb640 1 -- 172.21.15.112:0/2996978864 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f05f00be900 con 0x7f06041067e0 2024-09-21T01:01:47.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.946+0000 7f0608a7a640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f05f407af30 0x7f05f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:47.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.946+0000 7f0608a7a640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f05f407af30 0x7f05f407d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05f8005fd0 tx=0x7f05f800b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:47.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:47.950+0000 7f0601ffb640 1 -- 172.21.15.112:0/2996978864 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05f0089f00 con 0x7f06041067e0 2024-09-21T01:01:48.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.196+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0604062630 con 0x7f05f407af30 2024-09-21T01:01:48.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.206+0000 7f0601ffb640 1 -- 172.21.15.112:0/2996978864 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0604062630 con 0x7f05f407af30 2024-09-21T01:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (2m) 0s ago 13m 19.7M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (5m) 0s ago 13m 8753k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (4m) 22s ago 12m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (31s) 0s ago 13m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (26s) 22s ago 12m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (116s) 0s ago 12m 80.8M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (7m) 0s ago 7m 150M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (7m) 0s ago 7m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (7m) 22s ago 7m 20.0M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (7m) 22s ago 7m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (4m) 0s ago 14m 590M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (3m) 22s ago 12m 522M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (59s) 0s ago 14m 106M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (44s) 22s ago 12m 93.3M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (3m) 0s ago 13m 10.5M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (3m) 22s ago 12m 10.5M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (5s) 0s ago 11m 81.0M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:01:48.208 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (10m) 0s ago 10m 224M 1216M 19.1.1-373-g4e45e6b4 164465d2334a dddef3ba1872 2024-09-21T01:01:48.209 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (10m) 0s ago 10m 177M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T01:01:48.209 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (9m) 22s ago 9m 254M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T01:01:48.209 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (9m) 22s ago 9m 206M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:01:48.209 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (8m) 22s ago 8m 191M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:01:48.209 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (2m) 0s ago 12m 49.5M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f05f407af30 msgr2=0x7f05f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f05f407af30 0x7f05f407d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05f8005fd0 tx=0x7f05f800b390 comp rx=0 tx=0).stop 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041067e0 msgr2=0x7f0604198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041067e0 0x7f0604198ce0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05f0031460 tx=0x7f05f00045e0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 shutdown_connections 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f05f407af30 0x7f05f407d3f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06041067e0 0x7f0604198ce0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 --2- 172.21.15.112:0/2996978864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06041007e0 0x7f06041987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 >> 172.21.15.112:0/2996978864 conn(0x7f06040fc4c0 msgr2=0x7f06040fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:48.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 shutdown_connections 2024-09-21T01:01:48.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.210+0000 7f060acde640 1 -- 172.21.15.112:0/2996978864 wait complete. 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.301+0000 7f7769bb3640 1 -- 172.21.15.112:0/2027000304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764107910 msgr2=0x7f7764107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.301+0000 7f7769bb3640 1 --2- 172.21.15.112:0/2027000304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764107910 0x7f7764107cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7754009880 tx=0x7f775402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.301+0000 7f7769bb3640 1 -- 172.21.15.112:0/2027000304 shutdown_connections 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.301+0000 7f7769bb3640 1 --2- 172.21.15.112:0/2027000304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764101910 0x7f7764101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.301+0000 7f7769bb3640 1 --2- 172.21.15.112:0/2027000304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764107910 0x7f7764107cf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.301+0000 7f7769bb3640 1 -- 172.21.15.112:0/2027000304 >> 172.21.15.112:0/2027000304 conn(0x7f77640fd5f0 msgr2=0x7f77640ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.302+0000 7f7769bb3640 1 -- 172.21.15.112:0/2027000304 shutdown_connections 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.302+0000 7f7769bb3640 1 -- 172.21.15.112:0/2027000304 wait complete. 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.302+0000 7f7769bb3640 1 Processor -- start 2024-09-21T01:01:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.302+0000 7f7769bb3640 1 -- start start 2024-09-21T01:01:48.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7769bb3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764101910 0x7f776419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:48.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7769bb3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764107910 0x7f776419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7769bb3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f776410edc0 con 0x7f7764107910 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7769bb3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f776410ec40 con 0x7f7764101910 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764107910 0x7f776419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764107910 0x7f776419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47926/0 (socket says 172.21.15.112:47926) 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7762ffd640 1 -- 172.21.15.112:0/4011574220 learned_addr learned my addr 172.21.15.112:0/4011574220 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f77637fe640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764101910 0x7f776419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7762ffd640 1 -- 172.21.15.112:0/4011574220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764101910 msgr2=0x7f776419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7762ffd640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764101910 0x7f776419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7762ffd640 1 -- 172.21.15.112:0/4011574220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77641977e0 con 0x7f7764107910 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.303+0000 7f7762ffd640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764107910 0x7f776419dba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f775800d8d0 tx=0x7f775800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.304+0000 7f7760ff9640 1 -- 172.21.15.112:0/4011574220 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7758017030 con 0x7f7764107910 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.304+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7764197ad0 con 0x7f7764107910 2024-09-21T01:01:48.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.304+0000 7f7760ff9640 1 -- 172.21.15.112:0/4011574220 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7758004020 con 0x7f7764107910 2024-09-21T01:01:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.304+0000 7f7760ff9640 1 -- 172.21.15.112:0/4011574220 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77580047a0 con 0x7f7764107910 2024-09-21T01:01:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.304+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7764198060 con 0x7f7764107910 2024-09-21T01:01:48.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.306+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7764103050 con 0x7f7764107910 2024-09-21T01:01:48.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.306+0000 7f7760ff9640 1 -- 172.21.15.112:0/4011574220 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f77580041d0 con 0x7f7764107910 2024-09-21T01:01:48.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.307+0000 7f7760ff9640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f774c07af30 0x7f774c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:48.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.307+0000 7f77637fe640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f774c07af30 0x7f774c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:48.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.307+0000 7f7760ff9640 1 -- 172.21.15.112:0/4011574220 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f7758018070 con 0x7f7764107910 2024-09-21T01:01:48.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.308+0000 7f77637fe640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f774c07af30 0x7f774c07d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77540096c0 tx=0x7f7754031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:48.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.312+0000 7f7760ff9640 1 -- 172.21.15.112:0/4011574220 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7758069350 con 0x7f7764107910 2024-09-21T01:01:48.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.581+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7764104b20 con 0x7f7764107910 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.582+0000 7f7760ff9640 1 -- 172.21.15.112:0/4011574220 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f775806e200 con 0x7f7764107910 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 9, 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 4 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f774c07af30 msgr2=0x7f774c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f774c07af30 0x7f774c07d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77540096c0 tx=0x7f7754031400 comp rx=0 tx=0).stop 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764107910 msgr2=0x7f776419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764107910 0x7f776419dba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f775800d8d0 tx=0x7f775800dd90 comp rx=0 tx=0).stop 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 shutdown_connections 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f774c07af30 0x7f774c07d3f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7764107910 0x7f776419dba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 --2- 172.21.15.112:0/4011574220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7764101910 0x7f776419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 >> 172.21.15.112:0/4011574220 conn(0x7f77640fd5f0 msgr2=0x7f77640fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:48.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 shutdown_connections 2024-09-21T01:01:48.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.584+0000 7f7769bb3640 1 -- 172.21.15.112:0/4011574220 wait complete. 2024-09-21T01:01:48.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.672+0000 7fbd0c464640 1 -- 172.21.15.112:0/2850867669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 msgr2=0x7fbd04106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.672+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2850867669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd04106bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009880 tx=0x7fbd0002a530 comp rx=0 tx=0).stop 2024-09-21T01:01:48.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.673+0000 7fbd0c464640 1 -- 172.21.15.112:0/2850867669 shutdown_connections 2024-09-21T01:01:48.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.673+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2850867669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04100f30 0x7fbd04101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.673+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2850867669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd04106bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.673+0000 7fbd0c464640 1 -- 172.21.15.112:0/2850867669 >> 172.21.15.112:0/2850867669 conn(0x7fbd040fbc10 msgr2=0x7fbd040fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:48.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.673+0000 7fbd0c464640 1 -- 172.21.15.112:0/2850867669 shutdown_connections 2024-09-21T01:01:48.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.673+0000 7fbd0c464640 1 -- 172.21.15.112:0/2850867669 wait complete. 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0c464640 1 Processor -- start 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0c464640 1 -- start start 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0c464640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04100f30 0x7fbd0419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0c464640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd0419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0c464640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0410dcd0 con 0x7fbd04106810 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0c464640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0410db50 con 0x7fbd04100f30 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd099ff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd0419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd099ff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd0419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47942/0 (socket says 172.21.15.112:47942) 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd099ff640 1 -- 172.21.15.112:0/2750735622 learned_addr learned my addr 172.21.15.112:0/2750735622 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0a200640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04100f30 0x7fbd0419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd099ff640 1 -- 172.21.15.112:0/2750735622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04100f30 msgr2=0x7fbd0419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd099ff640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04100f30 0x7fbd0419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd099ff640 1 -- 172.21.15.112:0/2750735622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd04197790 con 0x7fbd04106810 2024-09-21T01:01:48.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.674+0000 7fbd0a200640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04100f30 0x7fbd0419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:48.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.675+0000 7fbd099ff640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd0419db50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400d6f0 tx=0x7fbcf400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:48.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.675+0000 7fbcfb7fe640 1 -- 172.21.15.112:0/2750735622 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcf4017070 con 0x7fbd04106810 2024-09-21T01:01:48.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.675+0000 7fbcfb7fe640 1 -- 172.21.15.112:0/2750735622 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcf400de00 con 0x7fbd04106810 2024-09-21T01:01:48.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.675+0000 7fbcfb7fe640 1 -- 172.21.15.112:0/2750735622 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcf4004bb0 con 0x7fbd04106810 2024-09-21T01:01:48.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.675+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd04197a80 con 0x7fbd04106810 2024-09-21T01:01:48.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.675+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd04198010 con 0x7fbd04106810 2024-09-21T01:01:48.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.676+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd04101390 con 0x7fbd04106810 2024-09-21T01:01:48.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.677+0000 7fbcfb7fe640 1 -- 172.21.15.112:0/2750735622 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbcf4004e60 con 0x7fbd04106810 2024-09-21T01:01:48.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.677+0000 7fbcfb7fe640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbcf007f350 0x7fbcf0081810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:48.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.677+0000 7fbcfb7fe640 1 -- 172.21.15.112:0/2750735622 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fbcf409dc50 con 0x7fbd04106810 2024-09-21T01:01:48.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.677+0000 7fbd0a200640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbcf007f350 0x7fbcf0081810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:48.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.678+0000 7fbd0a200640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbcf007f350 0x7fbcf0081810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd00000c00 tx=0x7fbd00031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.682+0000 7fbcfb7fe640 1 -- 172.21.15.112:0/2750735622 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbcf4069250 con 0x7fbd04106810 2024-09-21T01:01:48.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.921+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbd041982c0 con 0x7fbd04106810 2024-09-21T01:01:48.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.921+0000 7fbcfb7fe640 1 -- 172.21.15.112:0/2750735622 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7fbcf406e100 con 0x7fbd04106810 2024-09-21T01:01:48.923 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:01:48.923 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:01:48.923 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:01:48.923 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:01:48.923 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:01:48.923 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:01:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:01:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:01:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:01:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:01:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:01:48.924 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:01:48.925 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:01:48.925 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:01:48.925 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:01:48.925 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:01:48.925 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:01:48.925 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:01:48.925 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:01:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:01:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:01:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:01:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:01:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:01:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:01:48.926 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:01:48.927 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:01:48.927 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:01:48.927 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:01:48.927 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:01:48.927 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:01:48.927 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:01:48.927 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:01:48.928 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:01:48.928 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:48.928 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:48.928 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:48.928 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:01:48.928 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:01:48.929 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:48.929 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:48.929 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:01:48.930 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:01:48.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.924+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbcf007f350 msgr2=0x7fbcf0081810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.924+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbcf007f350 0x7fbcf0081810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd00000c00 tx=0x7fbd00031400 comp rx=0 tx=0).stop 2024-09-21T01:01:48.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.924+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 msgr2=0x7fbd0419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.924+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd0419db50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400d6f0 tx=0x7fbcf400dbb0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.925+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 shutdown_connections 2024-09-21T01:01:48.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.925+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbcf007f350 0x7fbcf0081810 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.925+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd04106810 0x7fbd0419db50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.925+0000 7fbd0c464640 1 --2- 172.21.15.112:0/2750735622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04100f30 0x7fbd0419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.925+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 >> 172.21.15.112:0/2750735622 conn(0x7fbd040fbc10 msgr2=0x7fbd040ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:48.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.925+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 shutdown_connections 2024-09-21T01:01:48.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:48.925+0000 7fbd0c464640 1 -- 172.21.15.112:0/2750735622 wait complete. 2024-09-21T01:01:49.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 -- 172.21.15.112:0/2865626573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4103420 msgr2=0x7f9bd410b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 --2- 172.21.15.112:0/2865626573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4103420 0x7f9bd410b910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80098b0 tx=0x7f9bc802a560 comp rx=0 tx=0).stop 2024-09-21T01:01:49.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 -- 172.21.15.112:0/2865626573 shutdown_connections 2024-09-21T01:01:49.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 --2- 172.21.15.112:0/2865626573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4103420 0x7f9bd410b910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 --2- 172.21.15.112:0/2865626573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd4102b00 0x7f9bd4102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 -- 172.21.15.112:0/2865626573 >> 172.21.15.112:0/2865626573 conn(0x7f9bd40fc4c0 msgr2=0x7f9bd40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 -- 172.21.15.112:0/2865626573 shutdown_connections 2024-09-21T01:01:49.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.018+0000 7f9bda547640 1 -- 172.21.15.112:0/2865626573 wait complete. 2024-09-21T01:01:49.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.019+0000 7f9bda547640 1 Processor -- start 2024-09-21T01:01:49.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.019+0000 7f9bda547640 1 -- start start 2024-09-21T01:01:49.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bda547640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4102b00 0x7f9bd419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bda547640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd4103420 0x7f9bd419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bda547640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd410edd0 con 0x7f9bd4102b00 2024-09-21T01:01:49.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bda547640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd410ec50 con 0x7f9bd4103420 2024-09-21T01:01:49.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4102b00 0x7f9bd419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4102b00 0x7f9bd419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47960/0 (socket says 172.21.15.112:47960) 2024-09-21T01:01:49.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd3fff640 1 -- 172.21.15.112:0/3684003775 learned_addr learned my addr 172.21.15.112:0/3684003775 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:49.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd37fe640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd4103420 0x7f9bd419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd3fff640 1 -- 172.21.15.112:0/3684003775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd4103420 msgr2=0x7f9bd419dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd3fff640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd4103420 0x7f9bd419dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd3fff640 1 -- 172.21.15.112:0/3684003775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd41978a0 con 0x7f9bd4102b00 2024-09-21T01:01:49.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.020+0000 7f9bd3fff640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4102b00 0x7f9bd419d6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d6f0 tx=0x7f9bc400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.021+0000 7f9bd17fa640 1 -- 172.21.15.112:0/3684003775 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4017070 con 0x7f9bd4102b00 2024-09-21T01:01:49.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.021+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd4197b90 con 0x7f9bd4102b00 2024-09-21T01:01:49.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.021+0000 7f9bd17fa640 1 -- 172.21.15.112:0/3684003775 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9bc400de00 con 0x7f9bd4102b00 2024-09-21T01:01:49.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.021+0000 7f9bd17fa640 1 -- 172.21.15.112:0/3684003775 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4017070 con 0x7f9bd4102b00 2024-09-21T01:01:49.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.021+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd41980f0 con 0x7f9bd4102b00 2024-09-21T01:01:49.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.022+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd406a3b0 con 0x7f9bd4102b00 2024-09-21T01:01:49.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.023+0000 7f9bd17fa640 1 -- 172.21.15.112:0/3684003775 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9bc4009a30 con 0x7f9bd4102b00 2024-09-21T01:01:49.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.023+0000 7f9bd17fa640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9bbc07b350 0x7f9bbc07d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.024+0000 7f9bd17fa640 1 -- 172.21.15.112:0/3684003775 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f9bc409db40 con 0x7f9bd4102b00 2024-09-21T01:01:49.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.024+0000 7f9bd37fe640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9bbc07b350 0x7f9bbc07d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.024+0000 7f9bd37fe640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9bbc07b350 0x7f9bbc07d810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8000c00 tx=0x7f9bc8031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.028+0000 7f9bd17fa640 1 -- 172.21.15.112:0/3684003775 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9bc40691a0 con 0x7f9bd4102b00 2024-09-21T01:01:49.228 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:49.228 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: pgmap v135: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:49.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:49.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:49.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4011574220' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:49.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:49 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2750735622' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:01:49.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.227+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9bd4198ed0 con 0x7f9bbc07b350 2024-09-21T01:01:49.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.228+0000 7f9bd17fa640 1 -- 172.21.15.112:0/3684003775 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9bd4198ed0 con 0x7f9bbc07b350 2024-09-21T01:01:49.232 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:01:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:01:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:01:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:01:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:01:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:01:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:01:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:01:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:01:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "7/23 daemons upgraded", 2024-09-21T01:01:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T01:01:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:01:49.234 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:01:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9bbc07b350 msgr2=0x7f9bbc07d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9bbc07b350 0x7f9bbc07d810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8000c00 tx=0x7f9bc8031400 comp rx=0 tx=0).stop 2024-09-21T01:01:49.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4102b00 msgr2=0x7f9bd419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4102b00 0x7f9bd419d6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d6f0 tx=0x7f9bc400dbb0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 shutdown_connections 2024-09-21T01:01:49.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9bbc07b350 0x7f9bbc07d810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd4103420 0x7f9bd419dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 --2- 172.21.15.112:0/3684003775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd4102b00 0x7f9bd419d6e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 >> 172.21.15.112:0/3684003775 conn(0x7f9bd40fc4c0 msgr2=0x7f9bd4103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 shutdown_connections 2024-09-21T01:01:49.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.230+0000 7f9bda547640 1 -- 172.21.15.112:0/3684003775 wait complete. 2024-09-21T01:01:49.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 -- 172.21.15.112:0/1305538094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1067e0 msgr2=0x7f67dc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 --2- 172.21.15.112:0/1305538094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1067e0 0x7f67dc106bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009880 tx=0x7f67cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 -- 172.21.15.112:0/1305538094 shutdown_connections 2024-09-21T01:01:49.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 --2- 172.21.15.112:0/1305538094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67dc1007e0 0x7f67dc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 --2- 172.21.15.112:0/1305538094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1067e0 0x7f67dc106bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 -- 172.21.15.112:0/1305538094 >> 172.21.15.112:0/1305538094 conn(0x7f67dc0fc4c0 msgr2=0x7f67dc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 -- 172.21.15.112:0/1305538094 shutdown_connections 2024-09-21T01:01:49.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 -- 172.21.15.112:0/1305538094 wait complete. 2024-09-21T01:01:49.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 Processor -- start 2024-09-21T01:01:49.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.315+0000 7f67e2661640 1 -- start start 2024-09-21T01:01:49.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67e2661640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1007e0 0x7f67dc19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67e2661640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67dc1067e0 0x7f67dc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67e2661640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc10dcb0 con 0x7f67dc1007e0 2024-09-21T01:01:49.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67e2661640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc10db30 con 0x7f67dc1067e0 2024-09-21T01:01:49.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67dbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1007e0 0x7f67dc19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67dbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1007e0 0x7f67dc19f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47978/0 (socket says 172.21.15.112:47978) 2024-09-21T01:01:49.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67dbfff640 1 -- 172.21.15.112:0/4006178682 learned_addr learned my addr 172.21.15.112:0/4006178682 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:01:49.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67db7fe640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67dc1067e0 0x7f67dc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67dbfff640 1 -- 172.21.15.112:0/4006178682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67dc1067e0 msgr2=0x7f67dc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67dbfff640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67dc1067e0 0x7f67dc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67dbfff640 1 -- 172.21.15.112:0/4006178682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc199980 con 0x7f67dc1007e0 2024-09-21T01:01:49.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.316+0000 7f67dbfff640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1007e0 0x7f67dc19f7c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67cc031460 tx=0x7f67cc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.317+0000 7f67d97fa640 1 -- 172.21.15.112:0/4006178682 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67cc03f070 con 0x7f67dc1007e0 2024-09-21T01:01:49.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.317+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67dc199c10 con 0x7f67dc1007e0 2024-09-21T01:01:49.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.317+0000 7f67d97fa640 1 -- 172.21.15.112:0/4006178682 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67cc004cf0 con 0x7f67dc1007e0 2024-09-21T01:01:49.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.317+0000 7f67d97fa640 1 -- 172.21.15.112:0/4006178682 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67cc035030 con 0x7f67dc1007e0 2024-09-21T01:01:49.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.317+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67dc19a140 con 0x7f67dc1007e0 2024-09-21T01:01:49.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.318+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67dc101f20 con 0x7f67dc1007e0 2024-09-21T01:01:49.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.318+0000 7f67d97fa640 1 -- 172.21.15.112:0/4006178682 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f67cc042070 con 0x7f67dc1007e0 2024-09-21T01:01:49.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.319+0000 7f67d97fa640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c407af30 0x7f67c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.319+0000 7f67d97fa640 1 -- 172.21.15.112:0/4006178682 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f67cc0beac0 con 0x7f67dc1007e0 2024-09-21T01:01:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.319+0000 7f67db7fe640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c407af30 0x7f67c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.319+0000 7f67db7fe640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c407af30 0x7f67c407d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f67d0005fd0 tx=0x7f67d0005e20 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:49.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.323+0000 7f67d97fa640 1 -- 172.21.15.112:0/4006178682 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67cc08a0c0 con 0x7f67dc1007e0 2024-09-21T01:01:49.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:49.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: pgmap v135: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:49.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:49.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:49.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4011574220' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:49.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:49.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:49 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2750735622' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:01:49.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.582+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f67dc19a4b0 con 0x7f67dc1007e0 2024-09-21T01:01:49.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.583+0000 7f67d97fa640 1 -- 172.21.15.112:0/4006178682 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1517 (secure 0 0 0) 0x7f67cc08ef70 con 0x7f67dc1007e0 2024-09-21T01:01:49.584 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded 2024-09-21T01:01:49.584 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:01:49.584 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:01:49.584 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T01:01:49.585 INFO:teuthology.orchestra.run.smithi112.stdout: osd.0 (root=default,host=smithi112) is down 2024-09-21T01:01:49.585 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded 2024-09-21T01:01:49.585 INFO:teuthology.orchestra.run.smithi112.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-21T01:01:49.585 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-21T01:01:49.585 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-21T01:01:49.585 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-21T01:01:49.586 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-21T01:01:49.586 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-21T01:01:49.586 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-21T01:01:49.586 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-21T01:01:49.586 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-21T01:01:49.586 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-21T01:01:49.586 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-21T01:01:49.587 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-21T01:01:49.587 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-21T01:01:49.587 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-21T01:01:49.587 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-21T01:01:49.587 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-21T01:01:49.587 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-21T01:01:49.588 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-21T01:01:49.588 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-21T01:01:49.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c407af30 msgr2=0x7f67c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c407af30 0x7f67c407d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f67d0005fd0 tx=0x7f67d0005e20 comp rx=0 tx=0).stop 2024-09-21T01:01:49.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1007e0 msgr2=0x7f67dc19f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:49.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1007e0 0x7f67dc19f7c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67cc031460 tx=0x7f67cc0048f0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 shutdown_connections 2024-09-21T01:01:49.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f67c407af30 0x7f67c407d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67dc1067e0 0x7f67dc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 --2- 172.21.15.112:0/4006178682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67dc1007e0 0x7f67dc19f7c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:49.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 >> 172.21.15.112:0/4006178682 conn(0x7f67dc0fc4c0 msgr2=0x7f67dc069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:49.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 shutdown_connections 2024-09-21T01:01:49.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:01:49.585+0000 7f67e2661640 1 -- 172.21.15.112:0/4006178682 wait complete. 2024-09-21T01:01:50.327 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:50 smithi187 ceph-mon[78584]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:50.327 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:50 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4006178682' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:01:50.394 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:50 smithi112 ceph-mon[109687]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:01:50.394 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:50 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4006178682' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:01:51.010 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:50 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[118605]: 2024-09-21T01:01:50.780+0000 7f229f024640 -1 osd.0 46 log_to_monitors true 2024-09-21T01:01:51.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:51 smithi187 ceph-mon[78584]: pgmap v136: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:51.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:51 smithi187 ceph-mon[78584]: from='osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:01:51.510 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:01:51 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[118605]: 2024-09-21T01:01:51.089+0000 7f2296da4640 -1 osd.0 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:01:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:51 smithi112 ceph-mon[109687]: pgmap v136: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:51 smithi112 ceph-mon[109687]: from='osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:01:52.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:01:52.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T01:01:52.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T01:01:52.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:52.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:52 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T01:01:52.350 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:01:52.350 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T01:01:52.350 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T01:01:52.350 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:52.350 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:52.350 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:52.350 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:52.351 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:52.351 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:52.351 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:52.351 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:52.351 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:01:52.351 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:52 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T01:01:53.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:53 smithi112 ceph-mon[109687]: pgmap v138: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:53.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:53 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T01:01:53.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:53 smithi112 ceph-mon[109687]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T01:01:53.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:53 smithi112 ceph-mon[109687]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:01:53.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:53 smithi112 ceph-mon[109687]: osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830] boot 2024-09-21T01:01:53.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:53 smithi112 ceph-mon[109687]: osdmap e50: 6 total, 6 up, 6 in 2024-09-21T01:01:53.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:53 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:53 smithi187 ceph-mon[78584]: pgmap v138: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:53 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:53 smithi187 ceph-mon[78584]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:53 smithi187 ceph-mon[78584]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:53 smithi187 ceph-mon[78584]: osd.0 [v2:172.21.15.112:6802/4000276830,v1:172.21.15.112:6803/4000276830] boot 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:53 smithi187 ceph-mon[78584]: osdmap e50: 6 total, 6 up, 6 in 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:53 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:01:54.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:54 smithi187 ceph-mon[78584]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T01:01:54.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:54 smithi112 ceph-mon[109687]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T01:01:55.376 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:55 smithi112 ceph-mon[109687]: pgmap v141: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/279 objects degraded (2.867%) 2024-09-21T01:01:55.376 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:55 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T01:01:55.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:55 smithi187 ceph-mon[78584]: pgmap v141: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/279 objects degraded (2.867%) 2024-09-21T01:01:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:55 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T01:01:57.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:57 smithi187 ceph-mon[78584]: pgmap v142: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/279 objects degraded (2.867%) 2024-09-21T01:01:57.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:57 smithi112 ceph-mon[109687]: pgmap v142: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/279 objects degraded (2.867%) 2024-09-21T01:01:58.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:58 smithi187 ceph-mon[78584]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded) 2024-09-21T01:01:58.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:58 smithi112 ceph-mon[109687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded) 2024-09-21T01:01:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:59 smithi187 ceph-mon[78584]: pgmap v143: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:01:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:01:59.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:59 smithi112 ceph-mon[109687]: pgmap v143: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:01:59.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:01:59.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:01:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:01.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:01 smithi187 ceph-mon[78584]: pgmap v144: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:01.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:01 smithi112 ceph-mon[109687]: pgmap v144: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:03 smithi187 ceph-mon[78584]: pgmap v145: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:03.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:03 smithi112 ceph-mon[109687]: pgmap v145: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:04.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:04 smithi187 ceph-mon[78584]: pgmap v146: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:04.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:04.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:04 smithi112 ceph-mon[109687]: pgmap v146: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:07.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:06 smithi112 ceph-mon[109687]: pgmap v147: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:07.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:06 smithi187 ceph-mon[78584]: pgmap v147: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:07.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:07 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T01:02:07.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:07 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T01:02:07.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:07 smithi187 ceph-mon[78584]: Upgrade: osd.1 is safe to restart 2024-09-21T01:02:08.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:07 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T01:02:08.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:07 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T01:02:08.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:07 smithi112 ceph-mon[109687]: Upgrade: osd.1 is safe to restart 2024-09-21T01:02:08.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:08 smithi112 ceph-mon[109687]: pgmap v148: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:08.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:08.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:02:08.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:09.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:08 smithi187 ceph-mon[78584]: pgmap v148: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:09.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:09.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:02:09.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:09.979 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:09 smithi112 ceph-mon[109687]: Upgrade: Updating osd.1 2024-09-21T01:02:09.979 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:09 smithi112 ceph-mon[109687]: Deploying daemon osd.1 on smithi112 2024-09-21T01:02:10.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:09 smithi187 ceph-mon[78584]: Upgrade: Updating osd.1 2024-09-21T01:02:10.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:09 smithi187 ceph-mon[78584]: Deploying daemon osd.1 on smithi112 2024-09-21T01:02:10.962 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:10 smithi112 ceph-mon[109687]: pgmap v149: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:11.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:10 smithi187 ceph-mon[78584]: pgmap v149: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:11.939 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:11 smithi112 systemd[1]: Stopping Ceph osd.1 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:02:12.260 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:11 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[57907]: 2024-09-21T01:02:11.941+0000 7fc331ab3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:02:12.260 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:11 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[57907]: 2024-09-21T01:02:11.941+0000 7fc331ab3640 -1 osd.1 51 *** Got signal Terminated *** 2024-09-21T01:02:12.260 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:11 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[57907]: 2024-09-21T01:02:11.941+0000 7fc331ab3640 -1 osd.1 51 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:02:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:12 smithi112 ceph-mon[109687]: pgmap v150: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:12 smithi112 ceph-mon[109687]: osd.1 marked itself down and dead 2024-09-21T01:02:13.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:12 smithi187 ceph-mon[78584]: pgmap v150: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:13.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:12 smithi187 ceph-mon[78584]: osd.1 marked itself down and dead 2024-09-21T01:02:13.372 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:13 smithi112 podman[123279]: 2024-09-21 01:02:13.07148892 +0000 UTC m=+1.234652769 container died dddef3ba1872aa73e2c46d5afdd11109d44e197f9f657fad5b8e03508d6d195c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-4e45e6b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:02:13.686 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:13 smithi112 podman[123279]: 2024-09-21 01:02:13.575193827 +0000 UTC m=+1.738357673 container cleanup dddef3ba1872aa73e2c46d5afdd11109d44e197f9f657fad5b8e03508d6d195c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:02:13.686 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:13 smithi112 bash[123279]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1 2024-09-21T01:02:14.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:13 smithi112 ceph-mon[109687]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:02:14.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:13 smithi112 ceph-mon[109687]: osdmap e52: 6 total, 5 up, 6 in 2024-09-21T01:02:14.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:14.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:14.011 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:13 smithi112 podman[123307]: 2024-09-21 01:02:13.860640384 +0000 UTC m=+0.787010232 container remove dddef3ba1872aa73e2c46d5afdd11109d44e197f9f657fad5b8e03508d6d195c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T01:02:14.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:13 smithi187 ceph-mon[78584]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:02:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:13 smithi187 ceph-mon[78584]: osdmap e52: 6 total, 5 up, 6 in 2024-09-21T01:02:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:14.481 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:14 smithi112 podman[123397]: 2024-09-21 01:02:14.085330249 +0000 UTC m=+0.015686031 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:02:14.481 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:14 smithi112 podman[123397]: 2024-09-21 01:02:14.203111805 +0000 UTC m=+0.133467583 container create a430fca9f9b9ea5df403a9ffdb08afad901ce1e23f0459395eb5f427a23a3c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:02:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:14 smithi112 ceph-mon[109687]: pgmap v152: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:14 smithi112 ceph-mon[109687]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T01:02:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:14 smithi112 ceph-mon[109687]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-21T01:02:14.761 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:14 smithi112 podman[123397]: 2024-09-21 01:02:14.481015079 +0000 UTC m=+0.411370864 container init a430fca9f9b9ea5df403a9ffdb08afad901ce1e23f0459395eb5f427a23a3c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T01:02:14.761 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:14 smithi112 podman[123397]: 2024-09-21 01:02:14.484986635 +0000 UTC m=+0.415342411 container start a430fca9f9b9ea5df403a9ffdb08afad901ce1e23f0459395eb5f427a23a3c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T01:02:14.761 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:14 smithi112 podman[123397]: 2024-09-21 01:02:14.597583482 +0000 UTC m=+0.527939270 container attach a430fca9f9b9ea5df403a9ffdb08afad901ce1e23f0459395eb5f427a23a3c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:02:14.761 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:14 smithi112 podman[123397]: 2024-09-21 01:02:14.678925396 +0000 UTC m=+0.609281172 container died a430fca9f9b9ea5df403a9ffdb08afad901ce1e23f0459395eb5f427a23a3c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:02:15.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:14 smithi187 ceph-mon[78584]: pgmap v152: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:15.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:14 smithi187 ceph-mon[78584]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T01:02:15.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:14 smithi187 ceph-mon[78584]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-21T01:02:15.760 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:15 smithi112 podman[123420]: 2024-09-21 01:02:15.40189539 +0000 UTC m=+0.716943297 container remove a430fca9f9b9ea5df403a9ffdb08afad901ce1e23f0459395eb5f427a23a3c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T01:02:15.760 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:15 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T01:02:15.760 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:15 smithi112 systemd[1]: Stopped Ceph osd.1 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:02:15.760 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:15 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.1.service: Consumed 56.918s CPU time. 2024-09-21T01:02:15.761 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:15 smithi112 systemd[1]: Starting Ceph osd.1 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:02:16.139 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:15 smithi112 podman[123518]: 2024-09-21 01:02:15.744426737 +0000 UTC m=+0.015996713 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:02:16.139 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:15 smithi112 podman[123518]: 2024-09-21 01:02:15.878149367 +0000 UTC m=+0.149719322 container create 84e5f650695842bf097495c6de42d29c4d3df4b08d3d5f01be66a846689bf905 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T01:02:16.139 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:16 smithi112 podman[123518]: 2024-09-21 01:02:16.139056894 +0000 UTC m=+0.410626853 container init 84e5f650695842bf097495c6de42d29c4d3df4b08d3d5f01be66a846689bf905 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:02:16.510 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:16 smithi112 podman[123518]: 2024-09-21 01:02:16.142562844 +0000 UTC m=+0.414132808 container start 84e5f650695842bf097495c6de42d29c4d3df4b08d3d5f01be66a846689bf905 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T01:02:16.510 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:16 smithi112 podman[123518]: 2024-09-21 01:02:16.222296177 +0000 UTC m=+0.493866133 container attach 84e5f650695842bf097495c6de42d29c4d3df4b08d3d5f01be66a846689bf905 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:02:16.510 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:16 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:16.511 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:16 smithi112 bash[123518]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:16.511 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:16 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:16.511 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:16 smithi112 bash[123518]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:17.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:16 smithi112 ceph-mon[109687]: pgmap v154: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:17.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:16 smithi187 ceph-mon[78584]: pgmap v154: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:17.410 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T01:02:17.410 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 bash[123518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T01:02:17.410 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T01:02:17.411 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 bash[123518]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T01:02:17.726 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 bash[123518]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 bash[123518]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 bash[123518]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 bash[123518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate[123533]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 bash[123518]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-21T01:02:17.727 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:17 smithi112 podman[123518]: 2024-09-21 01:02:17.437956099 +0000 UTC m=+1.709526055 container died 84e5f650695842bf097495c6de42d29c4d3df4b08d3d5f01be66a846689bf905 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T01:02:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:17 smithi112 ceph-mon[109687]: Health check failed: Degraded data redundancy: 2/279 objects degraded (0.717%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T01:02:18.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:17 smithi187 ceph-mon[78584]: Health check failed: Degraded data redundancy: 2/279 objects degraded (0.717%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T01:02:18.398 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 podman[123669]: 2024-09-21 01:02:18.04339888 +0000 UTC m=+0.599548823 container remove 84e5f650695842bf097495c6de42d29c4d3df4b08d3d5f01be66a846689bf905 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:02:18.398 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 podman[123730]: 2024-09-21 01:02:18.152489629 +0000 UTC m=+0.016087758 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:02:18.398 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 podman[123730]: 2024-09-21 01:02:18.269261293 +0000 UTC m=+0.132859447 container create 373b804b4706a448c8124683a1435e5358ea6e21b1c2f74f13fd1a6989f0a01e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T01:02:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:18 smithi112 ceph-mon[109687]: pgmap v155: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2/279 objects degraded (0.717%) 2024-09-21T01:02:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:18 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:18 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:18 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:19.011 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 podman[123730]: 2024-09-21 01:02:18.53863379 +0000 UTC m=+0.402231902 container init 373b804b4706a448c8124683a1435e5358ea6e21b1c2f74f13fd1a6989f0a01e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:02:19.011 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 podman[123730]: 2024-09-21 01:02:18.542311611 +0000 UTC m=+0.405909732 container start 373b804b4706a448c8124683a1435e5358ea6e21b1c2f74f13fd1a6989f0a01e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:02:19.011 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 ceph-osd[123749]: -- 172.21.15.112:0/2339811861 <== mon.0 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56491da9a1e0 con 0x56491cd8b180 2024-09-21T01:02:19.011 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 bash[123730]: 373b804b4706a448c8124683a1435e5358ea6e21b1c2f74f13fd1a6989f0a01e 2024-09-21T01:02:19.011 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:18 smithi112 systemd[1]: Started Ceph osd.1 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:02:19.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:18 smithi187 ceph-mon[78584]: pgmap v155: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2/279 objects degraded (0.717%) 2024-09-21T01:02:19.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:18 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:19.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:18 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:19.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:18 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:19.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 -- 172.21.15.112:0/289301386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 msgr2=0x7f2570102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 --2- 172.21.15.112:0/289301386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f2570102e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2560009880 tx=0x7f256002a530 comp rx=0 tx=0).stop 2024-09-21T01:02:19.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 -- 172.21.15.112:0/289301386 shutdown_connections 2024-09-21T01:02:19.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 --2- 172.21.15.112:0/289301386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25701033c0 0x7f257010b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 --2- 172.21.15.112:0/289301386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f2570102e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 -- 172.21.15.112:0/289301386 >> 172.21.15.112:0/289301386 conn(0x7f25700fc4c0 msgr2=0x7f25700fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:19.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 -- 172.21.15.112:0/289301386 shutdown_connections 2024-09-21T01:02:19.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.671+0000 7f257507f640 1 -- 172.21.15.112:0/289301386 wait complete. 2024-09-21T01:02:19.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.672+0000 7f257507f640 1 Processor -- start 2024-09-21T01:02:19.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.672+0000 7f257507f640 1 -- start start 2024-09-21T01:02:19.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.672+0000 7f257507f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f257019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:19.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.672+0000 7f257507f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25701033c0 0x7f257019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f257507f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f257010edb0 con 0x7f2570102aa0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f257507f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f257010ec30 con 0x7f25701033c0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f257019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f257019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51310/0 (socket says 172.21.15.112:51310) 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256ed9d640 1 -- 172.21.15.112:0/910418086 learned_addr learned my addr 172.21.15.112:0/910418086 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256e59c640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25701033c0 0x7f257019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256ed9d640 1 -- 172.21.15.112:0/910418086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25701033c0 msgr2=0x7f257019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256ed9d640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25701033c0 0x7f257019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256ed9d640 1 -- 172.21.15.112:0/910418086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2570197780 con 0x7f2570102aa0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f256ed9d640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f257019d600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2560031460 tx=0x7f25600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f2557fff640 1 -- 172.21.15.112:0/910418086 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f256003f070 con 0x7f2570102aa0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2570197a10 con 0x7f2570102aa0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f2557fff640 1 -- 172.21.15.112:0/910418086 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25600035f0 con 0x7f2570102aa0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.673+0000 7f2557fff640 1 -- 172.21.15.112:0/910418086 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2560035030 con 0x7f2570102aa0 2024-09-21T01:02:19.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.674+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2570197f40 con 0x7f2570102aa0 2024-09-21T01:02:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.675+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257006a410 con 0x7f2570102aa0 2024-09-21T01:02:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.675+0000 7f2557fff640 1 -- 172.21.15.112:0/910418086 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2560042070 con 0x7f2570102aa0 2024-09-21T01:02:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.676+0000 7f2557fff640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f255807af30 0x7f255807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.676+0000 7f2557fff640 1 -- 172.21.15.112:0/910418086 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6156+0+0 (secure 0 0 0) 0x7f25600be9d0 con 0x7f2570102aa0 2024-09-21T01:02:19.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.676+0000 7f256e59c640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f255807af30 0x7f255807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:19.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.676+0000 7f256e59c640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f255807af30 0x7f255807d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25640058c0 tx=0x7f2564005850 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:19.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.680+0000 7f2557fff640 1 -- 172.21.15.112:0/910418086 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2560089fd0 con 0x7f2570102aa0 2024-09-21T01:02:19.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.908+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f25701982b0 con 0x7f255807af30 2024-09-21T01:02:19.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.910+0000 7f2557fff640 1 -- 172.21.15.112:0/910418086 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f25701982b0 con 0x7f255807af30 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f255807af30 msgr2=0x7f255807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f255807af30 0x7f255807d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25640058c0 tx=0x7f2564005850 comp rx=0 tx=0).stop 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 msgr2=0x7f257019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f257019d600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2560031460 tx=0x7f25600045e0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 shutdown_connections 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f255807af30 0x7f255807d3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25701033c0 0x7f257019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 --2- 172.21.15.112:0/910418086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570102aa0 0x7f257019d600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 >> 172.21.15.112:0/910418086 conn(0x7f25700fc4c0 msgr2=0x7f2570108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:19.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 shutdown_connections 2024-09-21T01:02:19.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.912+0000 7f257507f640 1 -- 172.21.15.112:0/910418086 wait complete. 2024-09-21T01:02:19.922 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:02:19.922 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:19 smithi112 ceph-mon[109687]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-21T01:02:19.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 -- 172.21.15.112:0/4000412373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 msgr2=0x7f08e0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 --2- 172.21.15.112:0/4000412373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e0106c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009880 tx=0x7f08d002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 -- 172.21.15.112:0/4000412373 shutdown_connections 2024-09-21T01:02:19.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 --2- 172.21.15.112:0/4000412373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08e0100820 0x7f08e0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 --2- 172.21.15.112:0/4000412373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e0106c00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 -- 172.21.15.112:0/4000412373 >> 172.21.15.112:0/4000412373 conn(0x7f08e00fc520 msgr2=0x7f08e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:19.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 -- 172.21.15.112:0/4000412373 shutdown_connections 2024-09-21T01:02:19.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 -- 172.21.15.112:0/4000412373 wait complete. 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 Processor -- start 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.997+0000 7f08e61cd640 1 -- start start 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08e61cd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08e0100820 0x7f08e010b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08e61cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e010bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08e61cd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08e010edf0 con 0x7f08e0106820 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08e61cd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f08e010ec70 con 0x7f08e0100820 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08d6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e010bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08d6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e010bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51318/0 (socket says 172.21.15.112:51318) 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08d6ffd640 1 -- 172.21.15.112:0/1507541895 learned_addr learned my addr 172.21.15.112:0/1507541895 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08df7fe640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08e0100820 0x7f08e010b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08d6ffd640 1 -- 172.21.15.112:0/1507541895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08e0100820 msgr2=0x7f08e010b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08d6ffd640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08e0100820 0x7f08e010b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08d6ffd640 1 -- 172.21.15.112:0/1507541895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e010c230 con 0x7f08e0106820 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.998+0000 7f08d6ffd640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e010bcf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08c800d6f0 tx=0x7f08c800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.999+0000 7f08dd7fa640 1 -- 172.21.15.112:0/1507541895 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08c8017070 con 0x7f08e0106820 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.999+0000 7f08dd7fa640 1 -- 172.21.15.112:0/1507541895 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08c800de00 con 0x7f08e0106820 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.999+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e010c520 con 0x7f08e0106820 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.999+0000 7f08dd7fa640 1 -- 172.21.15.112:0/1507541895 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08c8004bb0 con 0x7f08e0106820 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:19.999+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e01a3e60 con 0x7f08e0106820 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.000+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e0101f60 con 0x7f08e0106820 2024-09-21T01:02:20.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.001+0000 7f08dd7fa640 1 -- 172.21.15.112:0/1507541895 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f08c8004e60 con 0x7f08e0106820 2024-09-21T01:02:20.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.001+0000 7f08dd7fa640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08cc07af30 0x7f08cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.002+0000 7f08df7fe640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08cc07af30 0x7f08cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.002+0000 7f08dd7fa640 1 -- 172.21.15.112:0/1507541895 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6156+0+0 (secure 0 0 0) 0x7f08c809dba0 con 0x7f08e0106820 2024-09-21T01:02:20.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.002+0000 7f08df7fe640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08cc07af30 0x7f08cc07d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08d00096c0 tx=0x7f08d0031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.006+0000 7f08dd7fa640 1 -- 172.21.15.112:0/1507541895 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08c80691a0 con 0x7f08e0106820 2024-09-21T01:02:20.060 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:19 smithi187 ceph-mon[78584]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-21T01:02:20.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.213+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08e0062630 con 0x7f08cc07af30 2024-09-21T01:02:20.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.214+0000 7f08dd7fa640 1 -- 172.21.15.112:0/1507541895 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f08e0062630 con 0x7f08cc07af30 2024-09-21T01:02:20.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08cc07af30 msgr2=0x7f08cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08cc07af30 0x7f08cc07d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08d00096c0 tx=0x7f08d0031400 comp rx=0 tx=0).stop 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 msgr2=0x7f08e010bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e010bcf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08c800d6f0 tx=0x7f08c800dbb0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 shutdown_connections 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08cc07af30 0x7f08cc07d3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08e0106820 0x7f08e010bcf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 --2- 172.21.15.112:0/1507541895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08e0100820 0x7f08e010b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 >> 172.21.15.112:0/1507541895 conn(0x7f08e00fc520 msgr2=0x7f08e00fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 shutdown_connections 2024-09-21T01:02:20.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.217+0000 7f08e61cd640 1 -- 172.21.15.112:0/1507541895 wait complete. 2024-09-21T01:02:20.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/656728019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94102ae0 msgr2=0x7f4b94102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/656728019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94102ae0 0x7f4b94102ec0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009880 tx=0x7f4b8402a530 comp rx=0 tx=0).stop 2024-09-21T01:02:20.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/656728019 shutdown_connections 2024-09-21T01:02:20.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/656728019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b94103400 0x7f4b9410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/656728019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94102ae0 0x7f4b94102ec0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/656728019 >> 172.21.15.112:0/656728019 conn(0x7f4b940fc520 msgr2=0x7f4b940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/656728019 shutdown_connections 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.299+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/656728019 wait complete. 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b9bf5d640 1 Processor -- start 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b9bf5d640 1 -- start start 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b9bf5d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b94102ae0 0x7f4b94100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b9bf5d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94103400 0x7f4b94100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b9bf5d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9410edf0 con 0x7f4b94103400 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b9bf5d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9410ec70 con 0x7f4b94102ae0 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b994f8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94103400 0x7f4b94100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b994f8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94103400 0x7f4b94100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51334/0 (socket says 172.21.15.112:51334) 2024-09-21T01:02:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b994f8640 1 -- 172.21.15.112:0/4036818852 learned_addr learned my addr 172.21.15.112:0/4036818852 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b994f8640 1 -- 172.21.15.112:0/4036818852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b94102ae0 msgr2=0x7f4b94100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b99cf9640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b94102ae0 0x7f4b94100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b994f8640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b94102ae0 0x7f4b94100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b994f8640 1 -- 172.21.15.112:0/4036818852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b941011c0 con 0x7f4b94103400 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.300+0000 7f4b994f8640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94103400 0x7f4b94100c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000d6c0 tx=0x7f4b9000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.301+0000 7f4b8affd640 1 -- 172.21.15.112:0/4036818852 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b90017070 con 0x7f4b94103400 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.301+0000 7f4b8affd640 1 -- 172.21.15.112:0/4036818852 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b90009ce0 con 0x7f4b94103400 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.301+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b941014b0 con 0x7f4b94103400 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.301+0000 7f4b8affd640 1 -- 172.21.15.112:0/4036818852 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b9000f3c0 con 0x7f4b94103400 2024-09-21T01:02:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.301+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b941a3e60 con 0x7f4b94103400 2024-09-21T01:02:20.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.302+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9406abe0 con 0x7f4b94103400 2024-09-21T01:02:20.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.303+0000 7f4b8affd640 1 -- 172.21.15.112:0/4036818852 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4b90010460 con 0x7f4b94103400 2024-09-21T01:02:20.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.303+0000 7f4b8affd640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4b8007af30 0x7f4b8007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.303+0000 7f4b8affd640 1 -- 172.21.15.112:0/4036818852 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6156+0+0 (secure 0 0 0) 0x7f4b9009dde0 con 0x7f4b94103400 2024-09-21T01:02:20.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.303+0000 7f4b99cf9640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4b8007af30 0x7f4b8007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.304+0000 7f4b99cf9640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4b8007af30 0x7f4b8007d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b84031460 tx=0x7f4b84009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.308+0000 7f4b8affd640 1 -- 172.21.15.112:0/4036818852 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b900693e0 con 0x7f4b94103400 2024-09-21T01:02:20.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.497+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4b94062630 con 0x7f4b8007af30 2024-09-21T01:02:20.498 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:20 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[123745]: 2024-09-21T01:02:20.182+0000 7fdb8c24b640 -1 Falling back to public interface 2024-09-21T01:02:20.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.507+0000 7f4b8affd640 1 -- 172.21.15.112:0/4036818852 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4b94062630 con 0x7f4b8007af30 2024-09-21T01:02:20.507 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (2m) 32s ago 13m 19.7M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (5m) 32s ago 13m 8753k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (5m) 55s ago 13m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (63s) 32s ago 13m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (58s) 55s ago 13m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (2m) 32s ago 13m 80.8M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (8m) 32s ago 8m 150M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (8m) 32s ago 8m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (8m) 55s ago 8m 20.0M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (8m) 55s ago 8m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (5m) 32s ago 14m 590M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (3m) 55s ago 12m 522M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (92s) 32s ago 15m 106M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:02:20.508 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (76s) 55s ago 12m 93.3M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (3m) 32s ago 13m 10.5M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (3m) 55s ago 12m 10.5M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (37s) 32s ago 11m 81.0M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 starting - - - 1216M 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (10m) 32s ago 10m 177M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (10m) 55s ago 10m 254M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (9m) 55s ago 9m 206M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (9m) 55s ago 9m 191M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:02:20.509 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (3m) 32s ago 13m 49.5M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4b8007af30 msgr2=0x7f4b8007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4b8007af30 0x7f4b8007d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b84031460 tx=0x7f4b84009560 comp rx=0 tx=0).stop 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94103400 msgr2=0x7f4b94100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94103400 0x7f4b94100c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000d6c0 tx=0x7f4b9000db80 comp rx=0 tx=0).stop 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 shutdown_connections 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4b8007af30 0x7f4b8007d3f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b94103400 0x7f4b94100c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 --2- 172.21.15.112:0/4036818852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b94102ae0 0x7f4b94100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 >> 172.21.15.112:0/4036818852 conn(0x7f4b940fc520 msgr2=0x7f4b94108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 shutdown_connections 2024-09-21T01:02:20.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.509+0000 7f4b9bf5d640 1 -- 172.21.15.112:0/4036818852 wait complete. 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 -- 172.21.15.112:0/1819063819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 msgr2=0x7fc41410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 --2- 172.21.15.112:0/1819063819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 0x7fc41410b8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc400009880 tx=0x7fc40002a530 comp rx=0 tx=0).stop 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 -- 172.21.15.112:0/1819063819 shutdown_connections 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 --2- 172.21.15.112:0/1819063819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 0x7fc41410b8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 --2- 172.21.15.112:0/1819063819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc414102ae0 0x7fc414102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 -- 172.21.15.112:0/1819063819 >> 172.21.15.112:0/1819063819 conn(0x7fc4140fc520 msgr2=0x7fc4140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 -- 172.21.15.112:0/1819063819 shutdown_connections 2024-09-21T01:02:20.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.597+0000 7fc41ac11640 1 -- 172.21.15.112:0/1819063819 wait complete. 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc41ac11640 1 Processor -- start 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc41ac11640 1 -- start start 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc41ac11640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc414102ae0 0x7fc41419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc41ac11640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 0x7fc41419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc41ac11640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc414102550 con 0x7fc414103400 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc41ac11640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141023d0 con 0x7fc414102ae0 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc413fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 0x7fc41419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc413fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 0x7fc41419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51350/0 (socket says 172.21.15.112:51350) 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc413fff640 1 -- 172.21.15.112:0/3788303520 learned_addr learned my addr 172.21.15.112:0/3788303520 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc4189ad640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc414102ae0 0x7fc41419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc4189ad640 1 -- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 msgr2=0x7fc41419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.598+0000 7fc4189ad640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 0x7fc41419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.599+0000 7fc4189ad640 1 -- 172.21.15.112:0/3788303520 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc414199a40 con 0x7fc414102ae0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.599+0000 7fc4189ad640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc414102ae0 0x7fc41419f880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc40800e970 tx=0x7fc40800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.599+0000 7fc411ffb640 1 -- 172.21.15.112:0/3788303520 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc40800cac0 con 0x7fc414102ae0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.599+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc414199d30 con 0x7fc414102ae0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.599+0000 7fc411ffb640 1 -- 172.21.15.112:0/3788303520 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc40800cc60 con 0x7fc414102ae0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.599+0000 7fc411ffb640 1 -- 172.21.15.112:0/3788303520 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4080047a0 con 0x7fc414102ae0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.599+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41419a290 con 0x7fc414102ae0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.600+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41406abe0 con 0x7fc414102ae0 2024-09-21T01:02:20.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.601+0000 7fc411ffb640 1 -- 172.21.15.112:0/3788303520 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc408004ab0 con 0x7fc414102ae0 2024-09-21T01:02:20.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.602+0000 7fc411ffb640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc40407af30 0x7fc40407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.602+0000 7fc413fff640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc40407af30 0x7fc40407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.602+0000 7fc411ffb640 1 -- 172.21.15.112:0/3788303520 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6156+0+0 (secure 0 0 0) 0x7fc40809e510 con 0x7fc414102ae0 2024-09-21T01:02:20.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.602+0000 7fc413fff640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc40407af30 0x7fc40407d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc41419b230 tx=0x7fc4000058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.607+0000 7fc411ffb640 1 -- 172.21.15.112:0/3788303520 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc408069a70 con 0x7fc414102ae0 2024-09-21T01:02:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.877+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc41419af70 con 0x7fc414102ae0 2024-09-21T01:02:20.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.878+0000 7fc411ffb640 1 -- 172.21.15.112:0/3788303520 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fc40806e920 con 0x7fc414102ae0 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4, 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:02:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:02:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8, 2024-09-21T01:02:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 5 2024-09-21T01:02:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:02:20.880 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:02:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc40407af30 msgr2=0x7fc40407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc40407af30 0x7fc40407d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc41419b230 tx=0x7fc4000058d0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc414102ae0 msgr2=0x7fc41419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc414102ae0 0x7fc41419f880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc40800e970 tx=0x7fc40800ee30 comp rx=0 tx=0).stop 2024-09-21T01:02:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 shutdown_connections 2024-09-21T01:02:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc40407af30 0x7fc40407d3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc414103400 0x7fc41419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 --2- 172.21.15.112:0/3788303520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc414102ae0 0x7fc41419f880 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.880+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 >> 172.21.15.112:0/3788303520 conn(0x7fc4140fc520 msgr2=0x7fc414108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.881+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 shutdown_connections 2024-09-21T01:02:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.881+0000 7fc41ac11640 1 -- 172.21.15.112:0/3788303520 wait complete. 2024-09-21T01:02:20.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.964+0000 7f5dba2f2640 1 -- 172.21.15.112:0/2014185934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db40ffd70 msgr2=0x7f5db41001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.964+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/2014185934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db40ffd70 0x7f5db41001d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009880 tx=0x7f5da802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.964+0000 7f5dba2f2640 1 -- 172.21.15.112:0/2014185934 shutdown_connections 2024-09-21T01:02:20.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.964+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/2014185934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db40ffd70 0x7f5db41001d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.964+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/2014185934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db4106950 0x7f5db4106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.965+0000 7f5dba2f2640 1 -- 172.21.15.112:0/2014185934 >> 172.21.15.112:0/2014185934 conn(0x7f5db40fbc60 msgr2=0x7f5db40fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:20.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.965+0000 7f5dba2f2640 1 -- 172.21.15.112:0/2014185934 shutdown_connections 2024-09-21T01:02:20.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.965+0000 7f5dba2f2640 1 -- 172.21.15.112:0/2014185934 wait complete. 2024-09-21T01:02:20.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.965+0000 7f5dba2f2640 1 Processor -- start 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.965+0000 7f5dba2f2640 1 -- start start 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5dba2f2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db40ffd70 0x7f5db4100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5dba2f2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db4106950 0x7f5db4101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5dba2f2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5db410eef0 con 0x7f5db4106950 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5dba2f2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5db410ed70 con 0x7f5db40ffd70 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db4106950 0x7f5db4101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db4106950 0x7f5db4101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51374/0 (socket says 172.21.15.112:51374) 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db37fe640 1 -- 172.21.15.112:0/187136028 learned_addr learned my addr 172.21.15.112:0/187136028 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db3fff640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db40ffd70 0x7f5db4100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db37fe640 1 -- 172.21.15.112:0/187136028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db40ffd70 msgr2=0x7f5db4100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db37fe640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db40ffd70 0x7f5db4100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:20.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db37fe640 1 -- 172.21.15.112:0/187136028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db41019d0 con 0x7f5db4106950 2024-09-21T01:02:20.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db37fe640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db4106950 0x7f5db4101490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5da8031460 tx=0x7f5da80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db17fa640 1 -- 172.21.15.112:0/187136028 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5da803f070 con 0x7f5db4106950 2024-09-21T01:02:20.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db4101c60 con 0x7f5db4106950 2024-09-21T01:02:20.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db17fa640 1 -- 172.21.15.112:0/187136028 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5da8004b10 con 0x7f5db4106950 2024-09-21T01:02:20.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.966+0000 7f5db17fa640 1 -- 172.21.15.112:0/187136028 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5da8035030 con 0x7f5db4106950 2024-09-21T01:02:20.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.967+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db41a3e20 con 0x7f5db4106950 2024-09-21T01:02:20.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.968+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db4103090 con 0x7f5db4106950 2024-09-21T01:02:20.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.968+0000 7f5db17fa640 1 -- 172.21.15.112:0/187136028 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f5da8042070 con 0x7f5db4106950 2024-09-21T01:02:20.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.969+0000 7f5db17fa640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f5d9c07af40 0x7f5d9c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:20.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.969+0000 7f5db17fa640 1 -- 172.21.15.112:0/187136028 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6156+0+0 (secure 0 0 0) 0x7f5da80beaa0 con 0x7f5db4106950 2024-09-21T01:02:20.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.969+0000 7f5db3fff640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f5d9c07af40 0x7f5d9c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:20.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.969+0000 7f5db3fff640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f5d9c07af40 0x7f5d9c07d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5da4005fd0 tx=0x7f5da400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:20.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:20.973+0000 7f5db17fa640 1 -- 172.21.15.112:0/187136028 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5da808a0a0 con 0x7f5db4106950 2024-09-21T01:02:21.063 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:20 smithi112 ceph-mon[109687]: pgmap v156: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:21.063 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:20 smithi112 ceph-mon[109687]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:21.063 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:20 smithi112 ceph-mon[109687]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:21.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:20 smithi187 ceph-mon[78584]: pgmap v156: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:21.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:20 smithi187 ceph-mon[78584]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:21.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:20 smithi187 ceph-mon[78584]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:21.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.192+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5db41024b0 con 0x7f5db4106950 2024-09-21T01:02:21.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.193+0000 7f5db17fa640 1 -- 172.21.15.112:0/187136028 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7f5db41024b0 con 0x7f5db4106950 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:02:21.194 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:02:21.195 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:21.196 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:02:21.197 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:21.197 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:21.197 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:02:21.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f5d9c07af40 msgr2=0x7f5d9c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f5d9c07af40 0x7f5d9c07d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5da4005fd0 tx=0x7f5da400b390 comp rx=0 tx=0).stop 2024-09-21T01:02:21.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db4106950 msgr2=0x7f5db4101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db4106950 0x7f5db4101490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5da8031460 tx=0x7f5da80045e0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 shutdown_connections 2024-09-21T01:02:21.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f5d9c07af40 0x7f5d9c07d400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5db4106950 0x7f5db4101490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 --2- 172.21.15.112:0/187136028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db40ffd70 0x7f5db4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 >> 172.21.15.112:0/187136028 conn(0x7f5db40fbc60 msgr2=0x7f5db40fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:21.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 shutdown_connections 2024-09-21T01:02:21.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.195+0000 7f5dba2f2640 1 -- 172.21.15.112:0/187136028 wait complete. 2024-09-21T01:02:21.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 -- 172.21.15.112:0/3457050228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 msgr2=0x7f0214107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 --2- 172.21.15.112:0/3457050228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214107cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0204009880 tx=0x7f020402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 -- 172.21.15.112:0/3457050228 shutdown_connections 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 --2- 172.21.15.112:0/3457050228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0214101910 0x7f0214101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 --2- 172.21.15.112:0/3457050228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214107cf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 -- 172.21.15.112:0/3457050228 >> 172.21.15.112:0/3457050228 conn(0x7f02140fd630 msgr2=0x7f02140ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 -- 172.21.15.112:0/3457050228 shutdown_connections 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 -- 172.21.15.112:0/3457050228 wait complete. 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.280+0000 7f021985b640 1 Processor -- start 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f021985b640 1 -- start start 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f021985b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0214101910 0x7f02140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f021985b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f021985b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f021410edc0 con 0x7f0214107910 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f021985b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f021410ec40 con 0x7f0214101910 2024-09-21T01:02:21.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f020bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f020bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51394/0 (socket says 172.21.15.112:51394) 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f020bfff640 1 -- 172.21.15.112:0/2379258157 learned_addr learned my addr 172.21.15.112:0/2379258157 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f0212ffd640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0214101910 0x7f02140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f020bfff640 1 -- 172.21.15.112:0/2379258157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0214101910 msgr2=0x7f02140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f020bfff640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0214101910 0x7f02140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f020bfff640 1 -- 172.21.15.112:0/2379258157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0214074f70 con 0x7f0214107910 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f0212ffd640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0214101910 0x7f02140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f020bfff640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214074a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c8a0 tx=0x7f01fc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.281+0000 7f0218859640 1 -- 172.21.15.112:0/2379258157 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01fc0079b0 con 0x7f0214107910 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.282+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0214075260 con 0x7f0214107910 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.282+0000 7f0218859640 1 -- 172.21.15.112:0/2379258157 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01fc007b50 con 0x7f0214107910 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.282+0000 7f0218859640 1 -- 172.21.15.112:0/2379258157 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01fc018700 con 0x7f0214107910 2024-09-21T01:02:21.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.282+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02141a3db0 con 0x7f0214107910 2024-09-21T01:02:21.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.283+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0214103050 con 0x7f0214107910 2024-09-21T01:02:21.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.283+0000 7f0218859640 1 -- 172.21.15.112:0/2379258157 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f01fc007d00 con 0x7f0214107910 2024-09-21T01:02:21.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.284+0000 7f0218859640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f020007af30 0x7f020007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:21.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.284+0000 7f0212ffd640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f020007af30 0x7f020007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:21.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.284+0000 7f0218859640 1 -- 172.21.15.112:0/2379258157 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6156+0+0 (secure 0 0 0) 0x7f01fc09e310 con 0x7f0214107910 2024-09-21T01:02:21.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.285+0000 7f0212ffd640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f020007af30 0x7f020007d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0204006010 tx=0x7f02040095f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:21.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.289+0000 7f0218859640 1 -- 172.21.15.112:0/2379258157 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01fc014030 con 0x7f0214107910 2024-09-21T01:02:21.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.494+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0214062630 con 0x7f020007af30 2024-09-21T01:02:21.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.496+0000 7f0218859640 1 -- 172.21.15.112:0/2379258157 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f0214062630 con 0x7f020007af30 2024-09-21T01:02:21.496 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:02:21.496 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "7/23 daemons upgraded", 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:02:21.497 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:02:21.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f020007af30 msgr2=0x7f020007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f020007af30 0x7f020007d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0204006010 tx=0x7f02040095f0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 msgr2=0x7f0214074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214074a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c8a0 tx=0x7f01fc00cd60 comp rx=0 tx=0).stop 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 shutdown_connections 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f020007af30 0x7f020007d3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0214107910 0x7f0214074a30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 --2- 172.21.15.112:0/2379258157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0214101910 0x7f02140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 >> 172.21.15.112:0/2379258157 conn(0x7f02140fd630 msgr2=0x7f02140fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 shutdown_connections 2024-09-21T01:02:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.498+0000 7f021985b640 1 -- 172.21.15.112:0/2379258157 wait complete. 2024-09-21T01:02:21.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.583+0000 7f2bd0b49640 1 -- 172.21.15.112:0/756276843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 msgr2=0x7f2bcc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.583+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/756276843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc101d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009880 tx=0x7f2bc002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.583+0000 7f2bd0b49640 1 -- 172.21.15.112:0/756276843 shutdown_connections 2024-09-21T01:02:21.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.583+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/756276843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc101d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.583+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/756276843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bcc107910 0x7f2bcc107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.583+0000 7f2bd0b49640 1 -- 172.21.15.112:0/756276843 >> 172.21.15.112:0/756276843 conn(0x7f2bcc0fd5f0 msgr2=0x7f2bcc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:21.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.584+0000 7f2bd0b49640 1 -- 172.21.15.112:0/756276843 shutdown_connections 2024-09-21T01:02:21.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.584+0000 7f2bd0b49640 1 -- 172.21.15.112:0/756276843 wait complete. 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.584+0000 7f2bd0b49640 1 Processor -- start 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.584+0000 7f2bd0b49640 1 -- start start 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.584+0000 7f2bd0b49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bd0b49640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bcc107910 0x7f2bcc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bd0b49640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc10ede0 con 0x7f2bcc101910 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bd0b49640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc10ec60 con 0x7f2bcc107910 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bca59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:21.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bca59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51406/0 (socket says 172.21.15.112:51406) 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bca59c640 1 -- 172.21.15.112:0/3915312944 learned_addr learned my addr 172.21.15.112:0/3915312944 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bc9d9b640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bcc107910 0x7f2bcc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bca59c640 1 -- 172.21.15.112:0/3915312944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bcc107910 msgr2=0x7f2bcc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bca59c640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bcc107910 0x7f2bcc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bca59c640 1 -- 172.21.15.112:0/3915312944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc074f70 con 0x7f2bcc101910 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bca59c640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc0744f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c8f0 tx=0x7f2bc400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bbb7fe640 1 -- 172.21.15.112:0/3915312944 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bc40079b0 con 0x7f2bcc101910 2024-09-21T01:02:21.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bcc075260 con 0x7f2bcc101910 2024-09-21T01:02:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bbb7fe640 1 -- 172.21.15.112:0/3915312944 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bc40054e0 con 0x7f2bcc101910 2024-09-21T01:02:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bbb7fe640 1 -- 172.21.15.112:0/3915312944 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bc4004dd0 con 0x7f2bcc101910 2024-09-21T01:02:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.585+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bcc1a3e50 con 0x7f2bcc101910 2024-09-21T01:02:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.586+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bcc103050 con 0x7f2bcc101910 2024-09-21T01:02:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.587+0000 7f2bbb7fe640 1 -- 172.21.15.112:0/3915312944 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2bc4005020 con 0x7f2bcc101910 2024-09-21T01:02:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.587+0000 7f2bbb7fe640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2bb407aed0 0x7f2bb407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.588+0000 7f2bc9d9b640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2bb407aed0 0x7f2bb407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.588+0000 7f2bbb7fe640 1 -- 172.21.15.112:0/3915312944 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6156+0+0 (secure 0 0 0) 0x7f2bc409df20 con 0x7f2bcc101910 2024-09-21T01:02:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.588+0000 7f2bc9d9b640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2bb407aed0 0x7f2bb407d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc075f80 tx=0x7f2bc0031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:21.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.592+0000 7f2bbb7fe640 1 -- 172.21.15.112:0/3915312944 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2bc4014030 con 0x7f2bcc101910 2024-09-21T01:02:21.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.852+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2bcc101d70 con 0x7f2bcc101910 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.853+0000 7f2bbb7fe640 1 -- 172.21.15.112:0/3915312944 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1182 (secure 0 0 0) 0x7f2bc4069520 con 0x7f2bcc101910 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout: osd.1 (root=default,host=smithi112) is down 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-21T01:02:21.854 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-21T01:02:21.855 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2bb407aed0 msgr2=0x7f2bb407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2bb407aed0 0x7f2bb407d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc075f80 tx=0x7f2bc0031400 comp rx=0 tx=0).stop 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 msgr2=0x7f2bcc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc0744f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c8f0 tx=0x7f2bc400cdb0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 shutdown_connections 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2bb407aed0 0x7f2bb407d390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bcc107910 0x7f2bcc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 --2- 172.21.15.112:0/3915312944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc101910 0x7f2bcc0744f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 >> 172.21.15.112:0/3915312944 conn(0x7f2bcc0fd5f0 msgr2=0x7f2bcc0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 shutdown_connections 2024-09-21T01:02:21.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:21.855+0000 7f2bd0b49640 1 -- 172.21.15.112:0/3915312944 wait complete. 2024-09-21T01:02:22.072 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:21 smithi112 ceph-mon[109687]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:22.072 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:21 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3788303520' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:22.072 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:21 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/187136028' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:02:22.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:21 smithi187 ceph-mon[78584]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:22.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:21 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3788303520' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:22.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:21 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/187136028' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:02:22.977 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:22 smithi112 ceph-mon[109687]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:22.978 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:22 smithi112 ceph-mon[109687]: pgmap v157: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:22.978 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:22 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3915312944' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:02:23.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:22 smithi187 ceph-mon[78584]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:23.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:22 smithi187 ceph-mon[78584]: pgmap v157: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:23.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:22 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3915312944' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:02:25.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:24 smithi112 ceph-mon[109687]: pgmap v158: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:25.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:24 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T01:02:25.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:25.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:25.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:25.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:24 smithi187 ceph-mon[78584]: pgmap v158: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:24 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T01:02:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:25.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:26.972 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:26 smithi112 ceph-mon[109687]: pgmap v159: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:27.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:26 smithi187 ceph-mon[78584]: pgmap v159: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:27.260 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:26 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[123745]: 2024-09-21T01:02:26.971+0000 7fdb8c24b640 -1 osd.1 51 log_to_monitors true 2024-09-21T01:02:27.920 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:27 smithi112 ceph-mon[109687]: from='osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:02:28.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:27 smithi187 ceph-mon[78584]: from='osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:02:28.260 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:02:27 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[123745]: 2024-09-21T01:02:27.919+0000 7fdb7ffc3640 -1 osd.1 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: pgmap v160: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:29.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T01:02:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: pgmap v160: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:02:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:29.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T01:02:30.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:29 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T01:02:30.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:29 smithi187 ceph-mon[78584]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T01:02:30.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:29 smithi187 ceph-mon[78584]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:02:30.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:29 smithi187 ceph-mon[78584]: osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732] boot 2024-09-21T01:02:30.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:29 smithi187 ceph-mon[78584]: osdmap e55: 6 total, 6 up, 6 in 2024-09-21T01:02:30.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:02:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:29 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T01:02:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:29 smithi112 ceph-mon[109687]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T01:02:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:29 smithi112 ceph-mon[109687]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:02:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:29 smithi112 ceph-mon[109687]: osd.1 [v2:172.21.15.112:6810/3281764732,v1:172.21.15.112:6811/3281764732] boot 2024-09-21T01:02:30.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:29 smithi112 ceph-mon[109687]: osdmap e55: 6 total, 6 up, 6 in 2024-09-21T01:02:30.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:02:31.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:30 smithi187 ceph-mon[78584]: pgmap v163: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:31.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:30 smithi187 ceph-mon[78584]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T01:02:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:30 smithi112 ceph-mon[109687]: pgmap v163: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:30 smithi112 ceph-mon[109687]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T01:02:33.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:32 smithi187 ceph-mon[78584]: pgmap v165: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:33.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:32 smithi112 ceph-mon[109687]: pgmap v165: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T01:02:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:33 smithi112 ceph-mon[109687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded) 2024-09-21T01:02:34.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:33 smithi187 ceph-mon[78584]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded) 2024-09-21T01:02:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:34 smithi112 ceph-mon[109687]: pgmap v166: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:35.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:34 smithi187 ceph-mon[78584]: pgmap v166: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:37.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:36 smithi112 ceph-mon[109687]: pgmap v167: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:37.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:36 smithi187 ceph-mon[78584]: pgmap v167: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:38 smithi112 ceph-mon[109687]: pgmap v168: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:39.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:38 smithi187 ceph-mon[78584]: pgmap v168: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:41.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:40 smithi112 ceph-mon[109687]: pgmap v169: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:41.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:40 smithi187 ceph-mon[78584]: pgmap v169: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:43.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:42 smithi112 ceph-mon[109687]: pgmap v170: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:43.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:42 smithi187 ceph-mon[78584]: pgmap v170: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:44.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:44.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:44.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:44.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T01:02:44.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:44 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T01:02:44.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:44 smithi112 ceph-mon[109687]: Upgrade: osd.2 is safe to restart 2024-09-21T01:02:44.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:44 smithi112 ceph-mon[109687]: pgmap v171: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T01:02:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:44 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T01:02:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:44 smithi187 ceph-mon[78584]: Upgrade: osd.2 is safe to restart 2024-09-21T01:02:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:44 smithi187 ceph-mon[78584]: pgmap v171: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:46.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:46 smithi112 ceph-mon[109687]: Upgrade: Updating osd.2 2024-09-21T01:02:46.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:46 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:46.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:46 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:02:46.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:46 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:46.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:46 smithi112 ceph-mon[109687]: Deploying daemon osd.2 on smithi112 2024-09-21T01:02:46.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:46 smithi187 ceph-mon[78584]: Upgrade: Updating osd.2 2024-09-21T01:02:46.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:46 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:46.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:46 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:02:46.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:46 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:46.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:46 smithi187 ceph-mon[78584]: Deploying daemon osd.2 on smithi112 2024-09-21T01:02:47.231 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:47 smithi112 ceph-mon[109687]: pgmap v172: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:47.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:47 smithi187 ceph-mon[78584]: pgmap v172: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:48.144 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:47 smithi112 systemd[1]: Stopping Ceph osd.2 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:02:48.510 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:48 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[65373]: 2024-09-21T01:02:48.142+0000 7f830736a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:02:48.510 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:48 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[65373]: 2024-09-21T01:02:48.142+0000 7f830736a640 -1 osd.2 56 *** Got signal Terminated *** 2024-09-21T01:02:48.510 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:48 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[65373]: 2024-09-21T01:02:48.142+0000 7f830736a640 -1 osd.2 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:02:49.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:49 smithi112 ceph-mon[109687]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:49.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:49 smithi112 ceph-mon[109687]: osd.2 marked itself down and dead 2024-09-21T01:02:49.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:49 smithi187 ceph-mon[78584]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:49.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:49 smithi187 ceph-mon[78584]: osd.2 marked itself down and dead 2024-09-21T01:02:49.663 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:49 smithi112 podman[128581]: 2024-09-21 01:02:49.363304818 +0000 UTC m=+1.309576938 container died 2a18e1363a77f9f1790b5000d1131c37acb6a369f510314a35aa7d24950ab9d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:02:50.003 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:49 smithi112 podman[128581]: 2024-09-21 01:02:49.760371003 +0000 UTC m=+1.706643113 container cleanup 2a18e1363a77f9f1790b5000d1131c37acb6a369f510314a35aa7d24950ab9d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T01:02:50.003 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:49 smithi112 bash[128581]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2 2024-09-21T01:02:50.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:50 smithi112 ceph-mon[109687]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:02:50.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:50 smithi112 ceph-mon[109687]: osdmap e57: 6 total, 5 up, 6 in 2024-09-21T01:02:50.261 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:50 smithi112 podman[128608]: 2024-09-21 01:02:50.003571447 +0000 UTC m=+0.636943470 container remove 2a18e1363a77f9f1790b5000d1131c37acb6a369f510314a35aa7d24950ab9d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:02:50.310 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:50 smithi187 ceph-mon[78584]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:02:50.310 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:50 smithi187 ceph-mon[78584]: osdmap e57: 6 total, 5 up, 6 in 2024-09-21T01:02:50.582 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:50 smithi112 podman[128698]: 2024-09-21 01:02:50.230506499 +0000 UTC m=+0.016317866 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:02:50.582 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:50 smithi112 podman[128698]: 2024-09-21 01:02:50.371526984 +0000 UTC m=+0.157338341 container create 6d8c6c0db4c97f0a3027578b24dbc507a04b3e76f93d29ca3c9a5fe8a40ba5b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:02:50.582 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:50 smithi112 podman[128698]: 2024-09-21 01:02:50.582460263 +0000 UTC m=+0.368271622 container init 6d8c6c0db4c97f0a3027578b24dbc507a04b3e76f93d29ca3c9a5fe8a40ba5b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T01:02:51.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:50 smithi112 podman[128698]: 2024-09-21 01:02:50.585994895 +0000 UTC m=+0.371806253 container start 6d8c6c0db4c97f0a3027578b24dbc507a04b3e76f93d29ca3c9a5fe8a40ba5b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T01:02:51.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:50 smithi112 podman[128698]: 2024-09-21 01:02:50.682468481 +0000 UTC m=+0.468279838 container attach 6d8c6c0db4c97f0a3027578b24dbc507a04b3e76f93d29ca3c9a5fe8a40ba5b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T01:02:51.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:50 smithi112 podman[128698]: 2024-09-21 01:02:50.770148658 +0000 UTC m=+0.555960015 container died 6d8c6c0db4c97f0a3027578b24dbc507a04b3e76f93d29ca3c9a5fe8a40ba5b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:02:51.344 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:51 smithi112 ceph-mon[109687]: pgmap v175: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:51.344 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:51 smithi112 ceph-mon[109687]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T01:02:51.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:51 smithi187 ceph-mon[78584]: pgmap v175: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:02:51.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:51 smithi187 ceph-mon[78584]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T01:02:51.760 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:51 smithi112 podman[128721]: 2024-09-21 01:02:51.344444843 +0000 UTC m=+0.566537745 container remove 6d8c6c0db4c97f0a3027578b24dbc507a04b3e76f93d29ca3c9a5fe8a40ba5b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T01:02:51.761 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:51 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T01:02:51.761 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:51 smithi112 systemd[1]: Stopped Ceph osd.2 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:02:51.761 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:51 smithi112 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.2.service: Consumed 45.133s CPU time. 2024-09-21T01:02:51.761 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:51 smithi112 systemd[1]: Starting Ceph osd.2 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:02:51.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 -- 172.21.15.112:0/4048696087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810102b00 msgr2=0x7f8810102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:51.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 --2- 172.21.15.112:0/4048696087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810102b00 0x7f8810102ee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f880c0098b0 tx=0x7f880c02a560 comp rx=0 tx=0).stop 2024-09-21T01:02:51.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 -- 172.21.15.112:0/4048696087 shutdown_connections 2024-09-21T01:02:51.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 --2- 172.21.15.112:0/4048696087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8810103420 0x7f881010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:51.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 --2- 172.21.15.112:0/4048696087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810102b00 0x7f8810102ee0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:51.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 -- 172.21.15.112:0/4048696087 >> 172.21.15.112:0/4048696087 conn(0x7f88100fc4c0 msgr2=0x7f88100fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 -- 172.21.15.112:0/4048696087 shutdown_connections 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.943+0000 7f8817694640 1 -- 172.21.15.112:0/4048696087 wait complete. 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8817694640 1 Processor -- start 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8817694640 1 -- start start 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8817694640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8810102b00 0x7f881019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8817694640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810103420 0x7f881019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8817694640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f881010edd0 con 0x7f8810103420 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8817694640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f881010ec50 con 0x7f8810102b00 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8814c2f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810103420 0x7f881019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8814c2f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810103420 0x7f881019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36306/0 (socket says 172.21.15.112:36306) 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.944+0000 7f8814c2f640 1 -- 172.21.15.112:0/569048785 learned_addr learned my addr 172.21.15.112:0/569048785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f8815430640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8810102b00 0x7f881019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:51.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f8814c2f640 1 -- 172.21.15.112:0/569048785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8810102b00 msgr2=0x7f881019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f8814c2f640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8810102b00 0x7f881019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f8814c2f640 1 -- 172.21.15.112:0/569048785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8810197800 con 0x7f8810103420 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f8814c2f640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810103420 0x7f881019dbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f880000d6f0 tx=0x7f880000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f88067fc640 1 -- 172.21.15.112:0/569048785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8800017070 con 0x7f8810103420 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8810197af0 con 0x7f8810103420 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f88067fc640 1 -- 172.21.15.112:0/569048785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f880000de00 con 0x7f8810103420 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8810198080 con 0x7f8810103420 2024-09-21T01:02:51.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.945+0000 7f88067fc640 1 -- 172.21.15.112:0/569048785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8800020060 con 0x7f8810103420 2024-09-21T01:02:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.946+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881006a3b0 con 0x7f8810103420 2024-09-21T01:02:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.947+0000 7f88067fc640 1 -- 172.21.15.112:0/569048785 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8800005020 con 0x7f8810103420 2024-09-21T01:02:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.948+0000 7f88067fc640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f87fc07af30 0x7f87fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.948+0000 7f88067fc640 1 -- 172.21.15.112:0/569048785 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7f880009da00 con 0x7f8810103420 2024-09-21T01:02:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.948+0000 7f8815430640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f87fc07af30 0x7f87fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:51.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.948+0000 7f8815430640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f87fc07af30 0x7f87fc07d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f880c000c00 tx=0x7f880c031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:51.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:51.953+0000 7f88067fc640 1 -- 172.21.15.112:0/569048785 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8800069000 con 0x7f8810103420 2024-09-21T01:02:52.039 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:51 smithi112 podman[128820]: 2024-09-21 01:02:51.689922839 +0000 UTC m=+0.016035505 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:02:52.040 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:51 smithi112 podman[128820]: 2024-09-21 01:02:51.820618517 +0000 UTC m=+0.146731167 container create 04b31628db434b415718a890a7ea1496163cce20283c1f711c16b68193828e91 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:02:52.040 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:52 smithi112 podman[128820]: 2024-09-21 01:02:52.039783476 +0000 UTC m=+0.365896130 container init 04b31628db434b415718a890a7ea1496163cce20283c1f711c16b68193828e91 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:02:52.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.153+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8810198330 con 0x7f87fc07af30 2024-09-21T01:02:52.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.154+0000 7f88067fc640 1 -- 172.21.15.112:0/569048785 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8810198330 con 0x7f87fc07af30 2024-09-21T01:02:52.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f87fc07af30 msgr2=0x7f87fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f87fc07af30 0x7f87fc07d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f880c000c00 tx=0x7f880c031400 comp rx=0 tx=0).stop 2024-09-21T01:02:52.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810103420 msgr2=0x7f881019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810103420 0x7f881019dbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f880000d6f0 tx=0x7f880000dbb0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 shutdown_connections 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f87fc07af30 0x7f87fc07d3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8810103420 0x7f881019dbc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 --2- 172.21.15.112:0/569048785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8810102b00 0x7f881019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 >> 172.21.15.112:0/569048785 conn(0x7f88100fc4c0 msgr2=0x7f8810103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 shutdown_connections 2024-09-21T01:02:52.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.158+0000 7f8817694640 1 -- 172.21.15.112:0/569048785 wait complete. 2024-09-21T01:02:52.172 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 -- 172.21.15.112:0/1703578321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc102aa0 msgr2=0x7f83bc102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 --2- 172.21.15.112:0/1703578321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc102aa0 0x7f83bc102e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009880 tx=0x7f83ac02a530 comp rx=0 tx=0).stop 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 -- 172.21.15.112:0/1703578321 shutdown_connections 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 --2- 172.21.15.112:0/1703578321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83bc1033c0 0x7f83bc10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 --2- 172.21.15.112:0/1703578321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc102aa0 0x7f83bc102e80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 -- 172.21.15.112:0/1703578321 >> 172.21.15.112:0/1703578321 conn(0x7f83bc0fc4c0 msgr2=0x7f83bc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 -- 172.21.15.112:0/1703578321 shutdown_connections 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.250+0000 7f83c23b6640 1 -- 172.21.15.112:0/1703578321 wait complete. 2024-09-21T01:02:52.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.251+0000 7f83c23b6640 1 Processor -- start 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.251+0000 7f83c23b6640 1 -- start start 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83c23b6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83bc102aa0 0x7f83bc19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83c23b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1033c0 0x7f83bc19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83c23b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc10edd0 con 0x7f83bc1033c0 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83c23b6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc10ec50 con 0x7f83bc102aa0 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1033c0 0x7f83bc19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1033c0 0x7f83bc19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49426/0 (socket says 172.21.15.112:49426) 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bb7fe640 1 -- 172.21.15.112:0/3712778363 learned_addr learned my addr 172.21.15.112:0/3712778363 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bbfff640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83bc102aa0 0x7f83bc19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bb7fe640 1 -- 172.21.15.112:0/3712778363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83bc102aa0 msgr2=0x7f83bc19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bb7fe640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83bc102aa0 0x7f83bc19f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bb7fe640 1 -- 172.21.15.112:0/3712778363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc1999f0 con 0x7f83bc1033c0 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bbfff640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83bc102aa0 0x7f83bc19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:02:52.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.252+0000 7f83bb7fe640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1033c0 0x7f83bc19fd70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83b000d6d0 tx=0x7f83b000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.253+0000 7f83b97fa640 1 -- 172.21.15.112:0/3712778363 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83b0017070 con 0x7f83bc1033c0 2024-09-21T01:02:52.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.253+0000 7f83b97fa640 1 -- 172.21.15.112:0/3712778363 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83b00054e0 con 0x7f83bc1033c0 2024-09-21T01:02:52.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.253+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83bc199ce0 con 0x7f83bc1033c0 2024-09-21T01:02:52.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.253+0000 7f83b97fa640 1 -- 172.21.15.112:0/3712778363 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83b0004ae0 con 0x7f83bc1033c0 2024-09-21T01:02:52.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.253+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83bc19a270 con 0x7f83bc1033c0 2024-09-21T01:02:52.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.254+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83bc06a410 con 0x7f83bc1033c0 2024-09-21T01:02:52.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.255+0000 7f83b97fa640 1 -- 172.21.15.112:0/3712778363 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f83b0004de0 con 0x7f83bc1033c0 2024-09-21T01:02:52.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.255+0000 7f83b97fa640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f83a407af30 0x7f83a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.255+0000 7f83b97fa640 1 -- 172.21.15.112:0/3712778363 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7f83b009dbf0 con 0x7f83bc1033c0 2024-09-21T01:02:52.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.255+0000 7f83bbfff640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f83a407af30 0x7f83a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.256+0000 7f83bbfff640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f83a407af30 0x7f83a407d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac031420 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.260+0000 7f83b97fa640 1 -- 172.21.15.112:0/3712778363 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83b00691f0 con 0x7f83bc1033c0 2024-09-21T01:02:52.371 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:52 smithi112 ceph-mon[109687]: Health check failed: Degraded data redundancy: 11/279 objects degraded (3.943%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T01:02:52.371 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:52 smithi112 podman[128820]: 2024-09-21 01:02:52.044611463 +0000 UTC m=+0.370724115 container start 04b31628db434b415718a890a7ea1496163cce20283c1f711c16b68193828e91 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:02:52.371 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:52 smithi112 podman[128820]: 2024-09-21 01:02:52.156727952 +0000 UTC m=+0.482840622 container attach 04b31628db434b415718a890a7ea1496163cce20283c1f711c16b68193828e91 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:02:52.371 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:52 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:52.371 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:52 smithi112 bash[128820]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:52.371 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:52 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:52.372 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:52 smithi112 bash[128820]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:02:52.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:52 smithi187 ceph-mon[78584]: Health check failed: Degraded data redundancy: 11/279 objects degraded (3.943%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T01:02:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.465+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f83bc19af20 con 0x7f83a407af30 2024-09-21T01:02:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.466+0000 7f83b97fa640 1 -- 172.21.15.112:0/3712778363 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f83bc19af20 con 0x7f83a407af30 2024-09-21T01:02:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.468+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f83a407af30 msgr2=0x7f83a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.468+0000 7f83c23b6640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f83a407af30 0x7f83a407d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac031420 comp rx=0 tx=0).stop 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1033c0 msgr2=0x7f83bc19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1033c0 0x7f83bc19fd70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83b000d6d0 tx=0x7f83b000db90 comp rx=0 tx=0).stop 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 shutdown_connections 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f83a407af30 0x7f83a407d3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc1033c0 0x7f83bc19fd70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 --2- 172.21.15.112:0/3712778363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83bc102aa0 0x7f83bc19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 >> 172.21.15.112:0/3712778363 conn(0x7f83bc0fc4c0 msgr2=0x7f83bc100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 shutdown_connections 2024-09-21T01:02:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.469+0000 7f83c23b6640 1 -- 172.21.15.112:0/3712778363 wait complete. 2024-09-21T01:02:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 -- 172.21.15.112:0/2498876378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 msgr2=0x7f4df4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 --2- 172.21.15.112:0/2498876378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4100c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009880 tx=0x7f4de402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 -- 172.21.15.112:0/2498876378 shutdown_connections 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 --2- 172.21.15.112:0/2498876378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4100c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 --2- 172.21.15.112:0/2498876378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df4106820 0x7f4df4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 -- 172.21.15.112:0/2498876378 >> 172.21.15.112:0/2498876378 conn(0x7f4df40fc520 msgr2=0x7f4df40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 -- 172.21.15.112:0/2498876378 shutdown_connections 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.550+0000 7f4dfc520640 1 -- 172.21.15.112:0/2498876378 wait complete. 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfc520640 1 Processor -- start 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfc520640 1 -- start start 2024-09-21T01:02:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfc520640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfc520640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df4106820 0x7f4df4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfc520640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4df410dd50 con 0x7f4df4100820 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfc520640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4df410dbd0 con 0x7f4df4106820 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfa2bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfa2bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49446/0 (socket says 172.21.15.112:49446) 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfa2bc640 1 -- 172.21.15.112:0/1744222417 learned_addr learned my addr 172.21.15.112:0/1744222417 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4df9abb640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df4106820 0x7f4df4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfa2bc640 1 -- 172.21.15.112:0/1744222417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df4106820 msgr2=0x7f4df4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfa2bc640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df4106820 0x7f4df4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4dfa2bc640 1 -- 172.21.15.112:0/1744222417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df41993b0 con 0x7f4df4100820 2024-09-21T01:02:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.551+0000 7f4df9abb640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df4106820 0x7f4df4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:02:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.552+0000 7f4dfa2bc640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4198870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4df000b420 tx=0x7f4df000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.552+0000 7f4deb7fe640 1 -- 172.21.15.112:0/1744222417 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4df0011630 con 0x7f4df4100820 2024-09-21T01:02:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.552+0000 7f4deb7fe640 1 -- 172.21.15.112:0/1744222417 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4df0016070 con 0x7f4df4100820 2024-09-21T01:02:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.552+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df41996a0 con 0x7f4df4100820 2024-09-21T01:02:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.552+0000 7f4deb7fe640 1 -- 172.21.15.112:0/1744222417 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4df0010d40 con 0x7f4df4100820 2024-09-21T01:02:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.552+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df41a1ca0 con 0x7f4df4100820 2024-09-21T01:02:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.553+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df4101f60 con 0x7f4df4100820 2024-09-21T01:02:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.553+0000 7f4deb7fe640 1 -- 172.21.15.112:0/1744222417 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4df001b460 con 0x7f4df4100820 2024-09-21T01:02:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.554+0000 7f4deb7fe640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4de007af80 0x7f4de007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.554+0000 7f4deb7fe640 1 -- 172.21.15.112:0/1744222417 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7f4df009d6f0 con 0x7f4df4100820 2024-09-21T01:02:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.554+0000 7f4df9abb640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4de007af80 0x7f4de007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.555+0000 7f4df9abb640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4de007af80 0x7f4de007d440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4de4006010 tx=0x7f4de40095f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.560+0000 7f4deb7fe640 1 -- 172.21.15.112:0/1744222417 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4df41996a0 con 0x7f4df4100820 2024-09-21T01:02:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.749+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4df4062630 con 0x7f4de007af80 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.758+0000 7f4deb7fe640 1 -- 172.21.15.112:0/1744222417 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4df4062630 con 0x7f4de007af80 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (3m) 28s ago 14m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (6m) 28s ago 14m 8799k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (5m) 87s ago 13m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (95s) 28s ago 14m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (90s) 87s ago 13m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (3m) 28s ago 14m 80.8M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (8m) 28s ago 8m 150M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:02:52.759 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (8m) 28s ago 8m 16.9M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (8m) 87s ago 8m 20.0M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (8m) 87s ago 8m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (5m) 28s ago 15m 591M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (4m) 87s ago 13m 522M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (2m) 28s ago 15m 108M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (108s) 87s ago 13m 93.3M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 28s ago 14m 10.9M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (4m) 87s ago 13m 10.5M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (69s) 28s ago 12m 150M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (34s) 28s ago 11m 79.5M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (11m) 28s ago 11m 179M 1216M 19.1.1-373-g4e45e6b4 164465d2334a 2a18e1363a77 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (10m) 87s ago 10m 254M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T01:02:52.760 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (10m) 87s ago 10m 206M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:02:52.761 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (9m) 87s ago 9m 191M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:02:52.761 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (3m) 28s ago 13m 49.6M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:02:52.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4de007af80 msgr2=0x7f4de007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4de007af80 0x7f4de007d440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4de4006010 tx=0x7f4de40095f0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 msgr2=0x7f4df4198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4198870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4df000b420 tx=0x7f4df000b8e0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 shutdown_connections 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4de007af80 0x7f4de007d440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df4106820 0x7f4df4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 --2- 172.21.15.112:0/1744222417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4df4100820 0x7f4df4198870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 >> 172.21.15.112:0/1744222417 conn(0x7f4df40fc520 msgr2=0x7f4df40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.760+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 shutdown_connections 2024-09-21T01:02:52.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.761+0000 7f4dfc520640 1 -- 172.21.15.112:0/1744222417 wait complete. 2024-09-21T01:02:52.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 -- 172.21.15.112:0/2071600278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 msgr2=0x7fcd6c1001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 --2- 172.21.15.112:0/2071600278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c1001b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009880 tx=0x7fcd6002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 -- 172.21.15.112:0/2071600278 shutdown_connections 2024-09-21T01:02:52.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 --2- 172.21.15.112:0/2071600278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c1001b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 --2- 172.21.15.112:0/2071600278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd6c106930 0x7fcd6c106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 -- 172.21.15.112:0/2071600278 >> 172.21.15.112:0/2071600278 conn(0x7fcd6c0fbc40 msgr2=0x7fcd6c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:52.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 -- 172.21.15.112:0/2071600278 shutdown_connections 2024-09-21T01:02:52.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 -- 172.21.15.112:0/2071600278 wait complete. 2024-09-21T01:02:52.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 Processor -- start 2024-09-21T01:02:52.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.841+0000 7fcd7276c640 1 -- start start 2024-09-21T01:02:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd7276c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd7276c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd6c106930 0x7fcd6c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd7276c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c10eed0 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd7276c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c10ed50 con 0x7fcd6c106930 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49460/0 (socket says 172.21.15.112:49460) 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6bfff640 1 -- 172.21.15.112:0/4212197225 learned_addr learned my addr 172.21.15.112:0/4212197225 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6b7fe640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd6c106930 0x7fcd6c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6bfff640 1 -- 172.21.15.112:0/4212197225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd6c106930 msgr2=0x7fcd6c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6bfff640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd6c106930 0x7fcd6c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6bfff640 1 -- 172.21.15.112:0/4212197225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c1019b0 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.842+0000 7fcd6bfff640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c100f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00d6f0 tx=0x7fcd5c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.843+0000 7fcd697fa640 1 -- 172.21.15.112:0/4212197225 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd5c017070 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.843+0000 7fcd697fa640 1 -- 172.21.15.112:0/4212197225 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd5c00de00 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.843+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c101ca0 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.843+0000 7fcd697fa640 1 -- 172.21.15.112:0/4212197225 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd5c004bb0 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.843+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c1a3ee0 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.844+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6c103070 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.845+0000 7fcd697fa640 1 -- 172.21.15.112:0/4212197225 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcd5c004e60 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.845+0000 7fcd697fa640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcd5407af30 0x7fcd5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.845+0000 7fcd697fa640 1 -- 172.21.15.112:0/4212197225 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7fcd5c09dba0 con 0x7fcd6c0ffd50 2024-09-21T01:02:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.845+0000 7fcd6b7fe640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcd5407af30 0x7fcd5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.846+0000 7fcd6b7fe640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcd5407af30 0x7fcd5407d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c1029c0 tx=0x7fcd60031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:52.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:52.850+0000 7fcd697fa640 1 -- 172.21.15.112:0/4212197225 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd5c0691a0 con 0x7fcd6c0ffd50 2024-09-21T01:02:53.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.106+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcd6c102460 con 0x7fcd6c0ffd50 2024-09-21T01:02:53.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.106+0000 7fcd697fa640 1 -- 172.21.15.112:0/4212197225 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fcd5c06e050 con 0x7fcd6c0ffd50 2024-09-21T01:02:53.107 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:02:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:02:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:02:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:02:53.107 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 6 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:02:53.108 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:02:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.108+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcd5407af30 msgr2=0x7fcd5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.108+0000 7fcd7276c640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcd5407af30 0x7fcd5407d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c1029c0 tx=0x7fcd60031400 comp rx=0 tx=0).stop 2024-09-21T01:02:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.108+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 msgr2=0x7fcd6c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.108+0000 7fcd7276c640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c100f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00d6f0 tx=0x7fcd5c00dbb0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.108+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 shutdown_connections 2024-09-21T01:02:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.109+0000 7fcd7276c640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcd5407af30 0x7fcd5407d3f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.109+0000 7fcd7276c640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd6c106930 0x7fcd6c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.109+0000 7fcd7276c640 1 --2- 172.21.15.112:0/4212197225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c0ffd50 0x7fcd6c100f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.109+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 >> 172.21.15.112:0/4212197225 conn(0x7fcd6c0fbc40 msgr2=0x7fcd6c0fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.109+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 shutdown_connections 2024-09-21T01:02:53.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.109+0000 7fcd7276c640 1 -- 172.21.15.112:0/4212197225 wait complete. 2024-09-21T01:02:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.189+0000 7faf64bdc640 1 -- 172.21.15.112:0/2271448433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60102ae0 msgr2=0x7faf60102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.189+0000 7faf64bdc640 1 --2- 172.21.15.112:0/2271448433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60102ae0 0x7faf60102ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf50009880 tx=0x7faf5002a530 comp rx=0 tx=0).stop 2024-09-21T01:02:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.189+0000 7faf64bdc640 1 -- 172.21.15.112:0/2271448433 shutdown_connections 2024-09-21T01:02:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.189+0000 7faf64bdc640 1 --2- 172.21.15.112:0/2271448433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf60103400 0x7faf6010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.189+0000 7faf64bdc640 1 --2- 172.21.15.112:0/2271448433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60102ae0 0x7faf60102ec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.189+0000 7faf64bdc640 1 -- 172.21.15.112:0/2271448433 >> 172.21.15.112:0/2271448433 conn(0x7faf600fc520 msgr2=0x7faf600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 -- 172.21.15.112:0/2271448433 shutdown_connections 2024-09-21T01:02:53.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 -- 172.21.15.112:0/2271448433 wait complete. 2024-09-21T01:02:53.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 Processor -- start 2024-09-21T01:02:53.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 -- start start 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf60102ae0 0x7faf60100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60103400 0x7faf60100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf6010ee10 con 0x7faf60103400 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.190+0000 7faf64bdc640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faf6010ec90 con 0x7faf60102ae0 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60103400 0x7faf60100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60103400 0x7faf60100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49470/0 (socket says 172.21.15.112:49470) 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5dd9b640 1 -- 172.21.15.112:0/1095893382 learned_addr learned my addr 172.21.15.112:0/1095893382 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5e59c640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf60102ae0 0x7faf60100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5dd9b640 1 -- 172.21.15.112:0/1095893382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf60102ae0 msgr2=0x7faf60100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5dd9b640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf60102ae0 0x7faf60100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5dd9b640 1 -- 172.21.15.112:0/1095893382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf601011c0 con 0x7faf60103400 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5e59c640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf60102ae0 0x7faf60100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:02:53.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf5dd9b640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60103400 0x7faf60100c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf5400d6d0 tx=0x7faf5400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf4f7fe640 1 -- 172.21.15.112:0/1095893382 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf54017070 con 0x7faf60103400 2024-09-21T01:02:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf601014b0 con 0x7faf60103400 2024-09-21T01:02:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf4f7fe640 1 -- 172.21.15.112:0/1095893382 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf540054e0 con 0x7faf60103400 2024-09-21T01:02:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf4f7fe640 1 -- 172.21.15.112:0/1095893382 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf54004ae0 con 0x7faf60103400 2024-09-21T01:02:53.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.191+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf601a3fa0 con 0x7faf60103400 2024-09-21T01:02:53.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.192+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6006abe0 con 0x7faf60103400 2024-09-21T01:02:53.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.193+0000 7faf4f7fe640 1 -- 172.21.15.112:0/1095893382 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7faf54004d90 con 0x7faf60103400 2024-09-21T01:02:53.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.193+0000 7faf4f7fe640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faf4807af80 0x7faf4807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.194+0000 7faf4f7fe640 1 -- 172.21.15.112:0/1095893382 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7faf5409db40 con 0x7faf60103400 2024-09-21T01:02:53.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.194+0000 7faf5e59c640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faf4807af80 0x7faf4807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.194+0000 7faf5e59c640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faf4807af80 0x7faf4807d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf50000c00 tx=0x7faf50031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:53.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.198+0000 7faf4f7fe640 1 -- 172.21.15.112:0/1095893382 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf540691c0 con 0x7faf60103400 2024-09-21T01:02:53.334 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-mon[109687]: pgmap v177: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 11/279 objects degraded (3.943%) 2024-09-21T01:02:53.335 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-mon[109687]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:53.335 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T01:02:53.335 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 bash[128820]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T01:02:53.335 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T01:02:53.335 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 bash[128820]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T01:02:53.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:53 smithi187 ceph-mon[78584]: pgmap v177: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 11/279 objects degraded (3.943%) 2024-09-21T01:02:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:53 smithi187 ceph-mon[78584]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.424+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7faf60101c70 con 0x7faf60103400 2024-09-21T01:02:53.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.424+0000 7faf4f7fe640 1 -- 172.21.15.112:0/1095893382 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7faf5406e070 con 0x7faf60103400 2024-09-21T01:02:53.425 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:02:53.425 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:02:53.425 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:02:53.426 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:02:53.427 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:53.428 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:02:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:02:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.426+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faf4807af80 msgr2=0x7faf4807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.426+0000 7faf64bdc640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faf4807af80 0x7faf4807d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf50000c00 tx=0x7faf50031400 comp rx=0 tx=0).stop 2024-09-21T01:02:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.426+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60103400 msgr2=0x7faf60100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.426+0000 7faf64bdc640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60103400 0x7faf60100c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf5400d6d0 tx=0x7faf5400db90 comp rx=0 tx=0).stop 2024-09-21T01:02:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.427+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 shutdown_connections 2024-09-21T01:02:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.427+0000 7faf64bdc640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7faf4807af80 0x7faf4807d440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.427+0000 7faf64bdc640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf60103400 0x7faf60100c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.427+0000 7faf64bdc640 1 --2- 172.21.15.112:0/1095893382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf60102ae0 0x7faf60100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.427+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 >> 172.21.15.112:0/1095893382 conn(0x7faf600fc520 msgr2=0x7faf60108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.427+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 shutdown_connections 2024-09-21T01:02:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.427+0000 7faf64bdc640 1 -- 172.21.15.112:0/1095893382 wait complete. 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 -- 172.21.15.112:0/1486005936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1067e0 msgr2=0x7f08cc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 --2- 172.21.15.112:0/1486005936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1067e0 0x7f08cc106bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009880 tx=0x7f08bc02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 -- 172.21.15.112:0/1486005936 shutdown_connections 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 --2- 172.21.15.112:0/1486005936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc1007e0 0x7f08cc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 --2- 172.21.15.112:0/1486005936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1067e0 0x7f08cc106bc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 -- 172.21.15.112:0/1486005936 >> 172.21.15.112:0/1486005936 conn(0x7f08cc0fc4c0 msgr2=0x7f08cc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 -- 172.21.15.112:0/1486005936 shutdown_connections 2024-09-21T01:02:53.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 -- 172.21.15.112:0/1486005936 wait complete. 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.510+0000 7f08d099e640 1 Processor -- start 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08d099e640 1 -- start start 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08d099e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1007e0 0x7f08cc19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08d099e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc1067e0 0x7f08cc19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08d099e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc10dcb0 con 0x7f08cc1007e0 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08d099e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc10db30 con 0x7f08cc1067e0 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08ca59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1007e0 0x7f08cc19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08ca59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1007e0 0x7f08cc19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49490/0 (socket says 172.21.15.112:49490) 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08ca59c640 1 -- 172.21.15.112:0/546672095 learned_addr learned my addr 172.21.15.112:0/546672095 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08c9d9b640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc1067e0 0x7f08cc19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08ca59c640 1 -- 172.21.15.112:0/546672095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc1067e0 msgr2=0x7f08cc19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08ca59c640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc1067e0 0x7f08cc19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08ca59c640 1 -- 172.21.15.112:0/546672095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc1966e0 con 0x7f08cc1007e0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08ca59c640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1007e0 0x7f08cc19c610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08bc031460 tx=0x7f08bc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.511+0000 7f08bb7fe640 1 -- 172.21.15.112:0/546672095 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08bc03f070 con 0x7f08cc1007e0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.512+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc196970 con 0x7f08cc1007e0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.512+0000 7f08bb7fe640 1 -- 172.21.15.112:0/546672095 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08bc0035f0 con 0x7f08cc1007e0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.512+0000 7f08bb7fe640 1 -- 172.21.15.112:0/546672095 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08bc035030 con 0x7f08cc1007e0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.512+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc196e70 con 0x7f08cc1007e0 2024-09-21T01:02:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.513+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08cc101f20 con 0x7f08cc1007e0 2024-09-21T01:02:53.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.513+0000 7f08bb7fe640 1 -- 172.21.15.112:0/546672095 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f08bc042070 con 0x7f08cc1007e0 2024-09-21T01:02:53.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.514+0000 7f08bb7fe640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08b407af30 0x7f08b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.514+0000 7f08bb7fe640 1 -- 172.21.15.112:0/546672095 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7f08bc0be970 con 0x7f08cc1007e0 2024-09-21T01:02:53.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.514+0000 7f08c9d9b640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08b407af30 0x7f08b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.514+0000 7f08c9d9b640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08b407af30 0x7f08b407d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f08cc197f30 tx=0x7f08c000b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:53.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.519+0000 7f08bb7fe640 1 -- 172.21.15.112:0/546672095 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08bc0c0e20 con 0x7f08cc1007e0 2024-09-21T01:02:53.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.718+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08cc1971e0 con 0x7f08b407af30 2024-09-21T01:02:53.719 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 bash[128820]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 bash[128820]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 bash[128820]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 bash[128820]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate[128837]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 bash[128820]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-21T01:02:53.720 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:53 smithi112 podman[128820]: 2024-09-21 01:02:53.362861677 +0000 UTC m=+1.688974331 container died 04b31628db434b415718a890a7ea1496163cce20283c1f711c16b68193828e91 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T01:02:53.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.720+0000 7f08bb7fe640 1 -- 172.21.15.112:0/546672095 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f08cc1971e0 con 0x7f08b407af30 2024-09-21T01:02:53.721 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:02:53.721 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:02:53.721 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "8/23 daemons upgraded", 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:02:53.722 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:02:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08b407af30 msgr2=0x7f08b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08b407af30 0x7f08b407d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f08cc197f30 tx=0x7f08c000b390 comp rx=0 tx=0).stop 2024-09-21T01:02:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1007e0 msgr2=0x7f08cc19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1007e0 0x7f08cc19c610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08bc031460 tx=0x7f08bc0045e0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 shutdown_connections 2024-09-21T01:02:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08b407af30 0x7f08b407d3f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc1067e0 0x7f08cc19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 --2- 172.21.15.112:0/546672095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc1007e0 0x7f08cc19c610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 >> 172.21.15.112:0/546672095 conn(0x7f08cc0fc4c0 msgr2=0x7f08cc0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 shutdown_connections 2024-09-21T01:02:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.722+0000 7f08d099e640 1 -- 172.21.15.112:0/546672095 wait complete. 2024-09-21T01:02:53.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.805+0000 7ff781814640 1 -- 172.21.15.112:0/4074596612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 msgr2=0x7ff77c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.805+0000 7ff781814640 1 --2- 172.21.15.112:0/4074596612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c106bc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff774009c20 tx=0x7ff77402a970 comp rx=0 tx=0).stop 2024-09-21T01:02:53.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.805+0000 7ff781814640 1 -- 172.21.15.112:0/4074596612 shutdown_connections 2024-09-21T01:02:53.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.805+0000 7ff781814640 1 --2- 172.21.15.112:0/4074596612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff77c1007e0 0x7ff77c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.805+0000 7ff781814640 1 --2- 172.21.15.112:0/4074596612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c106bc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.805+0000 7ff781814640 1 -- 172.21.15.112:0/4074596612 >> 172.21.15.112:0/4074596612 conn(0x7ff77c0fc4c0 msgr2=0x7ff77c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:53.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.805+0000 7ff781814640 1 -- 172.21.15.112:0/4074596612 shutdown_connections 2024-09-21T01:02:53.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.806+0000 7ff781814640 1 -- 172.21.15.112:0/4074596612 wait complete. 2024-09-21T01:02:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.806+0000 7ff781814640 1 Processor -- start 2024-09-21T01:02:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.806+0000 7ff781814640 1 -- start start 2024-09-21T01:02:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.806+0000 7ff781814640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff77c1007e0 0x7ff77c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.806+0000 7ff781814640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.806+0000 7ff781814640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c10dc90 con 0x7ff77c1067e0 2024-09-21T01:02:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.806+0000 7ff781814640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c10db10 con 0x7ff77c1007e0 2024-09-21T01:02:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49514/0 (socket says 172.21.15.112:49514) 2024-09-21T01:02:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77a7fc640 1 -- 172.21.15.112:0/3298134464 learned_addr learned my addr 172.21.15.112:0/3298134464 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:02:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77affd640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff77c1007e0 0x7ff77c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77a7fc640 1 -- 172.21.15.112:0/3298134464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff77c1007e0 msgr2=0x7ff77c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77a7fc640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff77c1007e0 0x7ff77c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77a7fc640 1 -- 172.21.15.112:0/3298134464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c199270 con 0x7ff77c1067e0 2024-09-21T01:02:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff77a7fc640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c198d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c8a0 tx=0x7ff76400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff780812640 1 -- 172.21.15.112:0/3298134464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7640079b0 con 0x7ff77c1067e0 2024-09-21T01:02:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff780812640 1 -- 172.21.15.112:0/3298134464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff764007b50 con 0x7ff77c1067e0 2024-09-21T01:02:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff780812640 1 -- 172.21.15.112:0/3298134464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff764018700 con 0x7ff77c1067e0 2024-09-21T01:02:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c199560 con 0x7ff77c1067e0 2024-09-21T01:02:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.807+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c1a1b60 con 0x7ff77c1067e0 2024-09-21T01:02:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.808+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77c101f20 con 0x7ff77c1067e0 2024-09-21T01:02:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.809+0000 7ff780812640 1 -- 172.21.15.112:0/3298134464 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7ff764007d00 con 0x7ff77c1067e0 2024-09-21T01:02:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.810+0000 7ff780812640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff76807af30 0x7ff76807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.810+0000 7ff780812640 1 -- 172.21.15.112:0/3298134464 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6156+0+0 (secure 0 0 0) 0x7ff76409e2f0 con 0x7ff77c1067e0 2024-09-21T01:02:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.810+0000 7ff77affd640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff76807af30 0x7ff76807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.810+0000 7ff77affd640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff76807af30 0x7ff76807d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff774009430 tx=0x7ff7740093a0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:53.814+0000 7ff780812640 1 -- 172.21.15.112:0/3298134464 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff764014030 con 0x7ff77c1067e0 2024-09-21T01:02:54.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.067+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff77c1039f0 con 0x7ff77c1067e0 2024-09-21T01:02:54.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.067+0000 7ff780812640 1 -- 172.21.15.112:0/3298134464 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+683 (secure 0 0 0) 0x7ff7640698f0 con 0x7ff77c1067e0 2024-09-21T01:02:54.069 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 11/279 objects degraded (3.943%), 4 pgs degraded 2024-09-21T01:02:54.069 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:02:54.069 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:02:54.069 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T01:02:54.069 INFO:teuthology.orchestra.run.smithi112.stdout: osd.2 (root=default,host=smithi112) is down 2024-09-21T01:02:54.070 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 11/279 objects degraded (3.943%), 4 pgs degraded 2024-09-21T01:02:54.070 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-21T01:02:54.070 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-21T01:02:54.070 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-21T01:02:54.070 INFO:teuthology.orchestra.run.smithi112.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-21T01:02:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.069+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff76807af30 msgr2=0x7ff76807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.069+0000 7ff781814640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff76807af30 0x7ff76807d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff774009430 tx=0x7ff7740093a0 comp rx=0 tx=0).stop 2024-09-21T01:02:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.069+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 msgr2=0x7ff77c198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:54.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.069+0000 7ff781814640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c198d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c8a0 tx=0x7ff76400cd60 comp rx=0 tx=0).stop 2024-09-21T01:02:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.070+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 shutdown_connections 2024-09-21T01:02:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.070+0000 7ff781814640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7ff76807af30 0x7ff76807d3f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.070+0000 7ff781814640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77c1067e0 0x7ff77c198d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.070+0000 7ff781814640 1 --2- 172.21.15.112:0/3298134464 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff77c1007e0 0x7ff77c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.070+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 >> 172.21.15.112:0/3298134464 conn(0x7ff77c0fc4c0 msgr2=0x7ff77c0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.070+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 shutdown_connections 2024-09-21T01:02:54.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:02:54.070+0000 7ff781814640 1 -- 172.21.15.112:0/3298134464 wait complete. 2024-09-21T01:02:54.360 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:54 smithi112 podman[129081]: 2024-09-21 01:02:54.245281464 +0000 UTC m=+0.876327673 container remove 04b31628db434b415718a890a7ea1496163cce20283c1f711c16b68193828e91 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T01:02:54.360 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:54 smithi112 ceph-mon[109687]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:54.361 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:54 smithi112 ceph-mon[109687]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:54.361 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:54 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4212197225' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:54.361 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:54 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1095893382' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:02:54.361 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:54 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3298134464' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:02:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:54 smithi187 ceph-mon[78584]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:54 smithi187 ceph-mon[78584]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:54 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4212197225' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:02:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:54 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1095893382' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:02:54.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:54 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3298134464' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:02:54.636 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:54 smithi112 podman[129188]: 2024-09-21 01:02:54.354260723 +0000 UTC m=+0.016223646 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:02:54.636 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:54 smithi112 podman[129188]: 2024-09-21 01:02:54.488126758 +0000 UTC m=+0.150089679 container create 1c095dd62a18b6dbcef655597902d410cdf43dd2cc8022c1a62a015a6ff506cf (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:02:55.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:54 smithi112 podman[129188]: 2024-09-21 01:02:54.74090673 +0000 UTC m=+0.402869660 container init 1c095dd62a18b6dbcef655597902d410cdf43dd2cc8022c1a62a015a6ff506cf (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:02:55.011 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:54 smithi112 podman[129188]: 2024-09-21 01:02:54.744430302 +0000 UTC m=+0.406393232 container start 1c095dd62a18b6dbcef655597902d410cdf43dd2cc8022c1a62a015a6ff506cf (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T01:02:55.011 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:54 smithi112 bash[129188]: 1c095dd62a18b6dbcef655597902d410cdf43dd2cc8022c1a62a015a6ff506cf 2024-09-21T01:02:55.011 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:54 smithi112 systemd[1]: Started Ceph osd.2 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:02:55.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:55 smithi112 ceph-mon[109687]: pgmap v178: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:02:55.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:55 smithi112 ceph-mon[109687]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:55.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:55 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:55.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:55 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:55.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:55 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:55 smithi187 ceph-mon[78584]: pgmap v178: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:02:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:55 smithi187 ceph-mon[78584]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:02:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:55 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:55 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:55 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:56.197 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:02:56 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[129203]: 2024-09-21T01:02:56.145+0000 7fc012de3640 -1 Falling back to public interface 2024-09-21T01:02:57.227 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:57 smithi112 ceph-mon[109687]: pgmap v179: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:02:57.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:57 smithi187 ceph-mon[78584]: pgmap v179: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:02:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:59 smithi112 ceph-mon[109687]: pgmap v180: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:02:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:59.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:02:59 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 35/279 objects degraded (12.545%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T01:02:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:59 smithi187 ceph-mon[78584]: pgmap v180: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:02:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:02:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:02:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:02:59 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 35/279 objects degraded (12.545%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:01.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:00 smithi112 ceph-mon[109687]: pgmap v181: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:01.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.084 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.084 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:00 smithi187 ceph-mon[78584]: pgmap v181: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:01.760 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:03:01 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[129203]: 2024-09-21T01:03:01.520+0000 7fc012de3640 -1 osd.2 56 log_to_monitors true 2024-09-21T01:03:02.096 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:01 smithi112 ceph-mon[109687]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:03:02.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:01 smithi187 ceph-mon[78584]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:03:03.048 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:03:02 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[129203]: 2024-09-21T01:03:02.780+0000 7fc006b5b640 -1 osd.2 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:03:03.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:02 smithi112 ceph-mon[109687]: pgmap v182: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:03.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:02 smithi112 ceph-mon[109687]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:03:03.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:02 smithi112 ceph-mon[109687]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T01:03:03.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:02 smithi112 ceph-mon[109687]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T01:03:03.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:02 smithi112 ceph-mon[109687]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' 2024-09-21T01:03:03.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:02 smithi187 ceph-mon[78584]: pgmap v182: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:03.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:02 smithi187 ceph-mon[78584]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:03:03.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:02 smithi187 ceph-mon[78584]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T01:03:03.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:02 smithi187 ceph-mon[78584]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T01:03:03.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:02 smithi187 ceph-mon[78584]: from='osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151]' entity='osd.2' 2024-09-21T01:03:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:03 smithi187 ceph-mon[78584]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:03:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:03 smithi187 ceph-mon[78584]: osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151] boot 2024-09-21T01:03:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:03 smithi187 ceph-mon[78584]: osdmap e60: 6 total, 6 up, 6 in 2024-09-21T01:03:04.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:03 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:03:04.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:03 smithi112 ceph-mon[109687]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:03:04.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:03 smithi112 ceph-mon[109687]: osd.2 [v2:172.21.15.112:6818/2928337151,v1:172.21.15.112:6819/2928337151] boot 2024-09-21T01:03:04.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:03 smithi112 ceph-mon[109687]: osdmap e60: 6 total, 6 up, 6 in 2024-09-21T01:03:04.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:03 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: pgmap v184: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:05.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:05.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T01:03:05.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T01:03:05.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T01:03:05.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:04 smithi187 ceph-mon[78584]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T01:03:05.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: pgmap v184: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T01:03:05.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:04 smithi112 ceph-mon[109687]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T01:03:07.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:06 smithi187 ceph-mon[78584]: pgmap v187: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:06 smithi112 ceph-mon[109687]: pgmap v187: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:03:08.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:07 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 13/279 objects degraded (4.659%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:08.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:07 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 13/279 objects degraded (4.659%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:08 smithi112 ceph-mon[109687]: pgmap v188: 65 pgs: 8 active+undersized, 5 active+undersized+degraded, 52 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13/279 objects degraded (4.659%) 2024-09-21T01:03:09.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:08 smithi187 ceph-mon[78584]: pgmap v188: 65 pgs: 8 active+undersized, 5 active+undersized+degraded, 52 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13/279 objects degraded (4.659%) 2024-09-21T01:03:10.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:09 smithi112 ceph-mon[109687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/279 objects degraded (4.659%), 5 pgs degraded) 2024-09-21T01:03:10.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:09 smithi187 ceph-mon[78584]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/279 objects degraded (4.659%), 5 pgs degraded) 2024-09-21T01:03:11.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:10 smithi112 ceph-mon[109687]: pgmap v189: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:11.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:10 smithi187 ceph-mon[78584]: pgmap v189: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:13.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:12 smithi112 ceph-mon[109687]: pgmap v190: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:13.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:12 smithi187 ceph-mon[78584]: pgmap v190: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:14.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:14 smithi187 ceph-mon[78584]: pgmap v191: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:14.677 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:14.677 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:14.677 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:14 smithi112 ceph-mon[109687]: pgmap v191: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:17.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:16 smithi112 ceph-mon[109687]: pgmap v192: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:17.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:16 smithi187 ceph-mon[78584]: pgmap v192: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:18 smithi112 ceph-mon[109687]: pgmap v193: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:18 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:19.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:18 smithi187 ceph-mon[78584]: pgmap v193: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:19.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:18 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:20.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:19 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T01:03:20.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:19 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T01:03:20.170 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:19 smithi187 ceph-mon[78584]: Upgrade: osd.3 is safe to restart 2024-09-21T01:03:20.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:19 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T01:03:20.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:19 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T01:03:20.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:19 smithi112 ceph-mon[109687]: Upgrade: osd.3 is safe to restart 2024-09-21T01:03:21.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:20 smithi112 ceph-mon[109687]: pgmap v194: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:21.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:21.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:03:21.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:21.281 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:20 smithi187 ceph-mon[78584]: pgmap v194: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:21.282 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:21.282 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:03:21.282 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:22.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:21 smithi187 ceph-mon[78584]: Upgrade: Updating osd.3 2024-09-21T01:03:22.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:21 smithi187 ceph-mon[78584]: Deploying daemon osd.3 on smithi187 2024-09-21T01:03:22.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:21 smithi112 ceph-mon[109687]: Upgrade: Updating osd.3 2024-09-21T01:03:22.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:21 smithi112 ceph-mon[109687]: Deploying daemon osd.3 on smithi187 2024-09-21T01:03:23.101 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:22 smithi187 ceph-mon[78584]: pgmap v195: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:22 smithi112 ceph-mon[109687]: pgmap v195: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:23.716 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:23 smithi187 systemd[1]: Stopping Ceph osd.3 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:03:24.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:23 smithi187 ceph-mon[78584]: osd.3 marked itself down and dead 2024-09-21T01:03:24.159 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:23 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[40919]: 2024-09-21T01:03:23.713+0000 7f6dba9ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:03:24.159 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:23 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[40919]: 2024-09-21T01:03:23.713+0000 7f6dba9ae640 -1 osd.3 61 *** Got signal Terminated *** 2024-09-21T01:03:24.159 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:23 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[40919]: 2024-09-21T01:03:23.713+0000 7f6dba9ae640 -1 osd.3 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:03:24.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 -- 172.21.15.112:0/2907201146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794102ae0 msgr2=0x7f1794102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 --2- 172.21.15.112:0/2907201146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794102ae0 0x7f1794102ec0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17840097e0 tx=0x7f178402a480 comp rx=0 tx=0).stop 2024-09-21T01:03:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 -- 172.21.15.112:0/2907201146 shutdown_connections 2024-09-21T01:03:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 --2- 172.21.15.112:0/2907201146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794103400 0x7f179410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 --2- 172.21.15.112:0/2907201146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794102ae0 0x7f1794102ec0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 -- 172.21.15.112:0/2907201146 >> 172.21.15.112:0/2907201146 conn(0x7f17940fc4c0 msgr2=0x7f17940fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 -- 172.21.15.112:0/2907201146 shutdown_connections 2024-09-21T01:03:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.164+0000 7f1799e9a640 1 -- 172.21.15.112:0/2907201146 wait complete. 2024-09-21T01:03:24.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.165+0000 7f1799e9a640 1 Processor -- start 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.165+0000 7f1799e9a640 1 -- start start 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f1799e9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794102ae0 0x7f179419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f1799e9a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794103400 0x7f179419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f1799e9a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f179410edb0 con 0x7f1794102ae0 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f1799e9a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f179410ec30 con 0x7f1794103400 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f17937fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794102ae0 0x7f179419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f17937fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794102ae0 0x7f179419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39442/0 (socket says 172.21.15.112:39442) 2024-09-21T01:03:24.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f17937fe640 1 -- 172.21.15.112:0/590600968 learned_addr learned my addr 172.21.15.112:0/590600968 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f1792ffd640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794103400 0x7f179419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f17937fe640 1 -- 172.21.15.112:0/590600968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794103400 msgr2=0x7f179419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f17937fe640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794103400 0x7f179419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f17937fe640 1 -- 172.21.15.112:0/590600968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17941977a0 con 0x7f1794102ae0 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.166+0000 7f17937fe640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794102ae0 0x7f179419d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f178402a9a0 tx=0x7f1784004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.167+0000 7f1790ff9640 1 -- 172.21.15.112:0/590600968 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1784040070 con 0x7f1794102ae0 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.167+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1794197a30 con 0x7f1794102ae0 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.167+0000 7f1790ff9640 1 -- 172.21.15.112:0/590600968 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1784031400 con 0x7f1794102ae0 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.167+0000 7f1790ff9640 1 -- 172.21.15.112:0/590600968 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1784003b10 con 0x7f1794102ae0 2024-09-21T01:03:24.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.167+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1794197f60 con 0x7f1794102ae0 2024-09-21T01:03:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.168+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179406a3d0 con 0x7f1794102ae0 2024-09-21T01:03:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.168+0000 7f1790ff9640 1 -- 172.21.15.112:0/590600968 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1784039040 con 0x7f1794102ae0 2024-09-21T01:03:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.169+0000 7f1790ff9640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f177c07af30 0x7f177c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.169+0000 7f1790ff9640 1 -- 172.21.15.112:0/590600968 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f17840bf790 con 0x7f1794102ae0 2024-09-21T01:03:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.169+0000 7f1792ffd640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f177c07af30 0x7f177c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.170+0000 7f1792ffd640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f177c07af30 0x7f177c07d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1794108920 tx=0x7f1788009260 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:24.174 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:23 smithi112 ceph-mon[109687]: osd.3 marked itself down and dead 2024-09-21T01:03:24.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.174+0000 7f1790ff9640 1 -- 172.21.15.112:0/590600968 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f178408ae10 con 0x7f1794102ae0 2024-09-21T01:03:24.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.374+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1794198210 con 0x7f177c07af30 2024-09-21T01:03:24.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.375+0000 7f1790ff9640 1 -- 172.21.15.112:0/590600968 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f1794198210 con 0x7f177c07af30 2024-09-21T01:03:24.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f177c07af30 msgr2=0x7f177c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f177c07af30 0x7f177c07d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1794108920 tx=0x7f1788009260 comp rx=0 tx=0).stop 2024-09-21T01:03:24.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794102ae0 msgr2=0x7f179419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794102ae0 0x7f179419d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f178402a9a0 tx=0x7f1784004270 comp rx=0 tx=0).stop 2024-09-21T01:03:24.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 shutdown_connections 2024-09-21T01:03:24.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f177c07af30 0x7f177c07d3f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794103400 0x7f179419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 --2- 172.21.15.112:0/590600968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1794102ae0 0x7f179419d620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 >> 172.21.15.112:0/590600968 conn(0x7f17940fc4c0 msgr2=0x7f1794103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:24.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 shutdown_connections 2024-09-21T01:03:24.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.377+0000 7f1799e9a640 1 -- 172.21.15.112:0/590600968 wait complete. 2024-09-21T01:03:24.388 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:03:24.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 -- 172.21.15.112:0/3753615608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 msgr2=0x7fe3b4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/3753615608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b4100c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009880 tx=0x7fe3a002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 -- 172.21.15.112:0/3753615608 shutdown_connections 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/3753615608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b4100c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/3753615608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3b41067e0 0x7fe3b4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 -- 172.21.15.112:0/3753615608 >> 172.21.15.112:0/3753615608 conn(0x7fe3b40fc4c0 msgr2=0x7fe3b40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 -- 172.21.15.112:0/3753615608 shutdown_connections 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 -- 172.21.15.112:0/3753615608 wait complete. 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 Processor -- start 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.464+0000 7fe3bb06e640 1 -- start start 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3bb06e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b40fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3bb06e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3b41067e0 0x7fe3b40fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3bb06e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b410dcb0 con 0x7fe3b41007e0 2024-09-21T01:03:24.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3bb06e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b410db30 con 0x7fe3b41067e0 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b8e0a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b40fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b8e0a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b40fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39464/0 (socket says 172.21.15.112:39464) 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b8e0a640 1 -- 172.21.15.112:0/1743502631 learned_addr learned my addr 172.21.15.112:0/1743502631 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b3fff640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3b41067e0 0x7fe3b40fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b8e0a640 1 -- 172.21.15.112:0/1743502631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3b41067e0 msgr2=0x7fe3b40fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b8e0a640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3b41067e0 0x7fe3b40fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b8e0a640 1 -- 172.21.15.112:0/1743502631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b40fd690 con 0x7fe3b41007e0 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b3fff640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3b41067e0 0x7fe3b40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.465+0000 7fe3b8e0a640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b40fcc10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800e970 tx=0x7fe3a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.466+0000 7fe3b1ffb640 1 -- 172.21.15.112:0/1743502631 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3a800cac0 con 0x7fe3b41007e0 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.466+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b40fd980 con 0x7fe3b41007e0 2024-09-21T01:03:24.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.466+0000 7fe3b1ffb640 1 -- 172.21.15.112:0/1743502631 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3a80054e0 con 0x7fe3b41007e0 2024-09-21T01:03:24.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.466+0000 7fe3b1ffb640 1 -- 172.21.15.112:0/1743502631 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3a8010430 con 0x7fe3b41007e0 2024-09-21T01:03:24.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.466+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b41a3eb0 con 0x7fe3b41007e0 2024-09-21T01:03:24.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.467+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b4101f20 con 0x7fe3b41007e0 2024-09-21T01:03:24.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.468+0000 7fe3b1ffb640 1 -- 172.21.15.112:0/1743502631 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe3a8004f00 con 0x7fe3b41007e0 2024-09-21T01:03:24.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.469+0000 7fe3b1ffb640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe3a407af80 0x7fe3a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.469+0000 7fe3b1ffb640 1 -- 172.21.15.112:0/1743502631 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fe3a809e670 con 0x7fe3b41007e0 2024-09-21T01:03:24.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.469+0000 7fe3b3fff640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe3a407af80 0x7fe3a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.469+0000 7fe3b3fff640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe3a407af80 0x7fe3a407d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40fe6a0 tx=0x7fe3a0031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:24.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.474+0000 7fe3b1ffb640 1 -- 172.21.15.112:0/1743502631 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3a8069cf0 con 0x7fe3b41007e0 2024-09-21T01:03:24.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.675+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe3b4062630 con 0x7fe3a407af80 2024-09-21T01:03:24.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.677+0000 7fe3b1ffb640 1 -- 172.21.15.112:0/1743502631 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fe3b4062630 con 0x7fe3a407af80 2024-09-21T01:03:24.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe3a407af80 msgr2=0x7fe3a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe3a407af80 0x7fe3a407d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40fe6a0 tx=0x7fe3a0031400 comp rx=0 tx=0).stop 2024-09-21T01:03:24.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 msgr2=0x7fe3b40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b40fcc10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800e970 tx=0x7fe3a800ed70 comp rx=0 tx=0).stop 2024-09-21T01:03:24.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 shutdown_connections 2024-09-21T01:03:24.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe3a407af80 0x7fe3a407d440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3b41067e0 0x7fe3b40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 --2- 172.21.15.112:0/1743502631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3b41007e0 0x7fe3b40fcc10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 >> 172.21.15.112:0/1743502631 conn(0x7fe3b40fc4c0 msgr2=0x7fe3b4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:24.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 shutdown_connections 2024-09-21T01:03:24.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.679+0000 7fe3bb06e640 1 -- 172.21.15.112:0/1743502631 wait complete. 2024-09-21T01:03:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.763+0000 7fa0b500b640 1 -- 172.21.15.112:0/4008256630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01007e0 msgr2=0x7fa0b0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.763+0000 7fa0b500b640 1 --2- 172.21.15.112:0/4008256630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01007e0 0x7fa0b0100c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa098009880 tx=0x7fa09802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.763+0000 7fa0b500b640 1 -- 172.21.15.112:0/4008256630 shutdown_connections 2024-09-21T01:03:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.764+0000 7fa0b500b640 1 --2- 172.21.15.112:0/4008256630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01007e0 0x7fa0b0100c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.764+0000 7fa0b500b640 1 --2- 172.21.15.112:0/4008256630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b01067e0 0x7fa0b0106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.764+0000 7fa0b500b640 1 -- 172.21.15.112:0/4008256630 >> 172.21.15.112:0/4008256630 conn(0x7fa0b00fc4c0 msgr2=0x7fa0b00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:24.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.764+0000 7fa0b500b640 1 -- 172.21.15.112:0/4008256630 shutdown_connections 2024-09-21T01:03:24.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.764+0000 7fa0b500b640 1 -- 172.21.15.112:0/4008256630 wait complete. 2024-09-21T01:03:24.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.764+0000 7fa0b500b640 1 Processor -- start 2024-09-21T01:03:24.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0b500b640 1 -- start start 2024-09-21T01:03:24.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0b500b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b01007e0 0x7fa0b01023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0b500b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01067e0 0x7fa0b01028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0b500b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010dc90 con 0x7fa0b01067e0 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0b500b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010db10 con 0x7fa0b01007e0 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0ae59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01067e0 0x7fa0b01028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0ae59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01067e0 0x7fa0b01028f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39474/0 (socket says 172.21.15.112:39474) 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0ae59c640 1 -- 172.21.15.112:0/1597022842 learned_addr learned my addr 172.21.15.112:0/1597022842 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0aed9d640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b01007e0 0x7fa0b01023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0ae59c640 1 -- 172.21.15.112:0/1597022842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b01007e0 msgr2=0x7fa0b01023b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0ae59c640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b01007e0 0x7fa0b01023b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.765+0000 7fa0ae59c640 1 -- 172.21.15.112:0/1597022842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b0102e30 con 0x7fa0b01067e0 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.766+0000 7fa0ae59c640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01067e0 0x7fa0b01028f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa098031460 tx=0x7fa0980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.766+0000 7fa0a7fff640 1 -- 172.21.15.112:0/1597022842 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa09803f070 con 0x7fa0b01067e0 2024-09-21T01:03:24.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.766+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b01030c0 con 0x7fa0b01067e0 2024-09-21T01:03:24.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.766+0000 7fa0a7fff640 1 -- 172.21.15.112:0/1597022842 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa098004cf0 con 0x7fa0b01067e0 2024-09-21T01:03:24.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.766+0000 7fa0a7fff640 1 -- 172.21.15.112:0/1597022842 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa098035030 con 0x7fa0b01067e0 2024-09-21T01:03:24.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.766+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b01a3d00 con 0x7fa0b01067e0 2024-09-21T01:03:24.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.767+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b0101f20 con 0x7fa0b01067e0 2024-09-21T01:03:24.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.768+0000 7fa0a7fff640 1 -- 172.21.15.112:0/1597022842 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa098042070 con 0x7fa0b01067e0 2024-09-21T01:03:24.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.768+0000 7fa0a7fff640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa09c07af80 0x7fa09c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:24.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.768+0000 7fa0a7fff640 1 -- 172.21.15.112:0/1597022842 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fa0980be910 con 0x7fa0b01067e0 2024-09-21T01:03:24.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.769+0000 7fa0aed9d640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa09c07af80 0x7fa09c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:24.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.769+0000 7fa0aed9d640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa09c07af80 0x7fa09c07d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000abe0 tx=0x7fa0a000a2d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:24.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.773+0000 7fa0a7fff640 1 -- 172.21.15.112:0/1597022842 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa098089f90 con 0x7fa0b01067e0 2024-09-21T01:03:24.808 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:24 smithi187 podman[85559]: 2024-09-21 01:03:24.502116658 +0000 UTC m=+0.890218447 container died 4a50fabac2c309a78c271fd107fffb32faf64b6fbe6b26ae237b22bad3a74a57 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:03:24.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:24.994+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa0b00fcc00 con 0x7fa09c07af80 2024-09-21T01:03:25.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.004+0000 7fa0a7fff640 1 -- 172.21.15.112:0/1597022842 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa0b00fcc00 con 0x7fa09c07af80 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (3m) 25s ago 14m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (6m) 25s ago 15m 8850k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (6m) 119s ago 14m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (2m) 25s ago 14m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (2m) 119s ago 14m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (3m) 25s ago 14m 81.2M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (9m) 25s ago 9m 150M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (9m) 25s ago 9m 17.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:03:25.006 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (9m) 119s ago 9m 20.0M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (9m) 119s ago 9m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (6m) 25s ago 16m 593M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (5m) 119s ago 13m 522M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (2m) 25s ago 16m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (2m) 119s ago 13m 93.3M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 25s ago 14m 11.1M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (4m) 119s ago 14m 10.5M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (102s) 25s ago 12m 149M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (66s) 25s ago 12m 153M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (30s) 25s ago 11m 79.3M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (11m) 119s ago 11m 254M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 4a50fabac2c3 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (10m) 119s ago 10m 206M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (10m) 119s ago 10m 191M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:03:25.007 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (4m) 25s ago 14m 56.0M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa09c07af80 msgr2=0x7fa09c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa09c07af80 0x7fa09c07d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000abe0 tx=0x7fa0a000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01067e0 msgr2=0x7fa0b01028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01067e0 0x7fa0b01028f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa098031460 tx=0x7fa0980048f0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 shutdown_connections 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa09c07af80 0x7fa09c07d440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0b01067e0 0x7fa0b01028f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 --2- 172.21.15.112:0/1597022842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0b01007e0 0x7fa0b01023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 >> 172.21.15.112:0/1597022842 conn(0x7fa0b00fc4c0 msgr2=0x7fa0b0104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 shutdown_connections 2024-09-21T01:03:25.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.006+0000 7fa0b500b640 1 -- 172.21.15.112:0/1597022842 wait complete. 2024-09-21T01:03:25.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 -- 172.21.15.112:0/321386264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 msgr2=0x7f6c2c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 --2- 172.21.15.112:0/321386264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c106bc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009880 tx=0x7f6c1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 -- 172.21.15.112:0/321386264 shutdown_connections 2024-09-21T01:03:25.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 --2- 172.21.15.112:0/321386264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c1007e0 0x7f6c2c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 --2- 172.21.15.112:0/321386264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c106bc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 -- 172.21.15.112:0/321386264 >> 172.21.15.112:0/321386264 conn(0x7f6c2c0fc4c0 msgr2=0x7f6c2c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 -- 172.21.15.112:0/321386264 shutdown_connections 2024-09-21T01:03:25.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.087+0000 7f6c31b02640 1 -- 172.21.15.112:0/321386264 wait complete. 2024-09-21T01:03:25.090 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:24 smithi112 ceph-mon[109687]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:25.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:24 smithi112 ceph-mon[109687]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:03:25.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:24 smithi112 ceph-mon[109687]: osdmap e62: 6 total, 5 up, 6 in 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.088+0000 7f6c31b02640 1 Processor -- start 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.088+0000 7f6c31b02640 1 -- start start 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.088+0000 7f6c31b02640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c1007e0 0x7f6c2c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.088+0000 7f6c31b02640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c31b02640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c10dcb0 con 0x7f6c2c1067e0 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c31b02640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c10db30 con 0x7f6c2c1007e0 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c1007e0 0x7f6c2c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39496/0 (socket says 172.21.15.112:39496) 2024-09-21T01:03:25.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2affd640 1 -- 172.21.15.112:0/102150142 learned_addr learned my addr 172.21.15.112:0/102150142 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c1007e0 0x7f6c2c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:60562/0 (socket says 172.21.15.112:60562) 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2affd640 1 -- 172.21.15.112:0/102150142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c1007e0 msgr2=0x7f6c2c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2affd640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c1007e0 0x7f6c2c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2affd640 1 -- 172.21.15.112:0/102150142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c199360 con 0x7f6c2c1067e0 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c2affd640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c198d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000d6f0 tx=0x7f6c2000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.089+0000 7f6c28ff9640 1 -- 172.21.15.112:0/102150142 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c20017070 con 0x7f6c2c1067e0 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.090+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c199650 con 0x7f6c2c1067e0 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.090+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c1a1c50 con 0x7f6c2c1067e0 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.090+0000 7f6c28ff9640 1 -- 172.21.15.112:0/102150142 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c2000de00 con 0x7f6c2c1067e0 2024-09-21T01:03:25.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.090+0000 7f6c28ff9640 1 -- 172.21.15.112:0/102150142 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c20004bb0 con 0x7f6c2c1067e0 2024-09-21T01:03:25.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.091+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c18005290 con 0x7f6c2c1067e0 2024-09-21T01:03:25.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.092+0000 7f6c28ff9640 1 -- 172.21.15.112:0/102150142 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6c20009a30 con 0x7f6c2c1067e0 2024-09-21T01:03:25.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.092+0000 7f6c28ff9640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6c1407af80 0x7f6c1407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.093+0000 7f6c28ff9640 1 -- 172.21.15.112:0/102150142 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f6c2009da00 con 0x7f6c2c1067e0 2024-09-21T01:03:25.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.093+0000 7f6c2b7fe640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6c1407af80 0x7f6c1407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.093+0000 7f6c2b7fe640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6c1407af80 0x7f6c1407d440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0096c0 tx=0x7f6c1c031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.101+0000 7f6c28ff9640 1 -- 172.21.15.112:0/102150142 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c2c199650 con 0x7f6c2c1067e0 2024-09-21T01:03:25.137 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:24 smithi187 podman[85559]: 2024-09-21 01:03:24.926087344 +0000 UTC m=+1.314189139 container cleanup 4a50fabac2c309a78c271fd107fffb32faf64b6fbe6b26ae237b22bad3a74a57 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS) 2024-09-21T01:03:25.138 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:24 smithi187 bash[85559]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3 2024-09-21T01:03:25.138 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:24 smithi187 ceph-mon[78584]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:25.138 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:24 smithi187 ceph-mon[78584]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:03:25.138 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:24 smithi187 ceph-mon[78584]: osdmap e62: 6 total, 5 up, 6 in 2024-09-21T01:03:25.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.352+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6c18005d90 con 0x7f6c2c1067e0 2024-09-21T01:03:25.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.352+0000 7f6c28ff9640 1 -- 172.21.15.112:0/102150142 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f6c20069080 con 0x7f6c2c1067e0 2024-09-21T01:03:25.354 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 3 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:03:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6, 2024-09-21T01:03:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 7 2024-09-21T01:03:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:03:25.356 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6c1407af80 msgr2=0x7f6c1407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6c1407af80 0x7f6c1407d440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0096c0 tx=0x7f6c1c031400 comp rx=0 tx=0).stop 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 msgr2=0x7f6c2c198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c198d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000d6f0 tx=0x7f6c2000dbb0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 shutdown_connections 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6c1407af80 0x7f6c1407d440 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c2c1067e0 0x7f6c2c198d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 --2- 172.21.15.112:0/102150142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c1007e0 0x7f6c2c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 >> 172.21.15.112:0/102150142 conn(0x7f6c2c0fc4c0 msgr2=0x7f6c2c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 shutdown_connections 2024-09-21T01:03:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.355+0000 7f6c31b02640 1 -- 172.21.15.112:0/102150142 wait complete. 2024-09-21T01:03:25.408 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:25 smithi187 podman[85573]: 2024-09-21 01:03:25.13721932 +0000 UTC m=+0.635495093 container remove 4a50fabac2c309a78c271fd107fffb32faf64b6fbe6b26ae237b22bad3a74a57 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-4e45e6b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 -- 172.21.15.112:0/94312548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95880ffd20 msgr2=0x7f9588100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 --2- 172.21.15.112:0/94312548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95880ffd20 0x7f9588100180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9584009880 tx=0x7f958402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 -- 172.21.15.112:0/94312548 shutdown_connections 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 --2- 172.21.15.112:0/94312548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95880ffd20 0x7f9588100180 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 --2- 172.21.15.112:0/94312548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9588106900 0x7f9588106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 -- 172.21.15.112:0/94312548 >> 172.21.15.112:0/94312548 conn(0x7f95880fbc10 msgr2=0x7f95880fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 -- 172.21.15.112:0/94312548 shutdown_connections 2024-09-21T01:03:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.448+0000 7f958fec4640 1 -- 172.21.15.112:0/94312548 wait complete. 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958fec4640 1 Processor -- start 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958fec4640 1 -- start start 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958fec4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95880ffd20 0x7f9588100f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958fec4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9588106900 0x7f9588101440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958fec4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f958810ee80 con 0x7f9588106900 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958fec4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f958810ed00 con 0x7f95880ffd20 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958d45f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9588106900 0x7f9588101440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958d45f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9588106900 0x7f9588101440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39510/0 (socket says 172.21.15.112:39510) 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958dc60640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95880ffd20 0x7f9588100f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958d45f640 1 -- 172.21.15.112:0/897920121 learned_addr learned my addr 172.21.15.112:0/897920121 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958dc60640 1 -- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9588106900 msgr2=0x7f9588101440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958dc60640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9588106900 0x7f9588101440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958dc60640 1 -- 172.21.15.112:0/897920121 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9588101980 con 0x7f95880ffd20 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.449+0000 7f958d45f640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9588106900 0x7f9588101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.450+0000 7f958dc60640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95880ffd20 0x7f9588100f00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f957800e970 tx=0x7f957800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.450+0000 7f957effd640 1 -- 172.21.15.112:0/897920121 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f957800cac0 con 0x7f95880ffd20 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.450+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9588101c70 con 0x7f95880ffd20 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.450+0000 7f957effd640 1 -- 172.21.15.112:0/897920121 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f957800cc60 con 0x7f95880ffd20 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.450+0000 7f957effd640 1 -- 172.21.15.112:0/897920121 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9578018720 con 0x7f95880ffd20 2024-09-21T01:03:25.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.450+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95881a3eb0 con 0x7f95880ffd20 2024-09-21T01:03:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.451+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9588103040 con 0x7f95880ffd20 2024-09-21T01:03:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.452+0000 7f957effd640 1 -- 172.21.15.112:0/897920121 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9578010430 con 0x7f95880ffd20 2024-09-21T01:03:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.452+0000 7f957effd640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f957407af30 0x7f957407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.452+0000 7f957effd640 1 -- 172.21.15.112:0/897920121 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f957809e4f0 con 0x7f95880ffd20 2024-09-21T01:03:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.452+0000 7f958d45f640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f957407af30 0x7f957407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.453+0000 7f958d45f640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f957407af30 0x7f957407d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9588102990 tx=0x7f95840058d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.457+0000 7f957effd640 1 -- 172.21.15.112:0/897920121 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9578069af0 con 0x7f95880ffd20 2024-09-21T01:03:25.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.669+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9588102430 con 0x7f95880ffd20 2024-09-21T01:03:25.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.670+0000 7f957effd640 1 -- 172.21.15.112:0/897920121 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7f957806e9a0 con 0x7f95880ffd20 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:03:25.672 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:03:25.673 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:25.674 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:25.675 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:25.675 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:25.675 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:03:25.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f957407af30 msgr2=0x7f957407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f957407af30 0x7f957407d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9588102990 tx=0x7f95840058d0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95880ffd20 msgr2=0x7f9588100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95880ffd20 0x7f9588100f00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f957800e970 tx=0x7f957800ee30 comp rx=0 tx=0).stop 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 shutdown_connections 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f957407af30 0x7f957407d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9588106900 0x7f9588101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 --2- 172.21.15.112:0/897920121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95880ffd20 0x7f9588100f00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 >> 172.21.15.112:0/897920121 conn(0x7f95880fbc10 msgr2=0x7f95880fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 shutdown_connections 2024-09-21T01:03:25.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.672+0000 7f958fec4640 1 -- 172.21.15.112:0/897920121 wait complete. 2024-09-21T01:03:25.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.754+0000 7f0ef2c69640 1 -- 172.21.15.112:0/3462259085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 msgr2=0x7f0eec106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.754+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/3462259085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec106c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009880 tx=0x7f0edc02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 -- 172.21.15.112:0/3462259085 shutdown_connections 2024-09-21T01:03:25.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/3462259085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0eec100820 0x7f0eec100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/3462259085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec106c00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 -- 172.21.15.112:0/3462259085 >> 172.21.15.112:0/3462259085 conn(0x7f0eec0fc520 msgr2=0x7f0eec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 -- 172.21.15.112:0/3462259085 shutdown_connections 2024-09-21T01:03:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 -- 172.21.15.112:0/3462259085 wait complete. 2024-09-21T01:03:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 Processor -- start 2024-09-21T01:03:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 -- start start 2024-09-21T01:03:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0eec100820 0x7f0eec19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10dcf0 con 0x7f0eec106820 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.755+0000 7f0ef2c69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0eec10db70 con 0x7f0eec100820 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0eebfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0eebfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39520/0 (socket says 172.21.15.112:39520) 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0eebfff640 1 -- 172.21.15.112:0/2528210956 learned_addr learned my addr 172.21.15.112:0/2528210956 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0ef0a05640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0eec100820 0x7f0eec19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0eebfff640 1 -- 172.21.15.112:0/2528210956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0eec100820 msgr2=0x7f0eec19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0eebfff640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0eec100820 0x7f0eec19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0eebfff640 1 -- 172.21.15.112:0/2528210956 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eec1977e0 con 0x7f0eec106820 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0eebfff640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec19dba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000e970 tx=0x7f0ee000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0ee9ffb640 1 -- 172.21.15.112:0/2528210956 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ee000cac0 con 0x7f0eec106820 2024-09-21T01:03:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eec197ad0 con 0x7f0eec106820 2024-09-21T01:03:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0ee9ffb640 1 -- 172.21.15.112:0/2528210956 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ee00054e0 con 0x7f0eec106820 2024-09-21T01:03:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0ee9ffb640 1 -- 172.21.15.112:0/2528210956 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ee0010430 con 0x7f0eec106820 2024-09-21T01:03:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.756+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eec198060 con 0x7f0eec106820 2024-09-21T01:03:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.757+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eec101f60 con 0x7f0eec106820 2024-09-21T01:03:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.758+0000 7f0ee9ffb640 1 -- 172.21.15.112:0/2528210956 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0ee0004e80 con 0x7f0eec106820 2024-09-21T01:03:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.758+0000 7f0ee9ffb640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0ed407af30 0x7f0ed407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.759+0000 7f0ee9ffb640 1 -- 172.21.15.112:0/2528210956 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f0ee009e630 con 0x7f0eec106820 2024-09-21T01:03:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.759+0000 7f0ef0a05640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0ed407af30 0x7f0ed407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:25.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.759+0000 7f0ef0a05640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0ed407af30 0x7f0ed407d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0096c0 tx=0x7f0edc031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:25.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.763+0000 7f0ee9ffb640 1 -- 172.21.15.112:0/2528210956 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ee0069c30 con 0x7f0eec106820 2024-09-21T01:03:25.793 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:25 smithi187 podman[85664]: 2024-09-21 01:03:25.440233036 +0000 UTC m=+0.015769170 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:03:25.793 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:25 smithi187 podman[85664]: 2024-09-21 01:03:25.554875136 +0000 UTC m=+0.130411271 container create b9ed2bcc64dd78818fa60fbb758920cd6abd05d6da07582b02d916c649b262bc (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-21T01:03:25.793 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:25 smithi187 podman[85664]: 2024-09-21 01:03:25.793527765 +0000 UTC m=+0.369063904 container init b9ed2bcc64dd78818fa60fbb758920cd6abd05d6da07582b02d916c649b262bc (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T01:03:25.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.961+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0eec198370 con 0x7f0ed407af30 2024-09-21T01:03:25.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.962+0000 7f0ee9ffb640 1 -- 172.21.15.112:0/2528210956 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f0eec198370 con 0x7f0ed407af30 2024-09-21T01:03:25.964 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:03:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:03:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:03:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:03:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:03:25.964 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:03:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:03:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:03:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:03:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "9/23 daemons upgraded", 2024-09-21T01:03:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T01:03:25.965 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:03:25.965 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:03:25.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0ed407af30 msgr2=0x7f0ed407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0ed407af30 0x7f0ed407d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0096c0 tx=0x7f0edc031400 comp rx=0 tx=0).stop 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 msgr2=0x7f0eec19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec19dba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000e970 tx=0x7f0ee000ed70 comp rx=0 tx=0).stop 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 shutdown_connections 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f0ed407af30 0x7f0ed407d3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0eec106820 0x7f0eec19dba0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 --2- 172.21.15.112:0/2528210956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0eec100820 0x7f0eec19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 >> 172.21.15.112:0/2528210956 conn(0x7f0eec0fc520 msgr2=0x7f0eec06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 shutdown_connections 2024-09-21T01:03:25.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:25.965+0000 7f0ef2c69640 1 -- 172.21.15.112:0/2528210956 wait complete. 2024-09-21T01:03:26.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 -- 172.21.15.112:0/2855279585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc107930 msgr2=0x7f69cc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 --2- 172.21.15.112:0/2855279585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc107930 0x7f69cc107d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009880 tx=0x7f69c802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 -- 172.21.15.112:0/2855279585 shutdown_connections 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 --2- 172.21.15.112:0/2855279585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69cc101930 0x7f69cc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 --2- 172.21.15.112:0/2855279585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc107930 0x7f69cc107d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 -- 172.21.15.112:0/2855279585 >> 172.21.15.112:0/2855279585 conn(0x7f69cc0fd630 msgr2=0x7f69cc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 -- 172.21.15.112:0/2855279585 shutdown_connections 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.046+0000 7f69d310f640 1 -- 172.21.15.112:0/2855279585 wait complete. 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d310f640 1 Processor -- start 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d310f640 1 -- start start 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d310f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc101930 0x7f69cc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d310f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69cc107930 0x7f69cc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:26.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d310f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc10ee60 con 0x7f69cc101930 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d310f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc10ece0 con 0x7f69cc107930 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d0eab640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc101930 0x7f69cc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d0eab640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc101930 0x7f69cc19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39530/0 (socket says 172.21.15.112:39530) 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d0eab640 1 -- 172.21.15.112:0/3679846153 learned_addr learned my addr 172.21.15.112:0/3679846153 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69c3fff640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69cc107930 0x7f69cc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d0eab640 1 -- 172.21.15.112:0/3679846153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69cc107930 msgr2=0x7f69cc19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d0eab640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69cc107930 0x7f69cc19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.047+0000 7f69d0eab640 1 -- 172.21.15.112:0/3679846153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc197870 con 0x7f69cc101930 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.048+0000 7f69d0eab640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc101930 0x7f69cc19d6b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69c8031460 tx=0x7f69c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.048+0000 7f69c1ffb640 1 -- 172.21.15.112:0/3679846153 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69c803f070 con 0x7f69cc101930 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.048+0000 7f69c1ffb640 1 -- 172.21.15.112:0/3679846153 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69c8004cf0 con 0x7f69cc101930 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.048+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc197b00 con 0x7f69cc101930 2024-09-21T01:03:26.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.048+0000 7f69c1ffb640 1 -- 172.21.15.112:0/3679846153 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69c8035030 con 0x7f69cc101930 2024-09-21T01:03:26.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.048+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc198030 con 0x7f69cc101930 2024-09-21T01:03:26.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.049+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc103070 con 0x7f69cc101930 2024-09-21T01:03:26.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.049+0000 7f69c1ffb640 1 -- 172.21.15.112:0/3679846153 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f69c8042070 con 0x7f69cc101930 2024-09-21T01:03:26.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.050+0000 7f69c1ffb640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f69b407af30 0x7f69b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:26.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.050+0000 7f69c1ffb640 1 -- 172.21.15.112:0/3679846153 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f69c80beb30 con 0x7f69cc101930 2024-09-21T01:03:26.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.050+0000 7f69c3fff640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f69b407af30 0x7f69b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:26.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.050+0000 7f69c3fff640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f69b407af30 0x7f69b407d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0ffbf0 tx=0x7f69bc009110 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:26.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.055+0000 7f69c1ffb640 1 -- 172.21.15.112:0/3679846153 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69c808a090 con 0x7f69cc101930 2024-09-21T01:03:26.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:25 smithi187 ceph-mon[78584]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:26.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:25 smithi187 ceph-mon[78584]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:26.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:25 smithi187 ceph-mon[78584]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T01:03:26.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:25 smithi187 ceph-mon[78584]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:26.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:25 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/102150142' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:26.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:25 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/897920121' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:03:26.160 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:25 smithi187 podman[85664]: 2024-09-21 01:03:25.796953229 +0000 UTC m=+0.372489364 container start b9ed2bcc64dd78818fa60fbb758920cd6abd05d6da07582b02d916c649b262bc (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:03:26.160 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:25 smithi187 podman[85664]: 2024-09-21 01:03:25.876664629 +0000 UTC m=+0.452200780 container attach b9ed2bcc64dd78818fa60fbb758920cd6abd05d6da07582b02d916c649b262bc (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:03:26.160 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:25 smithi187 podman[85664]: 2024-09-21 01:03:25.988868739 +0000 UTC m=+0.564404875 container died b9ed2bcc64dd78818fa60fbb758920cd6abd05d6da07582b02d916c649b262bc (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:03:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:25 smithi112 ceph-mon[109687]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:25 smithi112 ceph-mon[109687]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:25 smithi112 ceph-mon[109687]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T01:03:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:25 smithi112 ceph-mon[109687]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:26.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:25 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/102150142' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:26.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:25 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/897920121' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:03:26.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.304+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f69cc198da0 con 0x7f69cc101930 2024-09-21T01:03:26.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.304+0000 7f69c1ffb640 1 -- 172.21.15.112:0/3679846153 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+290 (secure 0 0 0) 0x7f69c808ef40 con 0x7f69cc101930 2024-09-21T01:03:26.306 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-09-21T01:03:26.306 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:03:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:03:26.307 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T01:03:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: osd.3 (root=default,host=smithi187) is down 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f69b407af30 msgr2=0x7f69b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f69b407af30 0x7f69b407d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0ffbf0 tx=0x7f69bc009110 comp rx=0 tx=0).stop 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc101930 msgr2=0x7f69cc19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc101930 0x7f69cc19d6b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69c8031460 tx=0x7f69c80048f0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 shutdown_connections 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f69b407af30 0x7f69b407d3f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69cc107930 0x7f69cc19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 --2- 172.21.15.112:0/3679846153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69cc101930 0x7f69cc19d6b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 >> 172.21.15.112:0/3679846153 conn(0x7f69cc0fd630 msgr2=0x7f69cc0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 shutdown_connections 2024-09-21T01:03:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:26.307+0000 7f69d310f640 1 -- 172.21.15.112:0/3679846153 wait complete. 2024-09-21T01:03:26.590 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:26 smithi187 podman[85687]: 2024-09-21 01:03:26.572317943 +0000 UTC m=+0.577615433 container remove b9ed2bcc64dd78818fa60fbb758920cd6abd05d6da07582b02d916c649b262bc (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T01:03:26.908 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:26 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T01:03:26.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:26 smithi187 systemd[1]: Stopped Ceph osd.3 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:03:26.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:26 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.3.service: Consumed 1min 1.515s CPU time. 2024-09-21T01:03:26.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:26 smithi187 systemd[1]: Starting Ceph osd.3 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:03:27.251 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:26 smithi187 ceph-mon[78584]: pgmap v199: 65 pgs: 16 stale+active+clean, 49 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:27.251 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:26 smithi187 ceph-mon[78584]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:27.252 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:26 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3679846153' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:03:27.252 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 podman[85787]: 2024-09-21 01:03:26.913406872 +0000 UTC m=+0.015932762 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:03:27.252 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 podman[85787]: 2024-09-21 01:03:27.048774962 +0000 UTC m=+0.151300889 container create 898d922e99aa2505ee6fc4b8893c648ce7511148ecbe20b5161f98e584a6bed7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:03:27.252 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 podman[85787]: 2024-09-21 01:03:27.251462096 +0000 UTC m=+0.353987999 container init 898d922e99aa2505ee6fc4b8893c648ce7511148ecbe20b5161f98e584a6bed7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:03:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:26 smithi112 ceph-mon[109687]: pgmap v199: 65 pgs: 16 stale+active+clean, 49 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:26 smithi112 ceph-mon[109687]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:26 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3679846153' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:03:27.659 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 podman[85787]: 2024-09-21 01:03:27.254744747 +0000 UTC m=+0.357270637 container start 898d922e99aa2505ee6fc4b8893c648ce7511148ecbe20b5161f98e584a6bed7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:03:27.659 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 podman[85787]: 2024-09-21 01:03:27.369561589 +0000 UTC m=+0.472087475 container attach 898d922e99aa2505ee6fc4b8893c648ce7511148ecbe20b5161f98e584a6bed7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T01:03:27.659 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:03:27.659 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 bash[85787]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:03:27.659 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:03:27.659 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:27 smithi187 bash[85787]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:03:28.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:27 smithi112 ceph-mon[109687]: Health check failed: Degraded data redundancy: 13/279 objects degraded (4.659%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:28.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:27 smithi187 ceph-mon[78584]: Health check failed: Degraded data redundancy: 13/279 objects degraded (4.659%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:28.409 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T01:03:28.409 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 bash[85787]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T01:03:28.409 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T01:03:28.409 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 bash[85787]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T01:03:28.814 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T01:03:28.814 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 bash[85787]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 bash[85787]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 bash[85787]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 bash[85787]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate[85802]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 bash[85787]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-21T01:03:28.815 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:28 smithi187 podman[85787]: 2024-09-21 01:03:28.535553794 +0000 UTC m=+1.638079680 container died 898d922e99aa2505ee6fc4b8893c648ce7511148ecbe20b5161f98e584a6bed7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:03:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-mon[78584]: pgmap v200: 65 pgs: 6 active+undersized, 12 stale+active+clean, 5 active+undersized+degraded, 42 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13/279 objects degraded (4.659%) 2024-09-21T01:03:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:28 smithi112 ceph-mon[109687]: pgmap v200: 65 pgs: 6 active+undersized, 12 stale+active+clean, 5 active+undersized+degraded, 42 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13/279 objects degraded (4.659%) 2024-09-21T01:03:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:29.589 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 podman[85932]: 2024-09-21 01:03:29.224143709 +0000 UTC m=+0.682928701 container remove 898d922e99aa2505ee6fc4b8893c648ce7511148ecbe20b5161f98e584a6bed7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T01:03:29.590 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 podman[85992]: 2024-09-21 01:03:29.33233622 +0000 UTC m=+0.015683255 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:03:29.590 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 podman[85992]: 2024-09-21 01:03:29.433415781 +0000 UTC m=+0.116762851 container create ea28f02f247bc54cf3ae0d30f0f2df6d07f35a10771f9ad41ee889f7f9ea4996 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:03:29.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 podman[85992]: 2024-09-21 01:03:29.702721113 +0000 UTC m=+0.386068133 container init ea28f02f247bc54cf3ae0d30f0f2df6d07f35a10771f9ad41ee889f7f9ea4996 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:03:29.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 podman[85992]: 2024-09-21 01:03:29.705869326 +0000 UTC m=+0.389216348 container start ea28f02f247bc54cf3ae0d30f0f2df6d07f35a10771f9ad41ee889f7f9ea4996 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:03:29.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 ceph-osd[86011]: -- 172.21.15.187:0/2102672938 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556778acc1e0 con 0x556777d55180 2024-09-21T01:03:29.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 bash[85992]: ea28f02f247bc54cf3ae0d30f0f2df6d07f35a10771f9ad41ee889f7f9ea4996 2024-09-21T01:03:29.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:29 smithi187 systemd[1]: Started Ceph osd.3 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:03:31.102 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:30 smithi187 ceph-mon[78584]: pgmap v201: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:31.102 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:31.102 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:31.102 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:30 smithi112 ceph-mon[109687]: pgmap v201: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:31.408 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:31 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[86007]: 2024-09-21T01:03:31.342+0000 7f1e46fc3640 -1 Falling back to public interface 2024-09-21T01:03:33.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:32 smithi187 ceph-mon[78584]: pgmap v202: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:33.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:33.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:33.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:32 smithi112 ceph-mon[109687]: pgmap v202: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:33.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:33.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:34.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:34 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:34.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:34 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:34.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:34 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 62/279 objects degraded (22.222%), 18 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:34 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:34 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:34 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 62/279 objects degraded (22.222%), 18 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:35.172 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:35 smithi187 ceph-mon[78584]: pgmap v203: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:35 smithi112 ceph-mon[109687]: pgmap v203: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:37.376 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: pgmap v204: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:37.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:37 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T01:03:37.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: pgmap v204: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:37 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T01:03:38.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:38 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T01:03:38.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:38 smithi187 ceph-mon[78584]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T01:03:38.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:38 smithi187 ceph-mon[78584]: from='osd.3 [v2:172.21.15.187:6800/2694308571,v1:172.21.15.187:6801/2694308571]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:03:38.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:38 smithi187 ceph-mon[78584]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:03:38.409 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:38 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[86007]: 2024-09-21T01:03:38.081+0000 7f1e46fc3640 -1 osd.3 61 log_to_monitors true 2024-09-21T01:03:38.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:38 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T01:03:38.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:38 smithi112 ceph-mon[109687]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T01:03:38.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:38 smithi112 ceph-mon[109687]: from='osd.3 [v2:172.21.15.187:6800/2694308571,v1:172.21.15.187:6801/2694308571]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:03:38.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:38 smithi112 ceph-mon[109687]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:03:39.409 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:03:39 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[86007]: 2024-09-21T01:03:39.099+0000 7f1e3ad3b640 -1 osd.3 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:03:39.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:39 smithi187 ceph-mon[78584]: pgmap v205: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:39.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:39 smithi187 ceph-mon[78584]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:03:39.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:39 smithi187 ceph-mon[78584]: from='osd.3 [v2:172.21.15.187:6800/2694308571,v1:172.21.15.187:6801/2694308571]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:03:39.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:39 smithi187 ceph-mon[78584]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T01:03:39.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:39 smithi187 ceph-mon[78584]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:03:39.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:39 smithi187 ceph-mon[78584]: from='osd.3 ' entity='osd.3' 2024-09-21T01:03:39.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:39 smithi112 ceph-mon[109687]: pgmap v205: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:39.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:39 smithi112 ceph-mon[109687]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:03:39.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:39 smithi112 ceph-mon[109687]: from='osd.3 [v2:172.21.15.187:6800/2694308571,v1:172.21.15.187:6801/2694308571]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:03:39.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:39 smithi112 ceph-mon[109687]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T01:03:39.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:39 smithi112 ceph-mon[109687]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:03:39.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:39 smithi112 ceph-mon[109687]: from='osd.3 ' entity='osd.3' 2024-09-21T01:03:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:40 smithi187 ceph-mon[78584]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:03:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:40 smithi187 ceph-mon[78584]: osd.3 [v2:172.21.15.187:6800/2694308571,v1:172.21.15.187:6801/2694308571] boot 2024-09-21T01:03:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:40 smithi187 ceph-mon[78584]: osdmap e65: 6 total, 6 up, 6 in 2024-09-21T01:03:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:40 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:03:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:40 smithi112 ceph-mon[109687]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:03:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:40 smithi112 ceph-mon[109687]: osd.3 [v2:172.21.15.187:6800/2694308571,v1:172.21.15.187:6801/2694308571] boot 2024-09-21T01:03:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:40 smithi112 ceph-mon[109687]: osdmap e65: 6 total, 6 up, 6 in 2024-09-21T01:03:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:40 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:03:41.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:41 smithi187 ceph-mon[78584]: pgmap v207: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:41.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:41 smithi187 ceph-mon[78584]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T01:03:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:41 smithi112 ceph-mon[109687]: pgmap v207: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T01:03:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:41 smithi112 ceph-mon[109687]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T01:03:42.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:42 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 59/279 objects degraded (21.147%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:42.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:42 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 59/279 objects degraded (21.147%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T01:03:43.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:43 smithi112 ceph-mon[109687]: pgmap v210: 65 pgs: 4 peering, 17 active+undersized, 17 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/279 objects degraded (21.147%) 2024-09-21T01:03:43.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:43 smithi187 ceph-mon[78584]: pgmap v210: 65 pgs: 4 peering, 17 active+undersized, 17 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/279 objects degraded (21.147%) 2024-09-21T01:03:44.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:44 smithi187 ceph-mon[78584]: pgmap v211: 65 pgs: 4 peering, 61 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:44 smithi112 ceph-mon[109687]: pgmap v211: 65 pgs: 4 peering, 61 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:45 smithi112 ceph-mon[109687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/279 objects degraded (21.147%), 17 pgs degraded) 2024-09-21T01:03:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:45 smithi187 ceph-mon[78584]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/279 objects degraded (21.147%), 17 pgs degraded) 2024-09-21T01:03:46.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:46 smithi187 ceph-mon[78584]: pgmap v212: 65 pgs: 4 peering, 61 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:46 smithi112 ceph-mon[109687]: pgmap v212: 65 pgs: 4 peering, 61 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:49.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:48 smithi112 ceph-mon[109687]: pgmap v213: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:49.129 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:48 smithi187 ceph-mon[78584]: pgmap v213: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:51.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:50 smithi112 ceph-mon[109687]: pgmap v214: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:51.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:50 smithi187 ceph-mon[78584]: pgmap v214: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:51.978 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:51 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T01:03:52.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:51 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T01:03:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:52 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T01:03:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:52 smithi112 ceph-mon[109687]: Upgrade: osd.4 is safe to restart 2024-09-21T01:03:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:52 smithi112 ceph-mon[109687]: pgmap v215: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:53.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:52 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T01:03:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:52 smithi187 ceph-mon[78584]: Upgrade: osd.4 is safe to restart 2024-09-21T01:03:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:52 smithi187 ceph-mon[78584]: pgmap v215: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:54.209 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:53 smithi187 ceph-mon[78584]: Upgrade: Updating osd.4 2024-09-21T01:03:54.209 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:53 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:54.209 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:53 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:03:54.209 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:53 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:54.209 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:53 smithi187 ceph-mon[78584]: Deploying daemon osd.4 on smithi187 2024-09-21T01:03:54.209 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:53 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:53 smithi112 ceph-mon[109687]: Upgrade: Updating osd.4 2024-09-21T01:03:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:53 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:53 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:03:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:53 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:03:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:53 smithi112 ceph-mon[109687]: Deploying daemon osd.4 on smithi187 2024-09-21T01:03:54.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:53 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:55.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:54 smithi187 ceph-mon[78584]: pgmap v216: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:55.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:54 smithi112 ceph-mon[109687]: pgmap v216: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:56.061 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:55 smithi187 systemd[1]: Stopping Ceph osd.4 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:03:56.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 -- 172.21.15.112:0/500512811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc106820 msgr2=0x7fe8dc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/500512811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc106820 0x7fe8dc106c00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009880 tx=0x7fe8d002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 -- 172.21.15.112:0/500512811 shutdown_connections 2024-09-21T01:03:56.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/500512811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8dc100820 0x7fe8dc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/500512811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc106820 0x7fe8dc106c00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 -- 172.21.15.112:0/500512811 >> 172.21.15.112:0/500512811 conn(0x7fe8dc0fc520 msgr2=0x7fe8dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:56.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 -- 172.21.15.112:0/500512811 shutdown_connections 2024-09-21T01:03:56.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.398+0000 7fe8e2b92640 1 -- 172.21.15.112:0/500512811 wait complete. 2024-09-21T01:03:56.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e2b92640 1 Processor -- start 2024-09-21T01:03:56.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e2b92640 1 -- start start 2024-09-21T01:03:56.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e2b92640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc100820 0x7fe8dc19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e2b92640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8dc106820 0x7fe8dc19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e2b92640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc10dcf0 con 0x7fe8dc100820 2024-09-21T01:03:56.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e2b92640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc10db70 con 0x7fe8dc106820 2024-09-21T01:03:56.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e092e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc100820 0x7fe8dc19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e092e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc100820 0x7fe8dc19f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60150/0 (socket says 172.21.15.112:60150) 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e092e640 1 -- 172.21.15.112:0/1136361420 learned_addr learned my addr 172.21.15.112:0/1136361420 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8dbfff640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8dc106820 0x7fe8dc19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e092e640 1 -- 172.21.15.112:0/1136361420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8dc106820 msgr2=0x7fe8dc19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e092e640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8dc106820 0x7fe8dc19fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8e092e640 1 -- 172.21.15.112:0/1136361420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc199a40 con 0x7fe8dc100820 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.399+0000 7fe8dbfff640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8dc106820 0x7fe8dc19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.400+0000 7fe8e092e640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc100820 0x7fe8dc19f880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0031460 tx=0x7fe8d0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.400+0000 7fe8d9ffb640 1 -- 172.21.15.112:0/1136361420 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8d003f070 con 0x7fe8dc100820 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.400+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc199cd0 con 0x7fe8dc100820 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.400+0000 7fe8d9ffb640 1 -- 172.21.15.112:0/1136361420 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8d00035f0 con 0x7fe8dc100820 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.400+0000 7fe8d9ffb640 1 -- 172.21.15.112:0/1136361420 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8d0035030 con 0x7fe8dc100820 2024-09-21T01:03:56.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.400+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc19a200 con 0x7fe8dc100820 2024-09-21T01:03:56.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.401+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc101f60 con 0x7fe8dc100820 2024-09-21T01:03:56.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.402+0000 7fe8d9ffb640 1 -- 172.21.15.112:0/1136361420 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe8d0042070 con 0x7fe8dc100820 2024-09-21T01:03:56.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.402+0000 7fe8d9ffb640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe8cc07af30 0x7fe8cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.402+0000 7fe8d9ffb640 1 -- 172.21.15.112:0/1136361420 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6156+0+0 (secure 0 0 0) 0x7fe8d00be9b0 con 0x7fe8dc100820 2024-09-21T01:03:56.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.402+0000 7fe8dbfff640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe8cc07af30 0x7fe8cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.403+0000 7fe8dbfff640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe8cc07af30 0x7fe8cc07d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0fe3e0 tx=0x7fe8c8005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:56.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.407+0000 7fe8d9ffb640 1 -- 172.21.15.112:0/1136361420 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8d0089fb0 con 0x7fe8dc100820 2024-09-21T01:03:56.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:56 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[47632]: 2024-09-21T01:03:56.060+0000 7f7bbc239640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:03:56.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:56 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[47632]: 2024-09-21T01:03:56.060+0000 7f7bbc239640 -1 osd.4 66 *** Got signal Terminated *** 2024-09-21T01:03:56.409 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:56 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[47632]: 2024-09-21T01:03:56.060+0000 7f7bbc239640 -1 osd.4 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:03:56.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.600+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe8dc19afe0 con 0x7fe8cc07af30 2024-09-21T01:03:56.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.601+0000 7fe8d9ffb640 1 -- 172.21.15.112:0/1136361420 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fe8dc19afe0 con 0x7fe8cc07af30 2024-09-21T01:03:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe8cc07af30 msgr2=0x7fe8cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe8cc07af30 0x7fe8cc07d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0fe3e0 tx=0x7fe8c8005f90 comp rx=0 tx=0).stop 2024-09-21T01:03:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc100820 msgr2=0x7fe8dc19f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc100820 0x7fe8dc19f880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0031460 tx=0x7fe8d0004530 comp rx=0 tx=0).stop 2024-09-21T01:03:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 shutdown_connections 2024-09-21T01:03:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe8cc07af30 0x7fe8cc07d3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8dc106820 0x7fe8dc19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 --2- 172.21.15.112:0/1136361420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8dc100820 0x7fe8dc19f880 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 >> 172.21.15.112:0/1136361420 conn(0x7fe8dc0fc520 msgr2=0x7fe8dc0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:56.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 shutdown_connections 2024-09-21T01:03:56.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.603+0000 7fe8e2b92640 1 -- 172.21.15.112:0/1136361420 wait complete. 2024-09-21T01:03:56.613 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:03:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 -- 172.21.15.112:0/2747894904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c103480 msgr2=0x7fbd1c10b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 --2- 172.21.15.112:0/2747894904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c103480 0x7fbd1c10b970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009880 tx=0x7fbd1002a530 comp rx=0 tx=0).stop 2024-09-21T01:03:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 -- 172.21.15.112:0/2747894904 shutdown_connections 2024-09-21T01:03:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 --2- 172.21.15.112:0/2747894904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c103480 0x7fbd1c10b970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 --2- 172.21.15.112:0/2747894904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c102b60 0x7fbd1c102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 -- 172.21.15.112:0/2747894904 >> 172.21.15.112:0/2747894904 conn(0x7fbd1c0fc520 msgr2=0x7fbd1c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:56.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 -- 172.21.15.112:0/2747894904 shutdown_connections 2024-09-21T01:03:56.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.686+0000 7fbd21e93640 1 -- 172.21.15.112:0/2747894904 wait complete. 2024-09-21T01:03:56.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd21e93640 1 Processor -- start 2024-09-21T01:03:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd21e93640 1 -- start start 2024-09-21T01:03:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd21e93640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c102b60 0x7fbd1c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd21e93640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c103480 0x7fbd1c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd21e93640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10edf0 con 0x7fbd1c102b60 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd21e93640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10ec70 con 0x7fbd1c103480 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd1b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c102b60 0x7fbd1c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd1b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c102b60 0x7fbd1c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60178/0 (socket says 172.21.15.112:60178) 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd1b7fe640 1 -- 172.21.15.112:0/1586897395 learned_addr learned my addr 172.21.15.112:0/1586897395 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.687+0000 7fbd1affd640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c103480 0x7fbd1c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd1b7fe640 1 -- 172.21.15.112:0/1586897395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c103480 msgr2=0x7fbd1c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd1b7fe640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c103480 0x7fbd1c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd1b7fe640 1 -- 172.21.15.112:0/1586897395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c1977c0 con 0x7fbd1c102b60 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd1affd640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c103480 0x7fbd1c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd1b7fe640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c102b60 0x7fbd1c19d640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00e970 tx=0x7fbd0c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd18ff9640 1 -- 172.21.15.112:0/1586897395 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd0c00cac0 con 0x7fbd1c102b60 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c197ab0 con 0x7fbd1c102b60 2024-09-21T01:03:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd18ff9640 1 -- 172.21.15.112:0/1586897395 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd0c00cc60 con 0x7fbd1c102b60 2024-09-21T01:03:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd18ff9640 1 -- 172.21.15.112:0/1586897395 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd0c018720 con 0x7fbd1c102b60 2024-09-21T01:03:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.688+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1c198010 con 0x7fbd1c102b60 2024-09-21T01:03:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.689+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c06ab60 con 0x7fbd1c102b60 2024-09-21T01:03:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.690+0000 7fbd18ff9640 1 -- 172.21.15.112:0/1586897395 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fbd0c010430 con 0x7fbd1c102b60 2024-09-21T01:03:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.690+0000 7fbd18ff9640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbd0407af30 0x7fbd0407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.690+0000 7fbd18ff9640 1 -- 172.21.15.112:0/1586897395 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6156+0+0 (secure 0 0 0) 0x7fbd0c09e6d0 con 0x7fbd1c102b60 2024-09-21T01:03:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.690+0000 7fbd1affd640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbd0407af30 0x7fbd0407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.691+0000 7fbd1affd640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbd0407af30 0x7fbd0407d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c198b10 tx=0x7fbd10004f30 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:56.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.695+0000 7fbd18ff9640 1 -- 172.21.15.112:0/1586897395 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd0c069cd0 con 0x7fbd1c102b60 2024-09-21T01:03:56.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.891+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbd1c1982c0 con 0x7fbd0407af30 2024-09-21T01:03:56.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.893+0000 7fbd18ff9640 1 -- 172.21.15.112:0/1586897395 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fbd1c1982c0 con 0x7fbd0407af30 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbd0407af30 msgr2=0x7fbd0407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbd0407af30 0x7fbd0407d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c198b10 tx=0x7fbd10004f30 comp rx=0 tx=0).stop 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c102b60 msgr2=0x7fbd1c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c102b60 0x7fbd1c19d640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00e970 tx=0x7fbd0c00ee30 comp rx=0 tx=0).stop 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 shutdown_connections 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fbd0407af30 0x7fbd0407d3f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c103480 0x7fbd1c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 --2- 172.21.15.112:0/1586897395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c102b60 0x7fbd1c19d640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 >> 172.21.15.112:0/1586897395 conn(0x7fbd1c0fc520 msgr2=0x7fbd1c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:56.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 shutdown_connections 2024-09-21T01:03:56.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.895+0000 7fbd21e93640 1 -- 172.21.15.112:0/1586897395 wait complete. 2024-09-21T01:03:56.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:56 smithi112 ceph-mon[109687]: pgmap v217: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:56.937 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:56 smithi112 ceph-mon[109687]: osd.4 marked itself down and dead 2024-09-21T01:03:56.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1510792296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c107930 msgr2=0x7fc79c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1510792296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c107930 0x7fc79c107d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc794009880 tx=0x7fc79402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1510792296 shutdown_connections 2024-09-21T01:03:56.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1510792296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc79c101930 0x7fc79c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1510792296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c107930 0x7fc79c107d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1510792296 >> 172.21.15.112:0/1510792296 conn(0x7fc79c0fd630 msgr2=0x7fc79c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:56.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1510792296 shutdown_connections 2024-09-21T01:03:56.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.983+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1510792296 wait complete. 2024-09-21T01:03:56.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a43d3640 1 Processor -- start 2024-09-21T01:03:56.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a43d3640 1 -- start start 2024-09-21T01:03:56.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a43d3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c101930 0x7fc79c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a43d3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc79c107930 0x7fc79c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a43d3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10ede0 con 0x7fc79c101930 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a43d3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10ec60 con 0x7fc79c107930 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a216f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c101930 0x7fc79c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a216f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c101930 0x7fc79c19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60194/0 (socket says 172.21.15.112:60194) 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a216f640 1 -- 172.21.15.112:0/1398082929 learned_addr learned my addr 172.21.15.112:0/1398082929 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a216f640 1 -- 172.21.15.112:0/1398082929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc79c107930 msgr2=0x7fc79c19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a196e640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc79c107930 0x7fc79c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a216f640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc79c107930 0x7fc79c19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a216f640 1 -- 172.21.15.112:0/1398082929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c1977d0 con 0x7fc79c101930 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.984+0000 7fc7a196e640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc79c107930 0x7fc79c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:03:56.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.985+0000 7fc7a216f640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c101930 0x7fc79c19d650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc794031460 tx=0x7fc7940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:56.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.985+0000 7fc79b7fe640 1 -- 172.21.15.112:0/1398082929 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc79403f070 con 0x7fc79c101930 2024-09-21T01:03:56.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.985+0000 7fc79b7fe640 1 -- 172.21.15.112:0/1398082929 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc794004cf0 con 0x7fc79c101930 2024-09-21T01:03:56.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.985+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c197a60 con 0x7fc79c101930 2024-09-21T01:03:56.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.985+0000 7fc79b7fe640 1 -- 172.21.15.112:0/1398082929 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc794035030 con 0x7fc79c101930 2024-09-21T01:03:56.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.985+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79c197f90 con 0x7fc79c101930 2024-09-21T01:03:56.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.986+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79c103070 con 0x7fc79c101930 2024-09-21T01:03:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.987+0000 7fc79b7fe640 1 -- 172.21.15.112:0/1398082929 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc794042070 con 0x7fc79c101930 2024-09-21T01:03:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.987+0000 7fc79b7fe640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc78407af30 0x7fc78407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.987+0000 7fc79b7fe640 1 -- 172.21.15.112:0/1398082929 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fc7940beac0 con 0x7fc79c101930 2024-09-21T01:03:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.987+0000 7fc7a196e640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc78407af30 0x7fc78407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:56.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.988+0000 7fc7a196e640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc78407af30 0x7fc78407d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc79c100d60 tx=0x7fc7900082f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:56.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:56.992+0000 7fc79b7fe640 1 -- 172.21.15.112:0/1398082929 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc79408a0c0 con 0x7fc79c101930 2024-09-21T01:03:57.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.183+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc79c198240 con 0x7fc78407af30 2024-09-21T01:03:57.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.193+0000 7fc79b7fe640 1 -- 172.21.15.112:0/1398082929 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc79c198240 con 0x7fc78407af30 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (4m) 57s ago 15m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (7m) 57s ago 15m 8850k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (6m) 24s ago 14m 8493k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (2m) 57s ago 15m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (2m) 24s ago 14m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (4m) 57s ago 15m 81.2M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (9m) 57s ago 9m 150M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (10m) 57s ago 9m 17.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:03:57.194 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (9m) 24s ago 9m 20.9M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (9m) 24s ago 9m 19.1M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (6m) 57s ago 16m 593M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (5m) 24s ago 14m 523M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (3m) 57s ago 16m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (2m) 24s ago 14m 104M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 57s ago 15m 11.1M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (5m) 24s ago 14m 11.1M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (2m) 57s ago 13m 149M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (99s) 57s ago 12m 153M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (62s) 57s ago 12m 79.3M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (27s) 24s ago 11m 79.3M 2240M 19.3.0-5120-g18432218 ddce307e1f32 ea28f02f247b 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (11m) 24s ago 11m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 29a1bc8a5789 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (10m) 24s ago 10m 188M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:03:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (4m) 57s ago 14m 56.0M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:03:57.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc78407af30 msgr2=0x7fc78407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc78407af30 0x7fc78407d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc79c100d60 tx=0x7fc7900082f0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c101930 msgr2=0x7fc79c19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c101930 0x7fc79c19d650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc794031460 tx=0x7fc7940048f0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 shutdown_connections 2024-09-21T01:03:57.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc78407af30 0x7fc78407d3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc79c107930 0x7fc79c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 --2- 172.21.15.112:0/1398082929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc79c101930 0x7fc79c19d650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.195+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 >> 172.21.15.112:0/1398082929 conn(0x7fc79c0fd630 msgr2=0x7fc79c0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:57.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.196+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 shutdown_connections 2024-09-21T01:03:57.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.196+0000 7fc7a43d3640 1 -- 172.21.15.112:0/1398082929 wait complete. 2024-09-21T01:03:57.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 -- 172.21.15.112:0/4171005492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0100820 msgr2=0x7f68d0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 --2- 172.21.15.112:0/4171005492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0100820 0x7f68d0100c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009880 tx=0x7f68c402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 -- 172.21.15.112:0/4171005492 shutdown_connections 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 --2- 172.21.15.112:0/4171005492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0100820 0x7f68d0100c80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 --2- 172.21.15.112:0/4171005492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68d0106820 0x7f68d0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 -- 172.21.15.112:0/4171005492 >> 172.21.15.112:0/4171005492 conn(0x7f68d00fc520 msgr2=0x7f68d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 -- 172.21.15.112:0/4171005492 shutdown_connections 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.275+0000 7f68d561c640 1 -- 172.21.15.112:0/4171005492 wait complete. 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.276+0000 7f68d561c640 1 Processor -- start 2024-09-21T01:03:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.276+0000 7f68d561c640 1 -- start start 2024-09-21T01:03:57.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.276+0000 7f68d561c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68d0100820 0x7f68d0196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.276+0000 7f68d561c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0106820 0x7f68d0196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.276+0000 7f68d561c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f68d010dd50 con 0x7f68d0106820 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.276+0000 7f68d561c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f68d010dbd0 con 0x7f68d0100820 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.276+0000 7f68ce7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0106820 0x7f68d0196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68ce7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0106820 0x7f68d0196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60212/0 (socket says 172.21.15.112:60212) 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68ce7fc640 1 -- 172.21.15.112:0/699721592 learned_addr learned my addr 172.21.15.112:0/699721592 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68ceffd640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68d0100820 0x7f68d0196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68ce7fc640 1 -- 172.21.15.112:0/699721592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68d0100820 msgr2=0x7f68d0196660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68ce7fc640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68d0100820 0x7f68d0196660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68ce7fc640 1 -- 172.21.15.112:0/699721592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d01970e0 con 0x7f68d0106820 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68ce7fc640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0106820 0x7f68d0196ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68c4031460 tx=0x7f68c40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68b7fff640 1 -- 172.21.15.112:0/699721592 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68c403f070 con 0x7f68d0106820 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d0197370 con 0x7f68d0106820 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68b7fff640 1 -- 172.21.15.112:0/699721592 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68c4004cf0 con 0x7f68d0106820 2024-09-21T01:03:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68b7fff640 1 -- 172.21.15.112:0/699721592 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68c4035030 con 0x7f68d0106820 2024-09-21T01:03:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.277+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d01a3ea0 con 0x7f68d0106820 2024-09-21T01:03:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.278+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d0101f60 con 0x7f68d0106820 2024-09-21T01:03:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.279+0000 7f68b7fff640 1 -- 172.21.15.112:0/699721592 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f68c4042070 con 0x7f68d0106820 2024-09-21T01:03:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.279+0000 7f68b7fff640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f68b807af30 0x7f68b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.280+0000 7f68b7fff640 1 -- 172.21.15.112:0/699721592 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f68c40beb00 con 0x7f68d0106820 2024-09-21T01:03:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.280+0000 7f68ceffd640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f68b807af30 0x7f68b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.280+0000 7f68ceffd640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f68b807af30 0x7f68b807d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009f20 tx=0x7f68c00094f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:57.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.284+0000 7f68b7fff640 1 -- 172.21.15.112:0/699721592 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68c408a100 con 0x7f68d0106820 2024-09-21T01:03:57.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:56 smithi187 ceph-mon[78584]: pgmap v217: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:57.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:56 smithi187 ceph-mon[78584]: osd.4 marked itself down and dead 2024-09-21T01:03:57.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.535+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f68d006a8f0 con 0x7f68d0106820 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.535+0000 7f68b7fff640 1 -- 172.21.15.112:0/699721592 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f68c408efb0 con 0x7f68d0106820 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:57.536 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 4 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5, 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 8 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:03:57.537 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f68b807af30 msgr2=0x7f68b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f68b807af30 0x7f68b807d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009f20 tx=0x7f68c00094f0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0106820 msgr2=0x7f68d0196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0106820 0x7f68d0196ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68c4031460 tx=0x7f68c40048f0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 shutdown_connections 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f68b807af30 0x7f68b807d3f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68d0106820 0x7f68d0196ba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 --2- 172.21.15.112:0/699721592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68d0100820 0x7f68d0196660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 >> 172.21.15.112:0/699721592 conn(0x7f68d00fc520 msgr2=0x7f68d00fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 shutdown_connections 2024-09-21T01:03:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.538+0000 7f68d561c640 1 -- 172.21.15.112:0/699721592 wait complete. 2024-09-21T01:03:57.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 -- 172.21.15.112:0/2584105533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c103420 msgr2=0x7fcf4c10b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2584105533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c103420 0x7fcf4c10b910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf400098b0 tx=0x7fcf4002a560 comp rx=0 tx=0).stop 2024-09-21T01:03:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 -- 172.21.15.112:0/2584105533 shutdown_connections 2024-09-21T01:03:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2584105533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c103420 0x7fcf4c10b910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2584105533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4c102b00 0x7fcf4c102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 -- 172.21.15.112:0/2584105533 >> 172.21.15.112:0/2584105533 conn(0x7fcf4c0fc4c0 msgr2=0x7fcf4c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 -- 172.21.15.112:0/2584105533 shutdown_connections 2024-09-21T01:03:57.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 -- 172.21.15.112:0/2584105533 wait complete. 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 Processor -- start 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.619+0000 7fcf5406d640 1 -- start start 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf5406d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c102b00 0x7fcf4c100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf5406d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4c103420 0x7fcf4c100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf5406d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c10edd0 con 0x7fcf4c102b00 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf5406d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c10ec50 con 0x7fcf4c103420 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51e09640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c102b00 0x7fcf4c100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51e09640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c102b00 0x7fcf4c100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60222/0 (socket says 172.21.15.112:60222) 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51e09640 1 -- 172.21.15.112:0/2871663300 learned_addr learned my addr 172.21.15.112:0/2871663300 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51608640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4c103420 0x7fcf4c100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51e09640 1 -- 172.21.15.112:0/2871663300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4c103420 msgr2=0x7fcf4c100ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51e09640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4c103420 0x7fcf4c100ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51e09640 1 -- 172.21.15.112:0/2871663300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c1011e0 con 0x7fcf4c102b00 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf51e09640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c102b00 0x7fcf4c100760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00ea00 tx=0x7fcf3c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf4affd640 1 -- 172.21.15.112:0/2871663300 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf3c00cb80 con 0x7fcf4c102b00 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf4affd640 1 -- 172.21.15.112:0/2871663300 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf3c00cd20 con 0x7fcf4c102b00 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c1014d0 con 0x7fcf4c102b00 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.620+0000 7fcf4affd640 1 -- 172.21.15.112:0/2871663300 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf3c011470 con 0x7fcf4c102b00 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.621+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4c1a3e80 con 0x7fcf4c102b00 2024-09-21T01:03:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.621+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4c06a3b0 con 0x7fcf4c102b00 2024-09-21T01:03:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.622+0000 7fcf4affd640 1 -- 172.21.15.112:0/2871663300 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcf3c005020 con 0x7fcf4c102b00 2024-09-21T01:03:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.623+0000 7fcf4affd640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcf3407af80 0x7fcf3407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.623+0000 7fcf4affd640 1 -- 172.21.15.112:0/2871663300 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fcf3c09e3d0 con 0x7fcf4c102b00 2024-09-21T01:03:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.623+0000 7fcf51608640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcf3407af80 0x7fcf3407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.623+0000 7fcf51608640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcf3407af80 0x7fcf3407d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf40031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.627+0000 7fcf4affd640 1 -- 172.21.15.112:0/2871663300 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf3c016030 con 0x7fcf4c102b00 2024-09-21T01:03:57.762 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:57 smithi187 podman[90340]: 2024-09-21 01:03:57.459919686 +0000 UTC m=+1.497628389 container died 29a1bc8a57895e997615e33138d174fab88924a70663b5d5a2630a04839ffb8c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:03:57.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.840+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcf4c105f90 con 0x7fcf4c102b00 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.841+0000 7fcf4affd640 1 -- 172.21.15.112:0/2871663300 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7fcf3c0699b0 con 0x7fcf4c102b00 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:03:57.842 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:03:57.844 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:57.845 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:57.845 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:57.845 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:03:57.845 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:03:57.845 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:57.845 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:57.845 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcf3407af80 msgr2=0x7fcf3407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcf3407af80 0x7fcf3407d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf40031400 comp rx=0 tx=0).stop 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c102b00 msgr2=0x7fcf4c100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c102b00 0x7fcf4c100760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00ea00 tx=0x7fcf3c00eec0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 shutdown_connections 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcf3407af80 0x7fcf3407d440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4c103420 0x7fcf4c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 --2- 172.21.15.112:0/2871663300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf4c102b00 0x7fcf4c100760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 >> 172.21.15.112:0/2871663300 conn(0x7fcf4c0fc4c0 msgr2=0x7fcf4c103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 shutdown_connections 2024-09-21T01:03:57.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.843+0000 7fcf5406d640 1 -- 172.21.15.112:0/2871663300 wait complete. 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 -- 172.21.15.112:0/677926795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 msgr2=0x7fce9c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/677926795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c100c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce84009880 tx=0x7fce8402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 -- 172.21.15.112:0/677926795 shutdown_connections 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/677926795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c100c80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/677926795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce9c106820 0x7fce9c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 -- 172.21.15.112:0/677926795 >> 172.21.15.112:0/677926795 conn(0x7fce9c0fc520 msgr2=0x7fce9c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 -- 172.21.15.112:0/677926795 shutdown_connections 2024-09-21T01:03:57.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.927+0000 7fcea0e0b640 1 -- 172.21.15.112:0/677926795 wait complete. 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fcea0e0b640 1 Processor -- start 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fcea0e0b640 1 -- start start 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fcea0e0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fcea0e0b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce9c106820 0x7fce9c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fcea0e0b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c10dcd0 con 0x7fce9c100820 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fcea0e0b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c10db50 con 0x7fce9c106820 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fce9a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fce9a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c19c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60238/0 (socket says 172.21.15.112:60238) 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fce9a59c640 1 -- 172.21.15.112:0/1775946017 learned_addr learned my addr 172.21.15.112:0/1775946017 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.928+0000 7fce93fff640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce9c106820 0x7fce9c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fce9a59c640 1 -- 172.21.15.112:0/1775946017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce9c106820 msgr2=0x7fce9c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:57.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fce9a59c640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce9c106820 0x7fce9c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:57.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fce9a59c640 1 -- 172.21.15.112:0/1775946017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c1966c0 con 0x7fce9c100820 2024-09-21T01:03:57.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fce9a59c640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c19c5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c810 tx=0x7fce8c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:57.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fce937fe640 1 -- 172.21.15.112:0/1775946017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce8c004020 con 0x7fce9c100820 2024-09-21T01:03:57.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c1969b0 con 0x7fce9c100820 2024-09-21T01:03:57.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fce937fe640 1 -- 172.21.15.112:0/1775946017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce8c0041c0 con 0x7fce9c100820 2024-09-21T01:03:57.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fce937fe640 1 -- 172.21.15.112:0/1775946017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce8c0047a0 con 0x7fce9c100820 2024-09-21T01:03:57.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.929+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c196f10 con 0x7fce9c100820 2024-09-21T01:03:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.930+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c101f60 con 0x7fce9c100820 2024-09-21T01:03:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.931+0000 7fce937fe640 1 -- 172.21.15.112:0/1775946017 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fce8c0049c0 con 0x7fce9c100820 2024-09-21T01:03:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.931+0000 7fce937fe640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fce8807af30 0x7fce8807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.931+0000 7fce93fff640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fce8807af30 0x7fce8807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.931+0000 7fce937fe640 1 -- 172.21.15.112:0/1775946017 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fce8c09dee0 con 0x7fce9c100820 2024-09-21T01:03:57.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.932+0000 7fce93fff640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fce8807af30 0x7fce8807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce9c197f10 tx=0x7fce84031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:57.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:57.936+0000 7fce937fe640 1 -- 172.21.15.112:0/1775946017 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce8c014030 con 0x7fce9c100820 2024-09-21T01:03:58.070 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:57 smithi187 podman[90340]: 2024-09-21 01:03:57.860770552 +0000 UTC m=+1.898479261 container cleanup 29a1bc8a57895e997615e33138d174fab88924a70663b5d5a2630a04839ffb8c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T01:03:58.071 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:57 smithi187 bash[90340]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4 2024-09-21T01:03:58.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:57 smithi187 ceph-mon[78584]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:58.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:57 smithi187 ceph-mon[78584]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:58.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:57 smithi187 ceph-mon[78584]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:03:58.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:57 smithi187 ceph-mon[78584]: osdmap e67: 6 total, 5 up, 6 in 2024-09-21T01:03:58.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:57 smithi187 ceph-mon[78584]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:58.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:57 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/699721592' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:58.071 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:57 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2871663300' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:03:58.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.146+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce9c197280 con 0x7fce8807af30 2024-09-21T01:03:58.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:57 smithi112 ceph-mon[109687]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:58.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:57 smithi112 ceph-mon[109687]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:58.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:57 smithi112 ceph-mon[109687]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:03:58.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:57 smithi112 ceph-mon[109687]: osdmap e67: 6 total, 5 up, 6 in 2024-09-21T01:03:58.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:57 smithi112 ceph-mon[109687]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:58.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:57 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/699721592' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:03:58.147 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:57 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2871663300' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.147+0000 7fce937fe640 1 -- 172.21.15.112:0/1775946017 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fce9c197280 con 0x7fce8807af30 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:03:58.148 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:03:58.149 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:03:58.149 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:03:58.149 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "10/23 daemons upgraded", 2024-09-21T01:03:58.149 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T01:03:58.149 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:03:58.149 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:03:58.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fce8807af30 msgr2=0x7fce8807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fce8807af30 0x7fce8807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce9c197f10 tx=0x7fce84031400 comp rx=0 tx=0).stop 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 msgr2=0x7fce9c19c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c19c5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c810 tx=0x7fce8c00ccd0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 shutdown_connections 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fce8807af30 0x7fce8807d3f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce9c106820 0x7fce9c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 --2- 172.21.15.112:0/1775946017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce9c100820 0x7fce9c19c5f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 >> 172.21.15.112:0/1775946017 conn(0x7fce9c0fc520 msgr2=0x7fce9c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 shutdown_connections 2024-09-21T01:03:58.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.151+0000 7fcea0e0b640 1 -- 172.21.15.112:0/1775946017 wait complete. 2024-09-21T01:03:58.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 -- 172.21.15.112:0/4077636152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80101930 msgr2=0x7f2d80101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 --2- 172.21.15.112:0/4077636152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80101930 0x7f2d80101d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009880 tx=0x7f2d7402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 -- 172.21.15.112:0/4077636152 shutdown_connections 2024-09-21T01:03:58.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 --2- 172.21.15.112:0/4077636152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80101930 0x7f2d80101d90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 --2- 172.21.15.112:0/4077636152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d80107930 0x7f2d80107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 -- 172.21.15.112:0/4077636152 >> 172.21.15.112:0/4077636152 conn(0x7f2d800fd630 msgr2=0x7f2d800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 -- 172.21.15.112:0/4077636152 shutdown_connections 2024-09-21T01:03:58.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.232+0000 7f2d867d5640 1 -- 172.21.15.112:0/4077636152 wait complete. 2024-09-21T01:03:58.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d867d5640 1 Processor -- start 2024-09-21T01:03:58.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d867d5640 1 -- start start 2024-09-21T01:03:58.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d867d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d80101930 0x7f2d800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d867d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80107930 0x7f2d80074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d867d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8010ede0 con 0x7f2d80107930 2024-09-21T01:03:58.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d867d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8010ec60 con 0x7f2d80101930 2024-09-21T01:03:58.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d7f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80107930 0x7f2d80074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d7f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80107930 0x7f2d80074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60256/0 (socket says 172.21.15.112:60256) 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d7f7fe640 1 -- 172.21.15.112:0/2393192156 learned_addr learned my addr 172.21.15.112:0/2393192156 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d7ffff640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d80101930 0x7f2d800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d7f7fe640 1 -- 172.21.15.112:0/2393192156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d80101930 msgr2=0x7f2d800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d7f7fe640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d80101930 0x7f2d800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.233+0000 7f2d7f7fe640 1 -- 172.21.15.112:0/2393192156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d80074f70 con 0x7f2d80107930 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.234+0000 7f2d7f7fe640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80107930 0x7f2d80074a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d74031460 tx=0x7f2d740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.234+0000 7f2d7d7fa640 1 -- 172.21.15.112:0/2393192156 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d7403f070 con 0x7f2d80107930 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.234+0000 7f2d7d7fa640 1 -- 172.21.15.112:0/2393192156 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d740035f0 con 0x7f2d80107930 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.234+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d80075200 con 0x7f2d80107930 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.234+0000 7f2d7d7fa640 1 -- 172.21.15.112:0/2393192156 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d74035030 con 0x7f2d80107930 2024-09-21T01:03:58.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.234+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d801a3e10 con 0x7f2d80107930 2024-09-21T01:03:58.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.235+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d80103070 con 0x7f2d80107930 2024-09-21T01:03:58.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.236+0000 7f2d7d7fa640 1 -- 172.21.15.112:0/2393192156 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2d74042070 con 0x7f2d80107930 2024-09-21T01:03:58.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.236+0000 7f2d7d7fa640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2d6807af30 0x7f2d6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:58.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.236+0000 7f2d7d7fa640 1 -- 172.21.15.112:0/2393192156 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7f2d740be970 con 0x7f2d80107930 2024-09-21T01:03:58.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.236+0000 7f2d7ffff640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2d6807af30 0x7f2d6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:58.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.237+0000 7f2d7ffff640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2d6807af30 0x7f2d6807d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000bbe0 tx=0x7f2d7000b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:58.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.241+0000 7f2d7d7fa640 1 -- 172.21.15.112:0/2393192156 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d740c0e20 con 0x7f2d80107930 2024-09-21T01:03:58.409 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:58 smithi187 podman[90356]: 2024-09-21 01:03:58.070503667 +0000 UTC m=+0.610892463 container remove 29a1bc8a57895e997615e33138d174fab88924a70663b5d5a2630a04839ffb8c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:03:58.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.501+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2d80075a20 con 0x7f2d80107930 2024-09-21T01:03:58.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.502+0000 7f2d7d7fa640 1 -- 172.21.15.112:0/2393192156 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+290 (secure 0 0 0) 0x7f2d74089f70 con 0x7f2d80107930 2024-09-21T01:03:58.503 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-09-21T01:03:58.503 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:03:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:03:58.503 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T01:03:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: osd.4 (root=default,host=smithi187) is down 2024-09-21T01:03:58.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2d6807af30 msgr2=0x7f2d6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2d6807af30 0x7f2d6807d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000bbe0 tx=0x7f2d7000b390 comp rx=0 tx=0).stop 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80107930 msgr2=0x7f2d80074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80107930 0x7f2d80074a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d74031460 tx=0x7f2d740045e0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 shutdown_connections 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2d6807af30 0x7f2d6807d3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d80107930 0x7f2d80074a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 --2- 172.21.15.112:0/2393192156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d80101930 0x7f2d800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 >> 172.21.15.112:0/2393192156 conn(0x7f2d800fd630 msgr2=0x7f2d800fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 shutdown_connections 2024-09-21T01:03:58.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:03:58.504+0000 7f2d867d5640 1 -- 172.21.15.112:0/2393192156 wait complete. 2024-09-21T01:03:58.782 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:58 smithi187 podman[90444]: 2024-09-21 01:03:58.374299262 +0000 UTC m=+0.015839369 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:03:58.783 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:58 smithi187 podman[90444]: 2024-09-21 01:03:58.49658214 +0000 UTC m=+0.138122235 container create 07fe29089f6332255aea45aec583e809e5f8e4ea44d6f8770b5397067132806e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T01:03:58.783 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:58 smithi187 podman[90444]: 2024-09-21 01:03:58.707926211 +0000 UTC m=+0.349466307 container init 07fe29089f6332255aea45aec583e809e5f8e4ea44d6f8770b5397067132806e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T01:03:58.783 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:58 smithi187 podman[90444]: 2024-09-21 01:03:58.711270134 +0000 UTC m=+0.352810230 container start 07fe29089f6332255aea45aec583e809e5f8e4ea44d6f8770b5397067132806e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T01:03:58.783 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:58 smithi187 podman[90444]: 2024-09-21 01:03:58.782604246 +0000 UTC m=+0.424144351 container attach 07fe29089f6332255aea45aec583e809e5f8e4ea44d6f8770b5397067132806e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:03:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:58 smithi187 ceph-mon[78584]: pgmap v219: 65 pgs: 6 stale+active+clean, 59 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:58 smithi187 ceph-mon[78584]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T01:03:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:58 smithi187 ceph-mon[78584]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:03:58 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2393192156' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:03:59.159 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:58 smithi187 podman[90444]: 2024-09-21 01:03:58.905261527 +0000 UTC m=+0.546801623 container died 07fe29089f6332255aea45aec583e809e5f8e4ea44d6f8770b5397067132806e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T01:03:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:58 smithi112 ceph-mon[109687]: pgmap v219: 65 pgs: 6 stale+active+clean, 59 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:03:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:58 smithi112 ceph-mon[109687]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T01:03:59.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:58 smithi112 ceph-mon[109687]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:03:59.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:03:59.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:03:59.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:03:58 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2393192156' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:03:59.908 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:59 smithi187 podman[90467]: 2024-09-21 01:03:59.603108905 +0000 UTC m=+0.692250683 container remove 07fe29089f6332255aea45aec583e809e5f8e4ea44d6f8770b5397067132806e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T01:03:59.909 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:59 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T01:03:59.909 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:59 smithi187 systemd[1]: Stopped Ceph osd.4 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:03:59.909 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:59 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.4.service: Consumed 50.813s CPU time. 2024-09-21T01:04:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:00 smithi112 ceph-mon[109687]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T01:04:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:00 smithi112 ceph-mon[109687]: Health check failed: Degraded data redundancy: 29/279 objects degraded (10.394%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:00.331 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:00 smithi187 ceph-mon[78584]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T01:04:00.331 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:00 smithi187 ceph-mon[78584]: Health check failed: Degraded data redundancy: 29/279 objects degraded (10.394%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:00.331 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:03:59 smithi187 systemd[1]: Starting Ceph osd.4 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:04:00.331 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 podman[90568]: 2024-09-21 01:04:00.107335985 +0000 UTC m=+0.015895886 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:04:00.331 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 podman[90568]: 2024-09-21 01:04:00.221590892 +0000 UTC m=+0.130150787 container create e195cfed0272bc133d892d0e7c3884a9e7424154ebe73d080a86dc8bd49115b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:04:00.592 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 podman[90568]: 2024-09-21 01:04:00.433273353 +0000 UTC m=+0.341833254 container init e195cfed0272bc133d892d0e7c3884a9e7424154ebe73d080a86dc8bd49115b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T01:04:00.592 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 podman[90568]: 2024-09-21 01:04:00.436794779 +0000 UTC m=+0.345354673 container start e195cfed0272bc133d892d0e7c3884a9e7424154ebe73d080a86dc8bd49115b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:04:00.592 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 podman[90568]: 2024-09-21 01:04:00.52466567 +0000 UTC m=+0.433225579 container attach e195cfed0272bc133d892d0e7c3884a9e7424154ebe73d080a86dc8bd49115b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:04:00.592 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:00.592 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 bash[90568]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:00.592 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:00.592 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:00 smithi187 bash[90568]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:01.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:01 smithi112 ceph-mon[109687]: pgmap v221: 65 pgs: 9 active+undersized, 8 peering, 3 stale+active+clean, 7 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/279 objects degraded (10.394%) 2024-09-21T01:04:01.403 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-mon[78584]: pgmap v221: 65 pgs: 9 active+undersized, 8 peering, 3 stale+active+clean, 7 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/279 objects degraded (10.394%) 2024-09-21T01:04:01.658 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T01:04:01.659 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 bash[90568]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T01:04:01.659 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T01:04:01.659 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 bash[90568]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-21T01:04:02.086 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T01:04:02.086 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 bash[90568]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-21T01:04:02.086 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T01:04:02.086 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 bash[90568]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T01:04:02.087 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T01:04:02.087 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 bash[90568]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T01:04:02.087 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T01:04:02.087 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 bash[90568]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T01:04:02.087 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate[90584]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-21T01:04:02.087 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 bash[90568]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-21T01:04:02.087 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:01 smithi187 podman[90568]: 2024-09-21 01:04:01.724421303 +0000 UTC m=+1.632981204 container died e195cfed0272bc133d892d0e7c3884a9e7424154ebe73d080a86dc8bd49115b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:04:02.658 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 podman[90715]: 2024-09-21 01:04:02.39546579 +0000 UTC m=+0.663939787 container remove e195cfed0272bc133d892d0e7c3884a9e7424154ebe73d080a86dc8bd49115b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T01:04:02.659 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 podman[90775]: 2024-09-21 01:04:02.506458331 +0000 UTC m=+0.015885486 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:04:02.659 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 podman[90775]: 2024-09-21 01:04:02.612881958 +0000 UTC m=+0.122309100 container create 21ee55f89a04e97dad3405a55a581117b9a4027b5682d2e76b14630809b4b25b (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T01:04:03.009 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 podman[90775]: 2024-09-21 01:04:02.840599512 +0000 UTC m=+0.350026667 container init 21ee55f89a04e97dad3405a55a581117b9a4027b5682d2e76b14630809b4b25b (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T01:04:03.009 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 podman[90775]: 2024-09-21 01:04:02.844006446 +0000 UTC m=+0.353433591 container start 21ee55f89a04e97dad3405a55a581117b9a4027b5682d2e76b14630809b4b25b (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:04:03.009 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 ceph-osd[90794]: -- 172.21.15.187:0/1802162866 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e9905c1e0 con 0x559e982e5180 2024-09-21T01:04:03.009 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 bash[90775]: 21ee55f89a04e97dad3405a55a581117b9a4027b5682d2e76b14630809b4b25b 2024-09-21T01:04:03.009 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:02 smithi187 systemd[1]: Started Ceph osd.4 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:04:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:03 smithi112 ceph-mon[109687]: pgmap v222: 65 pgs: 13 active+undersized, 8 peering, 1 stale+active+clean, 11 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/279 objects degraded (14.337%) 2024-09-21T01:04:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:03 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:03 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:03 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:03.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:03 smithi187 ceph-mon[78584]: pgmap v222: 65 pgs: 13 active+undersized, 8 peering, 1 stale+active+clean, 11 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/279 objects degraded (14.337%) 2024-09-21T01:04:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:03 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:03 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:03 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:04.342 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:04 smithi187 ceph-mon[78584]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T01:04:04.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:04 smithi112 ceph-mon[109687]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T01:04:05.062 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:04 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:04:04.734+0000 7fa98a6a8640 -1 Falling back to public interface 2024-09-21T01:04:05.325 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:05 smithi187 ceph-mon[78584]: pgmap v223: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:05 smithi112 ceph-mon[109687]: pgmap v223: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:07.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:06 smithi187 ceph-mon[78584]: pgmap v224: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:07.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:07.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:07.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:07.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:06 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:06 smithi112 ceph-mon[109687]: pgmap v224: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:06 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:08 smithi112 ceph-mon[109687]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:08 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 47/279 objects degraded (16.846%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:09.309 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:08 smithi187 ceph-mon[78584]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:09.309 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:08 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 47/279 objects degraded (16.846%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:11.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T01:04:11.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:10 smithi112 ceph-mon[109687]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T01:04:11.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T01:04:11.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:10 smithi187 ceph-mon[78584]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T01:04:11.658 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:11 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:04:11.406+0000 7fa98a6a8640 -1 osd.4 66 log_to_monitors true 2024-09-21T01:04:12.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:11 smithi112 ceph-mon[109687]: from='osd.4 [v2:172.21.15.187:6808/2649625200,v1:172.21.15.187:6809/2649625200]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:04:12.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:11 smithi112 ceph-mon[109687]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:04:12.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:11 smithi187 ceph-mon[78584]: from='osd.4 [v2:172.21.15.187:6808/2649625200,v1:172.21.15.187:6809/2649625200]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:04:12.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:11 smithi187 ceph-mon[78584]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:04:12.908 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:04:12 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:04:12.630+0000 7fa97e420640 -1 osd.4 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:04:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:12 smithi187 ceph-mon[78584]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:12 smithi187 ceph-mon[78584]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:04:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:12 smithi187 ceph-mon[78584]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T01:04:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:12 smithi187 ceph-mon[78584]: from='osd.4 [v2:172.21.15.187:6808/2649625200,v1:172.21.15.187:6809/2649625200]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:12 smithi187 ceph-mon[78584]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:12.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:12 smithi187 ceph-mon[78584]: from='osd.4 ' entity='osd.4' 2024-09-21T01:04:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:12 smithi112 ceph-mon[109687]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:12 smithi112 ceph-mon[109687]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:04:13.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:12 smithi112 ceph-mon[109687]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T01:04:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:12 smithi112 ceph-mon[109687]: from='osd.4 [v2:172.21.15.187:6808/2649625200,v1:172.21.15.187:6809/2649625200]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:12 smithi112 ceph-mon[109687]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:13.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:12 smithi112 ceph-mon[109687]: from='osd.4 ' entity='osd.4' 2024-09-21T01:04:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:14 smithi187 ceph-mon[78584]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:04:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:14 smithi187 ceph-mon[78584]: osd.4 [v2:172.21.15.187:6808/2649625200,v1:172.21.15.187:6809/2649625200] boot 2024-09-21T01:04:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:14 smithi187 ceph-mon[78584]: osdmap e70: 6 total, 6 up, 6 in 2024-09-21T01:04:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:04:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:14 smithi187 ceph-mon[78584]: pgmap v230: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:14 smithi112 ceph-mon[109687]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:04:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:14 smithi112 ceph-mon[109687]: osd.4 [v2:172.21.15.187:6808/2649625200,v1:172.21.15.187:6809/2649625200] boot 2024-09-21T01:04:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:14 smithi112 ceph-mon[109687]: osdmap e70: 6 total, 6 up, 6 in 2024-09-21T01:04:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:04:14.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:14 smithi112 ceph-mon[109687]: pgmap v230: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:15.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:15 smithi187 ceph-mon[78584]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T01:04:16.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:15 smithi112 ceph-mon[109687]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T01:04:16.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:16 smithi187 ceph-mon[78584]: pgmap v232: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:17.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:16 smithi112 ceph-mon[109687]: pgmap v232: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T01:04:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:17 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 34/279 objects degraded (12.186%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:18.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:17 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 34/279 objects degraded (12.186%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:18 smithi112 ceph-mon[109687]: pgmap v233: 65 pgs: 11 active+undersized, 10 active+undersized+degraded, 44 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/279 objects degraded (12.186%) 2024-09-21T01:04:19.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:18 smithi187 ceph-mon[78584]: pgmap v233: 65 pgs: 11 active+undersized, 10 active+undersized+degraded, 44 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/279 objects degraded (12.186%) 2024-09-21T01:04:19.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:19 smithi187 ceph-mon[78584]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/279 objects degraded (12.186%), 10 pgs degraded) 2024-09-21T01:04:20.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:19 smithi112 ceph-mon[109687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/279 objects degraded (12.186%), 10 pgs degraded) 2024-09-21T01:04:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:20 smithi112 ceph-mon[109687]: pgmap v234: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:21.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:20 smithi187 ceph-mon[78584]: pgmap v234: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:23.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:22 smithi187 ceph-mon[78584]: pgmap v235: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:22 smithi112 ceph-mon[109687]: pgmap v235: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:24.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:24 smithi187 ceph-mon[78584]: pgmap v236: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:25.063 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:24 smithi112 ceph-mon[109687]: pgmap v236: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:26.032 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:25 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T01:04:26.032 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:25 smithi187 ceph-mon[78584]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T01:04:26.032 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:25 smithi187 ceph-mon[78584]: Upgrade: osd.5 is safe to restart 2024-09-21T01:04:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:25 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T01:04:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:25 smithi112 ceph-mon[109687]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T01:04:26.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:25 smithi112 ceph-mon[109687]: Upgrade: osd.5 is safe to restart 2024-09-21T01:04:27.322 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:27 smithi187 ceph-mon[78584]: pgmap v237: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:27.322 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:27 smithi187 ceph-mon[78584]: Upgrade: Updating osd.5 2024-09-21T01:04:27.323 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:27 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:27.323 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:27 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:04:27.323 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:27 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:27.323 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:27 smithi187 ceph-mon[78584]: Deploying daemon osd.5 on smithi187 2024-09-21T01:04:27.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:27 smithi112 ceph-mon[109687]: pgmap v237: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:27.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:27 smithi112 ceph-mon[109687]: Upgrade: Updating osd.5 2024-09-21T01:04:27.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:27 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:27.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:27 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:04:27.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:27 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:27.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:27 smithi112 ceph-mon[109687]: Deploying daemon osd.5 on smithi187 2024-09-21T01:04:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 -- 172.21.15.112:0/1181415652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 msgr2=0x7f6eb410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/1181415652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb410b8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009c20 tx=0x7f6ea402aa00 comp rx=0 tx=0).stop 2024-09-21T01:04:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 -- 172.21.15.112:0/1181415652 shutdown_connections 2024-09-21T01:04:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/1181415652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb410b8b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/1181415652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eb4102aa0 0x7f6eb4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 -- 172.21.15.112:0/1181415652 >> 172.21.15.112:0/1181415652 conn(0x7f6eb40fc4c0 msgr2=0x7f6eb40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 -- 172.21.15.112:0/1181415652 shutdown_connections 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.598+0000 7f6ebad7b640 1 -- 172.21.15.112:0/1181415652 wait complete. 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6ebad7b640 1 Processor -- start 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6ebad7b640 1 -- start start 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6ebad7b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eb4102aa0 0x7f6eb419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6ebad7b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6ebad7b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb410edd0 con 0x7f6eb41033c0 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6ebad7b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb410ec50 con 0x7f6eb4102aa0 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6eb3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6eb3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55524/0 (socket says 172.21.15.112:55524) 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6eb3fff640 1 -- 172.21.15.112:0/89411385 learned_addr learned my addr 172.21.15.112:0/89411385 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.599+0000 7f6eb8b17640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eb4102aa0 0x7f6eb419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb3fff640 1 -- 172.21.15.112:0/89411385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eb4102aa0 msgr2=0x7f6eb419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb3fff640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eb4102aa0 0x7f6eb419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb3fff640 1 -- 172.21.15.112:0/89411385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb4197860 con 0x7f6eb41033c0 2024-09-21T01:04:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb8b17640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eb4102aa0 0x7f6eb419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb3fff640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb419dbe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ea402af20 tx=0x7f6ea402ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb1ffb640 1 -- 172.21.15.112:0/89411385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ea4047070 con 0x7f6eb41033c0 2024-09-21T01:04:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb1ffb640 1 -- 172.21.15.112:0/89411385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ea402eeb0 con 0x7f6eb41033c0 2024-09-21T01:04:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6eb1ffb640 1 -- 172.21.15.112:0/89411385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ea4033050 con 0x7f6eb41033c0 2024-09-21T01:04:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb4197af0 con 0x7f6eb41033c0 2024-09-21T01:04:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.600+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb4198020 con 0x7f6eb41033c0 2024-09-21T01:04:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.601+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb406a410 con 0x7f6eb41033c0 2024-09-21T01:04:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.602+0000 7f6eb1ffb640 1 -- 172.21.15.112:0/89411385 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f6ea404a070 con 0x7f6eb41033c0 2024-09-21T01:04:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.603+0000 7f6eb1ffb640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6ea007af40 0x7f6ea007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.603+0000 7f6eb1ffb640 1 -- 172.21.15.112:0/89411385 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6156+0+0 (secure 0 0 0) 0x7f6ea403e030 con 0x7f6eb41033c0 2024-09-21T01:04:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.603+0000 7f6eb8b17640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6ea007af40 0x7f6ea007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.603+0000 7f6eb8b17640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6ea007af40 0x7f6ea007d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005fd0 tx=0x7f6eac005850 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.608+0000 7f6eb1ffb640 1 -- 172.21.15.112:0/89411385 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ea408a7a0 con 0x7f6eb41033c0 2024-09-21T01:04:28.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.803+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6eb4104f80 con 0x7f6ea007af40 2024-09-21T01:04:28.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.805+0000 7f6eb1ffb640 1 -- 172.21.15.112:0/89411385 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f6eb4104f80 con 0x7f6ea007af40 2024-09-21T01:04:28.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6ea007af40 msgr2=0x7f6ea007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6ea007af40 0x7f6ea007d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005fd0 tx=0x7f6eac005850 comp rx=0 tx=0).stop 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 msgr2=0x7f6eb419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb419dbe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ea402af20 tx=0x7f6ea402ed40 comp rx=0 tx=0).stop 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 shutdown_connections 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f6ea007af40 0x7f6ea007d400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41033c0 0x7f6eb419dbe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 --2- 172.21.15.112:0/89411385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eb4102aa0 0x7f6eb419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 >> 172.21.15.112:0/89411385 conn(0x7f6eb40fc4c0 msgr2=0x7f6eb4107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 shutdown_connections 2024-09-21T01:04:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.807+0000 7f6ebad7b640 1 -- 172.21.15.112:0/89411385 wait complete. 2024-09-21T01:04:28.816 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.889+0000 7f27a98cd640 1 -- 172.21.15.112:0/2508199425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a4100fc0 msgr2=0x7f27a4101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.889+0000 7f27a98cd640 1 --2- 172.21.15.112:0/2508199425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a4100fc0 0x7f27a4101420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2798009880 tx=0x7f279802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.889+0000 7f27a98cd640 1 -- 172.21.15.112:0/2508199425 shutdown_connections 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.889+0000 7f27a98cd640 1 --2- 172.21.15.112:0/2508199425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a4100fc0 0x7f27a4101420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.889+0000 7f27a98cd640 1 --2- 172.21.15.112:0/2508199425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27a41057f0 0x7f27a4105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.889+0000 7f27a98cd640 1 -- 172.21.15.112:0/2508199425 >> 172.21.15.112:0/2508199425 conn(0x7f27a40fbc60 msgr2=0x7f27a40fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.889+0000 7f27a98cd640 1 -- 172.21.15.112:0/2508199425 shutdown_connections 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.890+0000 7f27a98cd640 1 -- 172.21.15.112:0/2508199425 wait complete. 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.890+0000 7f27a98cd640 1 Processor -- start 2024-09-21T01:04:28.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.890+0000 7f27a98cd640 1 -- start start 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.890+0000 7f27a98cd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27a4100fc0 0x7f27a419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a98cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a41057f0 0x7f27a419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a98cd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f27a410dcc0 con 0x7f27a41057f0 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a98cd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f27a410db40 con 0x7f27a4100fc0 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a41057f0 0x7f27a419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a41057f0 0x7f27a419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55546/0 (socket says 172.21.15.112:55546) 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a27fc640 1 -- 172.21.15.112:0/3157889433 learned_addr learned my addr 172.21.15.112:0/3157889433 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a2ffd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27a4100fc0 0x7f27a419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a27fc640 1 -- 172.21.15.112:0/3157889433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27a4100fc0 msgr2=0x7f27a419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a27fc640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27a4100fc0 0x7f27a419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a27fc640 1 -- 172.21.15.112:0/3157889433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a4197720 con 0x7f27a41057f0 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a27fc640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a41057f0 0x7f27a419db90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2798031460 tx=0x7f27980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a88cb640 1 -- 172.21.15.112:0/3157889433 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f279803f070 con 0x7f27a41057f0 2024-09-21T01:04:28.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a88cb640 1 -- 172.21.15.112:0/3157889433 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2798004cf0 con 0x7f27a41057f0 2024-09-21T01:04:28.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a88cb640 1 -- 172.21.15.112:0/3157889433 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2798035030 con 0x7f27a41057f0 2024-09-21T01:04:28.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a41979b0 con 0x7f27a41057f0 2024-09-21T01:04:28.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.891+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a4197eb0 con 0x7f27a41057f0 2024-09-21T01:04:28.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.893+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a4101fd0 con 0x7f27a41057f0 2024-09-21T01:04:28.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.893+0000 7f27a88cb640 1 -- 172.21.15.112:0/3157889433 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2798042070 con 0x7f27a41057f0 2024-09-21T01:04:28.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.894+0000 7f27a88cb640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f278c07af30 0x7f278c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:28.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.894+0000 7f27a88cb640 1 -- 172.21.15.112:0/3157889433 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6156+0+0 (secure 0 0 0) 0x7f27980bea50 con 0x7f27a41057f0 2024-09-21T01:04:28.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.894+0000 7f27a2ffd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f278c07af30 0x7f278c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:28.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.894+0000 7f27a2ffd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f278c07af30 0x7f278c07d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2794005c40 tx=0x7f279400a590 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:28.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:28.898+0000 7f27a88cb640 1 -- 172.21.15.112:0/3157889433 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f279808a050 con 0x7f27a41057f0 2024-09-21T01:04:29.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.096+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f27a4198160 con 0x7f278c07af30 2024-09-21T01:04:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.097+0000 7f27a88cb640 1 -- 172.21.15.112:0/3157889433 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f27a4198160 con 0x7f278c07af30 2024-09-21T01:04:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f278c07af30 msgr2=0x7f278c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f278c07af30 0x7f278c07d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2794005c40 tx=0x7f279400a590 comp rx=0 tx=0).stop 2024-09-21T01:04:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a41057f0 msgr2=0x7f27a419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a41057f0 0x7f27a419db90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2798031460 tx=0x7f27980048f0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 shutdown_connections 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f278c07af30 0x7f278c07d3f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27a41057f0 0x7f27a419db90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 --2- 172.21.15.112:0/3157889433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27a4100fc0 0x7f27a419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 >> 172.21.15.112:0/3157889433 conn(0x7f27a40fbc60 msgr2=0x7f27a41000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 shutdown_connections 2024-09-21T01:04:29.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.100+0000 7f27a98cd640 1 -- 172.21.15.112:0/3157889433 wait complete. 2024-09-21T01:04:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 -- 172.21.15.112:0/4243339801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc100820 msgr2=0x7f18fc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 --2- 172.21.15.112:0/4243339801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc100820 0x7f18fc100c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009880 tx=0x7f18e802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 -- 172.21.15.112:0/4243339801 shutdown_connections 2024-09-21T01:04:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 --2- 172.21.15.112:0/4243339801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc100820 0x7f18fc100c80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 --2- 172.21.15.112:0/4243339801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18fc106820 0x7f18fc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 -- 172.21.15.112:0/4243339801 >> 172.21.15.112:0/4243339801 conn(0x7f18fc0fc520 msgr2=0x7f18fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 -- 172.21.15.112:0/4243339801 shutdown_connections 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 -- 172.21.15.112:0/4243339801 wait complete. 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 Processor -- start 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 -- start start 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.183+0000 7f19031e4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18fc100820 0x7f18fc198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f19031e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc106820 0x7f18fc198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f19031e4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc10dcf0 con 0x7f18fc106820 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f19031e4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc10db70 con 0x7f18fc100820 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18fbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc106820 0x7f18fc198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18fbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc106820 0x7f18fc198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55562/0 (socket says 172.21.15.112:55562) 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18fbfff640 1 -- 172.21.15.112:0/2686066566 learned_addr learned my addr 172.21.15.112:0/2686066566 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f1900f80640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18fc100820 0x7f18fc198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18fbfff640 1 -- 172.21.15.112:0/2686066566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18fc100820 msgr2=0x7f18fc198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18fbfff640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18fc100820 0x7f18fc198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18fbfff640 1 -- 172.21.15.112:0/2686066566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18fc199340 con 0x7f18fc106820 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18fbfff640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc106820 0x7f18fc198d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18e8031460 tx=0x7f18e8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18f9ffb640 1 -- 172.21.15.112:0/2686066566 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18e803f070 con 0x7f18fc106820 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18f9ffb640 1 -- 172.21.15.112:0/2686066566 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18e80035f0 con 0x7f18fc106820 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f18f9ffb640 1 -- 172.21.15.112:0/2686066566 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18e8035030 con 0x7f18fc106820 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.184+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18fc1995d0 con 0x7f18fc106820 2024-09-21T01:04:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.185+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18fc1a1b80 con 0x7f18fc106820 2024-09-21T01:04:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.185+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18fc101f60 con 0x7f18fc106820 2024-09-21T01:04:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.186+0000 7f18f9ffb640 1 -- 172.21.15.112:0/2686066566 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f18e8042070 con 0x7f18fc106820 2024-09-21T01:04:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.187+0000 7f18f9ffb640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.187+0000 7f18f9ffb640 1 -- 172.21.15.112:0/2686066566 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6156+0+0 (secure 0 0 0) 0x7f18e80be900 con 0x7f18fc106820 2024-09-21T01:04:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.187+0000 7f1900f80640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.187+0000 7f1900f80640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f18ec07af30 0x7f18ec07d3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009bd0 tx=0x7f18f0005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:29.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.191+0000 7f18f9ffb640 1 -- 172.21.15.112:0/2686066566 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18e8089f00 con 0x7f18fc106820 2024-09-21T01:04:29.302 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:29 smithi187 systemd[1]: Stopping Ceph osd.5 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:04:29.302 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:29 smithi187 ceph-mon[78584]: pgmap v238: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:29.303 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:29.303 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:29.303 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:29.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.378+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f18fc062630 con 0x7f18ec07af30 2024-09-21T01:04:29.379 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:29 smithi112 ceph-mon[109687]: pgmap v238: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:29.380 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:29.380 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:29.380 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:29.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.390+0000 7f18f9ffb640 1 -- 172.21.15.112:0/2686066566 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f18fc062630 con 0x7f18ec07af30 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 89s ago 15m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (8m) 89s ago 16m 8850k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (7m) 23s ago 15m 8544k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (3m) 89s ago 16m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (3m) 23s ago 15m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (4m) 89s ago 15m 81.2M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (10m) 89s ago 10m 150M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (10m) 89s ago 10m 17.2M - 19.1.1-373-g4e45e6b4 164465d2334a f2c38f70f23b 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (10m) 23s ago 10m 21.1M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (10m) 23s ago 10m 19.3M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:04:29.391 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (7m) 89s ago 17m 593M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (6m) 23s ago 15m 523M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (3m) 89s ago 17m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (3m) 23s ago 14m 104M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 89s ago 15m 11.1M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (5m) 23s ago 15m 11.2M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (2m) 89s ago 13m 149M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (2m) 89s ago 13m 153M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (95s) 89s ago 12m 79.3M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (60s) 23s ago 12m 171M 2240M 19.3.0-5120-g18432218 ddce307e1f32 ea28f02f247b 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (26s) 23s ago 11m 81.7M 2240M 19.3.0-5120-g18432218 ddce307e1f32 21ee55f89a04 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (11m) 23s ago 11m 189M 2240M 19.1.1-373-g4e45e6b4 164465d2334a bc69ec2bfcef 2024-09-21T01:04:29.392 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 89s ago 15m 56.0M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f18ec07af30 msgr2=0x7f18ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f18ec07af30 0x7f18ec07d3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009bd0 tx=0x7f18f0005f90 comp rx=0 tx=0).stop 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc106820 msgr2=0x7f18fc198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc106820 0x7f18fc198d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18e8031460 tx=0x7f18e8004530 comp rx=0 tx=0).stop 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 shutdown_connections 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18fc106820 0x7f18fc198d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 --2- 172.21.15.112:0/2686066566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18fc100820 0x7f18fc198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 >> 172.21.15.112:0/2686066566 conn(0x7f18fc0fc520 msgr2=0x7f18fc0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 shutdown_connections 2024-09-21T01:04:29.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.392+0000 7f19031e4640 1 -- 172.21.15.112:0/2686066566 wait complete. 2024-09-21T01:04:29.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.472+0000 7f4644748640 1 -- 172.21.15.112:0/2477154397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1007e0 msgr2=0x7f463c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.472+0000 7f4644748640 1 --2- 172.21.15.112:0/2477154397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1007e0 0x7f463c100c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f462c009880 tx=0x7f462c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 -- 172.21.15.112:0/2477154397 shutdown_connections 2024-09-21T01:04:29.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 --2- 172.21.15.112:0/2477154397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1007e0 0x7f463c100c40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 --2- 172.21.15.112:0/2477154397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f463c1067e0 0x7f463c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 -- 172.21.15.112:0/2477154397 >> 172.21.15.112:0/2477154397 conn(0x7f463c0fc4c0 msgr2=0x7f463c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:29.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 -- 172.21.15.112:0/2477154397 shutdown_connections 2024-09-21T01:04:29.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 -- 172.21.15.112:0/2477154397 wait complete. 2024-09-21T01:04:29.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 Processor -- start 2024-09-21T01:04:29.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 -- start start 2024-09-21T01:04:29.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f463c1007e0 0x7f463c0fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1067e0 0x7f463c0fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f463c10dcb0 con 0x7f463c1067e0 2024-09-21T01:04:29.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.473+0000 7f4644748640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f463c10db30 con 0x7f463c1007e0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4641ce3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1067e0 0x7f463c0fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4641ce3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1067e0 0x7f463c0fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55580/0 (socket says 172.21.15.112:55580) 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4641ce3640 1 -- 172.21.15.112:0/4161712550 learned_addr learned my addr 172.21.15.112:0/4161712550 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f46424e4640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f463c1007e0 0x7f463c0fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4641ce3640 1 -- 172.21.15.112:0/4161712550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f463c1007e0 msgr2=0x7f463c0fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4641ce3640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f463c1007e0 0x7f463c0fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4641ce3640 1 -- 172.21.15.112:0/4161712550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c0fd690 con 0x7f463c1067e0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4641ce3640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1067e0 0x7f463c0fd150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f462c031460 tx=0x7f462c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f46337fe640 1 -- 172.21.15.112:0/4161712550 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f462c03f070 con 0x7f463c1067e0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f46337fe640 1 -- 172.21.15.112:0/4161712550 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f462c0035f0 con 0x7f463c1067e0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463c0fd920 con 0x7f463c1067e0 2024-09-21T01:04:29.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f46337fe640 1 -- 172.21.15.112:0/4161712550 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f462c035030 con 0x7f463c1067e0 2024-09-21T01:04:29.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.474+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463c1a3df0 con 0x7f463c1067e0 2024-09-21T01:04:29.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.475+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463c101f20 con 0x7f463c1067e0 2024-09-21T01:04:29.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.476+0000 7f46337fe640 1 -- 172.21.15.112:0/4161712550 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f462c042070 con 0x7f463c1067e0 2024-09-21T01:04:29.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.477+0000 7f46337fe640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f462807af30 0x7f462807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.477+0000 7f46337fe640 1 -- 172.21.15.112:0/4161712550 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6156+0+0 (secure 0 0 0) 0x7f462c0be900 con 0x7f463c1067e0 2024-09-21T01:04:29.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.477+0000 7f46424e4640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f462807af30 0x7f462807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.477+0000 7f46424e4640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f462807af30 0x7f462807d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4638009bd0 tx=0x7f4638005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:29.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.481+0000 7f46337fe640 1 -- 172.21.15.112:0/4161712550 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f462c089f00 con 0x7f463c1067e0 2024-09-21T01:04:29.658 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:29 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[54275]: 2024-09-21T01:04:29.300+0000 7f75e38fa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:04:29.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:29 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[54275]: 2024-09-21T01:04:29.300+0000 7f75e38fa640 -1 osd.5 71 *** Got signal Terminated *** 2024-09-21T01:04:29.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:29 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[54275]: 2024-09-21T01:04:29.300+0000 7f75e38fa640 -1 osd.5 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:04:29.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.731+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f463c109d60 con 0x7f463c1067e0 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.731+0000 7f46337fe640 1 -- 172.21.15.112:0/4161712550 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f462c08c420 con 0x7f463c1067e0 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:04:29.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 5 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5, 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 9 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:04:29.733 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:04:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.734+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f462807af30 msgr2=0x7f462807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.734+0000 7f4644748640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f462807af30 0x7f462807d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4638009bd0 tx=0x7f4638005f90 comp rx=0 tx=0).stop 2024-09-21T01:04:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.734+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1067e0 msgr2=0x7f463c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.734+0000 7f4644748640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1067e0 0x7f463c0fd150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f462c031460 tx=0x7f462c004530 comp rx=0 tx=0).stop 2024-09-21T01:04:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.735+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 shutdown_connections 2024-09-21T01:04:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.735+0000 7f4644748640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f462807af30 0x7f462807d3f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.735+0000 7f4644748640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f463c1067e0 0x7f463c0fd150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.735+0000 7f4644748640 1 --2- 172.21.15.112:0/4161712550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f463c1007e0 0x7f463c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.735+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 >> 172.21.15.112:0/4161712550 conn(0x7f463c0fc4c0 msgr2=0x7f463c069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:29.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.735+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 shutdown_connections 2024-09-21T01:04:29.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.735+0000 7f4644748640 1 -- 172.21.15.112:0/4161712550 wait complete. 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 -- 172.21.15.112:0/4033876883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 msgr2=0x7f1c44106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/4033876883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44106bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009880 tx=0x7f1c4002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 -- 172.21.15.112:0/4033876883 shutdown_connections 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/4033876883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c44100810 0x7f1c44100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/4033876883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44106bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 -- 172.21.15.112:0/4033876883 >> 172.21.15.112:0/4033876883 conn(0x7f1c440fc510 msgr2=0x7f1c440fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 -- 172.21.15.112:0/4033876883 shutdown_connections 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.816+0000 7f1c4abf9640 1 -- 172.21.15.112:0/4033876883 wait complete. 2024-09-21T01:04:29.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c4abf9640 1 Processor -- start 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c4abf9640 1 -- start start 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c4abf9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c44100810 0x7f1c44107740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c4abf9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44107c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c4abf9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4410dcc0 con 0x7f1c44106810 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c4abf9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4410db40 con 0x7f1c44100810 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55586/0 (socket says 172.21.15.112:55586) 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c3bfff640 1 -- 172.21.15.112:0/1256437069 learned_addr learned my addr 172.21.15.112:0/1256437069 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.817+0000 7f1c48995640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c44100810 0x7f1c44107740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c3bfff640 1 -- 172.21.15.112:0/1256437069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c44100810 msgr2=0x7f1c44107740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c3bfff640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c44100810 0x7f1c44107740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c3bfff640 1 -- 172.21.15.112:0/1256437069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c441081c0 con 0x7f1c44106810 2024-09-21T01:04:29.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c3bfff640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44107c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400d8d0 tx=0x7f1c3400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:29.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c39ffb640 1 -- 172.21.15.112:0/1256437069 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c34017070 con 0x7f1c44106810 2024-09-21T01:04:29.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c39ffb640 1 -- 172.21.15.112:0/1256437069 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c34010460 con 0x7f1c44106810 2024-09-21T01:04:29.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c441084b0 con 0x7f1c44106810 2024-09-21T01:04:29.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c39ffb640 1 -- 172.21.15.112:0/1256437069 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c3400f5f0 con 0x7f1c44106810 2024-09-21T01:04:29.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.818+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c441a3e10 con 0x7f1c44106810 2024-09-21T01:04:29.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.819+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c44101f50 con 0x7f1c44106810 2024-09-21T01:04:29.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.820+0000 7f1c39ffb640 1 -- 172.21.15.112:0/1256437069 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1c34009a30 con 0x7f1c44106810 2024-09-21T01:04:29.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.820+0000 7f1c39ffb640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1c2c07af30 0x7f1c2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:29.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.820+0000 7f1c39ffb640 1 -- 172.21.15.112:0/1256437069 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6156+0+0 (secure 0 0 0) 0x7f1c3409de10 con 0x7f1c44106810 2024-09-21T01:04:29.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.820+0000 7f1c48995640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1c2c07af30 0x7f1c2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:29.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.821+0000 7f1c48995640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1c2c07af30 0x7f1c2c07d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1c400096c0 tx=0x7f1c40031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:29.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:29.825+0000 7f1c39ffb640 1 -- 172.21.15.112:0/1256437069 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c34069410 con 0x7f1c44106810 2024-09-21T01:04:30.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.038+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1c44108c70 con 0x7f1c44106810 2024-09-21T01:04:30.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.038+0000 7f1c39ffb640 1 -- 172.21.15.112:0/1256437069 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2022 (secure 0 0 0) 0x7f1c3406e2c0 con 0x7f1c44106810 2024-09-21T01:04:30.039 INFO:teuthology.orchestra.run.smithi112.stdout:e15 2024-09-21T01:04:30.039 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T00:54:11:404609+0000 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:04:30.040 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:04:30.041 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:14614} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/852244245,v1:172.21.15.112:6827/852244245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:04:30.042 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.040+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1c2c07af30 msgr2=0x7f1c2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1c2c07af30 0x7f1c2c07d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1c400096c0 tx=0x7f1c40031400 comp rx=0 tx=0).stop 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 msgr2=0x7f1c44107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44107c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400d8d0 tx=0x7f1c3400dd90 comp rx=0 tx=0).stop 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 shutdown_connections 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1c2c07af30 0x7f1c2c07d3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c44106810 0x7f1c44107c80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 --2- 172.21.15.112:0/1256437069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c44100810 0x7f1c44107740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 >> 172.21.15.112:0/1256437069 conn(0x7f1c440fc510 msgr2=0x7f1c4406a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 shutdown_connections 2024-09-21T01:04:30.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.041+0000 7f1c4abf9640 1 -- 172.21.15.112:0/1256437069 wait complete. 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.128+0000 7f6551941640 1 -- 172.21.15.112:0/2647452056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1067e0 msgr2=0x7f654c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.128+0000 7f6551941640 1 --2- 172.21.15.112:0/2647452056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1067e0 0x7f654c106bc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f653c009880 tx=0x7f653c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 -- 172.21.15.112:0/2647452056 shutdown_connections 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 --2- 172.21.15.112:0/2647452056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c1007e0 0x7f654c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 --2- 172.21.15.112:0/2647452056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1067e0 0x7f654c106bc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 -- 172.21.15.112:0/2647452056 >> 172.21.15.112:0/2647452056 conn(0x7f654c0fc4c0 msgr2=0x7f654c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 -- 172.21.15.112:0/2647452056 shutdown_connections 2024-09-21T01:04:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 -- 172.21.15.112:0/2647452056 wait complete. 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 Processor -- start 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 -- start start 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1007e0 0x7f654c19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c1067e0 0x7f654c19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f654c10dcb0 con 0x7f654c1007e0 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.129+0000 7f6551941640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f654c10db30 con 0x7f654c1067e0 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f654affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1007e0 0x7f654c19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f654affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1007e0 0x7f654c19d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55608/0 (socket says 172.21.15.112:55608) 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f654affd640 1 -- 172.21.15.112:0/983815114 learned_addr learned my addr 172.21.15.112:0/983815114 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f6543fff640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c1067e0 0x7f654c19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f654affd640 1 -- 172.21.15.112:0/983815114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c1067e0 msgr2=0x7f654c19db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f654affd640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c1067e0 0x7f654c19db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f654affd640 1 -- 172.21.15.112:0/983815114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c197790 con 0x7f654c1007e0 2024-09-21T01:04:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f654affd640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1007e0 0x7f654c19d610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f653c031460 tx=0x7f653c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f655093f640 1 -- 172.21.15.112:0/983815114 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f653c03f070 con 0x7f654c1007e0 2024-09-21T01:04:30.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f655093f640 1 -- 172.21.15.112:0/983815114 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f653c0035f0 con 0x7f654c1007e0 2024-09-21T01:04:30.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f655093f640 1 -- 172.21.15.112:0/983815114 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f653c035030 con 0x7f654c1007e0 2024-09-21T01:04:30.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654c197a20 con 0x7f654c1007e0 2024-09-21T01:04:30.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.130+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f654c197f50 con 0x7f654c1007e0 2024-09-21T01:04:30.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.131+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f654c101f20 con 0x7f654c1007e0 2024-09-21T01:04:30.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.132+0000 7f655093f640 1 -- 172.21.15.112:0/983815114 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f653c042070 con 0x7f654c1007e0 2024-09-21T01:04:30.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.133+0000 7f655093f640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f653807af30 0x7f653807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.133+0000 7f6543fff640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f653807af30 0x7f653807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.133+0000 7f655093f640 1 -- 172.21.15.112:0/983815114 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f653c0be970 con 0x7f654c1007e0 2024-09-21T01:04:30.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.133+0000 7f6543fff640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f653807af30 0x7f653807d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f654c105f20 tx=0x7f653400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.137+0000 7f655093f640 1 -- 172.21.15.112:0/983815114 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f653c0c0e20 con 0x7f654c1007e0 2024-09-21T01:04:30.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.333+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f654c198200 con 0x7f653807af30 2024-09-21T01:04:30.334 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:30 smithi112 ceph-mon[109687]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:30.334 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:30 smithi112 ceph-mon[109687]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:30.334 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:30 smithi112 ceph-mon[109687]: osd.5 marked itself down and dead 2024-09-21T01:04:30.334 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:30 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4161712550' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:30.334 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:30 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1256437069' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.334+0000 7f655093f640 1 -- 172.21.15.112:0/983815114 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f654c198200 con 0x7f653807af30 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:04:30.335 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:04:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:04:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:04:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "11/23 daemons upgraded", 2024-09-21T01:04:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T01:04:30.336 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:04:30.336 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f653807af30 msgr2=0x7f653807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f653807af30 0x7f653807d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f654c105f20 tx=0x7f653400b390 comp rx=0 tx=0).stop 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1007e0 msgr2=0x7f654c19d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1007e0 0x7f654c19d610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f653c031460 tx=0x7f653c0045e0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 shutdown_connections 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f653807af30 0x7f653807d3f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c1067e0 0x7f654c19db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 --2- 172.21.15.112:0/983815114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f654c1007e0 0x7f654c19d610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 >> 172.21.15.112:0/983815114 conn(0x7f654c0fc4c0 msgr2=0x7f654c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 shutdown_connections 2024-09-21T01:04:30.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.336+0000 7f6551941640 1 -- 172.21.15.112:0/983815114 wait complete. 2024-09-21T01:04:30.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:30 smithi187 ceph-mon[78584]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:30 smithi187 ceph-mon[78584]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:30 smithi187 ceph-mon[78584]: osd.5 marked itself down and dead 2024-09-21T01:04:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:30 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4161712550' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:30.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:30 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1256437069' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 -- 172.21.15.112:0/3113215032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 msgr2=0x7f26bc101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 --2- 172.21.15.112:0/3113215032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc101d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009880 tx=0x7f26ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 -- 172.21.15.112:0/3113215032 shutdown_connections 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 --2- 172.21.15.112:0/3113215032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc101d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 --2- 172.21.15.112:0/3113215032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26bc107930 0x7f26bc107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 -- 172.21.15.112:0/3113215032 >> 172.21.15.112:0/3113215032 conn(0x7f26bc0fd630 msgr2=0x7f26bc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 -- 172.21.15.112:0/3113215032 shutdown_connections 2024-09-21T01:04:30.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.418+0000 7f26c4208640 1 -- 172.21.15.112:0/3113215032 wait complete. 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c4208640 1 Processor -- start 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c4208640 1 -- start start 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c4208640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c4208640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26bc107930 0x7f26bc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c4208640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc10ede0 con 0x7f26bc101930 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c4208640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc10ec60 con 0x7f26bc107930 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c1fa4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c1fa4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55628/0 (socket says 172.21.15.112:55628) 2024-09-21T01:04:30.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c1fa4640 1 -- 172.21.15.112:0/2206632704 learned_addr learned my addr 172.21.15.112:0/2206632704 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c17a3640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26bc107930 0x7f26bc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c1fa4640 1 -- 172.21.15.112:0/2206632704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26bc107930 msgr2=0x7f26bc19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c1fa4640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26bc107930 0x7f26bc19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.419+0000 7f26c1fa4640 1 -- 172.21.15.112:0/2206632704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc197850 con 0x7f26bc101930 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.420+0000 7f26c1fa4640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc19d6d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26b400cc60 tx=0x7f26b400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.420+0000 7f26b2ffd640 1 -- 172.21.15.112:0/2206632704 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26b400ad30 con 0x7f26bc101930 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.420+0000 7f26b2ffd640 1 -- 172.21.15.112:0/2206632704 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26b4005020 con 0x7f26bc101930 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.420+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc197b40 con 0x7f26bc101930 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.420+0000 7f26b2ffd640 1 -- 172.21.15.112:0/2206632704 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26b400f660 con 0x7f26bc101930 2024-09-21T01:04:30.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.420+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26bc1980a0 con 0x7f26bc101930 2024-09-21T01:04:30.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.421+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26bc103070 con 0x7f26bc101930 2024-09-21T01:04:30.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.422+0000 7f26b2ffd640 1 -- 172.21.15.112:0/2206632704 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f26b40051d0 con 0x7f26bc101930 2024-09-21T01:04:30.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.422+0000 7f26b2ffd640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f26a807af80 0x7f26a807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:30.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.422+0000 7f26c17a3640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f26a807af80 0x7f26a807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:30.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.422+0000 7f26b2ffd640 1 -- 172.21.15.112:0/2206632704 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f26b409e510 con 0x7f26bc101930 2024-09-21T01:04:30.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.423+0000 7f26c17a3640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f26a807af80 0x7f26a807d440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26bc198ba0 tx=0x7f26ac031420 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:30.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.427+0000 7f26b2ffd640 1 -- 172.21.15.112:0/2206632704 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26b4014030 con 0x7f26bc101930 2024-09-21T01:04:30.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.678+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f26bc109ec0 con 0x7f26bc101930 2024-09-21T01:04:30.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.678+0000 7f26b2ffd640 1 -- 172.21.15.112:0/2206632704 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+290 (secure 0 0 0) 0x7f26b4069b90 con 0x7f26bc101930 2024-09-21T01:04:30.679 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-09-21T01:04:30.679 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:04:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:04:30.680 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T01:04:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: osd.5 (root=default,host=smithi187) is down 2024-09-21T01:04:30.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f26a807af80 msgr2=0x7f26a807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f26a807af80 0x7f26a807d440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26bc198ba0 tx=0x7f26ac031420 comp rx=0 tx=0).stop 2024-09-21T01:04:30.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 msgr2=0x7f26bc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:30.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc19d6d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26b400cc60 tx=0x7f26b400a620 comp rx=0 tx=0).stop 2024-09-21T01:04:30.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 shutdown_connections 2024-09-21T01:04:30.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f26a807af80 0x7f26a807d440 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26bc107930 0x7f26bc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 --2- 172.21.15.112:0/2206632704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc101930 0x7f26bc19d6d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:30.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.680+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 >> 172.21.15.112:0/2206632704 conn(0x7f26bc0fd630 msgr2=0x7f26bc0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:30.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.681+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 shutdown_connections 2024-09-21T01:04:30.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:04:30.681+0000 7f26c4208640 1 -- 172.21.15.112:0/2206632704 wait complete. 2024-09-21T01:04:30.851 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:30 smithi187 podman[95124]: 2024-09-21 01:04:30.556027436 +0000 UTC m=+1.401563366 container died bc69ec2bfcefdf17f5557ac195c9c7a8744703c9a76081fc2bc51eb417df9d4b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:04:31.159 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:30 smithi187 podman[95124]: 2024-09-21 01:04:30.96743945 +0000 UTC m=+1.812975369 container cleanup bc69ec2bfcefdf17f5557ac195c9c7a8744703c9a76081fc2bc51eb417df9d4b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T01:04:31.159 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:30 smithi187 bash[95124]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5 2024-09-21T01:04:31.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:31 smithi187 ceph-mon[78584]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:31.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:31 smithi187 ceph-mon[78584]: pgmap v239: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:31.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:31 smithi187 ceph-mon[78584]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:04:31.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:31 smithi187 ceph-mon[78584]: osdmap e72: 6 total, 5 up, 6 in 2024-09-21T01:04:31.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:31 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2206632704' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:04:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:31 smithi112 ceph-mon[109687]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:31 smithi112 ceph-mon[109687]: pgmap v239: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:31 smithi112 ceph-mon[109687]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T01:04:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:31 smithi112 ceph-mon[109687]: osdmap e72: 6 total, 5 up, 6 in 2024-09-21T01:04:31.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:31 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2206632704' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:04:31.573 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:31 smithi187 podman[95141]: 2024-09-21 01:04:31.168729909 +0000 UTC m=+0.606988008 container remove bc69ec2bfcefdf17f5557ac195c9c7a8744703c9a76081fc2bc51eb417df9d4b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T01:04:31.826 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:31 smithi187 podman[95229]: 2024-09-21 01:04:31.475798393 +0000 UTC m=+0.015682521 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:04:31.826 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:31 smithi187 podman[95229]: 2024-09-21 01:04:31.594631804 +0000 UTC m=+0.134515960 container create 07a2d9a02bfb836d9981419451644fc9c1557207fd6e521e5b49cfcb9bfb7cef (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:04:31.826 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:31 smithi187 podman[95229]: 2024-09-21 01:04:31.822423342 +0000 UTC m=+0.362307460 container init 07a2d9a02bfb836d9981419451644fc9c1557207fd6e521e5b49cfcb9bfb7cef (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T01:04:31.826 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:31 smithi187 podman[95229]: 2024-09-21 01:04:31.825811756 +0000 UTC m=+0.365695875 container start 07a2d9a02bfb836d9981419451644fc9c1557207fd6e521e5b49cfcb9bfb7cef (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:04:32.089 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:31 smithi187 podman[95229]: 2024-09-21 01:04:31.913888591 +0000 UTC m=+0.453772714 container attach 07a2d9a02bfb836d9981419451644fc9c1557207fd6e521e5b49cfcb9bfb7cef (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T01:04:32.089 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:32 smithi187 podman[95229]: 2024-09-21 01:04:32.014219542 +0000 UTC m=+0.554103656 container died 07a2d9a02bfb836d9981419451644fc9c1557207fd6e521e5b49cfcb9bfb7cef (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T01:04:32.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:32 smithi187 ceph-mon[78584]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:32.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:32 smithi187 ceph-mon[78584]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T01:04:32.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:32 smithi112 ceph-mon[109687]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:04:32.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:32 smithi112 ceph-mon[109687]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T01:04:32.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:32 smithi187 podman[95253]: 2024-09-21 01:04:32.584059728 +0000 UTC m=+0.563924182 container remove 07a2d9a02bfb836d9981419451644fc9c1557207fd6e521e5b49cfcb9bfb7cef (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:04:32.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:32 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T01:04:32.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:32 smithi187 systemd[1]: Stopped Ceph osd.5 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:04:32.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:32 smithi187 systemd[1]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.5.service: Consumed 52.443s CPU time. 2024-09-21T01:04:32.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:32 smithi187 systemd[1]: Starting Ceph osd.5 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:04:33.296 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:33 smithi187 ceph-mon[78584]: pgmap v242: 65 pgs: 3 active+undersized, 11 stale+active+clean, 51 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:33.296 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 podman[95349]: 2024-09-21 01:04:32.923566931 +0000 UTC m=+0.016051695 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:04:33.297 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 podman[95349]: 2024-09-21 01:04:33.035469494 +0000 UTC m=+0.127954286 container create ff68d495159b7d6e55da0f965ab8f23c15afd75199d2c13f920f54fb7b827923 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T01:04:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:33 smithi112 ceph-mon[109687]: pgmap v242: 65 pgs: 3 active+undersized, 11 stale+active+clean, 51 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:33.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 podman[95349]: 2024-09-21 01:04:33.296527249 +0000 UTC m=+0.389012003 container init ff68d495159b7d6e55da0f965ab8f23c15afd75199d2c13f920f54fb7b827923 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T01:04:33.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 podman[95349]: 2024-09-21 01:04:33.300889914 +0000 UTC m=+0.393374665 container start ff68d495159b7d6e55da0f965ab8f23c15afd75199d2c13f920f54fb7b827923 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T01:04:33.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 podman[95349]: 2024-09-21 01:04:33.371317638 +0000 UTC m=+0.463802405 container attach ff68d495159b7d6e55da0f965ab8f23c15afd75199d2c13f920f54fb7b827923 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:04:33.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:33.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 bash[95349]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:33.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:33.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:33 smithi187 bash[95349]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T01:04:34.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-mon[78584]: Health check failed: Degraded data redundancy: 43/279 objects degraded (15.412%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:34.409 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T01:04:34.409 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 bash[95349]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T01:04:34.409 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T01:04:34.409 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 bash[95349]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-21T01:04:34.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:34 smithi112 ceph-mon[109687]: Health check failed: Degraded data redundancy: 43/279 objects degraded (15.412%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:34.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T01:04:34.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 bash[95349]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-21T01:04:34.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T01:04:34.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 bash[95349]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T01:04:34.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T01:04:34.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 bash[95349]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T01:04:34.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T01:04:34.910 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 bash[95349]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T01:04:34.910 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate[95364]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-21T01:04:34.910 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 bash[95349]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-21T01:04:34.910 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:34 smithi187 podman[95349]: 2024-09-21 01:04:34.581614384 +0000 UTC m=+1.674099151 container died ff68d495159b7d6e55da0f965ab8f23c15afd75199d2c13f920f54fb7b827923 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T01:04:35.249 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:35 smithi187 ceph-mon[78584]: pgmap v243: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:35.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:35 smithi112 ceph-mon[109687]: pgmap v243: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:35.568 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 podman[95494]: 2024-09-21 01:04:35.249911045 +0000 UTC m=+0.662154535 container remove ff68d495159b7d6e55da0f965ab8f23c15afd75199d2c13f920f54fb7b827923 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T01:04:35.569 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 podman[95552]: 2024-09-21 01:04:35.442398451 +0000 UTC m=+0.100450160 container create 5c353aaf7054780237ed18cb5894bd3c8f4e9d3438e3889aac429a9baa196106 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:04:35.569 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 podman[95552]: 2024-09-21 01:04:35.357764919 +0000 UTC m=+0.015816637 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:04:35.910 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 podman[95552]: 2024-09-21 01:04:35.694777071 +0000 UTC m=+0.352828802 container init 5c353aaf7054780237ed18cb5894bd3c8f4e9d3438e3889aac429a9baa196106 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T01:04:35.910 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 podman[95552]: 2024-09-21 01:04:35.697922667 +0000 UTC m=+0.355974380 container start 5c353aaf7054780237ed18cb5894bd3c8f4e9d3438e3889aac429a9baa196106 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:04:35.911 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 ceph-osd[95571]: -- 172.21.15.187:0/1298199100 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d1a9301e0 con 0x560d19bb8d00 2024-09-21T01:04:35.911 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 bash[95552]: 5c353aaf7054780237ed18cb5894bd3c8f4e9d3438e3889aac429a9baa196106 2024-09-21T01:04:35.911 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:35 smithi187 systemd[1]: Started Ceph osd.5 for ede6b7bc-77b2-11ef-baf5-efdc52797490. 2024-09-21T01:04:37.101 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:36 smithi187 ceph-mon[78584]: pgmap v244: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:37.101 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:36 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:37.101 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:36 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:37.101 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:36 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:37.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:36 smithi112 ceph-mon[109687]: pgmap v244: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:37.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:36 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:37.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:36 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:37.262 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:36 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:37.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:37 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:04:37.354+0000 7f3fa5731640 -1 Falling back to public interface 2024-09-21T01:04:39.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:38 smithi187 ceph-mon[78584]: pgmap v245: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:39.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:38 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:39.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:38 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:38 smithi112 ceph-mon[109687]: pgmap v245: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:38 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:38 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:40.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:40 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:40.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:40 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:40 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:40.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:40 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:41.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:41 smithi187 ceph-mon[78584]: pgmap v246: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:41 smithi112 ceph-mon[109687]: pgmap v246: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:43.372 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: pgmap v247: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:43.372 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.372 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T01:04:43.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='osd.5 [v2:172.21.15.187:6816/3544051650,v1:172.21.15.187:6817/3544051650]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:04:43.374 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:43 smithi112 ceph-mon[109687]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:04:43.408 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:04:43.032+0000 7f3fa5731640 -1 osd.5 71 log_to_monitors true 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: pgmap v247: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T01:04:43.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T01:04:43.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T01:04:43.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T01:04:43.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T01:04:43.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T01:04:43.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='osd.5 [v2:172.21.15.187:6816/3544051650,v1:172.21.15.187:6817/3544051650]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:04:43.411 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-mon[78584]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:04:43.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:04:43 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:04:43.459+0000 7f3f9d4b1640 -1 osd.5 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:04:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all osd 2024-09-21T01:04:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:04:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T01:04:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='osd.5 [v2:172.21.15.187:6816/3544051650,v1:172.21.15.187:6817/3544051650]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:44.414 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:44.415 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:44.415 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.yntrjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:04:44.415 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all osd 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='osd.5 [v2:172.21.15.187:6816/3544051650,v1:172.21.15.187:6817/3544051650]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:44.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.yntrjn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:04:44.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:45 smithi112 ceph-mon[109687]: pgmap v249: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:45 smithi112 ceph-mon[109687]: Upgrade: Updating mds.cephfs.smithi112.yntrjn 2024-09-21T01:04:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:45 smithi112 ceph-mon[109687]: Deploying daemon mds.cephfs.smithi112.yntrjn on smithi112 2024-09-21T01:04:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:45 smithi112 ceph-mon[109687]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:04:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:45 smithi112 ceph-mon[109687]: osd.5 [v2:172.21.15.187:6816/3544051650,v1:172.21.15.187:6817/3544051650] boot 2024-09-21T01:04:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:45 smithi112 ceph-mon[109687]: osdmap e75: 6 total, 6 up, 6 in 2024-09-21T01:04:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:45 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:04:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:45 smithi187 ceph-mon[78584]: pgmap v249: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:45 smithi187 ceph-mon[78584]: Upgrade: Updating mds.cephfs.smithi112.yntrjn 2024-09-21T01:04:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:45 smithi187 ceph-mon[78584]: Deploying daemon mds.cephfs.smithi112.yntrjn on smithi112 2024-09-21T01:04:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:45 smithi187 ceph-mon[78584]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T01:04:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:45 smithi187 ceph-mon[78584]: osd.5 [v2:172.21.15.187:6816/3544051650,v1:172.21.15.187:6817/3544051650] boot 2024-09-21T01:04:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:45 smithi187 ceph-mon[78584]: osdmap e75: 6 total, 6 up, 6 in 2024-09-21T01:04:45.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:45 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:04:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:46 smithi112 ceph-mon[109687]: osdmap e76: 6 total, 6 up, 6 in 2024-09-21T01:04:46.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:46 smithi112 ceph-mon[109687]: pgmap v252: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:46.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:46 smithi187 ceph-mon[78584]: osdmap e76: 6 total, 6 up, 6 in 2024-09-21T01:04:46.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:46 smithi187 ceph-mon[78584]: pgmap v252: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T01:04:47.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:47 smithi112 ceph-mon[109687]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T01:04:47.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:47 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 2 up:standby 2024-09-21T01:04:47.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:47 smithi187 ceph-mon[78584]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T01:04:47.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:47 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 2 up:standby 2024-09-21T01:04:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:48 smithi112 ceph-mon[109687]: pgmap v254: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 43 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:04:48.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:48 smithi187 ceph-mon[78584]: pgmap v254: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 43 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T01:04:49.643 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:49 smithi112 ceph-mon[109687]: Health check update: Degraded data redundancy: 35/279 objects degraded (12.545%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:49.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:49 smithi187 ceph-mon[78584]: Health check update: Degraded data redundancy: 35/279 objects degraded (12.545%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T01:04:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: pgmap v255: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/279 objects degraded (12.545%), 10 pgs degraded) 2024-09-21T01:04:51.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:boot 2024-09-21T01:04:51.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T01:04:51.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:51 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"} : dispatch 2024-09-21T01:04:51.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: pgmap v255: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:51.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:51.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:51.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:51.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/279 objects degraded (12.545%), 10 pgs degraded) 2024-09-21T01:04:51.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:boot 2024-09-21T01:04:51.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi112.ngfvvg=up:active} 3 up:standby 2024-09-21T01:04:51.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:51 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.yntrjn"} : dispatch 2024-09-21T01:04:53.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:53 smithi112 ceph-mon[109687]: pgmap v256: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:53.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:53 smithi187 ceph-mon[78584]: pgmap v256: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:55 smithi187 ceph-mon[78584]: pgmap v257: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:55 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:55.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:55 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:55.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:55 smithi112 ceph-mon[109687]: pgmap v257: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:55.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:55 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:55.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:55 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:57.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:56 smithi112 ceph-mon[109687]: pgmap v258: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:57.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:56 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:57.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:56 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:57.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:56 smithi187 ceph-mon[78584]: pgmap v258: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:57.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:56 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:57.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:56 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:59.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:58 smithi112 ceph-mon[109687]: pgmap v259: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:59.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:59.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:59.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:04:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:59.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:58 smithi187 ceph-mon[78584]: pgmap v259: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:04:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:04:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:04:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:04:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:00.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:00.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 -- 172.21.15.112:0/1557404571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 msgr2=0x7fc890106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:00.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 --2- 172.21.15.112:0/1557404571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc890106bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009880 tx=0x7fc88c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:05:00.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 -- 172.21.15.112:0/1557404571 shutdown_connections 2024-09-21T01:05:00.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 --2- 172.21.15.112:0/1557404571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8901007e0 0x7fc890100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:00.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 --2- 172.21.15.112:0/1557404571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc890106bc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:00.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 -- 172.21.15.112:0/1557404571 >> 172.21.15.112:0/1557404571 conn(0x7fc8900fc4c0 msgr2=0x7fc8900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:00.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 -- 172.21.15.112:0/1557404571 shutdown_connections 2024-09-21T01:05:00.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.767+0000 7fc898693640 1 -- 172.21.15.112:0/1557404571 wait complete. 2024-09-21T01:05:00.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc898693640 1 Processor -- start 2024-09-21T01:05:00.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc898693640 1 -- start start 2024-09-21T01:05:00.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc898693640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8901007e0 0x7fc890107c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:00.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc898693640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc8901081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:00.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc898693640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc89010dc90 con 0x7fc8901067e0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc898693640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc89010db10 con 0x7fc8901007e0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc895c2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc8901081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc895c2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc8901081c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54968/0 (socket says 172.21.15.112:54968) 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc895c2e640 1 -- 172.21.15.112:0/4038226814 learned_addr learned my addr 172.21.15.112:0/4038226814 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.768+0000 7fc89642f640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8901007e0 0x7fc890107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc895c2e640 1 -- 172.21.15.112:0/4038226814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8901007e0 msgr2=0x7fc890107c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc895c2e640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8901007e0 0x7fc890107c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc895c2e640 1 -- 172.21.15.112:0/4038226814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc890108700 con 0x7fc8901067e0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc895c2e640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc8901081c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc88000d8d0 tx=0x7fc88000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc8877fe640 1 -- 172.21.15.112:0/4038226814 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc880017070 con 0x7fc8901067e0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc8877fe640 1 -- 172.21.15.112:0/4038226814 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc880010460 con 0x7fc8901067e0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8901089f0 con 0x7fc8901067e0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc8877fe640 1 -- 172.21.15.112:0/4038226814 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc88000f5f0 con 0x7fc8901067e0 2024-09-21T01:05:00.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.769+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8901a3df0 con 0x7fc8901067e0 2024-09-21T01:05:00.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.770+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc890101f20 con 0x7fc8901067e0 2024-09-21T01:05:00.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.771+0000 7fc8877fe640 1 -- 172.21.15.112:0/4038226814 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc880009a30 con 0x7fc8901067e0 2024-09-21T01:05:00.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.771+0000 7fc8877fe640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc87c07af80 0x7fc87c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:00.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.771+0000 7fc8877fe640 1 -- 172.21.15.112:0/4038226814 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7fc88009dd60 con 0x7fc8901067e0 2024-09-21T01:05:00.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.771+0000 7fc89642f640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc87c07af80 0x7fc87c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:00.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.772+0000 7fc89642f640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc87c07af80 0x7fc87c07d440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0096c0 tx=0x7fc88c031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:00.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.776+0000 7fc8877fe640 1 -- 172.21.15.112:0/4038226814 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8800693e0 con 0x7fc8901067e0 2024-09-21T01:05:00.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.992+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc8900fdc80 con 0x7fc87c07af80 2024-09-21T01:05:00.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.993+0000 7fc8877fe640 1 -- 172.21.15.112:0/4038226814 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc8900fdc80 con 0x7fc87c07af80 2024-09-21T01:05:00.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc87c07af80 msgr2=0x7fc87c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc87c07af80 0x7fc87c07d440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0096c0 tx=0x7fc88c031400 comp rx=0 tx=0).stop 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 msgr2=0x7fc8901081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc8901081c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc88000d8d0 tx=0x7fc88000dd90 comp rx=0 tx=0).stop 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 shutdown_connections 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc87c07af80 0x7fc87c07d440 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8901067e0 0x7fc8901081c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 --2- 172.21.15.112:0/4038226814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8901007e0 0x7fc890107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 >> 172.21.15.112:0/4038226814 conn(0x7fc8900fc4c0 msgr2=0x7fc890109f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 shutdown_connections 2024-09-21T01:05:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:00.996+0000 7fc898693640 1 -- 172.21.15.112:0/4038226814 wait complete. 2024-09-21T01:05:01.005 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:05:01.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.080+0000 7f23fafd8640 1 -- 172.21.15.112:0/2996084250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4102b40 msgr2=0x7f23f4102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.080+0000 7f23fafd8640 1 --2- 172.21.15.112:0/2996084250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4102b40 0x7f23f4102f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0098b0 tx=0x7f23ec02a560 comp rx=0 tx=0).stop 2024-09-21T01:05:01.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.080+0000 7f23fafd8640 1 -- 172.21.15.112:0/2996084250 shutdown_connections 2024-09-21T01:05:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.080+0000 7f23fafd8640 1 --2- 172.21.15.112:0/2996084250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23f4103460 0x7f23f410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.080+0000 7f23fafd8640 1 --2- 172.21.15.112:0/2996084250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4102b40 0x7f23f4102f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.080+0000 7f23fafd8640 1 -- 172.21.15.112:0/2996084250 >> 172.21.15.112:0/2996084250 conn(0x7f23f40fc520 msgr2=0x7f23f40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.080+0000 7f23fafd8640 1 -- 172.21.15.112:0/2996084250 shutdown_connections 2024-09-21T01:05:01.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.081+0000 7f23fafd8640 1 -- 172.21.15.112:0/2996084250 wait complete. 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.081+0000 7f23fafd8640 1 Processor -- start 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.081+0000 7f23fafd8640 1 -- start start 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23fafd8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23f4102b40 0x7f23f41007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23fafd8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4103460 0x7f23f4100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23fafd8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23f410ee10 con 0x7f23f4103460 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23fafd8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f23f410ec90 con 0x7f23f4102b40 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4103460 0x7f23f4100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4103460 0x7f23f4100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54998/0 (socket says 172.21.15.112:54998) 2024-09-21T01:05:01.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f3fff640 1 -- 172.21.15.112:0/3292960260 learned_addr learned my addr 172.21.15.112:0/3292960260 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:01.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f8d74640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23f4102b40 0x7f23f41007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f3fff640 1 -- 172.21.15.112:0/3292960260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23f4102b40 msgr2=0x7f23f41007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f3fff640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23f4102b40 0x7f23f41007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f3fff640 1 -- 172.21.15.112:0/3292960260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f4101220 con 0x7f23f4103460 2024-09-21T01:05:01.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f8d74640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23f4102b40 0x7f23f41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:01.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.082+0000 7f23f3fff640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4103460 0x7f23f4100ce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f23e400cc60 tx=0x7f23e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:01.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.084+0000 7f23f1ffb640 1 -- 172.21.15.112:0/3292960260 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23e400ad30 con 0x7f23f4103460 2024-09-21T01:05:01.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.084+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f4101510 con 0x7f23f4103460 2024-09-21T01:05:01.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.084+0000 7f23f1ffb640 1 -- 172.21.15.112:0/3292960260 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23e4005020 con 0x7f23f4103460 2024-09-21T01:05:01.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.084+0000 7f23f1ffb640 1 -- 172.21.15.112:0/3292960260 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23e400f640 con 0x7f23f4103460 2024-09-21T01:05:01.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.084+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f41a3f00 con 0x7f23f4103460 2024-09-21T01:05:01.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.085+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f406ab80 con 0x7f23f4103460 2024-09-21T01:05:01.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.086+0000 7f23f1ffb640 1 -- 172.21.15.112:0/3292960260 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f23e4004b20 con 0x7f23f4103460 2024-09-21T01:05:01.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.086+0000 7f23f1ffb640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f23e007af30 0x7f23e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.086+0000 7f23f8d74640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f23e007af30 0x7f23e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.087+0000 7f23f1ffb640 1 -- 172.21.15.112:0/3292960260 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7f23e409e2b0 con 0x7f23f4103460 2024-09-21T01:05:01.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.087+0000 7f23f8d74640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f23e007af30 0x7f23e007d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000c00 tx=0x7f23ec009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:01.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.091+0000 7f23f1ffb640 1 -- 172.21.15.112:0/3292960260 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23e4014030 con 0x7f23f4103460 2024-09-21T01:05:01.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:01 smithi112 ceph-mon[109687]: pgmap v260: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:05:01.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:01.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ngfvvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:05:01.242 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:01.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.296+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f23f4062630 con 0x7f23e007af30 2024-09-21T01:05:01.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.297+0000 7f23f1ffb640 1 -- 172.21.15.112:0/3292960260 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f23f4062630 con 0x7f23e007af30 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f23e007af30 msgr2=0x7f23e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f23e007af30 0x7f23e007d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000c00 tx=0x7f23ec009560 comp rx=0 tx=0).stop 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4103460 msgr2=0x7f23f4100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4103460 0x7f23f4100ce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f23e400cc60 tx=0x7f23e400a620 comp rx=0 tx=0).stop 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 shutdown_connections 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f23e007af30 0x7f23e007d3f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f4103460 0x7f23f4100ce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 --2- 172.21.15.112:0/3292960260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23f4102b40 0x7f23f41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 >> 172.21.15.112:0/3292960260 conn(0x7f23f40fc520 msgr2=0x7f23f4107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:01.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 shutdown_connections 2024-09-21T01:05:01.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.299+0000 7f23fafd8640 1 -- 172.21.15.112:0/3292960260 wait complete. 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 -- 172.21.15.112:0/973385025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 msgr2=0x7f023c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 --2- 172.21.15.112:0/973385025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c100c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f022c009c20 tx=0x7f022c02a970 comp rx=0 tx=0).stop 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 -- 172.21.15.112:0/973385025 shutdown_connections 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 --2- 172.21.15.112:0/973385025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c100c80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 --2- 172.21.15.112:0/973385025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f023c106820 0x7f023c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 -- 172.21.15.112:0/973385025 >> 172.21.15.112:0/973385025 conn(0x7f023c0fc520 msgr2=0x7f023c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 -- 172.21.15.112:0/973385025 shutdown_connections 2024-09-21T01:05:01.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 -- 172.21.15.112:0/973385025 wait complete. 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 Processor -- start 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.383+0000 7f0242ac4640 1 -- start start 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0242ac4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0242ac4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f023c106820 0x7f023c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0242ac4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f023c10dcf0 con 0x7f023c100820 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0242ac4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f023c10db70 con 0x7f023c106820 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0240860640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0240860640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55010/0 (socket says 172.21.15.112:55010) 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0240860640 1 -- 172.21.15.112:0/2412240316 learned_addr learned my addr 172.21.15.112:0/2412240316 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:01.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f023bfff640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f023c106820 0x7f023c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0240860640 1 -- 172.21.15.112:0/2412240316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f023c106820 msgr2=0x7f023c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0240860640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f023c106820 0x7f023c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0240860640 1 -- 172.21.15.112:0/2412240316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c1977e0 con 0x7f023c100820 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0240860640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c19d660 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f022400d6f0 tx=0x7f022400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0239ffb640 1 -- 172.21.15.112:0/2412240316 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0224017070 con 0x7f023c100820 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023c197ad0 con 0x7f023c100820 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.384+0000 7f0239ffb640 1 -- 172.21.15.112:0/2412240316 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f022400de00 con 0x7f023c100820 2024-09-21T01:05:01.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.385+0000 7f0239ffb640 1 -- 172.21.15.112:0/2412240316 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0224004bb0 con 0x7f023c100820 2024-09-21T01:05:01.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.385+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f023c198060 con 0x7f023c100820 2024-09-21T01:05:01.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.386+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f023c101f60 con 0x7f023c100820 2024-09-21T01:05:01.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.386+0000 7f0239ffb640 1 -- 172.21.15.112:0/2412240316 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f0224004e60 con 0x7f023c100820 2024-09-21T01:05:01.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.387+0000 7f0239ffb640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f022807af40 0x7f022807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.387+0000 7f0239ffb640 1 -- 172.21.15.112:0/2412240316 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7f022409dc50 con 0x7f023c100820 2024-09-21T01:05:01.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.387+0000 7f023bfff640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f022807af40 0x7f022807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.387+0000 7f023bfff640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f022807af40 0x7f022807d400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f023c102360 tx=0x7f022c009360 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:01.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.391+0000 7f0239ffb640 1 -- 172.21.15.112:0/2412240316 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0224069250 con 0x7f023c100820 2024-09-21T01:05:01.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:01 smithi187 ceph-mon[78584]: pgmap v260: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:05:01.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:01 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:01 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.ngfvvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:05:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:01 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:01.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.582+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f023c198310 con 0x7f022807af40 2024-09-21T01:05:01.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.591+0000 7f0239ffb640 1 -- 172.21.15.112:0/2412240316 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f023c198310 con 0x7f022807af40 2024-09-21T01:05:01.592 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:05:01.592 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (5m) 6s ago 16m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:05:01.592 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (8m) 6s ago 16m 9084k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:05:01.592 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (7m) 23s ago 15m 8602k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:05:01.592 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (3m) 6s ago 16m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (3m) 23s ago 15m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (5m) 6s ago 16m 80.4M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (10m) 6s ago 10m 149M - 19.1.1-373-g4e45e6b4 164465d2334a 240382f21000 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (11s) 6s ago 11m 80.4M - 19.3.0-5120-g18432218 ddce307e1f32 af0746f04a0d 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (11m) 23s ago 11m 21.3M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (10m) 23s ago 10m 19.5M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (7m) 6s ago 17m 596M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (6m) 23s ago 15m 523M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (4m) 6s ago 17m 116M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (3m) 23s ago 15m 105M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 6s ago 16m 11.1M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (6m) 23s ago 15m 11.1M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:05:01.593 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (3m) 6s ago 14m 153M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:05:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (2m) 6s ago 13m 156M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:05:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (2m) 6s ago 13m 151M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:05:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (92s) 23s ago 12m 173M 2240M 19.3.0-5120-g18432218 ddce307e1f32 ea28f02f247b 2024-09-21T01:05:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (59s) 23s ago 12m 162M 2240M 19.3.0-5120-g18432218 ddce307e1f32 21ee55f89a04 2024-09-21T01:05:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (26s) 23s ago 12m 78.9M 2240M 19.3.0-5120-g18432218 ddce307e1f32 5c353aaf7054 2024-09-21T01:05:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (5m) 6s ago 16m 56.1M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:05:01.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f022807af40 msgr2=0x7f022807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f022807af40 0x7f022807d400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f023c102360 tx=0x7f022c009360 comp rx=0 tx=0).stop 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 msgr2=0x7f023c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c19d660 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f022400d6f0 tx=0x7f022400dbb0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 shutdown_connections 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f022807af40 0x7f022807d400 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f023c106820 0x7f023c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 --2- 172.21.15.112:0/2412240316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f023c100820 0x7f023c19d660 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 >> 172.21.15.112:0/2412240316 conn(0x7f023c0fc520 msgr2=0x7f023c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 shutdown_connections 2024-09-21T01:05:01.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.594+0000 7f0242ac4640 1 -- 172.21.15.112:0/2412240316 wait complete. 2024-09-21T01:05:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 -- 172.21.15.112:0/139047711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 msgr2=0x7fe304101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 --2- 172.21.15.112:0/139047711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe304101d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009880 tx=0x7fe2f002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 -- 172.21.15.112:0/139047711 shutdown_connections 2024-09-21T01:05:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 --2- 172.21.15.112:0/139047711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe304101d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 --2- 172.21.15.112:0/139047711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe304107930 0x7fe304107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 -- 172.21.15.112:0/139047711 >> 172.21.15.112:0/139047711 conn(0x7fe3040fd630 msgr2=0x7fe3040ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 -- 172.21.15.112:0/139047711 shutdown_connections 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.675+0000 7fe30ad38640 1 -- 172.21.15.112:0/139047711 wait complete. 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe30ad38640 1 Processor -- start 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe30ad38640 1 -- start start 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe30ad38640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe30419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe30ad38640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe304107930 0x7fe30419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe30ad38640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410ee00 con 0x7fe304101930 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe30ad38640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410ec80 con 0x7fe304107930 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe308ad4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe30419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe308ad4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe30419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55040/0 (socket says 172.21.15.112:55040) 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe308ad4640 1 -- 172.21.15.112:0/1535518549 learned_addr learned my addr 172.21.15.112:0/1535518549 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe303fff640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe304107930 0x7fe30419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe308ad4640 1 -- 172.21.15.112:0/1535518549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe304107930 msgr2=0x7fe30419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe308ad4640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe304107930 0x7fe30419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe308ad4640 1 -- 172.21.15.112:0/1535518549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe304197810 con 0x7fe304101930 2024-09-21T01:05:01.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.676+0000 7fe303fff640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe304107930 0x7fe30419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:05:01.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.677+0000 7fe308ad4640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe30419d690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800cc60 tx=0x7fe2f800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.677+0000 7fe301ffb640 1 -- 172.21.15.112:0/1535518549 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f800ad30 con 0x7fe304101930 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.677+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe304197b00 con 0x7fe304101930 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.677+0000 7fe301ffb640 1 -- 172.21.15.112:0/1535518549 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2f8005020 con 0x7fe304101930 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.677+0000 7fe301ffb640 1 -- 172.21.15.112:0/1535518549 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f800f640 con 0x7fe304101930 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.677+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe304198090 con 0x7fe304101930 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.678+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe304103070 con 0x7fe304101930 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.679+0000 7fe301ffb640 1 -- 172.21.15.112:0/1535518549 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fe2f80051d0 con 0x7fe304101930 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.679+0000 7fe301ffb640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe2f407af30 0x7fe2f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:01.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.679+0000 7fe301ffb640 1 -- 172.21.15.112:0/1535518549 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7fe2f809e2e0 con 0x7fe304101930 2024-09-21T01:05:01.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.679+0000 7fe303fff640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe2f407af30 0x7fe2f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:01.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.680+0000 7fe303fff640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe2f407af30 0x7fe2f407d3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0031460 tx=0x7fe2f00095f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:01.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.684+0000 7fe301ffb640 1 -- 172.21.15.112:0/1535518549 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2f8014030 con 0x7fe304101930 2024-09-21T01:05:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.941+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe304109ea0 con 0x7fe304101930 2024-09-21T01:05:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.942+0000 7fe301ffb640 1 -- 172.21.15.112:0/1535518549 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fe2f8069880 con 0x7fe304101930 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 6 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 1 2024-09-21T01:05:01.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:01.944 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:05:01.944 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T01:05:01.944 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 11 2024-09-21T01:05:01.944 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:05:01.944 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe2f407af30 msgr2=0x7fe2f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe2f407af30 0x7fe2f407d3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0031460 tx=0x7fe2f00095f0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 msgr2=0x7fe30419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe30419d690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800cc60 tx=0x7fe2f800a620 comp rx=0 tx=0).stop 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 shutdown_connections 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fe2f407af30 0x7fe2f407d3f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe304107930 0x7fe30419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 --2- 172.21.15.112:0/1535518549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe304101930 0x7fe30419d690 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 >> 172.21.15.112:0/1535518549 conn(0x7fe3040fd630 msgr2=0x7fe3040fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 shutdown_connections 2024-09-21T01:05:01.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:01.944+0000 7fe30ad38640 1 -- 172.21.15.112:0/1535518549 wait complete. 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 -- 172.21.15.112:0/3878899499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c106820 msgr2=0x7f121c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 --2- 172.21.15.112:0/3878899499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c106820 0x7f121c106c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f120c009880 tx=0x7f120c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 -- 172.21.15.112:0/3878899499 shutdown_connections 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 --2- 172.21.15.112:0/3878899499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121c100820 0x7f121c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 --2- 172.21.15.112:0/3878899499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c106820 0x7f121c106c00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 -- 172.21.15.112:0/3878899499 >> 172.21.15.112:0/3878899499 conn(0x7f121c0fc520 msgr2=0x7f121c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 -- 172.21.15.112:0/3878899499 shutdown_connections 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 -- 172.21.15.112:0/3878899499 wait complete. 2024-09-21T01:05:02.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 Processor -- start 2024-09-21T01:05:02.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.026+0000 7f12243f8640 1 -- start start 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12243f8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c100820 0x7f121c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12243f8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121c106820 0x7f121c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12243f8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f121c10dcf0 con 0x7f121c100820 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12243f8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f121c10db70 con 0x7f121c106820 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1222194640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c100820 0x7f121c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1222194640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c100820 0x7f121c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42664/0 (socket says 172.21.15.112:42664) 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1222194640 1 -- 172.21.15.112:0/269666953 learned_addr learned my addr 172.21.15.112:0/269666953 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:02.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1221993640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121c106820 0x7f121c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1222194640 1 -- 172.21.15.112:0/269666953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121c106820 msgr2=0x7f121c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1222194640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121c106820 0x7f121c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1222194640 1 -- 172.21.15.112:0/269666953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c197810 con 0x7f121c100820 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1221993640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121c106820 0x7f121c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f1222194640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c100820 0x7f121c19d690 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f120c031460 tx=0x7f120c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12137fe640 1 -- 172.21.15.112:0/269666953 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f120c03f070 con 0x7f121c100820 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12137fe640 1 -- 172.21.15.112:0/269666953 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f120c004cf0 con 0x7f121c100820 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121c197aa0 con 0x7f121c100820 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12137fe640 1 -- 172.21.15.112:0/269666953 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f120c035030 con 0x7f121c100820 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.027+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121c197fd0 con 0x7f121c100820 2024-09-21T01:05:02.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.028+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121c101f60 con 0x7f121c100820 2024-09-21T01:05:02.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.029+0000 7f12137fe640 1 -- 172.21.15.112:0/269666953 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f120c042070 con 0x7f121c100820 2024-09-21T01:05:02.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.029+0000 7f12137fe640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f120807af30 0x7f120807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.030+0000 7f12137fe640 1 -- 172.21.15.112:0/269666953 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7f120c0beac0 con 0x7f121c100820 2024-09-21T01:05:02.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.030+0000 7f1221993640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f120807af30 0x7f120807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.030+0000 7f1221993640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f120807af30 0x7f120807d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1218005fd0 tx=0x7f1218005ea0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:02.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.034+0000 7f12137fe640 1 -- 172.21.15.112:0/269666953 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f120c08a0c0 con 0x7f121c100820 2024-09-21T01:05:02.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.256+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f121c109da0 con 0x7f121c100820 2024-09-21T01:05:02.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.256+0000 7f12137fe640 1 -- 172.21.15.112:0/269666953 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) ==== 76+0+2022 (secure 0 0 0) 0x7f120c08ef70 con 0x7f121c100820 2024-09-21T01:05:02.257 INFO:teuthology.orchestra.run.smithi112.stdout:e17 2024-09-21T01:05:02.257 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T01:04:50:461723+0000 2024-09-21T01:05:02.257 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:05:02.257 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:05:02.257 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 15 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T00:54:11.404605+0000 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:05:02.258 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 44 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=14598} 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:05:02.259 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 14598 members: 14598 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{0:14598} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.112:6828/1434345295,v1:172.21.15.112:6829/1434345295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:24301} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:05:02.260 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:05:02.261 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-21T01:05:02.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f120807af30 msgr2=0x7f120807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f120807af30 0x7f120807d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1218005fd0 tx=0x7f1218005ea0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c100820 msgr2=0x7f121c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c100820 0x7f121c19d690 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f120c031460 tx=0x7f120c0048f0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 shutdown_connections 2024-09-21T01:05:02.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f120807af30 0x7f120807d3f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121c106820 0x7f121c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 --2- 172.21.15.112:0/269666953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f121c100820 0x7f121c19d690 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.258+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 >> 172.21.15.112:0/269666953 conn(0x7f121c0fc520 msgr2=0x7f121c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:02.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.259+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 shutdown_connections 2024-09-21T01:05:02.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.259+0000 7f12243f8640 1 -- 172.21.15.112:0/269666953 wait complete. 2024-09-21T01:05:02.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:02 smithi112 ceph-mon[109687]: Upgrade: Updating mds.cephfs.smithi112.ngfvvg 2024-09-21T01:05:02.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:02 smithi112 ceph-mon[109687]: Deploying daemon mds.cephfs.smithi112.ngfvvg on smithi112 2024-09-21T01:05:02.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:02 smithi112 ceph-mon[109687]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:02.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:02 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1535518549' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 -- 172.21.15.112:0/2910198500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4102b50 msgr2=0x7f7ca4102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2910198500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4102b50 0x7f7ca4102f30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009880 tx=0x7f7c9802a530 comp rx=0 tx=0).stop 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 -- 172.21.15.112:0/2910198500 shutdown_connections 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2910198500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca4103470 0x7f7ca410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2910198500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4102b50 0x7f7ca4102f30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 -- 172.21.15.112:0/2910198500 >> 172.21.15.112:0/2910198500 conn(0x7f7ca40fc4f0 msgr2=0x7f7ca40fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 -- 172.21.15.112:0/2910198500 shutdown_connections 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.351+0000 7f7caad0a640 1 -- 172.21.15.112:0/2910198500 wait complete. 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7caad0a640 1 Processor -- start 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7caad0a640 1 -- start start 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7caad0a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca4102b50 0x7f7ca419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7caad0a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4103470 0x7f7ca419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7caad0a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca410edc0 con 0x7f7ca4103470 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7caad0a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca410ec40 con 0x7f7ca4102b50 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7ca3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4103470 0x7f7ca419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7ca3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4103470 0x7f7ca419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42674/0 (socket says 172.21.15.112:42674) 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7ca3fff640 1 -- 172.21.15.112:0/2803752798 learned_addr learned my addr 172.21.15.112:0/2803752798 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.352+0000 7f7ca8aa6640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca4102b50 0x7f7ca419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7ca3fff640 1 -- 172.21.15.112:0/2803752798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca4102b50 msgr2=0x7f7ca419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7ca3fff640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca4102b50 0x7f7ca419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7ca3fff640 1 -- 172.21.15.112:0/2803752798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca4197830 con 0x7f7ca4103470 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7ca3fff640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4103470 0x7f7ca419dbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c810 tx=0x7f7c9000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7ca1ffb640 1 -- 172.21.15.112:0/2803752798 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c90004020 con 0x7f7ca4103470 2024-09-21T01:05:02.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7ca1ffb640 1 -- 172.21.15.112:0/2803752798 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c900041c0 con 0x7f7ca4103470 2024-09-21T01:05:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca4197b20 con 0x7f7ca4103470 2024-09-21T01:05:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.353+0000 7f7ca1ffb640 1 -- 172.21.15.112:0/2803752798 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c900047a0 con 0x7f7ca4103470 2024-09-21T01:05:02.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.354+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca41980b0 con 0x7f7ca4103470 2024-09-21T01:05:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.355+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca406ab90 con 0x7f7ca4103470 2024-09-21T01:05:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.356+0000 7f7ca1ffb640 1 -- 172.21.15.112:0/2803752798 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f7c900079b0 con 0x7f7ca4103470 2024-09-21T01:05:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.356+0000 7f7ca1ffb640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7c9407af80 0x7f7c9407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.357+0000 7f7ca1ffb640 1 -- 172.21.15.112:0/2803752798 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7f7c9009ddd0 con 0x7f7ca4103470 2024-09-21T01:05:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.357+0000 7f7ca8aa6640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7c9407af80 0x7f7c9407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.357+0000 7f7ca8aa6640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7c9407af80 0x7f7c9407d440 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000c00 tx=0x7f7c98004f30 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.361+0000 7f7ca1ffb640 1 -- 172.21.15.112:0/2803752798 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c90014030 con 0x7f7ca4103470 2024-09-21T01:05:02.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:02 smithi187 ceph-mon[78584]: Upgrade: Updating mds.cephfs.smithi112.ngfvvg 2024-09-21T01:05:02.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:02 smithi187 ceph-mon[78584]: Deploying daemon mds.cephfs.smithi112.ngfvvg on smithi112 2024-09-21T01:05:02.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:02 smithi187 ceph-mon[78584]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:02.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:02 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1535518549' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:02.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.566+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7ca41983c0 con 0x7f7c9407af80 2024-09-21T01:05:02.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.568+0000 7f7ca1ffb640 1 -- 172.21.15.112:0/2803752798 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7ca41983c0 con 0x7f7c9407af80 2024-09-21T01:05:02.568 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:05:02.568 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:05:02.568 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "osd", 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "13/23 daemons upgraded", 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:05:02.569 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:05:02.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7c9407af80 msgr2=0x7f7c9407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7c9407af80 0x7f7c9407d440 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000c00 tx=0x7f7c98004f30 comp rx=0 tx=0).stop 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4103470 msgr2=0x7f7ca419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4103470 0x7f7ca419dbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c810 tx=0x7f7c9000ccd0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 shutdown_connections 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f7c9407af80 0x7f7c9407d440 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ca4103470 0x7f7ca419dbf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 --2- 172.21.15.112:0/2803752798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca4102b50 0x7f7ca419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 >> 172.21.15.112:0/2803752798 conn(0x7f7ca40fc4f0 msgr2=0x7f7ca4107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 shutdown_connections 2024-09-21T01:05:02.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.570+0000 7f7caad0a640 1 -- 172.21.15.112:0/2803752798 wait complete. 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 -- 172.21.15.112:0/1444812575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 msgr2=0x7fddc010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1444812575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc010b950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009880 tx=0x7fddb402a530 comp rx=0 tx=0).stop 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 -- 172.21.15.112:0/1444812575 shutdown_connections 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1444812575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc010b950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1444812575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc0102b40 0x7fddc0102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 -- 172.21.15.112:0/1444812575 >> 172.21.15.112:0/1444812575 conn(0x7fddc00fc4c0 msgr2=0x7fddc00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 -- 172.21.15.112:0/1444812575 shutdown_connections 2024-09-21T01:05:02.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.658+0000 7fddc73bc640 1 -- 172.21.15.112:0/1444812575 wait complete. 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc73bc640 1 Processor -- start 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc73bc640 1 -- start start 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc73bc640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc0102b40 0x7fddc01007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc73bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc0100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc73bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fddc010edd0 con 0x7fddc0103460 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc73bc640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fddc010ec50 con 0x7fddc0102b40 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc4957640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc0100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc4957640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc0100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42680/0 (socket says 172.21.15.112:42680) 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc4957640 1 -- 172.21.15.112:0/1049486614 learned_addr learned my addr 172.21.15.112:0/1049486614 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.659+0000 7fddc5158640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc0102b40 0x7fddc01007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddc4957640 1 -- 172.21.15.112:0/1049486614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc0102b40 msgr2=0x7fddc01007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddc4957640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc0102b40 0x7fddc01007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddc4957640 1 -- 172.21.15.112:0/1049486614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc0101220 con 0x7fddc0103460 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddc4957640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc0100ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fddb4004f90 tx=0x7fddb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddbe7fc640 1 -- 172.21.15.112:0/1049486614 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fddb403f070 con 0x7fddc0103460 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddbe7fc640 1 -- 172.21.15.112:0/1049486614 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fddb4004ac0 con 0x7fddc0103460 2024-09-21T01:05:02.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc01014b0 con 0x7fddc0103460 2024-09-21T01:05:02.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddbe7fc640 1 -- 172.21.15.112:0/1049486614 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fddb4035030 con 0x7fddc0103460 2024-09-21T01:05:02.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.660+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc01a3d40 con 0x7fddc0103460 2024-09-21T01:05:02.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.661+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc006a370 con 0x7fddc0103460 2024-09-21T01:05:02.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.662+0000 7fddbe7fc640 1 -- 172.21.15.112:0/1049486614 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fddb4042070 con 0x7fddc0103460 2024-09-21T01:05:02.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.662+0000 7fddbe7fc640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdda807af30 0x7fdda807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:02.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.663+0000 7fddbe7fc640 1 -- 172.21.15.112:0/1049486614 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7fddb40be890 con 0x7fddc0103460 2024-09-21T01:05:02.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.663+0000 7fddc5158640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdda807af30 0x7fdda807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:02.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.663+0000 7fddc5158640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdda807af30 0x7fdda807d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fddb0005fd0 tx=0x7fddb0009500 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:02.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.668+0000 7fddbe7fc640 1 -- 172.21.15.112:0/1049486614 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fddb4089e90 con 0x7fddc0103460 2024-09-21T01:05:02.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.928+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fddc0106000 con 0x7fddc0103460 2024-09-21T01:05:02.929 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:02 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[109683]: 2024-09-21T01:05:02.782+0000 7fab6681d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:02.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.928+0000 7fddbe7fc640 1 -- 172.21.15.112:0/1049486614 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7fddb408ed40 con 0x7fddc0103460 2024-09-21T01:05:02.929 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-21T01:05:02.930 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T01:05:02.930 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs is degraded 2024-09-21T01:05:02.930 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:05:02.930 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:05:02.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdda807af30 msgr2=0x7fdda807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdda807af30 0x7fdda807d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fddb0005fd0 tx=0x7fddb0009500 comp rx=0 tx=0).stop 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 msgr2=0x7fddc0100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc0100ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fddb4004f90 tx=0x7fddb40046c0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 shutdown_connections 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fdda807af30 0x7fdda807d3f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc0103460 0x7fddc0100ce0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 --2- 172.21.15.112:0/1049486614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc0102b40 0x7fddc01007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 >> 172.21.15.112:0/1049486614 conn(0x7fddc00fc4c0 msgr2=0x7fddc0103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 shutdown_connections 2024-09-21T01:05:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:02.931+0000 7fddc73bc640 1 -- 172.21.15.112:0/1049486614 wait complete. 2024-09-21T01:05:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: pgmap v261: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/269666953' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: Standby daemon mds.cephfs.smithi187.cdcgvm assigned to filesystem cephfs as rank 0 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi187.cdcgvm=up:replay} 2 up:standby 2024-09-21T01:05:03.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:03 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1049486614' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:05:03.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: pgmap v261: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/269666953' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: Standby daemon mds.cephfs.smithi187.cdcgvm assigned to filesystem cephfs as rank 0 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi187.cdcgvm=up:replay} 2 up:standby 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:03 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1049486614' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:05:04.376 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:04 smithi112 ceph-mon[109687]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:04.377 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:04 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"} : dispatch 2024-09-21T01:05:04.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:04 smithi187 ceph-mon[78584]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:04.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:04 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"} : dispatch 2024-09-21T01:05:05.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:05 smithi187 ceph-mon[78584]: pgmap v263: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 1 op/s 2024-09-21T01:05:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:05 smithi112 ceph-mon[109687]: pgmap v263: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 1 op/s 2024-09-21T01:05:07.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:07 smithi112 ceph-mon[109687]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 1 op/s 2024-09-21T01:05:07.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:07 smithi187 ceph-mon[78584]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 1 op/s 2024-09-21T01:05:09.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:09 smithi187 ceph-mon[78584]: pgmap v265: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 3 op/s 2024-09-21T01:05:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:09 smithi112 ceph-mon[109687]: pgmap v265: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 3 op/s 2024-09-21T01:05:11.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:11 smithi187 ceph-mon[78584]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-21T01:05:11.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:11 smithi112 ceph-mon[109687]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-21T01:05:12.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:12 smithi112 ceph-mon[109687]: reconnect by client.24343 192.168.0.1:0/2267224782 after 0.000999984 2024-09-21T01:05:12.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:12 smithi112 ceph-mon[109687]: reconnect by client.14630 192.168.0.1:0/3559983563 after 0.000999984 2024-09-21T01:05:12.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:12 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:reconnect 2024-09-21T01:05:12.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:12 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi187.cdcgvm=up:reconnect} 2 up:standby 2024-09-21T01:05:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:12 smithi187 ceph-mon[78584]: reconnect by client.24343 192.168.0.1:0/2267224782 after 0.000999984 2024-09-21T01:05:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:12 smithi187 ceph-mon[78584]: reconnect by client.14630 192.168.0.1:0/3559983563 after 0.000999984 2024-09-21T01:05:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:12 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:reconnect 2024-09-21T01:05:12.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:12 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi187.cdcgvm=up:reconnect} 2 up:standby 2024-09-21T01:05:13.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:13 smithi112 ceph-mon[109687]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-21T01:05:13.376 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:13 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:rejoin 2024-09-21T01:05:13.376 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:13 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi187.cdcgvm=up:rejoin} 2 up:standby 2024-09-21T01:05:13.376 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:13 smithi112 ceph-mon[109687]: daemon mds.cephfs.smithi187.cdcgvm is now active in filesystem cephfs as rank 0 2024-09-21T01:05:13.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:13 smithi187 ceph-mon[78584]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-21T01:05:13.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:13 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:rejoin 2024-09-21T01:05:13.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:13 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi187.cdcgvm=up:rejoin} 2 up:standby 2024-09-21T01:05:13.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:13 smithi187 ceph-mon[78584]: daemon mds.cephfs.smithi187.cdcgvm is now active in filesystem cephfs as rank 0 2024-09-21T01:05:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:05:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:active 2024-09-21T01:05:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.112:6828/428821401,v1:172.21.15.112:6829/428821401] up:boot 2024-09-21T01:05:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi187.cdcgvm=up:active} 3 up:standby 2024-09-21T01:05:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"} : dispatch 2024-09-21T01:05:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:14.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:14.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:14.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:05:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6824/3413694617,v1:172.21.15.187:6825/3413694617] up:active 2024-09-21T01:05:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.112:6828/428821401,v1:172.21.15.112:6829/428821401] up:boot 2024-09-21T01:05:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi187.cdcgvm=up:active} 3 up:standby 2024-09-21T01:05:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.ngfvvg"} : dispatch 2024-09-21T01:05:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:14.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:15.506 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:15 smithi112 ceph-mon[109687]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 188 B/s wr, 8 op/s 2024-09-21T01:05:15.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:15 smithi187 ceph-mon[78584]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 188 B/s wr, 8 op/s 2024-09-21T01:05:17.332 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:17 smithi112 ceph-mon[109687]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T01:05:17.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:17 smithi187 ceph-mon[78584]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T01:05:19.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:19 smithi112 ceph-mon[109687]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:05:19.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:19 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:19.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:19 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:19.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:19 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:19.213 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:19 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:19.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:19 smithi187 ceph-mon[78584]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:05:19.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:19 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:19.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:19 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:19.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:19 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:19.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:19 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:21.239 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:21 smithi112 ceph-mon[109687]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-21T01:05:21.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:21 smithi187 ceph-mon[78584]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-21T01:05:23.003 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.4 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T01:05:23.003 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:23.003 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:23.003 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:23.003 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:23.003 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:23.003 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.4 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T01:05:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:23.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:23.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:23.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:23.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:23.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:23.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:23.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:23 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:23.364 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:23.365 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:23.365 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:23.365 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:23 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:24 smithi187 ceph-mon[78584]: Upgrade: Updating mds.cephfs.smithi187.cdcgvm 2024-09-21T01:05:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.cdcgvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:05:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:24 smithi187 ceph-mon[78584]: Deploying daemon mds.cephfs.smithi187.cdcgvm on smithi187 2024-09-21T01:05:24.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:24 smithi187 ceph-mon[78584]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.4 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T01:05:24.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:24 smithi112 ceph-mon[109687]: Upgrade: Updating mds.cephfs.smithi187.cdcgvm 2024-09-21T01:05:24.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:24.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.cdcgvm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:05:24.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:24.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:24 smithi112 ceph-mon[109687]: Deploying daemon mds.cephfs.smithi187.cdcgvm on smithi187 2024-09-21T01:05:24.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:24 smithi112 ceph-mon[109687]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.4 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T01:05:25.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:25 smithi187 ceph-mon[78584]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:05:25.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:25 smithi187 ceph-mon[78584]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:25.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:25 smithi187 ceph-mon[78584]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T01:05:25.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:25 smithi187 ceph-mon[78584]: Standby daemon mds.cephfs.smithi187.osicpg assigned to filesystem cephfs as rank 0 2024-09-21T01:05:25.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:25 smithi187 ceph-mon[78584]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:05:25.578 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:25 smithi187 ceph-mon[78584]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T01:05:25.579 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:25 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi187.osicpg=up:replay} 2 up:standby 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[109683]: 2024-09-21T01:05:25.325+0000 7fab6681d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-mon[109687]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-mon[109687]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-mon[109687]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-mon[109687]: Standby daemon mds.cephfs.smithi187.osicpg assigned to filesystem cephfs as rank 0 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-mon[109687]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-mon[109687]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T01:05:25.662 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:25 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi187.osicpg=up:replay} 2 up:standby 2024-09-21T01:05:26.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:26 smithi187 ceph-mon[78584]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-21T01:05:26.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:26 smithi112 ceph-mon[109687]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-21T01:05:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:28 smithi112 ceph-mon[109687]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-21T01:05:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:29.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:29.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:28 smithi187 ceph-mon[78584]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-21T01:05:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:29.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:31.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:30 smithi112 ceph-mon[109687]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-21T01:05:31.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:30 smithi187 ceph-mon[78584]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-21T01:05:33.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:32 smithi112 ceph-mon[109687]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 -- 172.21.15.112:0/79102138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc103400 msgr2=0x7f4ecc10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/79102138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc103400 0x7f4ecc10b8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009880 tx=0x7f4eb802a530 comp rx=0 tx=0).stop 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 -- 172.21.15.112:0/79102138 shutdown_connections 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/79102138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc103400 0x7f4ecc10b8f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/79102138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ecc102ae0 0x7f4ecc102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 -- 172.21.15.112:0/79102138 >> 172.21.15.112:0/79102138 conn(0x7f4ecc0fc520 msgr2=0x7f4ecc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 -- 172.21.15.112:0/79102138 shutdown_connections 2024-09-21T01:05:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.024+0000 7f4ed2f10640 1 -- 172.21.15.112:0/79102138 wait complete. 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed2f10640 1 Processor -- start 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed2f10640 1 -- start start 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed2f10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102ae0 0x7f4ecc073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed2f10640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ecc103400 0x7f4ecc06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed2f10640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc10ee10 con 0x7f4ecc102ae0 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed2f10640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc10ec90 con 0x7f4ecc103400 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed0cac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102ae0 0x7f4ecc073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed0cac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102ae0 0x7f4ecc073d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34336/0 (socket says 172.21.15.112:34336) 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ed0cac640 1 -- 172.21.15.112:0/2058567816 learned_addr learned my addr 172.21.15.112:0/2058567816 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.025+0000 7f4ecbfff640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ecc103400 0x7f4ecc06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ed0cac640 1 -- 172.21.15.112:0/2058567816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ecc103400 msgr2=0x7f4ecc06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ed0cac640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ecc103400 0x7f4ecc06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ed0cac640 1 -- 172.21.15.112:0/2058567816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc06c220 con 0x7f4ecc102ae0 2024-09-21T01:05:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ed0cac640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102ae0 0x7f4ecc073d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000d6f0 tx=0x7f4ec000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ec9ffb640 1 -- 172.21.15.112:0/2058567816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ec0017070 con 0x7f4ecc102ae0 2024-09-21T01:05:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc06c510 con 0x7f4ecc102ae0 2024-09-21T01:05:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ec9ffb640 1 -- 172.21.15.112:0/2058567816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ec000de00 con 0x7f4ecc102ae0 2024-09-21T01:05:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.026+0000 7f4ec9ffb640 1 -- 172.21.15.112:0/2058567816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ec0004bb0 con 0x7f4ecc102ae0 2024-09-21T01:05:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.027+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc06ca70 con 0x7f4ecc102ae0 2024-09-21T01:05:33.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.027+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc06abe0 con 0x7f4ecc102ae0 2024-09-21T01:05:33.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.028+0000 7f4ec9ffb640 1 -- 172.21.15.112:0/2058567816 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4ec0009a30 con 0x7f4ecc102ae0 2024-09-21T01:05:33.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.028+0000 7f4ec9ffb640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4ebc07af80 0x7f4ebc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.029+0000 7f4ec9ffb640 1 -- 172.21.15.112:0/2058567816 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f4ec009db70 con 0x7f4ecc102ae0 2024-09-21T01:05:33.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.029+0000 7f4ecbfff640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4ebc07af80 0x7f4ebc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.029+0000 7f4ecbfff640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4ebc07af80 0x7f4ebc07d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc06d530 tx=0x7f4eb8031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.033+0000 7f4ec9ffb640 1 -- 172.21.15.112:0/2058567816 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ec0069140 con 0x7f4ecc102ae0 2024-09-21T01:05:33.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:32 smithi187 ceph-mon[78584]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-21T01:05:33.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.230+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ecc062630 con 0x7f4ebc07af80 2024-09-21T01:05:33.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.231+0000 7f4ec9ffb640 1 -- 172.21.15.112:0/2058567816 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4ecc062630 con 0x7f4ebc07af80 2024-09-21T01:05:33.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4ebc07af80 msgr2=0x7f4ebc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4ebc07af80 0x7f4ebc07d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc06d530 tx=0x7f4eb8031400 comp rx=0 tx=0).stop 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102ae0 msgr2=0x7f4ecc073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102ae0 0x7f4ecc073d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000d6f0 tx=0x7f4ec000dbb0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 shutdown_connections 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4ebc07af80 0x7f4ebc07d440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ecc103400 0x7f4ecc06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 --2- 172.21.15.112:0/2058567816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102ae0 0x7f4ecc073d10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 >> 172.21.15.112:0/2058567816 conn(0x7f4ecc0fc520 msgr2=0x7f4ecc108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 shutdown_connections 2024-09-21T01:05:33.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.234+0000 7f4ed2f10640 1 -- 172.21.15.112:0/2058567816 wait complete. 2024-09-21T01:05:33.243 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 -- 172.21.15.112:0/1964730654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604107930 msgr2=0x7f8604107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 --2- 172.21.15.112:0/1964730654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604107930 0x7f8604107d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009c20 tx=0x7f85fc02a970 comp rx=0 tx=0).stop 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 -- 172.21.15.112:0/1964730654 shutdown_connections 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 --2- 172.21.15.112:0/1964730654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8604101930 0x7f8604101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 --2- 172.21.15.112:0/1964730654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604107930 0x7f8604107d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 -- 172.21.15.112:0/1964730654 >> 172.21.15.112:0/1964730654 conn(0x7f86040fd630 msgr2=0x7f86040ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 -- 172.21.15.112:0/1964730654 shutdown_connections 2024-09-21T01:05:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.317+0000 7f86097bd640 1 -- 172.21.15.112:0/1964730654 wait complete. 2024-09-21T01:05:33.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f86097bd640 1 Processor -- start 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f86097bd640 1 -- start start 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f86097bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604101930 0x7f860419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f86097bd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8604107930 0x7f860419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f86097bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f860410ede0 con 0x7f8604101930 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f86097bd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f860410ec60 con 0x7f8604107930 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f8602ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604101930 0x7f860419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f8602ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604101930 0x7f860419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34360/0 (socket says 172.21.15.112:34360) 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f8602ffd640 1 -- 172.21.15.112:0/2713675955 learned_addr learned my addr 172.21.15.112:0/2713675955 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.318+0000 7f86027fc640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8604107930 0x7f860419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f8602ffd640 1 -- 172.21.15.112:0/2713675955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8604107930 msgr2=0x7f860419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f8602ffd640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8604107930 0x7f860419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f8602ffd640 1 -- 172.21.15.112:0/2713675955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8604197810 con 0x7f8604101930 2024-09-21T01:05:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f8602ffd640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604101930 0x7f860419d690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85fc02ae90 tx=0x7f85fc02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f85fbfff640 1 -- 172.21.15.112:0/2713675955 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85fc047070 con 0x7f8604101930 2024-09-21T01:05:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8604197aa0 con 0x7f8604101930 2024-09-21T01:05:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f85fbfff640 1 -- 172.21.15.112:0/2713675955 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85fc02f7e0 con 0x7f8604101930 2024-09-21T01:05:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.319+0000 7f85fbfff640 1 -- 172.21.15.112:0/2713675955 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85fc034070 con 0x7f8604101930 2024-09-21T01:05:33.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.320+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8604197fd0 con 0x7f8604101930 2024-09-21T01:05:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.321+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8604103070 con 0x7f8604101930 2024-09-21T01:05:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.321+0000 7f85fbfff640 1 -- 172.21.15.112:0/2713675955 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f85fc04a070 con 0x7f8604101930 2024-09-21T01:05:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.322+0000 7f85fbfff640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85f007af30 0x7f85f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.322+0000 7f86027fc640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85f007af30 0x7f85f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.322+0000 7f85fbfff640 1 -- 172.21.15.112:0/2713675955 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f85fc0bedf0 con 0x7f8604101930 2024-09-21T01:05:33.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.322+0000 7f86027fc640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85f007af30 0x7f85f007d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8604100d40 tx=0x7f85ec00b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.326+0000 7f85fbfff640 1 -- 172.21.15.112:0/2713675955 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85fc03f070 con 0x7f8604101930 2024-09-21T01:05:33.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.520+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8604198280 con 0x7f85f007af30 2024-09-21T01:05:33.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.521+0000 7f85fbfff640 1 -- 172.21.15.112:0/2713675955 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f8604198280 con 0x7f85f007af30 2024-09-21T01:05:33.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85f007af30 msgr2=0x7f85f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85f007af30 0x7f85f007d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8604100d40 tx=0x7f85ec00b390 comp rx=0 tx=0).stop 2024-09-21T01:05:33.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604101930 msgr2=0x7f860419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604101930 0x7f860419d690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f85fc02ae90 tx=0x7f85fc02f5f0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 shutdown_connections 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f85f007af30 0x7f85f007d3f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8604107930 0x7f860419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 --2- 172.21.15.112:0/2713675955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8604101930 0x7f860419d690 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 >> 172.21.15.112:0/2713675955 conn(0x7f86040fd630 msgr2=0x7f86040fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 shutdown_connections 2024-09-21T01:05:33.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.524+0000 7f86097bd640 1 -- 172.21.15.112:0/2713675955 wait complete. 2024-09-21T01:05:33.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 -- 172.21.15.112:0/2813424407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 msgr2=0x7feee8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 --2- 172.21.15.112:0/2813424407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee8106bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feed8009880 tx=0x7feed802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 -- 172.21.15.112:0/2813424407 shutdown_connections 2024-09-21T01:05:33.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 --2- 172.21.15.112:0/2813424407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feee81007e0 0x7feee8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 --2- 172.21.15.112:0/2813424407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee8106bc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 -- 172.21.15.112:0/2813424407 >> 172.21.15.112:0/2813424407 conn(0x7feee80fc4c0 msgr2=0x7feee80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:33.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 -- 172.21.15.112:0/2813424407 shutdown_connections 2024-09-21T01:05:33.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 -- 172.21.15.112:0/2813424407 wait complete. 2024-09-21T01:05:33.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.605+0000 7feeef7d4640 1 Processor -- start 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeef7d4640 1 -- start start 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeef7d4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feee81007e0 0x7feee819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeef7d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeef7d4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feee810dc90 con 0x7feee81067e0 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeef7d4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7feee810db10 con 0x7feee81007e0 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeecd6f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeecd6f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34378/0 (socket says 172.21.15.112:34378) 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeecd6f640 1 -- 172.21.15.112:0/501154065 learned_addr learned my addr 172.21.15.112:0/501154065 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeed570640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feee81007e0 0x7feee819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeecd6f640 1 -- 172.21.15.112:0/501154065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feee81007e0 msgr2=0x7feee819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeecd6f640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feee81007e0 0x7feee819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeecd6f640 1 -- 172.21.15.112:0/501154065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee8197750 con 0x7feee81067e0 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.606+0000 7feeecd6f640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee819dbc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feee400d8d0 tx=0x7feee400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.607+0000 7feede7fc640 1 -- 172.21.15.112:0/501154065 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feee4017030 con 0x7feee81067e0 2024-09-21T01:05:33.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.607+0000 7feede7fc640 1 -- 172.21.15.112:0/501154065 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feee4004020 con 0x7feee81067e0 2024-09-21T01:05:33.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.607+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee8197a40 con 0x7feee81067e0 2024-09-21T01:05:33.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.607+0000 7feede7fc640 1 -- 172.21.15.112:0/501154065 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feee40047a0 con 0x7feee81067e0 2024-09-21T01:05:33.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.607+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee8197fa0 con 0x7feee81067e0 2024-09-21T01:05:33.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.608+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee8101f20 con 0x7feee81067e0 2024-09-21T01:05:33.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.609+0000 7feede7fc640 1 -- 172.21.15.112:0/501154065 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7feee40041d0 con 0x7feee81067e0 2024-09-21T01:05:33.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.609+0000 7feede7fc640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feed407af30 0x7feed407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.609+0000 7feeed570640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feed407af30 0x7feed407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.609+0000 7feede7fc640 1 -- 172.21.15.112:0/501154065 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7feee4018070 con 0x7feee81067e0 2024-09-21T01:05:33.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.610+0000 7feeed570640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feed407af30 0x7feed407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed80096c0 tx=0x7feed8031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.614+0000 7feede7fc640 1 -- 172.21.15.112:0/501154065 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feee4069380 con 0x7feee81067e0 2024-09-21T01:05:33.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.799+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7feee81982b0 con 0x7feed407af30 2024-09-21T01:05:33.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.809+0000 7feede7fc640 1 -- 172.21.15.112:0/501154065 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7feee81982b0 con 0x7feed407af30 2024-09-21T01:05:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:05:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (6m) 15s ago 16m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (9m) 15s ago 17m 9122k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (8m) 55s ago 16m 8602k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (4m) 15s ago 17m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (4m) 55s ago 16m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (5m) 15s ago 16m 80.5M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (21s) 15s ago 11m 80.3M - 19.3.0-5120-g18432218 ddce307e1f32 077f4f3983b0 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (44s) 15s ago 11m 81.0M - 19.3.0-5120-g18432218 ddce307e1f32 af0746f04a0d 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (11m) 55s ago 11m 21.3M - 19.1.1-373-g4e45e6b4 164465d2334a 3785dbc814a8 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (11m) 55s ago 11m 19.5M - 19.1.1-373-g4e45e6b4 164465d2334a b728f9d8a98e 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (8m) 15s ago 18m 597M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (7m) 55s ago 16m 523M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (4m) 15s ago 18m 116M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (4m) 55s ago 16m 105M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:05:33.810 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 15s ago 17m 11.7M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (6m) 55s ago 16m 11.1M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (3m) 15s ago 14m 158M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (3m) 15s ago 14m 165M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (2m) 15s ago 13m 158M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (2m) 55s ago 13m 173M 2240M 19.3.0-5120-g18432218 ddce307e1f32 ea28f02f247b 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (91s) 55s ago 13m 162M 2240M 19.3.0-5120-g18432218 ddce307e1f32 21ee55f89a04 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (58s) 55s ago 12m 78.9M 2240M 19.3.0-5120-g18432218 ddce307e1f32 5c353aaf7054 2024-09-21T01:05:33.811 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (6m) 15s ago 16m 56.2M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feed407af30 msgr2=0x7feed407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feed407af30 0x7feed407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed80096c0 tx=0x7feed8031400 comp rx=0 tx=0).stop 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 msgr2=0x7feee819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee819dbc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feee400d8d0 tx=0x7feee400dd90 comp rx=0 tx=0).stop 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 shutdown_connections 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feed407af30 0x7feed407d3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feee81067e0 0x7feee819dbc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 --2- 172.21.15.112:0/501154065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feee81007e0 0x7feee819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 >> 172.21.15.112:0/501154065 conn(0x7feee80fc4c0 msgr2=0x7feee8069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 shutdown_connections 2024-09-21T01:05:33.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.811+0000 7feeef7d4640 1 -- 172.21.15.112:0/501154065 wait complete. 2024-09-21T01:05:33.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/3917038220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78101930 msgr2=0x7f4c78101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/3917038220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78101930 0x7f4c78101d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009c20 tx=0x7f4c6c02a970 comp rx=0 tx=0).stop 2024-09-21T01:05:33.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/3917038220 shutdown_connections 2024-09-21T01:05:33.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/3917038220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78101930 0x7f4c78101d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/3917038220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c78107930 0x7f4c78107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/3917038220 >> 172.21.15.112:0/3917038220 conn(0x7f4c780fd630 msgr2=0x7f4c780ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:33.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/3917038220 shutdown_connections 2024-09-21T01:05:33.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/3917038220 wait complete. 2024-09-21T01:05:33.892 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:33 smithi112 ceph-mon[109687]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.891+0000 7f4c7d6f4640 1 Processor -- start 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c7d6f4640 1 -- start start 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c7d6f4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c78101930 0x7f4c780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c7d6f4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78107930 0x7f4c78074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c7d6f4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7810ee00 con 0x7f4c78107930 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c7d6f4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7810ec80 con 0x7f4c78101930 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c767fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78107930 0x7f4c78074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c767fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78107930 0x7f4c78074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34396/0 (socket says 172.21.15.112:34396) 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c767fc640 1 -- 172.21.15.112:0/4260869972 learned_addr learned my addr 172.21.15.112:0/4260869972 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:33.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c76ffd640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c78101930 0x7f4c780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c767fc640 1 -- 172.21.15.112:0/4260869972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c78101930 msgr2=0x7f4c780744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c767fc640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c78101930 0x7f4c780744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c767fc640 1 -- 172.21.15.112:0/4260869972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c78074f70 con 0x7f4c78107930 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.892+0000 7f4c767fc640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78107930 0x7f4c78074a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c02ae90 tx=0x7f4c6c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.893+0000 7f4c5ffff640 1 -- 172.21.15.112:0/4260869972 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c6c047070 con 0x7f4c78107930 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.893+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c78075200 con 0x7f4c78107930 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.893+0000 7f4c5ffff640 1 -- 172.21.15.112:0/4260869972 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c6c02f7e0 con 0x7f4c78107930 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.893+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c781a3dd0 con 0x7f4c78107930 2024-09-21T01:05:33.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.893+0000 7f4c5ffff640 1 -- 172.21.15.112:0/4260869972 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c6c034070 con 0x7f4c78107930 2024-09-21T01:05:33.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.894+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c78103070 con 0x7f4c78107930 2024-09-21T01:05:33.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.894+0000 7f4c5ffff640 1 -- 172.21.15.112:0/4260869972 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f4c6c04a070 con 0x7f4c78107930 2024-09-21T01:05:33.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.895+0000 7f4c5ffff640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4c6007af30 0x7f4c6007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:33.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.895+0000 7f4c76ffd640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4c6007af30 0x7f4c6007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:33.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.895+0000 7f4c5ffff640 1 -- 172.21.15.112:0/4260869972 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f4c6c0bedf0 con 0x7f4c78107930 2024-09-21T01:05:33.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.896+0000 7f4c76ffd640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4c6007af30 0x7f4c6007d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c70005fd0 tx=0x7f4c7000b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:33.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:33.900+0000 7f4c5ffff640 1 -- 172.21.15.112:0/4260869972 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c6c03f070 con 0x7f4c78107930 2024-09-21T01:05:34.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.152+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4c78075a20 con 0x7f4c78107930 2024-09-21T01:05:34.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.153+0000 7f4c5ffff640 1 -- 172.21.15.112:0/4260869972 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f4c6c08a340 con 0x7f4c78107930 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 6 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:34.154 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 12 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:05:34.155 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4c6007af30 msgr2=0x7f4c6007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4c6007af30 0x7f4c6007d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c70005fd0 tx=0x7f4c7000b390 comp rx=0 tx=0).stop 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78107930 msgr2=0x7f4c78074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78107930 0x7f4c78074a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c02ae90 tx=0x7f4c6c02f5f0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 shutdown_connections 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f4c6007af30 0x7f4c6007d3f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c78107930 0x7f4c78074a30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 --2- 172.21.15.112:0/4260869972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c78101930 0x7f4c780744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 >> 172.21.15.112:0/4260869972 conn(0x7f4c780fd630 msgr2=0x7f4c780fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:34.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 shutdown_connections 2024-09-21T01:05:34.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.155+0000 7f4c7d6f4640 1 -- 172.21.15.112:0/4260869972 wait complete. 2024-09-21T01:05:34.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:33 smithi187 ceph-mon[78584]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:34.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.236+0000 7fb743440640 1 -- 172.21.15.112:0/1299012139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 msgr2=0x7fb73c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.236+0000 7fb743440640 1 --2- 172.21.15.112:0/1299012139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c102ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb738009880 tx=0x7fb73802a530 comp rx=0 tx=0).stop 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 -- 172.21.15.112:0/1299012139 shutdown_connections 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 --2- 172.21.15.112:0/1299012139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb73c103400 0x7fb73c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 --2- 172.21.15.112:0/1299012139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c102ec0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 -- 172.21.15.112:0/1299012139 >> 172.21.15.112:0/1299012139 conn(0x7fb73c0fc520 msgr2=0x7fb73c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 -- 172.21.15.112:0/1299012139 shutdown_connections 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 -- 172.21.15.112:0/1299012139 wait complete. 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 Processor -- start 2024-09-21T01:05:34.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 -- start start 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb73c103400 0x7fb73c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c10ee70 con 0x7fb73c102ae0 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.237+0000 7fb743440640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c10ecf0 con 0x7fb73c103400 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7411dc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7411dc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34424/0 (socket says 172.21.15.112:34424) 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7411dc640 1 -- 172.21.15.112:0/2771805155 learned_addr learned my addr 172.21.15.112:0/2771805155 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7409db640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb73c103400 0x7fb73c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7411dc640 1 -- 172.21.15.112:0/2771805155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb73c103400 msgr2=0x7fb73c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7411dc640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb73c103400 0x7fb73c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7411dc640 1 -- 172.21.15.112:0/2771805155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c1011c0 con 0x7fb73c102ae0 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7411dc640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c100740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb738031460 tx=0x7fb7380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7327fc640 1 -- 172.21.15.112:0/2771805155 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb73803f070 con 0x7fb73c102ae0 2024-09-21T01:05:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7327fc640 1 -- 172.21.15.112:0/2771805155 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb738004cf0 con 0x7fb73c102ae0 2024-09-21T01:05:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73c101450 con 0x7fb73c102ae0 2024-09-21T01:05:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb7327fc640 1 -- 172.21.15.112:0/2771805155 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb738035030 con 0x7fb73c102ae0 2024-09-21T01:05:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.238+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73c1a3e60 con 0x7fb73c102ae0 2024-09-21T01:05:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.239+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73c06abe0 con 0x7fb73c102ae0 2024-09-21T01:05:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.240+0000 7fb7327fc640 1 -- 172.21.15.112:0/2771805155 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb738042070 con 0x7fb73c102ae0 2024-09-21T01:05:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.240+0000 7fb7327fc640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb72807af30 0x7fb72807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.241+0000 7fb7327fc640 1 -- 172.21.15.112:0/2771805155 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fb7380beb20 con 0x7fb73c102ae0 2024-09-21T01:05:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.241+0000 7fb7409db640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb72807af30 0x7fb72807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.241+0000 7fb7409db640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb72807af30 0x7fb72807d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb73c1021d0 tx=0x7fb72c009060 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:34.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.245+0000 7fb7327fc640 1 -- 172.21.15.112:0/2771805155 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb73808a070 con 0x7fb73c102ae0 2024-09-21T01:05:34.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.460+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb73c105fb0 con 0x7fb73c102ae0 2024-09-21T01:05:34.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.460+0000 7fb7327fc640 1 -- 172.21.15.112:0/2771805155 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1832 (secure 0 0 0) 0x7fb73808ef20 con 0x7fb73c102ae0 2024-09-21T01:05:34.461 INFO:teuthology.orchestra.run.smithi112.stdout:e24 2024-09-21T01:05:34.461 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T01:05:25:333148+0000 2024-09-21T01:05:34.461 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:05:34.461 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:05:34.461 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:05:34.461 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 24 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T01:05:25.333126+0000 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:05:34.462 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 79 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=24319} 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:05:34.463 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 0 members: 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{0:24319} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:05:34.464 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6828/428821401,v1:172.21.15.112:6829/428821401] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:05:34.465 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2024-09-21T01:05:34.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.462+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb72807af30 msgr2=0x7fb72807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.462+0000 7fb743440640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb72807af30 0x7fb72807d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb73c1021d0 tx=0x7fb72c009060 comp rx=0 tx=0).stop 2024-09-21T01:05:34.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.462+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 msgr2=0x7fb73c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.462+0000 7fb743440640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c100740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb738031460 tx=0x7fb7380048f0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.463+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 shutdown_connections 2024-09-21T01:05:34.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.463+0000 7fb743440640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb72807af30 0x7fb72807d3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.463+0000 7fb743440640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb73c103400 0x7fb73c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.463+0000 7fb743440640 1 --2- 172.21.15.112:0/2771805155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb73c102ae0 0x7fb73c100740 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.463+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 >> 172.21.15.112:0/2771805155 conn(0x7fb73c0fc520 msgr2=0x7fb73c108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:34.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.463+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 shutdown_connections 2024-09-21T01:05:34.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.463+0000 7fb743440640 1 -- 172.21.15.112:0/2771805155 wait complete. 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 -- 172.21.15.112:0/977789155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 msgr2=0x7fed64107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/977789155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed64107cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fed54009880 tx=0x7fed5402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 -- 172.21.15.112:0/977789155 shutdown_connections 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/977789155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed64101910 0x7fed64101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/977789155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed64107cf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 -- 172.21.15.112:0/977789155 >> 172.21.15.112:0/977789155 conn(0x7fed640fd630 msgr2=0x7fed640ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 -- 172.21.15.112:0/977789155 shutdown_connections 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 -- 172.21.15.112:0/977789155 wait complete. 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 Processor -- start 2024-09-21T01:05:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.545+0000 7fed6aaa7640 1 -- start start 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed6aaa7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed64101910 0x7fed6419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed6aaa7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed6419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed6aaa7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed6410ede0 con 0x7fed64107910 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed6aaa7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fed6410ec60 con 0x7fed64101910 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed63fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed6419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed63fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed6419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34442/0 (socket says 172.21.15.112:34442) 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed63fff640 1 -- 172.21.15.112:0/4180143636 learned_addr learned my addr 172.21.15.112:0/4180143636 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed68843640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed64101910 0x7fed6419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed63fff640 1 -- 172.21.15.112:0/4180143636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed64101910 msgr2=0x7fed6419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed63fff640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed64101910 0x7fed6419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed63fff640 1 -- 172.21.15.112:0/4180143636 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed641977d0 con 0x7fed64107910 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed63fff640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed6419db90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed5800ea00 tx=0x7fed5800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed61ffb640 1 -- 172.21.15.112:0/4180143636 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed5800cb80 con 0x7fed64107910 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed61ffb640 1 -- 172.21.15.112:0/4180143636 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed5800cd20 con 0x7fed64107910 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed64197ac0 con 0x7fed64107910 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.546+0000 7fed61ffb640 1 -- 172.21.15.112:0/4180143636 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed58011470 con 0x7fed64107910 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.547+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed64198050 con 0x7fed64107910 2024-09-21T01:05:34.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.548+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed64103050 con 0x7fed64107910 2024-09-21T01:05:34.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.548+0000 7fed61ffb640 1 -- 172.21.15.112:0/4180143636 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fed58011750 con 0x7fed64107910 2024-09-21T01:05:34.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.549+0000 7fed61ffb640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed4c07af30 0x7fed4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.549+0000 7fed61ffb640 1 -- 172.21.15.112:0/4180143636 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fed5809e4e0 con 0x7fed64107910 2024-09-21T01:05:34.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.549+0000 7fed68843640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed4c07af30 0x7fed4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.549+0000 7fed68843640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed4c07af30 0x7fed4c07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed540096c0 tx=0x7fed54031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:34.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.554+0000 7fed61ffb640 1 -- 172.21.15.112:0/4180143636 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed58016030 con 0x7fed64107910 2024-09-21T01:05:34.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.751+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fed64198360 con 0x7fed4c07af30 2024-09-21T01:05:34.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.753+0000 7fed61ffb640 1 -- 172.21.15.112:0/4180143636 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fed64198360 con 0x7fed4c07af30 2024-09-21T01:05:34.753 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:05:34.753 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "osd", 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr", 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "mon" 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "14/23 daemons upgraded", 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:05:34.754 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed4c07af30 msgr2=0x7fed4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed4c07af30 0x7fed4c07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed540096c0 tx=0x7fed54031400 comp rx=0 tx=0).stop 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 msgr2=0x7fed6419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed6419db90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed5800ea00 tx=0x7fed5800eec0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 shutdown_connections 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed4c07af30 0x7fed4c07d3f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed64107910 0x7fed6419db90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 --2- 172.21.15.112:0/4180143636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed64101910 0x7fed6419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 >> 172.21.15.112:0/4180143636 conn(0x7fed640fd630 msgr2=0x7fed640fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 shutdown_connections 2024-09-21T01:05:34.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.755+0000 7fed6aaa7640 1 -- 172.21.15.112:0/4180143636 wait complete. 2024-09-21T01:05:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/2100505102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88106820 msgr2=0x7f9b88106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/2100505102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88106820 0x7f9b88106c00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009880 tx=0x7f9b7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/2100505102 shutdown_connections 2024-09-21T01:05:34.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/2100505102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b88100820 0x7f9b88100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/2100505102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88106820 0x7f9b88106c00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/2100505102 >> 172.21.15.112:0/2100505102 conn(0x7f9b880fc520 msgr2=0x7f9b880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/2100505102 shutdown_connections 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/2100505102 wait complete. 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 Processor -- start 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.836+0000 7f9b8fdd3640 1 -- start start 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8fdd3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88100820 0x7f9b88198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8fdd3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b88106820 0x7f9b88198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8fdd3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8810dd50 con 0x7f9b88100820 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8fdd3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8810dbd0 con 0x7f9b88106820 2024-09-21T01:05:34.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8db6f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88100820 0x7f9b88198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8db6f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88100820 0x7f9b88198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34470/0 (socket says 172.21.15.112:34470) 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8db6f640 1 -- 172.21.15.112:0/638172554 learned_addr learned my addr 172.21.15.112:0/638172554 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8d36e640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b88106820 0x7f9b88198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8db6f640 1 -- 172.21.15.112:0/638172554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b88106820 msgr2=0x7f9b88198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8db6f640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b88106820 0x7f9b88198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8db6f640 1 -- 172.21.15.112:0/638172554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b881993a0 con 0x7f9b88100820 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8db6f640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88100820 0x7f9b88198860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c031460 tx=0x7f9b7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b7affd640 1 -- 172.21.15.112:0/638172554 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b7c03f070 con 0x7f9b88100820 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b88199630 con 0x7f9b88100820 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b7affd640 1 -- 172.21.15.112:0/638172554 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b7c004cf0 con 0x7f9b88100820 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.837+0000 7f9b7affd640 1 -- 172.21.15.112:0/638172554 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b7c035030 con 0x7f9b88100820 2024-09-21T01:05:34.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.838+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b881a1be0 con 0x7f9b88100820 2024-09-21T01:05:34.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.839+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b88101f60 con 0x7f9b88100820 2024-09-21T01:05:34.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.839+0000 7f9b7affd640 1 -- 172.21.15.112:0/638172554 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9b7c042070 con 0x7f9b88100820 2024-09-21T01:05:34.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.840+0000 7f9b7affd640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9b7407af30 0x7f9b7407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:34.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.840+0000 7f9b7affd640 1 -- 172.21.15.112:0/638172554 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f9b7c0beb40 con 0x7f9b88100820 2024-09-21T01:05:34.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.840+0000 7f9b8d36e640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9b7407af30 0x7f9b7407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:34.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.840+0000 7f9b8d36e640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9b7407af30 0x7f9b7407d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b8806ae50 tx=0x7f9b84009110 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:34.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:34.845+0000 7f9b7affd640 1 -- 172.21.15.112:0/638172554 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b7c08a090 con 0x7f9b88100820 2024-09-21T01:05:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:34 smithi112 ceph-mon[109687]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:34 smithi112 ceph-mon[109687]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8 op/s 2024-09-21T01:05:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:34 smithi112 ceph-mon[109687]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:34 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4260869972' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:35.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:34 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2771805155' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:05:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.091+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9b88108d90 con 0x7f9b88100820 2024-09-21T01:05:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.092+0000 7f9b7affd640 1 -- 172.21.15.112:0/638172554 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7f9b7c08ef40 con 0x7f9b88100820 2024-09-21T01:05:35.093 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-21T01:05:35.093 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T01:05:35.093 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs is degraded 2024-09-21T01:05:35.093 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:05:35.093 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9b7407af30 msgr2=0x7f9b7407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9b7407af30 0x7f9b7407d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b8806ae50 tx=0x7f9b84009110 comp rx=0 tx=0).stop 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88100820 msgr2=0x7f9b88198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88100820 0x7f9b88198860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c031460 tx=0x7f9b7c0048f0 comp rx=0 tx=0).stop 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 shutdown_connections 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9b7407af30 0x7f9b7407d3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b88106820 0x7f9b88198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 --2- 172.21.15.112:0/638172554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b88100820 0x7f9b88198860 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 >> 172.21.15.112:0/638172554 conn(0x7f9b880fc520 msgr2=0x7f9b880fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 shutdown_connections 2024-09-21T01:05:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:05:35.094+0000 7f9b8fdd3640 1 -- 172.21.15.112:0/638172554 wait complete. 2024-09-21T01:05:35.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:34 smithi187 ceph-mon[78584]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:34 smithi187 ceph-mon[78584]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8 op/s 2024-09-21T01:05:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:34 smithi187 ceph-mon[78584]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:34 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4260869972' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:35.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:34 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2771805155' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:05:36.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:35 smithi112 ceph-mon[109687]: reconnect by client.24343 192.168.0.1:0/2267224782 after 0.000999985 2024-09-21T01:05:36.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:35 smithi112 ceph-mon[109687]: reconnect by client.14630 192.168.0.1:0/3559983563 after 0.000999985 2024-09-21T01:05:36.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:35 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:reconnect 2024-09-21T01:05:36.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:35 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi187.osicpg=up:reconnect} 2 up:standby 2024-09-21T01:05:36.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:35 smithi112 ceph-mon[109687]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:36.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:35 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/638172554' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:05:36.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:35 smithi187 ceph-mon[78584]: reconnect by client.24343 192.168.0.1:0/2267224782 after 0.000999985 2024-09-21T01:05:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:35 smithi187 ceph-mon[78584]: reconnect by client.14630 192.168.0.1:0/3559983563 after 0.000999985 2024-09-21T01:05:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:35 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:reconnect 2024-09-21T01:05:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:35 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi187.osicpg=up:reconnect} 2 up:standby 2024-09-21T01:05:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:35 smithi187 ceph-mon[78584]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:36.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:35 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/638172554' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:05:37.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:36 smithi112 ceph-mon[109687]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-09-21T01:05:37.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:36 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:rejoin 2024-09-21T01:05:37.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:36 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi187.osicpg=up:rejoin} 2 up:standby 2024-09-21T01:05:37.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:36 smithi112 ceph-mon[109687]: daemon mds.cephfs.smithi187.osicpg is now active in filesystem cephfs as rank 0 2024-09-21T01:05:37.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:36 smithi187 ceph-mon[78584]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-09-21T01:05:37.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:36 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:rejoin 2024-09-21T01:05:37.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:36 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi187.osicpg=up:rejoin} 2 up:standby 2024-09-21T01:05:37.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:36 smithi187 ceph-mon[78584]: daemon mds.cephfs.smithi187.osicpg is now active in filesystem cephfs as rank 0 2024-09-21T01:05:38.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:37 smithi112 ceph-mon[109687]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:05:38.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:37 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:active 2024-09-21T01:05:38.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:37 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi187.osicpg=up:active} 2 up:standby 2024-09-21T01:05:38.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:37 smithi187 ceph-mon[78584]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:05:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:37 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6826/1944064649,v1:172.21.15.187:6827/1944064649] up:active 2024-09-21T01:05:38.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:37 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi187.osicpg=up:active} 2 up:standby 2024-09-21T01:05:39.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:38 smithi112 ceph-mon[109687]: pgmap v281: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-09-21T01:05:39.089 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:38 smithi187 ceph-mon[78584]: pgmap v281: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-09-21T01:05:40.730 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:40 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:40.730 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:40 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:40.730 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:40 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:40.730 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:40 smithi187 ceph-mon[78584]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T01:05:40.730 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:40 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6824/2863682926,v1:172.21.15.187:6825/2863682926] up:boot 2024-09-21T01:05:40.730 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:40 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi187.osicpg=up:active} 3 up:standby 2024-09-21T01:05:40.730 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:40 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"} : dispatch 2024-09-21T01:05:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:40 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:40 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:40 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:40 smithi112 ceph-mon[109687]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T01:05:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:40 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6824/2863682926,v1:172.21.15.187:6825/2863682926] up:boot 2024-09-21T01:05:40.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:40 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi187.osicpg=up:active} 3 up:standby 2024-09-21T01:05:40.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:40 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi187.cdcgvm"} : dispatch 2024-09-21T01:05:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:42 smithi112 ceph-mon[109687]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T01:05:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:42 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:42 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:43.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:42 smithi187 ceph-mon[78584]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T01:05:43.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:42 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:43.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:42 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:44.301 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:44.301 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:44.301 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:44.301 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:44 smithi112 ceph-mon[109687]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-21T01:05:45.342 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:44 smithi187 ceph-mon[78584]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.0 KiB/s wr, 8 op/s 2024-09-21T01:05:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:05:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:47.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:47.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:47.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:47.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:47.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:47 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:05:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:47.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:47.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:47.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:47.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:47.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:47.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:47 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:05:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:48 smithi112 ceph-mon[109687]: Upgrade: Updating mds.cephfs.smithi187.osicpg 2024-09-21T01:05:48.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:48 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:48.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:48 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.osicpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:05:48.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:48 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:48.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:48 smithi112 ceph-mon[109687]: Deploying daemon mds.cephfs.smithi187.osicpg on smithi187 2024-09-21T01:05:48.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:48 smithi112 ceph-mon[109687]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:05:48.762 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:48 smithi187 ceph-mon[78584]: Upgrade: Updating mds.cephfs.smithi187.osicpg 2024-09-21T01:05:48.763 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:48 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:48.763 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:48 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi187.osicpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:05:48.763 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:48 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:48.763 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:48 smithi187 ceph-mon[78584]: Deploying daemon mds.cephfs.smithi187.osicpg on smithi187 2024-09-21T01:05:48.763 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:48 smithi187 ceph-mon[78584]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:05:49.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:49 smithi187 ceph-mon[78584]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:05:49.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:49 smithi187 ceph-mon[78584]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:49.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:49 smithi187 ceph-mon[78584]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T01:05:49.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:49 smithi187 ceph-mon[78584]: Standby daemon mds.cephfs.smithi112.yntrjn assigned to filesystem cephfs as rank 0 2024-09-21T01:05:49.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:49 smithi187 ceph-mon[78584]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:05:49.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:49 smithi187 ceph-mon[78584]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T01:05:49.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:49 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi112.yntrjn=up:replay} 2 up:standby 2024-09-21T01:05:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[109683]: 2024-09-21T01:05:49.359+0000 7fab6681d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-mon[109687]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:05:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-mon[109687]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:05:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-mon[109687]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T01:05:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-mon[109687]: Standby daemon mds.cephfs.smithi112.yntrjn assigned to filesystem cephfs as rank 0 2024-09-21T01:05:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-mon[109687]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:05:49.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-mon[109687]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T01:05:49.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:49 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi112.yntrjn=up:replay} 2 up:standby 2024-09-21T01:05:50.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:50 smithi112 ceph-mon[109687]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 4.6 KiB/s wr, 3 op/s 2024-09-21T01:05:50.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:50 smithi187 ceph-mon[78584]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 4.6 KiB/s wr, 3 op/s 2024-09-21T01:05:53.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:52 smithi112 ceph-mon[109687]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.6 KiB/s wr, 3 op/s 2024-09-21T01:05:53.060 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:52 smithi187 ceph-mon[78584]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.6 KiB/s wr, 3 op/s 2024-09-21T01:05:55.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:54 smithi112 ceph-mon[109687]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-21T01:05:55.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:54 smithi187 ceph-mon[78584]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-21T01:05:57.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:56 smithi112 ceph-mon[109687]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-21T01:05:57.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:56 smithi187 ceph-mon[78584]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-21T01:05:59.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:58 smithi112 ceph-mon[109687]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-21T01:05:59.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:59.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:59.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:59.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:59.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:05:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:59.085 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:58 smithi187 ceph-mon[78584]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-21T01:05:59.085 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:59.085 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:05:59.085 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:59.085 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:05:59.086 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:05:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:00.639 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:00 smithi187 ceph-mon[78584]: reconnect by client.14630 192.168.0.1:0/3559983563 after 0.000999974 2024-09-21T01:06:00.640 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:00 smithi187 ceph-mon[78584]: reconnect by client.24343 192.168.0.1:0/2267224782 after 0.00199995 2024-09-21T01:06:00.640 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:00 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.187:6826/749430440,v1:172.21.15.187:6827/749430440] up:boot 2024-09-21T01:06:00.640 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:00 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:reconnect 2024-09-21T01:06:00.640 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:00 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi112.yntrjn=up:reconnect} 3 up:standby 2024-09-21T01:06:00.640 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:00 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"} : dispatch 2024-09-21T01:06:00.640 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:00 smithi187 ceph-mon[78584]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-09-21T01:06:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:00 smithi112 ceph-mon[109687]: reconnect by client.14630 192.168.0.1:0/3559983563 after 0.000999974 2024-09-21T01:06:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:00 smithi112 ceph-mon[109687]: reconnect by client.24343 192.168.0.1:0/2267224782 after 0.00199995 2024-09-21T01:06:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:00 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.187:6826/749430440,v1:172.21.15.187:6827/749430440] up:boot 2024-09-21T01:06:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:00 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:reconnect 2024-09-21T01:06:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:00 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi112.yntrjn=up:reconnect} 3 up:standby 2024-09-21T01:06:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:00 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "mds metadata", "who": "cephfs.smithi187.osicpg"} : dispatch 2024-09-21T01:06:00.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:00 smithi112 ceph-mon[109687]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-09-21T01:06:01.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:01 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:rejoin 2024-09-21T01:06:01.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:01 smithi187 ceph-mon[78584]: fsmap cephfs:1/1 {0=cephfs.smithi112.yntrjn=up:rejoin} 3 up:standby 2024-09-21T01:06:01.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:01 smithi187 ceph-mon[78584]: daemon mds.cephfs.smithi112.yntrjn is now active in filesystem cephfs as rank 0 2024-09-21T01:06:01.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:01 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:01.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:01 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:01 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:rejoin 2024-09-21T01:06:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:01 smithi112 ceph-mon[109687]: fsmap cephfs:1/1 {0=cephfs.smithi112.yntrjn=up:rejoin} 3 up:standby 2024-09-21T01:06:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:01 smithi112 ceph-mon[109687]: daemon mds.cephfs.smithi112.yntrjn is now active in filesystem cephfs as rank 0 2024-09-21T01:06:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:01.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:01 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:02.518 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:02 smithi187 ceph-mon[78584]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:06:02.519 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:02 smithi187 ceph-mon[78584]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:active 2024-09-21T01:06:02.519 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:02 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T01:06:02.519 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:02 smithi187 ceph-mon[78584]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-21T01:06:02.519 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:02 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:02.519 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:02 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:02 smithi112 ceph-mon[109687]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:06:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:02 smithi112 ceph-mon[109687]: mds.? [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] up:active 2024-09-21T01:06:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:02 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T01:06:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:02 smithi112 ceph-mon[109687]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-21T01:06:02.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:02 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:02.761 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:02 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:04.837 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:04 smithi187 ceph-mon[78584]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:06:05.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:04 smithi112 ceph-mon[109687]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:06:05.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 -- 172.21.15.112:0/698566609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 msgr2=0x7f0400106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 --2- 172.21.15.112:0/698566609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f0400106d30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009880 tx=0x7f03fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 -- 172.21.15.112:0/698566609 shutdown_connections 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 --2- 172.21.15.112:0/698566609 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04000ffd70 0x7f04001001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 --2- 172.21.15.112:0/698566609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f0400106d30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 -- 172.21.15.112:0/698566609 >> 172.21.15.112:0/698566609 conn(0x7f04000fbc60 msgr2=0x7f04000fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 -- 172.21.15.112:0/698566609 shutdown_connections 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.183+0000 7f040859a640 1 -- 172.21.15.112:0/698566609 wait complete. 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f040859a640 1 Processor -- start 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f040859a640 1 -- start start 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f040859a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04000ffd70 0x7f040019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f040859a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f040019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f040859a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f040010eef0 con 0x7f0400106950 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f040859a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f040010ed70 con 0x7f04000ffd70 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0405b35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f040019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0405b35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f040019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38050/0 (socket says 172.21.15.112:38050) 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0405b35640 1 -- 172.21.15.112:0/2340031945 learned_addr learned my addr 172.21.15.112:0/2340031945 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0406336640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04000ffd70 0x7f040019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0405b35640 1 -- 172.21.15.112:0/2340031945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04000ffd70 msgr2=0x7f040019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0405b35640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04000ffd70 0x7f040019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0405b35640 1 -- 172.21.15.112:0/2340031945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0400197840 con 0x7f0400106950 2024-09-21T01:06:05.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.184+0000 7f0405b35640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f040019dc00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c8f0 tx=0x7f03f000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.185+0000 7f03f77fe640 1 -- 172.21.15.112:0/2340031945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03f00079b0 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.185+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0400197b30 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.185+0000 7f03f77fe640 1 -- 172.21.15.112:0/2340031945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03f00054e0 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.185+0000 7f03f77fe640 1 -- 172.21.15.112:0/2340031945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03f0004dd0 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.185+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04001980c0 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.186+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04001001d0 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.186+0000 7f03f77fe640 1 -- 172.21.15.112:0/2340031945 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f03f0005020 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.187+0000 7f03f77fe640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f03ec07aed0 0x7f03ec07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.187+0000 7f03f77fe640 1 -- 172.21.15.112:0/2340031945 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f03f009e070 con 0x7f0400106950 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.187+0000 7f0406336640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f03ec07aed0 0x7f03ec07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.188+0000 7f0406336640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f03ec07aed0 0x7f03ec07d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0096c0 tx=0x7f03fc031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.192+0000 7f03f77fe640 1 -- 172.21.15.112:0/2340031945 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03f0014030 con 0x7f0400106950 2024-09-21T01:06:05.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.386+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0400198440 con 0x7f03ec07aed0 2024-09-21T01:06:05.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.387+0000 7f03f77fe640 1 -- 172.21.15.112:0/2340031945 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0400198440 con 0x7f03ec07aed0 2024-09-21T01:06:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f03ec07aed0 msgr2=0x7f03ec07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f03ec07aed0 0x7f03ec07d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0096c0 tx=0x7f03fc031400 comp rx=0 tx=0).stop 2024-09-21T01:06:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 msgr2=0x7f040019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f040019dc00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c8f0 tx=0x7f03f000cdb0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 shutdown_connections 2024-09-21T01:06:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f03ec07aed0 0x7f03ec07d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0400106950 0x7f040019dc00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 --2- 172.21.15.112:0/2340031945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04000ffd70 0x7f040019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.389+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 >> 172.21.15.112:0/2340031945 conn(0x7f04000fbc60 msgr2=0x7f04000fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.390+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 shutdown_connections 2024-09-21T01:06:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.390+0000 7f040859a640 1 -- 172.21.15.112:0/2340031945 wait complete. 2024-09-21T01:06:05.400 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 -- 172.21.15.112:0/1221211613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4102b30 msgr2=0x7f78f4102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 --2- 172.21.15.112:0/1221211613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4102b30 0x7f78f4102f10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f78f00098b0 tx=0x7f78f002a560 comp rx=0 tx=0).stop 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 -- 172.21.15.112:0/1221211613 shutdown_connections 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 --2- 172.21.15.112:0/1221211613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4103450 0x7f78f410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 --2- 172.21.15.112:0/1221211613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4102b30 0x7f78f4102f10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 -- 172.21.15.112:0/1221211613 >> 172.21.15.112:0/1221211613 conn(0x7f78f40fc510 msgr2=0x7f78f40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 -- 172.21.15.112:0/1221211613 shutdown_connections 2024-09-21T01:06:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.473+0000 7f78fc439640 1 -- 172.21.15.112:0/1221211613 wait complete. 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.474+0000 7f78fc439640 1 Processor -- start 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.474+0000 7f78fc439640 1 -- start start 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.474+0000 7f78fc439640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4102b30 0x7f78f4100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.474+0000 7f78fc439640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4103450 0x7f78f4100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.474+0000 7f78fc439640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f78f410ede0 con 0x7f78f4103450 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.474+0000 7f78fc439640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f78f410ec60 con 0x7f78f4102b30 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.474+0000 7f78f99d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4103450 0x7f78f4100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fa1d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4102b30 0x7f78f4100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fa1d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4102b30 0x7f78f4100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.112:49280/0 (socket says 172.21.15.112:49280) 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78f99d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4103450 0x7f78f4100cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38064/0 (socket says 172.21.15.112:38064) 2024-09-21T01:06:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fa1d5640 1 -- 172.21.15.112:0/2190313008 learned_addr learned my addr 172.21.15.112:0/2190313008 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fa1d5640 1 -- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4103450 msgr2=0x7f78f4100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fa1d5640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4103450 0x7f78f4100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fa1d5640 1 -- 172.21.15.112:0/2190313008 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f4101210 con 0x7f78f4102b30 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78f99d4640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4103450 0x7f78f4100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fa1d5640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4102b30 0x7f78f4100790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f78f0031460 tx=0x7f78f00048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78eb7fe640 1 -- 172.21.15.112:0/2190313008 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78f003f070 con 0x7f78f4102b30 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f41014a0 con 0x7f78f4102b30 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78eb7fe640 1 -- 172.21.15.112:0/2190313008 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78f00044d0 con 0x7f78f4102b30 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.475+0000 7f78eb7fe640 1 -- 172.21.15.112:0/2190313008 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78f0035030 con 0x7f78f4102b30 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.476+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f41a3d80 con 0x7f78f4102b30 2024-09-21T01:06:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.477+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f406abd0 con 0x7f78f4102b30 2024-09-21T01:06:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.478+0000 7f78eb7fe640 1 -- 172.21.15.112:0/2190313008 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f78f0042070 con 0x7f78f4102b30 2024-09-21T01:06:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.478+0000 7f78eb7fe640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f78e007af30 0x7f78e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.478+0000 7f78eb7fe640 1 -- 172.21.15.112:0/2190313008 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f78f00beab0 con 0x7f78f4102b30 2024-09-21T01:06:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.478+0000 7f78f99d4640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f78e007af30 0x7f78e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.479+0000 7f78f99d4640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f78e007af30 0x7f78e007d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f78f4102220 tx=0x7f78e400a2d0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.483+0000 7f78eb7fe640 1 -- 172.21.15.112:0/2190313008 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78f0089fb0 con 0x7f78f4102b30 2024-09-21T01:06:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.676+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f78f4106070 con 0x7f78e007af30 2024-09-21T01:06:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.678+0000 7f78eb7fe640 1 -- 172.21.15.112:0/2190313008 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f78e4010430 con 0x7f78e007af30 2024-09-21T01:06:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f78e007af30 msgr2=0x7f78e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f78e007af30 0x7f78e007d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f78f4102220 tx=0x7f78e400a2d0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4102b30 msgr2=0x7f78f4100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4102b30 0x7f78f4100790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f78f0031460 tx=0x7f78f00048f0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 shutdown_connections 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f78e007af30 0x7f78e007d3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78f4103450 0x7f78f4100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 --2- 172.21.15.112:0/2190313008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78f4102b30 0x7f78f4100790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 >> 172.21.15.112:0/2190313008 conn(0x7f78f40fc510 msgr2=0x7f78f4103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 shutdown_connections 2024-09-21T01:06:05.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.680+0000 7f78fc439640 1 -- 172.21.15.112:0/2190313008 wait complete. 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 -- 172.21.15.112:0/585127051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 msgr2=0x7fc508102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 --2- 172.21.15.112:0/585127051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc508102ec0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009880 tx=0x7fc4f802a530 comp rx=0 tx=0).stop 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 -- 172.21.15.112:0/585127051 shutdown_connections 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 --2- 172.21.15.112:0/585127051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508103400 0x7fc50810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 --2- 172.21.15.112:0/585127051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc508102ec0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 -- 172.21.15.112:0/585127051 >> 172.21.15.112:0/585127051 conn(0x7fc5080fc520 msgr2=0x7fc5080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 -- 172.21.15.112:0/585127051 shutdown_connections 2024-09-21T01:06:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.761+0000 7fc50c889640 1 -- 172.21.15.112:0/585127051 wait complete. 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50c889640 1 Processor -- start 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50c889640 1 -- start start 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50c889640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc50819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50c889640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508103400 0x7fc50819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50c889640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810edf0 con 0x7fc508102ae0 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50c889640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810ec70 con 0x7fc508103400 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc50819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc50819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38090/0 (socket says 172.21.15.112:38090) 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50659c640 1 -- 172.21.15.112:0/156799488 learned_addr learned my addr 172.21.15.112:0/156799488 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc505d9b640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508103400 0x7fc50819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50659c640 1 -- 172.21.15.112:0/156799488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508103400 msgr2=0x7fc50819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50659c640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508103400 0x7fc50819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50659c640 1 -- 172.21.15.112:0/156799488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5081977e0 con 0x7fc508102ae0 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.762+0000 7fc50659c640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc50819d660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8031460 tx=0x7fc4f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.763+0000 7fc4ff7fe640 1 -- 172.21.15.112:0/156799488 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4f803f070 con 0x7fc508102ae0 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.763+0000 7fc4ff7fe640 1 -- 172.21.15.112:0/156799488 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4f80035f0 con 0x7fc508102ae0 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.763+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc508197a70 con 0x7fc508102ae0 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.763+0000 7fc4ff7fe640 1 -- 172.21.15.112:0/156799488 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4f8035030 con 0x7fc508102ae0 2024-09-21T01:06:05.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.763+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc508197fa0 con 0x7fc508102ae0 2024-09-21T01:06:05.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.764+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50806abe0 con 0x7fc508102ae0 2024-09-21T01:06:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.764+0000 7fc4ff7fe640 1 -- 172.21.15.112:0/156799488 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc4f8042070 con 0x7fc508102ae0 2024-09-21T01:06:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.765+0000 7fc4ff7fe640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc4f407af30 0x7fc4f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.765+0000 7fc4ff7fe640 1 -- 172.21.15.112:0/156799488 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fc4f80bea70 con 0x7fc508102ae0 2024-09-21T01:06:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.765+0000 7fc505d9b640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc4f407af30 0x7fc4f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.765+0000 7fc505d9b640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc4f407af30 0x7fc4f407d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5080fe510 tx=0x7fc4f000b2e0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:05.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.769+0000 7fc4ff7fe640 1 -- 172.21.15.112:0/156799488 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4f8089f70 con 0x7fc508102ae0 2024-09-21T01:06:05.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.958+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc508198250 con 0x7fc4f407af30 2024-09-21T01:06:05.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.968+0000 7fc4ff7fe640 1 -- 172.21.15.112:0/156799488 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc508198250 con 0x7fc4f407af30 2024-09-21T01:06:05.969 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (6m) 47s ago 17m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (9m) 47s ago 17m 9122k - 19.1.1-373-g4e45e6b4 164465d2334a 58972f8caf4a 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (8m) 4s ago 16m 8992k - 19.1.1-373-g4e45e6b4 164465d2334a c8b31925525c 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (4m) 47s ago 17m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (4m) 4s ago 16m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 47s ago 17m 80.5M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (53s) 47s ago 12m 80.3M - 19.3.0-5120-g18432218 ddce307e1f32 077f4f3983b0 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (76s) 47s ago 12m 81.0M - 19.3.0-5120-g18432218 ddce307e1f32 af0746f04a0d 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (26s) 4s ago 12m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 f75561e87ea7 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (7s) 4s ago 11m 80.1M - 19.3.0-5120-g18432218 ddce307e1f32 c881201fa04e 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (8m) 47s ago 18m 597M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (7m) 4s ago 16m 524M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:06:05.970 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (5m) 47s ago 18m 116M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (5m) 4s ago 16m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 47s ago 17m 11.7M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (7m) 4s ago 16m 10.5M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (4m) 47s ago 15m 158M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (3m) 47s ago 14m 165M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (3m) 47s ago 14m 158M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (2m) 4s ago 13m 185M 2240M 19.3.0-5120-g18432218 ddce307e1f32 ea28f02f247b 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (2m) 4s ago 13m 168M 2240M 19.3.0-5120-g18432218 ddce307e1f32 21ee55f89a04 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (90s) 4s ago 13m 152M 2240M 19.3.0-5120-g18432218 ddce307e1f32 5c353aaf7054 2024-09-21T01:06:05.971 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (6m) 47s ago 17m 56.2M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc4f407af30 msgr2=0x7fc4f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc4f407af30 0x7fc4f407d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5080fe510 tx=0x7fc4f000b2e0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 msgr2=0x7fc50819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc50819d660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8031460 tx=0x7fc4f80045e0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 shutdown_connections 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc4f407af30 0x7fc4f407d3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508103400 0x7fc50819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 --2- 172.21.15.112:0/156799488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc508102ae0 0x7fc50819d660 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 >> 172.21.15.112:0/156799488 conn(0x7fc5080fc520 msgr2=0x7fc508108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:05.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 shutdown_connections 2024-09-21T01:06:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:05.970+0000 7fc50c889640 1 -- 172.21.15.112:0/156799488 wait complete. 2024-09-21T01:06:06.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.054+0000 7f87b0759640 1 -- 172.21.15.112:0/2316516102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8107910 msgr2=0x7f87a8107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.054+0000 7f87b0759640 1 --2- 172.21.15.112:0/2316516102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8107910 0x7f87a8107cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009880 tx=0x7f87a402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.054+0000 7f87b0759640 1 -- 172.21.15.112:0/2316516102 shutdown_connections 2024-09-21T01:06:06.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.054+0000 7f87b0759640 1 --2- 172.21.15.112:0/2316516102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8101910 0x7f87a8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.054+0000 7f87b0759640 1 --2- 172.21.15.112:0/2316516102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8107910 0x7f87a8107cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.054+0000 7f87b0759640 1 -- 172.21.15.112:0/2316516102 >> 172.21.15.112:0/2316516102 conn(0x7f87a80fd5f0 msgr2=0x7f87a80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:06.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.054+0000 7f87b0759640 1 -- 172.21.15.112:0/2316516102 shutdown_connections 2024-09-21T01:06:06.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.055+0000 7f87b0759640 1 -- 172.21.15.112:0/2316516102 wait complete. 2024-09-21T01:06:06.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:06.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:06.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:06.057 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all mds 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ngfvvg"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ngfvvg"}]': finished 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.yntrjn"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.yntrjn"}]': finished 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.cdcgvm"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.cdcgvm"}]': finished 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.osicpg"} : dispatch 2024-09-21T01:06:06.058 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.osicpg"}]': finished 2024-09-21T01:06:06.059 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T01:06:06.059 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:05 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.055+0000 7f87b0759640 1 Processor -- start 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.055+0000 7f87b0759640 1 -- start start 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.055+0000 7f87b0759640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8101910 0x7f87a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.055+0000 7f87b0759640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8107910 0x7f87a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.055+0000 7f87b0759640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f87a810edc0 con 0x7f87a8101910 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87b0759640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f87a810ec40 con 0x7f87a8107910 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87ae4f5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8101910 0x7f87a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87ae4f5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8101910 0x7f87a80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38114/0 (socket says 172.21.15.112:38114) 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87ae4f5640 1 -- 172.21.15.112:0/2626173225 learned_addr learned my addr 172.21.15.112:0/2626173225 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:06.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87adcf4640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8107910 0x7f87a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87ae4f5640 1 -- 172.21.15.112:0/2626173225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8107910 msgr2=0x7f87a8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87ae4f5640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8107910 0x7f87a8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87ae4f5640 1 -- 172.21.15.112:0/2626173225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a8074f70 con 0x7f87a8101910 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f87ae4f5640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8101910 0x7f87a80744f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87a4031460 tx=0x7f87a4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.056+0000 7f879f7fe640 1 -- 172.21.15.112:0/2626173225 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87a403f070 con 0x7f87a8101910 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.057+0000 7f879f7fe640 1 -- 172.21.15.112:0/2626173225 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87a40035f0 con 0x7f87a8101910 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.057+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a8075200 con 0x7f87a8101910 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.057+0000 7f879f7fe640 1 -- 172.21.15.112:0/2626173225 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87a4035030 con 0x7f87a8101910 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.057+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a81a3d40 con 0x7f87a8101910 2024-09-21T01:06:06.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.058+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a8103050 con 0x7f87a8101910 2024-09-21T01:06:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.059+0000 7f879f7fe640 1 -- 172.21.15.112:0/2626173225 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f87a4042070 con 0x7f87a8101910 2024-09-21T01:06:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.059+0000 7f879f7fe640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f879407af30 0x7f879407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.060+0000 7f879f7fe640 1 -- 172.21.15.112:0/2626173225 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f87a40bea30 con 0x7f87a8101910 2024-09-21T01:06:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.060+0000 7f87adcf4640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f879407af30 0x7f879407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.060+0000 7f87adcf4640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f879407af30 0x7f879407d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87a8075f80 tx=0x7f8798005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:06.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.064+0000 7f879f7fe640 1 -- 172.21.15.112:0/2626173225 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87a4089f30 con 0x7f87a8101910 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all mds 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ngfvvg"} : dispatch 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.ngfvvg"}]': finished 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.yntrjn"} : dispatch 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.yntrjn"}]': finished 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.cdcgvm"} : dispatch 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.cdcgvm"}]': finished 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.osicpg"} : dispatch 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi187.osicpg"}]': finished 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T01:06:06.160 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:05 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T01:06:06.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.329+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f87a8104b20 con 0x7f87a8101910 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.330+0000 7f879f7fe640 1 -- 172.21.15.112:0/2626173225 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f87a408ede0 con 0x7f87a8101910 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 6 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 4 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 14 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:06:06.333 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f879407af30 msgr2=0x7f879407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f879407af30 0x7f879407d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87a8075f80 tx=0x7f8798005f90 comp rx=0 tx=0).stop 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8101910 msgr2=0x7f87a80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8101910 0x7f87a80744f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87a4031460 tx=0x7f87a4004530 comp rx=0 tx=0).stop 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 shutdown_connections 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f879407af30 0x7f879407d3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8107910 0x7f87a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 --2- 172.21.15.112:0/2626173225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87a8101910 0x7f87a80744f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 >> 172.21.15.112:0/2626173225 conn(0x7f87a80fd5f0 msgr2=0x7f87a80feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:06.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 shutdown_connections 2024-09-21T01:06:06.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.332+0000 7f87b0759640 1 -- 172.21.15.112:0/2626173225 wait complete. 2024-09-21T01:06:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 -- 172.21.15.112:0/2248692505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1067e0 msgr2=0x7f41fc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 --2- 172.21.15.112:0/2248692505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1067e0 0x7f41fc106bc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009880 tx=0x7f41ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 -- 172.21.15.112:0/2248692505 shutdown_connections 2024-09-21T01:06:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 --2- 172.21.15.112:0/2248692505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc1007e0 0x7f41fc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 --2- 172.21.15.112:0/2248692505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1067e0 0x7f41fc106bc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 -- 172.21.15.112:0/2248692505 >> 172.21.15.112:0/2248692505 conn(0x7f41fc0fc4c0 msgr2=0x7f41fc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 -- 172.21.15.112:0/2248692505 shutdown_connections 2024-09-21T01:06:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.415+0000 7f4202102640 1 -- 172.21.15.112:0/2248692505 wait complete. 2024-09-21T01:06:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f4202102640 1 Processor -- start 2024-09-21T01:06:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f4202102640 1 -- start start 2024-09-21T01:06:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f4202102640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1007e0 0x7f41fc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f4202102640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc1067e0 0x7f41fc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f4202102640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc10edd0 con 0x7f41fc1007e0 2024-09-21T01:06:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f4202102640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc10ec50 con 0x7f41fc1067e0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f41fb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1007e0 0x7f41fc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f41fb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1007e0 0x7f41fc19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38134/0 (socket says 172.21.15.112:38134) 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f41fb7fe640 1 -- 172.21.15.112:0/433852145 learned_addr learned my addr 172.21.15.112:0/433852145 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.416+0000 7f41faffd640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc1067e0 0x7f41fc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f41fb7fe640 1 -- 172.21.15.112:0/433852145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc1067e0 msgr2=0x7f41fc19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f41fb7fe640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc1067e0 0x7f41fc19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f41fb7fe640 1 -- 172.21.15.112:0/433852145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc197800 con 0x7f41fc1007e0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f41fb7fe640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1007e0 0x7f41fc19d680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f41ec031460 tx=0x7f41ec004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f41f8ff9640 1 -- 172.21.15.112:0/433852145 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41ec03f070 con 0x7f41fc1007e0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc197a90 con 0x7f41fc1007e0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f41f8ff9640 1 -- 172.21.15.112:0/433852145 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41ec0035f0 con 0x7f41fc1007e0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f41f8ff9640 1 -- 172.21.15.112:0/433852145 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41ec035030 con 0x7f41fc1007e0 2024-09-21T01:06:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.417+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc197fc0 con 0x7f41fc1007e0 2024-09-21T01:06:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.418+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc101f20 con 0x7f41fc1007e0 2024-09-21T01:06:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.419+0000 7f41f8ff9640 1 -- 172.21.15.112:0/433852145 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f41ec042070 con 0x7f41fc1007e0 2024-09-21T01:06:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.419+0000 7f41f8ff9640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e407af80 0x7f41e407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.419+0000 7f41f8ff9640 1 -- 172.21.15.112:0/433852145 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f41ec0be930 con 0x7f41fc1007e0 2024-09-21T01:06:06.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.419+0000 7f41faffd640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e407af80 0x7f41e407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.420+0000 7f41faffd640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e407af80 0x7f41e407d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41fc105da0 tx=0x7f41f0005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:06.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.424+0000 7f41f8ff9640 1 -- 172.21.15.112:0/433852145 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41ec089eb0 con 0x7f41fc1007e0 2024-09-21T01:06:06.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.649+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f41fc108d50 con 0x7f41fc1007e0 2024-09-21T01:06:06.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.649+0000 7f41f8ff9640 1 -- 172.21.15.112:0/433852145 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) ==== 76+0+2019 (secure 0 0 0) 0x7f41ec08ed60 con 0x7f41fc1007e0 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:e34 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T01:06:05:995603+0000 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 34 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T01:06:04.999026+0000 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:06:06.652 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 80 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=34314} 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:06:06.653 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 34314 members: 34314 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{0:34314} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6828/428821401,v1:172.21.15.112:6829/428821401] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.187:6824/2863682926,v1:172.21.15.187:6825/2863682926] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:06:06.654 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.187:6826/749430440,v1:172.21.15.187:6827/749430440] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:06:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 34 2024-09-21T01:06:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e407af80 msgr2=0x7f41e407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e407af80 0x7f41e407d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41fc105da0 tx=0x7f41f0005f90 comp rx=0 tx=0).stop 2024-09-21T01:06:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1007e0 msgr2=0x7f41fc19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1007e0 0x7f41fc19d680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f41ec031460 tx=0x7f41ec004530 comp rx=0 tx=0).stop 2024-09-21T01:06:06.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 shutdown_connections 2024-09-21T01:06:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f41e407af80 0x7f41e407d440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc1067e0 0x7f41fc19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 --2- 172.21.15.112:0/433852145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41fc1007e0 0x7f41fc19d680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.652+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 >> 172.21.15.112:0/433852145 conn(0x7f41fc0fc4c0 msgr2=0x7f41fc0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.653+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 shutdown_connections 2024-09-21T01:06:06.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.653+0000 7f4202102640 1 -- 172.21.15.112:0/433852145 wait complete. 2024-09-21T01:06:06.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 -- 172.21.15.112:0/3916537187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980100810 msgr2=0x7f5980100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 --2- 172.21.15.112:0/3916537187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980100810 0x7f5980100c70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f596c009880 tx=0x7f596c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 -- 172.21.15.112:0/3916537187 shutdown_connections 2024-09-21T01:06:06.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 --2- 172.21.15.112:0/3916537187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980100810 0x7f5980100c70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 --2- 172.21.15.112:0/3916537187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5980106810 0x7f5980106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 -- 172.21.15.112:0/3916537187 >> 172.21.15.112:0/3916537187 conn(0x7f59800fc510 msgr2=0x7f59800fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:06.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 -- 172.21.15.112:0/3916537187 shutdown_connections 2024-09-21T01:06:06.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.741+0000 7f59871ef640 1 -- 172.21.15.112:0/3916537187 wait complete. 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.742+0000 7f59871ef640 1 Processor -- start 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.742+0000 7f59871ef640 1 -- start start 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.742+0000 7f59871ef640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5980100810 0x7f598019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.742+0000 7f59871ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980106810 0x7f598019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.742+0000 7f59871ef640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f598010dcc0 con 0x7f5980106810 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.742+0000 7f59871ef640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f598010db40 con 0x7f5980100810 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.742+0000 7f597ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980106810 0x7f598019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980106810 0x7f598019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38160/0 (socket says 172.21.15.112:38160) 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597ffff640 1 -- 172.21.15.112:0/2208169463 learned_addr learned my addr 172.21.15.112:0/2208169463 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f5984f8b640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5980100810 0x7f598019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597ffff640 1 -- 172.21.15.112:0/2208169463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5980100810 msgr2=0x7f598019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597ffff640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5980100810 0x7f598019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597ffff640 1 -- 172.21.15.112:0/2208169463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59801966f0 con 0x7f5980106810 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597ffff640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980106810 0x7f598019cb60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f596c031460 tx=0x7f596c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597dffb640 1 -- 172.21.15.112:0/2208169463 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f596c035030 con 0x7f5980106810 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5980196980 con 0x7f5980106810 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.743+0000 7f597dffb640 1 -- 172.21.15.112:0/2208169463 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f596c03f070 con 0x7f5980106810 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.744+0000 7f597dffb640 1 -- 172.21.15.112:0/2208169463 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f596c03b820 con 0x7f5980106810 2024-09-21T01:06:06.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.744+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5980196e80 con 0x7f5980106810 2024-09-21T01:06:06.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.745+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5980101f50 con 0x7f5980106810 2024-09-21T01:06:06.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.745+0000 7f597dffb640 1 -- 172.21.15.112:0/2208169463 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f596c004b10 con 0x7f5980106810 2024-09-21T01:06:06.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.746+0000 7f597dffb640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f597007af80 0x7f597007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:06.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.746+0000 7f5984f8b640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f597007af80 0x7f597007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:06.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.746+0000 7f597dffb640 1 -- 172.21.15.112:0/2208169463 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f596c0c09d0 con 0x7f5980106810 2024-09-21T01:06:06.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.747+0000 7f5984f8b640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f597007af80 0x7f597007d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5974005fd0 tx=0x7f597400b590 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:06.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.751+0000 7f597dffb640 1 -- 172.21.15.112:0/2208169463 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f596c08bf50 con 0x7f5980106810 2024-09-21T01:06:06.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.946+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f59801971f0 con 0x7f597007af80 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.948+0000 7f597dffb640 1 -- 172.21.15.112:0/2208169463 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f59801971f0 con 0x7f597007af80 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262", 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": true, 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [ 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: "crash", 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: "mon", 2024-09-21T01:06:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: "mds", 2024-09-21T01:06:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: "osd", 2024-09-21T01:06:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr" 2024-09-21T01:06:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-21T01:06:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T01:06:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-21T01:06:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:06:06.951 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:06:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.950+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f597007af80 msgr2=0x7f597007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.950+0000 7f59871ef640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f597007af80 0x7f597007d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5974005fd0 tx=0x7f597400b590 comp rx=0 tx=0).stop 2024-09-21T01:06:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.950+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980106810 msgr2=0x7f598019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.950+0000 7f59871ef640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980106810 0x7f598019cb60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f596c031460 tx=0x7f596c0045e0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.951+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 shutdown_connections 2024-09-21T01:06:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.951+0000 7f59871ef640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f597007af80 0x7f597007d440 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.951+0000 7f59871ef640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5980106810 0x7f598019cb60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.951+0000 7f59871ef640 1 --2- 172.21.15.112:0/2208169463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5980100810 0x7f598019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.951+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 >> 172.21.15.112:0/2208169463 conn(0x7f59800fc510 msgr2=0x7f59800fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.951+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 shutdown_connections 2024-09-21T01:06:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:06.951+0000 7f59871ef640 1 -- 172.21.15.112:0/2208169463 wait complete. 2024-09-21T01:06:07.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 -- 172.21.15.112:0/3951686865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c1057d0 msgr2=0x7eff9c105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 --2- 172.21.15.112:0/3951686865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c1057d0 0x7eff9c105bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff98009880 tx=0x7eff9802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 -- 172.21.15.112:0/3951686865 shutdown_connections 2024-09-21T01:06:07.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 --2- 172.21.15.112:0/3951686865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff9c100fa0 0x7eff9c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 --2- 172.21.15.112:0/3951686865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c1057d0 0x7eff9c105bb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 -- 172.21.15.112:0/3951686865 >> 172.21.15.112:0/3951686865 conn(0x7eff9c0fbc40 msgr2=0x7eff9c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:07.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 -- 172.21.15.112:0/3951686865 shutdown_connections 2024-09-21T01:06:07.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.036+0000 7effa439e640 1 -- 172.21.15.112:0/3951686865 wait complete. 2024-09-21T01:06:07.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa439e640 1 Processor -- start 2024-09-21T01:06:07.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa439e640 1 -- start start 2024-09-21T01:06:07.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa439e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c100fa0 0x7eff9c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:07.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa439e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff9c1057d0 0x7eff9c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:07.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa439e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c10edd0 con 0x7eff9c100fa0 2024-09-21T01:06:07.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa439e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c10ec50 con 0x7eff9c1057d0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa213a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c100fa0 0x7eff9c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa213a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c100fa0 0x7eff9c19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38176/0 (socket says 172.21.15.112:38176) 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa213a640 1 -- 172.21.15.112:0/1091192158 learned_addr learned my addr 172.21.15.112:0/1091192158 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.037+0000 7effa1939640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff9c1057d0 0x7eff9c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7effa213a640 1 -- 172.21.15.112:0/1091192158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff9c1057d0 msgr2=0x7eff9c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7effa213a640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff9c1057d0 0x7eff9c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7effa213a640 1 -- 172.21.15.112:0/1091192158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c199a10 con 0x7eff9c100fa0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7effa213a640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c100fa0 0x7eff9c19f850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7eff98031460 tx=0x7eff980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7eff937fe640 1 -- 172.21.15.112:0/1091192158 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff9803f070 con 0x7eff9c100fa0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9c199ca0 con 0x7eff9c100fa0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7eff937fe640 1 -- 172.21.15.112:0/1091192158 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff980035f0 con 0x7eff9c100fa0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7eff937fe640 1 -- 172.21.15.112:0/1091192158 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff98035030 con 0x7eff9c100fa0 2024-09-21T01:06:07.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.038+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9c19a1d0 con 0x7eff9c100fa0 2024-09-21T01:06:07.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.039+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9c101fb0 con 0x7eff9c100fa0 2024-09-21T01:06:07.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.040+0000 7eff937fe640 1 -- 172.21.15.112:0/1091192158 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7eff98042070 con 0x7eff9c100fa0 2024-09-21T01:06:07.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.040+0000 7eff937fe640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7eff8807af30 0x7eff8807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:07.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.040+0000 7eff937fe640 1 -- 172.21.15.112:0/1091192158 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7eff980bea70 con 0x7eff9c100fa0 2024-09-21T01:06:07.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.040+0000 7effa1939640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7eff8807af30 0x7eff8807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:07.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.041+0000 7effa1939640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7eff8807af30 0x7eff8807d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0fe1e0 tx=0x7eff8c00b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:07.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.045+0000 7eff937fe640 1 -- 172.21.15.112:0/1091192158 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff98089f70 con 0x7eff9c100fa0 2024-09-21T01:06:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.1 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:06:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='client.44327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T01:06:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T01:06:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all rgw 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2626173225' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:07 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/433852145' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:06:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.310+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7eff9c19af40 con 0x7eff9c100fa0 2024-09-21T01:06:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.311+0000 7eff937fe640 1 -- 172.21.15.112:0/1091192158 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7eff9808ee20 con 0x7eff9c100fa0 2024-09-21T01:06:07.311 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:06:07.311 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:06:07.312 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:06:07.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7eff8807af30 msgr2=0x7eff8807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7eff8807af30 0x7eff8807d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0fe1e0 tx=0x7eff8c00b390 comp rx=0 tx=0).stop 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c100fa0 msgr2=0x7eff9c19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c100fa0 0x7eff9c19f850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7eff98031460 tx=0x7eff980045e0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 shutdown_connections 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7eff8807af30 0x7eff8807d3f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff9c1057d0 0x7eff9c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 --2- 172.21.15.112:0/1091192158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff9c100fa0 0x7eff9c19f850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 >> 172.21.15.112:0/1091192158 conn(0x7eff9c0fbc40 msgr2=0x7eff9c0fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 shutdown_connections 2024-09-21T01:06:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:07.313+0000 7effa439e640 1 -- 172.21.15.112:0/1091192158 wait complete. 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.1 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='client.44327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all rgw 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:07.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T01:06:07.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:07.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2626173225' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:07.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:07 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/433852145' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:06:08.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:08 smithi112 ceph-mon[109687]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:08.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:08 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1091192158' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:06:08.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:08.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T01:06:08.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:08 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:08.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:08 smithi187 ceph-mon[78584]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:08 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1091192158' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:06:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T01:06:08.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:08 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:09.224 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:09 smithi112 ceph-mon[109687]: Upgrade: Updating ceph-exporter.smithi112 (1/2) 2024-09-21T01:06:09.224 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:09 smithi112 ceph-mon[109687]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T01:06:09.224 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:09 smithi112 ceph-mon[109687]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.1 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:06:09.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:09 smithi187 ceph-mon[78584]: Upgrade: Updating ceph-exporter.smithi112 (1/2) 2024-09-21T01:06:09.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:09 smithi187 ceph-mon[78584]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T01:06:09.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:09 smithi187 ceph-mon[78584]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.1 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T01:06:11.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:11 smithi112 ceph-mon[109687]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-09-21T01:06:11.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:11 smithi187 ceph-mon[78584]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-09-21T01:06:13.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:13 smithi112 ceph-mon[109687]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:06:13.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:13 smithi187 ceph-mon[78584]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:06:14.402 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:14.402 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:06:14.402 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:14 smithi112 ceph-mon[109687]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:06:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:06:14.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:14 smithi187 ceph-mon[78584]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-21T01:06:16.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:16 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:16 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:16.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:16 smithi187 ceph-mon[78584]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3.8 KiB/s wr, 2 op/s 2024-09-21T01:06:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:16 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:16 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:16.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:16 smithi112 ceph-mon[109687]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3.8 KiB/s wr, 2 op/s 2024-09-21T01:06:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:17 smithi112 ceph-mon[109687]: Upgrade: Updating ceph-exporter.smithi187 (2/2) 2024-09-21T01:06:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:17 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:17 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T01:06:18.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:17 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:18.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:17 smithi112 ceph-mon[109687]: Deploying daemon ceph-exporter.smithi187 on smithi187 2024-09-21T01:06:18.025 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:17 smithi187 ceph-mon[78584]: Upgrade: Updating ceph-exporter.smithi187 (2/2) 2024-09-21T01:06:18.025 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:17 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:18.026 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:17 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi187", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T01:06:18.026 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:17 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:18.026 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:17 smithi187 ceph-mon[78584]: Deploying daemon ceph-exporter.smithi187 on smithi187 2024-09-21T01:06:18.882 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:18 smithi187 ceph-mon[78584]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3.8 KiB/s wr, 2 op/s 2024-09-21T01:06:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:18 smithi112 ceph-mon[109687]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 3.8 KiB/s wr, 2 op/s 2024-09-21T01:06:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:20 smithi112 ceph-mon[109687]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s wr, 1 op/s 2024-09-21T01:06:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:21.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:21.011 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:20 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:21.061 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:20 smithi187 ceph-mon[78584]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s wr, 1 op/s 2024-09-21T01:06:21.062 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:21.062 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:21.062 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:20 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:22.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:22 smithi187 ceph-mon[78584]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:22.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:22 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:22.909 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:22 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:22 smithi112 ceph-mon[109687]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:22 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:23.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:22 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:24.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:24.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:24 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:24.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:24.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:24 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:25.330 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:25 smithi187 ceph-mon[78584]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:25.330 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:25 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:25.330 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:25 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:25.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:25 smithi112 ceph-mon[109687]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:25.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:25 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:25.373 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:25 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:26.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:26 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:26.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:26 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:26.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:26 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:26.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:26 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:27 smithi112 ceph-mon[109687]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:27 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:27 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:27.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:27 smithi187 ceph-mon[78584]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:27.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:27 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:27.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:27 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:06:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T01:06:29.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:29.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"} : dispatch 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"}]': finished 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi187"} : dispatch 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi187"}]': finished 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T01:06:30.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:30.515 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T01:06:30.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T01:06:30.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: fsmap cephfs:1 {0=cephfs.smithi112.yntrjn=up:active} 3 up:standby 2024-09-21T01:06:30.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"} : dispatch 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"}]': finished 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi187"} : dispatch 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi187"}]': finished 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.660 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T01:06:30.661 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T01:06:30.662 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:30.663 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:30.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:30.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:30.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:30.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:30.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:30.664 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:31.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:31 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T01:06:31.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:31 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all iscsi 2024-09-21T01:06:31.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:31 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all nfs 2024-09-21T01:06:31.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:31 smithi112 ceph-mon[109687]: Upgrade: Setting container_image for all nvmeof 2024-09-21T01:06:31.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:31 smithi112 ceph-mon[109687]: Upgrade: Finalizing container_image settings 2024-09-21T01:06:31.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:31 smithi112 ceph-mon[109687]: Upgrade: Complete! 2024-09-21T01:06:31.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:31 smithi112 ceph-mon[109687]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:31.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:31 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T01:06:31.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:31 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all iscsi 2024-09-21T01:06:31.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:31 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all nfs 2024-09-21T01:06:31.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:31 smithi187 ceph-mon[78584]: Upgrade: Setting container_image for all nvmeof 2024-09-21T01:06:31.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:31 smithi187 ceph-mon[78584]: Upgrade: Finalizing container_image settings 2024-09-21T01:06:31.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:31 smithi187 ceph-mon[78584]: Upgrade: Complete! 2024-09-21T01:06:31.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:31 smithi187 ceph-mon[78584]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:33 smithi112 ceph-mon[109687]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:33 smithi187 ceph-mon[78584]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:34.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:34 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:34.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:34 smithi187 ceph-mon[78584]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:34.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:34 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:06:34.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:34 smithi112 ceph-mon[109687]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:37.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:36 smithi112 ceph-mon[109687]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:37.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:36 smithi187 ceph-mon[78584]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:37.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 -- 172.21.15.112:0/3990887733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001067e0 msgr2=0x7fb500106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 --2- 172.21.15.112:0/3990887733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001067e0 0x7fb500106bc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009c20 tx=0x7fb4f002a970 comp rx=0 tx=0).stop 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 -- 172.21.15.112:0/3990887733 shutdown_connections 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 --2- 172.21.15.112:0/3990887733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5001007e0 0x7fb500100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 --2- 172.21.15.112:0/3990887733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001067e0 0x7fb500106bc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 -- 172.21.15.112:0/3990887733 >> 172.21.15.112:0/3990887733 conn(0x7fb5000fc4c0 msgr2=0x7fb5000fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 -- 172.21.15.112:0/3990887733 shutdown_connections 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.409+0000 7fb50728f640 1 -- 172.21.15.112:0/3990887733 wait complete. 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50728f640 1 Processor -- start 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50728f640 1 -- start start 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50728f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001007e0 0x7fb500198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50728f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5001067e0 0x7fb500198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:37.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50728f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb50010dd10 con 0x7fb5001007e0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50728f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb50010db90 con 0x7fb5001067e0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50502b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001007e0 0x7fb500198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50502b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001007e0 0x7fb500198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41510/0 (socket says 172.21.15.112:41510) 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.410+0000 7fb50502b640 1 -- 172.21.15.112:0/2203344418 learned_addr learned my addr 172.21.15.112:0/2203344418 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb50502b640 1 -- 172.21.15.112:0/2203344418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5001067e0 msgr2=0x7fb500198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb50482a640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5001067e0 0x7fb500198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb50502b640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5001067e0 0x7fb500198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb50502b640 1 -- 172.21.15.112:0/2203344418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5001994b0 con 0x7fb5001007e0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb50502b640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001007e0 0x7fb500198920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0005cc0 tx=0x7fb4f002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb4fe7fc640 1 -- 172.21.15.112:0/2203344418 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4f0047070 con 0x7fb5001007e0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb4fe7fc640 1 -- 172.21.15.112:0/2203344418 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4f002f7e0 con 0x7fb5001007e0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb500199740 con 0x7fb5001007e0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb4fe7fc640 1 -- 172.21.15.112:0/2203344418 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4f0034070 con 0x7fb5001007e0 2024-09-21T01:06:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.411+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5001a1cf0 con 0x7fb5001007e0 2024-09-21T01:06:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.412+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb500101f20 con 0x7fb5001007e0 2024-09-21T01:06:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.413+0000 7fb4fe7fc640 1 -- 172.21.15.112:0/2203344418 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb4f004a070 con 0x7fb5001007e0 2024-09-21T01:06:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.413+0000 7fb4fe7fc640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb4e807af30 0x7fb4e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:37.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.414+0000 7fb50482a640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb4e807af30 0x7fb4e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.414+0000 7fb4fe7fc640 1 -- 172.21.15.112:0/2203344418 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fb4f00befe0 con 0x7fb5001007e0 2024-09-21T01:06:37.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.414+0000 7fb50482a640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb4e807af30 0x7fb4e807d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb50006a6c0 tx=0x7fb4f4008040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:37.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.418+0000 7fb4fe7fc640 1 -- 172.21.15.112:0/2203344418 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4f003f070 con 0x7fb5001007e0 2024-09-21T01:06:37.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.618+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb500062630 con 0x7fb4e807af30 2024-09-21T01:06:37.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.619+0000 7fb4fe7fc640 1 -- 172.21.15.112:0/2203344418 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fb500062630 con 0x7fb4e807af30 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb4e807af30 msgr2=0x7fb4e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb4e807af30 0x7fb4e807d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb50006a6c0 tx=0x7fb4f4008040 comp rx=0 tx=0).stop 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001007e0 msgr2=0x7fb500198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001007e0 0x7fb500198920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0005cc0 tx=0x7fb4f002f5f0 comp rx=0 tx=0).stop 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 shutdown_connections 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb4e807af30 0x7fb4e807d3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5001067e0 0x7fb500198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 --2- 172.21.15.112:0/2203344418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5001007e0 0x7fb500198920 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 >> 172.21.15.112:0/2203344418 conn(0x7fb5000fc4c0 msgr2=0x7fb5000fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 shutdown_connections 2024-09-21T01:06:37.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:37.621+0000 7fb50728f640 1 -- 172.21.15.112:0/2203344418 wait complete. 2024-09-21T01:06:38.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph orch ps' 2024-09-21T01:06:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:06:39.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:38 smithi112 ceph-mon[109687]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:39.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:38 smithi112 ceph-mon[109687]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 -- 172.21.15.112:0/1860316356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70107930 msgr2=0x7fee70107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 --2- 172.21.15.112:0/1860316356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70107930 0x7fee70107d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee64009880 tx=0x7fee6402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 -- 172.21.15.112:0/1860316356 shutdown_connections 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 --2- 172.21.15.112:0/1860316356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee70101930 0x7fee70101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 --2- 172.21.15.112:0/1860316356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70107930 0x7fee70107d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 -- 172.21.15.112:0/1860316356 >> 172.21.15.112:0/1860316356 conn(0x7fee700fd630 msgr2=0x7fee700ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 -- 172.21.15.112:0/1860316356 shutdown_connections 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 -- 172.21.15.112:0/1860316356 wait complete. 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 Processor -- start 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.130+0000 7fee76a7e640 1 -- start start 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee76a7e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70101930 0x7fee700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee76a7e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee70107930 0x7fee70074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee76a7e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fee7010ede0 con 0x7fee70101930 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee76a7e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fee7010ec60 con 0x7fee70107930 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee7481a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70101930 0x7fee700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee7481a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70101930 0x7fee700744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41528/0 (socket says 172.21.15.112:41528) 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee7481a640 1 -- 172.21.15.112:0/2680943477 learned_addr learned my addr 172.21.15.112:0/2680943477 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee6ffff640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee70107930 0x7fee70074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee7481a640 1 -- 172.21.15.112:0/2680943477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee70107930 msgr2=0x7fee70074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee7481a640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee70107930 0x7fee70074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee7481a640 1 -- 172.21.15.112:0/2680943477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee70074f70 con 0x7fee70101930 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee6ffff640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee70107930 0x7fee70074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee7481a640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70101930 0x7fee700744f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee64031460 tx=0x7fee640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee6dffb640 1 -- 172.21.15.112:0/2680943477 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee6403f070 con 0x7fee70101930 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee6dffb640 1 -- 172.21.15.112:0/2680943477 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee64004cf0 con 0x7fee70101930 2024-09-21T01:06:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee70075200 con 0x7fee70101930 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.131+0000 7fee6dffb640 1 -- 172.21.15.112:0/2680943477 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee64035030 con 0x7fee70101930 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.132+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701a3d40 con 0x7fee70101930 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.133+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee70103070 con 0x7fee70101930 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.133+0000 7fee6dffb640 1 -- 172.21.15.112:0/2680943477 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fee64042070 con 0x7fee70101930 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.134+0000 7fee6dffb640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fee6007af30 0x7fee6007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.134+0000 7fee6ffff640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fee6007af30 0x7fee6007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.134+0000 7fee6dffb640 1 -- 172.21.15.112:0/2680943477 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fee640beb90 con 0x7fee70101930 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.135+0000 7fee6ffff640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fee6007af30 0x7fee6007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee70075f80 tx=0x7fee5c005d90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.139+0000 7fee6dffb640 1 -- 172.21.15.112:0/2680943477 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fee6408a090 con 0x7fee70101930 2024-09-21T01:06:39.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:38 smithi187 ceph-mon[78584]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:39.161 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:38 smithi187 ceph-mon[78584]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:39.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.328+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fee70062630 con 0x7fee6007af30 2024-09-21T01:06:39.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.338+0000 7fee6dffb640 1 -- 172.21.15.112:0/2680943477 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fee70062630 con 0x7fee6007af30 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (7m) 14s ago 17m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (24s) 14s ago 18m 75.3M - 19.3.0-5120-g18432218 ddce307e1f32 03bec30c4fdb 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (19s) 16s ago 17m 74.4M - 19.3.0-5120-g18432218 ddce307e1f32 ac972aec3eb4 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (5m) 14s ago 18m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (5m) 16s ago 17m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (6m) 14s ago 17m 77.5M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (86s) 14s ago 12m 81.4M - 19.3.0-5120-g18432218 ddce307e1f32 077f4f3983b0 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (109s) 14s ago 12m 153M - 19.3.0-5120-g18432218 ddce307e1f32 af0746f04a0d 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (60s) 16s ago 12m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 f75561e87ea7 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (41s) 16s ago 12m 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 c881201fa04e 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (9m) 14s ago 19m 598M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:06:39.340 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (8m) 16s ago 17m 524M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (5m) 14s ago 19m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (5m) 16s ago 17m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 14s ago 18m 11.2M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (7m) 16s ago 17m 11.6M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (4m) 14s ago 15m 160M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (4m) 14s ago 15m 169M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (3m) 14s ago 14m 161M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (3m) 16s ago 14m 186M 2240M 19.3.0-5120-g18432218 ddce307e1f32 ea28f02f247b 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (2m) 16s ago 14m 168M 2240M 19.3.0-5120-g18432218 ddce307e1f32 21ee55f89a04 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (2m) 16s ago 13m 154M 2240M 19.3.0-5120-g18432218 ddce307e1f32 5c353aaf7054 2024-09-21T01:06:39.341 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (7m) 14s ago 17m 56.2M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:06:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fee6007af30 msgr2=0x7fee6007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fee6007af30 0x7fee6007d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee70075f80 tx=0x7fee5c005d90 comp rx=0 tx=0).stop 2024-09-21T01:06:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70101930 msgr2=0x7fee700744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70101930 0x7fee700744f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee64031460 tx=0x7fee640048f0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 shutdown_connections 2024-09-21T01:06:39.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fee6007af30 0x7fee6007d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee70107930 0x7fee70074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 --2- 172.21.15.112:0/2680943477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee70101930 0x7fee700744f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:39.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 >> 172.21.15.112:0/2680943477 conn(0x7fee700fd630 msgr2=0x7fee700fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:39.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 shutdown_connections 2024-09-21T01:06:39.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:39.340+0000 7fee76a7e640 1 -- 172.21.15.112:0/2680943477 wait complete. 2024-09-21T01:06:40.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph orch upgrade status' 2024-09-21T01:06:40.342 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:06:40.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.798+0000 7f1ba8a96640 1 -- 172.21.15.112:0/1717862490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 msgr2=0x7f1ba4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:40.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.798+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/1717862490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 0x7f1ba4106bc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009880 tx=0x7f1b9402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:40.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.799+0000 7f1ba8a96640 1 -- 172.21.15.112:0/1717862490 shutdown_connections 2024-09-21T01:06:40.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.799+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/1717862490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba41007e0 0x7f1ba4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.799+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/1717862490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 0x7f1ba4106bc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.799+0000 7f1ba8a96640 1 -- 172.21.15.112:0/1717862490 >> 172.21.15.112:0/1717862490 conn(0x7f1ba40fc4c0 msgr2=0x7f1ba40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.799+0000 7f1ba8a96640 1 -- 172.21.15.112:0/1717862490 shutdown_connections 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.799+0000 7f1ba8a96640 1 -- 172.21.15.112:0/1717862490 wait complete. 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.799+0000 7f1ba8a96640 1 Processor -- start 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba8a96640 1 -- start start 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba8a96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba41007e0 0x7f1ba4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba8a96640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 0x7f1ba4198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba8a96640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba410dcb0 con 0x7f1ba41067e0 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba8a96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba410db30 con 0x7f1ba41007e0 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 0x7f1ba4198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba259c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba41007e0 0x7f1ba4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:40.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 0x7f1ba4198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41548/0 (socket says 172.21.15.112:41548) 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba1d9b640 1 -- 172.21.15.112:0/3701441048 learned_addr learned my addr 172.21.15.112:0/3701441048 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.800+0000 7f1ba259c640 1 -- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 msgr2=0x7f1ba4198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1ba259c640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 0x7f1ba4198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1ba259c640 1 -- 172.21.15.112:0/3701441048 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba4199360 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1ba259c640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba41007e0 0x7f1ba4198820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b94006010 tx=0x7f1b940045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1b937fe640 1 -- 172.21.15.112:0/3701441048 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b9403f070 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1b937fe640 1 -- 172.21.15.112:0/3701441048 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b940035f0 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1b937fe640 1 -- 172.21.15.112:0/3701441048 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b94035030 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba41995f0 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.801+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba41a1ba0 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.802+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba4101f20 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.803+0000 7f1b937fe640 1 -- 172.21.15.112:0/3701441048 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1b94042070 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.804+0000 7f1b937fe640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b8c07af80 0x7f1b8c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.804+0000 7f1b937fe640 1 -- 172.21.15.112:0/3701441048 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f1b940be890 con 0x7f1ba41007e0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.804+0000 7f1ba1d9b640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b8c07af80 0x7f1b8c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:40.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.804+0000 7f1ba1d9b640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b8c07af80 0x7f1b8c07d440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1ba406a680 tx=0x7f1b98005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:40.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:40.809+0000 7f1b937fe640 1 -- 172.21.15.112:0/3701441048 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1b94089e10 con 0x7f1ba41007e0 2024-09-21T01:06:40.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:40 smithi187 ceph-mon[78584]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:40.908 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:40 smithi187 ceph-mon[78584]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:41.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.002+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1ba4062630 con 0x7f1b8c07af80 2024-09-21T01:06:41.004 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:40 smithi112 ceph-mon[109687]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:41.004 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:40 smithi112 ceph-mon[109687]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:41.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.004+0000 7f1b937fe640 1 -- 172.21.15.112:0/3701441048 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f1ba4062630 con 0x7f1b8c07af80 2024-09-21T01:06:41.005 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: "target_image": null, 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: "in_progress": false, 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: "which": "", 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: "services_complete": [], 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: "progress": null, 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: "message": "", 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: "is_paused": false 2024-09-21T01:06:41.006 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:06:41.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b8c07af80 msgr2=0x7f1b8c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b8c07af80 0x7f1b8c07d440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1ba406a680 tx=0x7f1b98005f90 comp rx=0 tx=0).stop 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba41007e0 msgr2=0x7f1ba4198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba41007e0 0x7f1ba4198820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b94006010 tx=0x7f1b940045e0 comp rx=0 tx=0).stop 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 shutdown_connections 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1b8c07af80 0x7f1b8c07d440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ba41067e0 0x7f1ba4198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 --2- 172.21.15.112:0/3701441048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba41007e0 0x7f1ba4198820 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 >> 172.21.15.112:0/3701441048 conn(0x7f1ba40fc4c0 msgr2=0x7f1ba40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 shutdown_connections 2024-09-21T01:06:41.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:41.006+0000 7f1ba8a96640 1 -- 172.21.15.112:0/3701441048 wait complete. 2024-09-21T01:06:41.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:41 smithi112 ceph-mon[109687]: from='client.44353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:41.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph health detail' 2024-09-21T01:06:42.015 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:06:42.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:41 smithi187 ceph-mon[78584]: from='client.44353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 -- 172.21.15.112:0/3500181740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 msgr2=0x7f3ce0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 --2- 172.21.15.112:0/3500181740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce0101d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009880 tx=0x7f3cdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 -- 172.21.15.112:0/3500181740 shutdown_connections 2024-09-21T01:06:42.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 --2- 172.21.15.112:0/3500181740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce0101d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 --2- 172.21.15.112:0/3500181740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0107930 0x7f3ce0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 -- 172.21.15.112:0/3500181740 >> 172.21.15.112:0/3500181740 conn(0x7f3ce00fd630 msgr2=0x7f3ce00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 -- 172.21.15.112:0/3500181740 shutdown_connections 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.477+0000 7f3ce830f640 1 -- 172.21.15.112:0/3500181740 wait complete. 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce830f640 1 Processor -- start 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce830f640 1 -- start start 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce830f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce830f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0107930 0x7f3ce0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce830f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce010ee00 con 0x7f3ce0101930 2024-09-21T01:06:42.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce830f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce010ec80 con 0x7f3ce0107930 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce60ab640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce60ab640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48592/0 (socket says 172.21.15.112:48592) 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce60ab640 1 -- 172.21.15.112:0/710707356 learned_addr learned my addr 172.21.15.112:0/710707356 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce58aa640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0107930 0x7f3ce0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce60ab640 1 -- 172.21.15.112:0/710707356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0107930 msgr2=0x7f3ce0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce60ab640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0107930 0x7f3ce0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce60ab640 1 -- 172.21.15.112:0/710707356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce0074f70 con 0x7f3ce0101930 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce58aa640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0107930 0x7f3ce0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.478+0000 7f3ce60ab640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce00744f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400d6f0 tx=0x7f3cd400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.479+0000 7f3cd37fe640 1 -- 172.21.15.112:0/710707356 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd4017070 con 0x7f3ce0101930 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.479+0000 7f3cd37fe640 1 -- 172.21.15.112:0/710707356 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cd400de00 con 0x7f3ce0101930 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.479+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce0075260 con 0x7f3ce0101930 2024-09-21T01:06:42.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.479+0000 7f3cd37fe640 1 -- 172.21.15.112:0/710707356 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd4004bb0 con 0x7f3ce0101930 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.479+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01a3e90 con 0x7f3ce0101930 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.480+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce0103070 con 0x7f3ce0101930 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.480+0000 7f3cd37fe640 1 -- 172.21.15.112:0/710707356 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3cd4004e60 con 0x7f3ce0101930 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.481+0000 7f3cd37fe640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3ccc07af30 0x7f3ccc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.481+0000 7f3ce58aa640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3ccc07af30 0x7f3ccc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.481+0000 7f3cd37fe640 1 -- 172.21.15.112:0/710707356 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f3cd409dd50 con 0x7f3ce0101930 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.481+0000 7f3ce58aa640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3ccc07af30 0x7f3ccc07d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006010 tx=0x7f3cdc0095f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:42.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.486+0000 7f3cd37fe640 1 -- 172.21.15.112:0/710707356 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3cd4069250 con 0x7f3ce0101930 2024-09-21T01:06:42.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.738+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3ce0109ea0 con 0x7f3ce0101930 2024-09-21T01:06:42.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.738+0000 7f3cd37fe640 1 -- 172.21.15.112:0/710707356 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f3cd406e100 con 0x7f3ce0101930 2024-09-21T01:06:42.740 INFO:teuthology.orchestra.run.smithi112.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:06:42.741 INFO:teuthology.orchestra.run.smithi112.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T01:06:42.741 INFO:teuthology.orchestra.run.smithi112.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T01:06:42.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3ccc07af30 msgr2=0x7f3ccc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3ccc07af30 0x7f3ccc07d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006010 tx=0x7f3cdc0095f0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 msgr2=0x7f3ce00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce00744f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400d6f0 tx=0x7f3cd400dbb0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 shutdown_connections 2024-09-21T01:06:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3ccc07af30 0x7f3ccc07d3f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0107930 0x7f3ce0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 --2- 172.21.15.112:0/710707356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce0101930 0x7f3ce00744f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:42.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.740+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 >> 172.21.15.112:0/710707356 conn(0x7f3ce00fd630 msgr2=0x7f3ce00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:42.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.741+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 shutdown_connections 2024-09-21T01:06:42.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:42.741+0000 7f3ce830f640 1 -- 172.21.15.112:0/710707356 wait complete. 2024-09-21T01:06:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:42 smithi112 ceph-mon[109687]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:43.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:42 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/710707356' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:06:43.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:42 smithi187 ceph-mon[78584]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:43.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:42 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/710707356' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T01:06:43.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph versions' 2024-09-21T01:06:43.612 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:06:43.987 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:06:44.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 -- 172.21.15.112:0/4023043671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 msgr2=0x7f08c010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:44.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 --2- 172.21.15.112:0/4023043671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c010b8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009880 tx=0x7f08b002a530 comp rx=0 tx=0).stop 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 -- 172.21.15.112:0/4023043671 shutdown_connections 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 --2- 172.21.15.112:0/4023043671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c010b8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 --2- 172.21.15.112:0/4023043671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08c0102ae0 0x7f08c0102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 -- 172.21.15.112:0/4023043671 >> 172.21.15.112:0/4023043671 conn(0x7f08c00fc520 msgr2=0x7f08c00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 -- 172.21.15.112:0/4023043671 shutdown_connections 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.060+0000 7f08c756d640 1 -- 172.21.15.112:0/4023043671 wait complete. 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c756d640 1 Processor -- start 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c756d640 1 -- start start 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c756d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08c0102ae0 0x7f08c019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c756d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c756d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08c010ee10 con 0x7f08c0103400 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c756d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f08c010ec90 con 0x7f08c0102ae0 2024-09-21T01:06:44.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c4b08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c4b08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48620/0 (socket says 172.21.15.112:48620) 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c4b08640 1 -- 172.21.15.112:0/4169139781 learned_addr learned my addr 172.21.15.112:0/4169139781 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c5309640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08c0102ae0 0x7f08c019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c4b08640 1 -- 172.21.15.112:0/4169139781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08c0102ae0 msgr2=0x7f08c019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c4b08640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08c0102ae0 0x7f08c019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c4b08640 1 -- 172.21.15.112:0/4169139781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c0197820 con 0x7f08c0103400 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.061+0000 7f08c4b08640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c019dbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f08b0031460 tx=0x7f08b0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.062+0000 7f08be7fc640 1 -- 172.21.15.112:0/4169139781 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08b003f070 con 0x7f08c0103400 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.062+0000 7f08be7fc640 1 -- 172.21.15.112:0/4169139781 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08b00035f0 con 0x7f08c0103400 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.062+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c0197ab0 con 0x7f08c0103400 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.062+0000 7f08be7fc640 1 -- 172.21.15.112:0/4169139781 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08b0035030 con 0x7f08c0103400 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.062+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c0197fe0 con 0x7f08c0103400 2024-09-21T01:06:44.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.063+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c006abe0 con 0x7f08c0103400 2024-09-21T01:06:44.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.063+0000 7f08be7fc640 1 -- 172.21.15.112:0/4169139781 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f08b0042070 con 0x7f08c0103400 2024-09-21T01:06:44.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.064+0000 7f08be7fc640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08a807af30 0x7f08a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:44.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.064+0000 7f08be7fc640 1 -- 172.21.15.112:0/4169139781 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f08b00bea00 con 0x7f08c0103400 2024-09-21T01:06:44.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.064+0000 7f08c5309640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08a807af30 0x7f08a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:44.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.064+0000 7f08c5309640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08a807af30 0x7f08a807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08b4005fd0 tx=0x7f08b400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:44.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.068+0000 7f08be7fc640 1 -- 172.21.15.112:0/4169139781 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08b0089f00 con 0x7f08c0103400 2024-09-21T01:06:44.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:06:44.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.318+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f08c0105f80 con 0x7f08c0103400 2024-09-21T01:06:44.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.318+0000 7f08be7fc640 1 -- 172.21.15.112:0/4169139781 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f08b008edb0 con 0x7f08c0103400 2024-09-21T01:06:44.320 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:06:44.320 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 6 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 4 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 14 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:06:44.321 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08a807af30 msgr2=0x7f08a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08a807af30 0x7f08a807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08b4005fd0 tx=0x7f08b400b390 comp rx=0 tx=0).stop 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 msgr2=0x7f08c019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c019dbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f08b0031460 tx=0x7f08b0004530 comp rx=0 tx=0).stop 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 shutdown_connections 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f08a807af30 0x7f08a807d3f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08c0103400 0x7f08c019dbe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 --2- 172.21.15.112:0/4169139781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08c0102ae0 0x7f08c019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 >> 172.21.15.112:0/4169139781 conn(0x7f08c00fc520 msgr2=0x7f08c0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 shutdown_connections 2024-09-21T01:06:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:06:44.321+0000 7f08c756d640 1 -- 172.21.15.112:0/4169139781 wait complete. 2024-09-21T01:06:44.862 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:44 smithi112 ceph-mon[109687]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:44.862 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:44 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4169139781' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:44.888 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-21T01:06:45.136 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:06:45.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:44 smithi187 ceph-mon[78584]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:45.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:44 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4169139781' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:06:45.598 INFO:teuthology.orchestra.run.smithi112.stdout:wait for servicemap items w/ changing names to refresh 2024-09-21T01:06:46.282 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'sleep 60' 2024-09-21T01:06:46.554 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:06:46.838 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:46 smithi112 ceph-mon[109687]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:47.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:46 smithi187 ceph-mon[78584]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:49.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:48 smithi187 ceph-mon[78584]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:49.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:48 smithi112 ceph-mon[109687]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:51.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:50 smithi187 ceph-mon[78584]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:51.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:50 smithi112 ceph-mon[109687]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:53.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:52 smithi187 ceph-mon[78584]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:52 smithi112 ceph-mon[109687]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:55.062 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:54 smithi112 ceph-mon[109687]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:55.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:54 smithi187 ceph-mon[78584]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:57.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:56 smithi112 ceph-mon[109687]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:57.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:56 smithi187 ceph-mon[78584]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:59.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:58 smithi187 ceph-mon[78584]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:06:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:06:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:58 smithi112 ceph-mon[109687]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:06:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:06:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:01.087 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:00 smithi112 ceph-mon[109687]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:01.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:00 smithi187 ceph-mon[78584]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:03.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:02 smithi187 ceph-mon[78584]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:02 smithi112 ceph-mon[109687]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:05.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:04 smithi187 ceph-mon[78584]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:04 smithi112 ceph-mon[109687]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:07.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:06 smithi187 ceph-mon[78584]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:06 smithi112 ceph-mon[109687]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:09.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:08 smithi187 ceph-mon[78584]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:08 smithi112 ceph-mon[109687]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:11.076 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:10 smithi187 ceph-mon[78584]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:11.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:10 smithi112 ceph-mon[109687]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:13.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:12 smithi187 ceph-mon[78584]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:13.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:12 smithi112 ceph-mon[109687]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:14.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:15.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:14 smithi187 ceph-mon[78584]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:14 smithi112 ceph-mon[109687]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:17.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:16 smithi187 ceph-mon[78584]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:16 smithi112 ceph-mon[109687]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:19.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:18 smithi187 ceph-mon[78584]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:19.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:18 smithi112 ceph-mon[109687]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:21.243 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:20 smithi187 ceph-mon[78584]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:21.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:20 smithi112 ceph-mon[109687]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:22 smithi112 ceph-mon[109687]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:23.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:22 smithi187 ceph-mon[78584]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:25.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:24 smithi112 ceph-mon[109687]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:25.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:24 smithi187 ceph-mon[78584]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:26 smithi112 ceph-mon[109687]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:27.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:26 smithi187 ceph-mon[78584]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:28 smithi112 ceph-mon[109687]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:28 smithi187 ceph-mon[78584]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:30.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:30.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:30 smithi112 ceph-mon[109687]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:30 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:07:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:30 smithi187 ceph-mon[78584]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:31.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:30 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:07:33.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:32 smithi112 ceph-mon[109687]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:33.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:32 smithi187 ceph-mon[78584]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:34 smithi112 ceph-mon[109687]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:35.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:34 smithi187 ceph-mon[78584]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:37.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:36 smithi112 ceph-mon[109687]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:37.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:36 smithi187 ceph-mon[78584]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:39 smithi112 ceph-mon[109687]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:39.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:39 smithi187 ceph-mon[78584]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:41.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:41 smithi112 ceph-mon[109687]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:41.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:41 smithi187 ceph-mon[78584]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:43.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:43 smithi112 ceph-mon[109687]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:43.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:43 smithi187 ceph-mon[78584]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:44.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:44.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:45.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:45 smithi187 ceph-mon[78584]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:45 smithi112 ceph-mon[109687]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:47.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:47 smithi112 ceph-mon[109687]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:47.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:47 smithi187 ceph-mon[78584]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:47.709 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph orch ps' 2024-09-21T01:07:47.966 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:07:48.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 -- 172.21.15.112:0/3720502663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 msgr2=0x7f2760100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:48.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 --2- 172.21.15.112:0/3720502663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f2760100c40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f275c009880 tx=0x7f275c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 -- 172.21.15.112:0/3720502663 shutdown_connections 2024-09-21T01:07:48.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 --2- 172.21.15.112:0/3720502663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f2760100c40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 --2- 172.21.15.112:0/3720502663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27601067e0 0x7f2760106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 -- 172.21.15.112:0/3720502663 >> 172.21.15.112:0/3720502663 conn(0x7f27600fc4c0 msgr2=0x7f27600fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:48.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 -- 172.21.15.112:0/3720502663 shutdown_connections 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.470+0000 7f2767d3e640 1 -- 172.21.15.112:0/3720502663 wait complete. 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2767d3e640 1 Processor -- start 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2767d3e640 1 -- start start 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2767d3e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f27601987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2767d3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27601067e0 0x7f2760198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2767d3e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f276010dcb0 con 0x7f27601007e0 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2767d3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f276010db30 con 0x7f27601067e0 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2765ada640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f27601987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2765ada640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f27601987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54482/0 (socket says 172.21.15.112:54482) 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2765ada640 1 -- 172.21.15.112:0/245579521 learned_addr learned my addr 172.21.15.112:0/245579521 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f27652d9640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27601067e0 0x7f2760198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2765ada640 1 -- 172.21.15.112:0/245579521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27601067e0 msgr2=0x7f2760198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2765ada640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27601067e0 0x7f2760198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2765ada640 1 -- 172.21.15.112:0/245579521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2760199330 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.471+0000 7f2765ada640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f27601987a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f275400d6f0 tx=0x7f275400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.472+0000 7f2752ffd640 1 -- 172.21.15.112:0/245579521 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2754017070 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.472+0000 7f2752ffd640 1 -- 172.21.15.112:0/245579521 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f275400de00 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.472+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27601a1810 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.472+0000 7f2752ffd640 1 -- 172.21.15.112:0/245579521 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2754004bb0 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.472+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27601a1c10 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.473+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2760101f20 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.473+0000 7f2752ffd640 1 -- 172.21.15.112:0/245579521 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2754004e60 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.474+0000 7f2752ffd640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f274c07af30 0x7f274c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.474+0000 7f2752ffd640 1 -- 172.21.15.112:0/245579521 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f275409dca0 con 0x7f27601007e0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.474+0000 7f27652d9640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f274c07af30 0x7f274c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.474+0000 7f27652d9640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f274c07af30 0x7f274c07d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f276006a6c0 tx=0x7f275c031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:48.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.479+0000 7f2752ffd640 1 -- 172.21.15.112:0/245579521 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27540a2070 con 0x7f27601007e0 2024-09-21T01:07:48.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.661+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 --> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2760108dc0 con 0x7f274c07af30 2024-09-21T01:07:48.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.672+0000 7f2752ffd640 1 -- 172.21.15.112:0/245579521 <== mgr.24473 v2:172.21.15.112:6800/990479702 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f275c004260 con 0x7f274c07af30 2024-09-21T01:07:48.672 INFO:teuthology.orchestra.run.smithi112.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:alertmanager.smithi112 smithi112 *:9093,9094 running (8m) 84s ago 19m 19.8M - 0.27.0 11f11916f8cd 8d4831ade4c9 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi112 smithi112 running (93s) 84s ago 19m 75.3M - 19.3.0-5120-g18432218 ddce307e1f32 03bec30c4fdb 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-exporter.smithi187 smithi187 running (88s) 86s ago 18m 74.4M - 19.3.0-5120-g18432218 ddce307e1f32 ac972aec3eb4 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi112 smithi112 running (6m) 84s ago 19m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 54c80dafbeb7 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:crash.smithi187 smithi187 running (6m) 86s ago 18m 6895k - 19.3.0-5120-g18432218 ddce307e1f32 2f18013ed000 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:grafana.smithi112 smithi112 *:3000 running (7m) 84s ago 18m 77.5M - 10.4.8 5aad1d7cf004 78fef6e41e8f 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.ngfvvg smithi112 running (2m) 84s ago 13m 81.4M - 19.3.0-5120-g18432218 ddce307e1f32 077f4f3983b0 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi112.yntrjn smithi112 running (2m) 84s ago 13m 153M - 19.3.0-5120-g18432218 ddce307e1f32 af0746f04a0d 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.cdcgvm smithi187 running (2m) 86s ago 13m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 f75561e87ea7 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:mds.cephfs.smithi187.osicpg smithi187 running (110s) 86s ago 13m 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 c881201fa04e 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi112.fzmyfw smithi112 *:8443,9283,8765 running (10m) 84s ago 20m 598M - 19.3.0-5120-g18432218 ddce307e1f32 7f4b85336c2c 2024-09-21T01:07:48.673 INFO:teuthology.orchestra.run.smithi112.stdout:mgr.smithi187.hpbgni smithi187 *:8443,9283,8765 running (9m) 86s ago 18m 524M - 19.3.0-5120-g18432218 ddce307e1f32 617e50ca3abc 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi112 smithi112 running (7m) 84s ago 20m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 090f017cf4b9 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:mon.smithi187 smithi187 running (6m) 86s ago 18m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 e3fc2a18eab4 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi112 smithi112 *:9100 running (9m) 84s ago 19m 11.2M - 1.7.0 72c9c2088986 9654e9abeb6f 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:node-exporter.smithi187 smithi187 *:9100 running (9m) 86s ago 18m 11.6M - 1.7.0 72c9c2088986 d44d3979a85f 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 smithi112 running (6m) 84s ago 17m 160M 1216M 19.3.0-5120-g18432218 ddce307e1f32 4e028816cafd 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 smithi112 running (5m) 84s ago 16m 169M 1216M 19.3.0-5120-g18432218 ddce307e1f32 373b804b4706 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 smithi112 running (4m) 84s ago 16m 161M 1216M 19.3.0-5120-g18432218 ddce307e1f32 1c095dd62a18 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 smithi187 running (4m) 86s ago 15m 186M 2240M 19.3.0-5120-g18432218 ddce307e1f32 ea28f02f247b 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 smithi187 running (3m) 86s ago 15m 168M 2240M 19.3.0-5120-g18432218 ddce307e1f32 21ee55f89a04 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 smithi187 running (3m) 86s ago 14m 154M 2240M 19.3.0-5120-g18432218 ddce307e1f32 5c353aaf7054 2024-09-21T01:07:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:prometheus.smithi112 smithi112 *:9095 running (8m) 84s ago 18m 56.2M - 2.51.0 1d3b7f56885b 4e4954912cfb 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f274c07af30 msgr2=0x7f274c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f274c07af30 0x7f274c07d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f276006a6c0 tx=0x7f275c031400 comp rx=0 tx=0).stop 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 msgr2=0x7f27601987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f27601987a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f275400d6f0 tx=0x7f275400dbb0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 shutdown_connections 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f274c07af30 0x7f274c07d3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27601067e0 0x7f2760198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 --2- 172.21.15.112:0/245579521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27601007e0 0x7f27601987a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:48.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 >> 172.21.15.112:0/245579521 conn(0x7f27600fc4c0 msgr2=0x7f27600fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:48.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 shutdown_connections 2024-09-21T01:07:48.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:48.674+0000 7f2767d3e640 1 -- 172.21.15.112:0/245579521 wait complete. 2024-09-21T01:07:49.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:49 smithi112 ceph-mon[109687]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:49.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:49 smithi187 ceph-mon[78584]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:49.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph versions' 2024-09-21T01:07:49.761 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:07:50.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.188+0000 7fcc83693640 1 -- 172.21.15.112:0/3058775467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 msgr2=0x7fcc7c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:50.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.188+0000 7fcc83693640 1 --2- 172.21.15.112:0/3058775467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c107cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009880 tx=0x7fcc7802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.188+0000 7fcc83693640 1 -- 172.21.15.112:0/3058775467 shutdown_connections 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.188+0000 7fcc83693640 1 --2- 172.21.15.112:0/3058775467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc7c101910 0x7fcc7c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.188+0000 7fcc83693640 1 --2- 172.21.15.112:0/3058775467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c107cf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.188+0000 7fcc83693640 1 -- 172.21.15.112:0/3058775467 >> 172.21.15.112:0/3058775467 conn(0x7fcc7c0fd5f0 msgr2=0x7fcc7c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.189+0000 7fcc83693640 1 -- 172.21.15.112:0/3058775467 shutdown_connections 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.189+0000 7fcc83693640 1 -- 172.21.15.112:0/3058775467 wait complete. 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.189+0000 7fcc83693640 1 Processor -- start 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.189+0000 7fcc83693640 1 -- start start 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc83693640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc7c101910 0x7fcc7c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc83693640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc83693640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7c10ede0 con 0x7fcc7c107910 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc83693640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7c10ec60 con 0x7fcc7c101910 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc80c2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc80c2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54504/0 (socket says 172.21.15.112:54504) 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc80c2e640 1 -- 172.21.15.112:0/1478192718 learned_addr learned my addr 172.21.15.112:0/1478192718 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc8142f640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc7c101910 0x7fcc7c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc80c2e640 1 -- 172.21.15.112:0/1478192718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc7c101910 msgr2=0x7fcc7c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc80c2e640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc7c101910 0x7fcc7c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc80c2e640 1 -- 172.21.15.112:0/1478192718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7c1977e0 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc80c2e640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c19dba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00d6f0 tx=0x7fcc6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc727fc640 1 -- 172.21.15.112:0/1478192718 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc6c017070 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7c197ad0 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.190+0000 7fcc727fc640 1 -- 172.21.15.112:0/1478192718 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc6c00de00 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.191+0000 7fcc727fc640 1 -- 172.21.15.112:0/1478192718 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc6c004bb0 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.191+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7c198060 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.191+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7c103050 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.192+0000 7fcc727fc640 1 -- 172.21.15.112:0/1478192718 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fcc6c004e60 con 0x7fcc7c107910 2024-09-21T01:07:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.193+0000 7fcc727fc640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcc6807af30 0x7fcc6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.193+0000 7fcc727fc640 1 -- 172.21.15.112:0/1478192718 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fcc6c09e060 con 0x7fcc7c107910 2024-09-21T01:07:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.193+0000 7fcc8142f640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcc6807af30 0x7fcc6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.194+0000 7fcc8142f640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcc6807af30 0x7fcc6807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcc780096c0 tx=0x7fcc78031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.197+0000 7fcc727fc640 1 -- 172.21.15.112:0/1478192718 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc6c069680 con 0x7fcc7c107910 2024-09-21T01:07:50.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:50 smithi187 ceph-mon[78584]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:50.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.452+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcc7c109e80 con 0x7fcc7c107910 2024-09-21T01:07:50.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:50 smithi112 ceph-mon[109687]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:50.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.452+0000 7fcc727fc640 1 -- 172.21.15.112:0/1478192718 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fcc6c06e530 con 0x7fcc7c107910 2024-09-21T01:07:50.453 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T01:07:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": { 2024-09-21T01:07:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:07:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:07:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": { 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 2 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": { 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 6 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 4 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "overall": { 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)": 14 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-21T01:07:50.454 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T01:07:50.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcc6807af30 msgr2=0x7fcc6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:50.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcc6807af30 0x7fcc6807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcc780096c0 tx=0x7fcc78031400 comp rx=0 tx=0).stop 2024-09-21T01:07:50.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 msgr2=0x7fcc7c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:50.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c19dba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00d6f0 tx=0x7fcc6c00dbb0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 shutdown_connections 2024-09-21T01:07:50.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fcc6807af30 0x7fcc6807d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc7c107910 0x7fcc7c19dba0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.454+0000 7fcc83693640 1 --2- 172.21.15.112:0/1478192718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc7c101910 0x7fcc7c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.455+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 >> 172.21.15.112:0/1478192718 conn(0x7fcc7c0fd5f0 msgr2=0x7fcc7c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:50.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.455+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 shutdown_connections 2024-09-21T01:07:50.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:50.455+0000 7fcc83693640 1 -- 172.21.15.112:0/1478192718 wait complete. 2024-09-21T01:07:51.123 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-21T01:07:51.373 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:07:51.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:51 smithi187 ceph-mon[78584]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:51.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:51 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1478192718' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:07:51.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:51 smithi112 ceph-mon[109687]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:51.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:51 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1478192718' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:07:51.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.842+0000 7fae41e85640 1 -- 172.21.15.112:0/585390925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 msgr2=0x7fae3c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.842+0000 7fae41e85640 1 --2- 172.21.15.112:0/585390925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c107d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009c20 tx=0x7fae2c02a970 comp rx=0 tx=0).stop 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.842+0000 7fae41e85640 1 -- 172.21.15.112:0/585390925 shutdown_connections 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.842+0000 7fae41e85640 1 --2- 172.21.15.112:0/585390925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3c101930 0x7fae3c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.842+0000 7fae41e85640 1 --2- 172.21.15.112:0/585390925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c107d10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.842+0000 7fae41e85640 1 -- 172.21.15.112:0/585390925 >> 172.21.15.112:0/585390925 conn(0x7fae3c0fd630 msgr2=0x7fae3c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.843+0000 7fae41e85640 1 -- 172.21.15.112:0/585390925 shutdown_connections 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.843+0000 7fae41e85640 1 -- 172.21.15.112:0/585390925 wait complete. 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.843+0000 7fae41e85640 1 Processor -- start 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.843+0000 7fae41e85640 1 -- start start 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae41e85640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3c101930 0x7fae3c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae41e85640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae41e85640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c10ede0 con 0x7fae3c107930 2024-09-21T01:07:51.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae41e85640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c10ec60 con 0x7fae3c101930 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54514/0 (socket says 172.21.15.112:54514) 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3affd640 1 -- 172.21.15.112:0/1538987553 learned_addr learned my addr 172.21.15.112:0/1538987553 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3b7fe640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3c101930 0x7fae3c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3affd640 1 -- 172.21.15.112:0/1538987553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3c101930 msgr2=0x7fae3c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3affd640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3c101930 0x7fae3c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3affd640 1 -- 172.21.15.112:0/1538987553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c1977d0 con 0x7fae3c107930 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae3affd640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c19db90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c8a0 tx=0x7fae3000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.844+0000 7fae38ff9640 1 -- 172.21.15.112:0/1538987553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae300079b0 con 0x7fae3c107930 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.845+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3c197ac0 con 0x7fae3c107930 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.845+0000 7fae38ff9640 1 -- 172.21.15.112:0/1538987553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae30007b50 con 0x7fae3c107930 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.845+0000 7fae38ff9640 1 -- 172.21.15.112:0/1538987553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae30018700 con 0x7fae3c107930 2024-09-21T01:07:51.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.845+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3c198050 con 0x7fae3c107930 2024-09-21T01:07:51.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.845+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae3c103070 con 0x7fae3c107930 2024-09-21T01:07:51.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.846+0000 7fae38ff9640 1 -- 172.21.15.112:0/1538987553 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fae30007d00 con 0x7fae3c107930 2024-09-21T01:07:51.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.847+0000 7fae38ff9640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fae2407af30 0x7fae2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:51.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.847+0000 7fae38ff9640 1 -- 172.21.15.112:0/1538987553 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fae3009e320 con 0x7fae3c107930 2024-09-21T01:07:51.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.847+0000 7fae3b7fe640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fae2407af30 0x7fae2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:51.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.847+0000 7fae3b7fe640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fae2407af30 0x7fae2407d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009430 tx=0x7fae2c03c040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:51.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:51.852+0000 7fae38ff9640 1 -- 172.21.15.112:0/1538987553 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae30014030 con 0x7fae3c107930 2024-09-21T01:07:52.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.105+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fae3c104b40 con 0x7fae3c107930 2024-09-21T01:07:52.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.105+0000 7fae38ff9640 1 -- 172.21.15.112:0/1538987553 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fae30069820 con 0x7fae3c107930 2024-09-21T01:07:52.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fae2407af30 msgr2=0x7fae2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:52.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fae2407af30 0x7fae2407d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009430 tx=0x7fae2c03c040 comp rx=0 tx=0).stop 2024-09-21T01:07:52.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 msgr2=0x7fae3c19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c19db90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c8a0 tx=0x7fae3000cd60 comp rx=0 tx=0).stop 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 shutdown_connections 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fae2407af30 0x7fae2407d3f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae3c107930 0x7fae3c19db90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 --2- 172.21.15.112:0/1538987553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3c101930 0x7fae3c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 >> 172.21.15.112:0/1538987553 conn(0x7fae3c0fd630 msgr2=0x7fae3c0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 shutdown_connections 2024-09-21T01:07:52.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:52.108+0000 7fae41e85640 1 -- 172.21.15.112:0/1538987553 wait complete. 2024-09-21T01:07:52.118 INFO:teuthology.orchestra.run.smithi112.stdout:true 2024-09-21T01:07:52.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -e sha1=1843221895adccfb3b692060251dd6a0183bc410 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-21T01:07:53.031 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:07:53.321 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:53 smithi112 ceph-mon[109687]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:53.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:53 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1538987553' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:07:53.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:53 smithi187 ceph-mon[78584]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:53.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:53 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1538987553' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 -- 172.21.15.112:0/23338682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0101930 msgr2=0x7fabd0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 --2- 172.21.15.112:0/23338682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0101930 0x7fabd0101d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009880 tx=0x7fabb802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 -- 172.21.15.112:0/23338682 shutdown_connections 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 --2- 172.21.15.112:0/23338682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0101930 0x7fabd0101d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 --2- 172.21.15.112:0/23338682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0107930 0x7fabd0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 -- 172.21.15.112:0/23338682 >> 172.21.15.112:0/23338682 conn(0x7fabd00fd630 msgr2=0x7fabd00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 -- 172.21.15.112:0/23338682 shutdown_connections 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.533+0000 7fabd69e2640 1 -- 172.21.15.112:0/23338682 wait complete. 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabd69e2640 1 Processor -- start 2024-09-21T01:07:53.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabd69e2640 1 -- start start 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabd69e2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101930 0x7fabd00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabd69e2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0107930 0x7fabd0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabd69e2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010ede0 con 0x7fabd0107930 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabd69e2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010ec60 con 0x7fabd0101930 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0107930 0x7fabd0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0107930 0x7fabd0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50802/0 (socket says 172.21.15.112:50802) 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcf7fe640 1 -- 172.21.15.112:0/1093817006 learned_addr learned my addr 172.21.15.112:0/1093817006 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcffff640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101930 0x7fabd00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcf7fe640 1 -- 172.21.15.112:0/1093817006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101930 msgr2=0x7fabd00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcf7fe640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101930 0x7fabd00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcf7fe640 1 -- 172.21.15.112:0/1093817006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd0074f70 con 0x7fabd0107930 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.534+0000 7fabcffff640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101930 0x7fabd00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.535+0000 7fabcf7fe640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0107930 0x7fabd0074a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabb8031460 tx=0x7fabb80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:53.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.535+0000 7fabcd7fa640 1 -- 172.21.15.112:0/1093817006 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabb803f070 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.535+0000 7fabcd7fa640 1 -- 172.21.15.112:0/1093817006 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fabb80035f0 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.535+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd0075200 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.535+0000 7fabcd7fa640 1 -- 172.21.15.112:0/1093817006 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabb8035030 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.535+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd01a3e10 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.536+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd0103070 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.537+0000 7fabcd7fa640 1 -- 172.21.15.112:0/1093817006 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fabb8042070 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.537+0000 7fabcd7fa640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fabbc07af80 0x7fabbc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.537+0000 7fabcd7fa640 1 -- 172.21.15.112:0/1093817006 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fabb80bea10 con 0x7fabd0107930 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.537+0000 7fabcffff640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fabbc07af80 0x7fabbc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.538+0000 7fabcffff640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fabbc07af80 0x7fabbc07d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009b40 tx=0x7fabc0005e50 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:53.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.542+0000 7fabcd7fa640 1 -- 172.21.15.112:0/1093817006 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fabb8089f90 con 0x7fabd0107930 2024-09-21T01:07:53.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.791+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fabd0109ec0 con 0x7fabd0107930 2024-09-21T01:07:53.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.791+0000 7fabcd7fa640 1 -- 172.21.15.112:0/1093817006 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fabb808ee40 con 0x7fabd0107930 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fabbc07af80 msgr2=0x7fabbc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fabbc07af80 0x7fabbc07d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009b40 tx=0x7fabc0005e50 comp rx=0 tx=0).stop 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0107930 msgr2=0x7fabd0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0107930 0x7fabd0074a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabb8031460 tx=0x7fabb80045e0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 shutdown_connections 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fabbc07af80 0x7fabbc07d440 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabd0107930 0x7fabd0074a30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 --2- 172.21.15.112:0/1093817006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101930 0x7fabd00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 >> 172.21.15.112:0/1093817006 conn(0x7fabd00fd630 msgr2=0x7fabd00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 shutdown_connections 2024-09-21T01:07:53.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:53.793+0000 7fabd69e2640 1 -- 172.21.15.112:0/1093817006 wait complete. 2024-09-21T01:07:53.803 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)" 2024-09-21T01:07:54.111 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:54 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1093817006' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:07:54.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:54 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1093817006' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T01:07:54.574 DEBUG:teuthology.parallel:result is None 2024-09-21T01:07:54.575 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T01:07:54.586 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T01:07:54.586 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T01:07:54.838 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:07:55.239 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:55 smithi112 ceph-mon[109687]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:55.310 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:55 smithi187 ceph-mon[78584]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.316+0000 7f3bfead4640 1 -- 172.21.15.112:0/2315391520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8101910 msgr2=0x7f3bf8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.316+0000 7f3bfead4640 1 --2- 172.21.15.112:0/2315391520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8101910 0x7f3bf8101d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009880 tx=0x7f3be402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 -- 172.21.15.112:0/2315391520 shutdown_connections 2024-09-21T01:07:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 --2- 172.21.15.112:0/2315391520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8101910 0x7f3bf8101d70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 --2- 172.21.15.112:0/2315391520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf8107910 0x7f3bf8107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 -- 172.21.15.112:0/2315391520 >> 172.21.15.112:0/2315391520 conn(0x7f3bf80fd5f0 msgr2=0x7f3bf80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 -- 172.21.15.112:0/2315391520 shutdown_connections 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 -- 172.21.15.112:0/2315391520 wait complete. 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 Processor -- start 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 -- start start 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf8101910 0x7f3bf819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8107910 0x7f3bf819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf810ede0 con 0x7f3bf8107910 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.317+0000 7f3bfead4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf810ec60 con 0x7f3bf8101910 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8107910 0x7f3bf819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8107910 0x7f3bf819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50824/0 (socket says 172.21.15.112:50824) 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf7fff640 1 -- 172.21.15.112:0/4077584423 learned_addr learned my addr 172.21.15.112:0/4077584423 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bfc870640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf8101910 0x7f3bf819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:55.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf7fff640 1 -- 172.21.15.112:0/4077584423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf8101910 msgr2=0x7f3bf819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf7fff640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf8101910 0x7f3bf819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf7fff640 1 -- 172.21.15.112:0/4077584423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf81977f0 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf7fff640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8107910 0x7f3bf819dbb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3be4031460 tx=0x7f3be40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf5ffb640 1 -- 172.21.15.112:0/4077584423 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3be403f070 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf8197a80 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf5ffb640 1 -- 172.21.15.112:0/4077584423 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3be40035f0 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bf5ffb640 1 -- 172.21.15.112:0/4077584423 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3be4035030 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.318+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf8197fb0 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.319+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf8103050 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.320+0000 7f3bf5ffb640 1 -- 172.21.15.112:0/4077584423 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f3be4042070 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.320+0000 7f3bf5ffb640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3be807af30 0x7f3be807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.321+0000 7f3bfc870640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3be807af30 0x7f3be807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.321+0000 7f3bf5ffb640 1 -- 172.21.15.112:0/4077584423 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f3be40beb20 con 0x7f3bf8107910 2024-09-21T01:07:55.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.321+0000 7f3bfc870640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3be807af30 0x7f3be807d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3bec005fd0 tx=0x7f3bec005850 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:55.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.325+0000 7f3bf5ffb640 1 -- 172.21.15.112:0/4077584423 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3be408a020 con 0x7f3bf8107910 2024-09-21T01:07:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.541+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3bf8198d20 con 0x7f3bf8107910 2024-09-21T01:07:55.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.542+0000 7f3bf5ffb640 1 -- 172.21.15.112:0/4077584423 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) ==== 76+0+2019 (secure 0 0 0) 0x7f3be408c020 con 0x7f3bf8107910 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:e35 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:btime 2024-09-21T01:06:29:451960+0000 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:legacy client fscid: 1 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:fs_name cephfs 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 35 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-21T00:53:53.557502+0000 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-21T01:06:28.543249+0000 2024-09-21T01:07:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:tableserver 0 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:root 0 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:session_timeout 60 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:session_autoclose 300 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:max_file_size 1099511627776 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:max_xattr_size 65536 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:required_client_features {} 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure 0 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:last_failure_osd_epoch 80 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:max_mds 1 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:in 0 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:up {0=34314} 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:failed 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:damaged 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:stopped 2024-09-21T01:07:55.545 INFO:teuthology.orchestra.run.smithi112.stdout:data_pools [3] 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:metadata_pool 2 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:inline_data enabled 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:balancer 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:bal_rank_mask -1 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:standby_count_wanted 1 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:qdb_cluster leader: 34314 members: 34314 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.yntrjn{0:34314} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.112:6826/640337427,v1:172.21.15.112:6827/640337427] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:Standby daemons: 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi112.ngfvvg{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6828/428821401,v1:172.21.15.112:6829/428821401] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.cdcgvm{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.187:6824/2863682926,v1:172.21.15.187:6825/2863682926] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:07:55.546 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.cephfs.smithi187.osicpg{-1:44323} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.187:6826/749430440,v1:172.21.15.187:6827/749430440] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:07:55.547 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 35 2024-09-21T01:07:55.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3be807af30 msgr2=0x7f3be807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:55.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3be807af30 0x7f3be807d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3bec005fd0 tx=0x7f3bec005850 comp rx=0 tx=0).stop 2024-09-21T01:07:55.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8107910 msgr2=0x7f3bf819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:55.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8107910 0x7f3bf819dbb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3be4031460 tx=0x7f3be40045e0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 shutdown_connections 2024-09-21T01:07:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f3be807af30 0x7f3be807d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf8107910 0x7f3bf819dbb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 --2- 172.21.15.112:0/4077584423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf8101910 0x7f3bf819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 >> 172.21.15.112:0/4077584423 conn(0x7f3bf80fd5f0 msgr2=0x7f3bf80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 shutdown_connections 2024-09-21T01:07:55.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:55.545+0000 7f3bfead4640 1 -- 172.21.15.112:0/4077584423 wait complete. 2024-09-21T01:07:56.204 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-21T01:07:56.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:07:56.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:56 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4077584423' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:07:56.327 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:56 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4077584423' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:07:56.461 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:07:56.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 -- 172.21.15.112:0/195511253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d8102980 msgr2=0x7f37d8102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 --2- 172.21.15.112:0/195511253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d8102980 0x7f37d8102d60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f37d40098b0 tx=0x7f37d402a4d0 comp rx=0 tx=0).stop 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 -- 172.21.15.112:0/195511253 shutdown_connections 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 --2- 172.21.15.112:0/195511253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37d81032a0 0x7f37d810b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 --2- 172.21.15.112:0/195511253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d8102980 0x7f37d8102d60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 -- 172.21.15.112:0/195511253 >> 172.21.15.112:0/195511253 conn(0x7f37d80fc360 msgr2=0x7f37d80fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 -- 172.21.15.112:0/195511253 shutdown_connections 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.893+0000 7f37de5a1640 1 -- 172.21.15.112:0/195511253 wait complete. 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37de5a1640 1 Processor -- start 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37de5a1640 1 -- start start 2024-09-21T01:07:56.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37de5a1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37d8102980 0x7f37d81005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37de5a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d81032a0 0x7f37d8100b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37de5a1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37d810ebe0 con 0x7f37d81032a0 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37de5a1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f37d810ea60 con 0x7f37d8102980 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37dcd9e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d81032a0 0x7f37d8100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37dcd9e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d81032a0 0x7f37d8100b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50848/0 (socket says 172.21.15.112:50848) 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37dcd9e640 1 -- 172.21.15.112:0/1058603075 learned_addr learned my addr 172.21.15.112:0/1058603075 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37dd59f640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37d8102980 0x7f37d81005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37dcd9e640 1 -- 172.21.15.112:0/1058603075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37d8102980 msgr2=0x7f37d81005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37dcd9e640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37d8102980 0x7f37d81005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.894+0000 7f37dcd9e640 1 -- 172.21.15.112:0/1058603075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8101060 con 0x7f37d81032a0 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.895+0000 7f37dcd9e640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d81032a0 0x7f37d8100b20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e970 tx=0x7f37cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:56.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.895+0000 7f37ca7fc640 1 -- 172.21.15.112:0/1058603075 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37cc00cac0 con 0x7f37d81032a0 2024-09-21T01:07:56.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.895+0000 7f37ca7fc640 1 -- 172.21.15.112:0/1058603075 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37cc00cc60 con 0x7f37d81032a0 2024-09-21T01:07:56.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.895+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d8101350 con 0x7f37d81032a0 2024-09-21T01:07:56.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.895+0000 7f37ca7fc640 1 -- 172.21.15.112:0/1058603075 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37cc018720 con 0x7f37d81032a0 2024-09-21T01:07:56.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.895+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d81a3c90 con 0x7f37d81032a0 2024-09-21T01:07:56.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.897+0000 7f37ca7fc640 1 -- 172.21.15.112:0/1058603075 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f37cc010430 con 0x7f37d81032a0 2024-09-21T01:07:56.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.897+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d806a370 con 0x7f37d81032a0 2024-09-21T01:07:56.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.898+0000 7f37ca7fc640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f37c407af30 0x7f37c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:56.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.898+0000 7f37ca7fc640 1 -- 172.21.15.112:0/1058603075 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f37cc09e720 con 0x7f37d81032a0 2024-09-21T01:07:56.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.898+0000 7f37dd59f640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f37c407af30 0x7f37c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:56.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.898+0000 7f37dd59f640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f37c407af30 0x7f37c407d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37d4000c00 tx=0x7f37d4031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:56.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:56.902+0000 7f37ca7fc640 1 -- 172.21.15.112:0/1058603075 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37cc069c20 con 0x7f37d81032a0 2024-09-21T01:07:57.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.118+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37d8105e50 con 0x7f37d81032a0 2024-09-21T01:07:57.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.119+0000 7f37ca7fc640 1 -- 172.21.15.112:0/1058603075 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5320 (secure 0 0 0) 0x7f37cc06ead0 con 0x7f37d81032a0 2024-09-21T01:07:57.121 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:07:57.121 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":35,"btime":"2024-09-21T01:06:29:451960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6827/749430440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":749430440},{"type":"v1","addr":"172.21.15.187:6827","nonce":749430440}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:06:28.543249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":0,"incarnation":30,"state":"up:active","state_seq":21,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-21T01:07:57.121 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 35 2024-09-21T01:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f37c407af30 msgr2=0x7f37c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f37c407af30 0x7f37c407d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37d4000c00 tx=0x7f37d4031400 comp rx=0 tx=0).stop 2024-09-21T01:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d81032a0 msgr2=0x7f37d8100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d81032a0 0x7f37d8100b20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e970 tx=0x7f37cc00ee30 comp rx=0 tx=0).stop 2024-09-21T01:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 shutdown_connections 2024-09-21T01:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f37c407af30 0x7f37c407d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:57.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d81032a0 0x7f37d8100b20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 --2- 172.21.15.112:0/1058603075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37d8102980 0x7f37d81005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.121+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 >> 172.21.15.112:0/1058603075 conn(0x7f37d80fc360 msgr2=0x7f37d8108e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.122+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 shutdown_connections 2024-09-21T01:07:57.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:57.122+0000 7f37de5a1640 1 -- 172.21.15.112:0/1058603075 wait complete. 2024-09-21T01:07:57.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:57 smithi187 ceph-mon[78584]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:57.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:57 smithi112 ceph-mon[109687]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:57.788 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-21T01:07:57.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 16 2024-09-21T01:07:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:07:58.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:58 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1058603075' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:58.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:58 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1058603075' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:58.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 -- 172.21.15.112:0/2228027849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 msgr2=0x7fed84106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:58.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 --2- 172.21.15.112:0/2228027849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed84106c00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fed74009880 tx=0x7fed7402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 -- 172.21.15.112:0/2228027849 shutdown_connections 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 --2- 172.21.15.112:0/2228027849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed84100820 0x7fed84100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 --2- 172.21.15.112:0/2228027849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed84106c00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 -- 172.21.15.112:0/2228027849 >> 172.21.15.112:0/2228027849 conn(0x7fed840fc520 msgr2=0x7fed840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 -- 172.21.15.112:0/2228027849 shutdown_connections 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.509+0000 7fed890a7640 1 -- 172.21.15.112:0/2228027849 wait complete. 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed890a7640 1 Processor -- start 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed890a7640 1 -- start start 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed890a7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed84100820 0x7fed8419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed890a7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed8419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed890a7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed8410dcf0 con 0x7fed84106820 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed890a7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fed8410db70 con 0x7fed84100820 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed8259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed8419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed8259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed8419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50866/0 (socket says 172.21.15.112:50866) 2024-09-21T01:07:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.510+0000 7fed8259c640 1 -- 172.21.15.112:0/3084507806 learned_addr learned my addr 172.21.15.112:0/3084507806 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed82d9d640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed84100820 0x7fed8419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed8259c640 1 -- 172.21.15.112:0/3084507806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed84100820 msgr2=0x7fed8419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed8259c640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed84100820 0x7fed8419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed8259c640 1 -- 172.21.15.112:0/3084507806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed841977e0 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed8259c640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed8419dba0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00d6f0 tx=0x7fed6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed7bfff640 1 -- 172.21.15.112:0/3084507806 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed6c017070 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed84197ad0 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed7bfff640 1 -- 172.21.15.112:0/3084507806 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed6c00de00 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed7bfff640 1 -- 172.21.15.112:0/3084507806 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed6c004bb0 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.511+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed84198060 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.512+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed84101f60 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.513+0000 7fed7bfff640 1 -- 172.21.15.112:0/3084507806 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fed6c004e60 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.513+0000 7fed7bfff640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed7007af30 0x7fed7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.513+0000 7fed7bfff640 1 -- 172.21.15.112:0/3084507806 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fed6c09dd50 con 0x7fed84106820 2024-09-21T01:07:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.513+0000 7fed82d9d640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed7007af30 0x7fed7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:58.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.514+0000 7fed82d9d640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed7007af30 0x7fed7007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed74031460 tx=0x7fed74009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:58.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.518+0000 7fed7bfff640 1 -- 172.21.15.112:0/3084507806 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed6c069250 con 0x7fed84106820 2024-09-21T01:07:58.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.736+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7fed84109da0 con 0x7fed84106820 2024-09-21T01:07:58.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.736+0000 7fed7bfff640 1 -- 172.21.15.112:0/3084507806 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) ==== 107+0+4478 (secure 0 0 0) 0x7fed6c06e100 con 0x7fed84106820 2024-09-21T01:07:58.738 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:07:58.738 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"btime":"2024-09-21T01:04:46:443273+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T00:54:11.404605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"cephfs.smithi112.ngfvvg","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/1434345295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1434345295},{"type":"v1","addr":"172.21.15.112:6829","nonce":1434345295}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14598,"qdb_cluster":[14598]},"id":1}]} 2024-09-21T01:07:58.738 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed7007af30 msgr2=0x7fed7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed7007af30 0x7fed7007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed74031460 tx=0x7fed74009560 comp rx=0 tx=0).stop 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 msgr2=0x7fed8419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed8419dba0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00d6f0 tx=0x7fed6c00dbb0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 shutdown_connections 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed7007af30 0x7fed7007d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed84106820 0x7fed8419dba0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 --2- 172.21.15.112:0/3084507806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed84100820 0x7fed8419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 >> 172.21.15.112:0/3084507806 conn(0x7fed840fc520 msgr2=0x7fed8406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 shutdown_connections 2024-09-21T01:07:58.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:07:58.739+0000 7fed890a7640 1 -- 172.21.15.112:0/3084507806 wait complete. 2024-09-21T01:07:59.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:59 smithi112 ceph-mon[109687]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:59.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:59.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:07:59 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3084507806' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-21T01:07:59.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 17 2024-09-21T01:07:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:59 smithi187 ceph-mon[78584]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:07:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:07:59.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:07:59 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3084507806' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-21T01:07:59.557 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 -- 172.21.15.112:0/4105860583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68100820 msgr2=0x7f9f68100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/4105860583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68100820 0x7f9f68100c80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009880 tx=0x7f9f5c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 -- 172.21.15.112:0/4105860583 shutdown_connections 2024-09-21T01:08:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/4105860583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68100820 0x7f9f68100c80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/4105860583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f68106820 0x7f9f68106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 -- 172.21.15.112:0/4105860583 >> 172.21.15.112:0/4105860583 conn(0x7f9f680fc520 msgr2=0x7f9f680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 -- 172.21.15.112:0/4105860583 shutdown_connections 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.008+0000 7f9f6cb85640 1 -- 172.21.15.112:0/4105860583 wait complete. 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f6cb85640 1 Processor -- start 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f6cb85640 1 -- start start 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f6cb85640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f68100820 0x7f9f6819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f6cb85640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68106820 0x7f9f6819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f6cb85640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6810dd50 con 0x7f9f68106820 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f6cb85640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6810dbd0 con 0x7f9f68100820 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f65d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68106820 0x7f9f6819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f65d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68106820 0x7f9f6819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50886/0 (socket says 172.21.15.112:50886) 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.009+0000 7f9f65d9b640 1 -- 172.21.15.112:0/3566453644 learned_addr learned my addr 172.21.15.112:0/3566453644 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f6659c640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f68100820 0x7f9f6819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f65d9b640 1 -- 172.21.15.112:0/3566453644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f68100820 msgr2=0x7f9f6819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f65d9b640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f68100820 0x7f9f6819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f65d9b640 1 -- 172.21.15.112:0/3566453644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f68196740 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f65d9b640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68106820 0x7f9f6819cbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c031460 tx=0x7f9f5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f577fe640 1 -- 172.21.15.112:0/3566453644 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f5c03f070 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f681969d0 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f577fe640 1 -- 172.21.15.112:0/3566453644 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f5c004cf0 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f577fe640 1 -- 172.21.15.112:0/3566453644 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f5c035030 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.010+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f68196ed0 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.011+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f68101f60 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.012+0000 7f9f577fe640 1 -- 172.21.15.112:0/3566453644 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9f5c042070 con 0x7f9f68106820 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.012+0000 7f9f577fe640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9f5007af30 0x7f9f5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.012+0000 7f9f577fe640 1 -- 172.21.15.112:0/3566453644 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f9f5c0bec00 con 0x7f9f68106820 2024-09-21T01:08:00.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.012+0000 7f9f6659c640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9f5007af30 0x7f9f5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:00.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.013+0000 7f9f6659c640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9f5007af30 0x7f9f5007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800a810 tx=0x7f9f58008040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:00.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.017+0000 7f9f577fe640 1 -- 172.21.15.112:0/3566453644 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f5c0c4020 con 0x7f9f68106820 2024-09-21T01:08:00.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.231+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f9f68108db0 con 0x7f9f68106820 2024-09-21T01:08:00.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.232+0000 7f9f577fe640 1 -- 172.21.15.112:0/3566453644 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) ==== 107+0+5325 (secure 0 0 0) 0x7f9f5c08a100 con 0x7f9f68106820 2024-09-21T01:08:00.233 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:00.233 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":17,"btime":"2024-09-21T01:04:50:461723+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T00:54:11.404605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"cephfs.smithi112.ngfvvg","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.112:6829/1434345295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":1434345295},{"type":"v1","addr":"172.21.15.112:6829","nonce":1434345295}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14598,"qdb_cluster":[14598]},"id":1}]} 2024-09-21T01:08:00.233 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9f5007af30 msgr2=0x7f9f5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9f5007af30 0x7f9f5007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800a810 tx=0x7f9f58008040 comp rx=0 tx=0).stop 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68106820 msgr2=0x7f9f6819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68106820 0x7f9f6819cbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c031460 tx=0x7f9f5c0048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 shutdown_connections 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f9f5007af30 0x7f9f5007d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f68106820 0x7f9f6819cbb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 --2- 172.21.15.112:0/3566453644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f68100820 0x7f9f6819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 >> 172.21.15.112:0/3566453644 conn(0x7f9f680fc520 msgr2=0x7f9f680fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 shutdown_connections 2024-09-21T01:08:00.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:00.234+0000 7f9f6cb85640 1 -- 172.21.15.112:0/3566453644 wait complete. 2024-09-21T01:08:00.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 18 2024-09-21T01:08:01.083 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:01.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:01 smithi112 ceph-mon[109687]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:01.204 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:01 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/3566453644' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T01:08:01.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:01 smithi187 ceph-mon[78584]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:01.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:01 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/3566453644' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.581+0000 7fed29833640 1 -- 172.21.15.112:0/291403424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24100810 msgr2=0x7fed24100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.581+0000 7fed29833640 1 --2- 172.21.15.112:0/291403424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24100810 0x7fed24100c70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009880 tx=0x7fed0c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.581+0000 7fed29833640 1 -- 172.21.15.112:0/291403424 shutdown_connections 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.581+0000 7fed29833640 1 --2- 172.21.15.112:0/291403424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24100810 0x7fed24100c70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.581+0000 7fed29833640 1 --2- 172.21.15.112:0/291403424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed24106810 0x7fed24106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.581+0000 7fed29833640 1 -- 172.21.15.112:0/291403424 >> 172.21.15.112:0/291403424 conn(0x7fed240fc510 msgr2=0x7fed240fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.582+0000 7fed29833640 1 -- 172.21.15.112:0/291403424 shutdown_connections 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.582+0000 7fed29833640 1 -- 172.21.15.112:0/291403424 wait complete. 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.582+0000 7fed29833640 1 Processor -- start 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.582+0000 7fed29833640 1 -- start start 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed29833640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed24100810 0x7fed24198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:01.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed29833640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24106810 0x7fed24198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed29833640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed2410dce0 con 0x7fed24106810 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed29833640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fed2410db60 con 0x7fed24100810 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24106810 0x7fed24198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24106810 0x7fed24198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50902/0 (socket says 172.21.15.112:50902) 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed1bfff640 1 -- 172.21.15.112:0/2796516071 learned_addr learned my addr 172.21.15.112:0/2796516071 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed22ffd640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed24100810 0x7fed24198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed1bfff640 1 -- 172.21.15.112:0/2796516071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed24100810 msgr2=0x7fed24198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed1bfff640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed24100810 0x7fed24198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed1bfff640 1 -- 172.21.15.112:0/2796516071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed24199370 con 0x7fed24106810 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed1bfff640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24106810 0x7fed24198d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed0c031460 tx=0x7fed0c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed28831640 1 -- 172.21.15.112:0/2796516071 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed0c03f070 con 0x7fed24106810 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed24199600 con 0x7fed24106810 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed28831640 1 -- 172.21.15.112:0/2796516071 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed0c004cf0 con 0x7fed24106810 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed28831640 1 -- 172.21.15.112:0/2796516071 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed0c035030 con 0x7fed24106810 2024-09-21T01:08:01.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.583+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed241a1bb0 con 0x7fed24106810 2024-09-21T01:08:01.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.584+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed24101f50 con 0x7fed24106810 2024-09-21T01:08:01.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.585+0000 7fed28831640 1 -- 172.21.15.112:0/2796516071 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fed0c042070 con 0x7fed24106810 2024-09-21T01:08:01.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.586+0000 7fed28831640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed1007af30 0x7fed1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:01.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.586+0000 7fed28831640 1 -- 172.21.15.112:0/2796516071 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fed0c0bf160 con 0x7fed24106810 2024-09-21T01:08:01.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.586+0000 7fed22ffd640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed1007af30 0x7fed1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:01.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.587+0000 7fed22ffd640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed1007af30 0x7fed1007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fed140058c0 tx=0x7fed1400a250 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:01.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.590+0000 7fed28831640 1 -- 172.21.15.112:0/2796516071 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed0c08a6e0 con 0x7fed24106810 2024-09-21T01:08:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.809+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7fed24100c70 con 0x7fed24106810 2024-09-21T01:08:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.809+0000 7fed28831640 1 -- 172.21.15.112:0/2796516071 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) ==== 107+0+4455 (secure 0 0 0) 0x7fed24100c70 con 0x7fed24106810 2024-09-21T01:08:01.811 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:01.811 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"btime":"2024-09-21T01:05:02:783477+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:02.783473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2024-09-21T01:08:01.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.811+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed1007af30 msgr2=0x7fed1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:01.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.811+0000 7fed29833640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed1007af30 0x7fed1007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fed140058c0 tx=0x7fed1400a250 comp rx=0 tx=0).stop 2024-09-21T01:08:01.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.811+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24106810 msgr2=0x7fed24198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.811+0000 7fed29833640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24106810 0x7fed24198d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed0c031460 tx=0x7fed0c0048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.812+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 shutdown_connections 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.812+0000 7fed29833640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fed1007af30 0x7fed1007d3f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.812+0000 7fed29833640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed24106810 0x7fed24198d70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.812+0000 7fed29833640 1 --2- 172.21.15.112:0/2796516071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed24100810 0x7fed24198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.812+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 >> 172.21.15.112:0/2796516071 conn(0x7fed240fc510 msgr2=0x7fed240fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.812+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 shutdown_connections 2024-09-21T01:08:01.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:01.812+0000 7fed29833640 1 -- 172.21.15.112:0/2796516071 wait complete. 2024-09-21T01:08:02.178 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:02 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2796516071' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T01:08:02.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:02 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2796516071' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T01:08:02.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 19 2024-09-21T01:08:02.866 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:03.246 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:03 smithi112 ceph-mon[109687]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:03.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 -- 172.21.15.112:0/2534351051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141067e0 msgr2=0x7fb514106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 --2- 172.21.15.112:0/2534351051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141067e0 0x7fb514106bc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb504009880 tx=0x7fb50402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 -- 172.21.15.112:0/2534351051 shutdown_connections 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 --2- 172.21.15.112:0/2534351051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5141007e0 0x7fb514100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 --2- 172.21.15.112:0/2534351051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141067e0 0x7fb514106bc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 -- 172.21.15.112:0/2534351051 >> 172.21.15.112:0/2534351051 conn(0x7fb5140fc4c0 msgr2=0x7fb5140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 -- 172.21.15.112:0/2534351051 shutdown_connections 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 -- 172.21.15.112:0/2534351051 wait complete. 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 Processor -- start 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.325+0000 7fb51a972640 1 -- start start 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb51a972640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141007e0 0x7fb5141988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:03.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb51a972640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5141067e0 0x7fb514198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb51a972640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb51410dd10 con 0x7fb5141007e0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb51a972640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb51410db90 con 0x7fb5141067e0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb513fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141007e0 0x7fb5141988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb513fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141007e0 0x7fb5141988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43994/0 (socket says 172.21.15.112:43994) 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb513fff640 1 -- 172.21.15.112:0/1911524305 learned_addr learned my addr 172.21.15.112:0/1911524305 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb5137fe640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5141067e0 0x7fb514198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb513fff640 1 -- 172.21.15.112:0/1911524305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5141067e0 msgr2=0x7fb514198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb513fff640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5141067e0 0x7fb514198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb513fff640 1 -- 172.21.15.112:0/1911524305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb514199400 con 0x7fb5141007e0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.326+0000 7fb513fff640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141007e0 0x7fb5141988c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb504031460 tx=0x7fb5040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.327+0000 7fb5117fa640 1 -- 172.21.15.112:0/1911524305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb50403f070 con 0x7fb5141007e0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.327+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb514199690 con 0x7fb5141007e0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.327+0000 7fb5117fa640 1 -- 172.21.15.112:0/1911524305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb504004cf0 con 0x7fb5141007e0 2024-09-21T01:08:03.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.327+0000 7fb5117fa640 1 -- 172.21.15.112:0/1911524305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb504035030 con 0x7fb5141007e0 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.327+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5141a1c40 con 0x7fb5141007e0 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.328+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb514101f20 con 0x7fb5141007e0 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.328+0000 7fb5117fa640 1 -- 172.21.15.112:0/1911524305 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb504042070 con 0x7fb5141007e0 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.329+0000 7fb5117fa640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb50007af30 0x7fb50007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.329+0000 7fb5117fa640 1 -- 172.21.15.112:0/1911524305 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fb5040beb90 con 0x7fb5141007e0 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.329+0000 7fb5137fe640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb50007af30 0x7fb50007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.329+0000 7fb5137fe640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb50007af30 0x7fb50007d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb51406a680 tx=0x7fb4fc009110 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:03.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.334+0000 7fb5117fa640 1 -- 172.21.15.112:0/1911524305 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb50408a090 con 0x7fb5141007e0 2024-09-21T01:08:03.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:03 smithi187 ceph-mon[78584]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:03.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.550+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7fb51406a120 con 0x7fb5141007e0 2024-09-21T01:08:03.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.551+0000 7fb5117fa640 1 -- 172.21.15.112:0/1911524305 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) ==== 107+0+4466 (secure 0 0 0) 0x7fb50408ef40 con 0x7fb5141007e0 2024-09-21T01:08:03.551 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:03.552 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":19,"btime":"2024-09-21T01:05:02:789086+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:02.789072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":0,"incarnation":19,"state":"up:replay","state_seq":3,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:03.552 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 19 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb50007af30 msgr2=0x7fb50007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb50007af30 0x7fb50007d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb51406a680 tx=0x7fb4fc009110 comp rx=0 tx=0).stop 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141007e0 msgr2=0x7fb5141988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141007e0 0x7fb5141988c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb504031460 tx=0x7fb5040048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 shutdown_connections 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb50007af30 0x7fb50007d3f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5141067e0 0x7fb514198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 --2- 172.21.15.112:0/1911524305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5141007e0 0x7fb5141988c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 >> 172.21.15.112:0/1911524305 conn(0x7fb5140fc4c0 msgr2=0x7fb5140fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 shutdown_connections 2024-09-21T01:08:03.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:03.553+0000 7fb51a972640 1 -- 172.21.15.112:0/1911524305 wait complete. 2024-09-21T01:08:04.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:04 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1911524305' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T01:08:04.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 20 2024-09-21T01:08:04.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:04 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1911524305' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T01:08:04.556 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 -- 172.21.15.112:0/3728995960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c107910 msgr2=0x7f051c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 --2- 172.21.15.112:0/3728995960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c107910 0x7f051c107cf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f050c009880 tx=0x7f050c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 -- 172.21.15.112:0/3728995960 shutdown_connections 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 --2- 172.21.15.112:0/3728995960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f051c101910 0x7f051c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 --2- 172.21.15.112:0/3728995960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c107910 0x7f051c107cf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 -- 172.21.15.112:0/3728995960 >> 172.21.15.112:0/3728995960 conn(0x7f051c0fd5f0 msgr2=0x7f051c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 -- 172.21.15.112:0/3728995960 shutdown_connections 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 -- 172.21.15.112:0/3728995960 wait complete. 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 Processor -- start 2024-09-21T01:08:05.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.043+0000 7f05222fa640 1 -- start start 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f05222fa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c101910 0x7f051c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f05222fa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f051c107910 0x7f051c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f05222fa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f051c10edc0 con 0x7f051c101910 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f05222fa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f051c10ec40 con 0x7f051c107910 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c101910 0x7f051c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c101910 0x7f051c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44006/0 (socket says 172.21.15.112:44006) 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051bfff640 1 -- 172.21.15.112:0/1664159510 learned_addr learned my addr 172.21.15.112:0/1664159510 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051b7fe640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f051c107910 0x7f051c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051bfff640 1 -- 172.21.15.112:0/1664159510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f051c107910 msgr2=0x7f051c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051bfff640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f051c107910 0x7f051c19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051bfff640 1 -- 172.21.15.112:0/1664159510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c1977b0 con 0x7f051c101910 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f051bfff640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c101910 0x7f051c19d630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f050c031460 tx=0x7f050c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.044+0000 7f05197fa640 1 -- 172.21.15.112:0/1664159510 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f050c03f070 con 0x7f051c101910 2024-09-21T01:08:05.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.045+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c197a40 con 0x7f051c101910 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.045+0000 7f05197fa640 1 -- 172.21.15.112:0/1664159510 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f050c0035f0 con 0x7f051c101910 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.045+0000 7f05197fa640 1 -- 172.21.15.112:0/1664159510 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f050c035030 con 0x7f051c101910 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.045+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c197f70 con 0x7f051c101910 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.046+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051c103050 con 0x7f051c101910 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.046+0000 7f05197fa640 1 -- 172.21.15.112:0/1664159510 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f050c042070 con 0x7f051c101910 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.047+0000 7f05197fa640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f050807af30 0x7f050807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.047+0000 7f05197fa640 1 -- 172.21.15.112:0/1664159510 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f050c0beb20 con 0x7f051c101910 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.047+0000 7f051b7fe640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f050807af30 0x7f050807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.047+0000 7f051b7fe640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f050807af30 0x7f050807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0504005fd0 tx=0x7f0504005850 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:05.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.051+0000 7f05197fa640 1 -- 172.21.15.112:0/1664159510 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f050c08a020 con 0x7f051c101910 2024-09-21T01:08:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:05 smithi112 ceph-mon[109687]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:05.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.267+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f051c104b20 con 0x7f051c101910 2024-09-21T01:08:05.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.268+0000 7f05197fa640 1 -- 172.21.15.112:0/1664159510 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) ==== 107+0+4471 (secure 0 0 0) 0x7f050c08c020 con 0x7f051c101910 2024-09-21T01:08:05.269 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:05.269 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"btime":"2024-09-21T01:05:11:105575+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:11.101895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":169,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:05.269 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 20 2024-09-21T01:08:05.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f050807af30 msgr2=0x7f050807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:05.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f050807af30 0x7f050807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0504005fd0 tx=0x7f0504005850 comp rx=0 tx=0).stop 2024-09-21T01:08:05.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c101910 msgr2=0x7f051c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:05.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c101910 0x7f051c19d630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f050c031460 tx=0x7f050c0045e0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 shutdown_connections 2024-09-21T01:08:05.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f050807af30 0x7f050807d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f051c107910 0x7f051c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 --2- 172.21.15.112:0/1664159510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f051c101910 0x7f051c19d630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:05.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 >> 172.21.15.112:0/1664159510 conn(0x7f051c0fd5f0 msgr2=0x7f051c0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:05.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 shutdown_connections 2024-09-21T01:08:05.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:05.271+0000 7f05222fa640 1 -- 172.21.15.112:0/1664159510 wait complete. 2024-09-21T01:08:05.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:05 smithi187 ceph-mon[78584]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:05.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 21 2024-09-21T01:08:06.143 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:06.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:06 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1664159510' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T01:08:06.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:06 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1664159510' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.567+0000 7f2600fd2640 1 -- 172.21.15.112:0/2033099482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 msgr2=0x7f25fc102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.567+0000 7f2600fd2640 1 --2- 172.21.15.112:0/2033099482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc102e80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009880 tx=0x7f25ec02a530 comp rx=0 tx=0).stop 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.567+0000 7f2600fd2640 1 -- 172.21.15.112:0/2033099482 shutdown_connections 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.567+0000 7f2600fd2640 1 --2- 172.21.15.112:0/2033099482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25fc1033c0 0x7f25fc10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.567+0000 7f2600fd2640 1 --2- 172.21.15.112:0/2033099482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc102e80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.567+0000 7f2600fd2640 1 -- 172.21.15.112:0/2033099482 >> 172.21.15.112:0/2033099482 conn(0x7f25fc0fc4c0 msgr2=0x7f25fc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 -- 172.21.15.112:0/2033099482 shutdown_connections 2024-09-21T01:08:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 -- 172.21.15.112:0/2033099482 wait complete. 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 Processor -- start 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 -- start start 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25fc1033c0 0x7f25fc19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10ee30 con 0x7f25fc102aa0 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.568+0000 7f2600fd2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10ecb0 con 0x7f25fc1033c0 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25fa59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25fa59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc19d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44016/0 (socket says 172.21.15.112:44016) 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25fa59c640 1 -- 172.21.15.112:0/4046609084 learned_addr learned my addr 172.21.15.112:0/4046609084 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25fa59c640 1 -- 172.21.15.112:0/4046609084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25fc1033c0 msgr2=0x7f25fc19dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25f9d9b640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25fc1033c0 0x7f25fc19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25fa59c640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25fc1033c0 0x7f25fc19dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25fa59c640 1 -- 172.21.15.112:0/4046609084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc1978e0 con 0x7f25fc102aa0 2024-09-21T01:08:06.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25f9d9b640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25fc1033c0 0x7f25fc19dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25fa59c640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc19d720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25ec031460 tx=0x7f25ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25eb7fe640 1 -- 172.21.15.112:0/4046609084 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25ec03f070 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc197b70 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25eb7fe640 1 -- 172.21.15.112:0/4046609084 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25ec004cf0 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f25eb7fe640 1 -- 172.21.15.112:0/4046609084 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25ec035030 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.569+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc1980a0 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.570+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc06a410 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.571+0000 7f25eb7fe640 1 -- 172.21.15.112:0/4046609084 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f25ec042070 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.571+0000 7f25eb7fe640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f25e407af30 0x7f25e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.572+0000 7f25eb7fe640 1 -- 172.21.15.112:0/4046609084 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f25ec0bec00 con 0x7f25fc102aa0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.572+0000 7f25f9d9b640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f25e407af30 0x7f25e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.572+0000 7f25f9d9b640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f25e407af30 0x7f25e407d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f25f0006fd0 tx=0x7f25f0008040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.576+0000 7f25eb7fe640 1 -- 172.21.15.112:0/4046609084 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25ec0c4020 con 0x7f25fc102aa0 2024-09-21T01:08:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.789+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f25fc198e10 con 0x7f25fc102aa0 2024-09-21T01:08:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.790+0000 7f25eb7fe640 1 -- 172.21.15.112:0/4046609084 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) ==== 107+0+4468 (secure 0 0 0) 0x7f25ec08a100 con 0x7f25fc102aa0 2024-09-21T01:08:06.791 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:06.791 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":21,"btime":"2024-09-21T01:05:12:111267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:11.114290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":170,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:06.791 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 21 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f25e407af30 msgr2=0x7f25e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f25e407af30 0x7f25e407d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f25f0006fd0 tx=0x7f25f0008040 comp rx=0 tx=0).stop 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 msgr2=0x7f25fc19d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc19d720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25ec031460 tx=0x7f25ec0048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 shutdown_connections 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f25e407af30 0x7f25e407d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25fc1033c0 0x7f25fc19dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 --2- 172.21.15.112:0/4046609084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25fc102aa0 0x7f25fc19d720 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.792+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 >> 172.21.15.112:0/4046609084 conn(0x7f25fc0fc4c0 msgr2=0x7f25fc108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:06.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.793+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 shutdown_connections 2024-09-21T01:08:06.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:06.793+0000 7f2600fd2640 1 -- 172.21.15.112:0/4046609084 wait complete. 2024-09-21T01:08:07.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:07 smithi112 ceph-mon[109687]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:08.074 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:07 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4046609084' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T01:08:08.075 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:07 smithi187 ceph-mon[78584]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:08.075 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:07 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4046609084' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T01:08:08.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 22 2024-09-21T01:08:08.344 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 -- 172.21.15.112:0/934624285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 msgr2=0x7fa6c4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/934624285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4106bc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009880 tx=0x7fa6b802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 -- 172.21.15.112:0/934624285 shutdown_connections 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/934624285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c41007e0 0x7fa6c4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/934624285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4106bc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 -- 172.21.15.112:0/934624285 >> 172.21.15.112:0/934624285 conn(0x7fa6c40fc4c0 msgr2=0x7fa6c40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 -- 172.21.15.112:0/934624285 shutdown_connections 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 -- 172.21.15.112:0/934624285 wait complete. 2024-09-21T01:08:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 Processor -- start 2024-09-21T01:08:08.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.834+0000 7fa6cb94a640 1 -- start start 2024-09-21T01:08:08.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6cb94a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c41007e0 0x7fa6c41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:08.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6cb94a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:08.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6cb94a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c410dd10 con 0x7fa6c41067e0 2024-09-21T01:08:08.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6cb94a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c410db90 con 0x7fa6c41007e0 2024-09-21T01:08:08.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c8ee5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:08.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c8ee5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44024/0 (socket says 172.21.15.112:44024) 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c8ee5640 1 -- 172.21.15.112:0/425802338 learned_addr learned my addr 172.21.15.112:0/425802338 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c96e6640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c41007e0 0x7fa6c41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c8ee5640 1 -- 172.21.15.112:0/425802338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c41007e0 msgr2=0x7fa6c41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c8ee5640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c41007e0 0x7fa6c41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c8ee5640 1 -- 172.21.15.112:0/425802338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c4199400 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6c8ee5640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4198e00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b420 tx=0x7fa6c000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6b67fc640 1 -- 172.21.15.112:0/425802338 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6c0011630 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c41996f0 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6b67fc640 1 -- 172.21.15.112:0/425802338 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6c0016070 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6b67fc640 1 -- 172.21.15.112:0/425802338 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6c0010d40 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.835+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c41a1cf0 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.836+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c4101f20 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.837+0000 7fa6b67fc640 1 -- 172.21.15.112:0/425802338 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fa6c001b460 con 0x7fa6c41067e0 2024-09-21T01:08:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.837+0000 7fa6b67fc640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa6b007af30 0x7fa6b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.838+0000 7fa6c96e6640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa6b007af30 0x7fa6b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.838+0000 7fa6b67fc640 1 -- 172.21.15.112:0/425802338 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fa6c009d840 con 0x7fa6c41067e0 2024-09-21T01:08:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.838+0000 7fa6c96e6640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa6b007af30 0x7fa6b007d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80096c0 tx=0x7fa6b8031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:08.842+0000 7fa6b67fc640 1 -- 172.21.15.112:0/425802338 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6c41996f0 con 0x7fa6c41067e0 2024-09-21T01:08:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.054+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7fa6c4108d50 con 0x7fa6c41067e0 2024-09-21T01:08:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.055+0000 7fa6b67fc640 1 -- 172.21.15.112:0/425802338 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) ==== 107+0+5324 (secure 0 0 0) 0x7fa6c0021250 con 0x7fa6c41067e0 2024-09-21T01:08:09.056 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:09.056 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-21T01:05:13:117062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:13.117057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi187.cdcgvm","rank":0,"incarnation":19,"state":"up:active","state_seq":171,"addr":"172.21.15.187:6825/3413694617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3413694617},{"type":"v1","addr":"172.21.15.187:6825","nonce":3413694617}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24301,"qdb_cluster":[24301]},"id":1}]} 2024-09-21T01:08:09.056 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-21T01:08:09.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa6b007af30 msgr2=0x7fa6b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:09.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa6b007af30 0x7fa6b007d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80096c0 tx=0x7fa6b8031400 comp rx=0 tx=0).stop 2024-09-21T01:08:09.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 msgr2=0x7fa6c4198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4198e00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b420 tx=0x7fa6c000b8e0 comp rx=0 tx=0).stop 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 shutdown_connections 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fa6b007af30 0x7fa6b007d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c41067e0 0x7fa6c4198e00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 --2- 172.21.15.112:0/425802338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c41007e0 0x7fa6c41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 >> 172.21.15.112:0/425802338 conn(0x7fa6c40fc4c0 msgr2=0x7fa6c40fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 shutdown_connections 2024-09-21T01:08:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:09.057+0000 7fa6cb94a640 1 -- 172.21.15.112:0/425802338 wait complete. 2024-09-21T01:08:09.413 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:09 smithi187 ceph-mon[78584]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:09.415 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:09 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/425802338' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T01:08:09.504 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:09 smithi112 ceph-mon[109687]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:09.504 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:09 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/425802338' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T01:08:09.771 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 23 2024-09-21T01:08:10.017 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:10.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 -- 172.21.15.112:0/1386857677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 msgr2=0x7f6134107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:10.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 --2- 172.21.15.112:0/1386857677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f6134107d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6130009880 tx=0x7f613002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 -- 172.21.15.112:0/1386857677 shutdown_connections 2024-09-21T01:08:10.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 --2- 172.21.15.112:0/1386857677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6134101930 0x7f6134101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 --2- 172.21.15.112:0/1386857677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f6134107d10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 -- 172.21.15.112:0/1386857677 >> 172.21.15.112:0/1386857677 conn(0x7f61340fd630 msgr2=0x7f61340ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:10.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 -- 172.21.15.112:0/1386857677 shutdown_connections 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.476+0000 7f613c198640 1 -- 172.21.15.112:0/1386857677 wait complete. 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f613c198640 1 Processor -- start 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f613c198640 1 -- start start 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f613c198640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6134101930 0x7f613419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f613c198640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f613419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f613c198640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f613410ee60 con 0x7f6134107930 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f613c198640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f613410ece0 con 0x7f6134101930 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f6139733640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f613419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f6139733640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f613419dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44042/0 (socket says 172.21.15.112:44042) 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f6139733640 1 -- 172.21.15.112:0/2000329747 learned_addr learned my addr 172.21.15.112:0/2000329747 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.477+0000 7f6139733640 1 -- 172.21.15.112:0/2000329747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6134101930 msgr2=0x7f613419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f6139f34640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6134101930 0x7f613419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f6139733640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6134101930 0x7f613419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f6139733640 1 -- 172.21.15.112:0/2000329747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6134197890 con 0x7f6134107930 2024-09-21T01:08:10.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f6139733640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f613419dc10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f612400b420 tx=0x7f612400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f612affd640 1 -- 172.21.15.112:0/2000329747 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6124011630 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f612affd640 1 -- 172.21.15.112:0/2000329747 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6124016070 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6134197b80 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f612affd640 1 -- 172.21.15.112:0/2000329747 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6124010d40 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.478+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6134198110 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.479+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6134103070 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.480+0000 7f612affd640 1 -- 172.21.15.112:0/2000329747 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f612401b460 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.480+0000 7f612affd640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f612007af30 0x7f612007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.480+0000 7f612affd640 1 -- 172.21.15.112:0/2000329747 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f612409d8b0 con 0x7f6134107930 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.480+0000 7f6139f34640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f612007af30 0x7f612007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.481+0000 7f6139f34640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f612007af30 0x7f612007d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6130031460 tx=0x7f6130009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:10.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.485+0000 7f612affd640 1 -- 172.21.15.112:0/2000329747 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6124021250 con 0x7f6134107930 2024-09-21T01:08:10.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.697+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f6134109f00 con 0x7f6134107930 2024-09-21T01:08:10.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.698+0000 7f612affd640 1 -- 172.21.15.112:0/2000329747 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) ==== 107+0+4452 (secure 0 0 0) 0x7f6124068db0 con 0x7f6134107930 2024-09-21T01:08:10.699 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:10.699 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":23,"btime":"2024-09-21T01:05:25:327252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:25.327247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 23 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f612007af30 msgr2=0x7f612007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f612007af30 0x7f612007d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6130031460 tx=0x7f6130009560 comp rx=0 tx=0).stop 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 msgr2=0x7f613419dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f613419dc10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f612400b420 tx=0x7f612400b8e0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 shutdown_connections 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f612007af30 0x7f612007d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6134107930 0x7f613419dc10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 --2- 172.21.15.112:0/2000329747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6134101930 0x7f613419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 >> 172.21.15.112:0/2000329747 conn(0x7f61340fd630 msgr2=0x7f61340fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 shutdown_connections 2024-09-21T01:08:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:10.700+0000 7f613c198640 1 -- 172.21.15.112:0/2000329747 wait complete. 2024-09-21T01:08:11.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:11 smithi112 ceph-mon[109687]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:11.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:11 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2000329747' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T01:08:11.327 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 24 2024-09-21T01:08:11.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:11 smithi187 ceph-mon[78584]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:11.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:11 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2000329747' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T01:08:11.575 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/4294823733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 msgr2=0x7f1bf4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/4294823733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf4100c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009880 tx=0x7f1be802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/4294823733 shutdown_connections 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/4294823733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf4100c80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/4294823733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf4106820 0x7f1bf4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/4294823733 >> 172.21.15.112:0/4294823733 conn(0x7f1bf40fc520 msgr2=0x7f1bf40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/4294823733 shutdown_connections 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.048+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/4294823733 wait complete. 2024-09-21T01:08:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.049+0000 7f1bfa2b7640 1 Processor -- start 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.049+0000 7f1bfa2b7640 1 -- start start 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.049+0000 7f1bfa2b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.049+0000 7f1bfa2b7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf4106820 0x7f1bf419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.049+0000 7f1bfa2b7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf410dcf0 con 0x7f1bf4100820 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.049+0000 7f1bfa2b7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf410db70 con 0x7f1bf4106820 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf419c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53784/0 (socket says 172.21.15.112:53784) 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf3fff640 1 -- 172.21.15.112:0/1525488327 learned_addr learned my addr 172.21.15.112:0/1525488327 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf37fe640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf4106820 0x7f1bf419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf3fff640 1 -- 172.21.15.112:0/1525488327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf4106820 msgr2=0x7f1bf419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf3fff640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf4106820 0x7f1bf419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf3fff640 1 -- 172.21.15.112:0/1525488327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf4196700 con 0x7f1bf4100820 2024-09-21T01:08:12.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf37fe640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf4106820 0x7f1bf419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf3fff640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf419c630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009860 tx=0x7f1be4009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf17fa640 1 -- 172.21.15.112:0/1525488327 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1be4005020 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf4196990 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf17fa640 1 -- 172.21.15.112:0/1525488327 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1be40047a0 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bf17fa640 1 -- 172.21.15.112:0/1525488327 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1be4007b00 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.050+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf4196ef0 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.051+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf4101f60 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.052+0000 7f1bf17fa640 1 -- 172.21.15.112:0/1525488327 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f1be4004950 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.052+0000 7f1bf17fa640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1bdc07af30 0x7f1bdc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.053+0000 7f1bf17fa640 1 -- 172.21.15.112:0/1525488327 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f1be4013030 con 0x7f1bf4100820 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.053+0000 7f1bf37fe640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1bdc07af30 0x7f1bdc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.053+0000 7f1bf37fe640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1bdc07af30 0x7f1bdc07d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4197f50 tx=0x7f1be8031400 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.057+0000 7f1bf17fa640 1 -- 172.21.15.112:0/1525488327 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1be406aec0 con 0x7f1bf4100820 2024-09-21T01:08:12.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.276+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f1bf41971a0 con 0x7f1bf4100820 2024-09-21T01:08:12.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.276+0000 7f1bf17fa640 1 -- 172.21.15.112:0/1525488327 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) ==== 107+0+4463 (secure 0 0 0) 0x7f1be406f020 con 0x7f1bf4100820 2024-09-21T01:08:12.277 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:12.277 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"btime":"2024-09-21T01:05:25:333148+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:25.333126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:12.277 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2024-09-21T01:08:12.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1bdc07af30 msgr2=0x7f1bdc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:12.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1bdc07af30 0x7f1bdc07d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4197f50 tx=0x7f1be8031400 comp rx=0 tx=0).stop 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 msgr2=0x7f1bf419c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf419c630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009860 tx=0x7f1be4009d20 comp rx=0 tx=0).stop 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 shutdown_connections 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f1bdc07af30 0x7f1bdc07d3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf4106820 0x7f1bf419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 --2- 172.21.15.112:0/1525488327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bf4100820 0x7f1bf419c630 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 >> 172.21.15.112:0/1525488327 conn(0x7f1bf40fc520 msgr2=0x7f1bf40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 shutdown_connections 2024-09-21T01:08:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:12.279+0000 7f1bfa2b7640 1 -- 172.21.15.112:0/1525488327 wait complete. 2024-09-21T01:08:12.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 25 2024-09-21T01:08:13.227 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:13.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:13 smithi112 ceph-mon[109687]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:13.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:13 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1525488327' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T01:08:13.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:13 smithi187 ceph-mon[78584]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:13.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:13 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1525488327' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 -- 172.21.15.112:0/2385873219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81008d0 msgr2=0x7f95f8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 --2- 172.21.15.112:0/2385873219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81008d0 0x7f95f8100cb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009880 tx=0x7f95ec02a530 comp rx=0 tx=0).stop 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 -- 172.21.15.112:0/2385873219 shutdown_connections 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 --2- 172.21.15.112:0/2385873219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f81011f0 0x7f95f81056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 --2- 172.21.15.112:0/2385873219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81008d0 0x7f95f8100cb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 -- 172.21.15.112:0/2385873219 >> 172.21.15.112:0/2385873219 conn(0x7f95f80fc520 msgr2=0x7f95f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 -- 172.21.15.112:0/2385873219 shutdown_connections 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.722+0000 7f95fef03640 1 -- 172.21.15.112:0/2385873219 wait complete. 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95fef03640 1 Processor -- start 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95fef03640 1 -- start start 2024-09-21T01:08:13.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95fef03640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f81008d0 0x7f95f819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95fef03640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81011f0 0x7f95f819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95fef03640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81153f0 con 0x7f95f81011f0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95fef03640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8115270 con 0x7f95f81008d0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81011f0 0x7f95f819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81011f0 0x7f95f819e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53804/0 (socket says 172.21.15.112:53804) 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95f7fff640 1 -- 172.21.15.112:0/197955278 learned_addr learned my addr 172.21.15.112:0/197955278 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95fcc9f640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f81008d0 0x7f95f819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95f7fff640 1 -- 172.21.15.112:0/197955278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f81008d0 msgr2=0x7f95f819dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95f7fff640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f81008d0 0x7f95f819dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.723+0000 7f95f7fff640 1 -- 172.21.15.112:0/197955278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81a28a0 con 0x7f95f81011f0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.724+0000 7f95f7fff640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81011f0 0x7f95f819e510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f95e400c8c0 tx=0x7f95e400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.724+0000 7f95f5ffb640 1 -- 172.21.15.112:0/197955278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95e4004020 con 0x7f95f81011f0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.724+0000 7f95f5ffb640 1 -- 172.21.15.112:0/197955278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95e40041c0 con 0x7f95f81011f0 2024-09-21T01:08:13.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.724+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81a2b90 con 0x7f95f81011f0 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.724+0000 7f95f5ffb640 1 -- 172.21.15.112:0/197955278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95e40047a0 con 0x7f95f81011f0 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.724+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81a3120 con 0x7f95f81011f0 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.725+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f806abe0 con 0x7f95f81011f0 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.726+0000 7f95f5ffb640 1 -- 172.21.15.112:0/197955278 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f95e40079b0 con 0x7f95f81011f0 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.726+0000 7f95f5ffb640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f95e807af30 0x7f95e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.726+0000 7f95f5ffb640 1 -- 172.21.15.112:0/197955278 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f95e409e040 con 0x7f95f81011f0 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.726+0000 7f95fcc9f640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f95e807af30 0x7f95e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:13.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.727+0000 7f95fcc9f640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f95e807af30 0x7f95e807d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95ec031460 tx=0x7f95ec005bd0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:13.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.731+0000 7f95f5ffb640 1 -- 172.21.15.112:0/197955278 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95e4014030 con 0x7f95f81011f0 2024-09-21T01:08:13.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.944+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f95f8102d90 con 0x7f95f81011f0 2024-09-21T01:08:13.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.945+0000 7f95f5ffb640 1 -- 172.21.15.112:0/197955278 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) ==== 107+0+4468 (secure 0 0 0) 0x7f95e4069540 con 0x7f95f81011f0 2024-09-21T01:08:13.946 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:13.946 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":25,"btime":"2024-09-21T01:05:34:736167+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:33.903874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":173,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:13.946 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 25 2024-09-21T01:08:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f95e807af30 msgr2=0x7f95e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f95e807af30 0x7f95e807d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95ec031460 tx=0x7f95ec005bd0 comp rx=0 tx=0).stop 2024-09-21T01:08:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81011f0 msgr2=0x7f95f819e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81011f0 0x7f95f819e510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f95e400c8c0 tx=0x7f95e400cd80 comp rx=0 tx=0).stop 2024-09-21T01:08:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 shutdown_connections 2024-09-21T01:08:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f95e807af30 0x7f95e807d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:13.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95f81011f0 0x7f95f819e510 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:13.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 --2- 172.21.15.112:0/197955278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f81008d0 0x7f95f819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:13.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.947+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 >> 172.21.15.112:0/197955278 conn(0x7f95f80fc520 msgr2=0x7f95f8112bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:13.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.948+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 shutdown_connections 2024-09-21T01:08:13.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:13.948+0000 7f95fef03640 1 -- 172.21.15.112:0/197955278 wait complete. 2024-09-21T01:08:14.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:14.257 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:14 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/197955278' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T01:08:14.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:14.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:14 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/197955278' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T01:08:14.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 26 2024-09-21T01:08:14.866 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:15.244 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:15 smithi112 ceph-mon[109687]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 -- 172.21.15.112:0/2154580255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0107930 msgr2=0x7f39d0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 --2- 172.21.15.112:0/2154580255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0107930 0x7f39d0107d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009880 tx=0x7f39cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 -- 172.21.15.112:0/2154580255 shutdown_connections 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 --2- 172.21.15.112:0/2154580255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39d0101930 0x7f39d0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 --2- 172.21.15.112:0/2154580255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0107930 0x7f39d0107d10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 -- 172.21.15.112:0/2154580255 >> 172.21.15.112:0/2154580255 conn(0x7f39d00fd630 msgr2=0x7f39d00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 -- 172.21.15.112:0/2154580255 shutdown_connections 2024-09-21T01:08:15.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.324+0000 7f39d7b34640 1 -- 172.21.15.112:0/2154580255 wait complete. 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d7b34640 1 Processor -- start 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d7b34640 1 -- start start 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d7b34640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0101930 0x7f39d019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d7b34640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39d0107930 0x7f39d019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d7b34640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39d010ee00 con 0x7f39d0101930 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d7b34640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f39d010ec80 con 0x7f39d0107930 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d58d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0101930 0x7f39d019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d58d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0101930 0x7f39d019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53824/0 (socket says 172.21.15.112:53824) 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d58d0640 1 -- 172.21.15.112:0/565048497 learned_addr learned my addr 172.21.15.112:0/565048497 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.325+0000 7f39d50cf640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39d0107930 0x7f39d019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39d58d0640 1 -- 172.21.15.112:0/565048497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39d0107930 msgr2=0x7f39d019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39d58d0640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39d0107930 0x7f39d019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39d58d0640 1 -- 172.21.15.112:0/565048497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d01977f0 con 0x7f39d0101930 2024-09-21T01:08:15.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39d58d0640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0101930 0x7f39d019d670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39cc031460 tx=0x7f39cc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39c6ffd640 1 -- 172.21.15.112:0/565048497 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39cc03f070 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d0197a80 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39c6ffd640 1 -- 172.21.15.112:0/565048497 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39cc0035f0 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39c6ffd640 1 -- 172.21.15.112:0/565048497 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39cc035030 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.326+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d0197fb0 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.327+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d0103070 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.328+0000 7f39c6ffd640 1 -- 172.21.15.112:0/565048497 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f39cc042070 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.328+0000 7f39c6ffd640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f39bc07af30 0x7f39bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.328+0000 7f39c6ffd640 1 -- 172.21.15.112:0/565048497 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f39cc0bea00 con 0x7f39d0101930 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.328+0000 7f39d50cf640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f39bc07af30 0x7f39bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.329+0000 7f39d50cf640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f39bc07af30 0x7f39bc07d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39d00ffc20 tx=0x7f39c0005f90 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:15.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.333+0000 7f39c6ffd640 1 -- 172.21.15.112:0/565048497 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39cc089f00 con 0x7f39d0101930 2024-09-21T01:08:15.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:15 smithi187 ceph-mon[78584]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:15.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.549+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f39d0109ea0 con 0x7f39d0101930 2024-09-21T01:08:15.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.550+0000 7f39c6ffd640 1 -- 172.21.15.112:0/565048497 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) ==== 107+0+4465 (secure 0 0 0) 0x7f39cc08edb0 con 0x7f39d0101930 2024-09-21T01:08:15.551 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:15.551 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"btime":"2024-09-21T01:05:35:742393+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:34.744641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":174,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:15.551 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 26 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f39bc07af30 msgr2=0x7f39bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f39bc07af30 0x7f39bc07d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39d00ffc20 tx=0x7f39c0005f90 comp rx=0 tx=0).stop 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0101930 msgr2=0x7f39d019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0101930 0x7f39d019d670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39cc031460 tx=0x7f39cc004530 comp rx=0 tx=0).stop 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 shutdown_connections 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f39bc07af30 0x7f39bc07d3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39d0107930 0x7f39d019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 --2- 172.21.15.112:0/565048497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39d0101930 0x7f39d019d670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 >> 172.21.15.112:0/565048497 conn(0x7f39d00fd630 msgr2=0x7f39d00fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:15.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 shutdown_connections 2024-09-21T01:08:15.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:15.552+0000 7f39d7b34640 1 -- 172.21.15.112:0/565048497 wait complete. 2024-09-21T01:08:16.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 27 2024-09-21T01:08:16.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:16 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/565048497' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T01:08:16.399 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:16.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:16 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/565048497' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T01:08:16.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 -- 172.21.15.112:0/1331047831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 msgr2=0x7f286c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 --2- 172.21.15.112:0/1331047831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c100c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2854009880 tx=0x7f285402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 -- 172.21.15.112:0/1331047831 shutdown_connections 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 --2- 172.21.15.112:0/1331047831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c100c80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 --2- 172.21.15.112:0/1331047831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f286c106820 0x7f286c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 -- 172.21.15.112:0/1331047831 >> 172.21.15.112:0/1331047831 conn(0x7f286c0fc520 msgr2=0x7f286c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 -- 172.21.15.112:0/1331047831 shutdown_connections 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.913+0000 7f2870c73640 1 -- 172.21.15.112:0/1331047831 wait complete. 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f2870c73640 1 Processor -- start 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f2870c73640 1 -- start start 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f2870c73640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f2870c73640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f286c106820 0x7f286c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f2870c73640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f286c10dd50 con 0x7f286c100820 2024-09-21T01:08:16.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f2870c73640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f286c10dbd0 con 0x7f286c106820 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f286a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f286a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53856/0 (socket says 172.21.15.112:53856) 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.914+0000 7f286a59c640 1 -- 172.21.15.112:0/4054656563 learned_addr learned my addr 172.21.15.112:0/4054656563 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f2869d9b640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f286c106820 0x7f286c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f286a59c640 1 -- 172.21.15.112:0/4054656563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f286c106820 msgr2=0x7f286c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f286a59c640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f286c106820 0x7f286c198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f286a59c640 1 -- 172.21.15.112:0/4054656563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c1993d0 con 0x7f286c100820 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f286a59c640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c198840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f285c00b420 tx=0x7f285c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f28637fe640 1 -- 172.21.15.112:0/4054656563 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f285c011630 con 0x7f286c100820 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f28637fe640 1 -- 172.21.15.112:0/4054656563 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f285c016070 con 0x7f286c100820 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c1a18b0 con 0x7f286c100820 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f28637fe640 1 -- 172.21.15.112:0/4054656563 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f285c010d40 con 0x7f286c100820 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.915+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c1a1cb0 con 0x7f286c100820 2024-09-21T01:08:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.916+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c101f60 con 0x7f286c100820 2024-09-21T01:08:16.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.917+0000 7f28637fe640 1 -- 172.21.15.112:0/4054656563 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f285c01b460 con 0x7f286c100820 2024-09-21T01:08:16.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.917+0000 7f28637fe640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f285807af30 0x7f285807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:16.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.918+0000 7f28637fe640 1 -- 172.21.15.112:0/4054656563 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f285c09d840 con 0x7f286c100820 2024-09-21T01:08:16.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.918+0000 7f2869d9b640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f285807af30 0x7f285807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:16.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.918+0000 7f2869d9b640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f285807af30 0x7f285807d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2854031460 tx=0x7f2854009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:16.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:16.922+0000 7f28637fe640 1 -- 172.21.15.112:0/4054656563 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f285c021250 con 0x7f286c100820 2024-09-21T01:08:17.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.137+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f286c100c80 con 0x7f286c100820 2024-09-21T01:08:17.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.137+0000 7f28637fe640 1 -- 172.21.15.112:0/4054656563 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) ==== 107+0+4474 (secure 0 0 0) 0x7f285c068d40 con 0x7f286c100820 2024-09-21T01:08:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:17.138 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"btime":"2024-09-21T01:05:36:753580+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:36.753572+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":0,"incarnation":24,"state":"up:active","state_seq":175,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24319,"qdb_cluster":[24319]},"id":1}]} 2024-09-21T01:08:17.138 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 27 2024-09-21T01:08:17.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.139+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f285807af30 msgr2=0x7f285807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:17.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.139+0000 7f2870c73640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f285807af30 0x7f285807d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2854031460 tx=0x7f2854009560 comp rx=0 tx=0).stop 2024-09-21T01:08:17.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.139+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 msgr2=0x7f286c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:17.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.139+0000 7f2870c73640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c198840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f285c00b420 tx=0x7f285c00b8e0 comp rx=0 tx=0).stop 2024-09-21T01:08:17.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.140+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 shutdown_connections 2024-09-21T01:08:17.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.140+0000 7f2870c73640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f285807af30 0x7f285807d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:17.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.140+0000 7f2870c73640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f286c106820 0x7f286c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:17.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.140+0000 7f2870c73640 1 --2- 172.21.15.112:0/4054656563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f286c100820 0x7f286c198840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:17.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.140+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 >> 172.21.15.112:0/4054656563 conn(0x7f286c0fc520 msgr2=0x7f286c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:17.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.140+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 shutdown_connections 2024-09-21T01:08:17.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:17.140+0000 7f2870c73640 1 -- 172.21.15.112:0/4054656563 wait complete. 2024-09-21T01:08:17.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:17 smithi187 ceph-mon[78584]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:17.490 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:17 smithi112 ceph-mon[109687]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:17.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 28 2024-09-21T01:08:18.108 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:18.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:18 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/4054656563' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T01:08:18.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:18 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/4054656563' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.573+0000 7efcd51b5640 1 -- 172.21.15.112:0/3366842309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 msgr2=0x7efcd0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.573+0000 7efcd51b5640 1 --2- 172.21.15.112:0/3366842309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd0106bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009880 tx=0x7efcc002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.573+0000 7efcd51b5640 1 -- 172.21.15.112:0/3366842309 shutdown_connections 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.573+0000 7efcd51b5640 1 --2- 172.21.15.112:0/3366842309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcd01007e0 0x7efcd0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.573+0000 7efcd51b5640 1 --2- 172.21.15.112:0/3366842309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd0106bc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.573+0000 7efcd51b5640 1 -- 172.21.15.112:0/3366842309 >> 172.21.15.112:0/3366842309 conn(0x7efcd00fc4c0 msgr2=0x7efcd00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.574+0000 7efcd51b5640 1 -- 172.21.15.112:0/3366842309 shutdown_connections 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.574+0000 7efcd51b5640 1 -- 172.21.15.112:0/3366842309 wait complete. 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.574+0000 7efcd51b5640 1 Processor -- start 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcd51b5640 1 -- start start 2024-09-21T01:08:18.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcd51b5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcd01007e0 0x7efcd019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcd51b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcd51b5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcd010dcb0 con 0x7efcd01067e0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcd51b5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efcd010db30 con 0x7efcd01007e0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd019db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53868/0 (socket says 172.21.15.112:53868) 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcce59c640 1 -- 172.21.15.112:0/869727996 learned_addr learned my addr 172.21.15.112:0/869727996 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcced9d640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcd01007e0 0x7efcd019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcce59c640 1 -- 172.21.15.112:0/869727996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcd01007e0 msgr2=0x7efcd019d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcce59c640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcd01007e0 0x7efcd019d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcce59c640 1 -- 172.21.15.112:0/869727996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd0197790 con 0x7efcd01067e0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcced9d640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcd01007e0 0x7efcd019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.575+0000 7efcce59c640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd019db50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efcc400c8f0 tx=0x7efcc400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.576+0000 7efcb7fff640 1 -- 172.21.15.112:0/869727996 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc40079b0 con 0x7efcd01067e0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.576+0000 7efcb7fff640 1 -- 172.21.15.112:0/869727996 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcc40054e0 con 0x7efcd01067e0 2024-09-21T01:08:18.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.576+0000 7efcb7fff640 1 -- 172.21.15.112:0/869727996 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcc4004dd0 con 0x7efcd01067e0 2024-09-21T01:08:18.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.576+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd0197a80 con 0x7efcd01067e0 2024-09-21T01:08:18.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.576+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd0198010 con 0x7efcd01067e0 2024-09-21T01:08:18.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.577+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd0101f20 con 0x7efcd01067e0 2024-09-21T01:08:18.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.578+0000 7efcb7fff640 1 -- 172.21.15.112:0/869727996 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7efcc4005020 con 0x7efcd01067e0 2024-09-21T01:08:18.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.578+0000 7efcb7fff640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efcb807aed0 0x7efcb807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:18.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.578+0000 7efcb7fff640 1 -- 172.21.15.112:0/869727996 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7efcc409e0e0 con 0x7efcd01067e0 2024-09-21T01:08:18.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.578+0000 7efcced9d640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efcb807aed0 0x7efcb807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:18.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.579+0000 7efcced9d640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efcb807aed0 0x7efcb807d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcc0031460 tx=0x7efcc0009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:18.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.583+0000 7efcb7fff640 1 -- 172.21.15.112:0/869727996 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efcc4014030 con 0x7efcd01067e0 2024-09-21T01:08:18.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.798+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7efcd0109d60 con 0x7efcd01067e0 2024-09-21T01:08:18.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.799+0000 7efcb7fff640 1 -- 172.21.15.112:0/869727996 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) ==== 107+0+5324 (secure 0 0 0) 0x7efcc40695e0 con 0x7efcd01067e0 2024-09-21T01:08:18.800 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:18.800 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":28,"btime":"2024-09-21T01:05:39:935799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:36.753572+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi187.osicpg","rank":0,"incarnation":24,"state":"up:active","state_seq":175,"addr":"172.21.15.187:6827/1944064649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1944064649},{"type":"v1","addr":"172.21.15.187:6827","nonce":1944064649}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24319,"qdb_cluster":[24319]},"id":1}]} 2024-09-21T01:08:18.800 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 28 2024-09-21T01:08:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efcb807aed0 msgr2=0x7efcb807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efcb807aed0 0x7efcb807d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcc0031460 tx=0x7efcc0009560 comp rx=0 tx=0).stop 2024-09-21T01:08:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 msgr2=0x7efcd019db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd019db50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efcc400c8f0 tx=0x7efcc400cdb0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 shutdown_connections 2024-09-21T01:08:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7efcb807aed0 0x7efcb807d390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd01067e0 0x7efcd019db50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 --2- 172.21.15.112:0/869727996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcd01007e0 0x7efcd019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 >> 172.21.15.112:0/869727996 conn(0x7efcd00fc4c0 msgr2=0x7efcd0069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 shutdown_connections 2024-09-21T01:08:18.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:18.801+0000 7efcd51b5640 1 -- 172.21.15.112:0/869727996 wait complete. 2024-09-21T01:08:19.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:19 smithi112 ceph-mon[109687]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:19.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:19 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/869727996' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T01:08:19.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:19 smithi187 ceph-mon[78584]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:19.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:19 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/869727996' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T01:08:19.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 29 2024-09-21T01:08:19.877 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:20.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 -- 172.21.15.112:0/410193055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 msgr2=0x7f9480100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:20.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 --2- 172.21.15.112:0/410193055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f9480100c40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9468009880 tx=0x7f946802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 -- 172.21.15.112:0/410193055 shutdown_connections 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 --2- 172.21.15.112:0/410193055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f9480100c40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 --2- 172.21.15.112:0/410193055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94801067e0 0x7f9480106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 -- 172.21.15.112:0/410193055 >> 172.21.15.112:0/410193055 conn(0x7f94800fc4c0 msgr2=0x7f94800fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 -- 172.21.15.112:0/410193055 shutdown_connections 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.327+0000 7f94869d1640 1 -- 172.21.15.112:0/410193055 wait complete. 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.328+0000 7f94869d1640 1 Processor -- start 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.328+0000 7f94869d1640 1 -- start start 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.328+0000 7f94869d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f94801987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.328+0000 7f94869d1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94801067e0 0x7f9480198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.328+0000 7f94869d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f948010dcb0 con 0x7f94801007e0 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.328+0000 7f94869d1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f948010db30 con 0x7f94801067e0 2024-09-21T01:08:20.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f94801987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f94801987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53886/0 (socket says 172.21.15.112:53886) 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947ffff640 1 -- 172.21.15.112:0/556770924 learned_addr learned my addr 172.21.15.112:0/556770924 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f9477fff640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94801067e0 0x7f9480198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947ffff640 1 -- 172.21.15.112:0/556770924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94801067e0 msgr2=0x7f9480198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947ffff640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94801067e0 0x7f9480198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947ffff640 1 -- 172.21.15.112:0/556770924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480199320 con 0x7f94801007e0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f9477fff640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94801067e0 0x7f9480198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947ffff640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f94801987e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f947000c8f0 tx=0x7f947000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947dffb640 1 -- 172.21.15.112:0/556770924 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94700079b0 con 0x7f94801007e0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9480199610 con 0x7f94801007e0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947dffb640 1 -- 172.21.15.112:0/556770924 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94700054e0 con 0x7f94801007e0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f947dffb640 1 -- 172.21.15.112:0/556770924 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9470004dd0 con 0x7f94801007e0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.329+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94801a1c10 con 0x7f94801007e0 2024-09-21T01:08:20.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.330+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9480101f20 con 0x7f94801007e0 2024-09-21T01:08:20.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.331+0000 7f947dffb640 1 -- 172.21.15.112:0/556770924 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9470005020 con 0x7f94801007e0 2024-09-21T01:08:20.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.332+0000 7f947dffb640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f946c07aed0 0x7f946c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:20.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.332+0000 7f947dffb640 1 -- 172.21.15.112:0/556770924 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f947009e0e0 con 0x7f94801007e0 2024-09-21T01:08:20.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.332+0000 7f9477fff640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f946c07aed0 0x7f946c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:20.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.332+0000 7f9477fff640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f946c07aed0 0x7f946c07d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9468006010 tx=0x7f94680095f0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:20.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.337+0000 7f947dffb640 1 -- 172.21.15.112:0/556770924 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9480199610 con 0x7f94801007e0 2024-09-21T01:08:20.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.559+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f9480100c40 con 0x7f94801007e0 2024-09-21T01:08:20.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.560+0000 7f947dffb640 1 -- 172.21.15.112:0/556770924 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) ==== 107+0+4452 (secure 0 0 0) 0x7f9470014030 con 0x7f94801007e0 2024-09-21T01:08:20.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:20.560 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-21T01:05:49:360117+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:49.360112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:20.561 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f946c07aed0 msgr2=0x7f946c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f946c07aed0 0x7f946c07d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9468006010 tx=0x7f94680095f0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 msgr2=0x7f94801987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f94801987e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f947000c8f0 tx=0x7f947000cdb0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 shutdown_connections 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f946c07aed0 0x7f946c07d390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94801067e0 0x7f9480198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 --2- 172.21.15.112:0/556770924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94801007e0 0x7f94801987e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 >> 172.21.15.112:0/556770924 conn(0x7f94800fc4c0 msgr2=0x7f94800fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 shutdown_connections 2024-09-21T01:08:20.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:20.562+0000 7f94869d1640 1 -- 172.21.15.112:0/556770924 wait complete. 2024-09-21T01:08:21.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:21 smithi112 ceph-mon[109687]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:21.206 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:21 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/556770924' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T01:08:21.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 30 2024-09-21T01:08:21.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:21 smithi187 ceph-mon[78584]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:21.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:21 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/556770924' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T01:08:21.484 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:21.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 -- 172.21.15.112:0/3903714631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 msgr2=0x7feaf0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:21.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 --2- 172.21.15.112:0/3903714631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf0107d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feae0009880 tx=0x7feae002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:21.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 -- 172.21.15.112:0/3903714631 shutdown_connections 2024-09-21T01:08:21.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 --2- 172.21.15.112:0/3903714631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feaf0101930 0x7feaf0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:21.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 --2- 172.21.15.112:0/3903714631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf0107d10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:21.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 -- 172.21.15.112:0/3903714631 >> 172.21.15.112:0/3903714631 conn(0x7feaf00fd630 msgr2=0x7feaf00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:21.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 -- 172.21.15.112:0/3903714631 shutdown_connections 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.942+0000 7feaf623e640 1 -- 172.21.15.112:0/3903714631 wait complete. 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feaf623e640 1 Processor -- start 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feaf623e640 1 -- start start 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feaf623e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feaf0101930 0x7feaf019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feaf623e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feaf623e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feaf010ede0 con 0x7feaf0107930 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feaf623e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7feaf010ec60 con 0x7feaf0101930 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feae7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feae7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53896/0 (socket says 172.21.15.112:53896) 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.943+0000 7feae7fff640 1 -- 172.21.15.112:0/434997944 learned_addr learned my addr 172.21.15.112:0/434997944 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feaef7fe640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feaf0101930 0x7feaf019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feae7fff640 1 -- 172.21.15.112:0/434997944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feaf0101930 msgr2=0x7feaf019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:21.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feae7fff640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feaf0101930 0x7feaf019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feae7fff640 1 -- 172.21.15.112:0/434997944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf0197810 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feae7fff640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf019dbd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fead800d8d0 tx=0x7fead800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feaed7fa640 1 -- 172.21.15.112:0/434997944 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fead8017070 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf0197b00 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feaed7fa640 1 -- 172.21.15.112:0/434997944 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fead8010460 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feaed7fa640 1 -- 172.21.15.112:0/434997944 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fead800f5f0 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.944+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf0198090 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.945+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf0103070 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.946+0000 7feaed7fa640 1 -- 172.21.15.112:0/434997944 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fead8009a30 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.946+0000 7feaed7fa640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feadc07af30 0x7feadc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.946+0000 7feaed7fa640 1 -- 172.21.15.112:0/434997944 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fead809dfe0 con 0x7feaf0107930 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.946+0000 7feaef7fe640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feadc07af30 0x7feadc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.947+0000 7feaef7fe640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feadc07af30 0x7feadc07d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feae0031460 tx=0x7feae0009560 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:21.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:21.951+0000 7feaed7fa640 1 -- 172.21.15.112:0/434997944 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fead80694e0 con 0x7feaf0107930 2024-09-21T01:08:22.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.162+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7feaf0104b40 con 0x7feaf0107930 2024-09-21T01:08:22.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.163+0000 7feaed7fa640 1 -- 172.21.15.112:0/434997944 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) ==== 107+0+4463 (secure 0 0 0) 0x7fead806e390 con 0x7feaf0107930 2024-09-21T01:08:22.164 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:22.164 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":30,"btime":"2024-09-21T01:05:49:367422+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:49.367405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:22.164 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 30 2024-09-21T01:08:22.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feadc07af30 msgr2=0x7feadc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:22.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feadc07af30 0x7feadc07d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feae0031460 tx=0x7feae0009560 comp rx=0 tx=0).stop 2024-09-21T01:08:22.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 msgr2=0x7feaf019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:22.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf019dbd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fead800d8d0 tx=0x7fead800dd90 comp rx=0 tx=0).stop 2024-09-21T01:08:22.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 shutdown_connections 2024-09-21T01:08:22.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7feadc07af30 0x7feadc07d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:22.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaf0107930 0x7feaf019dbd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:22.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 --2- 172.21.15.112:0/434997944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feaf0101930 0x7feaf019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:22.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 >> 172.21.15.112:0/434997944 conn(0x7feaf00fd630 msgr2=0x7feaf00fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:22.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 shutdown_connections 2024-09-21T01:08:22.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:22.165+0000 7feaf623e640 1 -- 172.21.15.112:0/434997944 wait complete. 2024-09-21T01:08:22.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 31 2024-09-21T01:08:23.077 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:23.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:23 smithi187 ceph-mon[78584]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:23.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:23 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/434997944' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T01:08:23.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:23 smithi112 ceph-mon[109687]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:23.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:23 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/434997944' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T01:08:23.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 -- 172.21.15.112:0/1690461466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081007e0 msgr2=0x7f8f08100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/1690461466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081007e0 0x7f8f08100c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009880 tx=0x7f8ef802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 -- 172.21.15.112:0/1690461466 shutdown_connections 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/1690461466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081007e0 0x7f8f08100c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/1690461466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f081067e0 0x7f8f08106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 -- 172.21.15.112:0/1690461466 >> 172.21.15.112:0/1690461466 conn(0x7f8f080fc4c0 msgr2=0x7f8f080fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 -- 172.21.15.112:0/1690461466 shutdown_connections 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.538+0000 7f8f0f88e640 1 -- 172.21.15.112:0/1690461466 wait complete. 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0f88e640 1 Processor -- start 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0f88e640 1 -- start start 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0f88e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f081007e0 0x7f8f081023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0f88e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081067e0 0x7f8f081028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0f88e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0810dc90 con 0x7f8f081067e0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0f88e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0810db10 con 0x7f8f081007e0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0ce29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081067e0 0x7f8f081028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0ce29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081067e0 0x7f8f081028f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52670/0 (socket says 172.21.15.112:52670) 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.539+0000 7f8f0ce29640 1 -- 172.21.15.112:0/2928222084 learned_addr learned my addr 172.21.15.112:0/2928222084 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8f0d62a640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f081007e0 0x7f8f081023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8f0ce29640 1 -- 172.21.15.112:0/2928222084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f081007e0 msgr2=0x7f8f081023b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8f0ce29640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f081007e0 0x7f8f081023b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8f0ce29640 1 -- 172.21.15.112:0/2928222084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f08102e30 con 0x7f8f081067e0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8f0ce29640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081067e0 0x7f8f081028f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8031460 tx=0x7f8ef80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8efe7fc640 1 -- 172.21.15.112:0/2928222084 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ef803f070 con 0x7f8f081067e0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8efe7fc640 1 -- 172.21.15.112:0/2928222084 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ef8004cf0 con 0x7f8f081067e0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8efe7fc640 1 -- 172.21.15.112:0/2928222084 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ef8035030 con 0x7f8f081067e0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f081030c0 con 0x7f8f081067e0 2024-09-21T01:08:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.540+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f081a3d50 con 0x7f8f081067e0 2024-09-21T01:08:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.541+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f08101f20 con 0x7f8f081067e0 2024-09-21T01:08:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.542+0000 7f8efe7fc640 1 -- 172.21.15.112:0/2928222084 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f8ef8042070 con 0x7f8f081067e0 2024-09-21T01:08:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.543+0000 7f8efe7fc640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ef407af80 0x7f8ef407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.543+0000 7f8f0d62a640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ef407af80 0x7f8ef407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.543+0000 7f8efe7fc640 1 -- 172.21.15.112:0/2928222084 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f8ef80beae0 con 0x7f8f081067e0 2024-09-21T01:08:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.543+0000 7f8f0d62a640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ef407af80 0x7f8ef407d440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8f040058c0 tx=0x7f8f0400a4c0 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.547+0000 7f8efe7fc640 1 -- 172.21.15.112:0/2928222084 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ef808a060 con 0x7f8f081067e0 2024-09-21T01:08:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.759+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f8f081a4000 con 0x7f8f081067e0 2024-09-21T01:08:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.760+0000 7f8efe7fc640 1 -- 172.21.15.112:0/2928222084 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) ==== 107+0+5314 (secure 0 0 0) 0x7f8ef808ef10 con 0x7f8f081067e0 2024-09-21T01:08:23.760 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:23.761 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"btime":"2024-09-21T01:05:59:304318+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6827/749430440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":749430440},{"type":"v1","addr":"172.21.15.187:6827","nonce":749430440}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:58.746906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 31 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ef407af80 msgr2=0x7f8ef407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ef407af80 0x7f8ef407d440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8f040058c0 tx=0x7f8f0400a4c0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081067e0 msgr2=0x7f8f081028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081067e0 0x7f8f081028f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8031460 tx=0x7f8ef80048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 shutdown_connections 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f8ef407af80 0x7f8ef407d440 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f081067e0 0x7f8f081028f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 --2- 172.21.15.112:0/2928222084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f081007e0 0x7f8f081023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:23.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 >> 172.21.15.112:0/2928222084 conn(0x7f8f080fc4c0 msgr2=0x7f8f08104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:23.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 shutdown_connections 2024-09-21T01:08:23.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:23.762+0000 7f8f0f88e640 1 -- 172.21.15.112:0/2928222084 wait complete. 2024-09-21T01:08:24.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:24 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2928222084' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T01:08:24.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:24 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2928222084' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T01:08:24.450 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 32 2024-09-21T01:08:24.703 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:25.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 -- 172.21.15.112:0/1964989116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c106820 msgr2=0x7fb45c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:25.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 --2- 172.21.15.112:0/1964989116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c106820 0x7fb45c106c00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009880 tx=0x7fb44c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 -- 172.21.15.112:0/1964989116 shutdown_connections 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 --2- 172.21.15.112:0/1964989116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb45c100820 0x7fb45c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 --2- 172.21.15.112:0/1964989116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c106820 0x7fb45c106c00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 -- 172.21.15.112:0/1964989116 >> 172.21.15.112:0/1964989116 conn(0x7fb45c0fc520 msgr2=0x7fb45c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 -- 172.21.15.112:0/1964989116 shutdown_connections 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.156+0000 7fb460aad640 1 -- 172.21.15.112:0/1964989116 wait complete. 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.157+0000 7fb460aad640 1 Processor -- start 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.157+0000 7fb460aad640 1 -- start start 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.157+0000 7fb460aad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c100820 0x7fb45c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.157+0000 7fb460aad640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb45c106820 0x7fb45c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.157+0000 7fb460aad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c10dcf0 con 0x7fb45c100820 2024-09-21T01:08:25.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.157+0000 7fb460aad640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c10db70 con 0x7fb45c106820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb45a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c100820 0x7fb45c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb45a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c100820 0x7fb45c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52692/0 (socket says 172.21.15.112:52692) 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb45a59c640 1 -- 172.21.15.112:0/1703502096 learned_addr learned my addr 172.21.15.112:0/1703502096 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb453fff640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb45c106820 0x7fb45c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb45a59c640 1 -- 172.21.15.112:0/1703502096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb45c106820 msgr2=0x7fb45c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb45a59c640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb45c106820 0x7fb45c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb45a59c640 1 -- 172.21.15.112:0/1703502096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c1977e0 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb45a59c640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c100820 0x7fb45c19d660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb44c031460 tx=0x7fb44c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb4537fe640 1 -- 172.21.15.112:0/1703502096 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb44c03f070 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c197a70 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb4537fe640 1 -- 172.21.15.112:0/1703502096 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb44c0035f0 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb4537fe640 1 -- 172.21.15.112:0/1703502096 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb44c035030 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.158+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c197fa0 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.159+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c101f60 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.160+0000 7fb4537fe640 1 -- 172.21.15.112:0/1703502096 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fb44c042070 con 0x7fb45c100820 2024-09-21T01:08:25.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.160+0000 7fb4537fe640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb44807af30 0x7fb44807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:25.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.161+0000 7fb4537fe640 1 -- 172.21.15.112:0/1703502096 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fb44c0bea70 con 0x7fb45c100820 2024-09-21T01:08:25.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.161+0000 7fb453fff640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb44807af30 0x7fb44807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:25.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.161+0000 7fb453fff640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb44807af30 0x7fb44807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb45c104fa0 tx=0x7fb44400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:25.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.165+0000 7fb4537fe640 1 -- 172.21.15.112:0/1703502096 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb44c089f70 con 0x7fb45c100820 2024-09-21T01:08:25.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:25 smithi112 ceph-mon[109687]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.379+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7fb45c109da0 con 0x7fb45c100820 2024-09-21T01:08:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.380+0000 7fb4537fe640 1 -- 172.21.15.112:0/1703502096 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) ==== 107+0+5311 (secure 0 0 0) 0x7fb44c08ee20 con 0x7fb45c100820 2024-09-21T01:08:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:25.381 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":32,"btime":"2024-09-21T01:06:00:306226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6827/749430440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":749430440},{"type":"v1","addr":"172.21.15.187:6827","nonce":749430440}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:05:59.309558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T01:08:25.381 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 32 2024-09-21T01:08:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb44807af30 msgr2=0x7fb44807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb44807af30 0x7fb44807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb45c104fa0 tx=0x7fb44400b390 comp rx=0 tx=0).stop 2024-09-21T01:08:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c100820 msgr2=0x7fb45c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c100820 0x7fb45c19d660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb44c031460 tx=0x7fb44c0045e0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 shutdown_connections 2024-09-21T01:08:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fb44807af30 0x7fb44807d3f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb45c106820 0x7fb45c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 --2- 172.21.15.112:0/1703502096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb45c100820 0x7fb45c19d660 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.382+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 >> 172.21.15.112:0/1703502096 conn(0x7fb45c0fc520 msgr2=0x7fb45c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.383+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 shutdown_connections 2024-09-21T01:08:25.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:25.383+0000 7fb460aad640 1 -- 172.21.15.112:0/1703502096 wait complete. 2024-09-21T01:08:25.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:25 smithi187 ceph-mon[78584]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:26.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 33 2024-09-21T01:08:26.258 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:26.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:26 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/1703502096' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T01:08:26.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:26 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/1703502096' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T01:08:26.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 -- 172.21.15.112:0/1709143781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 msgr2=0x7f29a0104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:26.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/1709143781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a0104c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2994009880 tx=0x7f299402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 -- 172.21.15.112:0/1709143781 shutdown_connections 2024-09-21T01:08:26.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/1709143781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a0104c00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/1709143781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a0100200 0x7f29a01005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 -- 172.21.15.112:0/1709143781 >> 172.21.15.112:0/1709143781 conn(0x7f29a00fbc60 msgr2=0x7f29a00fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:26.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 -- 172.21.15.112:0/1709143781 shutdown_connections 2024-09-21T01:08:26.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.710+0000 7f29a5e4c640 1 -- 172.21.15.112:0/1709143781 wait complete. 2024-09-21T01:08:26.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.711+0000 7f29a5e4c640 1 Processor -- start 2024-09-21T01:08:26.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.711+0000 7f29a5e4c640 1 -- start start 2024-09-21T01:08:26.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.711+0000 7f29a5e4c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a0100200 0x7f29a019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.711+0000 7f29a5e4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.711+0000 7f29a5e4c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29a010cbf0 con 0x7f29a0100bb0 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.711+0000 7f29a5e4c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f29a010ca70 con 0x7f29a0100200 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52708/0 (socket says 172.21.15.112:52708) 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299effd640 1 -- 172.21.15.112:0/18218748 learned_addr learned my addr 172.21.15.112:0/18218748 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299f7fe640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a0100200 0x7f29a019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299effd640 1 -- 172.21.15.112:0/18218748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a0100200 msgr2=0x7f29a019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299effd640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a0100200 0x7f29a019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299effd640 1 -- 172.21.15.112:0/18218748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a0197810 con 0x7f29a0100bb0 2024-09-21T01:08:26.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299effd640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a019dbd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2994031460 tx=0x7f29940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:26.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299cff9640 1 -- 172.21.15.112:0/18218748 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f299403f070 con 0x7f29a0100bb0 2024-09-21T01:08:26.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a0197aa0 con 0x7f29a0100bb0 2024-09-21T01:08:26.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299cff9640 1 -- 172.21.15.112:0/18218748 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2994004cf0 con 0x7f29a0100bb0 2024-09-21T01:08:26.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f299cff9640 1 -- 172.21.15.112:0/18218748 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2994035030 con 0x7f29a0100bb0 2024-09-21T01:08:26.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.712+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a0197fd0 con 0x7f29a0100bb0 2024-09-21T01:08:26.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.713+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a01016e0 con 0x7f29a0100bb0 2024-09-21T01:08:26.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.714+0000 7f299cff9640 1 -- 172.21.15.112:0/18218748 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2994042070 con 0x7f29a0100bb0 2024-09-21T01:08:26.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.714+0000 7f299cff9640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f298807af30 0x7f298807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:26.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.715+0000 7f299f7fe640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f298807af30 0x7f298807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:26.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.715+0000 7f299cff9640 1 -- 172.21.15.112:0/18218748 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f29940bebc0 con 0x7f29a0100bb0 2024-09-21T01:08:26.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.715+0000 7f299f7fe640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f298807af30 0x7f298807d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2990005fd0 tx=0x7f2990005e20 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:26.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.719+0000 7f299cff9640 1 -- 172.21.15.112:0/18218748 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f299408a0c0 con 0x7f29a0100bb0 2024-09-21T01:08:26.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.930+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f29a0108510 con 0x7f29a0100bb0 2024-09-21T01:08:26.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.930+0000 7f299cff9640 1 -- 172.21.15.112:0/18218748 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) ==== 107+0+5320 (secure 0 0 0) 0x7f299408ef70 con 0x7f29a0100bb0 2024-09-21T01:08:26.931 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:26.931 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":33,"btime":"2024-09-21T01:06:01:311506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6827/749430440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":749430440},{"type":"v1","addr":"172.21.15.187:6827","nonce":749430440}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:06:01.311497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":0,"incarnation":30,"state":"up:active","state_seq":21,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-21T01:08:26.932 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 33 2024-09-21T01:08:26.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.932+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f298807af30 msgr2=0x7f298807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:26.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.932+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f298807af30 0x7f298807d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2990005fd0 tx=0x7f2990005e20 comp rx=0 tx=0).stop 2024-09-21T01:08:26.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.932+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 msgr2=0x7f29a019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:26.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.932+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a019dbd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2994031460 tx=0x7f29940048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.933+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 shutdown_connections 2024-09-21T01:08:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.933+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f298807af30 0x7f298807d3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.933+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a0100bb0 0x7f29a019dbd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.933+0000 7f29a5e4c640 1 --2- 172.21.15.112:0/18218748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a0100200 0x7f29a019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.933+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 >> 172.21.15.112:0/18218748 conn(0x7f29a00fbc60 msgr2=0x7f29a00fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.933+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 shutdown_connections 2024-09-21T01:08:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:26.933+0000 7f29a5e4c640 1 -- 172.21.15.112:0/18218748 wait complete. 2024-09-21T01:08:27.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:27 smithi187 ceph-mon[78584]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:27.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:27 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/18218748' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T01:08:27.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:27 smithi112 ceph-mon[109687]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:27.494 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:27 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/18218748' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T01:08:27.523 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 34 2024-09-21T01:08:27.783 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 -- 172.21.15.112:0/3844022968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764107930 msgr2=0x7fc764107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 --2- 172.21.15.112:0/3844022968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764107930 0x7fc764107d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc754009880 tx=0x7fc75402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 -- 172.21.15.112:0/3844022968 shutdown_connections 2024-09-21T01:08:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 --2- 172.21.15.112:0/3844022968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc764101930 0x7fc764101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 --2- 172.21.15.112:0/3844022968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764107930 0x7fc764107d10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 -- 172.21.15.112:0/3844022968 >> 172.21.15.112:0/3844022968 conn(0x7fc7640fd630 msgr2=0x7fc7640ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:28.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 -- 172.21.15.112:0/3844022968 shutdown_connections 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.243+0000 7fc768d22640 1 -- 172.21.15.112:0/3844022968 wait complete. 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc768d22640 1 Processor -- start 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc768d22640 1 -- start start 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc768d22640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764101930 0x7fc76419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc768d22640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc764107930 0x7fc76419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc768d22640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc76410ee60 con 0x7fc764101930 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc768d22640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc76410ece0 con 0x7fc764107930 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc76259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764101930 0x7fc76419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc76259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764101930 0x7fc76419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52720/0 (socket says 172.21.15.112:52720) 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc76259c640 1 -- 172.21.15.112:0/367354451 learned_addr learned my addr 172.21.15.112:0/367354451 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc75bfff640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc764107930 0x7fc76419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc76259c640 1 -- 172.21.15.112:0/367354451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc764107930 msgr2=0x7fc76419dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:28.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc76259c640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc764107930 0x7fc76419dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc76259c640 1 -- 172.21.15.112:0/367354451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc764197890 con 0x7fc764101930 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.244+0000 7fc76259c640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764101930 0x7fc76419d6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc754031460 tx=0x7fc7540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.245+0000 7fc75b7fe640 1 -- 172.21.15.112:0/367354451 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc75403f070 con 0x7fc764101930 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.245+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc764197b20 con 0x7fc764101930 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.245+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc764198050 con 0x7fc764101930 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.245+0000 7fc75b7fe640 1 -- 172.21.15.112:0/367354451 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc754004cf0 con 0x7fc764101930 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.245+0000 7fc75b7fe640 1 -- 172.21.15.112:0/367354451 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc754049060 con 0x7fc764101930 2024-09-21T01:08:28.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.246+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc744005290 con 0x7fc764101930 2024-09-21T01:08:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.247+0000 7fc75b7fe640 1 -- 172.21.15.112:0/367354451 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7fc754042070 con 0x7fc764101930 2024-09-21T01:08:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.248+0000 7fc75b7fe640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc75007af80 0x7fc75007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.248+0000 7fc75b7fe640 1 -- 172.21.15.112:0/367354451 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7fc7540bea60 con 0x7fc764101930 2024-09-21T01:08:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.248+0000 7fc75bfff640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc75007af80 0x7fc75007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:28.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.248+0000 7fc75bfff640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc75007af80 0x7fc75007d440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc7640ffc10 tx=0x7fc74c008040 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:28.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.252+0000 7fc75b7fe640 1 -- 172.21.15.112:0/367354451 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc754089ec0 con 0x7fc764101930 2024-09-21T01:08:28.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.478+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7fc744005580 con 0x7fc764101930 2024-09-21T01:08:28.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.479+0000 7fc75b7fe640 1 -- 172.21.15.112:0/367354451 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) ==== 107+0+5320 (secure 0 0 0) 0x7fc75408e020 con 0x7fc764101930 2024-09-21T01:08:28.483 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T01:08:28.483 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":34,"btime":"2024-09-21T01:06:05:995603+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi112.ngfvvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6829/428821401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":428821401},{"type":"v1","addr":"172.21.15.112:6829","nonce":428821401}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi187.cdcgvm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6825/2863682926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2863682926},{"type":"v1","addr":"172.21.15.187:6825","nonce":2863682926}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44323,"name":"cephfs.smithi187.osicpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6827/749430440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":749430440},{"type":"v1","addr":"172.21.15.187:6827","nonce":749430440}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T00:53:53.557502+0000","modified":"2024-09-21T01:06:04.999026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi112.yntrjn","rank":0,"incarnation":30,"state":"up:active","state_seq":21,"addr":"172.21.15.112:6827/640337427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":640337427},{"type":"v1","addr":"172.21.15.112:6827","nonce":640337427}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-21T01:08:28.483 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 34 2024-09-21T01:08:28.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc75007af80 msgr2=0x7fc75007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc75007af80 0x7fc75007d440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc7640ffc10 tx=0x7fc74c008040 comp rx=0 tx=0).stop 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764101930 msgr2=0x7fc76419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764101930 0x7fc76419d6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc754031460 tx=0x7fc7540048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 shutdown_connections 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7fc75007af80 0x7fc75007d440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc764107930 0x7fc76419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 --2- 172.21.15.112:0/367354451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc764101930 0x7fc76419d6d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.481+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 >> 172.21.15.112:0/367354451 conn(0x7fc7640fd630 msgr2=0x7fc7640fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:28.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.482+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 shutdown_connections 2024-09-21T01:08:28.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:28.482+0000 7fc768d22640 1 -- 172.21.15.112:0/367354451 wait complete. 2024-09-21T01:08:29.113 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T01:08:29.123 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T01:08:29.124 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T01:08:29.124 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:08:29.142 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T01:08:29.143 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:08:29.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:08:29.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:29 smithi187 ceph-mon[78584]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:29.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:29 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/367354451' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-21T01:08:29.486 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:29 smithi112 ceph-mon[109687]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:29 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/367354451' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-21T01:08:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 -- 172.21.15.112:0/1907572824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 msgr2=0x7f9378102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 --2- 172.21.15.112:0/1907572824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f9378102ec0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9368009880 tx=0x7f936802a530 comp rx=0 tx=0).stop 2024-09-21T01:08:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 -- 172.21.15.112:0/1907572824 shutdown_connections 2024-09-21T01:08:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 --2- 172.21.15.112:0/1907572824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9378103400 0x7f937810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 --2- 172.21.15.112:0/1907572824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f9378102ec0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 -- 172.21.15.112:0/1907572824 >> 172.21.15.112:0/1907572824 conn(0x7f93780fc520 msgr2=0x7f93780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 -- 172.21.15.112:0/1907572824 shutdown_connections 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.976+0000 7f937f5cb640 1 -- 172.21.15.112:0/1907572824 wait complete. 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937f5cb640 1 Processor -- start 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937f5cb640 1 -- start start 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937f5cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f937819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937f5cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9378103400 0x7f937819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937f5cb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f937810edf0 con 0x7f9378102ae0 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937f5cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f937810ec70 con 0x7f9378103400 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937d367640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f937819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937d367640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f937819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52738/0 (socket says 172.21.15.112:52738) 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937d367640 1 -- 172.21.15.112:0/2716845221 learned_addr learned my addr 172.21.15.112:0/2716845221 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937cb66640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9378103400 0x7f937819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937d367640 1 -- 172.21.15.112:0/2716845221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9378103400 msgr2=0x7f937819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.977+0000 7f937d367640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9378103400 0x7f937819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f937d367640 1 -- 172.21.15.112:0/2716845221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93781977e0 con 0x7f9378102ae0 2024-09-21T01:08:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f937cb66640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9378103400 0x7f937819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:08:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f937d367640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f937819d660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9368031460 tx=0x7f93680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f936e7fc640 1 -- 172.21.15.112:0/2716845221 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f936803f070 con 0x7f9378102ae0 2024-09-21T01:08:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f936e7fc640 1 -- 172.21.15.112:0/2716845221 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9368004cf0 con 0x7f9378102ae0 2024-09-21T01:08:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9378197a70 con 0x7f9378102ae0 2024-09-21T01:08:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f936e7fc640 1 -- 172.21.15.112:0/2716845221 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9368035030 con 0x7f9378102ae0 2024-09-21T01:08:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.978+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9378197fa0 con 0x7f9378102ae0 2024-09-21T01:08:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.979+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937806abe0 con 0x7f9378102ae0 2024-09-21T01:08:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.980+0000 7f936e7fc640 1 -- 172.21.15.112:0/2716845221 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f9368042070 con 0x7f9378102ae0 2024-09-21T01:08:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.980+0000 7f936e7fc640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f936407af30 0x7f936407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.980+0000 7f936e7fc640 1 -- 172.21.15.112:0/2716845221 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f93680bebc0 con 0x7f9378102ae0 2024-09-21T01:08:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.980+0000 7f937cb66640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f936407af30 0x7f936407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.981+0000 7f937cb66640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f936407af30 0x7f936407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9374005d90 tx=0x7f9374005d20 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:29.985+0000 7f936e7fc640 1 -- 172.21.15.112:0/2716845221 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f936808a0c0 con 0x7f9378102ae0 2024-09-21T01:08:30.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.173+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9378105fb0 con 0x7f9378102ae0 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.173+0000 7f936e7fc640 1 -- 172.21.15.112:0/2716845221 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v80) ==== 81+0+2225 (secure 0 0 0) 0x7f936808ef70 con 0x7f9378102ae0 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6827/1944064649 2024-09-22T01:05:49.359816+0000 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6826/1944064649 2024-09-22T01:05:49.359816+0000 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6825/3413694617 2024-09-22T01:05:25.326938+0000 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6824/3413694617 2024-09-22T01:05:25.326938+0000 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6829/1434345295 2024-09-22T01:05:02.783241+0000 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6828/1434345295 2024-09-22T01:05:02.783241+0000 2024-09-21T01:08:30.174 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1888748619 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/467812698 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1353438780 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/186527546 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/31517036 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6828/2068672275 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6827/1702504243 2024-09-22T00:54:08.390761+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6826/1702504243 2024-09-22T00:54:08.390761+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1057860168 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6829/2068672275 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1095552815 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/3765534604 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1149588560 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/163748665 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:30.175 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1149588560 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/3765534604 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1370295957 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/4169831408 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/3893613006 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/1717395158 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/2125532167 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1831378595 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/722840575 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1888748619 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3460305391 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/713543 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1831378595 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/987062445 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/2064942528 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:30.176 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3625555904 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:30.177 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/703678932 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:30.177 INFO:teuthology.orchestra.run.smithi112.stderr:listed 37 entries 2024-09-21T01:08:30.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f936407af30 msgr2=0x7f936407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:30.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f936407af30 0x7f936407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9374005d90 tx=0x7f9374005d20 comp rx=0 tx=0).stop 2024-09-21T01:08:30.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 msgr2=0x7f937819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:30.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f937819d660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9368031460 tx=0x7f93680048f0 comp rx=0 tx=0).stop 2024-09-21T01:08:30.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 shutdown_connections 2024-09-21T01:08:30.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f936407af30 0x7f936407d3f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:30.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9378103400 0x7f937819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:30.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 --2- 172.21.15.112:0/2716845221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9378102ae0 0x7f937819d660 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:30.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 >> 172.21.15.112:0/2716845221 conn(0x7f93780fc520 msgr2=0x7f9378108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:30.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 shutdown_connections 2024-09-21T01:08:30.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:30.176+0000 7f937f5cb640 1 -- 172.21.15.112:0/2716845221 wait complete. 2024-09-21T01:08:30.818 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T01:08:30.818 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:08:30.836 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:08:31.133 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/mon.smithi112/config 2024-09-21T01:08:31.255 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:31 smithi112 ceph-mon[109687]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:31.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:31 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2716845221' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:08:31.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:31 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:31.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:31 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:08:31.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:31 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:08:31.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:31 smithi187 ceph-mon[78584]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:31 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2716845221' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:08:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:31 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:31 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:08:31.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:31 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:08:31.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.624+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/3751250918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0107930 msgr2=0x7f2cf0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:31.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.624+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/3751250918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0107930 0x7f2cf0107d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009880 tx=0x7f2ce002a4a0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/3751250918 shutdown_connections 2024-09-21T01:08:31.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/3751250918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf0101930 0x7f2cf0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/3751250918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0107930 0x7f2cf0107d10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/3751250918 >> 172.21.15.112:0/3751250918 conn(0x7f2cf00fd630 msgr2=0x7f2cf00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/3751250918 shutdown_connections 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/3751250918 wait complete. 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 Processor -- start 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.625+0000 7f2cf5d3c640 1 -- start start 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cf5d3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0101930 0x7f2cf00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cf5d3c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf0107930 0x7f2cf0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cf5d3c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf010ede0 con 0x7f2cf0101930 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cf5d3c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf010ec60 con 0x7f2cf0107930 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cef7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0101930 0x7f2cf00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cef7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0101930 0x7f2cf00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52758/0 (socket says 172.21.15.112:52758) 2024-09-21T01:08:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cef7fe640 1 -- 172.21.15.112:0/2664097170 learned_addr learned my addr 172.21.15.112:0/2664097170 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2ceeffd640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf0107930 0x7f2cf0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cef7fe640 1 -- 172.21.15.112:0/2664097170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf0107930 msgr2=0x7f2cf0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cef7fe640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf0107930 0x7f2cf0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cef7fe640 1 -- 172.21.15.112:0/2664097170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf0074f70 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cef7fe640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0101930 0x7f2cf00744f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0031460 tx=0x7f2ce00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cecff9640 1 -- 172.21.15.112:0/2664097170 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ce003f070 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.626+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf0075200 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.627+0000 7f2cecff9640 1 -- 172.21.15.112:0/2664097170 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ce00035f0 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.627+0000 7f2cecff9640 1 -- 172.21.15.112:0/2664097170 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ce0035030 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.627+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf01a3dd0 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.628+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf0103070 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.628+0000 7f2cecff9640 1 -- 172.21.15.112:0/2664097170 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 33) ==== 103322+0+0 (secure 0 0 0) 0x7f2ce0042070 con 0x7f2cf0101930 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.629+0000 7f2cecff9640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2cd807af30 0x7f2cd807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.629+0000 7f2ceeffd640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2cd807af30 0x7f2cd807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.629+0000 7f2cecff9640 1 -- 172.21.15.112:0/2664097170 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6414+0+0 (secure 0 0 0) 0x7f2ce00bead0 con 0x7f2cf0101930 2024-09-21T01:08:31.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.629+0000 7f2ceeffd640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2cd807af30 0x7f2cd807d3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0075f80 tx=0x7f2ce400b390 comp rx=0 tx=0).ready entity=mgr.24473 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:31.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.633+0000 7f2cecff9640 1 -- 172.21.15.112:0/2664097170 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ce0089f70 con 0x7f2cf0101930 2024-09-21T01:08:31.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.824+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2cf002d7c0 con 0x7f2cf0101930 2024-09-21T01:08:31.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.824+0000 7f2cecff9640 1 -- 172.21.15.112:0/2664097170 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v80) ==== 81+0+2225 (secure 0 0 0) 0x7f2ce008ee20 con 0x7f2cf0101930 2024-09-21T01:08:31.826 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6827/1944064649 2024-09-22T01:05:49.359816+0000 2024-09-21T01:08:31.826 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6826/1944064649 2024-09-22T01:05:49.359816+0000 2024-09-21T01:08:31.826 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6825/3413694617 2024-09-22T01:05:25.326938+0000 2024-09-21T01:08:31.826 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6824/3413694617 2024-09-22T01:05:25.326938+0000 2024-09-21T01:08:31.826 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6829/1434345295 2024-09-22T01:05:02.783241+0000 2024-09-21T01:08:31.826 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6828/1434345295 2024-09-22T01:05:02.783241+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1888748619 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/467812698 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1353438780 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/186527546 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/31517036 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6828/2068672275 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6827/1702504243 2024-09-22T00:54:08.390761+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6826/1702504243 2024-09-22T00:54:08.390761+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1057860168 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:6829/2068672275 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1095552815 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/3765534604 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1149588560 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/163748665 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1149588560 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/3765534604 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/1370295957 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/4169831408 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/3893613006 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/1717395158 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/2125532167 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6800/1831378595 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/722840575 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1888748619 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3460305391 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/713543 2024-09-22T00:49:05.189182+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6801/1831378595 2024-09-22T00:47:38.084945+0000 2024-09-21T01:08:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/987062445 2024-09-22T00:48:09.439159+0000 2024-09-21T01:08:31.829 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.187:0/2064942528 2024-09-22T00:57:27.525603+0000 2024-09-21T01:08:31.829 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/3625555904 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:31.829 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:0/703678932 2024-09-22T00:55:59.023700+0000 2024-09-21T01:08:31.829 INFO:teuthology.orchestra.run.smithi112.stderr:listed 37 entries 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2cd807af30 msgr2=0x7f2cd807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2cd807af30 0x7f2cd807d3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0075f80 tx=0x7f2ce400b390 comp rx=0 tx=0).stop 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0101930 msgr2=0x7f2cf00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0101930 0x7f2cf00744f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0031460 tx=0x7f2ce00045e0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 shutdown_connections 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:6800/990479702,v1:172.21.15.112:6801/990479702] conn(0x7f2cd807af30 0x7f2cd807d3f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf0107930 0x7f2cf0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 --2- 172.21.15.112:0/2664097170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0101930 0x7f2cf00744f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 >> 172.21.15.112:0/2664097170 conn(0x7f2cf00fd630 msgr2=0x7f2cf00fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.826+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 shutdown_connections 2024-09-21T01:08:31.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T01:08:31.827+0000 7f2cf5d3c640 1 -- 172.21.15.112:0/2664097170 wait complete. 2024-09-21T01:08:32.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:08:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:32 smithi187 ceph-mon[78584]: from='client.? 172.21.15.112:0/2664097170' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:08:32.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:32.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:32.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:08:32.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:32 smithi112 ceph-mon[109687]: from='client.? 172.21.15.112:0/2664097170' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:08:32.487 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-21T01:08:32.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:08:32.487 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T01:08:32.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T01:08:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:33 smithi187 ceph-mon[78584]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:33.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:33 smithi112 ceph-mon[109687]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:35.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:35 smithi187 ceph-mon[78584]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:35.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:35 smithi112 ceph-mon[109687]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:37.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:37 smithi112 ceph-mon[109687]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:37.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:37 smithi187 ceph-mon[78584]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:39.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:39 smithi187 ceph-mon[78584]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:39.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:39 smithi112 ceph-mon[109687]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:41.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:41 smithi187 ceph-mon[78584]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:41.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:41 smithi112 ceph-mon[109687]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:43.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:43 smithi187 ceph-mon[78584]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:43.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:43 smithi112 ceph-mon[109687]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:44.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:45.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:45 smithi187 ceph-mon[78584]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:45 smithi112 ceph-mon[109687]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:47.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:47 smithi187 ceph-mon[78584]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:47.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:47 smithi112 ceph-mon[109687]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:49.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:49 smithi187 ceph-mon[78584]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:49 smithi112 ceph-mon[109687]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:51.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:51 smithi187 ceph-mon[78584]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:51.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:51 smithi112 ceph-mon[109687]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:53.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:53 smithi112 ceph-mon[109687]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:53.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:53 smithi187 ceph-mon[78584]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:55.576 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:55 smithi112 ceph-mon[109687]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:55.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:55 smithi187 ceph-mon[78584]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:57.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:57 smithi187 ceph-mon[78584]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:57.762 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:57 smithi112 ceph-mon[109687]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:58.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:58.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:08:59.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:08:59 smithi187 ceph-mon[78584]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:08:59.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:08:59 smithi112 ceph-mon[109687]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:00.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:00 smithi187 ceph-mon[78584]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:00 smithi112 ceph-mon[109687]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:03.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:02 smithi187 ceph-mon[78584]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:03.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:02 smithi112 ceph-mon[109687]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:05.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:04 smithi187 ceph-mon[78584]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:04 smithi112 ceph-mon[109687]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:07.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:06 smithi112 ceph-mon[109687]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:07.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:06 smithi187 ceph-mon[78584]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:09.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:08 smithi187 ceph-mon[78584]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:08 smithi112 ceph-mon[109687]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:11.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:10 smithi187 ceph-mon[78584]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:11.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:10 smithi112 ceph-mon[109687]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:13.102 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:12 smithi187 ceph-mon[78584]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:13.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:12 smithi112 ceph-mon[109687]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:14.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:09:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:09:15.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:14 smithi187 ceph-mon[78584]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:14 smithi112 ceph-mon[109687]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:17.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:16 smithi187 ceph-mon[78584]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:16 smithi112 ceph-mon[109687]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:19.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:18 smithi112 ceph-mon[109687]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:19.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:18 smithi187 ceph-mon[78584]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:21.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:20 smithi112 ceph-mon[109687]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:21.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:20 smithi187 ceph-mon[78584]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:22 smithi112 ceph-mon[109687]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:23.268 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:22 smithi187 ceph-mon[78584]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:25.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:24 smithi112 ceph-mon[109687]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:25.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:25 smithi187 ceph-mon[78584]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:27 smithi112 ceph-mon[109687]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:27.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:27 smithi187 ceph-mon[78584]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:29 smithi112 ceph-mon[109687]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:09:29.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:29 smithi187 ceph-mon[78584]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:29.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:09:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:31 smithi112 ceph-mon[109687]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:31.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:31 smithi187 ceph-mon[78584]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:32.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:32.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:09:32.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:09:32.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:32.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:32.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:09:32.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:32.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:09:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:09:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:32.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:09:33.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:33 smithi187 ceph-mon[78584]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:33 smithi112 ceph-mon[109687]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:35.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:35 smithi187 ceph-mon[78584]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:35.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:35 smithi112 ceph-mon[109687]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:37.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:37 smithi112 ceph-mon[109687]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:37.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:37 smithi187 ceph-mon[78584]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:39 smithi112 ceph-mon[109687]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:39.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:39 smithi187 ceph-mon[78584]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:41.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:41 smithi187 ceph-mon[78584]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:41 smithi112 ceph-mon[109687]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:43.372 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:43 smithi112 ceph-mon[109687]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:43.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:43 smithi187 ceph-mon[78584]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:44.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:09:44.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:09:45.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:45 smithi187 ceph-mon[78584]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:45 smithi112 ceph-mon[109687]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:47.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:47 smithi187 ceph-mon[78584]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:47 smithi112 ceph-mon[109687]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:49.364 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:49 smithi112 ceph-mon[109687]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:49.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:49 smithi187 ceph-mon[78584]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:51.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:51 smithi187 ceph-mon[78584]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:51 smithi112 ceph-mon[109687]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:53.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:53 smithi187 ceph-mon[78584]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:53.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:53 smithi112 ceph-mon[109687]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:55.364 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:55 smithi112 ceph-mon[109687]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:55.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:55 smithi187 ceph-mon[78584]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:57.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:57 smithi187 ceph-mon[78584]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:57.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:57 smithi112 ceph-mon[109687]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:59.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:59 smithi187 ceph-mon[78584]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:59.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:09:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:09:59.378 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:59 smithi112 ceph-mon[109687]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:09:59.378 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:09:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:00.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:00 smithi187 ceph-mon[78584]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:10:00.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:00 smithi112 ceph-mon[109687]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T01:10:01.364 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:01 smithi112 ceph-mon[109687]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:01.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:01 smithi187 ceph-mon[78584]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:03.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:03 smithi187 ceph-mon[78584]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:03.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:03 smithi112 ceph-mon[109687]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:05.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:05 smithi187 ceph-mon[78584]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:05 smithi112 ceph-mon[109687]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:07.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:07 smithi112 ceph-mon[109687]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:07.410 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:07 smithi187 ceph-mon[78584]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:09.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:09 smithi187 ceph-mon[78584]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:09 smithi112 ceph-mon[109687]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:11.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:11 smithi187 ceph-mon[78584]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:11.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:11 smithi112 ceph-mon[109687]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:13.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:13 smithi112 ceph-mon[109687]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:13.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:13 smithi187 ceph-mon[78584]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:14.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:15.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:15 smithi187 ceph-mon[78584]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:15.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:15 smithi112 ceph-mon[109687]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:17.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:17 smithi187 ceph-mon[78584]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:17.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:17 smithi112 ceph-mon[109687]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:19.372 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:19 smithi112 ceph-mon[109687]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:19.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:19 smithi187 ceph-mon[78584]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:21.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:21 smithi187 ceph-mon[78584]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:21.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:21 smithi112 ceph-mon[109687]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:23.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:23 smithi187 ceph-mon[78584]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:23.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:23 smithi112 ceph-mon[109687]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:25.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:25 smithi112 ceph-mon[109687]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:25.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:25 smithi187 ceph-mon[78584]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:27.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:27 smithi187 ceph-mon[78584]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:27.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:27 smithi112 ceph-mon[109687]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:29.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:29 smithi187 ceph-mon[78584]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:29.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:29 smithi112 ceph-mon[109687]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:31.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:31 smithi187 ceph-mon[78584]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:31.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:31 smithi112 ceph-mon[109687]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:32.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:32 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:32.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:32 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:33.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:33 smithi187 ceph-mon[78584]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:33.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:33.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:33.409 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:10:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:33 smithi112 ceph-mon[109687]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:10:35.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:35 smithi187 ceph-mon[78584]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:35.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:35 smithi112 ceph-mon[109687]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:37.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:37 smithi112 ceph-mon[109687]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:37.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:37 smithi187 ceph-mon[78584]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:39.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:39 smithi187 ceph-mon[78584]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:39.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:39 smithi112 ceph-mon[109687]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:41.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:41 smithi187 ceph-mon[78584]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:41 smithi112 ceph-mon[109687]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:43.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:43 smithi187 ceph-mon[78584]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:43.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:43 smithi112 ceph-mon[109687]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:44.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:44.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:45.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:45 smithi187 ceph-mon[78584]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:45.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:45 smithi112 ceph-mon[109687]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:47.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:47 smithi187 ceph-mon[78584]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:47 smithi112 ceph-mon[109687]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:49.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:49 smithi112 ceph-mon[109687]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:49.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:49 smithi187 ceph-mon[78584]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:51.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:51 smithi112 ceph-mon[109687]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:51.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:51 smithi187 ceph-mon[78584]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:53.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:53 smithi112 ceph-mon[109687]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:53.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:53 smithi187 ceph-mon[78584]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:55.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:55 smithi112 ceph-mon[109687]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:55.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:55 smithi187 ceph-mon[78584]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:57.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:57 smithi112 ceph-mon[109687]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:57.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:57 smithi187 ceph-mon[78584]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:59.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:59 smithi112 ceph-mon[109687]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:59.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:10:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:10:59.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:59 smithi187 ceph-mon[78584]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:10:59.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:10:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:01.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:01 smithi112 ceph-mon[109687]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:01.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:01 smithi187 ceph-mon[78584]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:03.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:03 smithi112 ceph-mon[109687]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:03.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:03 smithi187 ceph-mon[78584]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:05.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:05 smithi187 ceph-mon[78584]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:05.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:05 smithi112 ceph-mon[109687]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:07.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:07 smithi112 ceph-mon[109687]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:07.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:07 smithi187 ceph-mon[78584]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:09.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:09 smithi112 ceph-mon[109687]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:09.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:09 smithi187 ceph-mon[78584]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:11.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:11 smithi112 ceph-mon[109687]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:11.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:11 smithi187 ceph-mon[78584]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:13.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:13 smithi112 ceph-mon[109687]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:13.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:13 smithi187 ceph-mon[78584]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:14.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:14 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:14.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:14 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:15.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:15 smithi187 ceph-mon[78584]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:15.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:15 smithi112 ceph-mon[109687]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:17.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:17 smithi112 ceph-mon[109687]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:17.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:17 smithi187 ceph-mon[78584]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:19.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:19 smithi112 ceph-mon[109687]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:19.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:19 smithi187 ceph-mon[78584]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:21.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:21 smithi112 ceph-mon[109687]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:21.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:21 smithi187 ceph-mon[78584]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:23.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:23 smithi112 ceph-mon[109687]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:23.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:23 smithi187 ceph-mon[78584]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:25.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:25 smithi112 ceph-mon[109687]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:25.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:25 smithi187 ceph-mon[78584]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:27.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:27 smithi112 ceph-mon[109687]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:27.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:27 smithi187 ceph-mon[78584]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:29 smithi112 ceph-mon[109687]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:29.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:29 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:29.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:29 smithi187 ceph-mon[78584]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:29.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:29 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:31.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:31 smithi112 ceph-mon[109687]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:31.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:31 smithi187 ceph-mon[78584]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:33 smithi112 ceph-mon[109687]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:33.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:33.511 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:11:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:33 smithi187 ceph-mon[78584]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:33.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:33.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:11:35.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:35 smithi112 ceph-mon[109687]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:35.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:35 smithi187 ceph-mon[78584]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:37.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:37 smithi112 ceph-mon[109687]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:37.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:37 smithi187 ceph-mon[78584]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:39.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:39 smithi112 ceph-mon[109687]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:39.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:39 smithi187 ceph-mon[78584]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:41.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:41 smithi112 ceph-mon[109687]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:41.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:41 smithi187 ceph-mon[78584]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:43.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:43 smithi112 ceph-mon[109687]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:43.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:43 smithi187 ceph-mon[78584]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:44.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:44 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:44.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:44 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:45.607 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:45 smithi187 ceph-mon[78584]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:45.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:45 smithi112 ceph-mon[109687]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:47.510 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:47 smithi112 ceph-mon[109687]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:47.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:47 smithi187 ceph-mon[78584]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:49.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:49 smithi187 ceph-mon[78584]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:49.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:49 smithi112 ceph-mon[109687]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:51.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:51 smithi187 ceph-mon[78584]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:51.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:51 smithi112 ceph-mon[109687]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:53.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:53 smithi187 ceph-mon[78584]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:53.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:53 smithi112 ceph-mon[109687]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:55.562 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:55 smithi112 ceph-mon[109687]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:55.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:55 smithi187 ceph-mon[78584]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:57.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:57 smithi187 ceph-mon[78584]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:57.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:57 smithi112 ceph-mon[109687]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:59.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:59 smithi187 ceph-mon[78584]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:59.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:11:59 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:11:59.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:59 smithi112 ceph-mon[109687]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:11:59.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:11:59 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:01.628 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:01 smithi112 ceph-mon[109687]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:01.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:01 smithi187 ceph-mon[78584]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:03.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:03 smithi187 ceph-mon[78584]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:03.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:03 smithi112 ceph-mon[109687]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:05.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:05 smithi187 ceph-mon[78584]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:05.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:05 smithi112 ceph-mon[109687]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:07.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:07 smithi187 ceph-mon[78584]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:07.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:07 smithi112 ceph-mon[109687]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:09.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:09 smithi187 ceph-mon[78584]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:09.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:09 smithi112 ceph-mon[109687]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:11.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:11 smithi187 ceph-mon[78584]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:11.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:11 smithi112 ceph-mon[109687]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:13.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:13 smithi187 ceph-mon[78584]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:13.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:13 smithi112 ceph-mon[109687]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:13.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:15.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:15 smithi187 ceph-mon[78584]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:15.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:15 smithi112 ceph-mon[109687]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:17.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:17 smithi187 ceph-mon[78584]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:17.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:17 smithi112 ceph-mon[109687]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:19.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:19 smithi187 ceph-mon[78584]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:19.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:19 smithi112 ceph-mon[109687]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:21.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:21 smithi187 ceph-mon[78584]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:21.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:21 smithi112 ceph-mon[109687]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:23.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:23 smithi187 ceph-mon[78584]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:23.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:23 smithi112 ceph-mon[109687]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:25.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:25 smithi187 ceph-mon[78584]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:25.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:25 smithi112 ceph-mon[109687]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:27.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:27 smithi187 ceph-mon[78584]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:27.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:27 smithi112 ceph-mon[109687]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:28.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:28.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:29.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:29 smithi187 ceph-mon[78584]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:29.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:29 smithi112 ceph-mon[109687]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:30.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:30 smithi187 ceph-mon[78584]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:30.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:30 smithi112 ceph-mon[109687]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:33.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:32 smithi187 ceph-mon[78584]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:33.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:32 smithi112 ceph-mon[109687]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:34.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:34.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:34.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:34.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:33 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:12:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:34.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:33 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' 2024-09-21T01:12:35.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:34 smithi187 ceph-mon[78584]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:35.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:34 smithi112 ceph-mon[109687]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:37.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:36 smithi187 ceph-mon[78584]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:37.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:36 smithi112 ceph-mon[109687]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:39.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:38 smithi187 ceph-mon[78584]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:39.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:38 smithi112 ceph-mon[109687]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:41.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:40 smithi187 ceph-mon[78584]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:41.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:40 smithi112 ceph-mon[109687]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:43.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:42 smithi187 ceph-mon[78584]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:43.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:42 smithi112 ceph-mon[109687]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:44.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:43 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:44.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:43 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:45.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:44 smithi187 ceph-mon[78584]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:45.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:44 smithi112 ceph-mon[109687]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:47.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:46 smithi187 ceph-mon[78584]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:47.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:46 smithi112 ceph-mon[109687]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:49.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:48 smithi187 ceph-mon[78584]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:49.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:48 smithi112 ceph-mon[109687]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:51.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:50 smithi187 ceph-mon[78584]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:51.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:50 smithi112 ceph-mon[109687]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:53.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:52 smithi187 ceph-mon[78584]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:53.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:52 smithi112 ceph-mon[109687]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:55.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:54 smithi187 ceph-mon[78584]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:55.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:54 smithi112 ceph-mon[109687]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:57.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:56 smithi187 ceph-mon[78584]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:57.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:56 smithi112 ceph-mon[109687]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:59.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:58 smithi187 ceph-mon[78584]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:59.159 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:12:58 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:12:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:58 smithi112 ceph-mon[109687]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:12:59.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:12:58 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:13:01.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:00 smithi187 ceph-mon[78584]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:01.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:00 smithi112 ceph-mon[109687]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:03.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:02 smithi112 ceph-mon[109687]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:03.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:02 smithi187 ceph-mon[78584]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:05.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:04 smithi187 ceph-mon[78584]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:05.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:04 smithi112 ceph-mon[109687]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:07.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:06 smithi187 ceph-mon[78584]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:07.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:06 smithi112 ceph-mon[109687]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:09.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:08 smithi187 ceph-mon[78584]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:09.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:08 smithi112 ceph-mon[109687]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:11.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:10 smithi187 ceph-mon[78584]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:11.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:10 smithi112 ceph-mon[109687]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:13.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:12 smithi112 ceph-mon[109687]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:13.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:12 smithi187 ceph-mon[78584]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:14.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:13 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:13:14.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:13 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:13:15.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:14 smithi112 ceph-mon[109687]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:15.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:14 smithi187 ceph-mon[78584]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:16 smithi112 ceph-mon[109687]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:17.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:16 smithi187 ceph-mon[78584]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:19.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:18 smithi112 ceph-mon[109687]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:19.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:18 smithi187 ceph-mon[78584]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:21.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:20 smithi112 ceph-mon[109687]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:21.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:20 smithi187 ceph-mon[78584]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:23.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:22 smithi112 ceph-mon[109687]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:23.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:22 smithi187 ceph-mon[78584]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:25.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:24 smithi112 ceph-mon[109687]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:25.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:24 smithi187 ceph-mon[78584]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:27.211 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:26 smithi187 ceph-mon[78584]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:27.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:26 smithi112 ceph-mon[109687]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:28 smithi112 ceph-mon[109687]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:29.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:28 smithi112 ceph-mon[109687]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:13:29.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:28 smithi187 ceph-mon[78584]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:29.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:28 smithi187 ceph-mon[78584]: from='mgr.24473 172.21.15.112:0/540539109' entity='mgr.smithi112.fzmyfw' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T01:13:31.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:30 smithi112 ceph-mon[109687]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:31.408 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:30 smithi187 ceph-mon[78584]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T01:13:31.580 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-21T01:13:31.580 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T01:13:31.582 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T01:13:31.599 INFO:tasks.cephadm:Teardown begin 2024-09-21T01:13:31.599 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/cephadm.py", line 2380, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T01:13:31.601 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:13:31.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:13:31.668 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T01:13:31.668 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:13:31.693 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:13:31.726 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T01:13:31.726 INFO:tasks.cephadm.mon.smithi112:Stopping mon.smithi112... 2024-09-21T01:13:31.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112 2024-09-21T01:13:32.010 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:31 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:13:32.340 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:32 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[109683]: 2024-09-21T01:13:32.055+0000 7fab6c028640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:13:32.340 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:32 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112[109683]: 2024-09-21T01:13:32.055+0000 7fab6c028640 -1 mon.smithi112@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T01:13:32.340 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:32 smithi112 podman[150929]: 2024-09-21 01:13:32.086785974 +0000 UTC m=+0.157917901 container died 090f017cf4b96c73d545a51208d3a3fa82fe7eb2b647ec6aae815bd40f5f0cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T01:13:32.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:32 smithi112 podman[150929]: 2024-09-21 01:13:32.547842075 +0000 UTC m=+0.618974001 container cleanup 090f017cf4b96c73d545a51208d3a3fa82fe7eb2b647ec6aae815bd40f5f0cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:32.648 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:32 smithi112 bash[150929]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112 2024-09-21T01:13:32.957 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 01:13:32 smithi112 podman[150941]: 2024-09-21 01:13:32.841150663 +0000 UTC m=+0.756879587 container remove 090f017cf4b96c73d545a51208d3a3fa82fe7eb2b647ec6aae815bd40f5f0cdd (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi112, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T01:13:32.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi112.service' 2024-09-21T01:13:33.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:13:33.020 INFO:tasks.cephadm.mon.smithi112:Stopped mon.smithi112 2024-09-21T01:13:33.020 INFO:tasks.cephadm.mon.smithi187:Stopping mon.smithi187... 2024-09-21T01:13:33.020 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi187 2024-09-21T01:13:33.346 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:33 smithi187 systemd[1]: Stopping Ceph mon.smithi187 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:13:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:33 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187[78580]: 2024-09-21T01:13:33.345+0000 7f4802af8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi187 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:13:33.658 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:33 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187[78580]: 2024-09-21T01:13:33.345+0000 7f4802af8640 -1 mon.smithi187@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T01:13:33.659 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:33 smithi187 podman[111289]: 2024-09-21 01:13:33.55019943 +0000 UTC m=+0.327669556 container died e3fc2a18eab40476aec885a3acbd5eaf005dc5b9d85f00040b1d9cdc2193d838 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:34.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:34 smithi187 podman[111289]: 2024-09-21 01:13:34.012338342 +0000 UTC m=+0.789808463 container cleanup e3fc2a18eab40476aec885a3acbd5eaf005dc5b9d85f00040b1d9cdc2193d838 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T01:13:34.158 INFO:journalctl@ceph.mon.smithi187.smithi187.stdout:Sep 21 01:13:34 smithi187 bash[111289]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-mon-smithi187 2024-09-21T01:13:34.444 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@mon.smithi187.service' 2024-09-21T01:13:34.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:13:34.490 INFO:tasks.cephadm.mon.smithi187:Stopped mon.smithi187 2024-09-21T01:13:34.490 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T01:13:34.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.0 2024-09-21T01:13:34.760 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:34 smithi112 systemd[1]: Stopping Ceph osd.0 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:13:35.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:34 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[118605]: 2024-09-21T01:13:34.785+0000 7f229bfbc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:13:35.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:34 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[118605]: 2024-09-21T01:13:34.785+0000 7f229bfbc640 -1 osd.0 80 *** Got signal Terminated *** 2024-09-21T01:13:35.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:34 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0[118605]: 2024-09-21T01:13:34.785+0000 7f229bfbc640 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:13:40.654 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:40 smithi112 podman[151060]: 2024-09-21 01:13:40.322557875 +0000 UTC m=+5.637050844 container died 4e028816cafdd854e0889e3dc7a7cb70a67c0ea5fffd509e629c4d4266574be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:40.962 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:40 smithi112 podman[151060]: 2024-09-21 01:13:40.752908735 +0000 UTC m=+6.067401693 container cleanup 4e028816cafdd854e0889e3dc7a7cb70a67c0ea5fffd509e629c4d4266574be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:13:40.963 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:40 smithi112 bash[151060]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0 2024-09-21T01:13:41.260 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:40 smithi112 podman[151075]: 2024-09-21 01:13:40.962826089 +0000 UTC m=+0.638581435 container remove 4e028816cafdd854e0889e3dc7a7cb70a67c0ea5fffd509e629c4d4266574be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T01:13:41.699 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:41 smithi112 podman[151168]: 2024-09-21 01:13:41.270697092 +0000 UTC m=+0.016182281 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:41.699 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:41 smithi112 podman[151168]: 2024-09-21 01:13:41.371791518 +0000 UTC m=+0.117276707 container create dc905f9c5698c24fe8887b0bc46ad4c7b2fcd62466facbdb2873faf1c8317f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:13:41.699 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:41 smithi112 podman[151168]: 2024-09-21 01:13:41.607773335 +0000 UTC m=+0.353258531 container init dc905f9c5698c24fe8887b0bc46ad4c7b2fcd62466facbdb2873faf1c8317f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:13:41.699 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:41 smithi112 podman[151168]: 2024-09-21 01:13:41.61132083 +0000 UTC m=+0.356806020 container start dc905f9c5698c24fe8887b0bc46ad4c7b2fcd62466facbdb2873faf1c8317f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:13:41.699 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:41 smithi112 podman[151168]: 2024-09-21 01:13:41.699398623 +0000 UTC m=+0.444883813 container attach dc905f9c5698c24fe8887b0bc46ad4c7b2fcd62466facbdb2873faf1c8317f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:13:42.010 INFO:journalctl@ceph.osd.0.smithi112.stdout:Sep 21 01:13:41 smithi112 podman[151168]: 2024-09-21 01:13:41.803286949 +0000 UTC m=+0.548772139 container died dc905f9c5698c24fe8887b0bc46ad4c7b2fcd62466facbdb2873faf1c8317f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T01:13:42.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T01:13:42.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:13:42.478 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T01:13:42.478 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T01:13:42.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.1 2024-09-21T01:13:42.697 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:42 smithi112 systemd[1]: Stopping Ceph osd.1 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:13:43.010 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:42 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[123745]: 2024-09-21T01:13:42.813+0000 7fdb891e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:13:43.010 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:42 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[123745]: 2024-09-21T01:13:42.813+0000 7fdb891e3640 -1 osd.1 80 *** Got signal Terminated *** 2024-09-21T01:13:43.010 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:42 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1[123745]: 2024-09-21T01:13:42.813+0000 7fdb891e3640 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:13:48.499 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:48 smithi112 podman[151272]: 2024-09-21 01:13:48.2164178 +0000 UTC m=+5.513603600 container died 373b804b4706a448c8124683a1435e5358ea6e21b1c2f74f13fd1a6989f0a01e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T01:13:48.760 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:48 smithi112 podman[151272]: 2024-09-21 01:13:48.598639193 +0000 UTC m=+5.895824987 container cleanup 373b804b4706a448c8124683a1435e5358ea6e21b1c2f74f13fd1a6989f0a01e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T01:13:48.760 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:48 smithi112 bash[151272]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1 2024-09-21T01:13:49.260 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:48 smithi112 podman[151299]: 2024-09-21 01:13:48.908655301 +0000 UTC m=+0.691689806 container remove 373b804b4706a448c8124683a1435e5358ea6e21b1c2f74f13fd1a6989f0a01e (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:13:49.590 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:49 smithi112 podman[151392]: 2024-09-21 01:13:49.171406218 +0000 UTC m=+0.016223827 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:49.590 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:49 smithi112 podman[151392]: 2024-09-21 01:13:49.291188367 +0000 UTC m=+0.136006011 container create 1fa977463decf4a4c1093de73b5c75d2cf43dbb0f2d4e4e89fa8d04aef1f94fa (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T01:13:49.935 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:49 smithi112 podman[151392]: 2024-09-21 01:13:49.737078309 +0000 UTC m=+0.581895907 container init 1fa977463decf4a4c1093de73b5c75d2cf43dbb0f2d4e4e89fa8d04aef1f94fa (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:13:49.935 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:49 smithi112 podman[151392]: 2024-09-21 01:13:49.74079779 +0000 UTC m=+0.585615402 container start 1fa977463decf4a4c1093de73b5c75d2cf43dbb0f2d4e4e89fa8d04aef1f94fa (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T01:13:49.935 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:49 smithi112 podman[151392]: 2024-09-21 01:13:49.828507346 +0000 UTC m=+0.673324957 container attach 1fa977463decf4a4c1093de73b5c75d2cf43dbb0f2d4e4e89fa8d04aef1f94fa (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T01:13:50.232 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 21 01:13:49 smithi112 podman[151392]: 2024-09-21 01:13:49.935263451 +0000 UTC m=+0.780081055 container died 1fa977463decf4a4c1093de73b5c75d2cf43dbb0f2d4e4e89fa8d04aef1f94fa (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T01:13:50.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T01:13:50.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:13:50.608 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T01:13:50.608 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T01:13:50.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.2 2024-09-21T01:13:50.943 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:50 smithi112 systemd[1]: Stopping Ceph osd.2 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:13:51.260 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:50 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[129203]: 2024-09-21T01:13:50.943+0000 7fc00fd7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:13:51.260 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:50 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[129203]: 2024-09-21T01:13:50.943+0000 7fc00fd7b640 -1 osd.2 80 *** Got signal Terminated *** 2024-09-21T01:13:51.260 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:50 smithi112 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2[129203]: 2024-09-21T01:13:50.943+0000 7fc00fd7b640 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:13:56.654 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:56 smithi112 podman[151494]: 2024-09-21 01:13:56.385760246 +0000 UTC m=+5.543356036 container died 1c095dd62a18b6dbcef655597902d410cdf43dd2cc8022c1a62a015a6ff506cf (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T01:13:57.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:56 smithi112 podman[151494]: 2024-09-21 01:13:56.752031336 +0000 UTC m=+5.909627126 container cleanup 1c095dd62a18b6dbcef655597902d410cdf43dd2cc8022c1a62a015a6ff506cf (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T01:13:57.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:56 smithi112 bash[151494]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2 2024-09-21T01:13:57.446 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:57 smithi112 podman[151508]: 2024-09-21 01:13:57.070070057 +0000 UTC m=+0.679544258 container remove 1c095dd62a18b6dbcef655597902d410cdf43dd2cc8022c1a62a015a6ff506cf (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:57.723 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:57 smithi112 podman[151611]: 2024-09-21 01:13:57.349440758 +0000 UTC m=+0.020437320 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:57.723 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:57 smithi112 podman[151611]: 2024-09-21 01:13:57.479335079 +0000 UTC m=+0.150331634 container create 6797ac991012c67f6f2d89a3af7cee1560cadca51355ecf9015f1e2c0ba4c1e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:57.723 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:57 smithi112 podman[151611]: 2024-09-21 01:13:57.723393319 +0000 UTC m=+0.394389876 container init 6797ac991012c67f6f2d89a3af7cee1560cadca51355ecf9015f1e2c0ba4c1e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T01:13:58.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:57 smithi112 podman[151611]: 2024-09-21 01:13:57.72668091 +0000 UTC m=+0.397677458 container start 6797ac991012c67f6f2d89a3af7cee1560cadca51355ecf9015f1e2c0ba4c1e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:58.010 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:57 smithi112 podman[151611]: 2024-09-21 01:13:57.806906686 +0000 UTC m=+0.477903244 container attach 6797ac991012c67f6f2d89a3af7cee1560cadca51355ecf9015f1e2c0ba4c1e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:13:58.011 INFO:journalctl@ceph.osd.2.smithi112.stdout:Sep 21 01:13:57 smithi112 podman[151611]: 2024-09-21 01:13:57.920105512 +0000 UTC m=+0.591102075 container died 6797ac991012c67f6f2d89a3af7cee1560cadca51355ecf9015f1e2c0ba4c1e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:13:58.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T01:13:58.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:13:58.530 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T01:13:58.530 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T01:13:58.531 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.3 2024-09-21T01:13:58.823 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:13:58 smithi187 systemd[1]: Stopping Ceph osd.3 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:13:59.158 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:13:58 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[86007]: 2024-09-21T01:13:58.822+0000 7f1e43f5b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:13:59.158 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:13:58 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[86007]: 2024-09-21T01:13:58.822+0000 7f1e43f5b640 -1 osd.3 80 *** Got signal Terminated *** 2024-09-21T01:13:59.158 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:13:58 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3[86007]: 2024-09-21T01:13:58.822+0000 7f1e43f5b640 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:14:01.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:01 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:01.615+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:02.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:02 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:02.640+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:04.101 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:03 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:03.685+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:04.408 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:04 smithi187 podman[111413]: 2024-09-21 01:14:04.315453567 +0000 UTC m=+5.593712967 container died ea28f02f247bc54cf3ae0d30f0f2df6d07f35a10771f9ad41ee889f7f9ea4996 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T01:14:04.409 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:04 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:04.100+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:04.890 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:04 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:04.675+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:04.890 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:04 smithi187 podman[111413]: 2024-09-21 01:14:04.664527073 +0000 UTC m=+5.942786455 container cleanup ea28f02f247bc54cf3ae0d30f0f2df6d07f35a10771f9ad41ee889f7f9ea4996 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:14:04.890 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:04 smithi187 bash[111413]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3 2024-09-21T01:14:05.158 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:04 smithi187 podman[111432]: 2024-09-21 01:14:04.890104174 +0000 UTC m=+0.567522661 container remove ea28f02f247bc54cf3ae0d30f0f2df6d07f35a10771f9ad41ee889f7f9ea4996 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:14:05.159 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:05 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:05.064+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:05.627 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:05 smithi187 podman[111518]: 2024-09-21 01:14:05.227898 +0000 UTC m=+0.015831328 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:14:05.627 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:05 smithi187 podman[111518]: 2024-09-21 01:14:05.325078521 +0000 UTC m=+0.113011891 container create 54de3f86835d92a1d1799d60091da105c1cb409c62b32987848ffd8677074855 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T01:14:05.627 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:05 smithi187 podman[111518]: 2024-09-21 01:14:05.527459973 +0000 UTC m=+0.315393306 container init 54de3f86835d92a1d1799d60091da105c1cb409c62b32987848ffd8677074855 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T01:14:05.627 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:05 smithi187 podman[111518]: 2024-09-21 01:14:05.531432987 +0000 UTC m=+0.319366314 container start 54de3f86835d92a1d1799d60091da105c1cb409c62b32987848ffd8677074855 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T01:14:05.627 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:05 smithi187 podman[111518]: 2024-09-21 01:14:05.627354653 +0000 UTC m=+0.415287978 container attach 54de3f86835d92a1d1799d60091da105c1cb409c62b32987848ffd8677074855 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T01:14:05.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:05 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:05.669+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:05.909 INFO:journalctl@ceph.osd.3.smithi187.stdout:Sep 21 01:14:05 smithi187 podman[111518]: 2024-09-21 01:14:05.722613578 +0000 UTC m=+0.510546903 container died 54de3f86835d92a1d1799d60091da105c1cb409c62b32987848ffd8677074855 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T01:14:06.323 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:06 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:06.076+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:06.344 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T01:14:06.384 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:14:06.385 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T01:14:06.385 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T01:14:06.385 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.4 2024-09-21T01:14:06.603 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:06 smithi187 systemd[1]: Stopping Ceph osd.4 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:14:06.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:06 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:06.661+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:06.909 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:06 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:06.743+0000 7fa987640640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:14:06.909 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:06 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:06.743+0000 7fa987640640 -1 osd.4 80 *** Got signal Terminated *** 2024-09-21T01:14:06.909 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:06 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:06.743+0000 7fa987640640 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:14:07.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:07 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:07.031+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:07.885 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:07 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:07.634+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:08.158 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:08 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:08.070+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:08.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:08 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:08.596+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:08.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:08 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:08.596+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:09.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:09 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:09.049+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:09.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:09 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:09.627+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:09.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:09 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:09.627+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:10.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:10 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:10.044+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:10.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:10 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:10.044+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:45.281433+0000 front 2024-09-21T01:13:45.281369+0000 (oldest deadline 2024-09-21T01:14:09.981252+0000) 2024-09-21T01:14:10.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:10 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:10.589+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:10.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:10 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:10.589+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:11.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:11 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:11.049+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:37.680628+0000 front 2024-09-21T01:13:37.680690+0000 (oldest deadline 2024-09-21T01:14:03.580466+0000) 2024-09-21T01:14:11.408 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:11 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4[90790]: 2024-09-21T01:14:11.049+0000 7fa97fc23640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:45.281433+0000 front 2024-09-21T01:13:45.281369+0000 (oldest deadline 2024-09-21T01:14:09.981252+0000) 2024-09-21T01:14:11.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:11 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:11.609+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:11.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:11 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:11.609+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:12.386 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:12 smithi187 podman[111623]: 2024-09-21 01:14:12.096239294 +0000 UTC m=+5.476728487 container died 21ee55f89a04e97dad3405a55a581117b9a4027b5682d2e76b14630809b4b25b (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T01:14:12.658 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:12 smithi187 podman[111623]: 2024-09-21 01:14:12.48447602 +0000 UTC m=+5.864965213 container cleanup 21ee55f89a04e97dad3405a55a581117b9a4027b5682d2e76b14630809b4b25b (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T01:14:12.659 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:12 smithi187 bash[111623]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4 2024-09-21T01:14:12.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:12 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:12.607+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:12.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:12 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:12.607+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:13.106 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:12 smithi187 podman[111648]: 2024-09-21 01:14:12.769301695 +0000 UTC m=+0.661902472 container remove 21ee55f89a04e97dad3405a55a581117b9a4027b5682d2e76b14630809b4b25b (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T01:14:13.381 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:13 smithi187 podman[111735]: 2024-09-21 01:14:13.008948084 +0000 UTC m=+0.015894451 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:14:13.381 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:13 smithi187 podman[111735]: 2024-09-21 01:14:13.145248318 +0000 UTC m=+0.152194717 container create 2d3839dd6987afdbc7294c0b1cd660fc0bf0896004fa07c0e1ca1b18710be7b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:14:13.381 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:13 smithi187 podman[111735]: 2024-09-21 01:14:13.381157097 +0000 UTC m=+0.388103462 container init 2d3839dd6987afdbc7294c0b1cd660fc0bf0896004fa07c0e1ca1b18710be7b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T01:14:13.649 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:13 smithi187 podman[111735]: 2024-09-21 01:14:13.384547398 +0000 UTC m=+0.391493760 container start 2d3839dd6987afdbc7294c0b1cd660fc0bf0896004fa07c0e1ca1b18710be7b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:14:13.649 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:13 smithi187 podman[111735]: 2024-09-21 01:14:13.464404604 +0000 UTC m=+0.471350963 container attach 2d3839dd6987afdbc7294c0b1cd660fc0bf0896004fa07c0e1ca1b18710be7b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:14:13.649 INFO:journalctl@ceph.osd.4.smithi187.stdout:Sep 21 01:14:13 smithi187 podman[111735]: 2024-09-21 01:14:13.570470058 +0000 UTC m=+0.577416426 container died 2d3839dd6987afdbc7294c0b1cd660fc0bf0896004fa07c0e1ca1b18710be7b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:14:13.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:13 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:13.648+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:13.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:13 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:13.648+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:14.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T01:14:14.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:14:14.271 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T01:14:14.271 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T01:14:14.271 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.5 2024-09-21T01:14:14.604 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:14 smithi187 systemd[1]: Stopping Ceph osd.5 for ede6b7bc-77b2-11ef-baf5-efdc52797490... 2024-09-21T01:14:14.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:14 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:14.603+0000 7f3fa26c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:14:14.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:14 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:14.603+0000 7f3fa26c9640 -1 osd.5 80 *** Got signal Terminated *** 2024-09-21T01:14:14.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:14 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:14.603+0000 7f3fa26c9640 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:14:14.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:14 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:14.608+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:14.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:14 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:14.608+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:15.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:15 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:15.650+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:15.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:15 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:15.650+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:16.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:16 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:16.612+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:16.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:16 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:16.612+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:17.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:17 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:17.602+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:17.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:17 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:17.602+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:18.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:18 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:18.594+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:18.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:18 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:18.594+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:18.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:18 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:18.594+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6822 osd.2 since back 2024-09-21T01:13:54.902813+0000 front 2024-09-21T01:13:54.902839+0000 (oldest deadline 2024-09-21T01:14:18.402560+0000) 2024-09-21T01:14:19.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:19 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:19.577+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6806 osd.0 since back 2024-09-21T01:13:35.299338+0000 front 2024-09-21T01:13:35.299505+0000 (oldest deadline 2024-09-21T01:14:01.199264+0000) 2024-09-21T01:14:19.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:19 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:19.577+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6814 osd.1 since back 2024-09-21T01:13:46.801327+0000 front 2024-09-21T01:13:46.801309+0000 (oldest deadline 2024-09-21T01:14:08.501223+0000) 2024-09-21T01:14:19.909 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:19 smithi187 ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5[95567]: 2024-09-21T01:14:19.577+0000 7f3f9ecb4640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.112:6822 osd.2 since back 2024-09-21T01:13:54.902813+0000 front 2024-09-21T01:13:54.902839+0000 (oldest deadline 2024-09-21T01:14:18.402560+0000) 2024-09-21T01:14:20.247 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:19 smithi187 podman[111837]: 2024-09-21 01:14:19.953488361 +0000 UTC m=+5.449675603 container died 5c353aaf7054780237ed18cb5894bd3c8f4e9d3438e3889aac429a9baa196106 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:14:20.605 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:20 smithi187 podman[111837]: 2024-09-21 01:14:20.337437231 +0000 UTC m=+5.833624462 container cleanup 5c353aaf7054780237ed18cb5894bd3c8f4e9d3438e3889aac429a9baa196106 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T01:14:20.605 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:20 smithi187 bash[111837]: ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5 2024-09-21T01:14:20.908 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:20 smithi187 podman[111852]: 2024-09-21 01:14:20.605190798 +0000 UTC m=+0.645616146 container remove 5c353aaf7054780237ed18cb5894bd3c8f4e9d3438e3889aac429a9baa196106 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T01:14:21.289 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:20 smithi187 podman[111942]: 2024-09-21 01:14:20.835075354 +0000 UTC m=+0.015403493 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:14:21.289 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:20 smithi187 podman[111942]: 2024-09-21 01:14:20.947876052 +0000 UTC m=+0.128204229 container create bb44b8c9de8272135d3a0659e34688f7d70cb0fd01712663befa6471a8fca8c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T01:14:21.289 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:21 smithi187 podman[111942]: 2024-09-21 01:14:21.175251439 +0000 UTC m=+0.355579578 container init bb44b8c9de8272135d3a0659e34688f7d70cb0fd01712663befa6471a8fca8c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:14:21.289 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:21 smithi187 podman[111942]: 2024-09-21 01:14:21.178558099 +0000 UTC m=+0.358886241 container start bb44b8c9de8272135d3a0659e34688f7d70cb0fd01712663befa6471a8fca8c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:14:21.289 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:21 smithi187 podman[111942]: 2024-09-21 01:14:21.288850626 +0000 UTC m=+0.469178772 container attach bb44b8c9de8272135d3a0659e34688f7d70cb0fd01712663befa6471a8fca8c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T01:14:21.659 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 01:14:21 smithi187 podman[111942]: 2024-09-21 01:14:21.365025528 +0000 UTC m=+0.545353665 container died bb44b8c9de8272135d3a0659e34688f7d70cb0fd01712663befa6471a8fca8c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:14:21.970 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ede6b7bc-77b2-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T01:14:22.007 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:14:22.007 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T01:14:22.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:14:22.209 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:14:26.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[76913]: fuse finished with error 0 and tester_r 0 2024-09-21T01:14:46.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:14:47.009 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:14:59.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:14:59.912 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:14:59.939 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T01:14:59.941 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343/remote/smithi112/crash 2024-09-21T01:14:59.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:14:59.979 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:14:59.979 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:14:59.981 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343/remote/smithi187/crash 2024-09-21T01:14:59.981 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:15:00.009 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /var/lib/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:15:00.009 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:15:00.010 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T01:15:00.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T01:15:00.056 INFO:tasks.cephadm:Compressing logs... 2024-09-21T01:15:00.057 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:15:00.099 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:15:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T01:15:00.122 INFO:teuthology.orchestra.run.smithi112.stderr:: No such file or directory 2024-09-21T01:15:00.123 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi112.ngfvvg.log 2024-09-21T01:15:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T01:15:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi112.ngfvvg.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi112.yntrjn.log 2024-09-21T01:15:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:15:00.124 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:15:00.126 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi112.yntrjn.log: /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:15:00.126 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T01:15:00.126 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:15:00.126 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.2.log: 86.6% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:15:00.127 INFO:teuthology.orchestra.run.smithi187.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi187.osicpg.log 2024-09-21T01:15:00.127 INFO:teuthology.orchestra.run.smithi187.stderr:: No such file or directory 2024-09-21T01:15:00.127 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:15:00.128 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi187.osicpg.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T01:15:00.128 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:15:00.128 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:15:00.130 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi187.log 2024-09-21T01:15:00.130 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log: -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mgr.smithi187.hpbgni.log 2024-09-21T01:15:00.130 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi187.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T01:15:00.130 INFO:teuthology.orchestra.run.smithi187.stderr: 85.1% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:15:00.131 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mgr.smithi187.hpbgni.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:15:00.131 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.5.log: 94.1% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi187.log.gz 2024-09-21T01:15:00.131 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mon.smithi187.log 2024-09-21T01:15:00.131 INFO:teuthology.orchestra.run.smithi112.stderr: 91.5% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:15:00.132 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.log: 91.6% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:15:00.132 INFO:teuthology.orchestra.run.smithi187.stderr: 88.6% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:15:00.139 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi112.log 2024-09-21T01:15:00.139 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mgr.smithi112.fzmyfw.log 2024-09-21T01:15:00.140 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi187.cdcgvm.log 2024-09-21T01:15:00.140 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mon.smithi187.log: gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T01:15:00.142 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi112.log: 94.0% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi112.log.gz 2024-09-21T01:15:00.142 INFO:teuthology.orchestra.run.smithi112.stderr: 88.6% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:15:00.142 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mon.smithi112.log 2024-09-21T01:15:00.143 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mgr.smithi112.fzmyfw.log: /var/log/ceph/ceph-client.0.log 2024-09-21T01:15:00.144 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi187.cdcgvm.log: 91.1% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:15:00.145 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-21T01:15:00.146 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mon.smithi112.log: 91.2% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:15:00.147 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:15:00.156 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:15:00.178 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:15:00.181 INFO:teuthology.orchestra.run.smithi187.stderr: 89.3% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mgr.smithi187.hpbgni.log.gz 2024-09-21T01:15:00.251 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:15:00.557 INFO:teuthology.orchestra.run.smithi112.stderr: 89.5% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mgr.smithi112.fzmyfw.log.gz 2024-09-21T01:15:00.642 INFO:teuthology.orchestra.run.smithi187.stderr: 92.4% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mon.smithi187.log.gz 2024-09-21T01:15:01.409 INFO:teuthology.orchestra.run.smithi112.stderr: 90.4% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mon.smithi112.log.gz 2024-09-21T01:15:04.561 INFO:teuthology.orchestra.run.smithi112.stderr: 93.7% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T01:15:05.367 INFO:teuthology.orchestra.run.smithi187.stderr: 93.8% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T01:15:05.733 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T01:15:06.735 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T01:15:06.982 INFO:teuthology.orchestra.run.smithi187.stderr: 94.9% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi187.cdcgvm.log.gz 2024-09-21T01:15:07.095 INFO:teuthology.orchestra.run.smithi187.stderr: 93.8% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T01:15:07.783 INFO:teuthology.orchestra.run.smithi187.stderr: 93.8% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T01:15:07.975 INFO:teuthology.orchestra.run.smithi112.stderr: 94.9% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi112.yntrjn.log.gz 2024-09-21T01:15:08.109 INFO:teuthology.orchestra.run.smithi187.stderr: 94.9% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi187.osicpg.log.gz 2024-09-21T01:15:14.452 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-21T01:15:14.453 INFO:teuthology.orchestra.run.smithi187.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-21T01:15:14.454 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-09-21T01:15:14.454 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m14.340s 2024-09-21T01:15:14.455 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m48.007s 2024-09-21T01:15:14.455 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m1.437s 2024-09-21T01:15:15.494 INFO:teuthology.orchestra.run.smithi112.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T01:16:39.898 INFO:teuthology.orchestra.run.smithi112.stderr: 92.8% -- replaced with /var/log/ceph/ede6b7bc-77b2-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi112.ngfvvg.log.gz 2024-09-21T01:16:39.900 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-21T01:16:39.900 INFO:teuthology.orchestra.run.smithi112.stderr:real 1m39.788s 2024-09-21T01:16:39.900 INFO:teuthology.orchestra.run.smithi112.stderr:user 2m16.631s 2024-09-21T01:16:39.901 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m4.416s 2024-09-21T01:16:39.901 INFO:tasks.cephadm:Archiving logs... 2024-09-21T01:16:39.901 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343/remote/smithi112/log 2024-09-21T01:16:39.902 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:16:59.282 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343/remote/smithi187/log 2024-09-21T01:16:59.283 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:17:04.745 INFO:tasks.cephadm:Removing cluster... 2024-09-21T01:17:04.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 --force 2024-09-21T01:17:04.946 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:17:05.341 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ede6b7bc-77b2-11ef-baf5-efdc52797490 --force 2024-09-21T01:17:05.544 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: ede6b7bc-77b2-11ef-baf5-efdc52797490 2024-09-21T01:17:05.838 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T01:17:05.839 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:17:05.856 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:17:05.872 INFO:tasks.cephadm:Teardown complete 2024-09-21T01:17:05.873 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T01:17:06.170 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T01:17:06.171 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T01:17:06.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:17:06.175 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:17:06.254 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T01:17:06.609 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T01:17:06.610 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:17:06.613 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:17:06.628 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:17:06.629 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:17:06.633 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:17:06.633 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-09-21T01:17:06.633 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 +379us[ +378us] +/- 35ms 2024-09-21T01:17:06.634 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -1154us[-1154us] +/- 62ms 2024-09-21T01:17:06.634 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +597us[ +597us] +/- 67ms 2024-09-21T01:17:06.634 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:17:06.635 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:17:06.635 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-21T01:17:06.635 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +376us[ +387us] +/- 35ms 2024-09-21T01:17:06.635 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1156us[-1156us] +/- 62ms 2024-09-21T01:17:06.635 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +638us[ +638us] +/- 67ms 2024-09-21T01:17:06.636 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:17:06.636 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T01:17:06.809 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T01:17:06.809 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T01:17:06.894 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:17:06.983 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:17:07.059 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:17:07.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:07.091 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:17:07.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:07.119 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T01:17:07.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T01:17:07.165 INFO:teuthology.task.internal:Duration was 2192.062720 seconds 2024-09-21T01:17:07.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T01:17:07.178 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T01:17:07.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:17:07.181 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:17:07.220 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:17:07.220 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:17:07.549 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T01:17:07.549 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T01:17:07.549 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:17:07.610 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-09-21T01:17:07.610 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:17:07.632 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T01:17:07.632 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:17:07.652 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:17:07.699 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T01:17:07.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:17:07.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:17:08.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T01:17:08.376 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T01:17:08.376 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:17:08.401 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:17:08.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T01:17:08.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.446 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.466 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-21T01:17:08.491 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-09-21T01:17:08.536 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:08.551 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:17:08.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:08.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T01:17:08.603 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T01:17:08.604 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343/remote/smithi112 2024-09-21T01:17:08.604 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:17:08.653 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913343/remote/smithi187 2024-09-21T01:17:08.654 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:17:08.690 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T01:17:08.691 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:17:08.693 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:17:08.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T01:17:08.753 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T01:17:08.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T01:17:08.766 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T01:17:08.766 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:17:08.768 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:17:08.780 INFO:teuthology.orchestra.run.smithi112.stdout: 262169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 21 01:17 /home/ubuntu/cephtest 2024-09-21T01:17:08.781 INFO:teuthology.orchestra.run.smithi112.stdout: 526553 4 d--------- 2 ubuntu ubuntu 4096 Sep 21 00:54 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:17:08.781 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-21T01:17:08.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:17:08.782 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-21T01:17:08.783 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi112 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-21T01:17:08.783 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T01:17:08.796 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T01:17:08.810 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T01:17:08.813 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2192.062720298767 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-09-21T01:17:08.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:17:08.901 INFO:teuthology.run:FAIL